We changed COGS and income account on few items, the open POs that have these items once billed - would they show the new accounts on the GL impact?

Yes. Open SO's will reflect the new accounts upon fulfillment.