For raising PO's, is it possible to control which vendors have tax on their vendor record? Or can that only be done on the Item record?

Shouldnt your vendors have a tax item on the master? You can select a zero rate code there. Also could be on Subsidiary relationship record for a Per Sub selection

note also tax schedule in the Item record is a factor