depends on how you have taxes set up really. You can specify at the tax group -> item level and it goes to the shipping address if i am not mistaken