If I'm to charge 0.0275% per item on an order to create a total sum for a credit card convenience fee, does that convenience fee need to include tax as well?

Lots of rules surrounding this to include no debit cards can be surcharged. Make sure to look at card association guidelines for surcharges and check the laws for the state(s) your business operates in as some states don’t allow.