Everytime I load up a vendor bill for a vendor, it auto-adds and expense line, which appears to be the last expense that vendor used - how can I stop this form happening?

Check if you have a workflow or script to do this

Does the vendor have a "default expense account" on the vendor record?

oh yes you can check that too

Thats it! Defautl Expense Accounts