Is there a way to mass delete / inactivate customer addresses ?

Since you can't perform a saved search for addresses, the only way to handle this would be via scripting.

Address is a related record available in Customer search and Customer CSV import, so you can export the addresses, then CSV import to mark them as inactive using Address Internal Id as the key.