I would try creating a Saved Search to export the definitions of ALL your current Assemblies with their Member Items, export to XLS/CSV. From the export file you remove the labor/overhead lines items, and then reimport the member items.
It'll be fairly involved if you haven't done an export/import like that, but I'd recommend doing it for one single item to get the format and test process. Once you can do it for one assembly, you should be able to do it for all in one import. Perfect sandbox project.
An important piece is that when you reimport the Member Items into their parent Assemblies, you want to check the box for "Overwrite Sublists", otherwise it'll write the lines items over the existing ones without removing the lines you're trying to remove. And make sure you export ALL the member items fields so they all come in exactly the same (but minus labor line items).