if I upload a bunch of JEs with a csv import - am I able to quickly delete the JE's created with that import somehow?

Maybe you can explore mass delete using a saved search of those created JEs. Haven't tried though. But might be an option.