Yes. This is a downside of an account customization project. SuiteApp projects don't have this downside. With a SuiteApp project, checkout a previous version of your project from source control and deploy it, SDF will update all existing objects and remove any objects that are no longer part of your project. Super cool. If it weren't for the annual dev fee to deploy SuiteApp projects, this would be the way to go.