dumb question probably, but if I update my custom field internal IDs for a few that I was lazy on and didn't name them, will that break places they are referenced?

Yes