is there a way to prevent a user from seeing inventory on hand for certain locations?

Have you tried to restrict user access to the location? Only issue is the user will have NO access to that location at all. (You'd have to take user's current role and make it custom, and allow access to all locations except the one you dont want them to have access to)

thanks @Kman