Unfortunately the Employee restriction is pretty limited in functionality. I have found it to work on ANY employee field on any record
Could you make a custom segment or use one of the existing segments (Department, Class Location) to do what you need?
For example if you restrict the Employee by location = Own and Subordinates Only. Then set the location record on transaction but NOT on customers then they could see all customers but only see transactions assigned to their location
Would that work?