what do I need to look for to have my users be able to fulfill a single sales order from multiple locations? Ie. at the time of shipping Select 2 items from location A and 2 from location B?

You need to have the location set at the line level of the sale order.