I have often created custom fields for clients on the item record that source the commerce categories for the List/Record. Then I pair this with a script that adds the item to a category when it is selected on the item record. Then, because the item record has a field value of the category I can add that in the Web Site Setup as a facet.
It's a bit of work to get setup, but once its there it works well.