It seems that in an 2020.1 environment, only items that have associated a commerce category are displayed on the webstore, even if that box is ticket

There are a bunch of settings in setup > sca > set up website that do nothing, and are leftover vestiges from site builder. It's not documented anywhere for some reason. Sounds like this might be one of them