That said - I don't think there's a "remove" option from the list outside of field setup.