Correct, it cannot be accomplished through configuration in the UI. You would need to script the form to add the column to make it visible in the list. (There are some address validation bundles which show custom columns, and this is how they accomplish it)