I think that it's always been this way, since when this checkbox in not checked, the sublist is basically loaded as view only static list without any XML or scripts behind it.