It seems that if I use the

FieldDisplayType.HIDDEN

there is no way to display it again, it is kind of weird, I will try to see if there is any property field that could help