Is it possible to prevent editing of Creation Date and Last Modified Date in a child record sublist natively? Or do I have to do this with a script?

Are you saying someone can modify or set those manually? I didn't think that was possible.

It doesn't look like it allows the changes to actually save, but the form itself allows you to change the value

potentially a disabled custom field that uses a formula default value if you are only interested in view