Is it just my personal Slack settings or is anyone else getting alerted of a new post when it's just a user joining the channel?

It's not just you. A bit much for a workspace this size I think.

I just noticed it recently however. Someone new joining a channel didn't constitute as a notification before

I believe there is an administrator-level setting to toggle this off, or so the AI seems to think.