Is it true in a saved search if you turn on "SEND EMAIL ALERTS WHEN RECORDS ARE CREATED/UPDATED" it wont email you when a record is created?

I've had odd behaviours with this feature - maybe it's not odd, just that I am not 100% sure how this works, but I feel sometimes it sends the alert, but in most instances it doesn't!