Anyone has a good process of how to monitor a folder for new files to process?

use a scheduled or map reduce script to do a search on the folder and process the files

yeah, that's my process. I would prefer not to have a maximum of 15 minutes delay, but at the same time I don't want to have a scheduledscript/MR running constantly.