I'd probably suggest taking your complex script and modifying it to work as a map reduce script that runs daily.