Does anyone know if the 'N/task' module is available in a map/reduce script. Trying to chain 2 together.
s
Sandii
05/24/2021, 2:59 PM
It is indeed, I think it might not be availble to use in each stage though. You can definitely use it in the
summarize
👍 1
k
karlenigma
05/24/2021, 2:59 PM
OK good. Before i go and try it lol
karlenigma
05/24/2021, 3:00 PM
Yeah only want it in summarize. No way i want to task 10000's of MR deployments lol
s
scottvonduhn
05/24/2021, 3:35 PM
I use this pattern a lot, actually, chaining multiple M/R scripts together (having the summarize step of script 1 start script 2). It works very well, and avoids potential timing issues if the two were scheduled independently, but the second script needs the first one to have completed before running.
k
karlenigma
05/24/2021, 3:35 PM
Thanks Scott. Yeah just tested and working like a charm!