mrob
10/24/2023, 4:04 PMerictgrubaugh
10/24/2023, 4:58 PMmap
and/or reduce
stages need this Array as well? If not, and it's not too expensive, you could just move the retrieval of the Array to the summarize
stage directly.mrob
10/24/2023, 4:59 PMmrob
10/24/2023, 5:00 PMalien4u
10/24/2023, 6:53 PMconst myVendors = [];
summaryContext.output.iterator().each(function (key, value){
const sVendorId = key;
myVendors.push(sVendorId);
return true;
});
Your reduce could look like this:
reduceContext.write({key: sVendorId, value: ''});
alien4u
10/24/2023, 6:55 PMmrob
10/24/2023, 6:56 PMmrob
10/24/2023, 7:23 PMalien4u
10/24/2023, 7:26 PMmrob
10/24/2023, 7:31 PMalien4u
10/24/2023, 7:55 PMerictgrubaugh
10/24/2023, 7:56 PMreduce
stage instead of summarize
to do the active toggling because summarize
is not parallelizederictgrubaugh
10/24/2023, 7:56 PMgetInputData
and read the file in summarize
mrob
10/24/2023, 7:57 PMerictgrubaugh
10/24/2023, 7:58 PMNElliott
10/25/2023, 7:49 AMmrob
10/25/2023, 3:53 PM