mrob
10/24/2023, 4:04 PMerictgrubaugh
10/24/2023, 4:58 PMmap and/or reduce stages need this Array as well? If not, and it's not too expensive, you could just move the retrieval of the Array to the summarize stage directly.mrob
10/24/2023, 4:59 PMmrob
10/24/2023, 5:00 PMalien4u
10/24/2023, 6:53 PMconst myVendors = [];
summaryContext.output.iterator().each(function (key, value){
const sVendorId = key;
myVendors.push(sVendorId);
return true;
});
Your reduce could look like this:
reduceContext.write({key: sVendorId, value: ''});alien4u
10/24/2023, 6:55 PMmrob
10/24/2023, 6:56 PMmrob
10/24/2023, 7:23 PMalien4u
10/24/2023, 7:26 PMmrob
10/24/2023, 7:31 PMalien4u
10/24/2023, 7:55 PMerictgrubaugh
10/24/2023, 7:56 PMreduce stage instead of summarize to do the active toggling because summarize is not parallelizederictgrubaugh
10/24/2023, 7:56 PMgetInputData and read the file in summarizemrob
10/24/2023, 7:57 PMerictgrubaugh
10/24/2023, 7:58 PMNElliott
10/25/2023, 7:49 AMmrob
10/25/2023, 3:53 PM