Has anyone ever attempted to do 'chunking' in a ma...
# suitescriptd
darrenhillconsulting
02/08/2023, 4:37 PMHas anyone ever attempted to do 'chunking' in a map/reduce by using the
mapContext.keymapContext.writedarrenhillconsulting
02/08/2023, 4:43 PMmapContext.write({key: (+mapContext.key % 100), value: 'some value' })darrenhillconsulting
02/08/2023, 4:53 PMeven better
darrenhillconsulting
02/08/2023, 4:54 PMmapContext.write({key: Math.floor (+mapContext.key/100), value: 'some value' })w
Watz
02/08/2023, 5:25 PMDon't see why it shouldn't work. Got any issues with it?
I generate JE-lines in map with all the JE-body data as a stringyfied JSON as the key and let shuffle group them for the reduce stages so all lines with a common body gets grouped together.
s
Shawn Talbert
02/08/2023, 5:27 PMin general this should be pretty common since it's a key feature of the MR model.
Shawn Talbert
02/08/2023, 5:28 PMwhat you use to collect data into reduce is application dependent, but I would think it doesn't matter as long as it fits your use case.
d
darrenhillconsulting
02/08/2023, 8:03 PMFair enough ... great place to bounce off ideas
s
Shawn Talbert
02/08/2023, 8:50 PMspeaking of ideas, I was pondering why your
/1003 Views