Hello, I can easily take a flag from map and conditionally enable/disable the code in reduce. , but is it possible to totally skip reduce stage for any particular value, like instead going to reduce it goes back to map with next value.
b
battk
01/07/2021, 2:40 PM
This sounds strange, a map reduce processes all data in map before moving to reduce
battk
01/07/2021, 2:40 PM
And only data written in map moves onto reduce
d
Dan Anderson
01/07/2021, 2:43 PM
I think you could conditionally skip the context.write during the map phase for this or include your flag in the values you write and return early on the reduce phase if it’s present.
s
Sandii
01/07/2021, 2:55 PM
Yeah, not writing down to the reduce is the correct method