Hmm ok, I've never done a map reduce. I'll look into it. Will I be able to do it in one go with map reduce?
j
jmacdonald
12/03/2018, 11:02 AM
Yeah a map/reduce should handle this easily, in your get input data stage you're going to want to create an array of csv lines. Should be easy with the file module