personally, I use 100k lines as a rough cutoff, if it's less, 4 or less csv files seems easier, if it's more, I like a schedules script and/or map reduce (disclaimer, I'm quite comfortable with excel)