I would definitely second an approach that involve...
# suitescript
e
I would definitely second an approach that involves paging/smaller chunks of the data