Hello, I need to import 3 millions of items in Net...
# suitescript
t
Hello, I need to import 3 millions of items in NetSuite. What's the best way? A CSV file is ok? And having so many items will have an big impact on the general performance in NS ?
g
If you attempt a CSV import you need to know that you can only import 20.000 lines per import. So there is a lot of files you need to upload. Estimate 30 minutes per file. You can queue them and run them during the night. Good luck 🙂 We have done it several times. It is a process easy enough for an intern to complete. The only impact on performance is that you can not run other imports in parallel.
But the general question remains: why would someone have 3million items? Is it actual products or just random records?
Another solution is to import data into a custom record and then run a script that processes the data. Depending on complexity of your data that may be an alternative.
t
Thanks. My client is selling a lot of different items 🙂 I think I'll try to go for a M/R script on a super large CSV file, did you already try? . I was more concern about the general performance of Netsuite for instance when you do a saved search on so many items, or when you have to pick an item in a dropdown list of items, will it take ages?
a
@T_GDB I will go in a different way with this, I think you can create 3 JSON files upload them to the file cabinet and do your import with a Map Reduce Script... the actual lomit for CSV import is 25k per file but you will be doing that forever is going to take an insane amount of time...also splitting 3million in 25k could be time consuming...
t
ok thanks @alien4u.
And actually why 3 JSON files and not 1 ?
a
Because 3 Millions is a lot... if you script break, fail or anything would be more difficult to isolate the problem. Is very unlikely you will be able to import 3 millions without errors... is just probabilities laws... In the other hand I don't know what would be the size for a 3millions JSON, I think there is a limit of 10MB or something for files you can read from script on file cabinet or something like that, I do not remember exactly...