What is the most efficient (ie. fastest) method fo...
# suitescripte
Emanuel V
10/09/2023, 1:15 AMWhat is the most efficient (ie. fastest) method for updating a single field across multiple records of a given type, say 10000-50000 item records? The basic example seems to be a full record load then save for each update, which seems like a slow, inefficenct method. More advanced methods involve map/reduce to run updates concurrently, but essentially uses the same load/save paradigm. Just wondering if there is some suitescript construct that I am missing.
m
michoel
10/09/2023, 1:27 AMa
Anthony OConnor
10/09/2023, 1:29 AMprobably just want to use a CSV import for something like that tbh
m
michoel
10/09/2023, 1:33 AMFor use via SuiteScript you can create a file and then trigger the CSV import with N/task
👍 1
michoel
10/09/2023, 1:33 AMIt would be interesting to compare performance of CSV import vs a Map/Reduce with submitFields
michoel
10/09/2023, 1:34 AMYou can also try integrator.io (Celigo)'s data loader
a
Anthony OConnor
10/09/2023, 1:47 AMCSV wins
Anthony OConnor
10/09/2023, 1:48 AMi guess it depends how much concurrency you use, and if you're prepared to use all 5 CSV import jobs concurrently
Anthony OConnor
10/09/2023, 1:49 AMi dont remember exactly the details but i coworker tested it and CSV won
m
michoel
10/09/2023, 1:49 AMAnd if you run scripts/workflows on CSV Import
a
Anthony OConnor
10/09/2023, 1:50 AMwell that would depend if you need them to run or not, if you dont then you turn them off... if you do then submitFields may not work cos any XEDIT wont have all the fields available to do what the script wants to do
Anthony OConnor
10/09/2023, 1:51 AMactually aftersubmits shouldn't matter for performance
d
David B
10/09/2023, 1:54 AMwhat about inline editing the records via a custom record as parent?
did this for custom record children, about 500 per parent. Took the "update all the records" portion of the MR from a couple of hours to a few minutes (8k records total?)
David B
10/09/2023, 1:55 AMrequires some setup, as all the "children" records have to have their parent set first.
And not sure if the performance would translate if the children weren't custom records
a
Anthony OConnor
10/09/2023, 1:56 AMyeah situationally that very nice, but as you point out it has some limitations
Anthony OConnor
10/09/2023, 1:56 AMit really just depends on your needs and the size of your data
👍 1
m
michoel
10/09/2023, 2:04 AM@David B I don't think this is possible if the child record isn't a custom record
d
David B
10/09/2023, 2:04 AMgood to know
t
Tyn Guardian
10/09/2023, 2:50 AMYou can try mass update
☝🏻 1
☝️ 1
d
David B
10/09/2023, 2:53 AMthanks for digging that one out Michoel, can't get much more official then having battk say it's not possible 😅
2 Views