I have been wanting to convert a CSV to Excel in S...
# suitescriptb
borncorp
01/06/2023, 10:55 PMI have been wanting to convert a CSV to Excel in Suitescript for a while. I tried SheetJS but it seems like it needs to load the whole file for processing so there's a size limit of 10MB. I don't see a way to stream it into SheetJS. I was able to figure out a solution but I am curious how everyone else is overcoming that limitation? I might write a blog post about my solution if I find it to be an improvement over others.
👀 1
r
rustyshackles
01/07/2023, 1:45 AMI would be interested in that blog post
✅ 1
b
battk
01/07/2023, 3:19 AMwill probably require some variation of using file iterators or readers to make a giant string, sheet js doesnt do streaming for its input
battk
01/07/2023, 3:20 AMessentially only a synchronous read
battk
01/07/2023, 3:27 AMyou can probably do something like creating the worksheet directly from each line instead of making sheet js parse the giant string
battk
01/07/2023, 3:28 AMthat would make a difference in memory management since you wouldnt have 2 large objects in memory at the same time
m
marth141
01/07/2023, 5:15 AMYou can include minified js in suitescripts??
e
erictgrubaugh
01/07/2023, 3:56 PMSure
erictgrubaugh
01/07/2023, 3:56 PMminified js is still js
erictgrubaugh
01/07/2023, 3:57 PMIt just has to be AMD-compatible
m
marth141
01/07/2023, 3:57 PMAMD compatible?
marth141
01/07/2023, 3:58 PMOh Asynchronous Module Definition.
✅ 1
b
borncorp
01/07/2023, 10:38 PM@battk Yeah, that's pretty much what I ended up doing since I couldn't figure out a way to use SheetJS for those giant files
borncorp
01/07/2023, 10:40 PMMy method still has its limits but I was able to handle a 100 MB file fine
borncorp
01/07/2023, 10:46 PMI'll write a blog post about it later. Thanks everyone for your input!
55 Views