Hello, looking for some suggestions. We are planning to implement a wide-spread data integration, where several internal applications will be sending some data to NetSuite, but through an intermediate AWS S3 data bucket. We are looking at both Celigo and Boomi as integration platforms. Are there any other good alternatives to consider?

I assume connecting to S3 bucket via sftp is not an option

SFTP may be an option, i'm not sure. I have honestly very little direct experience with S3, so I didn't even know that was an option (I assumed it was all HTTPS access).

you could have a look at workato too. When we had boomi, we were charged per endpoint (which sounds like it would be a lot in your use case). With workato, they charge you per integration "recipe" which can have as many endpoints as you like in it. This worked out better for our use cases across the organisation (it does create a bit of red tape in justifying each new integration process though, and also can mean some anti-patterns to minimise your number of recipes) There is also jitterbit to consider (we weren't that impressed with their initial demo of the software but that was >4 years ago, so it might have moved on since then). I'm sure there are some new players on the scene as well

for SFTP, your company policy should allow and it should be separately enabled for the S3 bucket you'll access

@Jon Kears we actually will have multiple streams of data coming in, but they will all be going to a single endpoint, so the costs may not be too bad. Also, we had the same experience with Jitterbit about 4 or 5 years ago. We actually paid for a year's worth of service, but had so much trouble getting it to work right (simple things like connecting to NetSuite), that we gave up and cancelled it after one year. It left a bad impression with everyone involved, so I don't think we'd consider Jitterbit again. I'll take a look at Workato though, it's always good to have more options. Thanks for the recommendation!

@scottvonduhn Mulesoft

Mulesoft > Boomi

S3 integration can be done using SuiteScript. The caveat is when you’re needing to do wildcard searches and/or moving/copying files.

Go with Boomi @scottvonduhn , Celigo is very limited

Thanks for that advice. We are definitely evaluating Boomi

We ended up ditching boomi and using AWS + Lambda + SQS for most Netsuite integrations

@Nicholas Penree do you use any external libraries to connect to AWS or it is mainly https, sftp modules?

https

we currently use S3 and Lambda. most probably will use more services from AWS in the future.

@Selcuk Dogru We support AWS4 using Cypto.JS

@Nicholas Penree that's very helpful. thanks

Tactical Connect (SuiteApp) sends netsuite searches to S3 buckets. www.tacticalconnect.com

Thanks @Josh_SatoriReporting we are looking almost exclusivelt to go in the other direction. The S3 buckets are just a temporary external storage where files will be staged prior to being imported into NetSuite

I see! Yes, Tactical Connect only extracts the data.