Has anyone had to work on an option for doing a fu...
# general
m
Has anyone had to work on an option for doing a full data dump from NetSuite to an outside resource, not using a connector to run queries on, but dump data into something like a data lake? Some context, my current employer was bought up by another company. The new company is very data centric/heavy with doing predictive analytics. They are asking for a complete data dump of what we have in NetSuite to load into their own systems for data analytics. They don't want a connector to a BI system like Power BI, the want a data dump to then import into something like Amazon Redshift.
e
We use the ODBC/JDBC connector (
NetSuite SuiteAnalytics Connect
), then query the tables as any other SQL source. The connector is an extra paid module in NetSuite.
With that, you can do whatever you want in your ETL process.
m
I've brought up the connect feature with ODBC a couple of times, but they keep dismissing it for some reason.
e
ODBC is the "native" connector. The other ones are the third party apps. So... you are left with nothing. Well, you can always use manual saved searches and/or reports > dump to CSV. Titanic quest, slow and unreliable.
m
Titanic is an understatement. I found a way to get a list of all the tables in Netsuite, then with a map/reduce I could run simple select * from table commands to get all of the data, but there's a lot of data. A week of invoices pulls over 100,000 lines which is past the SuiteQL limit since we don't have the connect feature at the moment. I'm really hoping to avoid doing it through saved searches, but I may be out of luck........
a
@Edgar Valdes how is your experience with the suite analytics connect?
e
Our internal Data team uses it heavily, no issues so far. I use it for reports that are easily done with SQL.
a
Are there any performance issues? Like being slow? We are currently using Kingsway and is very slow. We have quite a lot of records
m
@Andreea Barcan My company finally broke down and paid for SuiteAnalytics connect. I've found the performance can really depend on what software you are using with connect. I've connected to it with both Celigo and DataGrip and the performance hasn't been pretty good. I did originally try a program called DBeaver which seemed to run slow with Connect.
a
Thank you for the feedback