Hello, I am trying to use third party tool to replicate all the transaction related data in the our internal data lake for analysis. One quick and dirty way to do that is to get get a saved search and download that data using API -- this is painfully slow we have > million records and it took over 12 Hrs to replicate it. we cannot do incremental pulls since we would not get any information on transactions that have been deleted. Another approach would be to get the individual tables and then stich then to make all the transaction (we are primarily interested in all the expense data) however I cannot figure which tables to replicate. We would need all granular details for each transaction (and sub transaction). Ideally would like to be able to do incremental pulls that also provide deletion information. Is it possible to do this with SOAP APIs or is this only possible with Rest APIs

SOAP only supports certain transaction types so I would not recommend using it (since you won't be able to pull all transactions). SuiteQL via REST could work. ODBC also an option. Might depend on how often you are trying to do this

those performance numbers you state sounds more in line with a basic search that returns records instead of an advanced search that returns search columns

Thank you!