We need to export saved searches on a schedule to ...
# general
j
We need to export saved searches on a schedule to sftp server. It has to be semicolon-separated. Tactical connect does not allow either sftp or semicolon. Any ideas?
f
Pull the search via something like an Airflow (e.g. Cloud Composer) and then use Python to format the data and post to your SFTP server.
w
Write a suitescript. Two options depending on how large the outputs are. 1. Write a scheduled script that submits a search-task. Then add a inbound dependency script that processes the data in the csv into the format you need and then uploads it to an sftp. 2. Write a single scheduled script that runs the search, formats the output and uploads to sftp.
🙌 1
j
Thank you both. @Watz its really large data sets. Shall we go with 1 or 2?
w
I'd say number 1. If the file is larger than 10MB, you need to stream the lines from the original file into a new file if you need to reformat it.