In a Map/Reduce script I need to return a searchOb...
# suitescripte
Edgar Valdes
12/04/2023, 3:00 PMIn a Map/Reduce script I need to return a searchObject.
If there are 30K results, are all of them passed to the next stage? Or do I need to do some pagination?
e
erictgrubaugh
12/04/2023, 3:10 PMIf you're just returning the
Search✅ 1
e
Edgar Valdes
12/04/2023, 3:52 PMAwesome, thanks Eric!
Edgar Valdes
12/04/2023, 3:52 PMI guess there is no equivalent when using N/query 👀
m
Mike Robbins
12/04/2023, 4:12 PMThis SA article implies that you can return an object using suiteQL, but the one time I tried, my getInputData function just hung until it timed out.
Copy code
return {
type: 'suiteql',
query: suiteQL,
params: [271]
};e
Edgar Valdes
12/04/2023, 4:16 PMThanks for the reference Mike
Edgar Valdes
12/04/2023, 4:17 PMI stumbled upon an article from Tim Dietrich, and he uses pagination manually to get all the rows
e
erictgrubaugh
12/04/2023, 4:35 PM^^ This actually worked for me; I wasn't aware of it so thought I'd test it out.
Copy code
define([], () => {
function getInputData() {
return {
type: 'suiteql',
query: 'SELECT * FROM customrecord_sma_config'
}
}
function reduce(context) {
log.debug({ title: 'result=', details: context.values.map(JSON.parse) })
}
return { getInputData, reduce }
});🙌 1
erictgrubaugh
12/04/2023, 4:35 PMLogs results for each record with field values as expected
✅ 1
erictgrubaugh
12/04/2023, 4:50 PMIt's undocumented, so I probably wouldn't rely on this heavily, but it's interesting to know it's possible/in development?
👀 1
e
Edgar Valdes
12/04/2023, 5:51 PMVery interesting!
Edgar Valdes
12/04/2023, 5:52 PMFor my use case it is crucial that all the rows are returned, because each line is an item for an invoice. Some invoices have 2 or 3 items, so I group them in the map stage, and create the invoice in the reduce stage. Missing results in the query would result in inaccurate invoices.
w
Watz
12/04/2023, 6:03 PMBeen using suiteql-query as getinput pretty often. Have not had any issues with it.
The SA article is part of the documentation, so I'm considering it documented. https://docs.oracle.com/en/cloud/saas/netsuite/ns-online-help/section_158039627694.html
e
erictgrubaugh
12/04/2023, 6:05 PMOh interesting. Seems like a gap in the docs for
getInputDataw
Watz
12/04/2023, 6:07 PMDefinitely! Everyone should comment that help section. 😀
✅ 2
s
Shawn Talbert
12/04/2023, 6:11 PMYes, all the rows will get sent to
mapmapgetInputData()Shawn Talbert
12/04/2023, 6:13 PMFor this reason, MR scripts are no better than Scheduled Scripts if you have a search that times out; the search timeout error will happen prior to any
mapw
Watz
12/04/2023, 6:16 PMWhat kind of timeouts have you encountered in getInputData? I think I've seen getInputData's that have been running for almost an hour using a search.
s
Shawn Talbert
12/04/2023, 6:19 PMI don't remember the exact time limit - it's whatever amount of time it takes for NS to throw the timeout error 🙂
Shawn Talbert
12/04/2023, 6:59 PMI did just find a note I had that says getInputData has a 60 minute time limit.
👍 2
Shawn Talbert
12/04/2023, 7:00 PMThat's perhaps separate from the search timeout error that can be thrown in various script types, but perhaps the limits happen to be 60?
w
Watz
12/04/2023, 7:01 PM16 Views