Hi, our client is running a SEO crawl on their SCA...
# suitecommerce
j
Hi, our client is running a SEO crawl on their SCA site and is being blocked with a 429 error. They have said the 'crawler' is set at its slowest crawl speed. Anyone know a way around this? Thanks
d
I had this happen last month on February 12th -- without any intentional SEO crawlers. I reported the 429 errors to NS support in an urgent ticket. They blamed it on my domain having CloudFlare domain proxy/CDN services, despite the error not originating from CloudFlare (and sure looking like a NetSuite error to me.) The issue went away 20 minutes later and I've been nervous of more 429 "Too Many Requests" returning since then.
d
Hey were you able to figure this out? Its not just about setting the crawler to "slower", but also making sure it isn't recognized as a spammy crawler. IE if they are using ScreamingFrog running from their computer, it is very likely that they won't be able to receive a response. Feel free to reach out