This site was built to compliment the existing NetSuite Professionals Slack Community by adding a means for members to easily find answers to common questions and to create a searchable database of those questions and answers.

NetSuite Professionals

I am trying to add a _robots.txt_ file to our File Cabinet (under Web Site Hosting Files &gt; Live Hosting Files).
But we have multiple domains in this account, associated to 1 website record (ex: <http://domain1.com|domain1.com>, <http://domain2.com|domain2.com>, <http://domain3.com|domain3.com>).
How can I disable crawling for a specific domain (ex: <http://domain1.com|domain1.com>), and still allow crawling for the other domains?
We also have another website record which also needs to have crawling enabled.

As per my understanding so far, once I add a _robots.txt_ file to Live Hosting Files, it will be applied to all SSP Applications (and domains) that run under Live Hosting Files.

Yeah, we typically only allow one shared robots.txt for all web store. If you must have a separate one for another domain then you could create a different file in the same location and then set up a system redirect for it. That should work.

Okay Steve, I’ll try doing that. Thanks. :slightly_smiling_face: