Implementing robots.txt for my existing site within RW 8.7

Good to know.

Oops…Thanx Rodney. It was wrong. Devil in the details and all that. Draft was unchecked and so was show in navigation -good, file was not “robots.txt.”, folder was “code” not “/” . We live in hope, ha. Just in case here is the screen capture.
Will undertake analysis soon.
R

Yes it was off by default for me as well. Oh boy here we go…

There is an add-on that does the job for you: Rapidbot by 4ground (https://4gnd.com/store/index.php?product/page/39/RapidBot+3). Very easy to allow or disallow certain search engines. Just add a Rapidbot page to your project.

Hans

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.