# Implementing robots.txt for my existing site within RW 8.7

**URL:** <https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040>\
**Category:** RapidWeaver Classic\
**Created:** [December 3, 2020, 4:12pm UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040 "2020-12-03T16:12:57Z")\
**Posts on this page:** 5\
**Page:** 2

<div class="post-metadata">

**Author:** ![forbesrodney](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/forbesrodney/32/20067_2.png) [@forbesrodney](https://forums.realmacsoftware.com/u/forbesrodney)\
**Post date:** [December 4, 2020, 7:24pm UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040/21 "2020-12-04T19:24:52Z")

</div>

Good to know.

---

<div class="post-metadata">

**Author:** ![Vlask0vec2020](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/vlask0vec2020/32/21036_2.png) [@Vlask0vec2020](https://forums.realmacsoftware.com/u/Vlask0vec2020)\
**Post date:** [December 4, 2020, 9:22pm UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040/22 "2020-12-04T21:22:50Z")

</div>

Oops…Thanx Rodney. It was wrong. Devil in the details and all that. Draft was unchecked and so was show in navigation -good, file was not “robots.txt.”, folder was “code” not “/” . We live in hope, ha. Just in case here is the screen capture.  
Will undertake analysis soon.  
R

 ![Screen Shot 2020-12-04 at 10.14.45 PM.png](https://europe1.discourse-cdn.com/flex005/uploads/realmacsoftware1/original/3X/7/0/70990c449a170a00235103b7249b588c72fb0085.png)

---

<div class="post-metadata">

**Author:** ![Vlask0vec2020](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/vlask0vec2020/32/21036_2.png) [@Vlask0vec2020](https://forums.realmacsoftware.com/u/Vlask0vec2020)\
**Post date:** [December 4, 2020, 9:38pm UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040/23 "2020-12-04T21:38:35Z")

</div>

Yes it was off by default for me as well. Oh boy here we go…

---

<div class="post-metadata">

**Author:** ![Panans](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/panans/32/22695_2.png) [@Panans](https://forums.realmacsoftware.com/u/Panans)\
**Post date:** [December 5, 2020, 11:50am UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040/24 "2020-12-05T11:50:51Z")

</div>

There is an add-on that does the job for you: Rapidbot by 4ground ([https://4gnd.com/store/index.php?product/page/39/RapidBot+3](https://4gnd.com/store/index.php?product/page/39/RapidBot+3)). Very easy to allow or disallow certain search engines. Just add a Rapidbot page to your project.

Hans

---

<div class="post-metadata">

**Author:** ![system](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/system/32/25301_2.png) [@system](https://forums.realmacsoftware.com/u/system)\
**Post date:** [January 4, 2021, 9:50pm UTC](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040/25 "2021-01-04T21:50:56Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.

[Previous page](https://forums.realmacsoftware.com/t/implementing-robots-txt-for-my-existing-site-within-rw-8-7/36040.md?page=1)