# Dev Best Practices:Testing Site--Avoid Indexing

**URL:** <https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149>\
**Category:** RapidWeaver Classic\
**Created:** [February 10, 2019, 2:51pm UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149 "2019-02-10T14:51:03Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![mokane99](https://avatars.discourse-cdn.com/v4/letter/m/e8c25b/32.png) [@mokane99](https://forums.realmacsoftware.com/u/mokane99)\
**Post date:** [February 10, 2019, 2:51pm UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149/1 "2019-02-10T14:51:03Z")

</div>

Are there any Rapidweaver-specific best practices for website testing? I’m specifically looking for avoiding Google/Bing and other search engines indexing draft and not ready for prime time sites. “Modify your robots.txt” file is a common solution but this has nothing to do with Rapidweaver.

I’ve come across several Wordpress-specific solutions but the site in question has no WP components.

If there is a snippet that would serve the function of preventing indexing before the site should go public, that would help.

---

<div class="post-metadata">

**Author:** ![teefers](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/teefers/32/8173_2.png) [@teefers](https://forums.realmacsoftware.com/u/teefers)\
**Post date:** [February 10, 2019, 3:46pm UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149/2 "2019-02-10T15:46:52Z")

</div>

I don’t know if there’s a “Best Practice”. There’s a number of different ways to prevent indexing.  
If you run a “testing” sub domain I think that makes the blocking of indexing much easier.  
You can place a very generic robots.txt file at the “root” of sub domain. That will stop legitimate crawlers like search engines, however it provides no protection from others not so legitimate traffic both human and not.

You can also add security measures on the sub domain such as an htaccess and **htpasswd** files or a third party security product like pagesafe that will block indexing and everyone else that don’t have login credentials. This approach would be my choice as it also keeps competition out. @ben used to have a video on the htaccess file approach on the community site, but I couldn’t find it, perhaps it’s out on YouTube.

You can also on a page level mark them not to be index. This is built into RapidWeaver, but is the hardest and has the risk of forgetting to remove this before going live. That can quickly ruin your SERP rankings.

---

<div class="post-metadata">

**Author:** ![cabinetmaker](https://avatars.discourse-cdn.com/v4/letter/c/2bfe46/32.png) [@cabinetmaker](https://forums.realmacsoftware.com/u/cabinetmaker)\
**Post date:** [February 28, 2019, 7:55am UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149/3 "2019-02-28T07:55:33Z")

</div>

I have this same question too. I am just marking this post so I can find it again.

---

<div class="post-metadata">

**Author:** ![mokane99](https://avatars.discourse-cdn.com/v4/letter/m/e8c25b/32.png) [@mokane99](https://forums.realmacsoftware.com/u/mokane99)\
**Post date:** [February 28, 2019, 8:28am UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149/4 "2019-02-28T08:28:08Z")

</div>

As it turns out, I had a copy of Pagesafe which I hadn’t used for a while. This stack solved the issue.

---

<div class="post-metadata">

**Author:** ![system](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/system/32/25301_2.png) [@system](https://forums.realmacsoftware.com/u/system)\
**Post date:** [March 30, 2019, 6:28pm UTC](https://forums.realmacsoftware.com/t/dev-best-practices-testing-site-avoid-indexing/25149/5 "2019-03-30T18:28:20Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.