# RapidWeaver SEO Articles

**URL:** <https://forums.realmacsoftware.com/t/rapidweaver-seo-articles/15848>\
**Category:** RapidWeaver Classic\
**Tags:** seo, rapidweaver\
**Created:** [August 23, 2017, 9:11am UTC](https://forums.realmacsoftware.com/t/rapidweaver-seo-articles/15848 "2017-08-23T09:11:33Z")\
**Posts on this page:** 1\
**Showing post:** 11

<div class="post-metadata">

**Author:** ![teefers](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/teefers/32/8173_2.png) [@teefers](https://forums.realmacsoftware.com/u/teefers)\
**Post date:** [August 24, 2017, 10:16pm UTC](https://forums.realmacsoftware.com/t/rapidweaver-seo-articles/15848/11 "2017-08-24T22:16:38Z")

</div>

robots.txt is a separate file in your root directory.  
We talked about this earlier in the year; you can create one with RW or a text editor:

> [@Locked password store page - robots - to follow or not?](http://forums.realmacsoftware.com/t/locked-password-store-page-robots-to-follow-or-not/11974/11):
>
> Hi Lisa, Sorry I missed your reply on this. Did you get this figured out? I think the problem your having with google flagging the 401 paages is in that it can not read the pages (htaccess blocking them) to see your no index meta tag. Since the store pages are in your navigation (and sitemap) search engines will try to read them. You might want to put a robots.txt file in the top level directory (root) of your site: It is a simple text file must be called: robots.txt musst be placed in t…

**don’t forget to test this!** - A messed up robots.txt file can stop search engines from indexing all or part of your site.

> **[Google Search Console](https://accounts.google.com/v3/signin/identifier?continue=https%3A%2F%2Fwww.google.com%2Fwebmasters%2Ftools%2Frobots-testing-tool&followup=https%3A%2F%2Fwww.google.com%2Fwebmasters%2Ftools%2Frobots-testing-tool&ifkv=ASKXGp0QCBLF4GyEIH3o2bu-1veUkrw4CRfh3kuPzGW5mC5xKWb0UR9VGuL4T94pVDF8i-C7mzInag&passive=1209600&service=sitemaps&flowName=GlifWebSignIn&flowEntry=ServiceLogin&dsh=S-1207327511%3A1707193987313872&theme=glif)**
>
> Use Search Console to monitor Google Search results data for your properties.

---

_[View the full topic](https://forums.realmacsoftware.com/t/rapidweaver-seo-articles/15848)._
