# I found this in my robots.txt

**URL:** <https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702>\
**Category:** RapidWeaver Classic\
**Created:** [September 9, 2019, 9:03pm UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702 "2019-09-09T21:03:32Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![kim](https://avatars.discourse-cdn.com/v4/letter/k/9f8e36/32.png) [@kim](https://forums.realmacsoftware.com/u/kim)\
**Post date:** [September 9, 2019, 9:03pm UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/1 "2019-09-09T21:03:33Z")

</div>

I use Rapid Weaver and I am wondering what this is in my robots.txt file???  
Please??

{\rtf1\ansi\ansicpg1252\cocoartf1404\cocoasubrtf470  
{\fonttbl\f0\fmodern\fcharset0 Courier;}  
{\colortbl;\red255\green255\blue255;\red255\green255\blue217;}  
\margl1440\margr1440\vieww10800\viewh8400\viewkind0  
\deftab720  
\pard\pardeftab720\partightenfactor0

\f0\fs24 \cf0 \cb2 \expnd0\expndtw0\kerning0  
User-agent: \*  
Disallow:}

---

<div class="post-metadata">

**Author:** ![teefers](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/teefers/32/8173_2.png) [@teefers](https://forums.realmacsoftware.com/u/teefers)\
**Post date:** [September 9, 2019, 9:54pm UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/2 "2019-09-09T21:54:53Z")

</div>

Don’t know where that came from. Other than part of the last two lines

```auto
User-agent: *
Disallow:

```

It doesn’t even look like good `robots.txt` syntax.  
If you don’t need `robots.txt` file then I would delete it.

more info here:  
[https://support.google.com/webmasters/answer/6062608?hl=en](https://support.google.com/webmasters/answer/6062608?hl=en)

---

<div class="post-metadata">

**Author:** ![MarkSealey](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/marksealey/32/22895_2.png) [@MarkSealey](https://forums.realmacsoftware.com/u/MarkSealey)\
**Post date:** [September 9, 2019, 10:46pm UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/3 "2019-09-09T22:46:04Z")

</div>

kim,

Did you perhaps paste the text which you did want in your robots.txt from a _TextEdit_, _Pages_ - or _Word_ file… it looks as though those lines may be formatting or other metadata?

---

<div class="post-metadata">

**Author:** ![kim](https://avatars.discourse-cdn.com/v4/letter/k/9f8e36/32.png) [@kim](https://forums.realmacsoftware.com/u/kim)\
**Post date:** [September 12, 2019, 4:39am UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/4 "2019-09-12T04:39:40Z")

</div>

Thank you Mark!  
You are spot on!  
Thank you for your help!  
Kim

---

<div class="post-metadata">

**Author:** ![MarkSealey](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/marksealey/32/22895_2.png) [@MarkSealey](https://forums.realmacsoftware.com/u/MarkSealey)\
**Post date:** [September 12, 2019, 5:14pm UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/5 "2019-09-12T17:14:29Z")

</div>

Welcome, Kim! Good luck 🙂

---

<div class="post-metadata">

**Author:** ![system](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/system/32/25301_2.png) [@system](https://forums.realmacsoftware.com/u/system)\
**Post date:** [October 13, 2019, 3:14am UTC](https://forums.realmacsoftware.com/t/i-found-this-in-my-robots-txt/28702/6 "2019-10-13T03:14:32Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.