# Right to Be Forgotten

**URL:** <https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870>\
**Category:** RapidWeaver Classic\
**Created:** [March 20, 2019, 8:58am UTC](https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870 "2019-03-20T08:58:23Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![mokane99](https://avatars.discourse-cdn.com/v4/letter/m/e8c25b/32.png) [@mokane99](https://forums.realmacsoftware.com/u/mokane99)\
**Post date:** [March 20, 2019, 8:58am UTC](https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870/1 "2019-03-20T08:58:23Z")

</div>

I received a request to add a robots.txt file in order to insure that an individual (who was mentioned in a court case) is not picked up by search engines. Even though this is a public record, he doesn’t have anything to do with the reasons for the case and I do not want to get involved in the extraterritorial application of EU law, so I have agreed to exclude the page from the search engines. It will still be on the court’s web site.

My question concerns the syntax necessary to exclude a page.

The URL facing the public is along the lines of:

[http://mywebsite.com/documents/courtcase.pdf](http://mywebsite.com/documents/courtcase.pdf)

But on the server, the structure is:

/html/mywebsite/documents/courtcase.pdf [note absence of “.com”]

In creating the robots.txt file, you are supposed to begin the URL with a “/”, so which is correct?

(a) /mywebsite.com/documents/courtcase.pdf or  
(b) /html/mywebsite/documents/courtcase.pdf

Server is MediaTemple gridserver, if it makes a difference.

A similar question was asked before on the forum but the links are all dead.

---

<div class="post-metadata">

**Author:** ![NeilUK](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/neiluk/32/23434_2.png) [@NeilUK](https://forums.realmacsoftware.com/u/NeilUK)\
**Post date:** [March 20, 2019, 10:32am UTC](https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870/2 "2019-03-20T10:32:18Z")

</div>

It should be:

```
User-agent: *
Disallow: /documents/courtcase.pdf

```

You can exclude the “User-agent” part if you already have that in your robots.txt file.

---

<div class="post-metadata">

**Author:** ![teefers](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/teefers/32/8173_2.png) [@teefers](https://forums.realmacsoftware.com/u/teefers)\
**Post date:** [March 20, 2019, 12:33pm UTC](https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870/3 "2019-03-20T12:33:19Z")

</div>

You can get pretty complete `robots.txt` file instructions from `google.com` webmasters section. If you hit the next button on the top and bottom of this instructions page you’ll find instructions and a link to **robots Googles tester tool**. It works quite well and is easy to use.

[https://support.google.com/webmasters/answer/6062596?hl=en&ref\_topic=6061961](https://support.google.com/webmasters/answer/6062596?hl=en&ref_topic=6061961)

---

<div class="post-metadata">

**Author:** ![system](https://dub1.discourse-cdn.com/flex005/user_avatar/forums.realmacsoftware.com/system/32/25301_2.png) [@system](https://forums.realmacsoftware.com/u/system)\
**Post date:** [April 19, 2019, 10:33pm UTC](https://forums.realmacsoftware.com/t/right-to-be-forgotten/25870/4 "2019-04-19T22:33:27Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.