RapidBot and 4gnd

A few years back, I have purchased a simple plugin called RapidBot from 4gnd (formerly Omniidea). This plugin’s single purpose was to create a robots.txt file. Although I could create that file manually, RapidBot made it easier and prevented typos and/or wrong directory paths.

Unfortunately, RW8 is no longer supported by RapidBot. There is an information on 4gnd’s website, stating that new version for RW8 will be released in September 2018. However, it looks like that has never happened.

@rob – can you give me some kind of indication that this plugin is not abandoned now?

How is this different from SiteMap by YourHead, formerly developed by LogHound?

I do not use SiteMap plugin, but it’s pretty safe to assume that it creates… a site map. If I remember well, YourHead’s SiteMap had a few advantages over the RW’s native sitemap feature, but I do not recall particular differences.

it’s pretty safe to assume that it creates… a site map

Yeah, duh, I guess so.

What are the advantages and/or disadvantages of a robots.text file vs a sitemap?

How do these two work within the context of SEO?

Can you do both?

Thanks for your help. I’m always open to learning something new.

Just found something that may answer your question to @rob /4gnd.

“The /robots.txt standard is not actively developed. See What about further development of /robots.txt? for more discussion.”

Found at The Web Robots Pages

I’d still like to know the difference between a sitemap and a robot.text.

A sitemap:


Basically, a sitemap tells search engines what there is and a robots.txt tells them what to do - or not to do with it.

1 Like

So they are both advantageous for SEO purposes. At least that’s what it seems like.

Yes. They are both advantageous but optional. Your website can function with or without either one. It’s up to you whether to use them or not.

We have just released RapidBot 2.6.0 which supports RapidWeaver 8.


Thanks for the information, Roberto.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.