Any time that you have a large number of very similar pages then a dynamic database (or maybe static file) driven site is what you need.
Sites like Amazon don’t manually build a new page for each product. They just have a database of their products and a few generic pages that get filled in with the data.
There are tools in RW to build sites like this (I’ll let @joeworkman @Elixir @willwood @yuzool and the others tell you about how to get that done).
That way you could build a single community page (or perhaps a handful) that is filled in with the community data, images, and links from the database. This would hopefully mean a much smaller site that opens in second and publishes in minutes that is much more easily maintained – simply changing, adding, removing data from the database would update your site – perhaps without ever touching RW.
If the idea of an online database is distasteful – and there are really valid reasons that it may be – then a similar system can be built using a “static site generator”. This lets you manage content by simply editing text files on your server. This has all the benefits of a database – but just uses files and folders to do the trick.
Anytime you start doing repetitive tests – especially into the many hundreds of repetitions – and definitely when the file sizes grow over 1GB, it’s time to ask: Is this the right tool for the job? Is there another way to get this done?
Whatever you decide, the next time you have to wait 15 hours to publish your site, perhaps use some of those hours to research ways other ways to accomplish this task. If you post more about the details of your project I’m sure many here would have good ideas to help you on your way.
I don’t normally recommend hiring consultants – I like to think that most projects can be accomplished with a bit of effort – that’s the best part of RapidWeaver. But this sounds like a really big project – with a lot of time invested – perhaps investing a bit of money in hiring a consultant to help re-architect this massive beast into something a bit less beastly. There are lots of good for-hire consultants here on the forum and, in this case it would probably be money well spent.