Forum Speed.

[Dishmop]

Is it my computer or has there been several periods when the foum server is on a go slow....which might account for several duplicate posts perhaps...

 

[BKF Admin]

Its the server,we had a couple of robots crawling the site that got stuck.

Should speed up again now.

 

[Dishmop]

Its the server,we had a couple of robots crawling the site that got stuck.

Should speed up again now.

Too much honey I guess..

 

[Mammoth]

we had a couple of robots crawling the site that got stuck

RAID kills crawling bugs

No seriously, you can use no robots META tags to stop those pesky things crawling certain pages or links. Not everything needs crawling.

Take a peek at tools dot seobook dot com/robots-txt/


Easier still, set a crawl delay, so the crawl occurs in the wee small hours (GMT of course).

Cheers

 

[BKF Admin]

Thanks Mammoth,that is really helpful.