|
|
|
|
|
|
Welcome to the Australian Ford Forums forum. You are currently viewing our boards as a guest which gives you limited access to view most discussions and inserts advertising. By joining our free community you will have access to post topics, communicate privately with other members, respond to polls, upload content and access many other special features without post based advertising banners. Registration is simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. Please Note: All new registrations go through a manual approval queue to keep spammers out. This is checked twice each day so there will be a delay before your registration is activated. |
|
|||||||
| Site Support If something isn't working or you have a suggestion ( a nice one !! ) let us know here. |
|
|
Thread Tools | Display Modes |
03-06-2021, 12:24 PM
|
#1 | ||
|
Chairman & Administrator
  
Join Date: Dec 2004
Location: 1975
Posts: 107,263
|
Good afternoon.
No, I'm not posting about some exotic 8-legged creature but about the web crawlers that have been hammering this site for the last 5 days or so. These crawlers are ignoring the normal directives that robots are supposed to follow and thus we have several hundred of them crawling the site constantly. The impact is that the server CPU's get maxxed out at 100% and overall performance slows to a (no pun intended) crawl. They can normally be kept at bay by blocking them at the server level but for some reason this doesn't appear to be stopping this lot of Huawei crawlers. There have been problems reported around the world from them so we aren't the only ones being impacted as Huawei try to get their search engine up to the standard of Google as part of their ongoing war with each other. We are working with out ISP to find a solution.
__________________
 Observatio Facta Rotae
|
||
|
|
| 31 users like this post: | 1970XW351, |
Chinese Spiders
Threaded Mode