Date:  Sun, 30 Aug 2009 08:32:46 -0700 (PDT)
From:  Dan Kriwitsky <webhosting (at mark) yahoo.com>
Subject:  [coba-e:15962] Re: DFix update
To:  coba-e (at mark) bluequartz.org
Message-Id:  <561910.34542.qm (at mark) web65614.mail.ac4.yahoo.com>
In-Reply-To:  <4A9A6E02.4010108 (at mark) theanchoragesylvania.com>
X-Mail-Count: 15962


>  * DFIX now looks source IP's for any hosts that are
> generating too many "file not founds errors" in your web
> server. These are very often caused by systems that are
> looking for vulnerabilities in your websites.

You might want to look at your error log and whitelist certain search engine bots. Unless you're very careful about things, having a site that changed e.g. from using .html to .php will cause the Googlebot to generate lots of 404 errors and you may not want to block the Googlebot from crawling your site.

-- 
Dan Kriwitsky