[SAC] Re: [OSGeo] #277: Robots Are Attacking!

OSGeo trac_osgeo at osgeo.org
Tue Jul 29 20:06:15 EDT 2008


#277: Robots Are Attacking!
------------------------+---------------------------------------------------
  Reporter:  warmerdam  |       Owner:  sac at lists.osgeo.org
      Type:  task       |      Status:  new                
  Priority:  normal     |   Component:  SAC                
Resolution:             |    Keywords:  trac               
------------------------+---------------------------------------------------
Comment (by crschmidt):

 Jason:

 What problem are you trying to solve? The 'crawler' causing problems in
 this case was crawling from a comcast internet connection: clearly not one
 of the 'big 3' search spiders, which are typically well behaved, according
 to all of my log-reading and observations.

 Anything that opens 45 different connections to your server at once is
 simply a broken crawler, in my mind, no questions asked.

-- 
Ticket URL: <https://trac.osgeo.org/osgeo/ticket/277#comment:3>
OSGeo <http://www.osgeo.org/>
OSGeo committee and general foundation issue tracker.


More information about the Sac mailing list