[gopher] (no subject)
Cameron Kaiser
spectre at floodgap.com
Wed May 18 12:32:49 UTC 2011
> > That someone is probably a web robot. I've had a few go-rounds with the
> > proprietor of gopherproxy.org when I temporarily blocked it for DOSing the
> > Twitter->gopher gateway after causing it to exceed its rate limit.
>
> The problem is it seems to be using some old cached info about the site, I
> see tons of access to files with the wrong type selector and to mboxs in
> the old umn gopherd style with R (subrange from file Rstart-end-).
Right, that's why I suspect it's a web robot checking old links out. The
real hell of it is it's going to do it forever, because the gopherproxy will
never return a 404. And this is another reason we don't want web robots
crawling proxies.
--
------------------------------------ personal: http://www.cameronkaiser.com/ --
Cameron Kaiser * Floodgap Systems * www.floodgap.com * ckaiser at floodgap.com
-- The only thing to fear is fearlessness -- R. E. M. -------------------------
More information about the Gopher-Project
mailing list