[gopher] [GOGOPH] Starting crawler

David Griffith dave at 661.org
Wed May 2 20:42:08 UTC 2012


On Wed, 2 May 2012, Damien Carol wrote:

> Hello gopherspace,
> 
> I will soon start crawling of gopherspace with my new crawler.
> I want to start it every weeks at sunday.
> The crawler will not send request more than 1 per second.
> 
> Please say me if that's correct for you all.
> The crawler only get Menu / Text nodes currently. I don't think it will be
> too much overload.
> 
> I'm waiting your feedbacks.
> 
> Regards,
> Damien CAROL
> 
> ps: you can already test the search engine at :
> gopher://dams.zapto.org/1/

Could you make it such that typing "gopher dams.zapto.org" at a Unix 
command line will bring up your page?

-- 
David Griffith
dave at 661.org



More information about the Gopher-Project mailing list