[gopher] [GOGOPH] Starting crawler

Damien Carol damien.carol at gmail.com
Wed May 2 15:23:05 UTC 2012


Hello gopherspace,

I will soon start crawling of gopherspace with my new crawler.
I want to start it every weeks at sunday.
The crawler will not send request more than 1 per second.

Please say me if that's correct for you all.
The crawler only get Menu / Text nodes currently. I don't think it will be
too much overload.

I'm waiting your feedbacks.

Regards,
Damien CAROL

ps: you can already test the search engine at :
gopher://dams.zapto.org/1/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/gopher-project/attachments/20120502/46dd799b/attachment.html>


More information about the Gopher-Project mailing list