[gopher] [GOGOPH] Starting crawler
Damien Carol
damien.carol at gmail.com
Wed May 2 15:23:05 UTC 2012
Hello gopherspace,
I will soon start crawling of gopherspace with my new crawler.
I want to start it every weeks at sunday.
The crawler will not send request more than 1 per second.
Please say me if that's correct for you all.
The crawler only get Menu / Text nodes currently. I don't think it will be
too much overload.
I'm waiting your feedbacks.
Regards,
Damien CAROL
ps: you can already test the search engine at :
gopher://dams.zapto.org/1/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/gopher-project/attachments/20120502/46dd799b/attachment.html>
More information about the Gopher-Project
mailing list