[gopher] A little Gopher crawler

[James Mills]

Hi All and Kim (author of Gophernicus!),

I wrote this little cralwer today:
https://gist.github.com/b781e02b0299fef1f3f6

I'm a bit disappointed in performance though of crawling my local
Gopehrspace (basically via localhost):

prologic at daisy
Mon Dec 15 15:13:08
~/tmp
$ time ./gspider.py &> index

real 5m27.825s
user 0m6.126s
sys 0m5.825s

prologic at daisy
Mon Dec 15 15:18:51
~/tmp
$ wc -l index
355 index

Any comments? :)

cheers
James

James Mills / prologic

E: prologic at shortcircuit.net.au
W: prologic.shortcircuit.net.au
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/gopher-project/attachments/20141215/238f41b5/attachment.html>