[gopher] GopherMole - a gopher media crawler

[Mateusz Viste]

On 01/03/2015 10:40 AM, James Mills wrote:
> You don't have my server (but it's new):
> gopher://daisy.shortcircuit.net.au/ <http://daisy.shortcircuit.net.au/>

Thanks, I've added it right now to the database. Will be spidered very 
soon. That brings us to a gopherspace of 137 active servers today.

 > My only retort to this is that UTF-8
 > drgrades gracefully to ISO-8859-1

Quite untrue. UTF-8 doesn't 'degrade' to anything, unless only low-ascii 
characters are used. Anything else gets encoded into 2,3 or 4 bytes-long 
code points, and these are guaranteed to be misrendered by any client 
unaware of UTF-8.

Mateusz






> On Fri, Jan 2, 2015 at 2:00 AM, Mateusz Viste <mateusz at viste.fr
> <mailto:mateusz at viste.fr>> wrote:
>
>     Hello list,
>
>     Here's a quick update on GopherMole - I worked on it since my last
>     post, and made a few improvements:
>
>       - a 'statistics' page, where one can see some interesting numbers
>       - support for PDF documents (although sadly, not many PDF files in
>     the gopherspace contain proper metadata to identify them)
>       - random searches (as in "give me 10 random mp3 files")
>
>        gopher://gopher.viste.fr/1/__gophermole/
>     <http://gopher.viste.fr/1/gophermole/>
>
>     Interesting fact: my spider arrived to the end of the visible
>     gopherspace, and found out there are 43'575 menus out there, spread
>     over 134 servers. These are definitely not very high numbers.
>
>     I'm curious to know whether the spider missed any servers - the full
>     list is available on gophermole (in the "statistics" menu). If you
>     are a gopher server owner, and see your server is not listed, I'd be
>     happy to know about it!
>
>     cheers,
>     Mateusz
>
>
>
>
>
>     On 12/30/2014 11:13 PM, Mateusz Viste wrote:
>
>         Hi all,
>
>         Here I present GopherMole.
>
>         GopherMole is a project I worked on since some time now, and
>         today is
>         the day when it's ready enough to be put public. It is basically a
>         gopher crawler, but focused on media files, and indexing the actual
>         (meta) content of files, not their menu descriptions.
>
>         It's far from being as polished as I'd like it to be, I will
>         improve it
>         with time. For now, it indexes MP3, OGG and EPUB files. Other
>         formats
>         will come later.
>
>         Finally, here is the URL where you can take GopherMole for a
>         test ride:
>
>         gopher://gopher.viste.fr/1/__gophermole
>         <http://gopher.viste.fr/1/gophermole>
>
>         cheers,
>         Mateusz
>
>
>     _________________________________________________
>     Gopher-Project mailing list
>     Gopher-Project at lists.alioth.__debian.org
>     <mailto:Gopher-Project at lists.alioth.debian.org>
>     http://lists.alioth.debian.__org/cgi-bin/mailman/listinfo/__gopher-project
>     <http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project>
>
>
>
>
> _______________________________________________
> Gopher-Project mailing list
> Gopher-Project at lists.alioth.debian.org
> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
>