[gopher] presentation of the 2007 gopherspace crawl

[Damien Carol]

If you make a crawler, try to use "robots.txt" files.

2012/4/26 Wolfgang Faust <wolfgangmcq at gmail.com>

> Those other versions are retrieved when the proxy is used and stored on
> the server. At some point I'm also going to get a crawler working. The
> interface is a lot of kludged-together PHP code, which really needs to get
> cleaned up.
>
>
> On Thu, Apr 26, 2012 at 4:29 AM, Florian Voigt <flvoigt at gmail.com> wrote:
>
>> Looks great. I see you're offering other version besides the 2007
>> archive. Where did you get those from? Also, can you share a little
>> more detail on how you put this together?
>>
>> -Florian
>>
>>
>>
>> On Thu, Apr 19, 2012 at 7:33 PM, Wolfgang Faust <wolfgangmcq at gmail.com>
>> wrote:
>> > I'm working on an HTTP interface myself. See:
>> > http://gopher-project:gpa-test-786@gpa.internetearth.com/
>> > I'll be fixing some bugs and adding a few improvements sometime this
>> month.
>> >
>> >
>> > On Thu, Apr 19, 2012 at 10:37 AM, Kim Holviala <kim at holviala.com>
>> wrote:
>> >>
>> >> On Apr 18, 2012, at 11:37 , Florian Voigt wrote:
>> >>
>> >> > do you think it would be possible to present the 2007 gopherspace
>> >> > crawl in a similar way that http://olduse.net - i.e. in a way that
>> >> > makes it possible for users to "explorer" gopherspace in a way it was
>> >> > back then? (Using the same front ends, etc.)
>> >>
>> >> gopher://gophernicus.org/
>> >>
>> >> And then "Browse the gopher archive". I've had that up and running for
>> a
>> >> few years now.... It's not the full 2007 archive, I think I've got
>> maybe 80%
>> >> of it imported in there + lots of more recent stuff.
>> >>
>> >>
>> >>
>> >> Kim
>> >>
>> >>
>> >>
>> >> _______________________________________________
>> >> Gopher-Project mailing list
>> >> Gopher-Project at lists.alioth.debian.org
>> >> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
>> >
>> >
>> >
>> >
>> > --
>> > 01010111 01101111 01101100 01100110
>> >
>> > _______________________________________________
>> > Gopher-Project mailing list
>> > Gopher-Project at lists.alioth.debian.org
>> > http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
>>
>> _______________________________________________
>> Gopher-Project mailing list
>> Gopher-Project at lists.alioth.debian.org
>> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
>>
>
>
>
> --
> 01010111 01101111 01101100 01100110
>
> _______________________________________________
> Gopher-Project mailing list
> Gopher-Project at lists.alioth.debian.org
> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/gopher-project
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/gopher-project/attachments/20120426/32176bde/attachment.html>