upcoming change on ci.debian.net: log compression

[Antonio Terceiro]

Hello everyone,

To optimize the storage requirements on ci.debian.net, I have just
committed a change to how logs are stored¹. Basically, all logs will now
be compressed with gzip, and therefore all *.log will be renamed to
*.log.gz.

¹ http://anonscm.debian.org/cgit/collab-maint/debci.git/commit/?id=c0416e3e1a2f06864554c2bc9be860ba73421a89

This change will go live in a couple of days.

All links to log files in the web UI were changed. I took special care
to not break any existing URL that might be out there in the wild; to
that effect, the web server configuration was changed so that:

- *.log will be redirected to *.log.gz, if the .log file does not exist
- *.log.gz wil be served with the appropriate HTTP headers so that
  browsers will to the right thing; i.e. the log files will be displayed
  inline in the browser as text/plain, after being decompressed on the
  client -- this will also save everyone some bandwidth².

² for most packages the savings are negligible, but some packages do
  have huge log files (eglibc, looking at you).

If you are doing any type of automated download of log files, you might
want to change your scripts to check whether the response you get is
compressed or not. Fun facts:

- both curl and wget do not handle compressed responses by default.
- curl can be passed the --compressed option, what will make it save the
  decompressed contents of the response. But if you pass --compressed and
  the response is not compressed, it will exit with an error.
- you can test the new behavior with http://ci.debian.net/data/test.log

-- 
Antonio Terceiro <terceiro at debian.org> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: Digital signature
URL: <http://lists.alioth.debian.org/pipermail/autopkgtest-devel/attachments/20141112/3062301b/attachment.sig>