upcoming change on ci.debian.net: log compression
terceiro at debian.org
Wed Nov 12 02:43:51 UTC 2014
To optimize the storage requirements on ci.debian.net, I have just
committed a change to how logs are stored¹. Basically, all logs will now
be compressed with gzip, and therefore all *.log will be renamed to
This change will go live in a couple of days.
All links to log files in the web UI were changed. I took special care
to not break any existing URL that might be out there in the wild; to
that effect, the web server configuration was changed so that:
- *.log will be redirected to *.log.gz, if the .log file does not exist
- *.log.gz wil be served with the appropriate HTTP headers so that
browsers will to the right thing; i.e. the log files will be displayed
inline in the browser as text/plain, after being decompressed on the
client -- this will also save everyone some bandwidth².
² for most packages the savings are negligible, but some packages do
have huge log files (eglibc, looking at you).
If you are doing any type of automated download of log files, you might
want to change your scripts to check whether the response you get is
compressed or not. Fun facts:
- both curl and wget do not handle compressed responses by default.
- curl can be passed the --compressed option, what will make it save the
decompressed contents of the response. But if you pass --compressed and
the response is not compressed, it will exit with an error.
- you can test the new behavior with http://ci.debian.net/data/test.log
Antonio Terceiro <terceiro at debian.org>
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 819 bytes
Desc: Digital signature
More information about the autopkgtest-devel