Bug#884604: devscripts: [uscan] please support hexadecimal encoded URLs

[Michael Banck]

Package: devscripts
Version: 2.15.3+deb8u1
Severity: wishlist

Dear Maintainer,

I have the issue that one of my upstreams is hosted on a GForge
instance, and its download urls are (needlessly I guess) encoding the
filenames in hexadecimal, e.g.:

https://ccpforge.cse.rl.ac.uk/gf/download/frsrelease/574/8924/%64%6c%5f%63%6c%61%73%73%5f%31%2e%31%30%2e%74%61%72%2e%67%7a

The part after 8924/ translates to "dl_class_1.10.tar.gz" which I would
need to furhter mangle to "dl-poly-classic-1.10.tar.gz", but that's
another matter.

I managed to find the correct line (out of many) by doing a pagemangle
on the link text (which contains the filename) and then mangling the URL
back via downloadurlmangle, but uscan refuses to download the URL it
correctly identified as candidate saying

uscan debug: https://ccpforge.cse.rl.ac.uk/gf/download/frsrelease/574/8924/%64%6c%5f%63%6c%61%73%73%5f%31%2e%31%30%2e%74%61%72%2e%67%7a by filenamemangle rule.
uscan warn: Fix filenamemangle to produce a filename with the correct version

The current debian/watch is:

version=4
opts="pagemangle=s/\">dl_class_([\d.]+)\.tar\.gz/dl_class_$1\.tar\.gz\">/,downloadurlmangle=s/dl_class_([\d.]+)\.tar\.gz//,filenamemangle=s/.*dl_class_([\d.]+)\.tar\.gz/dl-poly-classic-$1\.tar\.gz/"
\
https://ccpforge.cse.rl.ac.uk/gf/project/dl_poly_classic/frs/
.*/gf/download/frsrelease/.*

As filenamemangle does not allow for the /e flag (and thus some decoding
regexp like 's/%([A-Fa-f\d]{2})/chr hex $1/eg'), I can't do anything
about the URL currently AFAICT.

So I guess what I would need is some option to tell uscan that the last
part of the URL should be decoded (or maybe it could do that
automatically), from which it could figure out the version.


Michael

-- Package-specific info:

--- /etc/devscripts.conf ---

--- ~/.devscripts ---
DEBSIGN_KEYID=9ED101BF
DEBCHANGE_RELEASE_HEURISTIC=changelog
DEBCOMMIT_STRIP_MESSAGE=no

-- System Information:
Debian Release: 8.9
  APT prefers oldstable
  APT policy: (500, 'oldstable')
Architecture: i386 (i686)

Kernel: Linux 3.16.0-4-686-pae (SMP w/1 CPU core)
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages devscripts depends on:
ii  dpkg-dev     1.17.27
ii  libc6        2.19-18+deb8u10
ii  perl         5.20.2-3+deb8u8
ii  python3      3.4.2-2
pn  python3:any  <none>

Versions of packages devscripts recommends:
ii  at                          3.1.16-1
ii  curl                        7.38.0-4+deb8u5
ii  dctrl-tools                 2.23
pn  debian-keyring              <none>
ii  dput                        0.9.6.4
ii  dupload                     2.7.0
ii  equivs                      2.0.9
ii  fakeroot                    1.20.2-1
ii  file                        1:5.22+15-2+deb8u3
ii  gnupg                       1.4.18-7+deb8u3
pn  libdistro-info-perl         <none>
ii  libencode-locale-perl       1.03-1
pn  libjson-perl                <none>
ii  liblwp-protocol-https-perl  6.06-2
ii  libparse-debcontrol-perl    2.005-4
ii  libsoap-lite-perl           1.11-1
ii  liburi-perl                 1.64-1
ii  libwww-perl                 6.08-1
pn  lintian                     <none>
ii  man-db                      2.7.0.2-5
ii  patch                       2.7.5-1
ii  patchutils                  0.3.3-1
ii  python3-debian              0.1.27
ii  python3-magic               1:5.22+15-2+deb8u3
ii  sensible-utils              0.0.9
ii  strace                      4.9-2
ii  unzip                       6.0-16+deb8u3
ii  wdiff                       1.2.2-1
ii  wget                        1.16-1+deb8u2
ii  xz-utils                    5.1.1alpha+20120614-2+b3

Versions of packages devscripts suggests:
ii  bsd-mailx [mailx]            8.1.2-0.20141216cvs-2
pn  build-essential              <none>
pn  cvs-buildpackage             <none>
pn  debbindiff                   <none>
pn  devscripts-el                <none>
ii  gnuplot                      4.6.6-2
ii  gpgv                         1.4.18-7+deb8u3
ii  libauthen-sasl-perl          2.1600-1
pn  libfile-desktopentry-perl    <none>
ii  libnet-smtp-ssl-perl         1.01-3
ii  libterm-size-perl            0.207-1+b2
ii  libtimedate-perl             2.3000-2
ii  libyaml-syck-perl            1.27-2+b2
ii  mutt                         1.5.23-3
ii  openssh-client [ssh-client]  1:6.7p1-5+deb8u3
ii  svn-buildpackage             0.8.5+nmu1
ii  w3m                          0.5.3-19+deb8u2

-- no debconf information