[php-maint] 5.3.1-4 failing testcases summary

[sean finney]

now that everything's built on all arches, i figure it's prudent to
review the rest of the failing test cases.  i mget'd the debs for each
arch and did a little shell-fu plus some sed/grep/cut/sort/uniq and got
it crammed into an sqlite3 database file.   some interesting results:

sqlite> select arch,count(*) as failures from tests group by arch order by failures desc;
hurd-i386|71
kfreebsd-amd64|46
armel|40
i386|37
amd64|36
ia64|36
kfreebsd-i386|36
alpha|31
powerpc|28
hppa|26
s390|26

also interesting is the output of

sqlite> select testcase,group_concat(arch) from tests group by testcase order by count(testcase);

(see [1])

so, quite the spread there.  and, from my initial poking it seems that we're
not dealing with strictly contained subsets either (i.e. passing armel tests failing
on amd64, etc).  if anyone is interested i'll attach the sqlite db file and the
extracted test-results files can be found at[2].

i'm going to see about setting up a debug build on an armel system and
start there, since it's the highest linux-based arch in the failure count
(and because we know that we had issues on it previously).

any other volunteers to help out? :)


	sean

[1]
Zend/tests/bug44069.phpt|armel
Zend/tests/int_overflow_64bit.phpt|ia64
ext/hash/tests/hash_copy_001.phpt|armel
ext/hash/tests/hash_file_basic1.phpt|armel
ext/hash/tests/hash_hmac_basic.phpt|armel
ext/hash/tests/hash_hmac_file_basic.phpt|armel
ext/hash/tests/mhash_001.phpt|armel
ext/hash/tests/mhash_003.phpt|armel
ext/hash/tests/tiger.phpt|armel
ext/mbstring/tests/bug45923.phpt|armel
ext/pcre/tests/bug47662.phpt|hurd-i386
ext/phar/tests/tar/phar_setsignaturealgo2.phpt|kfreebsd-i386
ext/posix/tests/posix_access_safemode.phpt|ia64
ext/posix/tests/posix_errno_variation1.phpt|hurd-i386
ext/posix/tests/posix_mkfifo_safemode.phpt|ia64
ext/session/tests/session_save_path_variation2.phpt|hurd-i386
ext/session/tests/session_save_path_variation3.phpt|hurd-i386
ext/sockets/tests/socket_create_listen-nobind.phpt|hurd-i386
ext/sockets/tests/socket_create_pair-wrongparams.phpt|hurd-i386
ext/sockets/tests/socket_getpeername_ipv4loop.phpt|hurd-i386
ext/sockets/tests/socket_listen-wrongparams.phpt|hurd-i386
ext/sockets/tests/socket_read_params.phpt|hurd-i386
ext/sockets/tests/socket_select-wrongparams-1.phpt|hurd-i386
ext/sockets/tests/socket_sentto_recvfrom_ipv6_udp.phpt|i386
ext/sockets/tests/unixloop.phpt|hurd-i386
ext/standard/tests/file/006_error.phpt|ia64
ext/standard/tests/file/lstat_stat_basic.phpt|hurd-i386
ext/standard/tests/file/rename_variation.phpt|hurd-i386
ext/standard/tests/file/symlink_link_linkinfo_is_link_variation8.phpt|hurd-i386
ext/standard/tests/file/unlink_variation8.phpt|hurd-i386
ext/standard/tests/general_functions/bug39322.phpt|hurd-i386
ext/standard/tests/general_functions/proc_nice_variation5.phpt|hurd-i386
ext/standard/tests/math/decbin_variation1_64bit.phpt|ia64
ext/standard/tests/math/dechex_variation1_64bit.phpt|ia64
ext/standard/tests/math/decoct_variation1_64bit.phpt|ia64
ext/standard/tests/misc/time_nanosleep_error4.phpt|hurd-i386
ext/standard/tests/misc/time_nanosleep_error5.phpt|hurd-i386
ext/standard/tests/misc/time_sleep_until_basic.phpt|powerpc
ext/standard/tests/network/gethostbyname_basic002.phpt|i386
ext/standard/tests/network/gethostbyname_error004.phpt|i386
ext/standard/tests/network/getmxrr.phpt|i386
ext/standard/tests/network/http-stream.phpt|i386
ext/standard/tests/network/udgloop.phpt|hurd-i386
ext/standard/tests/network/unixloop.phpt|hurd-i386
ext/standard/tests/strings/strripos.phpt|armel
ext/standard/tests/strings/strripos_basic2.phpt|armel
ext/standard/tests/strings/strripos_variation1.phpt|armel
ext/standard/tests/strings/strripos_variation2.phpt|armel
ext/standard/tests/strings/strripos_variation3.phpt|armel
ext/standard/tests/strings/substr_compare.phpt|s390
ext/sysvmsg/tests/001.phpt|hurd-i386
ext/sysvmsg/tests/002.phpt|hurd-i386
ext/sysvmsg/tests/003.phpt|hurd-i386
ext/sysvsem/tests/sysv.phpt|hurd-i386
sapi/cli/tests/022.phpt|hurd-i386
tests/func/005a.phpt|hurd-i386
tests/lang/045.phpt|hurd-i386
tests/lang/operators/bitwiseShiftLeft_basiclong_64bit.phpt|ia64
tests/lang/operators/bitwiseShiftLeft_variationStr_64bit.phpt|ia64
tests/lang/operators/bitwiseShiftRight_basiclong_64bit.phpt|ia64
tests/security/open_basedir_scandir.phpt|hurd-i386
ext/phar/tests/020.phpt|alpha,kfreebsd-amd64
ext/phar/tests/021.phpt|alpha,kfreebsd-amd64
ext/phar/tests/phar_setsignaturealgo2.phpt|alpha,amd64
ext/posix/tests/posix_errno_variation2.phpt|hurd-i386,kfreebsd-i386
ext/posix/tests/posix_kill_basic.phpt|hurd-i386,kfreebsd-i386
ext/posix/tests/posix_times_basic.phpt|kfreebsd-amd64,kfreebsd-i386
ext/sockets/tests/socket_connect_params.phpt|kfreebsd-amd64,kfreebsd-i386
ext/sockets/tests/socket_write_params.phpt|kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/file/chmod_variation4.phpt|kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/file/umask_variation3.phpt|kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/file/userwrapper.phpt|alpha,kfreebsd-amd64
ext/standard/tests/mail/mail_basic2.phpt|alpha,amd64
ext/standard/tests/mail/mail_variation2.phpt|alpha,amd64
ext/standard/tests/network/gethostbyaddr_basic1.phpt|hurd-i386,powerpc
ext/standard/tests/streams/stream_get_line_nb.phpt|hppa,hurd-i386
ext/standard/tests/strings/vprintf_variation15_64bit.phpt|alpha,ia64
ext/standard/tests/strings/vsprintf_variation15_64bit.phpt|alpha,ia64
ext/sysvshm/tests/002.phpt|kfreebsd-amd64,kfreebsd-i386
tests/func/010.phpt|armel,powerpc
tests/lang/operators/bitwiseShiftRight_variationStr.phpt|armel,ia64
ext/sockets/tests/socket_getpeername_ipv6loop.phpt|amd64,hurd-i386,ia64
ext/standard/tests/file/006_variation2.phpt|hurd-i386,kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/file/chmod_basic.phpt|hurd-i386,kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/misc/time_nanosleep_error3.phpt|hurd-i386,kfreebsd-amd64,kfreebsd-i386
ext/sysvshm/tests/007.phpt|hurd-i386,kfreebsd-amd64,kfreebsd-i386
tests/lang/operators/bitwiseShiftLeft_variationStr.phpt|armel,powerpc,s390
ext/phar/tests/zip/phar_stub.phpt|hppa,hurd-i386,ia64,kfreebsd-amd64
ext/sockets/tests/socket_bind.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_getpeername.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_getsockname.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_sentto_recvfrom_ipv4_udp.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_sentto_recvfrom_unix.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_set_option_rcvtimeo.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/sockets/tests/socket_set_option_sndtimeo.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/standard/tests/general_functions/getservbyname_basic.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/standard/tests/general_functions/getservbyport_variation1.phpt|amd64,hurd-i386,i386,kfreebsd-amd64
ext/standard/tests/general_functions/var_dump_64bit.phpt|alpha,amd64,ia64,kfreebsd-amd64
ext/standard/tests/strings/htmlspecialchars_decode_variation2.phpt|armel,hppa,powerpc,s390
ext/ereg/tests/split_variation_004.phpt|alpha,armel,hppa,powerpc,s390
ext/ereg/tests/spliti_variation_004.phpt|alpha,armel,hppa,powerpc,s390
ext/sockets/tests/socket_set_option_error_socket_option.phpt|amd64,hurd-i386,i386,kfreebsd-amd64,kfreebsd-i386
ext/sockets/tests/socket_set_option_seolinger.phpt|amd64,hurd-i386,i386,kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/general_functions/getservbyport_basic.phpt|amd64,hurd-i386,i386,kfreebsd-amd64,kfreebsd-i386
ext/standard/tests/general_functions/proc_nice_basic.phpt|hurd-i386,ia64,kfreebsd-amd64,kfreebsd-i386,s390
ext/sockets/tests/socket_strerror.phpt|alpha,hppa,hurd-i386,kfreebsd-amd64,kfreebsd-i386,powerpc
ext/standard/tests/general_functions/var_export_basic3.phpt|armel,hppa,hurd-i386,i386,kfreebsd-i386,powerpc,s390
ext/posix/tests/posix_uname.phpt|alpha,amd64,armel,hppa,i386,ia64,powerpc,s390
ext/posix/tests/posix_uname_basic.phpt|alpha,amd64,armel,hppa,i386,ia64,powerpc,s390
Zend/tests/bug45877.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/calendar/tests/unixtojd.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/date/tests/DateTimeZone_listIdentifiers_basic1.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/date/tests/timezone_identifiers_list_basic1.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/date/tests/timezone_location_get.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/dba/tests/bug36436.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/dba/tests/bug48240.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/dba/tests/bug49125.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/dba/tests/dba_db4.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/filter/tests/033.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/filter/tests/046.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/spl/tests/arrayObject_magicMethods2.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/standard/tests/general_functions/import_request.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/standard/tests/general_functions/phpcredits.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/standard/tests/general_functions/proc_open02.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/standard/tests/streams/bug46024.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390
ext/xml/tests/bug32001.phpt|alpha,amd64,armel,hppa,hurd-i386,i386,ia64,kfreebsd-amd64,kfreebsd-i386,powerpc,s390

[2] http://people.debian.org/~seanius/php/5.3.1-4_test-results.tgz
-- 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: tests.db
Type: application/octet-stream
Size: 53248 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-php-maint/attachments/20100214/7d479af1/attachment-0001.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 190 bytes
Desc: Digital signature
URL: <http://lists.alioth.debian.org/pipermail/pkg-php-maint/attachments/20100214/7d479af1/attachment-0001.pgp>