dep8

Differences between revisions 16 and 18 (spanning 2 versions)
⇤ ← Revision 16 as of 2017-04-03 23:24:35 →
Size: 23652
Editor: powersj
Comment:
← Revision 18 as of 2017-04-05 22:20:52 → ⇥
Size: 26128
Editor: powersj
Comment:
Deletions are marked like this. Additions are marked like this.
Line 12: Line 12:
 1. [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise
1. [dep8] - do dep8 tests exists via the presence of:
  * debian/tests
  * debian/tests/control
 2. [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise
Line 14: Line 18:
 2. [dep8] - do dep8 tests exists via the presence of:
  * debian/tests
  * debian/tests/control
Line 21: Line 22:

This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries or source only. 		 5. Search for directories indicating tests
  * Search for a 'test', 'tests', 'testsuite', or 'test-suite' directory

This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries, or source only.
Line 27: Line 30:
== Data == == Results ==
Line 36: Line 39:
== Packages Missing dep8 Tests == == Opportunities ==

=== Key ===
This table explains further some of the notes found below.

|| '''Note''' || '''Meaning''' ||
|| Defined Testsuite in d/control || debian/control file has a 'Testsuite:' or 'XS-Testsuite:' entry; found by #2 above ||
|| Contains golang tests || Has files named *_test.go; found by #3 above ||
|| Contains Python tests in setup.py || Has a test_suite entry in setup.py; found by #4 above ||
|| Has test(s) directory || Has a directory found by #5 above ||
|| Has unit and integration tests || Has external, but known, extensive tests ||
|| Meta package || No need for tests on meta packages||

=== Table ===
Line 39: Line 55:
|| acpica-unix || [[https://pad.lv/1677698|LP: #1677698]] || || || acpica-unix || [[https://pad.lv/1677698|LP: #1677698]] || Has test(s) directory ||
Line 42: Line 58:
|| ant-contrib || [[https://pad.lv/1677702|LP: #1677702]] || ||
|| antlr3 || [[https://pad.lv/1677703|LP: #1677703]] || ||
|| apr || [[https://pad.lv/1677704|LP: #1677704]] || ||
|| asterisk || [[https://pad.lv/1677747|LP: #1677747]] || ||		 || ant-contrib || [[https://pad.lv/1677702|LP: #1677702]] || Has test(s) directory ||
|| antlr3 || [[https://pad.lv/1677703|LP: #1677703]] || Has test(s) directory ||
|| apr || [[https://pad.lv/1677704|LP: #1677704]] || Has test(s) directory ||
|| asterisk || [[https://pad.lv/1677747|LP: #1677747]] || Has test(s) directory ||
Line 47: Line 63:
|| augeas || [[https://pad.lv/1677749|LP: #1677749]] || || || augeas || [[https://pad.lv/1677749|LP: #1677749]] || Has test(s) directory ||
Line 55: Line 71:
|| beanstalkc || [[https://pad.lv/1677758|LP: #1677758]] || || || beanstalkc || [[https://pad.lv/1677758|LP: #1677758]] || Has test(s) directory ||
Line 57: Line 73:
|| billiard || Invalid || Has python tests ||
|| bind9 || [[https://pad.lv/1677761|LP: #1677761]] || ||
|| blinker || [[https://pad.lv/1677762|LP: #1677762]] || ||
|| bridge-utils || [[https://pad.lv/1677763|LP: #1677763]] || ||		 || billiard || Invalid || Contains Python tests in setup.py ||
|| bind9 || [[https://pad.lv/1677761|LP: #1677761]] || Has test(s) directory ||
|| blinker || [[https://pad.lv/1677762|LP: #1677762]] || Has test(s) directory ||
|| bridge-utils || [[https://pad.lv/1677763|LP: #1677763]] || Has test(s) directory ||
Line 62: Line 78:
|| byobu || [[https://pad.lv/1677765|LP: #1677765]] || ||
|| c3p0 || [[https://pad.lv/1677766|LP: #1677766]] || ||
|| cglib || [[https://pad.lv/1677767|LP: #1677767]] || ||
|| cglib3 || [[https://pad.lv/1677768|LP: #1677768]] || ||		 || byobu || [[https://pad.lv/1677765|LP: #1677765]] || Has test(s) directory ||
|| c3p0 || [[https://pad.lv/1677766|LP: #1677766]] || Has test(s) directory ||
|| cglib || [[https://pad.lv/1677767|LP: #1677767]] || Has test(s) directory ||
|| cglib3 || [[https://pad.lv/1677768|LP: #1677768]] || Has test(s) directory ||
Line 67: Line 83:
|| charm-tools || [[https://pad.lv/1677770|LP: #1677770]] || || || charm-tools || [[https://pad.lv/1677770|LP: #1677770]] || Has test(s) directory ||
Line 69: Line 85:
|| cheetah || [[https://pad.lv/1677772|LP: #1677772]] || || || cheetah || [[https://pad.lv/1677772|LP: #1677772]] || Has test(s) directory ||
Line 73: Line 89:
|| cluster-glue || [[https://pad.lv/1677776|LP: #1677776]] || || || cluster-glue || [[https://pad.lv/1677776|LP: #1677776]] || Has test(s) directory ||
Line 75: Line 91:
|| commons-io || [[https://pad.lv/1677778|LP: #1677778]] || ||
|| commons-vfs || [[https://pad.lv/1677779|LP: #1677779]] || ||		 || commons-io || [[https://pad.lv/1677778|LP: #1677778]] || Has test(s) directory ||
|| commons-vfs || [[https://pad.lv/1677779|LP: #1677779]] || Has test(s) directory ||
Line 83: Line 99:
|| dnsjava || [[https://pad.lv/1677828|LP: #1677828]] || || || dnsjava || [[https://pad.lv/1677828|LP: #1677828]] || Has test(s) directory ||
Line 90: Line 106:
|| ec2-ami-tools || [[https://pad.lv/1677842|LP: #1677842]] || || || ec2-ami-tools || [[https://pad.lv/1677842|LP: #1677842]] || Has test(s) directory ||
Line 92: Line 108:
|| elinks || [[https://pad.lv/1677841|LP: #1677841]] || || || elinks || [[https://pad.lv/1677841|LP: #1677841]] || Has test(s) directory ||
Line 96: Line 112:
|| excalibur-logkit || [[https://pad.lv/1677840|LP: #1677840]] || || || excalibur-logkit || [[https://pad.lv/1677840|LP: #1677840]] || Has test(s) directory ||
Line 102: Line 118:
|| geronimo-j2ee-connector-1.5-spec || [[https://pad.lv/1677816|LP: #1677816]] || ||
|| geronimo-jacc-1.1-spec || [[https://pad.lv/1677815|LP: #1677815]] || ||
|| geronimo-jms-1.1-spec || [[https://pad.lv/1677837|LP: #1677837]] || ||		 || geronimo-j2ee-connector-1.5-spec || [[https://pad.lv/1677816|LP: #1677816]] || Has test(s) directory ||
|| geronimo-jacc-1.1-spec || [[https://pad.lv/1677815|LP: #1677815]] || Has test(s) directory ||
|| geronimo-jms-1.1-spec || [[https://pad.lv/1677837|LP: #1677837]] || Has test(s) directory ||
Line 106: Line 122:
|| golang-1.6 || Invalid || Has go tests ||
|| golang-1.6-race-detector-runtime || [[https://pad.lv/1677812|LP: #1677812]] || ||
|| golang-1.7 || Invalid || Has go tests ||
|| golang-check.v1 || Invalid || Has go tests ||
|| golang-context|| Invalid || Has go tests ||
|| golang-github-bmizerany-assert || Invalid || Has go tests ||
|| golang-github-bmizerany-pat || Invalid || Has go tests ||
|| golang-github-gorilla-mux || Invalid || Has go tests ||
|| golang-github-mattn-go-colorable || Invalid || Has go tests ||
|| golang-github-mattn-go-isatty || Invalid || Has go tests ||
|| golang-github-mattn-go-sqlite3 || Invalid || Has go tests ||
|| golang-github-olekukonko-tablewriter || Invalid || Has go tests ||
|| golang-github-pborman-uuid || Invalid || Has go tests ||
|| golang-go-dbus || Invalid || Has go tests ||
|| golang-go.crypto || Invalid || Has go tests ||
|| golang-gocapability-dev || Invalid || Has go tests ||
|| golang-golang-x-net-dev || Invalid || Has go tests ||
|| golang-gopkg-flosch-pongo2.v3 || Invalid || Has go tests ||
|| golang-gopkg-inconshreveable-log15.v2 || Invalid || Has go tests ||
|| golang-gopkg-tomb.v2 || Invalid || Has go tests ||
|| golang-goprotobuf || Invalid || Has go tests ||
|| golang-juju-loggo || Invalid || Has go tests ||
|| golang-petname || Invalid || Has go tests ||
|| golang-pretty || Invalid || Has go tests ||
|| golang-text || Invalid || Has go tests ||
|| golang-x-text || Invalid || Has go tests ||
|| golang-yaml.v2 || Invalid || Has go tests ||		 || golang-1.6 || Invalid || Contains golang tests ||
|| golang-1.6-race-detector-runtime || [[https://pad.lv/1677812|LP: #1677812]] || Has test(s) directory ||
|| golang-1.7 || Invalid || Contains golang tests ||
|| golang-check.v1 || Invalid || Contains golang tests ||
|| golang-context|| Invalid || Contains golang tests ||
|| golang-github-bmizerany-assert || Invalid || Contains golang tests ||
|| golang-github-bmizerany-pat || Invalid || Contains golang tests ||
|| golang-github-gorilla-mux || Invalid || Contains golang tests ||
|| golang-github-mattn-go-colorable || Invalid || Contains golang tests ||
|| golang-github-mattn-go-isatty || Invalid || Contains golang tests ||
|| golang-github-mattn-go-sqlite3 || Invalid || Contains golang tests ||
|| golang-github-olekukonko-tablewriter || Invalid || Contains golang tests ||
|| golang-github-pborman-uuid || Invalid || Contains golang tests ||
|| golang-go-dbus || Invalid || Contains golang tests ||
|| golang-go.crypto || Invalid || Contains golang tests ||
|| golang-gocapability-dev || Invalid || Contains golang tests ||
|| golang-golang-x-net-dev || Invalid || Contains golang tests ||
|| golang-gopkg-flosch-pongo2.v3 || Invalid || Contains golang tests ||
|| golang-gopkg-inconshreveable-log15.v2 || Invalid || Contains golang tests ||
|| golang-gopkg-tomb.v2 || Invalid || Contains golang tests ||
|| golang-goprotobuf || Invalid || Contains golang tests ||
|| golang-juju-loggo || Invalid || Contains golang tests ||
|| golang-petname || Invalid || Contains golang tests ||
|| golang-pretty || Invalid || Contains golang tests ||
|| golang-text || Invalid || Contains golang tests ||
|| golang-x-text || Invalid || Contains golang tests ||
|| golang-yaml.v2 || Invalid || Contains golang tests ||
Line 134: Line 150:
|| groovy || [[https://pad.lv/1677859|LP: #1677859]] || ||
|| hardlink || [[https://pad.lv/1677860|LP: #1677860]] || ||		 || groovy || [[https://pad.lv/1677859|LP: #1677859]] || Has test(s) directory ||
|| hardlink || [[https://pad.lv/1677860|LP: #1677860]] || Has test(s) directory ||
Line 137: Line 153:
|| heimdal || [[https://pad.lv/1677863|LP: #1677863]] || || || heimdal || [[https://pad.lv/1677863|LP: #1677863]] || Has test(s) directory ||
Line 143: Line 159:
|| iproute2 || [[https://pad.lv/1677869|LP: #1677869]] || || || iproute2 || [[https://pad.lv/1677869|LP: #1677869]] || Has test(s) directory ||
Line 147: Line 163:
|| ipxe || [[https://pad.lv/1677874|LP: #1677874]] || || || ipxe || [[https://pad.lv/1677874|LP: #1677874]] || Has test(s) directory ||
Line 149: Line 165:
|| janino || [[https://pad.lv/1677876|LP: #1677876]] || || || janino || [[https://pad.lv/1677876|LP: #1677876]] || Has test(s) directory ||
Line 151: Line 167:
|| jug || [[https://pad.lv/1677878|LP: #1677878]] || || || jug || [[https://pad.lv/1677878|LP: #1677878]] || Has test(s) directory ||
Line 154: Line 170:
|| krb5 || [[https://pad.lv/1677881|LP: #1677881]] || || || krb5 || [[https://pad.lv/1677881|LP: #1677881]] || Has test(s) directory ||
Line 156: Line 172:
|| ldb || [[https://pad.lv/1677883|LP: #1677883]] || || || ldb || [[https://pad.lv/1677883|LP: #1677883]] || Has test(s) directory ||
Line 162: Line 178:
|| libapache2-reload-perl || [[https://pad.lv/1677889|LP: #1677889]] || ||
|| libaxiom-java || [[https://pad.lv/1677890|LP: #1677890]] || ||		 || libapache2-reload-perl || [[https://pad.lv/1677889|LP: #1677889]] || Fix coming ||
|| libaxiom-java || [[https://pad.lv/1677890|LP: #1677890]] || Has test(s) directory ||
Line 165: Line 181:
|| libcgroup || || Has test directory ||
|| libcommons-cli-java || || Has test directory ||
|| libcommons-compress-java || || Has test directory ||
|| libcommons-fileupload-java || || Has test directory ||
|| libcommons-jxpath-java || || Has test directory ||
|| libconfig-general-perl || Invalid || Has control file testsuite ||
|| libcss-minifier-xs-perl || Invalid || Has control file testsuite ||
|| libdbi || Invalid || library ||
|| libdbi-drivers || || Has test directory ||
|| libecap || Invalid || library ||
|| libesmtp || Invalid || library ||
|| libezmorph-java || || Has test directory ||
|| libfcgi-perl || Invalid || Has control file testsuite ||
|| libibverbs || Invalid || library ||
|| libiscsi || || Has test directory ||
|| libjavascript-minifier-xs-perl || Invalid || Has control file testsuite ||
|| libjson-java || || Has test directory ||
|| liblockfile || Invalid || library ||
|| libmemcached || || Has test directory ||
|| libmime-tools-perl || Invalid || Has control file testsuite ||
|| libmnl || Invalid || library ||
|| libmspack || || Has test directory ||
|| libnet || Invalid || library ||
|| libnetfilter-conntrack || Invalid || library ||
|| libnetfilter-cthelper || Invalid || library ||
|| libnetfilter-cttimeout || Invalid || library ||
|| libnetfilter-queue || Invalid || library ||
|| libnl3 || || Has test directory ||
|| libnss-ldap || Invalid || library ||
|| libp11 || || Has test directory ||
|| libpam-ldap || || Has test directory ||		 || libcgroup || || Has test(s) directory ||
|| libcommons-cli-java || || Has test(s) directory ||
|| libcommons-compress-java || || Has test(s) directory ||
|| libcommons-fileupload-java || || Has test(s) directory ||
|| libcommons-jxpath-java || || Has test(s) directory ||
|| libconfig-general-perl || Invalid || Defined Testsuite in d/control ||
|| libcss-minifier-xs-perl || Invalid || Defined Testsuite in d/control ||
|| libdbi || Invalid || Library ||
|| libdbi-drivers || || Has test(s) directory ||
|| libecap || Invalid || Library ||
|| libesmtp || Invalid || Library ||
|| libezmorph-java || || Has test(s) directory ||
|| libfcgi-perl || Invalid || Defined Testsuite in d/control ||
|| libibverbs || Invalid || Library ||
|| libiscsi || || Has test(s) directory ||
|| libjavascript-minifier-xs-perl || Invalid || Defined Testsuite in d/control ||
|| libjson-java || || Has test(s) directory ||
|| liblockfile || Invalid || Library ||
|| libmemcached || || Has test(s) directory ||
|| libmime-tools-perl || Invalid || Defined Testsuite in d/control ||
|| libmnl || Invalid || Library ||
|| libmspack || || Has test(s) directory ||
|| libnet || Invalid || Library ||
|| libnetfilter-conntrack || Invalid || Library ||
|| libnetfilter-cthelper || Invalid || Library ||
|| libnetfilter-cttimeout || Invalid || Library ||
|| libnetfilter-queue || Invalid || Library ||
|| libnl3 || || Has test(s) directory ||
|| libnss-ldap || Invalid || Library ||
|| libp11 || || Has test(s) directory ||
|| libpam-ldap || || Has test(s) directory ||
Line 197: Line 213:
|| libpam-radius-auth || Invalid || library ||
|| libparse-recdescent-perl || Invalid || Has control file testsuite ||		 || libpam-radius-auth || Invalid || Library ||
|| libparse-recdescent-perl || Invalid || Defined Testsuite in d/control ||
Line 200: Line 216:
|| libpcap || || Has test directory ||
|| librabbitmq || || Has test directory ||
|| librdmacm || Invalid || library ||
|| librtas || Invalid || library ||
|| libs3 || || Has test directory ||
|| libsdl1.2 || || Has test directory ||
|| libslf4j-java || || Has test directory ||
|| libstatgrab || || Has test directory ||
|| libtime-parsedate-perl || Invalid || Has control file testsuite ||
|| libtirpc || Invalid || library ||
|| libtommath || Invalid || library ||
|| liburcu || || Has test directory ||
|| libxml-security-java || || Has test directory ||
|| libxml-xpath-perl || Invalid || Has control file testsuite ||
|| libyaml || || Has test directory ||
|| lm-sensors || || Has test directory ||
|| logcheck || || Has test directory ||		 || libpcap || || Has test(s) directory ||
|| librabbitmq || || Has test(s) directory ||
|| librdmacm || Invalid || Library ||
|| librtas || Invalid || Library ||
|| libs3 || || Has test(s) directory ||
|| libsdl1.2 || || Has test(s) directory ||
|| libslf4j-java || || Has test(s) directory ||
|| libstatgrab || || Has test(s) directory ||
|| libtime-parsedate-perl || Invalid || Defined Testsuite in d/control ||
|| libtirpc || Invalid || Library ||
|| libtommath || Invalid || Library ||
|| liburcu || || Has test(s) directory ||
|| libxml-security-java || || Has test(s) directory ||
|| libxml-xpath-perl || Invalid || Defined Testsuite in d/control ||
|| libyaml || || Has test(s) directory ||
|| lm-sensors || || Has test(s) directory ||
|| logcheck || || Has test(s) directory ||
Line 222: Line 238:
|| m2crypto || Invalid || Has python tests || || m2crypto || Invalid || Contains Python tests in setup.py ||
Line 225: Line 241:
|| mail-spf-perl || Invalid || Has control file testsuite ||
|| mako || Invalid || Has python tests ||
|| markupsafe || Invalid || Has python tests ||		 || mail-spf-perl || Invalid || Defined Testsuite in d/control ||
|| mako || Invalid || Contains Python tests in setup.py ||
|| markupsafe || Invalid || Contains Python tests in setup.py ||
Line 235: Line 251:
|| monitoring-plugins || || Has test directory || || monitoring-plugins || || Has test(s) directory ||
Line 237: Line 253:
|| mvel || || Has test directory ||
|| mysql-defaults || [[https://pad.lv/1679343|LP: #1679343]] || ||
|| nagios-images || [[https://pad.lv/1679344|LP: #1679344]] || ||		 || mvel || || Has test(s) directory ||
|| mysql-defaults || Invalid || Meta package ||
|| nagios-images || Invalid || Images only ||
Line 241: Line 257:
|| nbd || || Has test directory ||
|| ndg-httpsclient || || Has test directory ||
|| net-snmp || || Has test directory ||		 || nbd || || Has test(s) directory ||
|| ndg-httpsclient || || Has test(s) directory ||
|| net-snmp || || Has test(s) directory ||
Line 245: Line 261:
|| netcf || || Has test directory ||
|| netty || || Has test directory ||		 || netcf || || Has test(s) directory ||
|| netty || || Has test(s) directory ||
Line 249: Line 265:
|| nmap || || Has test directory ||
|| nose || Invalid || Has python tests ||
|| nspr || || Has test directory ||
|| nss || || Has test directory ||
|| ntdb || || Has test directory ||
|| ntp || || Has test directory ||
|| numactl || || Has test directory ||		 || nmap || || Has test(s) directory ||
|| nose || Invalid || Contains Python tests in setup.py ||
|| nspr || || Has test(s) directory ||
|| nss || || Has test(s) directory ||
|| ntdb || || Has test(s) directory ||
|| ntp || || Has test(s) directory ||
|| numactl || || Has test(s) directory ||
Line 261: Line 277:
|| openbsd-inetd || || Has test directory ||
|| openhpi || || Has test directory ||		 || openbsd-inetd || || Has test(s) directory ||
|| openhpi || || Has test(s) directory ||
Line 264: Line 280:
|| openldap || || Has test directory ||
|| openvpn || || Has test directory ||		 || openldap || || Has test(s) directory ||
|| openvpn || || Has test(s) directory ||
Line 267: Line 283:
|| parsedatetime || Invalid || Has python tests || || parsedatetime || Invalid || Contains Python tests in setup.py ||
Line 270: Line 286:
|| php-pear || || Has test directory || || php-pear || || Has test(s) directory ||
Line 273: Line 289:
|| pollen || Invalid || Has go tests || || pollen || Invalid || Contains golang tests ||
Line 279: Line 295:
|| psmisc || || Has test directory || || psmisc || || Has test(s) directory ||
Line 281: Line 297:
|| pyjunitxml || || Has test directory ||
|| pylibmc || || Has test directory ||
|| python-amqplib || || Has test directory ||
|| python-cloudfiles || Invalid || Has python tests ||
|| python-coffin || || Has test directory ||		 || pyjunitxml || || Has test(s) directory ||
|| pylibmc || || Has test(s) directory ||
|| python-amqplib || || Has test(s) directory ||
|| python-cloudfiles || Invalid || Contains Python tests in setup.py ||
|| python-coffin || || Has test(s) directory ||
Line 287: Line 303:
|| python-ddt || || Has test directory || || python-ddt || || Has test(s) directory ||
Line 289: Line 305:
|| python-django || || Has test directory ||
|| python-django-piston || || Has test directory ||
|| python-django-south || || Has test directory ||
|| python-dns || || Has test directory ||
|| python-elasticsearch || Invalid || Has python tests ||
|| python-gevent || Invalid || Has python tests ||		 || python-django || || Has test(s) directory ||
|| python-django-piston || || Has test(s) directory ||
|| python-django-south || || Has test(s) directory ||
|| python-dns || || Has test(s) directory ||
|| python-elasticsearch || Invalid || Contains Python tests in setup.py ||
|| python-gevent || Invalid || Contains Python tests in setup.py ||
Line 296: Line 312:
|| python-hacking || || Has test directory ||
|| python-happybase || || Has test directory ||
|| python-hplefthandclient || || Has test directory ||
|| python-httpretty || Invalid || Has python tests ||
|| python-itsdangerous || Invalid || Has control file testsuite ||
|| python-jingo || || Has test directory ||		 || python-hacking || || Has test(s) directory ||
|| python-happybase || || Has test(s) directory ||
|| python-hplefthandclient || || Has test(s) directory ||
|| python-httpretty || Invalid || Contains Python tests in setup.py ||
|| python-itsdangerous || Invalid || Defined Testsuite in d/control ||
|| python-jingo || || Has test(s) directory ||
Line 304: Line 320:
|| python-kajiki || Invalid || Has python tests ||
|| python-ldappool || || Has test directory ||		 || python-kajiki || Invalid || Contains Python tests in setup.py ||
|| python-ldappool || || Has test(s) directory ||
Line 307: Line 323:
|| python-mccabe || Invalid || Has control file testsuite ||
|| python-nine || Invalid || Has python tests ||		 || python-mccabe || Invalid || Defined Testsuite in d/control ||
|| python-nine || Invalid || Contains Python tests in setup.py ||
Line 312: Line 328:
|| python-oauthlib || Invalid || Has python tests ||
|| python-pyelftools || || Has test directory ||		 || python-oauthlib || Invalid || Contains Python tests in setup.py ||
|| python-pyelftools || || Has test(s) directory ||
Line 317: Line 333:
|| python-seamicroclient || || Has test directory ||
|| python-setuptools-git || Invalid || Has python tests ||
|| python-stompy || Invalid || Has python tests ||		 || python-seamicroclient || || Has test(s) directory ||
|| python-setuptools-git || Invalid || Contains Python tests in setup.py ||
|| python-stompy || Invalid || Contains Python tests in setup.py ||
Line 321: Line 337:
|| python-tempita || Invalid || Has python tests || || python-tempita || Invalid || Contains Python tests in setup.py ||
Line 324: Line 340:
|| python-tx-tftp || || Has test directory ||
|| python-ws4py || || Has test directory ||		 || python-tx-tftp || || Has test(s) directory ||
|| python-ws4py || || Has test(s) directory ||
Line 327: Line 343:
|| qdox || || Has test directory ||
|| qemu || || Has test directory ||		 || qdox || || Has test(s) directory ||
|| qemu || || Has test(s) directory ||
Line 332: Line 348:
|| re2c || || Has test directory ||
|| requests || Invalid || Has python tests ||		 || re2c || || Has test(s) directory ||
|| requests || Invalid || Contains Python tests in setup.py ||
Line 335: Line 351:
|| rrdtool || || Has test directory ||
|| rsync || || Has test directory ||
|| ruby-augeas || Invalid || Has control file testsuite ||
|| ruby-childprocess || Invalid || Has control file testsuite ||
|| ruby-hashie || Invalid || Has control file testsuite ||
|| ruby-indentation || Invalid || Has control file testsuite ||
|| ruby-json || || Has test directory ||
|| ruby-molinillo || || Has test directory ||
|| ruby-net-http-persistent || || Has test directory ||
|| ruby-rspec || || Has test directory ||
|| ruby-safe-yaml || Invalid || Has control file testsuite ||
|| ruby-shadow || Invalid || Has control file testsuite ||		 || rrdtool || || Has test(s) directory ||
|| rsync || || Has test(s) directory ||
|| ruby-augeas || Invalid || Defined Testsuite in d/control ||
|| ruby-childprocess || Invalid || Defined Testsuite in d/control ||
|| ruby-hashie || Invalid || Defined Testsuite in d/control ||
|| ruby-indentation || Invalid || Defined Testsuite in d/control ||
|| ruby-json || || Has test(s) directory ||
|| ruby-molinillo || || Has test(s) directory ||
|| ruby-net-http-persistent || || Has test(s) directory ||
|| ruby-rspec || || Has test(s) directory ||
|| ruby-safe-yaml || Invalid || Defined Testsuite in d/control ||
|| ruby-shadow || Invalid || Defined Testsuite in d/control ||
Line 351: Line 367:
|| sharutils || || Has test directory || || sharutils || || Has test(s) directory ||
Line 360: Line 376:
|| sphinxcontrib-programoutput || || Has test directory ||
|| spice || || Has test directory ||		 || sphinxcontrib-programoutput || || Has test(s) directory ||
|| spice || || Has test(s) directory ||
Line 363: Line 379:
|| squid-deb-proxy || || Has test directory || || squid-deb-proxy || || Has test(s) directory ||
Line 367: Line 383:
|| sssd || || Has test directory ||
|| subunit || || Has test directory ||		 || sssd || || Has test(s) directory ||
|| subunit || || Has test(s) directory ||
Line 370: Line 386:
|| taglibs-standard || || Has test directory ||
|| tevent || || Has test directory ||		 || taglibs-standard || || Has test(s) directory ||
|| tevent || || Has test(s) directory ||
Line 376: Line 392:
|| tomcat7 || || Has test directory ||
|| tomcat8 || || Has test directory ||		 || tomcat7 || || Has test(s) directory ||
|| tomcat8 || || Has test(s) directory ||
Line 379: Line 395:
|| txamqp || || Has test directory ||
|| txaws || || Has test directory ||
|| txlongpoll || || Has test directory ||
|| txzookeeper || Invalid || Has python tests ||		 || txamqp || || Has test(s) directory ||
|| txaws || || Has test(s) directory ||
|| txlongpoll || || Has test(s) directory ||
|| txzookeeper || Invalid || Contains Python tests in setup.py ||
Line 384: Line 400:
|| ubuntu-virt || Invalid || meta package || || ubuntu-virt || Invalid || Meta package ||
Line 387: Line 403:
|| urlgrabber || || Has test directory ||
|| urwid || Invalid || Has python tests ||		 || urlgrabber || || Has test(s) directory ||
|| urwid || Invalid || Contains Python tests in setup.py ||
Line 391: Line 407:
|| uvtool || || Has test directory || || uvtool || || Has test(s) directory ||
Line 395: Line 411:
|| vgabios || || Has test directory || || vgabios || || Has test(s) directory ||
Line 397: Line 413:
|| vlock || || Has test directory ||
|| vm-builder || || Has test directory ||
|| w3m || || Has test directory ||		 || vlock || || Has test(s) directory ||
|| vm-builder || || Has test(s) directory ||
|| w3m || || Has test(s) directory ||
Line 401: Line 417:
|| walinuxagent || || Has test directory ||
|| websocket-client || Invalid || Has python tests ||
|| websockify || || Has test directory ||		 || walinuxagent || || Has test(s) directory ||
|| websocket-client || Invalid || Contains Python tests in setup.py ||
|| websockify || || Has test(s) directory ||
Line 405: Line 421:
|| wss4j || || Has test directory ||
|| xen || || Has test directory ||		 || wss4j || || Has test(s) directory ||
|| xen || || Has test(s) directory ||
Line 408: Line 424:
|| xmlrpc-epi || || Has test directory ||
|| xmlunit || || Has test directory ||		 || xmlrpc-epi || || Has test(s) directory ||
|| xmlunit || || Has test(s) directory ||
Line 411: Line 427:
|| yajl || || Has test directory ||
|| yui3 || || Has test directory ||		 || yajl || || Has test(s) directory ||
|| yui3 || || Has test(s) directory ||

Server Team dep8 Status

Overview

The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages.

This page tracks the status of dep8 tests existing in server team owned packages as defined by the package-to-team mappings.

Process

Given the package-to-team mappings, in order to determine whether a package had dep8 tests or not the following was done for every package owned by the 'server-team': Download the latest source via pull-lp-source <package name> zesty

  1. [dep8] - do dep8 tests exists via the presence of:
    • debian/tests
    • debian/tests/control
  2. [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise

    • grep debian/control 'Testsuite:'

  3. [go] - contains build time go-based tests

    • find . -name *_test.go

  4. [python] - setup.py has a test_suite defined

    • grep setup.py 'test_suite'

  5. Search for directories indicating tests
    • Search for a 'test', 'tests', 'testsuite', or 'test-suite' directory

This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries, or source only.

Launchpad Bugs

For each package a Launchpad bug was filed with the tag 'needs-dep8'.

Results

Following was determined on March 29, 2017. Of the 521 packages under 'ubuntu-server':

  • 374 packages do not have dep8 tests (Link)

  • 90 packages have dep8 tests (Link)

  • 57 packages are not available in zesty (Link)

Once removing packages that have golang tests, python test_suite in setup.py, or test-suite set in the control file the number drops to 312 (Link)

Opportunities

Key

This table explains further some of the notes found below.

Note

Meaning

Defined Testsuite in d/control

debian/control file has a 'Testsuite:' or 'XS-Testsuite:' entry; found by #2 above

Contains golang tests

Has files named *_test.go; found by #3 above

Contains Python tests in setup.py

Has a test_suite entry in setup.py; found by #4 above

Has test(s) directory

Has a directory found by #5 above

Has unit and integration tests

Has external, but known, extensive tests

Meta package

No need for tests on meta packages

Table

Name

LP Bug/Status

Notes

acpica-unix

LP: #1677698

Has test(s) directory

amavisd-new

LP: #1677700

analog

LP: #1677701

ant-contrib

LP: #1677702

Has test(s) directory

antlr3

LP: #1677703

Has test(s) directory

apr

LP: #1677704

Has test(s) directory

asterisk

LP: #1677747

Has test(s) directory

at

LP: #1677748

augeas

LP: #1677749

Has test(s) directory

authbind

LP: #1677750

autofs

LP: #1677751

awscli

LP: #1677753

awstats

LP: #1677754

backuppc

LP: #1677755

bacula

LP: #1677756

bcache-tools

LP: #1677757

beanstalkc

LP: #1677758

Has test(s) directory

beautifulsoup

LP: #1677759

billiard

Invalid

Contains Python tests in setup.py

bind9

LP: #1677761

Has test(s) directory

blinker

LP: #1677762

Has test(s) directory

bridge-utils

LP: #1677763

Has test(s) directory

bsd-mailx

LP: #1677764

byobu

LP: #1677765

Has test(s) directory

c3p0

LP: #1677766

Has test(s) directory

cglib

LP: #1677767

Has test(s) directory

cglib3

LP: #1677768

Has test(s) directory

cgroup-lite

LP: #1677769

charm-tools

LP: #1677770

Has test(s) directory

checksecurity

LP: #1677771

cheetah

LP: #1677772

Has test(s) directory

chkrootkit

LP: #1677773

cloud-init

Invalid

Has unit and integration tests

cloud-initramfs-tools

LP: #1677775

cluster-glue

LP: #1677776

Has test(s) directory

cobbler-enlist

LP: #1677777

commons-io

LP: #1677778

Has test(s) directory

commons-vfs

LP: #1677779

Has test(s) directory

curtin

Invalid

Has unit and integration tests

cyrus-sasl2

LP: #1677781

dh-php

LP: #1677782

ding-libs

LP: #1677783

dlm

LP: #1677845

dns-root-data

LP: #1677829

dnsjava

LP: #1677828

Has test(s) directory

dnsmasq

LP: #1677827

dnstracer

LP: #1677826

drac

LP: #1677844

drbd-utils

LP: #1677843

dwarves-dfsg

LP: #1677825

ebtables

LP: #1677824

ec2-ami-tools

LP: #1677842

Has test(s) directory

ec2-api-tools

LP: #1677822

elinks

LP: #1677841

Has test(s) directory

etckeeper

LP: #1677823

ethtool

LP: #1677820

euca2ools

LP: #1677821

excalibur-logkit

LP: #1677840

Has test(s) directory

eximdoc4

LP: #1677819

fetchmail

LP: #1677818

freeipmi

LP: #1677839

geronimo-ejb-3.0-spec

LP: #1677817

geronimo-interceptor-3.0-spec

LP: #1677838

geronimo-j2ee-connector-1.5-spec

LP: #1677816

Has test(s) directory

geronimo-jacc-1.1-spec

LP: #1677815

Has test(s) directory

geronimo-jms-1.1-spec

LP: #1677837

Has test(s) directory

geronimo-jpa-3.0-spec

LP: #1677814

golang-1.6

Invalid

Contains golang tests

golang-1.6-race-detector-runtime

LP: #1677812

Has test(s) directory

golang-1.7

Invalid

Contains golang tests

golang-check.v1

Invalid

Contains golang tests

golang-context

Invalid

Contains golang tests

golang-github-bmizerany-assert

Invalid

Contains golang tests

golang-github-bmizerany-pat

Invalid

Contains golang tests

golang-github-gorilla-mux

Invalid

Contains golang tests

golang-github-mattn-go-colorable

Invalid

Contains golang tests

golang-github-mattn-go-isatty

Invalid

Contains golang tests

golang-github-mattn-go-sqlite3

Invalid

Contains golang tests

golang-github-olekukonko-tablewriter

Invalid

Contains golang tests

golang-github-pborman-uuid

Invalid

Contains golang tests

golang-go-dbus

Invalid

Contains golang tests

golang-go.crypto

Invalid

Contains golang tests

golang-gocapability-dev

Invalid

Contains golang tests

golang-golang-x-net-dev

Invalid

Contains golang tests

golang-gopkg-flosch-pongo2.v3

Invalid

Contains golang tests

golang-gopkg-inconshreveable-log15.v2

Invalid

Contains golang tests

golang-gopkg-tomb.v2

Invalid

Contains golang tests

golang-goprotobuf

Invalid

Contains golang tests

golang-juju-loggo

Invalid

Contains golang tests

golang-petname

Invalid

Contains golang tests

golang-pretty

Invalid

Contains golang tests

golang-text

Invalid

Contains golang tests

golang-x-text

Invalid

Contains golang tests

golang-yaml.v2

Invalid

Contains golang tests

google-apputils-python

LP: #1677858

groovy

LP: #1677859

Has test(s) directory

hardlink

LP: #1677860

Has test(s) directory

heartbeat

LP: #1677861

heimdal

LP: #1677863

Has test(s) directory

htop

LP: #1677864

http-parser

LP: #1677865

ibmasm-utils

LP: #1677866

iotop

LP: #1677867

ipmitool

LP: #1677868

iproute2

LP: #1677869

Has test(s) directory

ipsec-tools

LP: #1677870

iptraf-ng

LP: #1677871

ipvsadm

LP: #1677873

ipxe

LP: #1677874

Has test(s) directory

irqbalance

LP: #1677875

janino

LP: #1677876

Has test(s) directory

joyent-mdata-client

LP: #1677877

jug

LP: #1677878

Has test(s) directory

keepalived

LP: #1677879

kerberos-configs

LP: #1677880

krb5

LP: #1677881

Has test(s) directory

ldap-auth-client

LP: #1677882

ldb

LP: #1677883

Has test(s) directory

ldns

LP: #1677884

libaio

LP: #1677885

libapache-mod-auth-kerb

LP: #1677886

libapache2-mod-auth-pgsql

LP: #1677887

libapache2-mod-auth-plain

LP: #1677888

libapache2-reload-perl

LP: #1677889

Fix coming

libaxiom-java

LP: #1677890

Has test(s) directory

libcacard

LP: #1677891

libcgroup

Has test(s) directory

libcommons-cli-java

Has test(s) directory

libcommons-compress-java

Has test(s) directory

libcommons-fileupload-java

Has test(s) directory

libcommons-jxpath-java

Has test(s) directory

libconfig-general-perl

Invalid

Defined Testsuite in d/control

libcss-minifier-xs-perl

Invalid

Defined Testsuite in d/control

libdbi

Invalid

Library

libdbi-drivers

Has test(s) directory

libecap

Invalid

Library

libesmtp

Invalid

Library

libezmorph-java

Has test(s) directory

libfcgi-perl

Invalid

Defined Testsuite in d/control

libibverbs

Invalid

Library

libiscsi

Has test(s) directory

libjavascript-minifier-xs-perl

Invalid

Defined Testsuite in d/control

libjson-java

Has test(s) directory

liblockfile

Invalid

Library

libmemcached

Has test(s) directory

libmime-tools-perl

Invalid

Defined Testsuite in d/control

libmnl

Invalid

Library

libmspack

Has test(s) directory

libnet

Invalid

Library

libnetfilter-conntrack

Invalid

Library

libnetfilter-cthelper

Invalid

Library

libnetfilter-cttimeout

Invalid

Library

libnetfilter-queue

Invalid

Library

libnl3

Has test(s) directory

libnss-ldap

Invalid

Library

libp11

Has test(s) directory

libpam-ldap

Has test(s) directory

libpam-mount

LP: #1679327

libpam-radius-auth

Invalid

Library

libparse-recdescent-perl

Invalid

Defined Testsuite in d/control

libparse-yapp-perl

LP: #1679328

libpcap

Has test(s) directory

librabbitmq

Has test(s) directory

librdmacm

Invalid

Library

librtas

Invalid

Library

libs3

Has test(s) directory

libsdl1.2

Has test(s) directory

libslf4j-java

Has test(s) directory

libstatgrab

Has test(s) directory

libtime-parsedate-perl

Invalid

Defined Testsuite in d/control

libtirpc

Invalid

Library

libtommath

Invalid

Library

liburcu

Has test(s) directory

libxml-security-java

Has test(s) directory

libxml-xpath-perl

Invalid

Defined Testsuite in d/control

libyaml

Has test(s) directory

lm-sensors

Has test(s) directory

logcheck

Has test(s) directory

logwatch

LP: #1679329

lsscsi

LP: #1679330

lua-lpeg

LP: #1679331

lua5.2

LP: #1679332

m2300w

LP: #1679333

m2crypto

Invalid

Contains Python tests in setup.py

maas

Invalid

Has unit and integration tests

maas-enlist

LP: #1679334

mail-spf-perl

Invalid

Defined Testsuite in d/control

mako

Invalid

Contains Python tests in setup.py

markupsafe

Invalid

Contains Python tests in setup.py

maven-ant-helper

LP: #1679335

mcollective

LP: #1679336

mdbtools

LP: #1679337

migrationtools

LP: #1679338

mime-construct

LP: #1679339

minicom

LP: #1679340

moin

LP: #1679341

monitoring-plugins

Has test(s) directory

mtx

LP: #1679342

mvel

Has test(s) directory

mysql-defaults

Invalid

Meta package

nagios-images

Invalid

Images only

nagios-nrpe

LP: #1679345

nbd

Has test(s) directory

ndg-httpsclient

Has test(s) directory

net-snmp

Has test(s) directory

net-tools

LP: #1679346

netcf

Has test(s) directory

netty

Has test(s) directory

nicstat

LP: #1679347

nis

LP: #1679348

nmap

Has test(s) directory

nose

Invalid

Contains Python tests in setup.py

nspr

Has test(s) directory

nss

Has test(s) directory

ntdb

Has test(s) directory

ntp

Has test(s) directory

numactl

Has test(s) directory

oops

LP: #1679349

oops-amqp

LP: #1679350

oops-datedir-repo

LP: #1679351

oops-twisted

LP: #1679352

oops-wsgi

LP: #1679353

openbsd-inetd

Has test(s) directory

openhpi

Has test(s) directory

openipmi

LP: #1679354

openldap

Has test(s) directory

openvpn

Has test(s) directory

pam-p11

LP: #1679355

parsedatetime

Invalid

Contains Python tests in setup.py

pax

LP: #1679356

php-defaults

LP: #1679357

php-pear

Has test(s) directory

pm-utils

LP: #1679359

pnm2ppa

LP: #1679360

pollen

Invalid

Contains golang tests

pollinate

LP: #1679361

popt

LP: #1679362

powernap

LP: #1679363

pptpd

LP: #1679364

procmail

LP: #1679365

psmisc

Has test(s) directory

pwgen

LP: #1679368

pyjunitxml

Has test(s) directory

pylibmc

Has test(s) directory

python-amqplib

Has test(s) directory

python-cloudfiles

Invalid

Contains Python tests in setup.py

python-coffin

Has test(s) directory

python-cryptography-vectors

LP: #1679369

python-ddt

Has test(s) directory

python-dingus

LP: #1679370

python-django

Has test(s) directory

python-django-piston

Has test(s) directory

python-django-south

Has test(s) directory

python-dns

Has test(s) directory

python-elasticsearch

Invalid

Contains Python tests in setup.py

python-gevent

Invalid

Contains Python tests in setup.py

python-gflags

LP: #1679371

python-hacking

Has test(s) directory

python-happybase

Has test(s) directory

python-hplefthandclient

Has test(s) directory

python-httpretty

Invalid

Contains Python tests in setup.py

python-itsdangerous

Invalid

Defined Testsuite in d/control

python-jingo

Has test(s) directory

python-jsonrpclib

LP: #1679372

python-jujuclient

LP: #1679373

python-kajiki

Invalid

Contains Python tests in setup.py

python-ldappool

Has test(s) directory

python-mailer

LP: #1679374

python-mccabe

Invalid

Defined Testsuite in d/control

python-nine

Invalid

Contains Python tests in setup.py

python-nose-testconfig

LP: #1679375

python-nosehtmloutput

LP: #1679376

python-oauth

LP: #1679377

python-oauthlib

Invalid

Contains Python tests in setup.py

python-pyelftools

Has test(s) directory

python-pytyrant

LP: #1679378

python-recaptcha

LP: #1679379

python-requestbuilder

LP: #1679380

python-seamicroclient

Has test(s) directory

python-setuptools-git

Invalid

Contains Python tests in setup.py

python-stompy

Invalid

Contains Python tests in setup.py

python-sysv-ipc

LP: #1679381

python-tempita

Invalid

Contains Python tests in setup.py

python-termstyle

LP: #1679382

python-thrift

LP: #1679383

python-tx-tftp

Has test(s) directory

python-ws4py

Has test(s) directory

python-xstatic

LP: #1679384

qdox

Has test(s) directory

qemu

Has test(s) directory

quota

LP:1679385 #

rabbitmq-server

LP: #1679386

raphael

LP: #1679387

re2c

Has test(s) directory

requests

Invalid

Contains Python tests in setup.py

rpcbind

LP: #1679390

rrdtool

Has test(s) directory

rsync

Has test(s) directory

ruby-augeas

Invalid

Defined Testsuite in d/control

ruby-childprocess

Invalid

Defined Testsuite in d/control

ruby-hashie

Invalid

Defined Testsuite in d/control

ruby-indentation

Invalid

Defined Testsuite in d/control

ruby-json

Has test(s) directory

ruby-molinillo

Has test(s) directory

ruby-net-http-persistent

Has test(s) directory

ruby-rspec

Has test(s) directory

ruby-safe-yaml

Invalid

Defined Testsuite in d/control

ruby-shadow

Invalid

Defined Testsuite in d/control

run-one

LP: #1679388

seabios

LP: #1679389

setserial

LP: #1679391

sg3-utils

LP: #1679392

sharutils

Has test(s) directory

shtool

LP: #1679393

siege

LP: #1679394

simplestreams

Invalid

Has unit tests

slof

LP: #1679395

smartmontools

LP: #1679396

socat

LP: #1679397

sphinxcontrib-httpdomain

LP: #1679398

sphinxcontrib-pecanwsme

LP: #1679399

sphinxcontrib-programoutput

Has test(s) directory

spice

Has test(s) directory

spice-protocol

LP: #1679401

squid-deb-proxy

Has test(s) directory

squid-langpack

LP: #1679403

ssh-import-id

LP: #1679404

ssl-cert

LP: #1679405

sssd

Has test(s) directory

subunit

Has test(s) directory

sysstat

LP: #1679406

taglibs-standard

Has test(s) directory

tevent

Has test(s) directory

tftp-hpa

LP: #1679407

tickcount

LP: #1679408

tinycdb

LP: #1679409

tmux

LP: #1679410

tomcat7

Has test(s) directory

tomcat8

Has test(s) directory

tomsfastmath

LP: #1679411

txamqp

Has test(s) directory

txaws

Has test(s) directory

txlongpoll

Has test(s) directory

txzookeeper

Invalid

Contains Python tests in setup.py

ubuntu-cloudimage-keyring

Invalid

keyring

ubuntu-virt

Invalid

Meta package

unbound

LP: #1679412

unixodbc

LP: #1679413

urlgrabber

Has test(s) directory

urwid

Invalid

Contains Python tests in setup.py

usbredir

LP: #1679414

uucp

LP: #1679415

uvtool

Has test(s) directory

vblade

LP: #1679416

vblade-persist

LP: #1679418

vcversioner

LP: #1679419

vgabios

Has test(s) directory

vlan

LP: #1679420

vlock

Has test(s) directory

vm-builder

Has test(s) directory

w3m

Has test(s) directory

wakeonlan

LP: #1679421

walinuxagent

Has test(s) directory

websocket-client

Invalid

Contains Python tests in setup.py

websockify

Has test(s) directory

whois

LP: #1679422

wss4j

Has test(s) directory

xen

Has test(s) directory

xinetd

LP: #1679423

xmlrpc-epi

Has test(s) directory

xmlunit

Has test(s) directory

xz-java

LP: #1679424

yajl

Has test(s) directory

yui3

Has test(s) directory

ServerTeam/dep8 (last edited 2017-04-18 21:27:26 by powersj)