dep8
Server Team dep8 Status
Overview
The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages.
This page tracks the status of dep8 tests existing in server team owned packages as defined by the package-to-team mappings.
Process
Given the package-to-team mappings, in order to determine whether a package had dep8 tests or not the following was done for every package owned by the 'server-team': Download the latest source via pull-lp-source <package name> zesty
- [dep8] - do dep8 tests exists via the presence of:
- debian/tests
- debian/tests/control
- [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise
grep debian/control 'Testsuite:'
- [go] - contains build time go-based tests
find . -name *_test.go
- [python] - setup.py has a test_suite defined
grep setup.py 'test_suite'
- Search for directories indicating tests
- Search for a 'test', 'tests', 'testsuite', or 'test-suite' directory
This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries, or source only.
Launchpad Bugs
For each package a Launchpad bug was filed with the tag 'needs-dep8'.
Results
Following was determined on April 3, 2017. Of the 464 packages under 'ubuntu-server' in Zesty:
- 149 source packages (32.1%) have no detected tests
- 135 source packages (29.1%) have test/tests directories
90 source packages (19.4%) have dep8 tests (Link)
- 27 source packages (5.8%) have golang tests
- 20 source packages (4.3%) have python tests defined in setup.py
- 17 source packages (3.7%) have test suites defined in d/control
Other packages include meta packages, source only packages, and/or packages with known upstream integration tests.
Opportunities
Key
This table explains further some of the notes found below.
Note |
Meaning |
Defined Testsuite in d/control |
debian/control file has a 'Testsuite:' or 'XS-Testsuite:' entry; found by #2 above |
Contains golang tests |
Has files named *_test.go; found by #3 above |
Contains Python tests in setup.py |
Has a test_suite entry in setup.py; found by #4 above |
Has test(s) directory |
Has a directory found by #5 above |
Has unit and integration tests |
Has external, but known, extensive tests |
Meta package |
No need for tests on meta packages |
Table
Name |
LP Bug/Status |
Notes |
acpica-unix |
Has test(s) directory |
|
amavisd-new |
|
|
analog |
|
|
ant-contrib |
Has test(s) directory |
|
antlr3 |
Has test(s) directory |
|
apr |
Has test(s) directory |
|
asterisk |
Has test(s) directory |
|
at |
|
|
augeas |
Has test(s) directory |
|
authbind |
|
|
autofs |
|
|
awscli |
|
|
awstats |
|
|
backuppc |
|
|
bacula |
|
|
bcache-tools |
|
|
beanstalkc |
Has test(s) directory |
|
beautifulsoup |
|
|
billiard |
Invalid |
Contains Python tests in setup.py |
bind9 |
Has test(s) directory |
|
blinker |
Has test(s) directory |
|
bridge-utils |
Has test(s) directory |
|
bsd-mailx |
|
|
byobu |
Has test(s) directory |
|
c3p0 |
Has test(s) directory |
|
cglib |
Has test(s) directory |
|
cglib3 |
Has test(s) directory |
|
cgroup-lite |
|
|
charm-tools |
Has test(s) directory |
|
checksecurity |
|
|
cheetah |
Has test(s) directory |
|
chkrootkit |
|
|
cloud-init |
Invalid |
Has unit and integration tests |
cloud-initramfs-tools |
|
|
cluster-glue |
Has test(s) directory |
|
cobbler-enlist |
|
|
commons-io |
Has test(s) directory |
|
commons-vfs |
Has test(s) directory |
|
curtin |
Invalid |
Has unit and integration tests |
cyrus-sasl2 |
|
|
dh-php |
|
|
ding-libs |
|
|
dlm |
|
|
dns-root-data |
|
|
dnsjava |
Has test(s) directory |
|
dnsmasq |
|
|
dnstracer |
|
|
drac |
|
|
drbd-utils |
|
|
dwarves-dfsg |
|
|
ebtables |
|
|
ec2-ami-tools |
Has test(s) directory |
|
ec2-api-tools |
|
|
elinks |
Has test(s) directory |
|
etckeeper |
|
|
ethtool |
|
|
euca2ools |
|
|
excalibur-logkit |
Has test(s) directory |
|
eximdoc4 |
|
|
fetchmail |
|
|
freeipmi |
|
|
geronimo-ejb-3.0-spec |
|
|
geronimo-interceptor-3.0-spec |
|
|
geronimo-j2ee-connector-1.5-spec |
Has test(s) directory |
|
geronimo-jacc-1.1-spec |
Has test(s) directory |
|
geronimo-jms-1.1-spec |
Has test(s) directory |
|
geronimo-jpa-3.0-spec |
|
|
golang-1.6 |
Invalid |
Contains golang tests |
golang-1.6-race-detector-runtime |
Has test(s) directory |
|
golang-1.7 |
Invalid |
Contains golang tests |
golang-check.v1 |
Invalid |
Contains golang tests |
golang-context |
Invalid |
Contains golang tests |
golang-github-bmizerany-assert |
Invalid |
Contains golang tests |
golang-github-bmizerany-pat |
Invalid |
Contains golang tests |
golang-github-gorilla-mux |
Invalid |
Contains golang tests |
golang-github-mattn-go-colorable |
Invalid |
Contains golang tests |
golang-github-mattn-go-isatty |
Invalid |
Contains golang tests |
golang-github-mattn-go-sqlite3 |
Invalid |
Contains golang tests |
golang-github-olekukonko-tablewriter |
Invalid |
Contains golang tests |
golang-github-pborman-uuid |
Invalid |
Contains golang tests |
golang-go-dbus |
Invalid |
Contains golang tests |
golang-go.crypto |
Invalid |
Contains golang tests |
golang-gocapability-dev |
Invalid |
Contains golang tests |
golang-golang-x-net-dev |
Invalid |
Contains golang tests |
golang-gopkg-flosch-pongo2.v3 |
Invalid |
Contains golang tests |
golang-gopkg-inconshreveable-log15.v2 |
Invalid |
Contains golang tests |
golang-gopkg-tomb.v2 |
Invalid |
Contains golang tests |
golang-goprotobuf |
Invalid |
Contains golang tests |
golang-juju-loggo |
Invalid |
Contains golang tests |
golang-petname |
Invalid |
Contains golang tests |
golang-pretty |
Invalid |
Contains golang tests |
golang-text |
Invalid |
Contains golang tests |
golang-x-text |
Invalid |
Contains golang tests |
golang-yaml.v2 |
Invalid |
Contains golang tests |
google-apputils-python |
|
|
groovy |
Has test(s) directory |
|
hardlink |
Has test(s) directory |
|
heartbeat |
|
|
heimdal |
Has test(s) directory |
|
htop |
|
|
http-parser |
|
|
ibmasm-utils |
|
|
iotop |
|
|
ipmitool |
|
|
iproute2 |
Has test(s) directory |
|
ipsec-tools |
|
|
iptraf-ng |
|
|
ipvsadm |
|
|
ipxe |
Has test(s) directory |
|
irqbalance |
|
|
janino |
Has test(s) directory |
|
joyent-mdata-client |
|
|
jug |
Has test(s) directory |
|
keepalived |
|
|
kerberos-configs |
|
|
krb5 |
Has test(s) directory |
|
ldap-auth-client |
|
|
ldb |
Has test(s) directory |
|
ldns |
|
|
libaio |
|
|
libapache-mod-auth-kerb |
|
|
libapache2-mod-auth-pgsql |
|
|
libapache2-mod-auth-plain |
|
|
libapache2-reload-perl |
Fix coming |
|
libaxiom-java |
Has test(s) directory |
|
libcacard |
|
|
libcgroup |
|
Has test(s) directory |
libcommons-cli-java |
|
Has test(s) directory |
libcommons-compress-java |
|
Has test(s) directory |
libcommons-fileupload-java |
|
Has test(s) directory |
libcommons-jxpath-java |
|
Has test(s) directory |
libconfig-general-perl |
Invalid |
Defined Testsuite in d/control |
libcss-minifier-xs-perl |
Invalid |
Defined Testsuite in d/control |
libdbi |
Invalid |
Library |
libdbi-drivers |
|
Has test(s) directory |
libecap |
Invalid |
Library |
libesmtp |
Invalid |
Library |
libezmorph-java |
|
Has test(s) directory |
libfcgi-perl |
Invalid |
Defined Testsuite in d/control |
libibverbs |
Invalid |
Library |
libiscsi |
|
Has test(s) directory |
libjavascript-minifier-xs-perl |
Invalid |
Defined Testsuite in d/control |
libjson-java |
|
Has test(s) directory |
liblockfile |
Invalid |
Library |
libmemcached |
|
Has test(s) directory |
libmime-tools-perl |
Invalid |
Defined Testsuite in d/control |
libmnl |
Invalid |
Library |
libmspack |
|
Has test(s) directory |
libnet |
Invalid |
Library |
libnetfilter-conntrack |
Invalid |
Library |
libnetfilter-cthelper |
Invalid |
Library |
libnetfilter-cttimeout |
Invalid |
Library |
libnetfilter-queue |
Invalid |
Library |
libnl3 |
|
Has test(s) directory |
libnss-ldap |
Invalid |
Library |
libp11 |
|
Has test(s) directory |
libpam-ldap |
|
Has test(s) directory |
libpam-mount |
|
|
libpam-radius-auth |
Invalid |
Library |
libparse-recdescent-perl |
Invalid |
Defined Testsuite in d/control |
libparse-yapp-perl |
|
|
libpcap |
|
Has test(s) directory |
librabbitmq |
|
Has test(s) directory |
librdmacm |
Invalid |
Library |
librtas |
Invalid |
Library |
libs3 |
|
Has test(s) directory |
libsdl1.2 |
|
Has test(s) directory |
libslf4j-java |
|
Has test(s) directory |
libstatgrab |
|
Has test(s) directory |
libtime-parsedate-perl |
Invalid |
Defined Testsuite in d/control |
libtirpc |
Invalid |
Library |
libtommath |
Invalid |
Library |
liburcu |
|
Has test(s) directory |
libxml-security-java |
|
Has test(s) directory |
libxml-xpath-perl |
Invalid |
Defined Testsuite in d/control |
libyaml |
|
Has test(s) directory |
lm-sensors |
|
Has test(s) directory |
logcheck |
|
Has test(s) directory |
logwatch |
|
|
lsscsi |
|
|
lua-lpeg |
|
|
lua5.2 |
|
|
m2300w |
|
|
m2crypto |
Invalid |
Contains Python tests in setup.py |
maas |
Invalid |
Has unit and integration tests |
maas-enlist |
|
|
mail-spf-perl |
Invalid |
Defined Testsuite in d/control |
mako |
Invalid |
Contains Python tests in setup.py |
markupsafe |
Invalid |
Contains Python tests in setup.py |
maven-ant-helper |
|
|
mcollective |
|
|
mdbtools |
|
|
migrationtools |
|
|
mime-construct |
|
|
minicom |
|
|
moin |
|
|
monitoring-plugins |
|
Has test(s) directory |
mtx |
|
|
mvel |
|
Has test(s) directory |
mysql-defaults |
Invalid |
Meta package |
nagios-images |
Invalid |
Images only |
nagios-nrpe |
|
|
nbd |
|
Has test(s) directory |
ndg-httpsclient |
|
Has test(s) directory |
net-snmp |
|
Has test(s) directory |
net-tools |
|
|
netcf |
|
Has test(s) directory |
netty |
|
Has test(s) directory |
nicstat |
|
|
nis |
|
|
nmap |
|
Has test(s) directory |
nose |
Invalid |
Contains Python tests in setup.py |
nspr |
|
Has test(s) directory |
nss |
|
Has test(s) directory |
ntdb |
|
Has test(s) directory |
ntp |
|
Has test(s) directory |
numactl |
|
Has test(s) directory |
oops |
|
|
oops-amqp |
|
|
oops-datedir-repo |
|
|
oops-twisted |
|
|
oops-wsgi |
|
|
openbsd-inetd |
|
Has test(s) directory |
openhpi |
|
Has test(s) directory |
openipmi |
|
|
openldap |
|
Has test(s) directory |
openvpn |
|
Has test(s) directory |
pam-p11 |
|
|
parsedatetime |
Invalid |
Contains Python tests in setup.py |
pax |
|
|
php-defaults |
|
|
php-pear |
|
Has test(s) directory |
pm-utils |
|
|
pnm2ppa |
|
|
pollen |
Invalid |
Contains golang tests |
pollinate |
|
|
popt |
|
|
powernap |
|
|
pptpd |
|
|
procmail |
|
|
psmisc |
|
Has test(s) directory |
pwgen |
|
|
pyjunitxml |
|
Has test(s) directory |
pylibmc |
|
Has test(s) directory |
python-amqplib |
|
Has test(s) directory |
python-cloudfiles |
Invalid |
Contains Python tests in setup.py |
python-coffin |
|
Has test(s) directory |
python-cryptography-vectors |
|
|
python-ddt |
|
Has test(s) directory |
python-dingus |
|
|
python-django |
|
Has test(s) directory |
python-django-piston |
|
Has test(s) directory |
python-django-south |
|
Has test(s) directory |
python-dns |
|
Has test(s) directory |
python-elasticsearch |
Invalid |
Contains Python tests in setup.py |
python-gevent |
Invalid |
Contains Python tests in setup.py |
python-gflags |
|
|
python-hacking |
|
Has test(s) directory |
python-happybase |
|
Has test(s) directory |
python-hplefthandclient |
|
Has test(s) directory |
python-httpretty |
Invalid |
Contains Python tests in setup.py |
python-itsdangerous |
Invalid |
Defined Testsuite in d/control |
python-jingo |
|
Has test(s) directory |
python-jsonrpclib |
|
|
python-jujuclient |
|
|
python-kajiki |
Invalid |
Contains Python tests in setup.py |
python-ldappool |
|
Has test(s) directory |
python-mailer |
|
|
python-mccabe |
Invalid |
Defined Testsuite in d/control |
python-nine |
Invalid |
Contains Python tests in setup.py |
python-nose-testconfig |
|
|
python-nosehtmloutput |
|
|
python-oauth |
|
|
python-oauthlib |
Invalid |
Contains Python tests in setup.py |
python-pyelftools |
|
Has test(s) directory |
python-pytyrant |
|
|
python-recaptcha |
|
|
python-requestbuilder |
|
|
python-seamicroclient |
|
Has test(s) directory |
python-setuptools-git |
Invalid |
Contains Python tests in setup.py |
python-stompy |
Invalid |
Contains Python tests in setup.py |
python-sysv-ipc |
|
|
python-tempita |
Invalid |
Contains Python tests in setup.py |
python-termstyle |
|
|
python-thrift |
|
|
python-tx-tftp |
|
Has test(s) directory |
python-ws4py |
|
Has test(s) directory |
python-xstatic |
|
|
qdox |
|
Has test(s) directory |
qemu |
|
Has test(s) directory |
quota |
|
|
rabbitmq-server |
|
|
raphael |
|
|
re2c |
|
Has test(s) directory |
requests |
Invalid |
Contains Python tests in setup.py |
rpcbind |
|
|
rrdtool |
|
Has test(s) directory |
rsync |
|
Has test(s) directory |
ruby-augeas |
Invalid |
Defined Testsuite in d/control |
ruby-childprocess |
Invalid |
Defined Testsuite in d/control |
ruby-hashie |
Invalid |
Defined Testsuite in d/control |
ruby-indentation |
Invalid |
Defined Testsuite in d/control |
ruby-json |
|
Has test(s) directory |
ruby-molinillo |
|
Has test(s) directory |
ruby-net-http-persistent |
|
Has test(s) directory |
ruby-rspec |
|
Has test(s) directory |
ruby-safe-yaml |
Invalid |
Defined Testsuite in d/control |
ruby-shadow |
Invalid |
Defined Testsuite in d/control |
run-one |
|
|
seabios |
|
|
setserial |
|
|
sg3-utils |
|
|
sharutils |
|
Has test(s) directory |
shtool |
|
|
siege |
|
|
simplestreams |
Invalid |
Has unit tests |
slof |
|
|
smartmontools |
|
|
socat |
|
|
sphinxcontrib-httpdomain |
|
|
sphinxcontrib-pecanwsme |
|
|
sphinxcontrib-programoutput |
|
Has test(s) directory |
spice |
|
Has test(s) directory |
spice-protocol |
|
|
squid-deb-proxy |
|
Has test(s) directory |
squid-langpack |
|
|
ssh-import-id |
|
|
ssl-cert |
|
|
sssd |
|
Has test(s) directory |
subunit |
|
Has test(s) directory |
sysstat |
|
|
taglibs-standard |
|
Has test(s) directory |
tevent |
|
Has test(s) directory |
tftp-hpa |
|
|
tickcount |
|
|
tinycdb |
|
|
tmux |
|
|
tomcat7 |
|
Has test(s) directory |
tomcat8 |
|
Has test(s) directory |
tomsfastmath |
|
|
txamqp |
|
Has test(s) directory |
txaws |
|
Has test(s) directory |
txlongpoll |
|
Has test(s) directory |
txzookeeper |
Invalid |
Contains Python tests in setup.py |
ubuntu-cloudimage-keyring |
Invalid |
keyring |
ubuntu-virt |
Invalid |
Meta package |
unbound |
|
|
unixodbc |
|
|
urlgrabber |
|
Has test(s) directory |
urwid |
Invalid |
Contains Python tests in setup.py |
usbredir |
|
|
uucp |
|
|
uvtool |
|
Has test(s) directory |
vblade |
|
|
vblade-persist |
|
|
vcversioner |
|
|
vgabios |
|
Has test(s) directory |
vlan |
|
|
vlock |
|
Has test(s) directory |
vm-builder |
|
Has test(s) directory |
w3m |
|
Has test(s) directory |
wakeonlan |
|
|
walinuxagent |
|
Has test(s) directory |
websocket-client |
Invalid |
Contains Python tests in setup.py |
websockify |
|
Has test(s) directory |
whois |
|
|
wss4j |
|
Has test(s) directory |
xen |
|
Has test(s) directory |
xinetd |
|
|
xmlrpc-epi |
|
Has test(s) directory |
xmlunit |
|
Has test(s) directory |
xz-java |
|
|
yajl |
|
Has test(s) directory |
yui3 |
|
Has test(s) directory |
ServerTeam/dep8 (last edited 2017-04-18 21:27:26 by powersj)