dep8
Server Team dep8 Status
Overview
The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages.
This page tracks the status of dep8 tests existing in server team owned packages as defined by the package-to-team mappings.
Process
Given the package-to-team mappings, in order to determine whether a package had dep8 tests or not the following was done for every package owned by the 'server-team': Download the latest source via pull-lp-source <package name> zesty
- [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise
grep debian/control 'Testsuite:'
- [dep8] - do dep8 tests exists via the presence of:
- debian/tests
- debian/tests/control
- [go] - contains build time go-based tests
find . -name *_test.go
- [python] - setup.py has a test_suite defined
grep setup.py 'test_suite'
This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries or source only.
Launchpad Bugs
For each package a Launchpad bug was filed with the tag 'needs-dep8'.
Data
Following was determined on March 29, 2017. Of the 521 packages under 'ubuntu-server':
374 packages do not have dep8 tests (Link)
90 packages have dep8 tests (Link)
57 packages are not available in zesty (Link)
Once removing packages that have golang tests, python test_suite in setup.py, or test-suite set in the control file the number drops to 312 (Link)
Packages Missing dep8 Tests
Name |
LP Bug |
Status |
Notes |
acpica-unix |
|
|
|
amavisd-new |
|
|
|
analog |
|
|
|
ant-contrib |
|
|
|
antlr3 |
|
|
|
apr |
|
|
|
asterisk |
|
|
|
at |
|
|
|
augeas |
|
|
|
authbind |
|
|
|
autofs |
|
|
|
awscli |
|
|
|
awstats |
|
|
|
backuppc |
|
|
|
bacula |
|
|
|
bcache-tools |
|
|
|
beanstalkc |
|
|
|
beautifulsoup |
|
|
|
billiard |
|
|
|
bind9 |
|
|
|
blinker |
|
|
|
bridge-utils |
|
|
|
bsd-mailx |
|
|
|
byobu |
|
|
|
c3p0 |
|
|
|
cglib |
|
|
|
cglib3 |
|
|
|
cgroup-lite |
|
|
|
charm-tools |
|
|
|
checksecurity |
|
|
|
cheetah |
|
|
|
chkrootkit |
|
|
|
cloud-init |
|
|
|
cloud-initramfs-tools |
|
|
|
cluster-glue |
|
|
|
cobbler-enlist |
|
|
|
commons-io |
|
|
|
commons-vfs |
|
|
|
curtin |
|
|
|
cyrus-sasl2 |
|
|
|
dh-php |
|
|
|
ding-libs |
|
|
|
dlm |
|
|
|
dns-root-data |
|
|
|
dnsjava |
|
|
|
dnsmasq |
|
|
|
dnstracer |
|
|
|
drac |
|
|
|
drbd-utils |
|
|
|
dwarves-dfsg |
|
|
|
ebtables |
|
|
|
ec2-ami-tools |
|
|
|
ec2-api-tools |
|
|
|
elinks |
|
|
|
etckeeper |
|
|
|
ethtool |
|
|
|
euca2ools |
|
|
|
excalibur-logkit |
|
|
|
eximdoc4 |
|
|
|
fetchmail |
|
|
|
freeipmi |
|
|
|
geronimo-ejb-3.0-spec |
|
|
|
geronimo-interceptor-3.0-spec |
|
|
|
geronimo-j2ee-connector-1.5-spec |
|
|
|
geronimo-jacc-1.1-spec |
|
|
|
geronimo-jms-1.1-spec |
|
|
|
geronimo-jpa-3.0-spec |
|
|
|
golang-1.6 |
|
|
|
golang-1.6-race-detector-runtime |
|
|
|
golang-1.7 |
|
|
|
golang-check.v1 |
|
|
|
golang-context |
Invalid |
Package has tests which are run at build time |
|
golang-github-bmizerany-assert |
|
|
|
golang-github-bmizerany-pat |
|
|
|
golang-github-gorilla-mux |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-colorable |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-isatty |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-sqlite3 |
Invalid |
Package has tests which are run at build time |
|
golang-github-olekukonko-tablewriter |
Invalid |
Package has tests which are run at build time |
|
golang-github-pborman-uuid |
Invalid |
Package has tests which are run at build time |
|
golang-go-dbus |
|
|
|
golang-go.crypto |
Invalid |
Package has tests which are run at build time |
|
golang-gocapability-dev |
Invalid |
Package has tests which are run at build time |
|
golang-golang-x-net-dev |
|
|
|
golang-gopkg-flosch-pongo2.v3 |
Invalid |
Package has tests which are run at build time |
|
golang-gopkg-inconshreveable-log15.v2 |
Invalid |
Package has tests which are run at build time |
|
golang-gopkg-tomb.v2 |
Invalid |
Package has tests which are run at build time |
|
golang-goprotobuf |
Invalid |
Package has tests which are run at build time |
|
golang-juju-loggo |
|
|
|
golang-petname |
Invalid |
Package has tests which are run at build time |
|
golang-pretty |
|
|
|
golang-text |
|
|
|
golang-x-text |
|
|
|
golang-yaml.v2 |
Invalid |
Package has tests which are run at build time |
|
google-apputils-python |
|
|
|
groovy |
|
|
|
hardlink |
|
|
|
heartbeat |
|
|
|
heimdal |
|
|
|
htop |
|
|
|
http-parser |
|
|
|
ibmasm-utils |
|
|
|
iotop |
|
|
|
ipmitool |
|
|
|
iproute2 |
|
|
|
ipsec-tools |
|
|
|
iptraf-ng |
|
|
|
ipvsadm |
|
|
|
ipxe |
|
|
|
irqbalance |
|
|
|
janino |
|
|
|
joyent-mdata-client |
|
|
|
jug |
|
|
|
keepalived |
|
|
|
kerberos-configs |
|
|
|
krb5 |
|
|
|
ldap-auth-client |
|
|
|
ldb |
|
|
|
ldns |
|
|
|
libaio |
|
|
|
libapache-mod-auth-kerb |
|
|
|
libapache2-mod-auth-pgsql |
|
|
|
libapache2-mod-auth-plain |
|
|
|
libapache2-reload-perl |
|
|
|
libaxiom-java |
|
|
|
libcacard |
|
|
|
libcgroup |
|
|
|
libcommons-cli-java |
|
|
|
libcommons-compress-java |
|
|
|
libcommons-fileupload-java |
|
|
|
libcommons-jxpath-java |
|
|
|
libconfig-general-perl |
|
|
|
libcss-minifier-xs-perl |
|
|
|
libdbi |
|
|
|
libdbi-drivers |
|
|
|
libecap |
|
|
|
libesmtp |
|
|
|
libezmorph-java |
|
|
|
libfcgi-perl |
|
|
|
libibverbs |
|
|
|
libiscsi |
|
|
|
libjavascript-minifier-xs-perl |
|
|
|
libjson-java |
|
|
|
liblockfile |
|
|
|
libmemcached |
|
|
|
libmime-tools-perl |
|
|
|
libmnl |
|
|
|
libmspack |
|
|
|
libnet |
|
|
|
libnetfilter-conntrack |
|
|
|
libnetfilter-cthelper |
|
|
|
libnetfilter-cttimeout |
|
|
|
libnetfilter-queue |
|
|
|
libnl3 |
|
|
|
libnss-ldap |
|
|
|
libp11 |
|
|
|
libpam-ldap |
|
|
|
libpam-mount |
|
|
|
libpam-radius-auth |
|
|
|
libparse-recdescent-perl |
|
|
|
libparse-yapp-perl |
|
|
|
libpcap |
|
|
|
librabbitmq |
|
|
|
librdmacm |
|
|
|
librtas |
|
|
|
libs3 |
|
|
|
libsdl1.2 |
|
|
|
libslf4j-java |
|
|
|
libstatgrab |
|
|
|
libtime-parsedate-perl |
|
|
|
libtirpc |
|
|
|
libtommath |
|
|
|
liburcu |
|
|
|
libxml-security-java |
|
|
|
libxml-xpath-perl |
|
|
|
libyaml |
|
|
|
lm-sensors |
|
|
|
logcheck |
|
|
|
logwatch |
|
|
|
lsscsi |
|
|
|
lua-lpeg |
|
|
|
lua5.2 |
|
|
|
m2300w |
|
|
|
m2crypto |
|
|
|
maas |
|
|
|
maas-enlist |
|
|
|
mail-spf-perl |
|
|
|
mako |
|
|
|
markupsafe |
|
|
|
maven-ant-helper |
|
|
|
mcollective |
|
|
|
mdbtools |
|
|
|
migrationtools |
|
|
|
mime-construct |
|
|
|
minicom |
|
|
|
moin |
|
|
|
monitoring-plugins |
|
|
|
mtx |
|
|
|
mvel |
|
|
|
mysql-defaults |
|
|
|
nagios-images |
|
|
|
nagios-nrpe |
|
|
|
nbd |
|
|
|
ndg-httpsclient |
|
|
|
net-snmp |
|
|
|
net-tools |
|
|
|
netcf |
|
|
|
netty |
|
|
|
nicstat |
|
|
|
nis |
|
|
|
nmap |
|
|
|
nose |
|
|
|
nspr |
|
|
|
nss |
|
|
|
ntdb |
|
|
|
ntp |
|
|
|
numactl |
|
|
|
oops |
|
|
|
oops-amqp |
|
|
|
oops-datedir-repo |
|
|
|
oops-twisted |
|
|
|
oops-wsgi |
|
|
|
openbsd-inetd |
|
|
|
openhpi |
|
|
|
openipmi |
|
|
|
openldap |
|
|
|
openvpn |
|
|
|
pam-p11 |
|
|
|
parsedatetime |
|
|
|
pax |
|
|
|
php-defaults |
|
|
|
php-pear |
|
|
|
pm-utils |
|
|
|
pnm2ppa |
|
|
|
pollen |
|
|
|
pollinate |
|
|
|
popt |
|
|
|
powernap |
|
|
|
pptpd |
|
|
|
procmail |
|
|
|
psmisc |
|
|
|
pwgen |
|
|
|
pyjunitxml |
|
|
|
pylibmc |
|
|
|
python-amqplib |
|
|
|
python-cloudfiles |
|
|
|
python-coffin |
|
|
|
python-cryptography-vectors |
|
|
|
python-ddt |
|
|
|
python-dingus |
|
|
|
python-django |
|
|
|
python-django-piston |
|
|
|
python-django-south |
|
|
|
python-dns |
|
|
|
python-elasticsearch |
|
|
|
python-gevent |
|
|
|
python-gflags |
|
|
|
python-hacking |
|
|
|
python-happybase |
|
|
|
python-hplefthandclient |
|
|
|
python-httpretty |
|
|
|
python-itsdangerous |
|
|
|
python-jingo |
|
|
|
python-jsonrpclib |
|
|
|
python-jujuclient |
|
|
|
python-kajiki |
|
|
|
python-ldappool |
|
|
|
python-mailer |
|
|
|
python-mccabe |
|
|
|
python-nine |
|
|
|
python-nose-testconfig |
|
|
|
python-nosehtmloutput |
|
|
|
python-oauth |
|
|
|
python-oauthlib |
|
|
|
python-pyelftools |
|
|
|
python-pytyrant |
|
|
|
python-recaptcha |
|
|
|
python-requestbuilder |
|
|
|
python-seamicroclient |
|
|
|
python-setuptools-git |
|
|
|
python-stompy |
|
|
|
python-sysv-ipc |
|
|
|
python-tempita |
|
|
|
python-termstyle |
|
|
|
python-thrift |
|
|
|
python-tx-tftp |
|
|
|
python-ws4py |
|
|
|
python-xstatic |
|
|
|
qdox |
|
|
|
qemu |
|
|
|
quota |
|
|
|
rabbitmq-server |
|
|
|
raphael |
|
|
|
re2c |
|
|
|
requests |
|
|
|
rpcbind |
|
|
|
rrdtool |
|
|
|
rsync |
|
|
|
ruby-augeas |
|
|
|
ruby-childprocess |
|
|
|
ruby-hashie |
|
|
|
ruby-indentation |
|
|
|
ruby-json |
|
|
|
ruby-molinillo |
|
|
|
ruby-net-http-persistent |
|
|
|
ruby-rspec |
|
|
|
ruby-safe-yaml |
|
|
|
ruby-shadow |
|
|
|
run-one |
|
|
|
seabios |
|
|
|
setserial |
|
|
|
sg3-utils |
|
|
|
sharutils |
|
|
|
shtool |
|
|
|
siege |
|
|
|
simplestreams |
|
|
|
slof |
|
|
|
smartmontools |
|
|
|
socat |
|
|
|
sphinxcontrib-httpdomain |
|
|
|
sphinxcontrib-pecanwsme |
|
|
|
sphinxcontrib-programoutput |
|
|
|
spice |
|
|
|
spice-protocol |
|
|
|
squid-deb-proxy |
|
|
|
squid-langpack |
|
|
|
ssh-import-id |
|
|
|
ssl-cert |
|
|
|
sssd |
|
|
|
subunit |
|
|
|
sysstat |
|
|
|
taglibs-standard |
|
|
|
tevent |
|
|
|
tftp-hpa |
|
|
|
tickcount |
|
|
|
tinycdb |
|
|
|
tmux |
|
|
|
tomcat7 |
|
|
|
tomcat8 |
|
|
|
tomsfastmath |
|
|
|
txamqp |
|
|
|
txaws |
|
|
|
txlongpoll |
|
|
|
txzookeeper |
|
|
|
ubuntu-cloudimage-keyring |
|
|
|
ubuntu-virt |
|
|
|
unbound |
|
|
|
unixodbc |
|
|
|
urlgrabber |
|
|
|
urwid |
|
|
|
usbredir |
|
|
|
uucp |
|
|
|
uvtool |
|
|
|
vblade |
|
|
|
vblade-persist |
|
|
|
vcversioner |
|
|
|
vgabios |
|
|
|
vlan |
|
|
|
vlock |
|
|
|
vm-builder |
|
|
|
w3m |
|
|
|
wakeonlan |
|
|
|
walinuxagent |
|
|
|
websocket-client |
|
|
|
websockify |
|
|
|
whois |
|
|
|
wss4j |
|
|
|
xen |
|
|
|
xinetd |
|
|
|
xmlrpc-epi |
|
|
|
xmlunit |
|
|
|
xz-java |
|
|
|
yajl |
|
|
|
yui3 |
|
|