dep8
|
Size: 40083
Comment:
|
Size: 40448
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 4: | Line 4: |
| This page tracks the status of dep8 tests existing in server team owned packages as defined by the [[http://people.canonical.com/~ubuntu-archive/package-team-mapping.json|package-to-team mappings]]. The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing, it provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages. | The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages. This page tracks the status of dep8 tests existing in server team owned packages as defined by the [[http://people.canonical.com/~ubuntu-archive/package-team-mapping.json|package-to-team mappings]]. |
| Line 10: | Line 12: |
| 2. Examine for the presence of the following in the source | 2. [dep8] - do dep8 tests exists via the presence of: |
| Line 13: | Line 15: |
This is a very crude method that leaves out the following possibilities: * Other language tests that are run at packaging and build time (e.g. go's _test.go files or python's setup.py has test_suite defined) * If a package has significant integration or package level testing (e.g. curtin's vmtest) |
3. [go] - contains build-time go-based tests * ```find . -name *_test.go``` 4. [python] - setup.py has a testsuite * ```grep setup.py 'test_suite'``` 5. [testsuite] - control file calls out an * ```grep debian/control '^Testsuite:'``` 6. [testdir] * If any directory named test or tests exist 7. [metapackage] - does the package only have a debian directory 8. [libs] - is the section declared as libs * ```grep debian/control '^Section: libs'``` This is a very crude method that leaves out the additional possibilities for other languages. These checks can continue to be added as time goes on. |
Server Team dep8 Status
Overview
The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages.
This page tracks the status of dep8 tests existing in server team owned packages as defined by the package-to-team mappings.
Process
Given the package-to-team mappings, in order to determine whether a package had dep8 tests or not the following was done for every package owned by the 'server-team':
Download the latest source via pull-lp-source <package name> zesty
- [dep8] - do dep8 tests exists via the presence of:
- debian/tests
- debian/tests/control
- [go] - contains build-time go-based tests
find . -name *_test.go
- [python] - setup.py has a testsuite
grep setup.py 'test_suite'
- [testsuite] - control file calls out an
grep debian/control '^Testsuite:'
- [testdir]
- If any directory named test or tests exist
- [metapackage] - does the package only have a debian directory
- [libs] - is the section declared as libs
grep debian/control '^Section: libs'
This is a very crude method that leaves out the additional possibilities for other languages. These checks can continue to be added as time goes on.
Launchpad Bugs
For each package a Launchpad bug was filed with the tag 'needs-dep8'.
Data
Following was determined on March 29, 2017.
374 packages do not have dep8 tests (Link)
90 packages have dep8 tests (Link)
57 packages are not available in zesty (Link)
Packages Missing dep8 Tests
Name |
LP Bug |
Status |
Notes |
acpica-unix |
|
|
|
amavisd-new |
|
|
|
analog |
|
|
|
ant-contrib |
|
|
|
antlr3 |
|
|
|
apr |
|
|
|
asterisk |
|
|
|
at |
|
|
|
augeas |
|
|
|
authbind |
|
|
|
autofs |
|
|
|
awscli |
|
|
|
awstats |
|
|
|
backuppc |
|
|
|
bacula |
|
|
|
bcache-tools |
|
|
|
beanstalkc |
|
|
|
beautifulsoup |
|
|
|
billiard |
|
|
|
bind9 |
|
|
|
blinker |
|
|
|
bridge-utils |
|
|
|
bsd-mailx |
|
|
|
byobu |
|
|
|
c3p0 |
|
|
|
cglib |
|
|
|
cglib3 |
|
|
|
cgroup-lite |
|
|
|
charm-tools |
|
|
|
checksecurity |
|
|
|
cheetah |
|
|
|
chkrootkit |
|
|
|
cloud-init |
|
|
|
cloud-initramfs-tools |
|
|
|
cluster-glue |
|
|
|
cobbler-enlist |
|
|
|
commons-io |
|
|
|
commons-vfs |
|
|
|
curtin |
|
|
|
cyrus-sasl2 |
|
|
|
dh-php |
|
|
|
ding-libs |
|
|
|
dlm |
|
|
|
dns-root-data |
|
|
|
dnsjava |
|
|
|
dnsmasq |
|
|
|
dnstracer |
|
|
|
drac |
|
|
|
drbd-utils |
|
|
|
dwarves-dfsg |
|
|
|
ebtables |
|
|
|
ec2-ami-tools |
|
|
|
ec2-api-tools |
|
|
|
elinks |
|
|
|
etckeeper |
|
|
|
ethtool |
|
|
|
euca2ools |
|
|
|
excalibur-logkit |
|
|
|
eximdoc4 |
|
|
|
fetchmail |
|
|
|
freeipmi |
|
|
|
geronimo-ejb-3.0-spec |
|
|
|
geronimo-interceptor-3.0-spec |
|
|
|
geronimo-j2ee-connector-1.5-spec |
|
|
|
geronimo-jacc-1.1-spec |
|
|
|
geronimo-jms-1.1-spec |
|
|
|
geronimo-jpa-3.0-spec |
|
|
|
golang-1.6 |
|
|
|
golang-1.6-race-detector-runtime |
|
|
|
golang-1.7 |
|
|
|
golang-check.v1 |
|
|
|
golang-context |
Invalid |
Package has tests which are run at build time |
|
golang-github-bmizerany-assert |
|
|
|
golang-github-bmizerany-pat |
|
|
|
golang-github-gorilla-mux |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-colorable |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-isatty |
Invalid |
Package has tests which are run at build time |
|
golang-github-mattn-go-sqlite3 |
Invalid |
Package has tests which are run at build time |
|
golang-github-olekukonko-tablewriter |
Invalid |
Package has tests which are run at build time |
|
golang-github-pborman-uuid |
Invalid |
Package has tests which are run at build time |
|
golang-go-dbus |
|
|
|
golang-go.crypto |
Invalid |
Package has tests which are run at build time |
|
golang-gocapability-dev |
Invalid |
Package has tests which are run at build time |
|
golang-golang-x-net-dev |
|
|
|
golang-gopkg-flosch-pongo2.v3 |
Invalid |
Package has tests which are run at build time |
|
golang-gopkg-inconshreveable-log15.v2 |
Invalid |
Package has tests which are run at build time |
|
golang-gopkg-tomb.v2 |
Invalid |
Package has tests which are run at build time |
|
golang-goprotobuf |
Invalid |
Package has tests which are run at build time |
|
golang-juju-loggo |
|
|
|
golang-petname |
Invalid |
Package has tests which are run at build time |
|
golang-pretty |
|
|
|
golang-text |
|
|
|
golang-x-text |
|
|
|
golang-yaml.v2 |
Invalid |
Package has tests which are run at build time |
|
google-apputils-python |
|
|
|
groovy |
|
|
|
hardlink |
|
|
|
heartbeat |
|
|
|
heimdal |
|
|
|
htop |
|
|
|
http-parser |
|
|
|
ibmasm-utils |
|
|
|
iotop |
|
|
|
ipmitool |
|
|
|
iproute2 |
|
|
|
ipsec-tools |
|
|
|
iptraf-ng |
|
|
|
ipvsadm |
|
|
|
ipxe |
|
|
|
irqbalance |
|
|
|
janino |
|
|
|
joyent-mdata-client |
|
|
|
jug |
|
|
|
keepalived |
|
|
|
kerberos-configs |
|
|
|
krb5 |
|
|
|
ldap-auth-client |
|
|
|
ldb |
|
|
|
ldns |
|
|
|
libaio |
|
|
|
libapache-mod-auth-kerb |
|
|
|
libapache2-mod-auth-pgsql |
|
|
|
libapache2-mod-auth-plain |
|
|
|
libapache2-reload-perl |
|
|
|
libaxiom-java |
|
|
|
libcacard |
|
|
|
libcgroup |
|
|
|
libcommons-cli-java |
|
|
|
libcommons-compress-java |
|
|
|
libcommons-fileupload-java |
|
|
|
libcommons-jxpath-java |
|
|
|
libconfig-general-perl |
|
|
|
libcss-minifier-xs-perl |
|
|
|
libdbi |
|
|
|
libdbi-drivers |
|
|
|
libecap |
|
|
|
libesmtp |
|
|
|
libezmorph-java |
|
|
|
libfcgi-perl |
|
|
|
libibverbs |
|
|
|
libiscsi |
|
|
|
libjavascript-minifier-xs-perl |
|
|
|
libjson-java |
|
|
|
liblockfile |
|
|
|
libmemcached |
|
|
|
libmime-tools-perl |
|
|
|
libmnl |
|
|
|
libmspack |
|
|
|
libnet |
|
|
|
libnetfilter-conntrack |
|
|
|
libnetfilter-cthelper |
|
|
|
libnetfilter-cttimeout |
|
|
|
libnetfilter-queue |
|
|
|
libnl3 |
|
|
|
libnss-ldap |
|
|
|
libp11 |
|
|
|
libpam-ldap |
|
|
|
libpam-mount |
|
|
|
libpam-radius-auth |
|
|
|
libparse-recdescent-perl |
|
|
|
libparse-yapp-perl |
|
|
|
libpcap |
|
|
|
librabbitmq |
|
|
|
librdmacm |
|
|
|
librtas |
|
|
|
libs3 |
|
|
|
libsdl1.2 |
|
|
|
libslf4j-java |
|
|
|
libstatgrab |
|
|
|
libtime-parsedate-perl |
|
|
|
libtirpc |
|
|
|
libtommath |
|
|
|
liburcu |
|
|
|
libxml-security-java |
|
|
|
libxml-xpath-perl |
|
|
|
libyaml |
|
|
|
lm-sensors |
|
|
|
logcheck |
|
|
|
logwatch |
|
|
|
lsscsi |
|
|
|
lua-lpeg |
|
|
|
lua5.2 |
|
|
|
m2300w |
|
|
|
m2crypto |
|
|
|
maas |
|
|
|
maas-enlist |
|
|
|
mail-spf-perl |
|
|
|
mako |
|
|
|
markupsafe |
|
|
|
maven-ant-helper |
|
|
|
mcollective |
|
|
|
mdbtools |
|
|
|
migrationtools |
|
|
|
mime-construct |
|
|
|
minicom |
|
|
|
moin |
|
|
|
monitoring-plugins |
|
|
|
mtx |
|
|
|
mvel |
|
|
|
mysql-defaults |
|
|
|
nagios-images |
|
|
|
nagios-nrpe |
|
|
|
nbd |
|
|
|
ndg-httpsclient |
|
|
|
net-snmp |
|
|
|
net-tools |
|
|
|
netcf |
|
|
|
netty |
|
|
|
nicstat |
|
|
|
nis |
|
|
|
nmap |
|
|
|
nose |
|
|
|
nspr |
|
|
|
nss |
|
|
|
ntdb |
|
|
|
ntp |
|
|
|
numactl |
|
|
|
oops |
|
|
|
oops-amqp |
|
|
|
oops-datedir-repo |
|
|
|
oops-twisted |
|
|
|
oops-wsgi |
|
|
|
openbsd-inetd |
|
|
|
openhpi |
|
|
|
openipmi |
|
|
|
openldap |
|
|
|
openvpn |
|
|
|
pam-p11 |
|
|
|
parsedatetime |
|
|
|
pax |
|
|
|
php-defaults |
|
|
|
php-pear |
|
|
|
pm-utils |
|
|
|
pnm2ppa |
|
|
|
pollen |
|
|
|
pollinate |
|
|
|
popt |
|
|
|
powernap |
|
|
|
pptpd |
|
|
|
procmail |
|
|
|
psmisc |
|
|
|
pwgen |
|
|
|
pyjunitxml |
|
|
|
pylibmc |
|
|
|
python-amqplib |
|
|
|
python-cloudfiles |
|
|
|
python-coffin |
|
|
|
python-cryptography-vectors |
|
|
|
python-ddt |
|
|
|
python-dingus |
|
|
|
python-django |
|
|
|
python-django-piston |
|
|
|
python-django-south |
|
|
|
python-dns |
|
|
|
python-elasticsearch |
|
|
|
python-gevent |
|
|
|
python-gflags |
|
|
|
python-hacking |
|
|
|
python-happybase |
|
|
|
python-hplefthandclient |
|
|
|
python-httpretty |
|
|
|
python-itsdangerous |
|
|
|
python-jingo |
|
|
|
python-jsonrpclib |
|
|
|
python-jujuclient |
|
|
|
python-kajiki |
|
|
|
python-ldappool |
|
|
|
python-mailer |
|
|
|
python-mccabe |
|
|
|
python-nine |
|
|
|
python-nose-testconfig |
|
|
|
python-nosehtmloutput |
|
|
|
python-oauth |
|
|
|
python-oauthlib |
|
|
|
python-pyelftools |
|
|
|
python-pytyrant |
|
|
|
python-recaptcha |
|
|
|
python-requestbuilder |
|
|
|
python-seamicroclient |
|
|
|
python-setuptools-git |
|
|
|
python-stompy |
|
|
|
python-sysv-ipc |
|
|
|
python-tempita |
|
|
|
python-termstyle |
|
|
|
python-thrift |
|
|
|
python-tx-tftp |
|
|
|
python-ws4py |
|
|
|
python-xstatic |
|
|
|
qdox |
|
|
|
qemu |
|
|
|
quota |
|
|
|
rabbitmq-server |
|
|
|
raphael |
|
|
|
re2c |
|
|
|
requests |
|
|
|
rpcbind |
|
|
|
rrdtool |
|
|
|
rsync |
|
|
|
ruby-augeas |
|
|
|
ruby-childprocess |
|
|
|
ruby-hashie |
|
|
|
ruby-indentation |
|
|
|
ruby-json |
|
|
|
ruby-molinillo |
|
|
|
ruby-net-http-persistent |
|
|
|
ruby-rspec |
|
|
|
ruby-safe-yaml |
|
|
|
ruby-shadow |
|
|
|
run-one |
|
|
|
seabios |
|
|
|
setserial |
|
|
|
sg3-utils |
|
|
|
sharutils |
|
|
|
shtool |
|
|
|
siege |
|
|
|
simplestreams |
|
|
|
slof |
|
|
|
smartmontools |
|
|
|
socat |
|
|
|
sphinxcontrib-httpdomain |
|
|
|
sphinxcontrib-pecanwsme |
|
|
|
sphinxcontrib-programoutput |
|
|
|
spice |
|
|
|
spice-protocol |
|
|
|
squid-deb-proxy |
|
|
|
squid-langpack |
|
|
|
ssh-import-id |
|
|
|
ssl-cert |
|
|
|
sssd |
|
|
|
subunit |
|
|
|
sysstat |
|
|
|
taglibs-standard |
|
|
|
tevent |
|
|
|
tftp-hpa |
|
|
|
tickcount |
|
|
|
tinycdb |
|
|
|
tmux |
|
|
|
tomcat7 |
|
|
|
tomcat8 |
|
|
|
tomsfastmath |
|
|
|
txamqp |
|
|
|
txaws |
|
|
|
txlongpoll |
|
|
|
txzookeeper |
|
|
|
ubuntu-cloudimage-keyring |
|
|
|
ubuntu-virt |
|
|
|
unbound |
|
|
|
unixodbc |
|
|
|
urlgrabber |
|
|
|
urwid |
|
|
|
usbredir |
|
|
|
uucp |
|
|
|
uvtool |
|
|
|
vblade |
|
|
|
vblade-persist |
|
|
|
vcversioner |
|
|
|
vgabios |
|
|
|
vlan |
|
|
|
vlock |
|
|
|
vm-builder |
|
|
|
w3m |
|
|
|
wakeonlan |
|
|
|
walinuxagent |
|
|
|
websocket-client |
|
|
|
websockify |
|
|
|
whois |
|
|
|
wss4j |
|
|
|
xen |
|
|
|
xinetd |
|
|
|
xmlrpc-epi |
|
|
|
xmlunit |
|
|
|
xz-java |
|
|
|
yajl |
|
|
|
yui3 |
|
|
ServerTeam/dep8 (last edited 2017-04-18 21:27:26 by powersj)