dep8

Differences between revisions 11 and 12
Revision 11 as of 2017-04-03 18:08:58
Size: 24289
Editor: powersj
Comment:
Revision 12 as of 2017-04-03 18:11:19
Size: 24325
Editor: powersj
Comment:
Deletions are marked like this. Additions are marked like this.
Line 115: Line 115:
|| golang-github-mattn-go-colorable || || CHECK || Has go tests ||
|| golang-github-mattn-go-isatty || || CHECK || Has go tests ||
|| golang-github-mattn-go-colorable || || Invalid || Has go tests ||
|| golang-github-mattn-go-isatty || || Invalid || Has go tests ||
Line 122: Line 122:
|| golang-gocapability-dev || || Invalid || Has go tests ||tps://pad.lv/|LP: #]] || || || || golang-gocapability-dev || || Invalid || Has go tests ||
|| golang-golang-x-ne
t-dev ||  || Invalid || Has go tests ||

Server Team dep8 Status

Overview

The purpose of this research was to determine opportunities for improvements in quality and test automation via the use of dep8. While dep8 is not the end-all be-all of testing as some packages run other tests during build, dep8 provides package maintainers a method for verifying their work and improves confidence when building and making changes and fixing bugs and provides a list of opportunities for experienced and new developers to help increase quality of Ubuntu packages.

This page tracks the status of dep8 tests existing in server team owned packages as defined by the package-to-team mappings.

Process

Given the package-to-team mappings, in order to determine whether a package had dep8 tests or not the following was done for every package owned by the 'server-team': Download the latest source via pull-lp-source <package name> zesty

  1. [testsuite] - control file calls out a testsuite (or XS-Testsuite), may be autopkgtest or otherwise
    • grep debian/control 'Testsuite:'

  2. [dep8] - do dep8 tests exists via the presence of:
    • debian/tests
    • debian/tests/control
  3. [go] - contains build time go-based tests
    • find . -name *_test.go

  4. [python] - setup.py has a test_suite defined
    • grep setup.py 'test_suite'

This is a very crude method that leaves out the additional possibilities of language specific tests, packages that are libraries or source only.

Launchpad Bugs

For each package a Launchpad bug was filed with the tag 'needs-dep8'.

Data

Following was determined on March 29, 2017. Of the 521 packages under 'ubuntu-server':

  • 374 packages do not have dep8 tests (Link)

  • 90 packages have dep8 tests (Link)

  • 57 packages are not available in zesty (Link)

Once removing packages that have golang tests, python test_suite in setup.py, or test-suite set in the control file the number drops to 312 (Link)

Packages Missing dep8 Tests

Name

LP Bug

Status

Notes

acpica-unix

LP: #1677698

amavisd-new

LP: #1677700

analog

LP: #1677701

ant-contrib

LP: #1677702

antlr3

LP: #1677703

apr

LP: #1677704

asterisk

LP: #1677747

at

LP: #1677748

augeas

LP: #1677749

authbind

LP: #1677750

autofs

LP: #1677751

awscli

LP: #1677753

awstats

LP: #1677754

backuppc

LP: #1677755

bacula

LP: #1677756

bcache-tools

LP: #1677757

beanstalkc

LP: #1677758

beautifulsoup

LP: #1677759

billiard

Invalid

Has python tests

bind9

LP: #1677761

blinker

LP: #1677762

bridge-utils

LP: #1677763

bsd-mailx

LP: #1677764

byobu

LP: #1677765

c3p0

LP: #1677766

cglib

LP: #1677767

cglib3

LP: #1677768

cgroup-lite

LP: #1677769

charm-tools

LP: #1677770

checksecurity

LP: #1677771

cheetah

LP: #1677772

chkrootkit

LP: #1677773

cloud-init

LP: #1677774

cloud-initramfs-tools

LP: #1677775

cluster-glue

LP: #1677776

cobbler-enlist

LP: #1677777

commons-io

LP: #1677778

commons-vfs

LP: #1677779

curtin

LP: #1677780

cyrus-sasl2

LP: #1677781

dh-php

LP: #1677782

ding-libs

LP: #1677783

dlm

LP: #1677845

dns-root-data

LP: #1677829

dnsjava

LP: #1677828

dnsmasq

LP: #1677827

dnstracer

LP: #1677826

drac

LP: #1677844

drbd-utils

LP: #1677843

dwarves-dfsg

LP: #1677825

ebtables

LP: #1677824

ec2-ami-tools

LP: #1677842

ec2-api-tools

LP: #1677822

elinks

LP: #1677841

etckeeper

LP: #1677823

ethtool

LP: #1677820

euca2ools

LP: #1677821

excalibur-logkit

LP: #1677840

eximdoc4

LP: #1677819

fetchmail

LP: #1677818

freeipmi

LP: #1677839

geronimo-ejb-3.0-spec

LP: #1677817

geronimo-interceptor-3.0-spec

LP: #1677838

geronimo-j2ee-connector-1.5-spec

LP: #1677816

geronimo-jacc-1.1-spec

LP: #1677815

geronimo-jms-1.1-spec

LP: #1677837

geronimo-jpa-3.0-spec

LP: #1677814

golang-1.6

Invalid

Has go tests

golang-1.6-race-detector-runtime

LP: #1677812

golang-1.7

Invalid

Has go tests

golang-check.v1

Invalid

Has go tests

golang-context

Invalid

Has go tests

golang-github-bmizerany-assert

Invalid

Has go tests

golang-github-bmizerany-pat

Invalid

Has go tests

golang-github-gorilla-mux

Invalid

Has go tests

golang-github-mattn-go-colorable

Invalid

Has go tests

golang-github-mattn-go-isatty

Invalid

Has go tests

golang-github-mattn-go-sqlite3

Invalid

Has go tests

golang-github-olekukonko-tablewriter

Invalid

Has go tests

golang-github-pborman-uuid

Invalid

Has go tests

golang-go-dbus

Invalid

Has go tests

golang-go.crypto

Invalid

Has go tests

golang-gocapability-dev

Invalid

Has go tests

golang-golang-x-net-dev

Invalid

Has go tests

golang-gopkg-flosch-pongo2.v3

Invalid

Has go tests

golang-gopkg-inconshreveable-log15.v2

Invalid

Has go tests

golang-gopkg-tomb.v2

Invalid

Has go tests

golang-goprotobuf

Invalid

Has go tests

golang-juju-loggo

Invalid

Has go tests

golang-petname

Invalid

Has go tests

golang-pretty

Invalid

Has go tests

golang-text

Invalid

Has go tests

golang-x-text

Invalid

Has go tests

golang-yaml.v2

Invalid

Has go tests

google-apputils-python

LP: #1677858

groovy

LP: #1677859

hardlink

LP: #1677860

heartbeat

LP: #1677861

heimdal

LP: #1677863

htop

LP: #1677864

http-parser

LP: #1677865

ibmasm-utils

LP: #1677866

iotop

LP: #1677867

ipmitool

LP: #1677868

iproute2

LP: #1677869

ipsec-tools

LP: #1677870

iptraf-ng

LP: #1677871

ipvsadm

LP: #1677873

ipxe

LP: #1677874

irqbalance

LP: #1677875

janino

LP: #1677876

joyent-mdata-client

LP: #1677877

jug

LP: #1677878

keepalived

LP: #1677879

kerberos-configs

LP: #1677880

krb5

LP: #1677881

ldap-auth-client

LP: #1677882

ldb

LP: #1677883

ldns

LP: #1677884

libaio

LP: #1677885

libapache-mod-auth-kerb

LP: #1677886

libapache2-mod-auth-pgsql

LP: #1677887

libapache2-mod-auth-plain

LP: #1677888

libapache2-reload-perl

LP: #1677889

libaxiom-java

LP: #1677890

libcacard

LP: #1677891

libcgroup

LP: #

libcommons-cli-java

LP: #

libcommons-compress-java

LP: #

libcommons-fileupload-java

LP: #

libcommons-jxpath-java

LP: #

libconfig-general-perl

Invalid

Has control file testsuite

libcss-minifier-xs-perl

Invalid

Has control file testsuite

libdbi

LP: #

libdbi-drivers

LP: #

libecap

LP: #

libesmtp

LP: #

libezmorph-java

LP: #

libfcgi-perl

Invalid

Has control file testsuite

libibverbs

LP: #

libiscsi

LP: #

libjavascript-minifier-xs-perl

Invalid

Has control file testsuite

libjson-java

LP: #

liblockfile

LP: #

libmemcached

LP: #

libmime-tools-perl

Invalid

Has control file testsuite

libmnl

LP: #

libmspack

LP: #

libnet

LP: #

libnetfilter-conntrack

LP: #

libnetfilter-cthelper

LP: #

libnetfilter-cttimeout

LP: #

libnetfilter-queue

LP: #

libnl3

LP: #

libnss-ldap

LP: #

libp11

LP: #

libpam-ldap

LP: #

libpam-mount

LP: #

libpam-radius-auth

LP: #

libparse-recdescent-perl

Invalid

Has control file testsuite

libparse-yapp-perl

LP: #

libpcap

LP: #

librabbitmq

LP: #

librdmacm

LP: #

librtas

LP: #

libs3

LP: #

libsdl1.2

LP: #

libslf4j-java

LP: #

libstatgrab

LP: #

libtime-parsedate-perl

Invalid

Has control file testsuite

libtirpc

LP: #

libtommath

LP: #

liburcu

LP: #

libxml-security-java

LP: #

libxml-xpath-perl

Invalid

Has control file testsuite

libyaml

LP: #

lm-sensors

LP: #

logcheck

LP: #

logwatch

LP: #

lsscsi

LP: #

lua-lpeg

LP: #

lua5.2

LP: #

m2300w

LP: #

m2crypto

Invalid

Has python tests

maas

LP: #

maas-enlist

LP: #

mail-spf-perl

Invalid

Has control file testsuite

mako

Invalid

Has python tests

markupsafe

Invalid

Has python tests

maven-ant-helper

LP: #

mcollective

LP: #

mdbtools

LP: #

migrationtools

LP: #

mime-construct

LP: #

minicom

LP: #

moin

LP: #

monitoring-plugins

LP: #

mtx

LP: #

mvel

LP: #

mysql-defaults

LP: #

nagios-images

LP: #

nagios-nrpe

LP: #

nbd

LP: #

ndg-httpsclient

LP: #

net-snmp

LP: #

net-tools

LP: #

netcf

LP: #

netty

LP: #

nicstat

LP: #

nis

LP: #

nmap

LP: #

nose

Invalid

Has python tests

nspr

LP: #

nss

LP: #

ntdb

LP: #

ntp

LP: #

numactl

LP: #

oops

LP: #

oops-amqp

LP: #

oops-datedir-repo

LP: #

oops-twisted

LP: #

oops-wsgi

LP: #

openbsd-inetd

LP: #

openhpi

LP: #

openipmi

LP: #

openldap

LP: #

openvpn

LP: #

pam-p11

LP: #

parsedatetime

Invalid

Has python tests

pax

LP: #

php-defaults

LP: #

php-pear

LP: #

pm-utils

LP: #

pnm2ppa

LP: #

pollen

Invalid

Has go tests

pollinate

LP: #

popt

LP: #

powernap

LP: #

pptpd

LP: #

procmail

LP: #

psmisc

LP: #

pwgen

LP: #

pyjunitxml

LP: #

pylibmc

LP: #

python-amqplib

LP: #

python-cloudfiles

Invalid

Has python tests

python-coffin

LP: #

python-cryptography-vectors

LP: #

python-ddt

LP: #

python-dingus

LP: #

python-django

LP: #

python-django-piston

LP: #

python-django-south

LP: #

python-dns

LP: #

python-elasticsearch

Invalid

Has python tests

python-gevent

Invalid

Has python tests

python-gflags

LP: #

python-hacking

LP: #

python-happybase

LP: #

python-hplefthandclient

LP: #

python-httpretty

Invalid

Has python tests

python-itsdangerous

Invalid

Has control file testsuite

python-jingo

LP: #

python-jsonrpclib

LP: #

python-jujuclient

LP: #

python-kajiki

Invalid

Has python tests

python-ldappool

LP: #

python-mailer

LP: #

python-mccabe

Invalid

Has control file testsuite

python-nine

Invalid

Has python tests

python-nose-testconfig

LP: #

python-nosehtmloutput

LP: #

python-oauth

LP: #

python-oauthlib

Invalid

Has python tests

python-pyelftools

LP: #

python-pytyrant

LP: #

python-recaptcha

LP: #

python-requestbuilder

LP: #

python-seamicroclient

LP: #

python-setuptools-git

Invalid

Has python tests

python-stompy

Invalid

Has python tests

python-sysv-ipc

LP: #

python-tempita

Invalid

Has python tests

python-termstyle

LP: #

python-thrift

LP: #

python-tx-tftp

LP: #

python-ws4py

LP: #

python-xstatic

LP: #

qdox

LP: #

qemu

LP: #

quota

LP: #

rabbitmq-server

LP: #

raphael

LP: #

re2c

LP: #

requests

Invalid

Has python tests

rpcbind

LP: #

rrdtool

LP: #

rsync

LP: #

ruby-augeas

Invalid

Has control file testsuite

ruby-childprocess

Invalid

Has control file testsuite

ruby-hashie

Invalid

Has control file testsuite

ruby-indentation

Invalid

Has control file testsuite

ruby-json

LP: #

ruby-molinillo

LP: #

ruby-net-http-persistent

LP: #

ruby-rspec

LP: #

ruby-safe-yaml

Invalid

Has control file testsuite

ruby-shadow

Invalid

Has control file testsuite

run-one

LP: #

seabios

LP: #

setserial

LP: #

sg3-utils

LP: #

sharutils

LP: #

shtool

LP: #

siege

LP: #

simplestreams

LP: #

slof

LP: #

smartmontools

LP: #

socat

LP: #

sphinxcontrib-httpdomain

LP: #

sphinxcontrib-pecanwsme

LP: #

sphinxcontrib-programoutput

LP: #

spice

LP: #

spice-protocol

LP: #

squid-deb-proxy

LP: #

squid-langpack

LP: #

ssh-import-id

LP: #

ssl-cert

LP: #

sssd

LP: #

subunit

LP: #

sysstat

LP: #

taglibs-standard

LP: #

tevent

LP: #

tftp-hpa

LP: #

tickcount

LP: #

tinycdb

LP: #

tmux

LP: #

tomcat7

LP: #

tomcat8

LP: #

tomsfastmath

LP: #

txamqp

LP: #

txaws

LP: #

txlongpoll

LP: #

txzookeeper

Invalid

Has python tests

ubuntu-cloudimage-keyring

LP: #

ubuntu-virt

LP: #

unbound

LP: #

unixodbc

LP: #

urlgrabber

LP: #

urwid

Invalid

Has python tests

usbredir

LP: #

uucp

LP: #

uvtool

LP: #

vblade

LP: #

vblade-persist

LP: #

vcversioner

LP: #

vgabios

LP: #

vlan

LP: #

vlock

LP: #

vm-builder

LP: #

w3m

LP: #

wakeonlan

LP: #

walinuxagent

LP: #

websocket-client

Invalid

Has python tests

websockify

LP: #

whois

LP: #

wss4j

LP: #

xen

LP: #

xinetd

LP: #

xmlrpc-epi

LP: #

xmlunit

LP: #

xz-java

LP: #

yajl

LP: #

yui3

LP: #

ServerTeam/dep8 (last edited 2017-04-18 21:27:26 by powersj)