RequiredTests

Introduction

autopkgtest tests can be very easily integrated into existing source packages and easily test-run locally. http://packaging.ubuntu.com/html/auto-pkg-test.html shows how to easily get started with this kind of tests. Log in to #ubuntu-quality to ask questions and get help.

If you decide to work on one of the tests, please add @SIG@ behind the package in question and if you submitted a test-case for review already, you might want to add a link to it.

Required Tests

For the following packages we require autopkgtest tests.

simple compile/link/run tests

The idea here is to test if we can easily compile and link against these libraries and run some very basic code.

The following tests might serve as inspiration:

For these libraries we require tests:

Library

Who

Status

libmysqlclient-dev

Daniel Kessel

Done: https://bugs.launchpad.net/ubuntu/+source/mysql-5.5/+bug/959683

libwebkitgtk-3.0-dev

libgstreamer0.10-dev, libgstreamer-plugins-base0.10-dev

libnux-3.0-dev

libunity-core-6.0-dev, libunity-dev

libindicator3-dev

libsoup2.4-dev

librsvg2-dev

libsecret-1-dev

libdbusmenu-glib-dev, libdbusmenu-gtk3-dev

libgdata-dev

cyphermox

in progress

libical-dev

libfolks-dev

libtelepathy-glib-dev

libtelepathy-qt4-dev

libbluetooth-dev

libmessaging-menu-dev

libpulse-dev

diwic

libqt4-dev

libvte-2.90-dev

libaccountsservice-dev

libbamf3-dev

functionality tests

The following packages don't have tests at all. It'd be great to let tests exercise the most common functionality and workflow (ie. for d-conf this might be: check reading, writing of schema keys, handling of invalid values for types, and schema creation/compilation, for a lens this might be: create a temporary home directory with some files, and check that these files are found).

Library

Who

Status

gzip

dholbach 2012-10-30 20:06:29

More generic test required in Debian: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=693691

d-conf

unity-lens-files

unity-lens-photos

unity-applications-daemon

indicator-session

indicator-messages

valac (we support several versions with a metapackage, ensure that this pulls in everything required)

evince (autopilot: open a simple PDF, scroll through it, verify that it is displaying something)

eog (autopilot: open various kinds of images, change between them with mouse and cursor, verify that it is displaying something)

run upstream test suite against system installed packages

What we want to do here is to get the upstream test suite run as part of the autopkgtest.

This is what's done here as well: Example: ubiquity tests

For the following tests we want to run upstream test-suites:

Library

Who

Status

apt

apt-clone

jibel

bamf

bzr

andrewsomething

(isn't this already in place?) jibel: there is a dep8 control file but no XS-Testsuite header for auto-discovery

jenkins

Daniel Kessel

mysql-5.5

Daniel Kessel

abandoned branch: lp:~d-kessel/ubuntu/raring/mysql/autopkgtest

nbd

python-launchpadlib

python-keyrging (used by launchpad-lib)

ubuntuone

webkit

fixing existing tests

Red ones on https://jenkins.qa.ubuntu.com/view/Saucy/view/AutoPkgTest/ ; there are a few which never succeeded

Library

Who

Status

maas

network-manager

software-center

ubuntu-release-upgrader

unity-firefox-extension

review package for tests

The following packages could do with some tests but have not been reviewed to see if they have upstream tests yet; if they have something usable then enable the upstream tests; otherwise write some basic functional tests to exercise the package.

Library

Who

Status

bacula

ganglia

iscsitarget

nagios3

open-iscsi

quagga

solr-tomcat/jetty

tgt

postfix

slapd/openldap

amavisd-new

spamassassin

freeradius

vsftp

haproxy

tftp-hpa

memcached

QATeam/RequiredTests (last edited 2013-12-03 12:19:20 by dholbach)