OneiricFinalTestReport

Oneiric Final Testing report - Oct 13, 2011

Summary

Test Coverage

65 contributors have provided 608 results and covered 278 testcases

  • Image Coverage : 98.78% (81/82) (Mythbuntu i386 not covered)

Coverage broken down by product:

Product

Test Case Coverage

Pass Rate

Ubuntu

100.00%

95.87%

Ubuntu ARM

100.00%

100.00%

Ubuntu Server

100.00%

98.86%

Edubuntu

100.00%

100.00%

Kubuntu

100.00%

92.45%

Lubuntu

100.00%

100.00%

Mythbuntu

16.67%

0.00%

Ubuntu Studio

100.00%

100.00%

Xubuntu

100.00%

100.00%

Failures summary

43 bugs have been reported affecting a total of 39 test cases.
13 Tests failed.

  • Failure Rate: 4.68% (13/278)


Bug Tasks Importance

  • Critical : 1 (1 closed)
  • High : 19 (5 closed)
  • Medium : 14
  • Low : 2
  • Undecided : 13 (4 closed)

Bugs Details

Details of Fixed Issues

Critical

  • LP: #872119 ubiquity (Ubuntu) Fix Released "Error occurred while copying the network settings" on bcmwl machine

High

  • LP: #856826 apport (Ubuntu) Fix Released 'guided resize' partioning leaves Mac unbootable

  • LP: #820466 alsa-lib (Ubuntu) Fix Released No sound input on omap4 pandaboard

  • LP: #820466 linux-ti-omap4 (Ubuntu) Fix Released No sound input on omap4 pandaboard

  • LP: #870214 ifupdown (Ubuntu) Invalid iSCSI root installation creates manual eth0 configuration + long boot

  • LP: #743359 ubiquity (Ubuntu) Fix Released Installer: LockFailedException: Failed to lock /target/var/cache/apt/archives/lock

Undecided

  • LP: #820466 pulseaudio (Ubuntu) Invalid No sound input on omap4 pandaboard

  • LP: #871520 banshee (Ubuntu) Invalid Can't pause, quit, or close banshee while, or after, playing example

  • LP: #872454 akonadi (Ubuntu) Invalid akonadi complains about invalid maildir after fresh install

  • LP: #760340 debian-installer (Ubuntu) Invalid Missing package tasks from expert install mode

Details of Opened Issues

High

  • LP: #870643 flashplugin-nonfree (Ubuntu) Confirmed package flashplugin-downloader 11.0.1.152ubuntu1 failed to install/upgrade: wget: unable to resolve host address `archive.canonical.com'

  • LP: #850005 jockey (Ubuntu) Triaged wrongly duplicated reports - jockey-backend crashed with SystemError: E:Sub-process /usr/bin/dpkg returned an error code (2)

  • LP: #857299 banshee (Ubuntu) Confirmed banshee window remain white on startup on armel

  • LP: #745960 grub2 (Ubuntu) Incomplete Cannot boot grub after installing to LVM

  • LP: #856826 grub2 (Ubuntu) New 'guided resize' partioning leaves Mac unbootable

  • LP: #856826 partman-base (Ubuntu) New 'guided resize' partioning leaves Mac unbootable

  • LP: #872966 ubiquity (Ubuntu) Confirmed Selecting a stock user picture does not work

  • LP: #838200 u-boot-linaro (Ubuntu) New No network support on Beagle XM

  • LP: #870214 open-iscsi (Ubuntu) Fix Committed iSCSI root installation creates manual eth0 configuration + long boot

  • LP: #870696 ubiquity (Ubuntu) Confirmed Oneiric pre-release ubiquity does not load all the translations

  • LP: #857816 xserver-xorg-video-intel (Ubuntu) Confirmed X fails to start on boot

  • LP: #873009 grub2 (Ubuntu) In Progress Unabled to boot degraded RAID-1 array from second disk

  • LP: #872120 casper (Ubuntu) Incomplete Lubuntu ISO testing - LiveCD session fails to start

  • LP: #856278 ac100-tarball-installer (Ubuntu) Triaged installation mode from SD card to USB key fails

Medium

  • LP: #870832 ubiquity (Ubuntu) Triaged Plymouth not shown during live disk shutdown.

  • LP: #872405 ubiquity (Ubuntu) New Swap partition smaller than RAM (entire disk install)

  • LP: #856763 parted (Ubuntu) Confirmed Mac cannot boot after manual partitioning, unless using ext4

  • LP: #872634 ubiquity-slideshow-ubuntu (Ubuntu) New ubiquity slideshow not show every Korean translations pages

  • LP: #872525 partman-uboot (Ubuntu) New No option for u-boot partition on armel platforms

  • LP: #860552 postgresql-common (Ubuntu) Fix Committed psql warnings (version 122)

  • LP: #872267 ubiquity (Ubuntu) Confirmed (iso testing) ubuntu install crash at end of installation

  • LP: #837470 pcmanfm (Ubuntu) Confirmed ISO Persistent mode : Desktop doesn't show documents and folders

  • LP: #871936 ubiquity (Ubuntu) New Live session switches to VT console [nvidia]

  • LP: #856293 ubiquity (Ubuntu) Confirmed oem-config not removed after install on preinstalled desktop images due to debconf.dat being locked

  • LP: #869825 ubiquity (Ubuntu) Triaged French (Switzerland) is no longer a layout choice in the installer

  • LP: #872713 kubuntu-netbook-default-settings (Ubuntu) Fix Committed Kubuntu oneiric for kubuntu-netbook-default-settings. Kmail shortcut in start menu favourites does not work

  • LP: #813837 ltsp (Ubuntu) Triaged ltsp client not able to load boot file: ltsp/amd64.tmp/pxelinux.0

  • LP: #841541 gnome-screensaver (Ubuntu) Triaged "num lock is on" warning remains even after num lock is turned off

Low

  • LP: #869239 ubiquity (Ubuntu) Confirmed webcam screen should be resized for netbooks (Eee PC, 10")

  • LP: #820466 alsa-utils (Ubuntu) Confirmed No sound input on omap4 pandaboard

Undecided

  • LP: #871553 xfce4-power-manager (Ubuntu) New Oneiric Lubuntu xfce4-power-manager displays a "broken" icon in lxpanel

  • LP: #872727 edubuntu-live (Ubuntu) Triaged edubuntu-packages ubiquity step sometimes doesn't show up, possibly utf-8 related

  • LP: #872400 unity (Ubuntu) New many UI problems after installing oneiric

  • LP: #872845 ubiquity (Ubuntu) New Oneiric 20111011 Ubiquity bootloader install fail on /dev/sda

  • LP: #872515 xfce4-session (Ubuntu) New Onboard Keyboard appears on desktop when GNOME Services is checked

  • LP: #872472 plymouth (Ubuntu) Incomplete Xubuntu Oneiric does not display "remove cd and hit Enter to continue" when installing from desktop cd

  • LP: #872121 colord (Ubuntu) New Lubuntu ISO Testing - colord closed unexpectedly during liveCD session

  • LP: #872122 casper (Ubuntu) Incomplete Lubuntu ISO Testing - unable to connect to wireless networks

  • LP: #873208 kubuntu-meta (Ubuntu) New Kubuntu listed as Ubuntu on grub menu on a dual boot install

Summary of Test Failures

Kubuntu Alternate amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • Release Notes for Ubuntu Fix Committed High
    • apport (Ubuntu) Fix Released High
    • grub2 (Ubuntu) New High
    • partman-base (Ubuntu) New High

Kubuntu Alternate amd64+mac - Install (entire disk with encryption)

  • LP: #745960 Cannot boot grub after installing to LVM

    • Release Notes for Ubuntu New High
    • grub2 (Ubuntu) Incomplete High
    • grub2 (Ubuntu Natty) Incomplete High
    • grub2 (Ubuntu Oneiric) Incomplete High
    • grub2 (Ubuntu Precise) Incomplete High

Kubuntu Desktop amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • Release Notes for Ubuntu Fix Committed High
    • apport (Ubuntu) Fix Released High
    • grub2 (Ubuntu) New High
    • partman-base (Ubuntu) New High

Kubuntu Desktop amd64+mac - Install (manual partitioning)

  • LP: #856763 Mac cannot boot after manual partitioning, unless using ext4

    • Release Notes for Ubuntu Fix Committed Medium
    • parted (Ubuntu) Confirmed Medium

Mythbuntu Desktop amd64 - Live Session

  • LP: #857816 X fails to start on boot

    • xserver-xorg-video-intel (Ubuntu) Confirmed High

Ubuntu Alternate amd64 - Install (LTSP server)

  • LP: #813837 ltsp client not able to load boot file: ltsp/amd64.tmp/pxelinux.0

    • ltsp (Ubuntu) Triaged Medium
    • ltsp (Ubuntu Lucid) Triaged Medium
    • ltsp (Ubuntu Precise) Triaged Medium

Ubuntu Alternate amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • Release Notes for Ubuntu Fix Committed High
    • apport (Ubuntu) Fix Released High
    • grub2 (Ubuntu) New High
    • partman-base (Ubuntu) New High

Ubuntu Alternate amd64+mac - Install (entire disk with encryption)

  • LP: #745960 Cannot boot grub after installing to LVM

    • Release Notes for Ubuntu New High
    • grub2 (Ubuntu) Incomplete High
    • grub2 (Ubuntu Natty) Incomplete High
    • grub2 (Ubuntu Oneiric) Incomplete High
    • grub2 (Ubuntu Precise) Incomplete High

Ubuntu Desktop amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • Release Notes for Ubuntu Fix Committed High
    • apport (Ubuntu) Fix Released High
    • grub2 (Ubuntu) New High
    • partman-base (Ubuntu) New High

Ubuntu Desktop amd64+mac - Install (entire disk)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • Release Notes for Ubuntu Fix Committed High
    • apport (Ubuntu) Fix Released High
    • grub2 (Ubuntu) New High
    • partman-base (Ubuntu) New High

Ubuntu Desktop amd64+mac - Install (manual partitioning)

  • LP: #856763 Mac cannot boot after manual partitioning, unless using ext4

    • Release Notes for Ubuntu Fix Committed Medium
    • parted (Ubuntu) Confirmed Medium

Ubuntu Desktop i386 - Install (manual partitioning)

  • LP: #872845 Oneiric 20111011 Ubiquity bootloader install fail on /dev/sda

    • ubiquity (Ubuntu) New Undecided

Ubuntu Server amd64 - Install (PostgreSQL database server)

  • LP: #860552 psql warnings (version 122)

    • postgresql-common (Ubuntu) Fix Committed Medium
    • postgresql-common (Ubuntu Oneiric) Fix Committed Medium
    • postgresql-common (Ubuntu Precise) Fix Committed High

Test Coverage Details by image

Image

Mandatory

Run Once

Edubuntu DVD amd64

2/2

1/1

Edubuntu DVD i386

2/2

1/1

Kubuntu Alternate amd64

4/4

4/4

Kubuntu Alternate amd64+mac

3/3

-

Kubuntu Alternate i386

4/4

4/4

Kubuntu Desktop amd64

7/7

-

Kubuntu Desktop amd64+mac

4/4

-

Kubuntu Desktop armel+omap

1/1

-

Kubuntu Desktop armel+omap4

1/1

-

Kubuntu Desktop i386

7/7

-

Kubuntu DVD amd64

4/4

-

Kubuntu DVD i386

4/4

-

Lubuntu Alternate amd64

3/3

-

Lubuntu Alternate i386

3/3

-

Lubuntu Desktop amd64

4/4

-

Lubuntu Desktop i386

4/4

-

Mythbuntu Desktop amd64

1/3

-

Mythbuntu Desktop i386

0/3

-

Netboot amd64

4/4

-

Netboot armel+omap

1/1

-

Netboot armel+omap4

1/1

-

Netboot i386

4/4

-

Ubuntu Alternate amd64

6/6

4/4

Ubuntu Alternate amd64+mac

4/4

-

Ubuntu Alternate i386

6/6

4/4

Ubuntu Core amd64

1/1

-

Ubuntu Core armel

1/1

-

Ubuntu Core i386

1/1

-

Ubuntu Desktop amd64

7/7

9/9

Ubuntu Desktop amd64+mac

4/4

-

Ubuntu Desktop armel+ac100

1/1

-

Ubuntu Desktop armel+mx5

1/1

-

Ubuntu Desktop armel+omap

1/1

-

Ubuntu Desktop armel+omap4

1/1

-

Ubuntu Desktop i386

7/7

9/9

Ubuntu DVD amd64

3/3

-

Ubuntu DVD i386

3/3

-

Ubuntu Server amd64

15/15

4/4

Ubuntu Server armel+omap

1/1

-

Ubuntu Server armel+omap4

1/1

-

Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) amd64

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) i386

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) amd64

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) i386

2/2

-

Ubuntu Server EC2 EBS (Europe) amd64

2/2

-

Ubuntu Server EC2 EBS (Europe) i386

2/2

-

Ubuntu Server EC2 EBS (US-East) amd64

2/2

-

Ubuntu Server EC2 EBS (US-East) i386

2/2

-

Ubuntu Server EC2 EBS (US-West) amd64

2/2

-

Ubuntu Server EC2 EBS (US-West) i386

2/2

-

Ubuntu Server EC2 HVM (US-East) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) i386

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) i386

2/2

-

Ubuntu Server EC2 instance (Europe) amd64

2/2

-

Ubuntu Server EC2 instance (Europe) i386

2/2

-

Ubuntu Server EC2 instance (US-East) amd64

2/2

-

Ubuntu Server EC2 instance (US-East) i386

2/2

-

Ubuntu Server EC2 instance (US-West) amd64

2/2

-

Ubuntu Server EC2 instance (US-West) i386

2/2

-

Ubuntu Server i386

15/15

4/4

Ubuntu Studio Alternate amd64

3/3

1/1

Ubuntu Studio Alternate i386

3/3

1/1

Ubuntu Wubi amd64

1/1

-

Ubuntu Wubi i386

1/1

-

Upgrade Edubuntu amd64

1/1

-

Upgrade Edubuntu i386

1/1

-

Upgrade Kubuntu amd64

1/1

-

Upgrade Kubuntu i386

1/1

-

Upgrade Ubuntu amd64

1/1

-

Upgrade Ubuntu i386

1/1

-

Upgrade Ubuntu Server amd64

1/1

-

Upgrade Ubuntu Server i386

1/1

-

Upgrade Wubi amd64

1/1

-

Upgrade Wubi i386

1/1

-

Upgrade Xubuntu amd64

1/1

-

Upgrade Xubuntu i386

1/1

-

Xubuntu Alternate amd64

3/3

1/1

Xubuntu Alternate i386

3/3

1/1

Xubuntu Desktop amd64

5/5

-

Xubuntu Desktop i386

5/5

-

QATeam/ReleaseReports/OneiricFinalTestReport (last edited 2011-10-13 09:52:05 by jibel)