OneiricFinalTestReport
Oneiric Final Testing report - Oct 13, 2011
Summary
Test Coverage
65 contributors have provided 608 results and covered 278 testcases
- Image Coverage : 98.78% (81/82) (Mythbuntu i386 not covered)
Coverage broken down by product:
Product |
Test Case Coverage |
Pass Rate |
Ubuntu |
100.00% |
95.87% |
Ubuntu ARM |
100.00% |
100.00% |
Ubuntu Server |
100.00% |
98.86% |
Edubuntu |
100.00% |
100.00% |
Kubuntu |
100.00% |
92.45% |
Lubuntu |
100.00% |
100.00% |
Mythbuntu |
16.67% |
0.00% |
Ubuntu Studio |
100.00% |
100.00% |
Xubuntu |
100.00% |
100.00% |
Failures summary
43 bugs have been reported affecting a total of 39 test cases.
13 Tests failed.
- Failure Rate: 4.68% (13/278)
Bug Tasks Importance
- Critical : 1 (1 closed)
- High : 19 (5 closed)
- Medium : 14
- Low : 2
- Undecided : 13 (4 closed)
Bugs Details
Details of Fixed Issues
Critical
LP: #872119 ubiquity (Ubuntu) Fix Released "Error occurred while copying the network settings" on bcmwl machine
High
LP: #856826 apport (Ubuntu) Fix Released 'guided resize' partioning leaves Mac unbootable
LP: #820466 alsa-lib (Ubuntu) Fix Released No sound input on omap4 pandaboard
LP: #820466 linux-ti-omap4 (Ubuntu) Fix Released No sound input on omap4 pandaboard
LP: #870214 ifupdown (Ubuntu) Invalid iSCSI root installation creates manual eth0 configuration + long boot
LP: #743359 ubiquity (Ubuntu) Fix Released Installer: LockFailedException: Failed to lock /target/var/cache/apt/archives/lock
Undecided
LP: #820466 pulseaudio (Ubuntu) Invalid No sound input on omap4 pandaboard
LP: #871520 banshee (Ubuntu) Invalid Can't pause, quit, or close banshee while, or after, playing example
LP: #872454 akonadi (Ubuntu) Invalid akonadi complains about invalid maildir after fresh install
LP: #760340 debian-installer (Ubuntu) Invalid Missing package tasks from expert install mode
Details of Opened Issues
High
LP: #870643 flashplugin-nonfree (Ubuntu) Confirmed package flashplugin-downloader 11.0.1.152ubuntu1 failed to install/upgrade: wget: unable to resolve host address `archive.canonical.com'
LP: #850005 jockey (Ubuntu) Triaged wrongly duplicated reports - jockey-backend crashed with SystemError: E:Sub-process /usr/bin/dpkg returned an error code (2)
LP: #857299 banshee (Ubuntu) Confirmed banshee window remain white on startup on armel
LP: #745960 grub2 (Ubuntu) Incomplete Cannot boot grub after installing to LVM
LP: #856826 grub2 (Ubuntu) New 'guided resize' partioning leaves Mac unbootable
LP: #856826 partman-base (Ubuntu) New 'guided resize' partioning leaves Mac unbootable
LP: #872966 ubiquity (Ubuntu) Confirmed Selecting a stock user picture does not work
LP: #838200 u-boot-linaro (Ubuntu) New No network support on Beagle XM
LP: #870214 open-iscsi (Ubuntu) Fix Committed iSCSI root installation creates manual eth0 configuration + long boot
LP: #870696 ubiquity (Ubuntu) Confirmed Oneiric pre-release ubiquity does not load all the translations
LP: #857816 xserver-xorg-video-intel (Ubuntu) Confirmed X fails to start on boot
LP: #873009 grub2 (Ubuntu) In Progress Unabled to boot degraded RAID-1 array from second disk
LP: #872120 casper (Ubuntu) Incomplete Lubuntu ISO testing - LiveCD session fails to start
LP: #856278 ac100-tarball-installer (Ubuntu) Triaged installation mode from SD card to USB key fails
Medium
LP: #870832 ubiquity (Ubuntu) Triaged Plymouth not shown during live disk shutdown.
LP: #872405 ubiquity (Ubuntu) New Swap partition smaller than RAM (entire disk install)
LP: #856763 parted (Ubuntu) Confirmed Mac cannot boot after manual partitioning, unless using ext4
LP: #872634 ubiquity-slideshow-ubuntu (Ubuntu) New ubiquity slideshow not show every Korean translations pages
LP: #872525 partman-uboot (Ubuntu) New No option for u-boot partition on armel platforms
LP: #860552 postgresql-common (Ubuntu) Fix Committed psql warnings (version 122)
LP: #872267 ubiquity (Ubuntu) Confirmed (iso testing) ubuntu install crash at end of installation
LP: #837470 pcmanfm (Ubuntu) Confirmed ISO Persistent mode : Desktop doesn't show documents and folders
LP: #871936 ubiquity (Ubuntu) New Live session switches to VT console [nvidia]
LP: #856293 ubiquity (Ubuntu) Confirmed oem-config not removed after install on preinstalled desktop images due to debconf.dat being locked
LP: #869825 ubiquity (Ubuntu) Triaged French (Switzerland) is no longer a layout choice in the installer
LP: #872713 kubuntu-netbook-default-settings (Ubuntu) Fix Committed Kubuntu oneiric for kubuntu-netbook-default-settings. Kmail shortcut in start menu favourites does not work
LP: #813837 ltsp (Ubuntu) Triaged ltsp client not able to load boot file: ltsp/amd64.tmp/pxelinux.0
LP: #841541 gnome-screensaver (Ubuntu) Triaged "num lock is on" warning remains even after num lock is turned off
Low
LP: #869239 ubiquity (Ubuntu) Confirmed webcam screen should be resized for netbooks (Eee PC, 10")
LP: #820466 alsa-utils (Ubuntu) Confirmed No sound input on omap4 pandaboard
Undecided
LP: #871553 xfce4-power-manager (Ubuntu) New Oneiric Lubuntu xfce4-power-manager displays a "broken" icon in lxpanel
LP: #872727 edubuntu-live (Ubuntu) Triaged edubuntu-packages ubiquity step sometimes doesn't show up, possibly utf-8 related
LP: #872400 unity (Ubuntu) New many UI problems after installing oneiric
LP: #872845 ubiquity (Ubuntu) New Oneiric 20111011 Ubiquity bootloader install fail on /dev/sda
LP: #872515 xfce4-session (Ubuntu) New Onboard Keyboard appears on desktop when GNOME Services is checked
LP: #872472 plymouth (Ubuntu) Incomplete Xubuntu Oneiric does not display "remove cd and hit Enter to continue" when installing from desktop cd
LP: #872121 colord (Ubuntu) New Lubuntu ISO Testing - colord closed unexpectedly during liveCD session
LP: #872122 casper (Ubuntu) Incomplete Lubuntu ISO Testing - unable to connect to wireless networks
LP: #873208 kubuntu-meta (Ubuntu) New Kubuntu listed as Ubuntu on grub menu on a dual boot install
Summary of Test Failures
Kubuntu Alternate amd64+mac - Install (auto-resize)
LP: #856826 'guided resize' partioning leaves Mac unbootable
- Release Notes for Ubuntu Fix Committed High
- apport (Ubuntu) Fix Released High
- grub2 (Ubuntu) New High
- partman-base (Ubuntu) New High
Kubuntu Alternate amd64+mac - Install (entire disk with encryption)
LP: #745960 Cannot boot grub after installing to LVM
- Release Notes for Ubuntu New High
- grub2 (Ubuntu) Incomplete High
- grub2 (Ubuntu Natty) Incomplete High
- grub2 (Ubuntu Oneiric) Incomplete High
- grub2 (Ubuntu Precise) Incomplete High
Kubuntu Desktop amd64+mac - Install (auto-resize)
LP: #856826 'guided resize' partioning leaves Mac unbootable
- Release Notes for Ubuntu Fix Committed High
- apport (Ubuntu) Fix Released High
- grub2 (Ubuntu) New High
- partman-base (Ubuntu) New High
Kubuntu Desktop amd64+mac - Install (manual partitioning)
LP: #856763 Mac cannot boot after manual partitioning, unless using ext4
- Release Notes for Ubuntu Fix Committed Medium
- parted (Ubuntu) Confirmed Medium
Mythbuntu Desktop amd64 - Live Session
LP: #857816 X fails to start on boot
- xserver-xorg-video-intel (Ubuntu) Confirmed High
Ubuntu Alternate amd64 - Install (LTSP server)
LP: #813837 ltsp client not able to load boot file: ltsp/amd64.tmp/pxelinux.0
- ltsp (Ubuntu) Triaged Medium
- ltsp (Ubuntu Lucid) Triaged Medium
- ltsp (Ubuntu Precise) Triaged Medium
Ubuntu Alternate amd64+mac - Install (auto-resize)
LP: #856826 'guided resize' partioning leaves Mac unbootable
- Release Notes for Ubuntu Fix Committed High
- apport (Ubuntu) Fix Released High
- grub2 (Ubuntu) New High
- partman-base (Ubuntu) New High
Ubuntu Alternate amd64+mac - Install (entire disk with encryption)
LP: #745960 Cannot boot grub after installing to LVM
- Release Notes for Ubuntu New High
- grub2 (Ubuntu) Incomplete High
- grub2 (Ubuntu Natty) Incomplete High
- grub2 (Ubuntu Oneiric) Incomplete High
- grub2 (Ubuntu Precise) Incomplete High
Ubuntu Desktop amd64+mac - Install (auto-resize)
LP: #856826 'guided resize' partioning leaves Mac unbootable
- Release Notes for Ubuntu Fix Committed High
- apport (Ubuntu) Fix Released High
- grub2 (Ubuntu) New High
- partman-base (Ubuntu) New High
Ubuntu Desktop amd64+mac - Install (entire disk)
LP: #856826 'guided resize' partioning leaves Mac unbootable
- Release Notes for Ubuntu Fix Committed High
- apport (Ubuntu) Fix Released High
- grub2 (Ubuntu) New High
- partman-base (Ubuntu) New High
Ubuntu Desktop amd64+mac - Install (manual partitioning)
LP: #856763 Mac cannot boot after manual partitioning, unless using ext4
- Release Notes for Ubuntu Fix Committed Medium
- parted (Ubuntu) Confirmed Medium
Ubuntu Desktop i386 - Install (manual partitioning)
LP: #872845 Oneiric 20111011 Ubiquity bootloader install fail on /dev/sda
- ubiquity (Ubuntu) New Undecided
Ubuntu Server amd64 - Install (PostgreSQL database server)
LP: #860552 psql warnings (version 122)
- postgresql-common (Ubuntu) Fix Committed Medium
- postgresql-common (Ubuntu Oneiric) Fix Committed Medium
- postgresql-common (Ubuntu Precise) Fix Committed High
Test Coverage Details by image
Image |
Mandatory |
Run Once |
Edubuntu DVD amd64 |
2/2 |
1/1 |
Edubuntu DVD i386 |
2/2 |
1/1 |
Kubuntu Alternate amd64 |
4/4 |
4/4 |
Kubuntu Alternate amd64+mac |
3/3 |
- |
Kubuntu Alternate i386 |
4/4 |
4/4 |
Kubuntu Desktop amd64 |
7/7 |
- |
Kubuntu Desktop amd64+mac |
4/4 |
- |
Kubuntu Desktop armel+omap |
1/1 |
- |
Kubuntu Desktop armel+omap4 |
1/1 |
- |
Kubuntu Desktop i386 |
7/7 |
- |
Kubuntu DVD amd64 |
4/4 |
- |
Kubuntu DVD i386 |
4/4 |
- |
Lubuntu Alternate amd64 |
3/3 |
- |
Lubuntu Alternate i386 |
3/3 |
- |
Lubuntu Desktop amd64 |
4/4 |
- |
Lubuntu Desktop i386 |
4/4 |
- |
Mythbuntu Desktop amd64 |
1/3 |
- |
Mythbuntu Desktop i386 |
0/3 |
- |
Netboot amd64 |
4/4 |
- |
Netboot armel+omap |
1/1 |
- |
Netboot armel+omap4 |
1/1 |
- |
Netboot i386 |
4/4 |
- |
Ubuntu Alternate amd64 |
6/6 |
4/4 |
Ubuntu Alternate amd64+mac |
4/4 |
- |
Ubuntu Alternate i386 |
6/6 |
4/4 |
Ubuntu Core amd64 |
1/1 |
- |
Ubuntu Core armel |
1/1 |
- |
Ubuntu Core i386 |
1/1 |
- |
Ubuntu Desktop amd64 |
7/7 |
9/9 |
Ubuntu Desktop amd64+mac |
4/4 |
- |
Ubuntu Desktop armel+ac100 |
1/1 |
- |
Ubuntu Desktop armel+mx5 |
1/1 |
- |
Ubuntu Desktop armel+omap |
1/1 |
- |
Ubuntu Desktop armel+omap4 |
1/1 |
- |
Ubuntu Desktop i386 |
7/7 |
9/9 |
Ubuntu DVD amd64 |
3/3 |
- |
Ubuntu DVD i386 |
3/3 |
- |
Ubuntu Server amd64 |
15/15 |
4/4 |
Ubuntu Server armel+omap |
1/1 |
- |
Ubuntu Server armel+omap4 |
1/1 |
- |
Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) amd64 |
2/2 |
- |
Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) i386 |
2/2 |
- |
Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) amd64 |
2/2 |
- |
Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) i386 |
2/2 |
- |
Ubuntu Server EC2 EBS (Europe) amd64 |
2/2 |
- |
Ubuntu Server EC2 EBS (Europe) i386 |
2/2 |
- |
Ubuntu Server EC2 EBS (US-East) amd64 |
2/2 |
- |
Ubuntu Server EC2 EBS (US-East) i386 |
2/2 |
- |
Ubuntu Server EC2 EBS (US-West) amd64 |
2/2 |
- |
Ubuntu Server EC2 EBS (US-West) i386 |
2/2 |
- |
Ubuntu Server EC2 HVM (US-East) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) i386 |
2/2 |
- |
Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) i386 |
2/2 |
- |
Ubuntu Server EC2 instance (Europe) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (Europe) i386 |
2/2 |
- |
Ubuntu Server EC2 instance (US-East) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (US-East) i386 |
2/2 |
- |
Ubuntu Server EC2 instance (US-West) amd64 |
2/2 |
- |
Ubuntu Server EC2 instance (US-West) i386 |
2/2 |
- |
Ubuntu Server i386 |
15/15 |
4/4 |
Ubuntu Studio Alternate amd64 |
3/3 |
1/1 |
Ubuntu Studio Alternate i386 |
3/3 |
1/1 |
Ubuntu Wubi amd64 |
1/1 |
- |
Ubuntu Wubi i386 |
1/1 |
- |
Upgrade Edubuntu amd64 |
1/1 |
- |
Upgrade Edubuntu i386 |
1/1 |
- |
Upgrade Kubuntu amd64 |
1/1 |
- |
Upgrade Kubuntu i386 |
1/1 |
- |
Upgrade Ubuntu amd64 |
1/1 |
- |
Upgrade Ubuntu i386 |
1/1 |
- |
Upgrade Ubuntu Server amd64 |
1/1 |
- |
Upgrade Ubuntu Server i386 |
1/1 |
- |
Upgrade Wubi amd64 |
1/1 |
- |
Upgrade Wubi i386 |
1/1 |
- |
Upgrade Xubuntu amd64 |
1/1 |
- |
Upgrade Xubuntu i386 |
1/1 |
- |
Xubuntu Alternate amd64 |
3/3 |
1/1 |
Xubuntu Alternate i386 |
3/3 |
1/1 |
Xubuntu Desktop amd64 |
5/5 |
- |
Xubuntu Desktop i386 |
5/5 |
- |
QATeam/ReleaseReports/OneiricFinalTestReport (last edited 2011-10-13 09:52:05 by jibel)