OneiricBeta2TestReport

Differences between revisions 1 and 3 (spanning 2 versions)
Revision 1 as of 2011-09-23 09:01:50
Size: 25436
Editor: jibel
Comment:
Revision 3 as of 2011-09-23 09:04:46
Size: 25442
Editor: jibel
Comment:
Deletions are marked like this. Additions are marked like this.
Line 10: Line 10:
 * Coverage broken down by product:
'''
Coverage broken down by product:'''
Line 71: Line 72:
=== Details of Fixed Issues === === Details of Opened Issues ===

Oneiric Beta 2 Testing report - Sep 23, 2011

Summary

Test Coverage

56 contributors have provided 606 results and covered 279 testcases

  • Image Coverage : 97.53% (79/81) (Edubuntu Upgrade not covered)

Coverage broken down by product:

Product

Test Case Coverage

Failure Rate

Ubuntu

97.56%

2.91%

Ubuntu ARM

100.00%

0.00%

Ubuntu Server

97.62%

0.00%

Edubuntu

100.00%

9.09%

Kubuntu

95.74%

14.81%

Lubuntu

100.00%

0.00%

Mythbuntu

100.00%

14.29%

Ubuntu Studio

100.00%

0.00%

Xubuntu

100.00%

9.09%

Failures summary

104 bugs have been reported affecting a total of 59 test cases.
15 Tests failed.

  • Failure Rate: 5.38% (15/279)


Bug Tasks Importance

  • Critical : 6 (3 closed)
  • High : 26 (7 closed)
  • Medium : 27 (2 closed)
  • Low : 8 (3 closed)
  • Wishlist : 3
  • Undecided : 40 (4 closed)

Bugs Details

Details of Fixed Issues

Critical

  • LP: #854706 ubiquity (Ubuntu) Fix Released ubiquity crashed with AttributeError in set_state(): 'NoneType' object has no attribute 'set_online_state'

  • LP: #854717 ubiquity (Ubuntu) Fix Released Broken panel icons and dialog style during ubiquity-dm and OEM install/final user configuration

  • LP: #855763 ubiquity (Ubuntu) Fix Released installer crashed

High

  • LP: #855295 lupin (Ubuntu) Fix Released Desktop not localized after a fresh installation

  • LP: #797868 network-manager (Ubuntu) Fix Released NetworkManager crashed with SIGSEGV in g_type_instance_get_private()

  • LP: #854490 cups (Ubuntu) Fix Released update from natty to oneiric hangs on libpam0g upgrade and cups reload

  • LP: #854087 software-center (Ubuntu) Fix Released software-center crashed with TypeError in _parse_menu_tag(): 'NoneType' object is not iterable

  • LP: #854179 ubiquity (Ubuntu) Fix Released ISO testing, install dialogue, OSD + background mess

  • LP: #855301 livecd-rootfs (Ubuntu) Fix Released universe not in sources.list after a fresh installation

  • LP: #38442 ubiquity (Ubuntu) Fix Released Ubiquity dialogues too large for 800x600 display

Medium

  • LP: #608047 italc (Ubuntu) Fix Released ica crashed on login with SIGSEGV in gtk_container_add() - happens every login

  • LP: #702283 usb-creator (Ubuntu) Invalid usb-creator doesn't create EFI-bootable USB sticks

Low

  • LP: #770320 ubiquity (Ubuntu) Fix Released Sorting non-English list: French installer sorts accented names at end of alphabet

  • LP: #838627 unity (Ubuntu) Fix Released Unity bar lose its transparency and visual glitches

  • LP: #759102 unity (Ubuntu) Invalid compiz assert failure: *** glibc detected *** compiz: free(): invalid pointer: 0xbfa9f5cc ***

Undecided

  • LP: #856213 ubiquity (Ubuntu) Fix Released Links "Release notes" and "Update this installer" shouldn't be displayed without network connection

  • LP: #855276 gnome-settings-daemon (Ubuntu) Invalid gnome-settings-daemon crashed with SIGSEGV in g_simple_async_result_complete()

  • LP: #838676 ubiquity (Ubuntu) Won't Fix Ubiquity "Choose a picture" screen too narrow

  • LP: #855287 lupin (Ubuntu) Fix Released date/time indicator displays string 'Time' instead of date/time on Wubi installation

Details of Opened Issues

Critical

  • LP: #852012 unity-2d (Ubuntu) Triaged unity-2d-panel assert failure: *** glibc detected *** unity-2d-panel: corrupted double-linked list: 0x094bc9b0 ***

  • LP: #832603 gnome-settings-daemon (Ubuntu) Triaged gnome-settings-daemon crashed with SIGSEGV in g_simple_async_result_complete()

  • LP: #851472 compiz (Ubuntu) Confirmed compiz crashed with SIGSEGV in _XFreeEventCookies()

High

  • LP: #854138 apt (Ubuntu) New software centre closed unexpectedly, libapt-pkg.so.4.11.0 segfault

  • LP: #750386 compiz (Ubuntu) Confirmed compiz crashed with SIGABRT in raise()

  • LP: #750386 unity (Ubuntu) Confirmed compiz crashed with SIGABRT in raise()

  • LP: #838200 u-boot-linaro (Ubuntu) New No network support on Beagle XM

  • LP: #745960 grub2 (Ubuntu) Confirmed Cannot boot grub after installing to LVM

  • LP: #855580 ubuntu-meta (Ubuntu) Triaged task 'Ubuntu Desktop USB' doesn't install a working desktop environment

  • LP: #564471 plymouth (Ubuntu) Triaged Lucid: garbled video at boot on radeon cards: bad color map due to 16-bit fb

  • LP: #853688 gcj-4.4 (Ubuntu) Triaged Natty to Oneiric - failed to calculate the upgrade with gcj-4.4-jre installed

  • LP: #851565 unity-greeter (Ubuntu) Fix Committed Onscreen Keyboard cannot be used to input password

  • LP: #792652 ubiquity (Ubuntu) Triaged ubiquity crashed with ValueError in command(): I/O operation on closed file

  • LP: #856418 ubiquity (Ubuntu) New KDE OEM Mode Hang On Shutdown

  • LP: #840094 xubuntu-meta (Ubuntu) Confirmed [xubuntu] There is no screen title

  • LP: #820514 ubiquity (Ubuntu) Confirmed oem-config-remove-gtk not found during preinstalled desktop initialization

  • LP: #856278 ac100-tarball-installer (Ubuntu) Triaged installation mode from SD card to USB key fails

  • LP: #853223 ubiquity-slideshow-ubuntu (Ubuntu) New mixed english/french slides during an installation in French

  • LP: #833783 initramfs-tools (Ubuntu) Confirmed boot failure: can't open /root/dev/console: no such file

  • LP: #854124 glib2.0 (Ubuntu) Triaged opening the system settings preferred application dialog breaks the defaults

  • LP: #855685 ubiquity-slideshow-ubuntu (Ubuntu) Triaged Slideshow: "Ubuntu is all about working for real people"

  • LP: #855287 indicator-datetime (Ubuntu) Confirmed date/time indicator displays string 'Time' instead of date/time on Wubi installation

Medium

  • LP: #781385 ubiquity (Ubuntu) New Ubiquity GTK should have useful accessible names set in the Glade .ui files instead of using the variable names

  • LP: #820080 libappindicator (Ubuntu) Triaged broken fallback icons for indicators

  • LP: #567955 memtest86+ (Ubuntu) Triaged grub2 always adds "memtest86 serial console" even when no serial port

  • LP: #834575 gconf (Ubuntu) Triaged gsettings-data-convert crashed with signal 5 in g_settings_set_value()

  • LP: #588725 linux (Ubuntu) Confirmed instance had no console output

  • LP: #588725 linux-ec2 (Ubuntu) Confirmed instance had no console output

  • LP: #856088 netcfg (Ubuntu) Confirmed Expert install defaults to invalid hostname

  • LP: #854707 gnome-settings-daemon (Ubuntu) Triaged gnome-settings-daemon crashed with SIGSEGV in g_variant_unref()

  • LP: #775124 ubiquity (Ubuntu) Triaged Ubiquity should have a command line option to override the free space check

  • LP: #855977 lubuntu-meta (Ubuntu) Confirmed Entries with "Lubuntu" are not translated on the boot menu on any Lubuntu ISO

  • LP: #854244 lubuntu-meta (Ubuntu) Fix Committed Software sources UI broken after d-i installation of Lubuntu

  • LP: #837235 u-boot-linaro (Ubuntu) Confirmed Broken ES2.0 support at U-boot-linaro 11.08

  • LP: #854717 indicator-power (Ubuntu) In Progress Broken panel icons and dialog style during ubiquity-dm and OEM install/final user configuration

  • LP: #854490 apt (Ubuntu) Confirmed update from natty to oneiric hangs on libpam0g upgrade and cups reload

  • LP: #834133 gnome-codec-install (Ubuntu) Triaged gnome-codec-install crashed with Depends in _run(): libstdc++6 (>= 4.1.1) but 4.6.1-7ubuntu2 is to be installed

  • LP: #856293 ubiquity (Ubuntu) New oem-config not removed after install on preinstalled desktop images due to debconf.dat being locked

  • LP: #837470 pcmanfm (Ubuntu) Confirmed ISO Persistent mode : Desktop doesn't show documents and folders

  • LP: #830946 ubiquity (Ubuntu) Confirmed Nothing displayed on embedded terminal.

  • LP: #806751 debian-installer (Ubuntu) New Boot partition on SD is too small on omap/omap4

  • LP: #557261 linux (Ubuntu) Confirmed The session live persistent with USB don't start, error in the prompt initramfs: (initramfs) stdin: error 0

  • LP: #820056 language-pack-fr-base (Ubuntu) Confirmed Should not recommend firefox-locale-*

  • LP: #631672 gnome-settings-daemon (Ubuntu) Expired gnome-settings-daemon crashed with signal 5 in xkl_process_error()

  • LP: #854127 xorg-server (Ubuntu) New Xorg crashed with SIGSEGV in WakeupHandler()

  • LP: #855767 pcmanfm (Ubuntu) New pcmanfm crashed with SIGSEGV in g_closure_invoke()

  • LP: #856091 netcfg (Ubuntu) Confirmed Expert install defaults to invalid domain name

Low

  • LP: #856057 kubuntu-default-settings (Ubuntu) Confirmed Rescue mode background on alternate CD purple

  • LP: #830898 ubiquity (Ubuntu) Confirmed broken icon displayed on window switcher

  • LP: #855986 ubiquity (Ubuntu) Triaged Ubiquity shows two icons in launcher

  • LP: #819542 jockey (Ubuntu) Confirmed Generic icon on (old) notification area

  • LP: #656646 cloud-init (Ubuntu) Confirmed transient network/keyscan issues

Wishlist

  • LP: #749691 ubiquity (Ubuntu) Confirmed "Ubiquity slideshow HTML content!" is the last part of the screen reader install

  • LP: #762291 unity-place-applications (Ubuntu) Incomplete Unity Applications Place should support nested menus and ideally be editable

  • LP: #798437 synaptic (Ubuntu) Confirmed Please lower the recommend for apt-xapian-index to suggest

Undecided

  • LP: #820080 jockey (Ubuntu) Confirmed broken fallback icons for indicators

  • LP: #856458 update-manager (Ubuntu) New python-central no longer needed, but not removed

  • LP: #841366 jockey (Ubuntu) Confirmed jockey-backend crashed with TypeError in pulse_items(): an integer is required

  • LP: #854995 virtualbox (Ubuntu) Incomplete virtualbox-guest-dkms 4.1.2-dfsg-1ubuntu1: virtualbox-guest kernel module failed to build (make: Makefile: No such file or directory)

  • LP: #855585 ubiquity (Ubuntu) New (ISO TESTING) missing layout french/swiss and not found internet at install menu

  • LP: #771446 ubiquity (Ubuntu) Incomplete Kubuntu installer uses wrong character encoding

  • LP: #854000 ubuntu-wallpapers (Ubuntu) New Wallpapers not updated in oneiric

  • LP: #856055 memtest86+ (Ubuntu) Confirmed Memtest run from DI installer menu never finishes

  • LP: #856460 ltsp (Ubuntu) New ltsp-live fails to configure internal NIC

  • LP: #855871 ubiquity (Ubuntu) Confirmed Grub install fails after manual xfs partitioning

  • LP: #854837 casper (Ubuntu) Confirmed Lubuntu live image boots to TTY

  • LP: #856354 update-manager (Ubuntu) New update-manager showing errors after fresh install of Oneiric

  • LP: #856356 firefox (Ubuntu) New Nuisance first run pop-up

  • LP: #856511 unity (Ubuntu) Confirmed Unity panel German translations

  • LP: #855042 ubiquity (Ubuntu) New ubiquity hangs while jockey-text at 100% CPU

  • LP: #855493 debian-installer (Ubuntu) New ( ISO Testing Kubuntu Alternate amd64 [20110920.9] no Hard discs detected )

  • LP: #855414 firefox (Ubuntu) Confirmed Unity dash becomes very slow/laggy when opening certain webpages (Launchpad) in Firefox

  • LP: #855414 nvidia-graphics-drivers (Ubuntu) Confirmed Unity dash becomes very slow/laggy when opening certain webpages (Launchpad) in Firefox

  • LP: #855414 unity (Ubuntu) Confirmed Unity dash becomes very slow/laggy when opening certain webpages (Launchpad) in Firefox

  • LP: #645449 ubiquity (Ubuntu) Confirmed Ubiquity hangs at Keyboard layout/Ready when you are

  • LP: #856763 parted (Ubuntu) New Mac cannot boot from reiserfs

  • LP: #762291 unity (Ubuntu) Incomplete Unity Applications Place should support nested menus and ideally be editable

  • LP: #855969 linux-ti-omap4 (Ubuntu) New excessive messaging in dmesg by kernel on omap4

  • LP: #813065 ubiquity (Ubuntu) New Live session switches to VT console briefly

  • LP: #856773 ubiquity (Ubuntu) New Welcome Screen: Cannot reach 'release notes' link with keyboard only.

  • LP: #838680 casper (Ubuntu) New ISO testing: USB stick: OEM installation mode cannot be deselected after an OEM install from the USB stick

  • LP: #365157 casper (Ubuntu) Confirmed Kubuntu live session has open TTY's left when Stopping

  • LP: #856826 ubiquity (Ubuntu) New 'guided resize' partioning leaves Mac unbootable

  • LP: #856384 muon (Ubuntu) New Muon software center doesn't rebuild search index after sources change

  • LP: #856380 muon (Ubuntu) New Muon doesn't show all available packages

  • LP: #856782 ubiquity (Ubuntu) New Prepare: Unable to read system requirements with a screen reader

  • LP: #856786 ubiquity (Ubuntu) New Many pages read 'live underscore installer frame'

  • LP: #855882 ubiquity-slideshow-ubuntu (Ubuntu) New Translate: "Thank you for choosing Kubuntu 11.10"

  • LP: #856793 ubiquity (Ubuntu) New On timezone page, city list is not accessible

  • LP: #856505 lightdm (Ubuntu) Confirmed LightDM German translations

  • LP: #856098 ubiquity (Ubuntu) New Message appears at an early stage of the installation saying that user does not have permission to open a temporary file

Summary of Test Failures

Edubuntu DVD amd64 - Live LTSP

  • LP: #856460 ltsp-live fails to configure internal NIC

    • ltsp (Ubuntu) New Undecided

Kubuntu Alternate amd64+mac - Install (entire disk with encryption)

  • LP: #745960 Cannot boot grub after installing to LVM

    • Release Notes for Ubuntu New High
    • grub2 (Ubuntu) Confirmed High
    • grub2 (Ubuntu Natty) Confirmed High
    • grub2 (Ubuntu Oneiric) Confirmed High

Kubuntu Alternate i386 - Install (OEM setup)

  • LP: #855763 installer crashed

    • ubiquity (Ubuntu) Fix Released Critical
    • ubiquity (Ubuntu Oneiric) Fix Released Critical

Kubuntu Alternate i386 - Test Memory (Live CD)

  • LP: #856055 Memtest run from DI installer menu never finishes

    • memtest86+ (Ubuntu) Confirmed Undecided

Kubuntu Desktop amd64 - Live Session

  • LP: #557261 The session live persistent with USB don't start, error in the prompt initramfs: (initramfs) stdin: error 0

    • BusyBox New Undecided

    • linux (Ubuntu) Confirmed Medium
    • linux (Ubuntu Oneiric) Confirmed Medium
    • linux (Ubuntu P-series) New Undecided

Kubuntu Desktop amd64 - Wubi (Windows installer)

  • LP: #856340 wubi failed with "list index out of range" on kubuntu installation

    • Wubi Fix Released Critical

Kubuntu Desktop amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • ubiquity (Ubuntu) New Undecided

Kubuntu Desktop amd64+mac - Live Session

  • LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

    • usb-creator (Ubuntu) Invalid Medium

Kubuntu Desktop i386 - Wubi (Windows installer)

  • LP: #856340 wubi failed with "list index out of range" on kubuntu installation

    • Wubi Fix Released Critical

Mythbuntu Desktop amd64 - Live Session

  • LP: #557261 The session live persistent with USB don't start, error in the prompt initramfs: (initramfs) stdin: error 0

    • BusyBox New Undecided

    • linux (Ubuntu) Confirmed Medium
    • linux (Ubuntu Oneiric) Confirmed Medium
    • linux (Ubuntu P-series) New Undecided

Ubuntu Alternate amd64+mac - Install (auto-resize)

  • LP: #856826 'guided resize' partioning leaves Mac unbootable

    • ubiquity (Ubuntu) New Undecided

Ubuntu Alternate amd64+mac - Install (entire disk with encryption)

  • LP: #745960 Cannot boot grub after installing to LVM

    • Release Notes for Ubuntu New High
    • grub2 (Ubuntu) Confirmed High
    • grub2 (Ubuntu Natty) Confirmed High
    • grub2 (Ubuntu Oneiric) Confirmed High

Ubuntu Desktop amd64+mac - Install (manual partitioning)

  • LP: #856763 Mac cannot boot from reiserfs

    • parted (Ubuntu) New Undecided

Xubuntu Desktop amd64 - Wubi (Windows installer)

  • LP: #856340 wubi failed with "list index out of range" on kubuntu installation

    • Wubi Fix Released Critical

Xubuntu Desktop i386 - Wubi (Windows installer)

  • LP: #856340 wubi failed with "list index out of range" on kubuntu installation

    • Wubi Fix Released Critical

Test Coverage Details by image

Image

Mandatory

Run Once

Edubuntu DVD amd64

2/2

1/1

Edubuntu DVD i386

2/2

1/1

Kubuntu Alternate amd64

4/4

4/4

Kubuntu Alternate amd64+mac

2/3

-

Kubuntu Alternate i386

4/4

4/4

Kubuntu Desktop amd64

7/7

-

Kubuntu Desktop amd64+mac

4/4

-

Kubuntu Desktop armel+omap

1/1

-

Kubuntu Desktop armel+omap4

1/1

-

Kubuntu Desktop i386

7/7

-

Kubuntu DVD amd64

4/4

-

Kubuntu DVD i386

4/4

-

Lubuntu Alternate amd64

3/3

-

Lubuntu Alternate i386

3/3

-

Lubuntu Desktop amd64

4/4

-

Lubuntu Desktop i386

4/4

-

Mythbuntu Desktop amd64

3/3

-

Mythbuntu Desktop i386

3/3

-

Netboot amd64

4/4

-

Netboot armel+omap

1/1

-

Netboot armel+omap4

1/1

-

Netboot i386

4/4

-

Ubuntu Alternate amd64

6/6

4/4

Ubuntu Alternate amd64+mac

4/4

-

Ubuntu Alternate i386

6/6

4/4

Ubuntu Core amd64

1/1

-

Ubuntu Core armel

1/1

-

Ubuntu Core i386

1/1

-

Ubuntu Desktop amd64

7/7

8/9

Ubuntu Desktop amd64+mac

4/4

-

Ubuntu Desktop armel+ac100

1/1

-

Ubuntu Desktop armel+omap

1/1

-

Ubuntu Desktop armel+omap4

1/1

-

Ubuntu Desktop i386

7/7

8/9

Ubuntu DVD amd64

3/3

-

Ubuntu DVD i386

3/3

-

Ubuntu Server amd64

15/16

2/4

Ubuntu Server armel+omap

1/1

-

Ubuntu Server armel+omap4

1/1

-

Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) amd64

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-NorthEast) i386

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) amd64

2/2

-

Ubuntu Server EC2 EBS (Asia-Pacific-SouthEast) i386

2/2

-

Ubuntu Server EC2 EBS (Europe) amd64

2/2

-

Ubuntu Server EC2 EBS (Europe) i386

2/2

-

Ubuntu Server EC2 EBS (US-East) amd64

2/2

-

Ubuntu Server EC2 EBS (US-East) i386

2/2

-

Ubuntu Server EC2 EBS (US-West) amd64

2/2

-

Ubuntu Server EC2 EBS (US-West) i386

2/2

-

Ubuntu Server EC2 HVM (US-East) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-NorthEast) i386

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) amd64

2/2

-

Ubuntu Server EC2 instance (Asia-Pacific-SouthEast) i386

2/2

-

Ubuntu Server EC2 instance (Europe) amd64

2/2

-

Ubuntu Server EC2 instance (Europe) i386

2/2

-

Ubuntu Server EC2 instance (US-East) amd64

2/2

-

Ubuntu Server EC2 instance (US-East) i386

2/2

-

Ubuntu Server EC2 instance (US-West) amd64

2/2

-

Ubuntu Server EC2 instance (US-West) i386

2/2

-

Ubuntu Server i386

15/16

2/4

Ubuntu Studio Alternate amd64

3/3

1/1

Ubuntu Studio Alternate i386

3/3

1/1

Ubuntu Wubi amd64

1/1

-

Ubuntu Wubi i386

1/1

-

Upgrade Edubuntu amd64

0/1

-

Upgrade Edubuntu i386

0/1

-

Upgrade Kubuntu amd64

1/1

-

Upgrade Kubuntu i386

1/1

-

Upgrade Ubuntu amd64

1/1

-

Upgrade Ubuntu i386

1/1

-

Upgrade Ubuntu Server amd64

1/1

-

Upgrade Ubuntu Server i386

1/1

-

Upgrade Wubi amd64

1/1

-

Upgrade Wubi i386

1/1

-

Upgrade Xubuntu amd64

1/1

-

Upgrade Xubuntu i386

1/1

-

Xubuntu Alternate amd64

3/3

1/1

Xubuntu Alternate i386

3/3

1/1

Xubuntu Desktop amd64

5/5

-

Xubuntu Desktop i386

5/5

-

QATeam/ReleaseReports/OneiricBeta2TestReport (last edited 2011-09-23 09:04:46 by jibel)