Oneiric Alpha 2 ISO Testing Report- Jul 07, 2011

Technical overview for Oneiric Alpha 2 is available at https://wiki.ubuntu.com/OneiricOcelot/TechnicalOverview

Testing Overview

Ubuntu

• i386/amd64
  • Image Coverage: 100%
  • Test Cases Coverage: 92%
    • Untested:
      • Desktop : VMWare Easyinstall, CJK install,
• ARM:
  • OMAP3 doesn't work

  • OMAP4: Major issue (#779410) package initramfs-tools 0.98.8ubuntu3 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1

• amd64+mac untested: Images are oversized (can't burn a CD) and bug 702283 (usb-creator doesn't create EFI-bootable USB sticks) blocks the creation of usb sticks.
• Other Major issues:

  • https://launchpad.net/bugs/781076 package doc-base 0.9.5ubuntu2 failed to install/upgrade: Byte order is not compatible at ../../lib/Storable.pm

    • Fixed, affects i386 upgrades

  • https://launchpad.net/bugs/788710 gnome-settings-daemon crashed with SIGSEGV in exit()

    • User annoyance but has no impact on the live session other than the apport message.

  • https://launchpad.net/bugs/791454 RAID1 Test Failed: Device need to be readded manually

    • Server team is working on it

  • https://launchpad.net/bugs/805783 nautilus crashed with SIGSEGV in ffi_call()

    • Fixed

  • https://launchpad.net/bugs/806349 OEM Install fails with - KeyError: "The cache has no package named 'python2.6-minimal'" - without network connection.

    • Workaround: plug a network cable.

Derivatives

• Xubuntu has problems with lightdm (live session doesn't start, uses wrong settings, empty default session)
• Edubuntu has critical issues:

  • https://launchpad.net/bugs/791611 LTSP live doesn't work with new Network Manager

  • https://launchpad.net/bugs/806419 nbd-server doesn't work on Oneiric

  • https://launchpad.net/bugs/806428 Missing detailed package selection step in Oneiric

    • Fixed
• Ubuntu Studio and Mythbuntu received very little

• Kubuntu will skip Alpha 2. The critical issue from Alpha 1 (https://launchpad.net/bugs/791446) has been fixed since then.

Test Coverage

43 contributors have provided 294 results and covered 260 testcases

• Image Coverage : 91.18% (62/68)
• Mandatory Test Cases : 81.60% (173/212)
• Run Once Test Cases : 64.58% (31/48)
• Overall : 78.46% (204/260)

Failures summary

57 bugs have been reported affecting a total of 89 test cases.
34 Tests failed.

• Failure Rate: 13.08% (34/260)

Bug Tasks Importance

• Critical : 1
• High : 20 (5 closed)
• Medium : 23
• Low : 5 (2 closed)
• Undecided : 15 (3 closed)

Bugs Details

Details of Fixed Issues

High

• LP: #791552 gcc-4.6-armel-cross (Ubuntu) Invalid No USB support on Armel

• LP: #791552 linux (Ubuntu) Fix Released No USB support on Armel

• LP: #791552 linux-ti-omap4 (Ubuntu) Fix Released No USB support on Armel

• LP: #806428 livecd-rootfs (Ubuntu) Fix Released Missing detailed package selection step in Oneiric

• LP: #806065 update-manager (Ubuntu) Fix Released dist-upgrader fails with "FstabEntry(*line.split()) TypeError: init() takes exactly 7 arguments (5 given)" if fs_freq and fs_passno fields not present in fstab entry

Low

• LP: #805938 banshee (Ubuntu) Invalid Totem set as default music player after install instead of Banshee

• LP: #796793 gnome-icon-theme (Ubuntu) Won't Fix accessibilty and shutdown menu are missing icons

Undecided

• LP: #806523 boot (Ubuntu) Invalid Boot error, plymouth command failed

• LP: #608132 unity (Ubuntu) Fix Released [dash] Keyboard navigation not implemented as specified

• LP: #796132 casper (Ubuntu) Invalid cd iso to big for 700mb cd

Details of Fixed Issues

Critical

• LP: #781076 doc-base (Ubuntu) Triaged package doc-base 0.9.5ubuntu2 failed to install/upgrade: Byte order is not compatible at ../../lib/Storable.pm

High

• LP: #564471 plymouth (Ubuntu) Triaged Lucid: garbled video at boot on radeon cards: bad color map due to 16-bit fb

• LP: #790712 linux (Ubuntu) Confirmed 20110531 i386 server ISO: order 5 allocation failure during install

• LP: #791611 ltsp (Ubuntu) Triaged LTSP live doesn't work with new Network Manager

• LP: #804734 xorg (Ubuntu) Fix Committed Please ship 60xdg_path-on-session like gdm

• LP: #805783 glib2.0 (Ubuntu) Confirmed nautilus crashed with SIGSEGV in ffi_call()

• LP: #788710 gnome-settings-daemon (Ubuntu) In Progress gnome-settings-daemon crashed with SIGSEGV in exit()

• LP: #803499 xubuntu-default-settings (Ubuntu) Triaged Xubuntu session using wrong settings

• LP: #766265 ubiquity (Ubuntu) Confirmed Ubiquity proceeds to use free space without warning

• LP: #806358 unity (Ubuntu) New no menu bar on top, compositing bug?

• LP: #784937 linux (Ubuntu) Confirmed /mnt not mounted, swap not used, disk is xvde

• LP: #806107 u-boot-linaro (Ubuntu) Fix Committed Latest version of u-boot for omap fails to load boot.scr

• LP: #799754 lightdm (Ubuntu) Triaged Please let vendors easily provide their own config

• LP: #791454 mdadm (Ubuntu) In Progress RAID1 Test Failed: Device need to be readded manually

• LP: #806419 ltsp (Ubuntu) Triaged nbd-server doesn't work on Oneiric

• LP: #806349 ubiquity (Ubuntu) Fix Committed OEM Install fails with - KeyError: "The cache has no package named 'python2.6-minimal'" - without network connection.

Medium

• LP: #806751 debian-installer (Ubuntu) New Boot partition on SD is too small on panda omap4

• LP: #806076 debian-installer (Ubuntu) Triaged Minimal Setup progress bar at 100% while downloading

• LP: #782507 partman-auto (Ubuntu) Confirmed Installation creates a new swap partition

• LP: #791139 ubiquity (Ubuntu) Confirmed When booting from an ISO, a shell is displayed for 2 min before the graphics environment starts

• LP: #806784 ubiquity (Ubuntu) Confirmed Oneiric installer crash: not enough space to unpack kernel headers

• LP: #806408 lightdm (Ubuntu) Confirmed After xubuntu upgrade or installation, default session on greeter must be xubuntu

• LP: #805244 ubuntu-sso-client (Ubuntu) Triaged Method "Create Collection" with signature "a{sv}" on interface "org.freedesktop.Secret.Service" doesn't exist

• LP: #805938 unity (Ubuntu) Triaged Totem set as default music player after install instead of Banshee

• LP: #784937 cloud-init (Ubuntu) Confirmed /mnt not mounted, swap not used, disk is xvde

• LP: #799238 casper (Ubuntu) Triaged Xubuntu i386 and amd64 20110618 xserver abort

• LP: #758486 linux-ti-omap4 (Ubuntu) New omapdss DISPC error on Panda platform

• LP: #796793 lightdm (Ubuntu) Triaged accessibilty and shutdown menu are missing icons

• LP: #645818 usb-creator (Ubuntu) Triaged Unknown keyword in configuration file: gfxboot

• LP: #656486 xserver-xorg-video-ati (Ubuntu) Confirmed error de Video - [DRM: radeon_ttm_backend_bind] * * ERROR no pudo enlazar 1.772 pginas

• LP: #793714 zeitgeist (Ubuntu) Triaged zeitgeist-daemon crashed with AttributeError in close(): 'NoneType' object has no attribute 'execute'

• LP: #806399 vinagre (Ubuntu) New Remove Desktop Viewer with Unusual Screen size

• LP: #557261 linux (Ubuntu) Confirmed The session live persistent with USB don't start, error in the prompt initramfs [WARNING: at /build/buildd/linux-2.6.38/drivers/gpu/drm/radeon/radeon_gart.c]

• LP: #805960 kubuntu-default-settings (Ubuntu) Fix Committed quickaccess widget not found

• LP: #657397 ubiquity (Ubuntu) Triaged Install alongside option displays incorrect device designations

• LP: #795046 lightdm (Ubuntu) Triaged xauth broken after logging in with lightdm

• LP: #806247 ubiquity (Ubuntu) Confirmed oem-config/ubiquity fails to configure lightdm for auto-login

• LP: #806559 lightdm (Ubuntu) Triaged debconf prompt about DM to use during natty->oneiric

• LP: #212370 linux (Ubuntu) Confirmed Have to modprobe coretemp manually in order to get CPU temperatures on MacBook Pro

Low

• LP: #784216 initramfs-tools (Ubuntu) Triaged /run/udev not writable error message

• LP: #806446 update-notifier (Ubuntu) New 'Incomplete Language Support' notification should not pop up without a network connection

• LP: #463067 xserver-xorg-input-synaptics (Ubuntu) New installer doesn't see mouse button1 up events

Undecided

• LP: #806082 casper (Ubuntu) Confirmed Shutdown screen after installation is confusing

• LP: #806672 debian-installer (Ubuntu) New UbuntuStudio images for Oneiric Alpha2 fail to install

• LP: #745960 grub2 (Ubuntu) Confirmed Cannot boot grub after installing to LVM

• LP: #779410 flash-kernel (Ubuntu) New package initramfs-tools 0.98.8ubuntu3 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1

• LP: #806113 linux (Ubuntu) New Series of segfaults early in the kernel boot process on omap.

• LP: #806872 ubiquity (Ubuntu) New ISO testing - live system fails to launch

• LP: #608132 unity-2d (Ubuntu) Triaged [dash] Keyboard navigation not implemented as specified

• LP: #702283 usb-creator (Ubuntu) Confirmed usb-creator doesn't create EFI-bootable USB sticks

• LP: #806817 kdebase-workspace (Ubuntu) New systemsettings crashed with ImportError in /usr/share/kde4/apps/system-config-printer-kde/options.py: No module named ppdippstr

• LP: #806453 udev (Ubuntu) New udevd fails with error creating queue file, instance fails to boot

• LP: #212370 lm-sensors (Ubuntu) New Have to modprobe coretemp manually in order to get CPU temperatures on MacBook Pro

• LP: #805906 ubiquity (Ubuntu) Incomplete system won't shutdown

Summary of Test Failures

Kubuntu Alternate amd64+mac - Install (entire disk with encryption)

• LP: #745960 Cannot boot grub after installing to LVM

  • Release Notes for Ubuntu New High
  • grub2 (Ubuntu) Confirmed Undecided
  • grub2 (Ubuntu Natty) Confirmed Undecided
  • grub2 (Ubuntu Oneiric) Confirmed Undecided

Kubuntu DVD amd64 - Live Session

• LP: #805906 system won't shutdown

  • ubiquity (Ubuntu) Incomplete Undecided

Kubuntu Desktop amd64 - Live Session

• LP: #557261 The session live persistent with USB don't start, error in the prompt initramfs [WARNING: at /build/buildd/linux-2.6.38/drivers/gpu/drm/radeon/radeon_gart.c]

  • Linux Confirmed Medium
  • linux (Ubuntu) Confirmed Medium

• LP: #656486 error de Video - [DRM: radeon_ttm_backend_bind] * * ERROR no pudo enlazar 1.772 pginas

  • xserver-xorg-video-ati (Ubuntu) Confirmed Medium
  • xserver-xorg-video-ati (Ubuntu Lucid) New Medium
  • xserver-xorg-video-ati (Ubuntu Maverick) New Undecided
  • xserver-xorg-video-ati (Ubuntu Natty) Confirmed Medium
  • xserver-xorg-video-ati (Ubuntu Oneiric) Confirmed High

Kubuntu Desktop amd64+mac - Install (auto-resize)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Kubuntu Desktop amd64+mac - Install (entire disk)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Kubuntu Desktop amd64+mac - Install (manual partitioning)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Kubuntu Desktop amd64+mac - Live Session

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Kubuntu Desktop i386 - Live Session

• LP: #564471 Lucid: garbled video at boot on radeon cards: bad color map due to 16-bit fb

  • plymouth (Ubuntu) Triaged High
  • plymouth (Ubuntu Lucid) Triaged High
  • plymouth (Ubuntu Natty) Triaged High

Mythbuntu Desktop i386 - Live Session

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

Netboot amd64 - Install (Xubuntu)

• LP: #806408 After xubuntu upgrade or installation, default session on greeter must be xubuntu

  • lightdm (Ubuntu) Confirmed Medium

Netboot arm omap - Install (ubuntu)

• LP: #806107 Latest version of u-boot for omap fails to load boot.scr

  • u-boot-linaro (Ubuntu) Fix Committed High

• LP: #806113 Series of segfaults early in the kernel boot process on omap.

  • linux (Ubuntu) New Undecided

Netboot i386 - Install (Xubuntu)

• LP: #806408 After xubuntu upgrade or installation, default session on greeter must be xubuntu

  • lightdm (Ubuntu) Confirmed Medium

Ubuntu Alternate amd64+mac - Free Software Only

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Alternate amd64+mac - Install (auto-resize)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Alternate amd64+mac - Install (entire disk with encryption)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Alternate amd64+mac - Install (entire disk)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Desktop amd64 - Install (OEM setup)

• LP: #806349 OEM Install fails with - KeyError: "The cache has no package named 'python2.6-minimal'" - without network connection.

  • ubiquity (Ubuntu) Fix Committed High
  • ubiquity (Ubuntu Oneiric) Fix Committed High

• LP: #806358 no menu bar on top, compositing bug?

  • unity (Ubuntu) New High

Ubuntu Desktop amd64+mac - Install (auto-resize)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Desktop amd64+mac - Install (entire disk)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Desktop amd64+mac - Install (manual partitioning)

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Desktop amd64+mac - Live Session

• LP: #702283 usb-creator doesn't create EFI-bootable USB sticks

  • usb-creator (Ubuntu) Confirmed Undecided

• LP: #796132 cd iso to big for 700mb cd

  • casper (Ubuntu) Invalid Undecided

Ubuntu Server amd64 - Install (default + RAID1)

• LP: #791454 RAID1 Test Failed: Device need to be readded manually

  • mdadm (Ubuntu) In Progress High
  • mdadm (Ubuntu Oneiric) In Progress High

Ubuntu Server armel+omap - Ubuntu Server Preinstall Armel

• LP: #806107 Latest version of u-boot for omap fails to load boot.scr

  • u-boot-linaro (Ubuntu) Fix Committed High

• LP: #806113 Series of segfaults early in the kernel boot process on omap.

  • linux (Ubuntu) New Undecided

Ubuntu Server i386 - Install (Openssh server)

• LP: #790712 20110531 i386 server ISO: order 5 allocation failure during install

  • linux (Ubuntu) Confirmed High
  • linux (Ubuntu Natty) Confirmed Undecided
  • linux (Ubuntu Oneiric) Confirmed High

Ubuntu Server i386 - Install (Samba server)

• LP: #790712 20110531 i386 server ISO: order 5 allocation failure during install

  • linux (Ubuntu) Confirmed High
  • linux (Ubuntu Natty) Confirmed Undecided
  • linux (Ubuntu Oneiric) Confirmed High

Ubuntu Server i386 - Install (Virtualization host)

• LP: #790712 20110531 i386 server ISO: order 5 allocation failure during install

  • linux (Ubuntu) Confirmed High
  • linux (Ubuntu Natty) Confirmed Undecided
  • linux (Ubuntu Oneiric) Confirmed High

Ubuntu Server i386 - Install (default + RAID1)

• LP: #791454 RAID1 Test Failed: Device need to be readded manually

  • mdadm (Ubuntu) In Progress High
  • mdadm (Ubuntu Oneiric) In Progress High

Ubuntu Server i386 - Install (default)

• LP: #790712 20110531 i386 server ISO: order 5 allocation failure during install

  • linux (Ubuntu) Confirmed High
  • linux (Ubuntu Natty) Confirmed Undecided
  • linux (Ubuntu Oneiric) Confirmed High

Ubuntu Studio Alternate amd64 - Install (entire disk with encryption)

• LP: #806672 UbuntuStudio images for Oneiric Alpha2 fail to install

  • debian-installer (Ubuntu) New Undecided

Ubuntu Studio Alternate i386 - Install (entire disk with encryption)

• LP: #806672 UbuntuStudio images for Oneiric Alpha2 fail to install

  • debian-installer (Ubuntu) New Undecided

Upgrade Ubuntu i386 - Upgrade

• LP: #781076 package doc-base 0.9.5ubuntu2 failed to install/upgrade: Byte order is not compatible at ../../lib/Storable.pm

  • doc-base (Ubuntu) Triaged Critical
  • doc-base (Ubuntu Oneiric) Triaged Critical
  • doc-base (Debian) Unknown Unknown

• LP: #806559 debconf prompt about DM to use during natty->oneiric

  • lightdm (Ubuntu) Triaged Medium
  • lightdm (Ubuntu Oneiric) Triaged Medium

Upgrade Xubuntu i386 - Upgrade

• LP: #781076 package doc-base 0.9.5ubuntu2 failed to install/upgrade: Byte order is not compatible at ../../lib/Storable.pm

  • doc-base (Ubuntu) Triaged Critical
  • doc-base (Ubuntu Oneiric) Triaged Critical
  • doc-base (Debian) Unknown Unknown

Xubuntu Desktop amd64 - Live Session

• LP: #645818 Unknown keyword in configuration file: gfxboot

  • usb-creator (Ubuntu) Triaged Medium
  • usb-creator (Ubuntu Lucid) Invalid Critical
  • usb-creator (Ubuntu Maverick) Triaged Medium
  • usb-creator (Ubuntu Natty) Triaged Medium
  • usb-creator (Ubuntu Oneiric) Triaged Medium
  • usb-creator (Fedora) Unknown Unknown

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

• LP: #799754 Please let vendors easily provide their own config

  • lightdm (Ubuntu) Triaged High

Xubuntu Desktop i386 - Live Session

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

• LP: #799238 Xubuntu i386 and amd64 20110618 xserver abort

  • casper (Ubuntu) Triaged Medium

• LP: #799754 Please let vendors easily provide their own config

  • lightdm (Ubuntu) Triaged High

• LP: #799754 Please let vendors easily provide their own config

  • lightdm (Ubuntu) Triaged High

• LP: #799754 Please let vendors easily provide their own config

  • lightdm (Ubuntu) Triaged High

• LP: #806872 ISO testing - live system fails to launch

  • ubiquity (Ubuntu) New Undecided

Test Coverage Details by image