NattyAlpha1TestReport

Natty Alpha1 Test Report - December 3rd, 2010

Summary

Test Coverage

Image Coverage: 43/47 = 91.49 %
- Uncovered Images:
  - Upgrade Kubuntu amd64
  - Upgrade Ubuntu amd64
  - Upgrade Ubuntu Server amd64
  - Upgrade Xubuntu amd64
Mandatory Testcase Coverage: 133/163 = 81.60 %
Optional Testcase Coverage: 12/40 = 30.00 %

Test Failure Analysis

36 Test Failures
Failure Rate 36/145 = 24.83 %

Bugs summary

Summary of Unfixed Issues

30 bugs unfixed

Critical - 1
High - 7
Medium - 4
Low - 3
Undecided - 15

See section titled "Details of Unfixed Issues" below.

Summary of Fixed Issues

4 bugs fixed

High - 2
Low - 1
Undecided - 1

Summary of test failures

Kubuntu Alternate amd64 - Install (OEM setup)

LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High

Tester's comment:

Kubuntu Desktop amd64 - Install (entire disk)

LP: #684423 - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided

Tester's comment: Hardware test

Kubuntu Desktop amd64 - Live Session

LP: #656486 - New report detailing "video error" - Incomplete - Undecided
LP: #629079 - apport will not work - New - Undecided

Tester's comment: Case ID: dls-001 and dls-002 are OK, but there is video error.

Case ID: dls-003 is KO, doesn't start the session live persistent.

PS: It is impossible to make the bug with the application "apport" because it does not work.

Kubuntu Desktop amd64 - Live Session

LP: #629079 - apport will not work - New - Undecided

Tester's comment: dls-003 not working

hardware test

Kubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment: Persistance still doesn't work.

Ubuntu Alternate amd64 - Install (auto-resize)

LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided

Tester's comment: System reboots but X doesn't work.

Failsafe works.

Ubuntu Alternate i386 - Install (OEM setup)

LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High

Tester's comment:

Ubuntu ARM Preinstalled omap4 - Pandaboard ARM Image Testing

LP: #684397 - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High

Tester's comment: System will fail unless ubiquity 2.5.5 fix is added to the image prior to first boot.

Ubuntu Desktop amd64 - Install (entire disk)

LP: #683775 - Natty Alpha 1, i915 has blank screen after boot - In Progress - High

Tester's comment: boots to alternatly black or purple screen, about 1/4 you get desktop; when desktop is visible the system seems ok, when not displayed desktop is running power button then return shutsdown as expected

Ubuntu Desktop amd64 - Install (entire disk)

LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided

Tester's comment:

Ubuntu Desktop amd64 - Install (manual partitioning)

LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided

Tester's comment:

Ubuntu Desktop amd64 - Install (manual partitioning)

LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided

Tester's comment: Installed, graphics ATI. Display doesn't work with xserver drivers, install restricted plymouth hangs, doesn't hand when restricted drivers are not installed

Ubuntu Desktop amd64 - Install (OEM setup)

LP: #684073 - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided

Tester's comment: Could not install from desktop so had to chose "install" option when booting from LiveCD image.

Note: Machine did not have 3D accelleration, so tested Classic Desktop version.

Ubuntu Desktop i386 - Free Software Only

LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided

Tester's comment:

Ubuntu Desktop i386 - Free Software Only

LP: #684208 - Misleading "Installation Finished" info box - Triaged - Low

Tester's comment:

Ubuntu Desktop i386 - Install (manual partitioning)

LP: #683994 - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium
LP: #683999 - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium

Tester's comment:

Ubuntu Desktop i386 - Install (OEM setup)

LP: #684036 - Installation stalls after keyboard selection - New - High

Tester's comment: Tested on hw (dell mini 9), the installation stalls after selecting the keyboard layout

Ubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment: Tested on HW. The Live session worked fine, but the persistence is not working.

Ubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment: No 3D fallback workaround works now, but no persistence

Ubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment: Persistance doesn't work.

Ubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment: 3D fallback works now, giving an informative message.

Ubuntu Desktop i386 - Live Session

LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided

Tester's comment: compiz crash when select extra visual effect by appearance proprieters

Ubuntu Desktop i386 - Live Session

LP: #683260 - persistence doesn't work on liveusb - New - Undecided

Tester's comment:

Ubuntu Desktop i386 - Live Session

LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided

Tester's comment: Compiz crash when I select extra visual effect

Ubuntu Desktop i386 - Wubi (Windows installer)

LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided

Tester's comment:

Ubuntu Desktop i386 - Wubi (Windows installer)

LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided

Tester's comment: when launch autorun wubi says: "no cd dected, cannot run CD menu" launch it manually and iso wants to install ubuntu 10.10 maverick.

Ubuntu Server amd64 - Install (Virtualization host)

LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High

Tester's comment: cpu-checker : Depends msr-tools but is not installable

qemu-kvm: Conflicts: kvm

Ubuntu Server amd64 - UEC install (minimal topology)

LP: #684304 - cciss module does not identify resources - New - High

Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig)

Ubuntu Server amd64 - UEC install (minimal topology)

LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High

Tester's comment: Nodes fail to install, due to cpu-checker failing.

Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (Europe) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (Europe) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (US-East) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (US-East) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (US-West) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 EBS (US-West) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (Europe) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (Europe) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (US-East) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (US-East) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (US-West) i386 - EC2 Multiple Instances Run

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server EC2 instance (US-West) i386 - EC2 User Data

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

Tester's comment:

Ubuntu Server i386 - Install (Virtualization host)

LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High

Tester's comment:

Ubuntu Server i386 - UEC install (minimal topology)

LP: #684304 - cciss module does not identify resources - New - High

Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig)

Upgrade Kubuntu i386 - Upgrade

LP: #682843 - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High

Tester's comment: == Details of Unfixed Issues ==

Critical

LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical

High

LP: #684036 - Installation stalls after keyboard selection - New - High
LP: #684304 - cciss module does not identify resources - New - High
LP: #683367 - apport fails to create crash file during upgrade to 11.04 - New - High
LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High
LP: #684060 - separated menus: no keyboard shortcuts for menus - Triaged - High
LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High
LP: #683775 - Natty Alpha 1, i915 has blank screen after boot - In Progress - High

Medium

LP: #566818 - [Lucid] cryptsetup passphrase prompt during boot: every character typed repeats the prompt - Confirmed - Medium
LP: #683994 - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium
LP: #684049 - unity launcher displays empty launcher button / type=link folder not supported - Triaged - Medium
LP: #683999 - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium

Low

LP: #656646 - transient network/keyscan issues - Confirmed - Low
LP: #684208 - Misleading "Installation Finished" info box - Triaged - Low
LP: #568643 - Missing jockey notification icon in xfce-panel in Xubuntu - Triaged - Low

Undecided

LP: #684423 - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided
LP: #629079 - apport will not work - New - Undecided
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided
LP: #684052 - live CD does not have reboot on the power menu - New - Undecided
LP: #682429 - Choosing use entire partition actually results in using entire disc - New - Undecided
LP: #657397 - Install alongside option displays incorrect device designations - New - Undecided
LP: #628097 - Maverick ubiquity windows can not be resized/maximized - New - Undecided
LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided
LP: #683704 - minimal install exceeds size objective - New - Undecided
LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided
LP: #657086 - No restart option after choosing to "Continue Testing" - Confirmed - Undecided
LP: #656486 - New report detailing "video error" - Incomplete - Undecided
LP: #684073 - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided
LP: #682327 - Compiz crashes when hitting Alt-Tab - Mesa 7.9 implementation error: bad format in _mesa_format_to_type_and_comps - Incomplete - Undecided

Details of Fixed Issues

High

LP: #684397 - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High
LP: #682843 - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High

Low

LP: #684050 - Typo in the release Notes 'Welcome to the Ubuntu "Natty Narwahl"' should be Narwhal - Fix Committed - Low

Undecided

LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided

Details of Invalid Issues

QATeam/ReleaseReports/NattyAlpha1TestReport (last edited 2010-12-03 09:40:45 by ACaen-151-1-71-98)

Ubuntu Wiki