PreciseAlpha1TestReport

Precise Alpha 1 Testing report - Dec 02, 2011

Summary

The pass rate is much higher than Oneiric Alpha 1 It is 97.80% for Precise A1 against 89.22% for Oneiric Alpha 1, and 18 bugs found in this milestone against 39 for the same milestone in Oneiric. But the number of critical and high importance defects are close (2 critical in both and 9 high in Precise against 12 in Oneiric)

The number of contributions is in line with Oneiric Alpha 1.

Test Coverage

33 contributors have provided 238 results and covered 227 testcases.

  • Image Coverage : 79.59% (39/49)


Coverage broken down by peoduct

Product

Coverage

Pass Rate

Edubuntu

100.00%

100.00%

Kubuntu

12.96%

77.78%

Lubuntu

85.71%

91.67%

Netboot

100.00%

100.00%

Ubuntu

83.87%

97.10%

Ubuntu Core

100.00%

100.00%

Ubuntu Server

90.00%

98.18%

Upgrade

100.00%

80.00%

Xubuntu

88.89%

95.65%

AMD64+Mac and PowerPC untested

Failures summary

18 bugs have been reported affecting a total of 15 test cases.


5 Tests failed.

  • Pass Rate: 97.80% (222/227)


Bug Tasks Importance

  • Critical : 2 (2 closed)
  • High : 9 (2 closed)
  • Medium : 6 (2 closed)
  • Undecided : 6 (1 closed)

Bugs Details

Details of Fixed Issues

Critical

  • LP: #893842 policykit-1 (Ubuntu) Fix Released Move "admin" group to "sudo"

  • LP: #898482 update-manager (Ubuntu) Fix Released Lucid to Precise upgrade fails: release upgrader fails to start

High

  • LP: #893842 language-selector (Ubuntu) Fix Released Move "admin" group to "sudo"

  • LP: #893842 policykit-desktop-privileges (Ubuntu) Fix Released Move "admin" group to "sudo"

Medium

  • LP: #893842 accountsservice (Ubuntu) Fix Released Move "admin" group to "sudo"

  • LP: #893842 jockey (Ubuntu) Fix Released Move "admin" group to "sudo"

Undecided

  • LP: #893842 userconfig (Ubuntu) Fix Released Move "admin" group to "sudo"

Details of Opened Issues

High

  • LP: #898551 update-manager (Ubuntu) Confirmed lucid desktop i386 -> precise upgrade failed: Resolver failed to calculate the upgrade

  • LP: #897714 ubiquity (Ubuntu) New oem-config-remove-gtk crashed with SystemExit in _on_failure(): 1

  • LP: #894768 linux (Ubuntu) In Progress Installation randomly fails with: File "/usr/lib/ubiquity/ubiquity/install_misc.py", line 621, in copy_file targetfh.write(buf) IOError: [Errno 22] Invalid argument

  • LP: #871785 ubiquity (Ubuntu) New crash on ARM at the end of install

  • LP: #766265 ubiquity (Ubuntu) Confirmed Ubiquity proceeds to use free space without warning

  • LP: #897680 ubiquity (Ubuntu) In Progress Precise Desktop 64Bit: libc6 fails to install if "install 3rd party software" is selected

  • LP: #838200 u-boot-linaro (Ubuntu) Confirmed No network support on Beagle XM

Medium

  • LP: #892394 unity-greeter (Ubuntu) Triaged Greeter logo needs to be updated for 12.04

  • LP: #897921 grub2 (Ubuntu) New Corrupted grub screen in Precise alpha1

  • LP: #837470 pcmanfm (Ubuntu) Confirmed ISO Persistent mode : Desktop doesn't show documents and folders

  • LP: #898127 linux (Ubuntu) Confirmed system hangs and errors at /build/buildd/linux-3.2.0/arch/x86/kernel/apic/ipi.c:113 default_send_IPI_mask_logical+0xdc/0xf0()

Undecided

  • LP: #897623 xserver-xorg-input-synaptics (Ubuntu) New Touchpad stops working on Samsung N310 shortly after first boot of Precise Alpha1

  • LP: #871553 xfce4-power-manager (Ubuntu) Confirmed Oneiric Lubuntu xfce4-power-manager displays a "broken" icon in lxpanel

  • LP: #888669 software-center (Ubuntu) Confirmed software-center crashed with IndexError in set_thumbnails_from_data(): list index out of range

  • LP: #897893 gnome-terminal (Ubuntu) New CTRL+ALT+T doesn't open a terminal anymore

  • LP: #897896 ubiquity (Ubuntu) New keyboard layout wrong choosing a different language for live session

Summary of Test Failures

Lubuntu Desktop i386 - Install (manual partitioning)

  • LP: #894768 Installation randomly fails with: File "/usr/lib/ubiquity/ubiquity/install_misc.py", line 621, in copy_file targetfh.write(buf) IOError: [Errno 22] Invalid argument

    • linux (Ubuntu) In Progress High
    • linux (Ubuntu Precise) In Progress High

Ubuntu Desktop i386 - Install (OEM setup)

  • LP: #894768 Installation randomly fails with: File "/usr/lib/ubiquity/ubiquity/install_misc.py", line 621, in copy_file targetfh.write(buf) IOError: [Errno 22] Invalid argument

    • linux (Ubuntu) In Progress High
    • linux (Ubuntu Precise) In Progress High

Ubuntu Server i386 - Install (default)

  • LP: #898127 system hangs and errors at /build/buildd/linux-3.2.0/arch/x86/kernel/apic/ipi.c:113 default_send_IPI_mask_logical+0xdc/0xf0()

    • Release Notes for Ubuntu New Undecided
    • Release Notes for Ubuntu precise New Undecided
    • linux (Ubuntu) Confirmed Medium

Upgrade Ubuntu i386 - Upgrade

  • LP: #898482 Lucid to Precise upgrade fails: release upgrader fails to start

    • update-manager (Ubuntu) Fix Released Critical
    • update-manager (Ubuntu Precise) Fix Released Critical

Xubuntu Desktop i386 - Install (auto-resize)

  • LP: #894768 Installation randomly fails with: File "/usr/lib/ubiquity/ubiquity/install_misc.py", line 621, in copy_file targetfh.write(buf) IOError: [Errno 22] Invalid argument

    • linux (Ubuntu) In Progress High
    • linux (Ubuntu Precise) In Progress High

Test Coverage Details by image

Image

Mandatory

Run Once

Edubuntu DVD amd64

2/2

1/1

Edubuntu DVD i386

2/2

1/1

Kubuntu Alternate amd64

0/4

1/4

Kubuntu Alternate amd64+mac

0/3

-

Kubuntu Alternate i386

0/4

0/4

Kubuntu Alternate powerpc

0/3

-

Kubuntu Desktop amd64

1/7

-

Kubuntu Desktop amd64+mac

0/4

-

Kubuntu Desktop armel+omap

1/1

-

Kubuntu Desktop armel+omap4

1/1

-

Kubuntu Desktop i386

1/7

-

Kubuntu Desktop powerpc

0/4

-

Kubuntu DVD amd64

2/4

-

Kubuntu DVD i386

0/4

-

Lubuntu Alternate amd64

3/3

-

Lubuntu Alternate i386

3/3

-

Lubuntu Desktop amd64

2/4

-

Lubuntu Desktop i386

4/4

-

Netboot amd64

4/4

-

Netboot i386

4/4

-

Ubuntu Alternate amd64

6/6

4/4

Ubuntu Alternate amd64+mac

0/4

-

Ubuntu Alternate i386

6/6

4/4

Ubuntu Alternate powerpc

0/5

-

Ubuntu Core amd64

1/1

-

Ubuntu Core armel

1/1

-

Ubuntu Core i386

1/1

-

Ubuntu Desktop amd64

6/7

5/9

Ubuntu Desktop amd64+mac

0/4

-

Ubuntu Desktop armel+ac100

1/1

-

Ubuntu Desktop armel+mx5

1/1

-

Ubuntu Desktop armel+omap

1/1

-

Ubuntu Desktop armel+omap4

1/1

-

Ubuntu Desktop i386

6/7

5/9

Ubuntu Desktop powerpc

0/5

-

Ubuntu DVD amd64

3/3

-

Ubuntu DVD i386

3/3

-

Ubuntu Server amd64

14/15

4/4

Ubuntu Server armel+omap

1/1

-

Ubuntu Server armel+omap4

1/1

-

Ubuntu Server i386

14/15

2/4

Upgrade Ubuntu amd64

1/1

-

Upgrade Ubuntu i386

1/1

-

Upgrade Ubuntu Server amd64

1/1

-

Upgrade Ubuntu Server i386

1/1

-

Xubuntu Alternate amd64

3/3

1/1

Xubuntu Alternate i386

3/3

1/1

Xubuntu Desktop amd64

4/5

-

Xubuntu Desktop i386

4/5

-

QATeam/ReleaseReports/PreciseAlpha1TestReport (last edited 2011-12-02 13:19:12 by jibel)