NattyAlpha1TestReport
Size: 12382
Comment:
|
← Revision 6 as of 2010-12-03 09:40:45 ⇥
Size: 19779
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 1: | Line 1: |
= Maverick RC Test Report - 1st October 2010 = | ## page was copied from QATeam/ReleaseReports/MaverickRCTestReport = Natty Alpha1 Test Report - December 3rd, 2010 = |
Line 6: | Line 8: |
* Image Coverage: 100% * Mandatory Testcase Coverage: 199/203 = 98.03% * "Run Once" Testcase Coverage: 18/19 = 94.74% |
* Image Coverage: 43/47 = 91.49 % * Uncovered Images: * Upgrade Kubuntu amd64 * Upgrade Ubuntu amd64 * Upgrade Ubuntu Server amd64 * Upgrade Xubuntu amd64 * Mandatory Testcase Coverage: 133/163 = 81.60 % * Optional Testcase Coverage: 12/40 = 30.00 % |
Line 11: | Line 17: |
* 16 Test Failures * Failure Rate 16/237 = 6.75 |
* 36 Test Failures * Failure Rate 36/145 = 24.83 % |
Line 16: | Line 22: |
49 bugs unfixed * High - 5 * Medium - 11 * Low - 4 * Undecided - 29 |
30 bugs unfixed * Critical - 1 * High - 7 * Medium - 4 * Low - 3 * Undecided - 15 |
Line 26: | Line 34: |
3 bugs fixed * High - 3 |
4 bugs fixed * High - 2 * Low - 1 * Undecided - 1 |
Line 31: | Line 42: |
=== Kubuntu Alternate amd64 - Install (OEM setup) === * LP: [[https://bugs.launchpad.net/bugs/650703|#650703]] - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High Tester's comment: === Kubuntu Desktop amd64 - Install (entire disk) === * LP: [[https://bugs.launchpad.net/bugs/684423|#684423]] - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided Tester's comment: Hardware test |
|
Line 32: | Line 49: |
* LP: Bug:#580918 - video error - Confirmed - Undecided Tester's comment: Case ID: dls-001 and dls-002 are OK, but there is a problem with video. Case ID: dls-003 is KO, becouse don't start the persistent live session. |
* LP: [[https://bugs.launchpad.net/bugs/656486|#656486]] - New report detailing "video error" - Incomplete - Undecided * LP: [[https://bugs.launchpad.net/bugs/629079|#629079]] - apport will not work - New - Undecided Tester's comment: Case ID: dls-001 and dls-002 are OK, but there is video error. Case ID: dls-003 is KO, doesn't start the session live persistent. PS: It is impossible to make the bug with the application "apport" because it does not work. === Kubuntu Desktop amd64 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/629079|#629079]] - apport will not work - New - Undecided Tester's comment: dls-003 not working hardware test |
Line 37: | Line 62: |
* LP: Bug:#532984 - Ubuntu 10.04 Alpha 3 won't boot on HP Compaq Pentium 4; displays an irrelevant Glib warning on the console - Invalid - Undecided Tester's comment: I could not boot because of the above bug. === Mythbuntu Desktop amd64 - Live Session === * LP: Bug:#650770 - nvidia 6150 display failure - New - Undecided Tester's comment: Live session not usable on nvidia 6150 system === Netboot arm omap - Install (ubuntu) === * LP: Bug:#652522 - modules missing from omap netboot image. - Confirmed - Medium Tester's comment: The system boots into debian installer, but there is no keyboard input and trying with the serial console fails as well. === Ubuntu Alternate amd64 - Install (OEM setup) === * LP: Bug:#650703 - OEM config appears to work but user setup is not run after reboot - New - Undecided Tester's comment: === Ubuntu Desktop i386 - Live Session === * LP: Bug:#439694 - nautilus crashed with SIGSEGV in g_cclosure_marshal_VOID__VOID() - Triaged - Medium Tester's comment: === Ubuntu Desktop i386 - Live Session === * LP: Bug:#640807 - Forces low refresh rate on CRT monitor - Confirmed - Undecided Tester's comment: Can't run Live CD, LCD monitor spits error: Input signal out of range. |
* LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: Persistance still doesn't work. === Ubuntu Alternate amd64 - Install (auto-resize) === * LP: [[https://bugs.launchpad.net/bugs/681294|#681294]] - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided Tester's comment: System reboots but X doesn't work. Failsafe works. === Ubuntu Alternate i386 - Install (OEM setup) === * LP: [[https://bugs.launchpad.net/bugs/650703|#650703]] - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High Tester's comment: === Ubuntu ARM Preinstalled omap4 - Pandaboard ARM Image Testing === * LP: [[https://bugs.launchpad.net/bugs/684397|#684397]] - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High Tester's comment: System will fail unless ubiquity 2.5.5 fix is added to the image prior to first boot. === Ubuntu Desktop amd64 - Install (entire disk) === * LP: [[https://bugs.launchpad.net/bugs/683775|#683775]] - Natty Alpha 1, i915 has blank screen after boot - In Progress - High Tester's comment: boots to alternatly black or purple screen, about 1/4 you get desktop; when desktop is visible the system seems ok, when not displayed desktop is running power button then return shutsdown as expected === Ubuntu Desktop amd64 - Install (entire disk) === * LP: [[https://bugs.launchpad.net/bugs/684083|#684083]] - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided Tester's comment: === Ubuntu Desktop amd64 - Install (manual partitioning) === * LP: [[https://bugs.launchpad.net/bugs/684083|#684083]] - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided Tester's comment: === Ubuntu Desktop amd64 - Install (manual partitioning) === * LP: [[https://bugs.launchpad.net/bugs/684083|#684083]] - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided Tester's comment: Installed, graphics ATI. Display doesn't work with xserver drivers, install restricted plymouth hangs, doesn't hand when restricted drivers are not installed === Ubuntu Desktop amd64 - Install (OEM setup) === * LP: [[https://bugs.launchpad.net/bugs/684073|#684073]] - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided Tester's comment: Could not install from desktop so had to chose "install" option when booting from LiveCD image. Note: Machine did not have 3D accelleration, so tested Classic Desktop version. === Ubuntu Desktop i386 - Free Software Only === * LP: [[https://bugs.launchpad.net/bugs/681294|#681294]] - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided Tester's comment: === Ubuntu Desktop i386 - Free Software Only === * LP: [[https://bugs.launchpad.net/bugs/684208|#684208]] - Misleading "Installation Finished" info box - Triaged - Low Tester's comment: === Ubuntu Desktop i386 - Install (manual partitioning) === * LP: [[https://bugs.launchpad.net/bugs/683994|#683994]] - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium * LP: [[https://bugs.launchpad.net/bugs/683999|#683999]] - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium Tester's comment: === Ubuntu Desktop i386 - Install (OEM setup) === * LP: [[https://bugs.launchpad.net/bugs/684036|#684036]] - Installation stalls after keyboard selection - New - High Tester's comment: Tested on hw (dell mini 9), the installation stalls after selecting the keyboard layout === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: Tested on HW. The Live session worked fine, but the persistence is not working. === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: No 3D fallback workaround works now, but no persistence === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: Persistance doesn't work. === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: 3D fallback works now, giving an informative message. === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/684193|#684193]] - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided Tester's comment: compiz crash when select extra visual effect by appearance proprieters === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided Tester's comment: === Ubuntu Desktop i386 - Live Session === * LP: [[https://bugs.launchpad.net/bugs/684193|#684193]] - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided Tester's comment: Compiz crash when I select extra visual effect |
Line 55: | Line 129: |
* LP: Bug:#651084 - Maverick Wubi fails to install when no network is present - New - Undecided Tester's comment: Update: even after installing a 3rd time using the same steps as jibel, I was unable to boot Ubuntu after doing a Wubi install on Windows XP 32bit on my Lenovo S-10 netbook. Should be Failed because I could not install without a network connection. Wubi failed every time without an active network connection, even though it's being run from a USB stick that was built from the Maverick 32bit Desktop ISO and should contain everything necessary to install. === Ubuntu Netbook Edition - Install (entire disk) === * LP: Bug:#651085 - When installing UNE, not clear what to do when GPU isn't supported - Triaged - Low Tester's comment: === Ubuntu Netbook Edition - Install (OEM setup) === * LP: Bug:#651112 - External hard drive install won't boot - New - Undecided * LP: Bug:#651098 - Launcher says "Ubuntu-Netbook" but should say "Ubuntu Netbook Edition" - New - Undecided Tester's comment: === Ubuntu Server amd64 - Install (Print server) === * LP: Bug:#650893 - [maverick] cups does not start at boot time - Fix Committed - High Tester's comment: === Ubuntu Server i386 - Install (Print server) === * LP: Bug:#650893 - [maverick] cups does not start at boot time - Fix Committed - High Tester's comment: === Upgrade Kubuntu amd64 - Upgrade === * LP: Bug:#496435 - upgrades of the grub-pc package can overwrite wrong MBR - Fix Released - High * LP: Bug:#642925 - after upgrading from 10.04.1 (Server) and rebooting, grub error: "the symbol 'grub_xputs not found." - Incomplete - Undecided * LP: Bug:#650546 - kdm crashes after login - New - Undecided Tester's comment: Upgrade process went fine, no errors. Upon reboot, i got grub error: the symbol `grub_xputs` not found I have a mixed sata/pata system, repaired grub from usb stick. Getting a KDM loop, or rather KDM or X is crashing after a few moments/minutes from login === Upgrade Ubuntu i386 - Upgrade === * LP: Bug:#640807 - Forces low refresh rate on CRT monitor - Confirmed - Undecided Tester's comment: Upon reboot my 22" LCD spits the error: Input signal out of range. === Upgrade Wubi amd64 - Upgrade === * LP: Bug:#651325 - package gnome-keyring 2.92.92.is.2.30.3-0ubuntu1.1 failed to install/upgrade: /var/lib/dpkg/tmp.ci/preinst: 31: dpkg-maintscript-helper: not found - New - Undecided Tester's comment: === Upgrade Wubi i386 - Upgrade === * LP: Bug:#651325 - package gnome-keyring 2.92.92.is.2.30.3-0ubuntu1.1 failed to install/upgrade: /var/lib/dpkg/tmp.ci/preinst: 31: dpkg-maintscript-helper: not found - New - Undecided Tester's comment: system unbootable after upgrade. selecting the 'Ubuntu' entry in the NT Bootloader restart the computer <<Anchor(UnfixedIssues)>> == Details of Unfixed Issues == |
* LP: [[https://bugs.launchpad.net/bugs/684076|#684076]] - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided Tester's comment: === Ubuntu Desktop i386 - Wubi (Windows installer) === * LP: [[https://bugs.launchpad.net/bugs/684076|#684076]] - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided Tester's comment: when launch autorun wubi says: "no cd dected, cannot run CD menu" launch it manually and iso wants to install ubuntu 10.10 maverick. === Ubuntu Server amd64 - Install (Virtualization host) === * LP: [[https://bugs.launchpad.net/bugs/683700|#683700]] - tasksel 'Virtualisation Host' fails to install - Triaged - High Tester's comment: cpu-checker : Depends msr-tools but is not installable qemu-kvm: Conflicts: kvm === Ubuntu Server amd64 - UEC install (minimal topology) === * LP: [[https://bugs.launchpad.net/bugs/684304|#684304]] - cciss module does not identify resources - New - High Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig) === Ubuntu Server amd64 - UEC install (minimal topology) === * LP: [[https://bugs.launchpad.net/bugs/683700|#683700]] - tasksel 'Virtualisation Host' fails to install - Triaged - High Tester's comment: Nodes fail to install, due to cpu-checker failing. === Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (Europe) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (Europe) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (US-East) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (US-East) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (US-West) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 EBS (US-West) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (Europe) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (Europe) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (US-East) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (US-East) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (US-West) i386 - EC2 Multiple Instances Run === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server EC2 instance (US-West) i386 - EC2 User Data === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical Tester's comment: === Ubuntu Server i386 - Install (Virtualization host) === * LP: [[https://bugs.launchpad.net/bugs/683700|#683700]] - tasksel 'Virtualisation Host' fails to install - Triaged - High Tester's comment: === Ubuntu Server i386 - UEC install (minimal topology) === * LP: [[https://bugs.launchpad.net/bugs/684304|#684304]] - cciss module does not identify resources - New - High Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig) === Upgrade Kubuntu i386 - Upgrade === * LP: [[https://bugs.launchpad.net/bugs/682843|#682843]] - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High Tester's comment: <<Anchor(UnfixedIssues)>>== Details of Unfixed Issues == === Critical === * LP: [[https://bugs.launchpad.net/bugs/669496|#669496]] - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical |
Line 103: | Line 208: |
* LP: Bug:#628930 - [i945GME] KDE Desktop effects not active by default - New - High * LP: Bug:#627815 - unable to save user-places.xbel - Confirmed - High * LP: Bug:#637947 - no sound devices on current ES2.0 boards - Confirmed - High * LP: Bug:#649939 - authentication popup does nothing when installating new software - Confirmed - High * LP: Bug:#643791 - Installation icon missing from Dove live image. - Triaged - High |
* LP: [[https://bugs.launchpad.net/bugs/684036|#684036]] - Installation stalls after keyboard selection - New - High * LP: [[https://bugs.launchpad.net/bugs/684304|#684304]] - cciss module does not identify resources - New - High * LP: [[https://bugs.launchpad.net/bugs/683367|#683367]] - apport fails to create crash file during upgrade to 11.04 - New - High * LP: [[https://bugs.launchpad.net/bugs/650703|#650703]] - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High * LP: [[https://bugs.launchpad.net/bugs/684060|#684060]] - separated menus: no keyboard shortcuts for menus - Triaged - High * LP: [[https://bugs.launchpad.net/bugs/683700|#683700]] - tasksel 'Virtualisation Host' fails to install - Triaged - High * LP: [[https://bugs.launchpad.net/bugs/683775|#683775]] - Natty Alpha 1, i915 has blank screen after boot - In Progress - High |
Line 110: | Line 217: |
* LP: Bug:#650995 - rhythmbox crashed with SIGSEGV in pthread_mutex_lock() - New - Medium * LP: Bug:#648414 - upowerd assert failure: *** glibc detected *** /usr/lib/upower/upowerd: double free or corruption (out): 0x00d13ec0 *** - New - Medium * LP: Bug:#651388 - Missing console output - New - Medium * LP: Bug:#652522 - modules missing from omap netboot image. - Confirmed - Medium * LP: Bug:#539027 - end_request: I/O error rebooting at end of install - Confirmed - Medium * LP: Bug:#566818 - [Lucid] cryptsetup passphrase prompt during boot: every character typed repeats the prompt - Confirmed - Medium * LP: Bug:#628221 - Partitioner shows Xubuntu as "Ubuntu Maverick" - Confirmed - Medium * LP: Bug:#439694 - nautilus crashed with SIGSEGV in g_cclosure_marshal_VOID__VOID() - Triaged - Medium * LP: Bug:#649328 - mutter crashed with SIGSEGV in g_signal_emit_valist() - Triaged - Medium * LP: Bug:#567334 - blocked tasks delay cloud-init for 240 seconds - Triaged - Medium * LP: Bug:#651367 - Text plymouth theme needed - Triaged - Medium |
* LP: [[https://bugs.launchpad.net/bugs/566818|#566818]] - [Lucid] cryptsetup passphrase prompt during boot: every character typed repeats the prompt - Confirmed - Medium * LP: [[https://bugs.launchpad.net/bugs/683994|#683994]] - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium * LP: [[https://bugs.launchpad.net/bugs/684049|#684049]] - unity launcher displays empty launcher button / type=link folder not supported - Triaged - Medium * LP: [[https://bugs.launchpad.net/bugs/683999|#683999]] - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium |
Line 123: | Line 223: |
* LP: Bug:#645420 - OTG port not enabled for OMAP4 - Confirmed - Low * LP: Bug:#651085 - When installing UNE, not clear what to do when GPU isn't supported - Triaged - Low * LP: Bug:#570950 - ud-multipart-01 test failed on included files - Triaged - Low * LP: Bug:#568643 - Missing jockey notification icon in xfce-panel in Xubuntu - Triaged - Low |
* LP: [[https://bugs.launchpad.net/bugs/656646|#656646]] - transient network/keyscan issues - Confirmed - Low * LP: [[https://bugs.launchpad.net/bugs/684208|#684208]] - Misleading "Installation Finished" info box - Triaged - Low * LP: [[https://bugs.launchpad.net/bugs/568643|#568643]] - Missing jockey notification icon in xfce-panel in Xubuntu - Triaged - Low |
Line 129: | Line 228: |
* LP: Bug:#650570 - sudo does not work in live image in persistent mode - New - Undecided * LP: Bug:#650934 - Rekonq crashes in a KVM with 800MB ram - New - Undecided * LP: Bug:#651302 - No sound in omap (beagle, beagleXM). - New - Undecided * LP: Bug:#651294 - X crash on KDM logout (still - yes, really) - New - Undecided * LP: Bug:#650770 - nvidia 6150 display failure - New - Undecided * LP: Bug:#650703 - OEM config appears to work but user setup is not run after reboot - New - Undecided * LP: Bug:#645578 - gnome-codec-install fails if universe not part of apt sources.list - New - Undecided * LP: Bug:#651391 - Changing desktop font changed entire theme appearance in une-efl - New - Undecided * LP: Bug:#644714 - Screen corruption waking from screen blank if no monitor present - New - Undecided * LP: Bug:#650449 - jockey-gtk crashed with BackendCrashError in convert_dbus_exceptions() - New - Undecided * LP: Bug:#649895 - ubiquity crashed with AttributeError in reset_locale() - New - Undecided * LP: Bug:#649917 - GLIb-WARNING **: getpwid_r(): failed due to unknown user id - New - Undecided * LP: Bug:#651281 - Need alsa configuration files for Dove A0 SOC platform - New - Undecided * LP: Bug:#651112 - External hard drive install won't boot - New - Undecided * LP: Bug:#651098 - Launcher says "Ubuntu-Netbook" but should say "Ubuntu Netbook Edition" - New - Undecided * LP: Bug:#650561 - Font rendering is garbled and unreadable - New - Undecided * LP: Bug:#651370 - ec2 kernel crash invalid opcode 0000 [#1] - New - Undecided * LP: Bug:#650546 - kdm crashes after login - New - Undecided * LP: Bug:#651325 - package gnome-keyring 2.92.92.is.2.30.3-0ubuntu1.1 failed to install/upgrade: /var/lib/dpkg/tmp.ci/preinst: 31: dpkg-maintscript-helper: not found - New - Undecided * LP: Bug:#651654 - package bcmwl-kernel-source 5.60.48.36 bdcom-0ubuntu5 failed to install/upgrade: subprocess installed post-installation script returned error exit status 1 - New - Undecided * LP: Bug:#580918 - video error - Confirmed - Undecided * LP: Bug:#649905 - Untranslatable messages in the installer - Confirmed - Undecided * LP: Bug:#640807 - Forces low refresh rate on CRT monitor - Confirmed - Undecided * LP: Bug:#628727 - Screen corruption make UNE unusable - Confirmed - Undecided * LP: Bug:#368986 - install fails missing obsolete /dev/MAKEDEV - Confirmed - Undecided * LP: Bug:#650615 - KDM is installed on Edubuntu, resulting in an unwanted gconf question during upgrade - Confirmed - Undecided * LP: Bug:#650689 - pitivi crashed with TypeError in _unblockPad() - Incomplete - Undecided * LP: Bug:#615084 - OK now - Incomplete - Undecided * LP: Bug:#642925 - after upgrading from 10.04.1 (Server) and rebooting, grub error: "the symbol 'grub_xputs not found." - Incomplete - Undecided |
* LP: [[https://bugs.launchpad.net/bugs/684423|#684423]] - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/629079|#629079]] - apport will not work - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/683260|#683260]] - persistence doesn't work on liveusb - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/684083|#684083]] - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/684052|#684052]] - live CD does not have reboot on the power menu - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/682429|#682429]] - Choosing use entire partition actually results in using entire disc - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/657397|#657397]] - Install alongside option displays incorrect device designations - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/628097|#628097]] - Maverick ubiquity windows can not be resized/maximized - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/684193|#684193]] - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/683704|#683704]] - minimal install exceeds size objective - New - Undecided * LP: [[https://bugs.launchpad.net/bugs/681294|#681294]] - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided * LP: [[https://bugs.launchpad.net/bugs/657086|#657086]] - No restart option after choosing to "Continue Testing" - Confirmed - Undecided * LP: [[https://bugs.launchpad.net/bugs/656486|#656486]] - New report detailing "video error" - Incomplete - Undecided * LP: [[https://bugs.launchpad.net/bugs/684073|#684073]] - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided * LP: [[https://bugs.launchpad.net/bugs/682327|#682327]] - Compiz crashes when hitting Alt-Tab - Mesa 7.9 implementation error: bad format in _mesa_format_to_type_and_comps - Incomplete - Undecided == Details of Fixed Issues == === High === * LP: [[https://bugs.launchpad.net/bugs/684397|#684397]] - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High * LP: [[https://bugs.launchpad.net/bugs/682843|#682843]] - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High === Low === * LP: [[https://bugs.launchpad.net/bugs/684050|#684050]] - Typo in the release Notes 'Welcome to the Ubuntu "Natty Narwahl"' should be Narwhal - Fix Committed - Low === Undecided === * LP: [[https://bugs.launchpad.net/bugs/684076|#684076]] - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided == Details of Invalid Issues == |
Line 164: | Line 264: |
* Kubuntu Alternate i386: 4/4 * Kubuntu Desktop amd64: 6/7 * Kubuntu Desktop Arm (omap): 1/1 * Kubuntu Desktop i386: 7/7 * Kubuntu DVD amd64: 4/4 * Kubuntu DVD i386: 4/4 * Kubuntu Mobile armel+omap3: 1/1 * Kubuntu Mobile armel+omap4: 1/1 * Kubuntu Mobile i386: 1/1 * Kubuntu Netbook Arm (dove): 1/1 * Kubuntu Netbook Arm (omap): 1/1 * Mythbuntu Desktop amd64: 3/3 * Mythbuntu Desktop i386: 3/3 * Netboot amd64: 4/4 * Netboot arm dove: 0/0 * Netboot arm imx51: 0/1 * Netboot arm omap: 1/1 * Netboot i386: 4/4 * Ubuntu Alternate amd64: 6/6 * Ubuntu Alternate i386: 6/6 * Ubuntu ARM Preinstalled omap3: 1/1 |
* Kubuntu Alternate i386: 3/4 * Kubuntu Desktop amd64: 4/7 * Kubuntu Desktop i386: 4/7 * Ubuntu Alternate amd64: 2/6 * Ubuntu Alternate i386: 4/6 |
Line 186: | Line 270: |
* Ubuntu Desktop amd64: 8/8 * Ubuntu Desktop i386: 8/8 * Ubuntu DVD amd64: 4/4 |
* Ubuntu Desktop amd64: 5/8 * Ubuntu Desktop i386: 7/8 * Ubuntu DVD amd64: 1/4 |
Line 190: | Line 274: |
* Ubuntu Netbook armel+dove: 2/2 * Ubuntu Netbook Edition: 3/3 * Ubuntu Server amd64: 16/17 |
* Ubuntu Server amd64: 15/17 |
Line 209: | Line 291: |
* Ubuntu Server i386: 16/17 | * Ubuntu Server i386: 15/17 |
Line 214: | Line 296: |
* Upgrade Edubuntu amd64: 1/1 * Upgrade Edubuntu i386: 1/1 * Upgrade Kubuntu amd64: 1/1 |
* Upgrade Kubuntu amd64: 0/1 |
Line 218: | Line 298: |
* Upgrade Ubuntu amd64: 1/1 | * Upgrade Ubuntu amd64: 0/1 |
Line 220: | Line 300: |
* Upgrade Ubuntu Server amd64: 1/1 | * Upgrade Ubuntu Server amd64: 0/1 |
Line 222: | Line 302: |
* Upgrade Wubi amd64: 1/1 * Upgrade Wubi i386: 1/1 * Upgrade Xubuntu amd64: 1/1 |
* Upgrade Xubuntu amd64: 0/1 |
Line 228: | Line 306: |
* Xubuntu Desktop amd64: 5/5 * Xubuntu Desktop i386: 5/5 |
* Xubuntu Desktop amd64: 4/5 * Xubuntu Desktop i386: 4/5 |
Natty Alpha1 Test Report - December 3rd, 2010
Summary
Test Coverage
- Image Coverage: 43/47 = 91.49 %
- Uncovered Images:
- Upgrade Kubuntu amd64
- Upgrade Ubuntu amd64
- Upgrade Ubuntu Server amd64
- Upgrade Xubuntu amd64
- Uncovered Images:
- Mandatory Testcase Coverage: 133/163 = 81.60 %
- Optional Testcase Coverage: 12/40 = 30.00 %
Test Failure Analysis
- 36 Test Failures
- Failure Rate 36/145 = 24.83 %
Bugs summary
Summary of Unfixed Issues
30 bugs unfixed
- Critical - 1
- High - 7
- Medium - 4
- Low - 3
- Undecided - 15
See section titled "Details of Unfixed Issues" below.
Summary of Fixed Issues
4 bugs fixed
- High - 2
- Low - 1
- Undecided - 1
Summary of test failures
Kubuntu Alternate amd64 - Install (OEM setup)
LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High
Tester's comment:
Kubuntu Desktop amd64 - Install (entire disk)
LP: #684423 - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided
Tester's comment: Hardware test
Kubuntu Desktop amd64 - Live Session
LP: #656486 - New report detailing "video error" - Incomplete - Undecided
LP: #629079 - apport will not work - New - Undecided
Tester's comment: Case ID: dls-001 and dls-002 are OK, but there is video error.
Case ID: dls-003 is KO, doesn't start the session live persistent.
PS: It is impossible to make the bug with the application "apport" because it does not work.
Kubuntu Desktop amd64 - Live Session
LP: #629079 - apport will not work - New - Undecided
Tester's comment: dls-003 not working
hardware test
Kubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment: Persistance still doesn't work.
Ubuntu Alternate amd64 - Install (auto-resize)
LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided
Tester's comment: System reboots but X doesn't work.
Failsafe works.
Ubuntu Alternate i386 - Install (OEM setup)
LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High
Tester's comment:
Ubuntu ARM Preinstalled omap4 - Pandaboard ARM Image Testing
LP: #684397 - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High
Tester's comment: System will fail unless ubiquity 2.5.5 fix is added to the image prior to first boot.
Ubuntu Desktop amd64 - Install (entire disk)
LP: #683775 - Natty Alpha 1, i915 has blank screen after boot - In Progress - High
Tester's comment: boots to alternatly black or purple screen, about 1/4 you get desktop; when desktop is visible the system seems ok, when not displayed desktop is running power button then return shutsdown as expected
Ubuntu Desktop amd64 - Install (entire disk)
LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided
Tester's comment:
Ubuntu Desktop amd64 - Install (manual partitioning)
LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided
Tester's comment:
Ubuntu Desktop amd64 - Install (manual partitioning)
LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided
Tester's comment: Installed, graphics ATI. Display doesn't work with xserver drivers, install restricted plymouth hangs, doesn't hand when restricted drivers are not installed
Ubuntu Desktop amd64 - Install (OEM setup)
LP: #684073 - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided
Tester's comment: Could not install from desktop so had to chose "install" option when booting from LiveCD image.
Note: Machine did not have 3D accelleration, so tested Classic Desktop version.
Ubuntu Desktop i386 - Free Software Only
LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided
Tester's comment:
Ubuntu Desktop i386 - Free Software Only
LP: #684208 - Misleading "Installation Finished" info box - Triaged - Low
Tester's comment:
Ubuntu Desktop i386 - Install (manual partitioning)
LP: #683994 - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium
LP: #683999 - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium
Tester's comment:
Ubuntu Desktop i386 - Install (OEM setup)
LP: #684036 - Installation stalls after keyboard selection - New - High
Tester's comment: Tested on hw (dell mini 9), the installation stalls after selecting the keyboard layout
Ubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment: Tested on HW. The Live session worked fine, but the persistence is not working.
Ubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment: No 3D fallback workaround works now, but no persistence
Ubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment: Persistance doesn't work.
Ubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment: 3D fallback works now, giving an informative message.
Ubuntu Desktop i386 - Live Session
LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided
Tester's comment: compiz crash when select extra visual effect by appearance proprieters
Ubuntu Desktop i386 - Live Session
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
Tester's comment:
Ubuntu Desktop i386 - Live Session
LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided
Tester's comment: Compiz crash when I select extra visual effect
Ubuntu Desktop i386 - Wubi (Windows installer)
LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided
Tester's comment:
Ubuntu Desktop i386 - Wubi (Windows installer)
LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided
Tester's comment: when launch autorun wubi says: "no cd dected, cannot run CD menu" launch it manually and iso wants to install ubuntu 10.10 maverick.
Ubuntu Server amd64 - Install (Virtualization host)
LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High
Tester's comment: cpu-checker : Depends msr-tools but is not installable
qemu-kvm: Conflicts: kvm
Ubuntu Server amd64 - UEC install (minimal topology)
LP: #684304 - cciss module does not identify resources - New - High
Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig)
Ubuntu Server amd64 - UEC install (minimal topology)
LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High
Tester's comment: Nodes fail to install, due to cpu-checker failing.
Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (Asia-Pacific) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (Europe) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (Europe) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (US-East) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (US-East) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (US-West) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 EBS (US-West) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (Asia-Pacific) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (Europe) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (Europe) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (US-East) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (US-East) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (US-West) i386 - EC2 Multiple Instances Run
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server EC2 instance (US-West) i386 - EC2 User Data
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
Tester's comment:
Ubuntu Server i386 - Install (Virtualization host)
LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High
Tester's comment:
Ubuntu Server i386 - UEC install (minimal topology)
LP: #684304 - cciss module does not identify resources - New - High
Tester's comment: failed on ISO install -- no CCISS disk resources found (QA UEC test rig)
Upgrade Kubuntu i386 - Upgrade
LP: #682843 - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High
Tester's comment: == Details of Unfixed Issues ==
Critical
LP: #669496 - natty fails ec2 boot on i386 or t1.micro - Confirmed - Critical
High
LP: #684036 - Installation stalls after keyboard selection - New - High
LP: #684304 - cciss module does not identify resources - New - High
LP: #683367 - apport fails to create crash file during upgrade to 11.04 - New - High
LP: #650703 - oem-config-prepare works, but oem-config fails to start after reboot - Confirmed - High
LP: #684060 - separated menus: no keyboard shortcuts for menus - Triaged - High
LP: #683700 - tasksel 'Virtualisation Host' fails to install - Triaged - High
LP: #683775 - Natty Alpha 1, i915 has blank screen after boot - In Progress - High
Medium
LP: #566818 - [Lucid] cryptsetup passphrase prompt during boot: every character typed repeats the prompt - Confirmed - Medium
LP: #683994 - plymouth-text theme shows Ubuntu 10.10 on Natty - Triaged - Medium
LP: #684049 - unity launcher displays empty launcher button / type=link folder not supported - Triaged - Medium
LP: #683999 - Natty slideshow welcome slide shows 10.10, not 11.04 - Triaged - Medium
Low
LP: #656646 - transient network/keyscan issues - Confirmed - Low
LP: #684208 - Misleading "Installation Finished" info box - Triaged - Low
LP: #568643 - Missing jockey notification icon in xfce-panel in Xubuntu - Triaged - Low
Undecided
LP: #684423 - kubuntu 20101202 amd64, install crash with exception during installation - New - Undecided
LP: #629079 - apport will not work - New - Undecided
LP: #683260 - persistence doesn't work on liveusb - New - Undecided
LP: #684083 - Plymouth hangs after installation of nvidia drivers on natty 20101202 - New - Undecided
LP: #684052 - live CD does not have reboot on the power menu - New - Undecided
LP: #682429 - Choosing use entire partition actually results in using entire disc - New - Undecided
LP: #657397 - Install alongside option displays incorrect device designations - New - Undecided
LP: #628097 - Maverick ubiquity windows can not be resized/maximized - New - Undecided
LP: #684193 - compiz crashed with SIGSEGV in g_source_unref() - New - Undecided
LP: #683704 - minimal install exceeds size objective - New - Undecided
LP: #681294 - [STAGING] X doesn't start with 2.6.37-6+ - Confirmed - Undecided
LP: #657086 - No restart option after choosing to "Continue Testing" - Confirmed - Undecided
LP: #656486 - New report detailing "video error" - Incomplete - Undecided
LP: #684073 - Natty OEM liveCD install - no install icon on desktop - Incomplete - Undecided
LP: #682327 - Compiz crashes when hitting Alt-Tab - Mesa 7.9 implementation error: bad format in _mesa_format_to_type_and_comps - Incomplete - Undecided
Details of Fixed Issues
High
LP: #684397 - oem-config fails if patch for ubiquity 2.5.5 is not in the system - Fix Released - High
LP: #682843 - package base-files 5.0.0ubuntu25 failed to install/upgrade: run-parts: /etc/update-motd.d/90-updates-available exited with return code 255 - Fix Released - High
Low
LP: #684050 - Typo in the release Notes 'Welcome to the Ubuntu "Natty Narwahl"' should be Narwhal - Fix Committed - Low
Undecided
LP: #684076 - Wubi.exe on 11.04 ISOs wants to install 10.10 - Fix Released - Undecided
Details of Invalid Issues
Test Coverage Details by Category
- Edubuntu DVD amd64: 2/2
- Edubuntu DVD i386: 2/2
- Kubuntu Alternate amd64: 4/4
- Kubuntu Alternate i386: 3/4
- Kubuntu Desktop amd64: 4/7
- Kubuntu Desktop i386: 4/7
- Ubuntu Alternate amd64: 2/6
- Ubuntu Alternate i386: 4/6
- Ubuntu ARM Preinstalled omap4: 1/1
- Ubuntu Desktop amd64: 5/8
- Ubuntu Desktop i386: 7/8
- Ubuntu DVD amd64: 1/4
- Ubuntu DVD i386: 4/4
- Ubuntu Server amd64: 15/17
- Ubuntu Server EC2 EBS (Asia-Pacific) amd64: 2/2
- Ubuntu Server EC2 EBS (Asia-Pacific) i386: 2/2
- Ubuntu Server EC2 EBS (Europe) amd64: 2/2
- Ubuntu Server EC2 EBS (Europe) i386: 2/2
- Ubuntu Server EC2 EBS (US-East) amd64: 2/2
- Ubuntu Server EC2 EBS (US-East) i386: 2/2
- Ubuntu Server EC2 EBS (US-West) amd64: 2/2
- Ubuntu Server EC2 EBS (US-West) i386: 2/2
- Ubuntu Server EC2 instance (Asia-Pacific) amd64: 2/2
- Ubuntu Server EC2 instance (Asia-Pacific) i386: 2/2
- Ubuntu Server EC2 instance (Europe) amd64: 2/2
- Ubuntu Server EC2 instance (Europe) i386: 2/2
- Ubuntu Server EC2 instance (US-East) amd64: 2/2
- Ubuntu Server EC2 instance (US-East) i386: 2/2
- Ubuntu Server EC2 instance (US-West) amd64: 2/2
- Ubuntu Server EC2 instance (US-West) i386: 2/2
- Ubuntu Server i386: 15/17
- Ubuntu Server UEC amd64: 2/2
- Ubuntu Server UEC i386: 2/2
- Ubuntu Studio Alternate amd64: 3/3
- Ubuntu Studio Alternate i386: 3/3
- Upgrade Kubuntu amd64: 0/1
- Upgrade Kubuntu i386: 1/1
- Upgrade Ubuntu amd64: 0/1
- Upgrade Ubuntu i386: 1/1
- Upgrade Ubuntu Server amd64: 0/1
- Upgrade Ubuntu Server i386: 1/1
- Upgrade Xubuntu amd64: 0/1
- Upgrade Xubuntu i386: 1/1
- Xubuntu Alternate amd64: 3/3
- Xubuntu Alternate i386: 3/3
- Xubuntu Desktop amd64: 4/5
- Xubuntu Desktop i386: 4/5
QATeam/ReleaseReports/NattyAlpha1TestReport (last edited 2010-12-03 09:40:45 by ACaen-151-1-71-98)