UbuntuMobileEdition
9962
Comment:
|
← Revision 33 as of 2008-10-08 17:54:02 ⇥
3481
|
Deletions are marked like this. | Additions are marked like this. |
Line 1: | Line 1: |
[[Include(Testing/Cases/Header)]] | ## page was copied from Testing/Cases/Ubuntu-Netbook-Remix ## page was copied from Testing/Cases/UMEdesktop <<Include(Testing/Cases/Header)>> |
Line 3: | Line 5: |
||<tablestyle="float:right; font-size: 0.9em; background:#F1F1ED;margin: 0 0 1em 1em;" style="padding:0.5em;">'''Contents'''<<BR>>[[https://wiki.ubuntu.com/Testing/Cases/UNRinstall?action=AttachFile&do=get&target=UNR.png|{{https://wiki.ubuntu.com/Testing/Cases/UNRinstall?action=AttachFile&do=get&target=UNR.png}}]]<<BR>><<TableOfContents(2)>>|| | |
Line 5: | Line 8: |
This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in Xnest/Xephyr on a development machine. | Welcome to the Ubuntu Mobile Edition testing wiki. The pages linked within are designed to guide you through the process of setting up an environment, testing the features, and reporting bugs. As always, feel free to update these pages with any clarifications/additional information that you find useful along the way. Happy Hunting. |
Line 7: | Line 10: |
== Environment Setup == | = Getting Started = |
Line 9: | Line 12: |
=== Xephyr === | == Environment == The first part of preparation, is to get a working environment up and running. There are a couple different ways. To learn more about getting your environment up and running visit:<<BR>> [[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobileinstall| Environment Setup]] |
Line 11: | Line 16: |
* Download the latest project tarball from the [http://cdimage.ubuntu.com/moblin/hardy/menlow : Build Area] * Launch Moblin Image Creator application * File -> Load Project -> Browse to .tar.bz2 * Select project in ''Platform Projects'' window in MIC interface. * Select target in ''Targets'' window in MIC interface. * Click the Terminal button in the ''Targets'' section. * Inside the target terminal type: # ume-xephyr-start [[BR]] this script does the following: # apt-get install xserver-xephyr |
== Test Cases == |
Line 22: | Line 18: |
# export DISPLAY=:0 | This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in KVM on a development machine. |
Line 24: | Line 20: |
# /etc/init.d/dbus start | The cases have been split into three categories; Basic Feature, Advanced Feature, and Compliance Testing. |
Line 26: | Line 22: |
# xinit /etc/X11/xinit/xinitrc -- /usr/bin/Xephyr :2 -host-cursor -screen 1024x600x32 -dpi 96 -ac | === Basic Feature Testing === |
Line 28: | Line 24: |
'''You should now have a working environment''' | The Basic Feature set are designed to cover the main applications included with Ubuntu Mobile Edition. They should be run as often as possible to ensure all baseline functionality is working.<<BR>> [[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-basic| Basic Functionality Testing]] |
Line 30: | Line 27: |
=== Device === * Download the latest image from the [http://cdimage.ubuntu.com/moblin/hardy/ : Build Area] |
=== Advanced Feature Testing === Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resources that are not commonly used.<<BR>> [[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-advanced-features| Advanced Feature Testing]] |
Line 33: | Line 31: |
* Insert ''' Empty ''' USB thumbdrive. * Open Moblin Image Creator and go to: Tools -> Write USB Image * Browse to the *.img file you retrieved from the Build Area and create the image to thumbdrive * Insert thumbdrive into MID device and restart the device. '' be sure you have downloaded the correct build for the chipset in your test device '' '''You should now have a working environment''' = Test Cases = == Basic Feature Testing == Basic feature testing covers the features that the user of the software will see on a daily basis. Defects in this area of functionality will be noticed immediately by the user. It is vital that this area of testing is performed as often as possible and by as many people as possible. === Core Applications and Plug-ins === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-apps : Cases] * Include an MID-optimized browser * Include an MID-optimized media player * Include Flash Movie Player, comparable to Adobe Flash Player version 9 * Include Adobe Acrobat Reader * Include a Java Run-time Environment * Media player plug-in === Additional Applications === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-additional-apps : Cases] * IM / Chat supporting AIM Windows Live Messenger Yahoo Messenger QQ (Most popular IM in Asia) Jabber ICQ MySpace IM Featuring: Multiple IM sessions at once Buddy notifications Private secure conversation * Standalone Email client supporting POP3 (POP3 before SMTP, APOP, TLS) IMAP4 SMTP (Plain auth, CRAM-MD5, DIGEST-MD5, TLS) GnuPG RSS Featuring: Off line mode Address book Spell check Auto-colored mail quotes HTML email formatting Search Anti-phishing protection * Video conferencing * Office document viewer supporting: MS Word (.doc) OpenOffice (.odf) Excel (.xls) PowerPoint (.ppt) * Casual games * Camera application Display/record video from cam Take snapshot with cam, save as JPEG Adjust camera settings * RSS reader Search through feeds Media management for downloading videos/podcasts * Clock Digital/analog mode time/date setting Support regional setting Alarm Can sync with NTP Dual timezone display Full screen mode (for use when docked) * Calculator Basic calculating memory function clipboard support * PIM Calendar Time Contacts Notes Appointments Task List * Remote desktop client VNC client RDP client Support for screen scaling and panning Stylus to Mouse click conversion * E-book reader === System Configuration & Utilities === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-config : Cases] * Software update mechanism tailored for MID * Power Management * Network Manager * Touchscreen calibration * Screen brightness * User theming customization * Font size / screen size * Hardware button configuration * Volume Controls * System Information * Date & Time settings === Codec Support === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec : Cases] * MPEG-3 (MP3) Support * Windows Media Audio (WMA) Support * Ogg Theora (ogg) Support * Real Audio Support * Musepack Support * FLAC Support * WMV 9 Support * Real Video Support * Ogg Theora (ogg) Support * MPEG-4 Support * AVI Support * Xvid media format Support * Apple Quicktime containers (MOV) Support * DivX media format (version; 3, 4, 5 and 6) Support * Flash video 7/8/9 (swf) Support * Ogg media (ogm) Support * Real Media (Ram, ra and rpm) Support * JPEG decode * BMP decode * GIF decode * PNG decode * JPEG encode * BMP encode * GIF encode * PNG encode * Real Helix DRM Support * WM DRM Support * OMA DRM v2.0 Support === Device Drivers === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-drivers : Cases] * WLAN Support * WiMax Support * WWAN Support * SDIO Support * Touchscreen Support * GPS Support * BlueTooth Support * Graphics – support x.org 7.1 or newer plus x11 2d driver, mesa 3d driver, agpgart kernel module, DRM kernel module and kernel frame buffer driver * Video Decode Acceleration * USB Client Support * Poulsbo chipset support (PCI IDs) * HD Audio – kernel patch to support chipset and ALSA codec driver * USB Camera Support == Advanced Feature Testing == Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resouces that are not commonly used. === Advanced Codec Support === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec-advanced : Cases] |
=== Compliance Testing === Compliance testing ensures that Ubuntu Mobile Edition conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of Ubuntu Mobile Edition and is a vital requirement for many of companies implementing it.<<BR>> [[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-compliance| Compliance Testing]] |
Line 263: | Line 36: |
* Support MPEG1/MPEG2 layer 3 decode | == Reporting Bugs == |
Line 265: | Line 38: |
* Support PCM inside WAV decoder | All bugs discovered in Ubuntu Mobile Edition should be logged against the main project:<<BR>> [[https://bugs.launchpad.net/ubuntu-mobile| Ubuntu Mobile Edition]] |
Line 267: | Line 41: |
* Support Dolby Digital/AC3 decode | There is some information that, when included, can make the triage team and developers work much easier. Please paste the following template into your bug reports submitted against UNR, and try to provide as much of the information as you can. |
Line 269: | Line 43: |
* Support Advanced Audio Coding (also known as MPEG-2 Part 7, and also MPEG-4 Part 3) decode | {{{ Build Version/Date: Environment used for testing: |
Line 271: | Line 47: |
* Support BSAC decode (MPEG4 audio codec used in T-DMB) * MPEG-1 Support * MPEG-2 Support * Line-21 Support * Real Video Support * VC1 Support * MPEG-4 Support Encode/Decode * MPEG-4 Part 10 (AVC, H.264) * MJPEG Support Encode/Decode * H-263 Support Encode/Decode * AVS Support * VP-6 Support * VP-7 Support * WMV 7 Support * WMV 8 Support * DV Support * HDV Support * H.261 Support Encode/Decode * MPEG TS/PS/ES Support * AVI splitter Support * ASF splitter (container for WMV) Support * MP4 splitter Support * MP4/3GPP Support * ASF Support * GSM AMR-WB Support * GSM Full rate (FR) Support * G.723.1 Support * G.729 Support * G.711 Support * G.726 Support * G.722 Support * Voice detection and echo cancellation Support * GSM-AMR Support * GSM-AMR WB+ Support * G.728 Support === Kernel === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-kernel : Cases] * Use kernel version 2.6.21 or later * Enable tickless idle |
Summary: |
Line 349: | Line 50: |
=== Bluetooth Profiles === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-bluetooth : Cases] |
Steps to Reproduce: |
Line 352: | Line 52: |
* Support the Generic Access Profile | |
Line 354: | Line 53: |
* Support the Service Discovery Profile | Expected result: |
Line 356: | Line 55: |
* Support the Hands Free Profile (HFP) Used by VIOP | |
Line 358: | Line 56: |
* Support the Generic Object Exchange Profile (GOEP) | Actual result:}}} |
Line 360: | Line 58: |
* Support the Advanced Audio Distribution Profile (A2DP) | |
Line 362: | Line 59: |
* Support the Human Interface Device Profile (HID) * Support the Headset Profile (HSP) === Power and Thermal Management === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-power : Cases] * ACPI 2.0 support, including support for the new C6 idle state * Thermal Management Optimizations === Media Infrastructure === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-media : Cases] * Include the Helix media framework * Include GStreamer == Compliance Testing == Compliance testing ensures that UME conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of UME and is a vital requirement for many of companies implementing UME. === General Distribution Characteristics === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-general : Cases] * Moblin Compliance to version 1.0 * Applications and other UI elements must be consistent with the MID application design guide * Built for a 32-bit platform * Licensing terms for all components * List of known non-open source components that will be included. === Performance (Excludes BIOS Times) === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-performance : Cases] * With platform in Hibernate state, time from user pressing power on button to desktop UI being fully responsive <= 16 sec * Time from user pressing sleep button to platform going to S3 state (not just display going blank) <= 7 sec * With platform in S3 state, time from user pressing wake-up button to desktop UI being fully responsive <= 7 sec * When the platform is Cold booted (i.e. when device probe, etc is required), the time from user pressing power on button to desktop UI being fully responsive <= 37 sec === Footprint === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-footprint : Cases] * Platform memory 192MB * Use a maximum of 500MB === Localization === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-locale : Cases] * Support English (US) === Documentation === [https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-docs : Cases] * Deliver updated Documentation * Licensing terms for all documentation * List of any proprietary documentation which cannot be made public. |
== Summary == Thank you for your interest in Ubuntu Mobile Edition testing. We hope you decide to contribute to the project. As always, if you have any questions or comments, feel free to visit the mobile team over on ''Freenode #ubuntu-mobile''. |
Introduction
Welcome to the Ubuntu Mobile Edition testing wiki. The pages linked within are designed to guide you through the process of setting up an environment, testing the features, and reporting bugs. As always, feel free to update these pages with any clarifications/additional information that you find useful along the way. Happy Hunting.
Getting Started
Environment
The first part of preparation, is to get a working environment up and running. There are a couple different ways. To learn more about getting your environment up and running visit:
Environment Setup
Test Cases
This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in KVM on a development machine.
The cases have been split into three categories; Basic Feature, Advanced Feature, and Compliance Testing.
Basic Feature Testing
The Basic Feature set are designed to cover the main applications included with Ubuntu Mobile Edition. They should be run as often as possible to ensure all baseline functionality is working.
Basic Functionality Testing
Advanced Feature Testing
Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resources that are not commonly used.
Advanced Feature Testing
Compliance Testing
Compliance testing ensures that Ubuntu Mobile Edition conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of Ubuntu Mobile Edition and is a vital requirement for many of companies implementing it.
Compliance Testing
Reporting Bugs
All bugs discovered in Ubuntu Mobile Edition should be logged against the main project:
Ubuntu Mobile Edition
There is some information that, when included, can make the triage team and developers work much easier. Please paste the following template into your bug reports submitted against UNR, and try to provide as much of the information as you can.
Build Version/Date: Environment used for testing: Summary: Steps to Reproduce: Expected result: Actual result:
Summary
Thank you for your interest in Ubuntu Mobile Edition testing. We hope you decide to contribute to the project. As always, if you have any questions or comments, feel free to visit the mobile team over on Freenode #ubuntu-mobile.
Testing/Cases/UbuntuMobileEdition (last edited 2008-10-08 17:54:02 by bismuth)