UbuntuMobileEdition

Differences between revisions 12 and 33 (spanning 21 versions)
Revision 12 as of 2008-04-04 16:01:29
Size: 9962
Editor: pool-70-16-165-200
Comment:
Revision 33 as of 2008-10-08 17:54:02
Size: 3481
Editor: bismuth
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
[[Include(Testing/Cases/Header)]] ## page was copied from Testing/Cases/Ubuntu-Netbook-Remix
## page was copied from Testing/Cases/UMEdesktop
<<Include(Testing/Cases/Header)>>
Line 3: Line 5:
||<tablestyle="float:right; font-size: 0.9em; background:#F1F1ED;margin: 0 0 1em 1em;" style="padding:0.5em;">'''Contents'''<<BR>>[[https://wiki.ubuntu.com/Testing/Cases/UNRinstall?action=AttachFile&do=get&target=UNR.png|{{https://wiki.ubuntu.com/Testing/Cases/UNRinstall?action=AttachFile&do=get&target=UNR.png}}]]<<BR>><<TableOfContents(2)>>||
Line 5: Line 8:
This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in Xnest/Xephyr on a development machine. Welcome to the Ubuntu Mobile Edition testing wiki. The pages linked within are designed to guide you through the process of setting up an environment, testing the features, and reporting bugs. As always, feel free to update these pages with any clarifications/additional information that you find useful along the way. Happy Hunting.
Line 7: Line 10:
== Environment Setup == = Getting Started =
Line 9: Line 12:
=== Xephyr === == Environment ==
The first part of preparation, is to get a working environment up and running. There are a couple different ways. To learn more about getting your environment up and running visit:<<BR>>
[[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobileinstall| Environment Setup]]
Line 11: Line 16:
 * Download the latest project tarball from the [http://cdimage.ubuntu.com/moblin/hardy/menlow : Build Area]
 * Launch Moblin Image Creator application
 * File -> Load Project -> Browse to .tar.bz2
 * Select project in ''Platform Projects'' window in MIC interface.
 * Select target in ''Targets'' window in MIC interface.
 * Click the Terminal button in the ''Targets'' section.
 * Inside the target terminal type:
    # ume-xephyr-start [[BR]]
    this script does the following:
      # apt-get install xserver-xephyr
== Test Cases ==
Line 22: Line 18:
      # export DISPLAY=:0 This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in KVM on a development machine.
Line 24: Line 20:
      # /etc/init.d/dbus start The cases have been split into three categories; Basic Feature, Advanced Feature, and Compliance Testing.
Line 26: Line 22:
      # xinit /etc/X11/xinit/xinitrc -- /usr/bin/Xephyr :2 -host-cursor -screen 1024x600x32 -dpi 96 -ac === Basic Feature Testing ===
Line 28: Line 24:
'''You should now have a working environment''' The Basic Feature set are designed to cover the main applications included with Ubuntu Mobile Edition. They should be run as often as possible to ensure all baseline functionality is working.<<BR>>
[[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-basic| Basic Functionality Testing]]
Line 30: Line 27:
=== Device ===
 * Download the latest image from the [http://cdimage.ubuntu.com/moblin/hardy/ : Build Area]
=== Advanced Feature Testing ===
Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resources that are not commonly used.<<BR>>
[[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-advanced-features| Advanced Feature Testing]]
Line 33: Line 31:
 * Insert ''' Empty ''' USB thumbdrive.

 * Open Moblin Image Creator and go to: Tools -> Write USB Image

 * Browse to the *.img file you retrieved from the Build Area and create the image to thumbdrive

 * Insert thumbdrive into MID device and restart the device. '' be sure you have downloaded the correct build for the chipset in your test device ''

'''You should now have a working environment'''

= Test Cases =
== Basic Feature Testing ==
Basic feature testing covers the features that the user of the software will see on a daily basis. Defects in this area of functionality will be noticed immediately by the user. It is vital that this area of testing is performed as often as possible and by as many people as possible.

=== Core Applications and Plug-ins ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-apps : Cases]

 * Include an MID-optimized browser

 * Include an MID-optimized media player

 * Include Flash Movie Player, comparable to Adobe Flash Player version 9

 * Include Adobe Acrobat Reader

 * Include a Java Run-time Environment

 * Media player plug-in

=== Additional Applications ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-additional-apps : Cases]

 * IM / Chat supporting
AIM
Windows Live Messenger
Yahoo Messenger
QQ (Most popular IM in Asia)
Jabber
ICQ
MySpace IM
Featuring:
Multiple IM sessions at once
Buddy notifications
Private secure conversation

 * Standalone Email client supporting
POP3 (POP3 before SMTP, APOP, TLS)
IMAP4
SMTP (Plain auth, CRAM-MD5, DIGEST-MD5, TLS)
GnuPG
RSS
Featuring:
Off line mode
Address book
Spell check
Auto-colored mail quotes
HTML email formatting
Search
Anti-phishing protection

 * Video conferencing

 * Office document viewer supporting:
PDF
MS Word (.doc)
OpenOffice (.odf)
Excel (.xls)
PowerPoint (.ppt)

 * Casual games

 * Camera application
Display/record video from cam
Take snapshot with cam, save as JPEG
Adjust camera settings

 * RSS reader
Search through feeds
Media management for downloading videos/podcasts

 * Clock
Digital/analog mode
time/date setting
Support regional setting
Alarm
Can sync with NTP
Dual timezone display
Full screen mode (for use when docked)

 * Calculator
Basic calculating
memory function
clipboard support

 * PIM
Calendar
Time
Contacts
Notes
Appointments
Task List

 * Remote desktop client
VNC client
RDP client
Support for screen scaling and panning
Stylus to Mouse click conversion

 * E-book reader

=== System Configuration & Utilities ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-config : Cases]

 * Software update mechanism tailored for MID

 * Power Management

 * Network Manager

 * Touchscreen calibration

 * Screen brightness

 * User theming customization

 * Font size / screen size

 * Hardware button configuration

 * Volume Controls

 * System Information

 * Date & Time settings

=== Codec Support ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec : Cases]

 * MPEG-3 (MP3) Support

 * Windows Media Audio (WMA) Support

 * Ogg Theora (ogg) Support

 * Real Audio Support

 * Musepack Support

 * FLAC Support

 * WMV 9 Support

 * Real Video Support

 * Ogg Theora (ogg) Support

 * MPEG-4 Support

 * AVI Support

 * Xvid media format Support

 * Apple Quicktime containers (MOV) Support

 * DivX media format (version; 3, 4, 5 and 6) Support

 * Flash video 7/8/9 (swf) Support

 * Ogg media (ogm) Support

 * Real Media (Ram, ra and rpm) Support

 * JPEG decode

 * BMP decode

 * GIF decode

 * PNG decode

 * JPEG encode

 * BMP encode

 * GIF encode

 * PNG encode

 * Real Helix DRM Support

 * WM DRM Support

 * OMA DRM v2.0 Support

=== Device Drivers ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-drivers : Cases]

 * WLAN Support

 * WiMax Support

 * WWAN Support

 * SDIO Support

 * Touchscreen Support

 * GPS Support

 * BlueTooth Support

 * Graphics – support x.org 7.1 or newer plus x11 2d driver, mesa 3d driver, agpgart kernel module, DRM kernel module and kernel frame buffer driver

 * Video Decode Acceleration

 * USB Client Support

 * Poulsbo chipset support (PCI IDs)

 * HD Audio – kernel patch to support chipset and ALSA codec driver

 * USB Camera Support

== Advanced Feature Testing ==
Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resouces that are not commonly used.

=== Advanced Codec Support ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec-advanced : Cases]
=== Compliance Testing ===
Compliance testing ensures that Ubuntu Mobile Edition conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of Ubuntu Mobile Edition and is a vital requirement for many of companies implementing it.<<BR>>
[[https://wiki.ubuntu.com/Testing/Cases/UbuntuMobile-compliance| Compliance Testing]]
Line 263: Line 36:
 * Support MPEG1/MPEG2 layer 3 decode == Reporting Bugs ==
Line 265: Line 38:
 * Support PCM inside WAV decoder All bugs discovered in Ubuntu Mobile Edition should be logged against the main project:<<BR>>
[[https://bugs.launchpad.net/ubuntu-mobile| Ubuntu Mobile Edition]]
Line 267: Line 41:
 * Support Dolby Digital/AC3 decode There is some information that, when included, can make the triage team and developers work much easier. Please paste the following template into your bug reports submitted against UNR, and try to provide as much of the information as you can.
Line 269: Line 43:
 * Support Advanced Audio Coding (also known as MPEG-2 Part 7, and also MPEG-4 Part 3) decode {{{
Build Version/Date:
Environment used for testing:
Line 271: Line 47:
 * Support BSAC decode (MPEG4 audio codec used in T-DMB)

 * MPEG-1 Support

 * MPEG-2 Support

 * Line-21 Support

 * Real Video Support

 * VC1 Support

 * MPEG-4 Support Encode/Decode

 * MPEG-4 Part 10 (AVC, H.264)

 * MJPEG Support Encode/Decode

 * H-263 Support Encode/Decode

 * AVS Support

 * VP-6 Support

 * VP-7 Support

 * WMV 7 Support

 * WMV 8 Support

 * DV Support

 * HDV Support

 * H.261 Support Encode/Decode

 * MPEG TS/PS/ES Support

 * AVI splitter Support

 * ASF splitter (container for WMV) Support

 * MP4 splitter Support

 * MP4/3GPP Support

 * ASF Support

 * GSM AMR-WB Support

 * GSM Full rate (FR) Support

 * G.723.1 Support

 * G.729 Support

 * G.711 Support

 * G.726 Support

 * G.722 Support

 * Voice detection and echo cancellation Support

 * GSM-AMR Support

 * GSM-AMR WB+ Support

 * G.728 Support

=== Kernel ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-kernel : Cases]

 * Use kernel version 2.6.21 or later

 * Enable tickless idle
Summary:
Line 349: Line 50:
=== Bluetooth Profiles ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-bluetooth : Cases]
Steps to Reproduce:
Line 352: Line 52:
 * Support the Generic Access Profile
Line 354: Line 53:
 * Support the Service Discovery Profile Expected result:
Line 356: Line 55:
 * Support the Hands Free Profile (HFP) Used by VIOP
Line 358: Line 56:
 * Support the Generic Object Exchange Profile (GOEP) Actual result:}}}
Line 360: Line 58:
 * Support the Advanced Audio Distribution Profile (A2DP)
Line 362: Line 59:
 * Support the Human Interface Device Profile (HID)

 * Support the Headset Profile (HSP)

=== Power and Thermal Management ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-power : Cases]

 * ACPI 2.0 support, including support for the new C6 idle state

 * Thermal Management Optimizations

=== Media Infrastructure ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-media : Cases]

 * Include the Helix media framework

 * Include GStreamer

== Compliance Testing ==
Compliance testing ensures that UME conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of UME and is a vital requirement for many of companies implementing UME.

=== General Distribution Characteristics ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-general : Cases]

 * Moblin Compliance to version 1.0

 * Applications and other UI elements must be consistent with the MID application design guide

 * Built for a 32-bit platform

 * Licensing terms for all components

 * List of known non-open source components that will be included.

=== Performance (Excludes BIOS Times) ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-performance : Cases]

 * With platform in Hibernate state, time from user pressing power on button to desktop UI being fully responsive <= 16 sec

 * Time from user pressing sleep button to platform going to S3 state (not just display going blank) <= 7 sec

 * With platform in S3 state, time from user pressing wake-up button to desktop UI being fully responsive <= 7 sec

 * When the platform is Cold booted (i.e. when device probe, etc is required), the time from user pressing power on button to desktop UI being fully responsive <= 37 sec

=== Footprint ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-footprint : Cases]

 * Platform memory 192MB

 * Use a maximum of 500MB

=== Localization ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-locale : Cases]

 * Support English (US)

=== Documentation ===
[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-docs : Cases]

 * Deliver updated Documentation

 * Licensing terms for all documentation

 * List of any proprietary documentation which cannot be made public.
== Summary ==
Thank you for your interest in Ubuntu Mobile Edition testing. We hope you decide to contribute to the project. As always, if you have any questions or comments, feel free to visit the mobile team over on ''Freenode #ubuntu-mobile''.

Introduction

Welcome to the Ubuntu Mobile Edition testing wiki. The pages linked within are designed to guide you through the process of setting up an environment, testing the features, and reporting bugs. As always, feel free to update these pages with any clarifications/additional information that you find useful along the way. Happy Hunting.

Getting Started

Environment

The first part of preparation, is to get a working environment up and running. There are a couple different ways. To learn more about getting your environment up and running visit:
Environment Setup

Test Cases

This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in KVM on a development machine.

The cases have been split into three categories; Basic Feature, Advanced Feature, and Compliance Testing.

Basic Feature Testing

The Basic Feature set are designed to cover the main applications included with Ubuntu Mobile Edition. They should be run as often as possible to ensure all baseline functionality is working.
Basic Functionality Testing

Advanced Feature Testing

Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resources that are not commonly used.
Advanced Feature Testing

Compliance Testing

Compliance testing ensures that Ubuntu Mobile Edition conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of Ubuntu Mobile Edition and is a vital requirement for many of companies implementing it.
Compliance Testing

Reporting Bugs

All bugs discovered in Ubuntu Mobile Edition should be logged against the main project:
Ubuntu Mobile Edition

There is some information that, when included, can make the triage team and developers work much easier. Please paste the following template into your bug reports submitted against UNR, and try to provide as much of the information as you can.

Build Version/Date:
Environment used for testing:

Summary:


Steps to Reproduce:


Expected result:


Actual result:

Summary

Thank you for your interest in Ubuntu Mobile Edition testing. We hope you decide to contribute to the project. As always, if you have any questions or comments, feel free to visit the mobile team over on Freenode #ubuntu-mobile.

Testing/Cases/UbuntuMobileEdition (last edited 2008-10-08 17:54:02 by bismuth)