UbuntuMobileEdition

Revision 12 as of 2008-04-04 16:01:29

Clear message

Include(Testing/Cases/Header)

Introduction

This is a comprehensive test case suite designed to confirm compliance with all project requirements. Most of these tests can be performed on mobile hardware or in Xnest/Xephyr on a development machine.

Environment Setup

Xephyr

  • Download the latest project tarball from the [http://cdimage.ubuntu.com/moblin/hardy/menlow : Build Area]

  • Launch Moblin Image Creator application

  • File -> Load Project -> Browse to .tar.bz2

  • Select project in Platform Projects window in MIC interface.

  • Select target in Targets window in MIC interface.

  • Click the Terminal button in the Targets section.

  • Inside the target terminal type:

    • # ume-xephyr-start BR this script does the following:

      • # apt-get install xserver-xephyr # export DISPLAY=:0 # /etc/init.d/dbus start # xinit /etc/X11/xinit/xinitrc -- /usr/bin/Xephyr :2 -host-cursor -screen 1024x600x32 -dpi 96 -ac

You should now have a working environment

Device

  • Download the latest image from the [http://cdimage.ubuntu.com/moblin/hardy/ : Build Area]

  • Insert Empty USB thumbdrive.

  • Open Moblin Image Creator and go to: Tools -> Write USB Image

  • Browse to the *.img file you retrieved from the Build Area and create the image to thumbdrive

  • Insert thumbdrive into MID device and restart the device. be sure you have downloaded the correct build for the chipset in your test device

You should now have a working environment

Test Cases

Basic Feature Testing

Basic feature testing covers the features that the user of the software will see on a daily basis. Defects in this area of functionality will be noticed immediately by the user. It is vital that this area of testing is performed as often as possible and by as many people as possible.

Core Applications and Plug-ins

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-apps : Cases]

  • Include an MID-optimized browser
  • Include an MID-optimized media player
  • Include Flash Movie Player, comparable to Adobe Flash Player version 9
  • Include Adobe Acrobat Reader
  • Include a Java Run-time Environment
  • Media player plug-in

Additional Applications

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-additional-apps : Cases]

  • IM / Chat supporting

AIM Windows Live Messenger Yahoo Messenger QQ (Most popular IM in Asia) Jabber ICQ MySpace IM Featuring: Multiple IM sessions at once Buddy notifications Private secure conversation

  • Standalone Email client supporting

POP3 (POP3 before SMTP, APOP, TLS) IMAP4 SMTP (Plain auth, CRAM-MD5, DIGEST-MD5, TLS) GnuPG RSS Featuring: Off line mode Address book Spell check Auto-colored mail quotes HTML email formatting Search Anti-phishing protection

  • Video conferencing
  • Office document viewer supporting:

PDF MS Word (.doc) OpenOffice (.odf) Excel (.xls) PowerPoint (.ppt)

  • Casual games
  • Camera application

Display/record video from cam Take snapshot with cam, save as JPEG Adjust camera settings

  • RSS reader

Search through feeds Media management for downloading videos/podcasts

  • Clock

Digital/analog mode time/date setting Support regional setting Alarm Can sync with NTP Dual timezone display Full screen mode (for use when docked)

  • Calculator

Basic calculating memory function clipboard support

  • PIM

Calendar Time Contacts Notes Appointments Task List

  • Remote desktop client

VNC client RDP client Support for screen scaling and panning Stylus to Mouse click conversion

  • E-book reader

System Configuration & Utilities

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-config : Cases]

  • Software update mechanism tailored for MID
  • Power Management
  • Network Manager
  • Touchscreen calibration
  • Screen brightness
  • User theming customization
  • Font size / screen size
  • Hardware button configuration
  • Volume Controls
  • System Information

  • Date & Time settings

Codec Support

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec : Cases]

  • MPEG-3 (MP3) Support
  • Windows Media Audio (WMA) Support
  • Ogg Theora (ogg) Support
  • Real Audio Support
  • Musepack Support
  • FLAC Support
  • WMV 9 Support
  • Real Video Support
  • Ogg Theora (ogg) Support
  • MPEG-4 Support
  • AVI Support
  • Xvid media format Support
  • Apple Quicktime containers (MOV) Support
  • DivX media format (version; 3, 4, 5 and 6) Support
  • Flash video 7/8/9 (swf) Support
  • Ogg media (ogm) Support
  • Real Media (Ram, ra and rpm) Support
  • JPEG decode
  • BMP decode
  • GIF decode
  • PNG decode
  • JPEG encode
  • BMP encode
  • GIF encode
  • PNG encode
  • Real Helix DRM Support
  • WM DRM Support
  • OMA DRM v2.0 Support

Device Drivers

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-drivers : Cases]

  • WLAN Support

  • WiMax Support

  • WWAN Support
  • SDIO Support
  • Touchscreen Support
  • GPS Support

  • BlueTooth Support

  • Graphics – support x.org 7.1 or newer plus x11 2d driver, mesa 3d driver, agpgart kernel module, DRM kernel module and kernel frame buffer driver
  • Video Decode Acceleration
  • USB Client Support
  • Poulsbo chipset support (PCI IDs)
  • HD Audio – kernel patch to support chipset and ALSA codec driver
  • USB Camera Support

Advanced Feature Testing

Advanced feature testing covers functionality that is hidden or not used as often as the basic feature set. These cases often require advanced knowledge of the underlying system or access to system resouces that are not commonly used.

Advanced Codec Support

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-codec-advanced : Cases]

  • Support MPEG1/MPEG2 layer 3 decode
  • Support PCM inside WAV decoder
  • Support Dolby Digital/AC3 decode
  • Support Advanced Audio Coding (also known as MPEG-2 Part 7, and also MPEG-4 Part 3) decode
  • Support BSAC decode (MPEG4 audio codec used in T-DMB)
  • MPEG-1 Support
  • MPEG-2 Support
  • Line-21 Support
  • Real Video Support
  • VC1 Support
  • MPEG-4 Support Encode/Decode
  • MPEG-4 Part 10 (AVC, H.264)
  • MJPEG Support Encode/Decode
  • H-263 Support Encode/Decode
  • AVS Support
  • VP-6 Support
  • VP-7 Support
  • WMV 7 Support
  • WMV 8 Support
  • DV Support
  • HDV Support
  • H.261 Support Encode/Decode
  • MPEG TS/PS/ES Support
  • AVI splitter Support
  • ASF splitter (container for WMV) Support
  • MP4 splitter Support
  • MP4/3GPP Support
  • ASF Support
  • GSM AMR-WB Support
  • GSM Full rate (FR) Support
  • G.723.1 Support
  • G.729 Support
  • G.711 Support
  • G.726 Support
  • G.722 Support
  • Voice detection and echo cancellation Support
  • GSM-AMR Support
  • GSM-AMR WB+ Support
  • G.728 Support

Kernel

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-kernel : Cases]

  • Use kernel version 2.6.21 or later
  • Enable tickless idle

Bluetooth Profiles

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-bluetooth : Cases]

  • Support the Generic Access Profile
  • Support the Service Discovery Profile
  • Support the Hands Free Profile (HFP) Used by VIOP
  • Support the Generic Object Exchange Profile (GOEP)
  • Support the Advanced Audio Distribution Profile (A2DP)
  • Support the Human Interface Device Profile (HID)
  • Support the Headset Profile (HSP)

Power and Thermal Management

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-power : Cases]

  • ACPI 2.0 support, including support for the new C6 idle state
  • Thermal Management Optimizations

Media Infrastructure

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-media : Cases]

  • Include the Helix media framework
  • Include GStreamer

Compliance Testing

Compliance testing ensures that UME conforms to all project requirements. These include basic system versioning to the inclusion of licensing information in the delivered builds. Compliance is important to the success of UME and is a vital requirement for many of companies implementing UME.

General Distribution Characteristics

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-general : Cases]

  • Moblin Compliance to version 1.0
  • Applications and other UI elements must be consistent with the MID application design guide
  • Built for a 32-bit platform
  • Licensing terms for all components
  • List of known non-open source components that will be included.

Performance (Excludes BIOS Times)

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-performance : Cases]

  • With platform in Hibernate state, time from user pressing power on button to desktop UI being fully responsive <= 16 sec

  • Time from user pressing sleep button to platform going to S3 state (not just display going blank) <= 7 sec

  • With platform in S3 state, time from user pressing wake-up button to desktop UI being fully responsive <= 7 sec

  • When the platform is Cold booted (i.e. when device probe, etc is required), the time from user pressing power on button to desktop UI being fully responsive <= 37 sec

Footprint

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-footprint : Cases]

  • Platform memory 192MB
  • Use a maximum of 500MB

Localization

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-locale : Cases]

  • Support English (US)

Documentation

[https://wiki.ubuntu.com/Testing/Cases/UMEdesktop-docs : Cases]

  • Deliver updated Documentation
  • Licensing terms for all documentation
  • List of any proprietary documentation which cannot be made public.