MobileTesting
Ubuntu Open Week - Intro to Mobile Testing - Chris Gregan & Dave Morley - Wed, Apr 30, 2008
=== jcastro changed the topic of #ubuntu-classroom to: Ubuntu Open Week | Information and Logs: https://wiki.ubuntu.com/UbuntuOpenWeek | How to ask questions: https://wiki.ubuntu.com/UbuntuOpenWeek/Rules | Ask questions in #ubuntu-classroom-chat, prefaced with "QUESTION:" |See https://wiki.ubuntu.com/UbuntuOpenWeek/JoiningIn to filter out channel noise | Current Session: "Intro to Mobile Testing" - Chris Gregan and Dave Morley [17:59] <jcastro> Ok, Intro to Mobile Testing with Chris Gregan and Dave Morley, take it away guys! [17:59] <cgregan> Good morning, afternoon, evening everyone [17:59] <cgregan> First let me introduce mayself [18:00] <cgregan> I am the lead tester for Ubuntu Mobile Edition [18:00] <cgregan> Today we will be doing a review of UME and how testing is being done [18:01] <cgregan> I will cover several topics. At the end of each section I will open up the floor for questions [18:01] <cgregan> We'll start with a brief overview of UME, then discuss supported hardware [18:01] <cgregan> Afterwards a bit about the tools we use to test [18:02] <cgregan> Then where to get cases and finally how to submit defects against UME [18:02] <cgregan> So...Lets start [18:03] <cgregan> UME is a project that was started in collaboration with Intel [18:03] <cgregan> The idea was to have an open source OS that supported Intel's new Mobile Internet Device platform [18:04] <cgregan> So...we signed up and have begun putting together a version of Hardy which will do exactly that [18:04] <cgregan> There are several areas that needed to be adjusted to support this platform. [18:05] <cgregan> Most changes are Kernel and driver [18:05] <cgregan> Right now the daily builds are focused on only a couple hardware platforms [18:06] <cgregan> However, our goal is to make it as widely available, platform-wise [18:06] <cgregan> Then of course...get all of you involved to improve it [18:07] <cgregan> So....the platforms we support currently are the Samsung Q1 (known as Mccaslin) [18:07] <cgregan> and the Intel reference hardware (known as Menlow) [18:07] <cgregan> They are both x86. [18:08] <cgregan> We have a project page setup in Launchpad that you can check out for more info: https://launchpad.net/ubuntu-mobile/ [18:08] <cgregan> Ok....any questions so far? [18:09] <popey> 18:07 < popey> QUESTION: What sort of hardware spec are these mobile devices? [18:09] <cgregan> popey: QUESTION: What sort of hardware spec are these mobile devices? [18:09] <popey> heh [18:10] <cgregan> So they are x86 and at full speed the intel platform runs at 1.6 Ghz [18:10] <popey> memory, storage, other funky devices? [18:11] <cgregan> Reference devices so far have been coming with flash drives of about 1 G [18:11] <cgregan> Memory is around 512Mbs [18:11] <cgregan> But this is just reference and all those specs can be adjusted by manufacturer [18:12] <cgregan> Processor speed is about all that is fixed at the top. [18:12] <davmor2_laptop> artir: QUESTION: Will we ever have a ubuntu phone?(mada by canonical) [18:13] <cgregan> Just to wet your appetites...the reference devices are very cool. 5 radios, 3d graphics, etc. [18:13] <cgregan> I know of no plans to release a device from Canonical [18:13] <davmor2_laptop> QUESTION: can this hardware be accessible to any developper between shiping date ? [18:13] <cgregan> Our goal is to become THE OS for MID platform. They will ask for us by name [18:14] <cgregan> Currently, the only commercial hardware on the market that we support is the Samsung Q1 [18:15] <davmor2_laptop> mybunche: QUESTION: Will you encourage/liase with/assist product manufactures (eg Nokia) to adopt UME? [18:15] <cgregan> We are working on some plans to introduce a program like the laptop initiative from a year ago...with MIDs, but we need some commercial devices for that [18:15] <cgregan> mybunche: They are currently coming to US, but yes [18:16] <cgregan> Ok.....shall we move on? [18:16] <cgregan> Tools! [18:17] <cgregan> So we use a development tool known as Moblin Image Creator [18:17] <cgregan> It was developed by Intel's Moblin project [18:17] <cgregan> Basically, it is an image creation tool. [18:18] <cgregan> Since these devices have no drives, you need to use a boot USB image to flash to a new OS [18:18] <cgregan> MIC does this for us [18:18] <cgregan> It is freely available in Ubuntu Universe Repo using Synaptic [18:19] <cgregan> We have some project wikis with setup info here: https://wiki.ubuntu.com/Testing/Cases/UMEinstall [18:20] <cgregan> Once you have it installed it is launched by icon in your Gnome Menu [18:20] <cgregan> Ok...so now you have MIC, but no UME yet. For that there are two methods [18:21] <cgregan> First...you are lucky to have a Q1 now...or a menlow device when they come out in a few month [18:21] <cgregan> What you want is the .img file from our build area [18:22] <cgregan> For Mccaslin: http://cdimage.ubuntu.com/moblin/hardy/menlow_full/ [18:22] <cgregan> Whoops: http://cdimage.ubuntu.com/moblin/hardy/mccaslin_samsungq1ultrafull/ [18:22] <cgregan> ok...then for menlow: http://cdimage.ubuntu.com/moblin/hardy/menlow_full/ [18:23] <cgregan> The .img files are not too large, but fast connection is recommended [18:23] <cgregan> Next you need a USB key...1Gb should do it [18:24] <cgregan> Launch MIC then use the Tools menu to Write USB Image [18:24] <cgregan> It will then ask you for the img location and then your USB mount [18:24] <cgregan> Some chugging...and then you have a boot device [18:25] <cgregan> Plug the key into your Q1 or Menlow and reboot [18:25] <cgregan> You will get a warning screen....which I repeat here: [18:26] <cgregan> The image will COMPLETELY overwrite your device storage....so move your rare flac bootlegs and pictures of the kid's 1st birthday off first! :-) [18:27] <cgregan> Ok....that was a fairly large info dump...any questions on device install? [18:28] <davmor2_laptop> No [18:28] <cgregan> Ok.....then lets move onto the steps for emulating...so we can all see the build without a device! [18:28] <cgregan> Built into MIC is a tool called Xephyr [18:28] <cgregan> It emulated X environments [18:28] <cgregan> and allows us to test builds without a device [18:29] <cgregan> It has some drawbacks....like you run as root. But for a basic idea of the build and some basic testing it is ok [18:29] <cgregan> For emulation you need the Project tarball [18:30] <cgregan> from our build area: http://cdimage.ubuntu.com/moblin/hardy/menlow/ [18:31] <cgregan> With MIC open use the File Menu to Load a Project [18:31] <cgregan> It will ask you to pick the tar file [18:31] <cgregan> And name the project file to install the chroot environment [18:32] <cgregan> We tend to use a standard format so we know which build we are working on [18:33] <cgregan> So something like Menlow04_30 [18:33] <cgregan> It will then think for quite a while [18:34] <cgregan> So it is a good time to run that load of laundry or grab a bite to eat [18:34] <cgregan> Once you have the project loaded...you will see it appear in the upper field in MIC [18:35] <cgregan> Clicking the project will populate the Targets area below [18:35] <cgregan> We have two in each build, but we are going to focus on the "full" here [18:36] <cgregan> So....select the full Target and click the Terminal button above it [18:36] <cgregan> This opens a chroot window for the full version [18:36] <cgregan> Now....there is a quick change we need to make here [18:37] <cgregan> The resolv.conf for the chroot is set to the build machine..so you will not have network connectivity if you do not edit it [18:37] <cgregan> So just vim /etc/resolv.conf [18:37] <cgregan> and change buildd to your domain [18:38] <cgregan> and the IP to your gateway IP [18:38] <cgregan> Ping Google.com to confirm [18:39] <cgregan> Ok....so now lets see the build. Type ume-xephyr-start [18:39] <cgregan> After a short boot, you will be looking at a "hildon-ized" gnome desktop [18:40] <cgregan> So rows of icons to access the mobile apps included [18:40] <cgregan> Now play around. We are still in very active testing so things are very fluid [18:41] <cgregan> One nice thing about UME is that it is a reference platform [18:41] <cgregan> this means it is a foundation [18:41] <cgregan> so it supports flash and html overlays of the desktop [18:42] <cgregan> so although the standard desktop is kinda utilitarian...you can easily make it quite nice [18:42] <cgregan> I have seen some very slick demo desktops in flash [18:43] <cgregan> Ok...questions? [18:44] <cgregan> Alright.....then lets move to testing [18:44] <cgregan> We have created a suite of cases based on the partnership requirements with Intel [18:45] <cgregan> The wiki landing page is https://wiki.ubuntu.com/Testing/Cases/UMEdesktop [18:45] <cgregan> They are divided into three groups [18:45] <cgregan> Basic, Advanced, and Compliance [18:45] <cgregan> Basic is exactly that. Simple cases to exercise the most used features [18:46] <cgregan> Advanced cases require either more system knowledge, or access to resource that we might not all have...like proprietary codecs for example [18:47] <cgregan> Compliance cases cover the agreed upon stats for the system. Disk usage, UI design, performance, etc. [18:47] <cgregan> These are agreed upon targets that we have agreed to meet [18:47] <cgregan> So we need to make sure they are met [18:48] <cgregan> Feel free to click around review and even exercise some cases n Xephyr [18:48] <cgregan> Each case has a table at the top with version of the build the cases were last run [18:49] <cgregan> With that said...updating that table has fallen a bit behind in the rush to test this release cycle...so they are blank for the most part [18:49] <cgregan> But feel free to use it [18:50] <cgregan> Once we have a regular release that can be tracked more like the traditional Ubuntu builds [18:50] <cgregan> Right now we are not operating that way [18:50] <cgregan> But after the may release I encourage all of you to look around and test some things [18:51] <cgregan> So...you tested and now you found some minor issues [18:51] <cgregan> We have a template we would like to see used [18:51] <cgregan> You can find it on the wiki: https://wiki.ubuntu.com/Testing/Cases/UMEdesktop [18:52] <cgregan> Paste it into the report and fill out each section as carefully and thoroughly as possible [18:52] <cgregan> Here is an example of a good one: https://bugs.launchpad.net/ubuntu-mobile/+bug/218850 [18:53] <cgregan> Feel free to add more info [18:53] <cgregan> Don't worry if you forget to use it...I will remind you: https://bugs.launchpad.net/ubuntu-mobile/+bug/221503 [18:54] <cgregan> Of course be sure you are running the latest build when you log an issue against UME. [18:55] <cgregan> One last thing...more than ubuntu and canonical folks are watching these bugs so lets make sure we keep it very professional in the bugs [18:55] <cgregan> We want to give these customers the best impression of our community [18:55] <cgregan> And that is it [18:55] <cgregan> Last 5 for questions [18:56] <davmor2_laptop> Can it be installed on an eeepc? [18:57] <cgregan> davmor2_laptop: Not currently...we are building for two specific platforms so the drivers for devices not on those platforms are not loaded to save space [18:57] <cgregan> But it is possible with some kernel changes and modprobing [18:57] <cgregan> If there is a ton of interest we can look into what exactly needs to be changed and post it [18:58] <cgregan> But that would be after May 30 [18:58] <davmor2_laptop> one of the other questions was on the browser backend [18:59] <cgregan> The browser is based on Firefox which has been customized by the Moblin project folks [18:59] <jcastro> ok, we're out of time, can you point people to your irc channel if they have more questions? [18:59] <cgregan> Well...thanks for listening in. If you have other questions feel free to ping me on irc or email
MeetingLogs/openweekhardy/MobileTesting (last edited 2008-08-06 16:18:01 by localhost)