activities
Activities Planner and Development Release Schedule
Period: RR (13.04) Development Cycle (October 2012 to April 2013).
Start date: Release date of Quantal Quetzal (18th October 2012).
Weeks: Start on a Thursday.
Aim: To identify testing opportunities that fit in with the development release process.
QA Cadence weeks run from Saturday to Saturday.
- Information on this page is drawn from various sources freely available to the public.
Week |
Date (Thursday) |
Work Item Iteration |
Status 13.04 Events & Now Testing |
Notes |
|
October 2012 |
|||||
1 |
October 25th |
|
Toolchain Uploaded |
|
|
|
October 29th to November 1st |
|
Ubuntu Developer Summit |
|
|
U+1 |
|
|
How to get the Development Release |
||
U+1 |
October 29th to November 4th |
Other Project |
LibreOffice 3.6.3 Released |
||
November 2012 |
|||||
2 |
November 1st |
|
|
|
|
3 |
November 8th |
|
|
Linux kernel 3.7.0-0 in Raring Ringtail from 9th |
|
U+1 |
November 14th |
Other Project |
Gnome 3.6.2 Released |
||
4 |
November 15th |
|
12.10 kernel 3.5.0.18 on 12.04 userspace #Application Testing |
||
U+1 |
November 20th |
Other Project |
FireFox 17 & Beta 18 Released |
||
U+1 |
November 20th |
Other Project |
Gnome 3.7.91 Beta Released |
||
5 |
November 22nd |
|
|
||
QA |
November 24th to December 1st |
|
Cadence week 1 |
Libreoffice? |
|
6 |
November 29th |
|
|
|
|
December 2012 |
|||||
7 |
December 6th |
|
Alpha 1 (tentative, flavours only) |
|
|
QA |
December 8th to 15th |
|
Cadence week 2 (flavour alpha?) |
|
|
8 |
December 13th |
|
|
|
|
9 |
December 20th |
|
|
|
|
10 |
December 27th |
|
12.04.2 kernel source freeze |
|
|
QA |
December 29th to January 5th |
|
Cadence week 3 |
|
|
January 2013 |
|||||
11 |
January 3rd |
|
|
|
|
U+1 |
Week of January 6th |
Other Project |
FireFox 18 & Beta 19 Released |
||
12 |
January 10th |
|
12.04.2 kernel freeze |
|
|
QA |
January 12th to 19th |
|
Cadence week 4 |
|
|
13 |
January 17th |
|
|
|
|
U+1 |
Week of January 23rd |
Other Project |
KDE SC 4.10 Released |
||
14 |
January 24th |
|
|
|
|
QA |
January 26th to February 2nd |
|
Cadence week 5 |
|
|
15 |
January 31st |
|
12.04.2 |
|
|
February 2013 |
|||||
16 |
February 7th |
|
Alpa 2 (tentative, flavours only) |
|
|
QA |
February 9th to 16th |
|
Cadence week 6 (flavour alpha?) |
|
|
17 |
February 14th |
|
Debian Import Freeze |
|
|
U+1 |
Week of February 18th |
Other Project |
FireFox 19 & Beta 20 Released |
||
18 |
February 21st |
|
|
|
|
QA |
February 23rd to March 2nd |
|
Cadence week 7 |
|
|
19 |
February 28th |
|
|
|
|
March 2013 |
|||||
U+1 |
March 5th |
Other Project |
KDE SC 4.10.1 Released |
||
20 |
March 7th |
|
Feature Freeze |
|
|
QA |
March 9th to 16th |
|
Cadence week 8 |
|
|
U+1 |
Week of March 10th |
Other Project |
Xfce 4.12 Released |
||
21 |
March 14th |
|
Beta 1 (tentative, flavours only) |
|
|
U+1 |
March 20th |
Other Project |
Gnome 3.7.92 Released |
||
22 |
March 21st |
|
|
||
QA |
March 23rd to 30th |
|
Cadence week 9 |
|
|
October 2012 |
|||||
23 |
March 28th |
|
|
||
April 2013 |
|||||
U+1 |
April 1st |
Other Project |
FireFox 20 & Beta 21 Released |
||
U+1 |
April 2nd |
Other Project |
KDE SC 4.10.2 Released |
||
24 |
April 4th |
|
|
||
QA |
April 6th to 13th |
|
Cadence week 10 |
|
|
25 |
April 11th |
|
|
||
26 |
April 18th |
|
FinalFreeze, Release Candidate. LanguagePackTranslationDeadline |
|
|
QA |
April 20th to 27th |
|
Cadence week 11 |
|
|
27 |
April 25th |
|
FinalRelease Ubuntu 13.04 |
|
Methods and Means
ISO Image Testing - Cadence Testing
- Every 2 weeks as part of our testing cadence,, we download copies of the latest daily ISO images, burn them to CDs (or load them into VM's) and test them. This brings to light many issues that might have been missed by other early adopters and developers, especially in the CD builds and installers.
If you are interested in this kind of testing, see the ISO information page for instructions on getting started with ISO testing and directions for using the test tracker.
The ISO Testing Walkthrough is a good place to start.
Also ensure you've joined the Ubuntu QA mailing list to know when the testing weeks are occurring.
ARM Testing
Additionally, if you have the hardware for it, we are actively helping push forward ubuntu onto ARM architectures. Check out the ARM pages for more information on testing ubuntu ARM images, including testing on a pandaboard.
Daily smoke Testing
- Between milestones, it is also good (but not release critical) to test the daily ISOs and as many applications as possible. This kind of testing can be done in a Virtual Machine or on spare hardware.
If you are interested in this kind of testing, see the Daily Smoke Testing page for instructions.
Stable Release Update (SRU) Testing
All stable release updates are first uploaded to the Proposed repository before they are released live. An important principle behind Ubuntu is that we should never make a working system worse; stable release updates need to be extensively tested to make sure that there are no regressions.
If you are interested in this kind of testing, there is a public Launchpad SRU Verificaton team that you can join as well as a fantastic SRU wiki page with helpful tools for finding bugs to work on.
Feature Testing
- One of the objectives each cycle is to provide testing for all the major features in the release. We organize periodic calls for testing to focus on new features, such as a new video driver or a big change to an important tool like Software Center.
If this kind of testing interests you, please join the Ubuntu QA mailing list. You will receive periodic emails about calls for testing a specific feature and how to participate.
General Testing
- Ubuntu is more than its default installation and basic tasks - it's an entire repository of software and possible configurations. We need to test as much of it as possible, and some things aren't well covered by established test cases and procedures. General testing is as simple as attempting to use the development release and reporting whatever problems you run into as a bug.
- If you are interested in this kind of testing, install the development version of ubuntu, and report and follow-up on any bugs you encounter. The mailing list and weekly QA meetings are another great place to discuss any bugs found that you feel may be of a more critical nature or have a widespread effect.
Application Testing
- Application testing is the manual testing of specific things (test cases) in applications. Regression tests are specific tests for potential breakages from one release to another (they're also relevant for SRU testing, above).
If you are interested in this kind of testing, head to Packages QA Tracker and run through the application testcases and report your results. NOTE: The application testcases are currently in the process of being migrated during the quantal cycle.
- Now Testing
- Week of 15th November - 12.10 kernel 3.5.0.18 on 12.04 userspace.
Install Quantal kernel Prerequisites: Make sure you are running the latest version of precise, and all your packages are up to date
1) Add the X-team ppa
sudo add-apt-repository ppa:ubuntu-x-swat/q-lts-backport
2) Update apt and install the new kernel
sudo apt-get update && sudo apt-get install linux-image-generic-lts-quantal linux-headers-generic-lts-quantal
3) Restart your computer to boot into the new kernel
Uninstall Quantal kernel You may remove the 3.5 kernel by using ppa-purge
1) Install ppa-purge
sudo apt-get install ppa-purge
2) Remove the ppa
sudo ppa-purge ppa:ubuntu-x-swat/q-lts-backport
3) PPA Purge will find the packages installed and offered to downgrade them. Say yes and ppa-purge will remove the upgraded versions and reinstall the versions from the archive.
4) Remove the meta packages
sudo apt-get remove --purge linux-image-generic-lts-quantal linux-headers-generic-lts-quantal
5) Remove the kernel itself. While running the new kernel, enter the following command
uname -r
This returns a number, like '3.5.0-8-generic'. Use the number (3.5.0-8) to replace the word KERNEL
sudo apt-get remove --purge linux-image-KERNEL-generic linux-headers-KERNEL linux-headers-KERNEL-generic
sudo apt-get autoremove
Eg, for '3.5.0-8'
sudo apt-get remove --purge linux-image-3.5.0-8-generic linux-headers-3.5.0-8 linux-headers-3.5.0-8
Notes based upon experience
During periods of transition from testing one kernel to testing the next we get the error message: "Unable to locate linux-image-generic-lts-quantal." The answer is to wait a few days and then run the update command again. It also takes the qa tracker as few days to be updated to allow reporting for that new kernel image.
Automated Testing
Automated testing is the conversion of large numbers of test cases into simple scripts. They can often be run in bulk with a single command. UTAH is the main way of automating testcases for ubuntu. In addition, the program Checkbox also allows for automated test cases to be run and recorded.
If you are interested in this kind of testing, start by running checkbox. It is now installed by default. You can find it in the Dash by searching for System Testing. If you wish to go further and write UTAH test cases, you can visit the Automated Testing page for more information.
Autopilot Unity Testing
The unity team has built autopilot as a testing tool for unity. However, autopilot has broader applications beyond unity to help us do automated testing on a grander scale. Source: http://qa.ubuntu.com/ See blog posted 20th November 2012.
To Install Autopilot
sudo apt-get install python-autopilot unity-autopilot
Caution: Autopilot tests should be run in a Guest session. Any data saved during a guest session is lost when we log out of the guest session. To prevent the lost of test results.
1) do not log out of the test session.
2) instead Switch User to your normal user account.
3) use the gksudo command to load Gedit or Nautilus.
4) browse to the /tmp folder and look for the guest folder. That is where you will find any documents saved whilst using the guest session. The guest folder will have a name similar to guest-v4GnNa. This folder name will be different each time you run a guest session. The second part of the name will be different.
5) copy the data into a new documetn and save it. Now you will not loose the data when you log out of the guest session.
Autopilot Unity Tests
This command will list all the Unity tests available.
autopilot list unity
There are at present 461 Unity tests. We can run them as a single test. For example:
autopilot run unity.tests.test_dash.DashRevealTests.test_alt_f4_close_dash
Or, we can run all the tests at the same time with this command:
autopilot run unity
Caution: It will take a very long time to run all 461 Unity tests.
I have grouped the Unity tests into batches and I have added a command argument that will cause Autopilot to save the results into a log file. These files will be found in the /tmp/guest-###### folder. The log files will have a name that is based upon the 'computer-name_date_time.log' format. Therefore each log file will have a slightly different name that relates to the day and time that the Unity batch test was run.
Autopilot Unity batch tests commands
Copy and paste each command into a terminal. The great the number of tests in a batch, the longer the test will run.
Batches with 1 tests
autopilot run -o . unity.tests.test_dash.CategoryHeaderTests
autopilot run -o . unity.tests.test_dash.DashDBusIfaceTests
autopilot run -o . unity.tests.test_dash.DashLensBarTests
autopilot run -o . unity.tests.test_dash.DashSearchInputTests
autopilot run -o . unity.tests.test_dash.DashVisualTests
autopilot run -o . unity.tests.test_home_lens
autopilot run -o . unity.tests.test_ibus.IBusTestsAnthy
autopilot run -o . unity.tests.test_ibus.IBusTestsHangul
autopilot run -o . unity.tests.test_ibus.IBusTestsPinyin
Batches with 2 tests
autopilot run -o . unity.tests.test_dash.DashBorderTests
autopilot run -o . unity.tests.test_dash.DashCrossMonitorsTests
autopilot run -o . unity.tests.test_dash.DashKeyboardFocusTests
autopilot run -o . unity.tests.test_hud.HudAlternativeKeybindingTests
autopilot run -o . unity.tests.test_hud.HudCrossMonitorsTests
autopilot run -o . unity.tests.test_hud.HudLauncherInteractionsTests
autopilot run -o . unity.tests.test_ibus.IBusTestsAnthyIgnore
autopilot run -o . unity.tests.test_ibus.IBusTestsPinyinIgnore
autopilot run -o . unity.tests.test_switcher.SwitcherDetailsTests
autopilot run -o . unity.tests.xim.test_gcin.GcinTestHangul
batches with 3 tests
autopilot run -o . unity.tests.test_hud.HudLockedLauncherInteractionsTests
autopilot run -o . unity.tests.test_panel.PanelIndicatorEntryTests
autopilot run -o . unity.tests.test_spread.SpreadTests
autopilot run -o . unity.tests.test_switcher.SwitcherWindowsManagementTests
Batches with 4 tests
autopilot run -o . unity.tests.launcher.test_shortcut
autopilot run -o . unity.tests.launcher.test_visual
autopilot run -o . unity.tests.test_dash.DashLensResultsTests
autopilot run -o . unity.tests.test_dash.PreviewInvocationTests
autopilot run -o . unity.tests.test_ibus.IBusActivationTests
autopilot run -o . unity.tests.test_panel.PanelGrabAreaTests
autopilot run -o . unity.tests.test_showdesktop.ShowDesktopTests
autopilot run -o . unity.tests.test_switcher.SwitcherDetailsModeTests
autopilot run -o . unity.tests.test_switcher.SwitcherWorkspaceTests
autopilot run -o . unity.tests.test_unity_logging.UnityLoggingTests
Laptop Testing
- Laptop Testing is about the manual testing of specific things (test cases) mainly related to laptops hardware, using milestone releases of the development version (alphas, betas and release candidates). The goal is to get Ubuntu to work great on as many different makes and models of laptops as possible and this can be done knowing which hardware works straight off the install CD and which hardware needs configuring or is poorly supported.
if you are interested in this kind of testing, head to the laptop testing Wiki page.