Mir

Differences between revisions 17 and 73 (spanning 56 versions)
⇤ ← Revision 17 as of 2014-03-19 15:01:36 →
Size: 2494
Editor: pool-173-64-197-91
Comment:
← Revision 73 as of 2019-05-23 10:34:32 → ⇥
Size: 5181
Editor: alan-griffiths
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
## page was copied from Process/Merges/TestPlans/Template
## page was renamed from Process/Merges/TestPlans/Common
## page was renamed from Process/TestPlans/Common
Line 7: Line 3:
 * '''Trunk URL''': lp:mir  * '''Trunk URL''': [[https://github.com/MirServer/mir/|github:MirServer/mir]]
Line 9: Line 5:
Line 15: Line 10:
 * '''Unity-Mir''' http://code.launchpad.net/unity-mir
 * '''Platform-api''' http://code.launchpad.net/platform-api
 * '''Xmir''' https://github.com/RAOF/xserver
  * '''Xmir''' https://code.launchpad.net/~xmir-team/xorg-server/+git/xmir
 * '''SDL''' [''16.04LTS only'']
 * '''qtubuntu''' https://launchpad.net/qtubuntu [''16.04LTS only'']
Line 22: Line 16:
'''This test plan is not supposed to be complete; use it to guide your manual testing so they don't miss big functional areas that are part in the component; also this should be used as guideline to inspire the exploratory testing which should be adapted smartly based on the real content of a release'''
Line 23: Line 19:
 * In addition, install updated image on phone and tablet
 * Install packages from build silo per the Release team's process
  * note: even safer to install only the packages you've built (not dist-upgrade)
 * Ensure navigating/scrolling the ui/Dash works as expected (note: cross check known unity8 bugs for any oddity)
 * Ensure time out and power button blanks screen, and power button unblanks screen
 * Ensure app launches and can quit
  * make sure to launch multiple apps and swap them
  * when you launch the app, do not touch the screen and make sure it updates
  * when you quit the app, make sure a new app doesn't launch
 * Browser copy/paste to notepad
  * open browser, go to cnn.com article with text
  * select text, long press for copy prompt, press copy
  * launch notepad, new note, long press to activate paste prompt, paste
  * select note to activate OSK, rotate a few times and ensure osk and notepad follow rotation
  * note copy/paste, OSK, rotation, moving between apps should function as expected
 * Download click & launch (covers dash, click, osk, acct)
  * (without having setup accounts) Navigate to the Dash recommended applications
  * select app, select install
  * should be prompted to settings, enter U1 info with OSK
  * return to dash install app, open app
  * note the various screen switching and OSK prompting should function as expected
 * run unity8 AP test
  * make writable, install AP testing with {{{phablet-click-test-setup}}}
  * running as phablet user on the device {{{stop unity8}}}
  * then from pc run {{{phablet-test-run unity8}}}
 * run browser AP test (ensure pass rate is similar to smoke results)
 * If mirclient API break, test Xmir on desktop
 * If any oddities are witness, retest virgin image without mir changes		  * Verify that the mir-tests-tools snap works

== Testing mir-test-tools ==

These tests should work on all supported series of Classic and on Ubuntu Core. First check that the `classic` channel has been updated with the release candidate:

   * $ '''snap info mir-test-tools'''

This should show something like:

   * '''candidate: 1.2.0-snap45 2019-05-22 (415) 121MB -'''

Where the version number matches the release being tested.

   * $ '''snap install --candidate mir-test-tools'''

There's a "handy script" to test the snap on the Wiki:

   * https://github.com/MirServer/mir-test-tools/wiki/Notes

Copy this and run it.

== Testing Ubuntu Classic ==

Testing differs between 16.04LTS and 18.04LTS or later. Testing for 16.04LTS has its own section below.

=== Test Plan 18.04LTS or later ===

 * The following should be repeated for 18.04LTS and any later series:

 * In addition update desktop from archive
  * Install packages from the [[https://launchpad.net/~mir-team/+archive/ubuntu/rc|release candidate PPA]]:
   * $ '''sudo add-apt-repository --update ppa:mir-team/rc'''
   * $ '''sudo apt install mir-demos mir-graphics-drivers-desktop mir-test-tools'''
  * Install applications to test with:
   * Qt Wayland support, qterminal and kate to test with:
    * $ '''sudo apt install qtwayland5 kate qterminal'''
   * Install weston-terminal:
    * $ '''sudo apt install weston'''
   * Install glmark2:
    * $ '''sudo apt install glmark2-wayland'''

 * Mir-on-X11
  * Use an X11 based desktop (Unity, Gnome, etc.).
  * Start a terminal sessions to launch the tests.
  * Run the "smoke tests" to ensure the example clients work
   * $ '''mir-smoke-test-runner'''
   * Check the result is "I: Smoke testing complete with returncode 0"
  * Run a test session in a window
   * $ '''miral-app'''
  * [in the Mir-on-X11 session] Try running, resizing, moving and switching between the following:
   * $ '''mir_demo_client_multiwin'''
   * $ '''kate'''
   * $ '''gnome-terminal'''
   * $ '''weston-terminal'''
   * $ '''glmark2-es2-wayland'''

 * Mir-on-KMS
  * Switch to VT4 and sign in
  * Run a test "tiling desktop" session
   * $ '''miral-app --window-manager tiling'''
  * Try running, and switching between the following:
   * $ '''mir_demo_client_multiwin'''
   * $ '''kate'''
   * $ '''gnome-terminal'''
   * $ '''weston-terminal'''
   * $ '''glmark2-es2-wayland'''

=== Test Plan 16.04LTS ===

 * In addition update desktop from archive
  * Install packages from the [[https://launchpad.net/~mir-team/+archive/ubuntu/rc|release candidate PPA]]:
   * $ '''sudo add-apt-repository ppa:ci-train-ppa-service/stable-phone-overlay'''
   * $ '''sudo add-apt-repository --update ppa:mir-team/rc'''
   * $ '''sudo apt install mir-demos mir-graphics-drivers-desktop mir-test-tools'''
  * Install applications to test with:
   * Qt Wayland support, qterminal and kate to test with:
    * $ '''sudo apt install kate qterminal qtubuntu-desktop'''
   * Install glmark2:
    * $ '''sudo apt install glmark2-wayland glmark2-mir'''

 * Mir-on-X11
  * Use an X11 based desktop (Unity, Gnome, etc.).
  * Start a terminal sessions to launch the tests.
  * Run the "smoke tests" to ensure the example clients work
   * $ '''mir-smoke-test-runner'''
   * Check the result is "I: Smoke testing complete with returncode 0"
  * Run a test session in a window
   * $ '''miral-app -qt-mirclient -sdl2-mirclient'''
  * [in the Mir-on-X11 session] Try running, resizing, moving and switching between the following:
   * $ '''mir_demo_client_multiwin'''
   * $ '''kate'''
   * $ '''glmark2-es2-wayland'''
   * $ '''glmark2-es2-mir'''

 * Mir-on-KMS
  * Switch to VT4 and sign in
   * $ '''miral-app -qt-mirclient -sdl2-mirclient --window-manager tiling'''
  * Try running, and switching between the following:
   * $ '''mir_demo_client_multiwin'''
   * $ '''kate'''
   * $ '''glmark2-es2-wayland'''
   * $ '''glmark2-es2-mir'''
  * Run the "smoke tests" to ensure the example clients work
   * $ '''mir-smoke-test-runner'''
   * Check the result is "I: Smoke testing complete with returncode 0"

 * Mir-on-KMS
  * Switch to VT4 and sign in
   * $ '''miral-app -qt-mirclient -sdl2-mirclient'''

Dependents/Clients

Clients of this component

Test Plan

This test plan is not supposed to be complete; use it to guide your manual testing so they don't miss big functional areas that are part in the component; also this should be used as guideline to inspire the exploratory testing which should be adapted smartly based on the real content of a release

  • Successful run of automated CI testing
  • Verify that the mir-tests-tools snap works

Testing mir-test-tools

These tests should work on all supported series of Classic and on Ubuntu Core. First check that the classic channel has been updated with the release candidate:

  • $ snap info mir-test-tools

This should show something like:

  • candidate: 1.2.0-snap45 2019-05-22 (415) 121MB -

Where the version number matches the release being tested.

  • $ snap install --candidate mir-test-tools

There's a "handy script" to test the snap on the Wiki:

Copy this and run it.

Testing Ubuntu Classic

Testing differs between 16.04LTS and 18.04LTS or later. Testing for 16.04LTS has its own section below.

Test Plan 18.04LTS or later

  • The following should be repeated for 18.04LTS and any later series:
  • In addition update desktop from archive

    • Install packages from the release candidate PPA:

      • $ sudo add-apt-repository --update ppa:mir-team/rc

      • $ sudo apt install mir-demos mir-graphics-drivers-desktop mir-test-tools

    • Install applications to test with:
      • Qt Wayland support, qterminal and kate to test with:

        • $ sudo apt install qtwayland5 kate qterminal

      • Install weston-terminal:

        • $ sudo apt install weston

      • Install glmark2:

        • $ sudo apt install glmark2-wayland

  • Mir-on-X11
    • Use an X11 based desktop (Unity, Gnome, etc.).
    • Start a terminal sessions to launch the tests.
    • Run the "smoke tests" to ensure the example clients work

      • $ mir-smoke-test-runner

      • Check the result is "I: Smoke testing complete with returncode 0"
    • Run a test session in a window

      • $ miral-app

    • [in the Mir-on-X11 session] Try running, resizing, moving and switching between the following:

      • $ mir_demo_client_multiwin

      • $ kate

      • $ gnome-terminal

      • $ weston-terminal

      • $ glmark2-es2-wayland

  • Mir-on-KMS
    • Switch to VT4 and sign in
    • Run a test "tiling desktop" session

      • $ miral-app --window-manager tiling

    • Try running, and switching between the following:

      • $ mir_demo_client_multiwin

      • $ kate

      • $ gnome-terminal

      • $ weston-terminal

      • $ glmark2-es2-wayland

Test Plan 16.04LTS

  • In addition update desktop from archive

    • Install packages from the release candidate PPA:

      • $ sudo add-apt-repository ppa:ci-train-ppa-service/stable-phone-overlay

      • $ sudo add-apt-repository --update ppa:mir-team/rc

      • $ sudo apt install mir-demos mir-graphics-drivers-desktop mir-test-tools

    • Install applications to test with:
      • Qt Wayland support, qterminal and kate to test with:

        • $ sudo apt install kate qterminal qtubuntu-desktop

      • Install glmark2:

        • $ sudo apt install glmark2-wayland glmark2-mir

  • Mir-on-X11
    • Use an X11 based desktop (Unity, Gnome, etc.).
    • Start a terminal sessions to launch the tests.
    • Run the "smoke tests" to ensure the example clients work

      • $ mir-smoke-test-runner

      • Check the result is "I: Smoke testing complete with returncode 0"
    • Run a test session in a window

      • $ miral-app -qt-mirclient -sdl2-mirclient

    • [in the Mir-on-X11 session] Try running, resizing, moving and switching between the following:

      • $ mir_demo_client_multiwin

      • $ kate

      • $ glmark2-es2-wayland

      • $ glmark2-es2-mir

  • Mir-on-KMS
    • Switch to VT4 and sign in

      • $ miral-app -qt-mirclient -sdl2-mirclient --window-manager tiling

    • Try running, and switching between the following:

      • $ mir_demo_client_multiwin

      • $ kate

      • $ glmark2-es2-wayland

      • $ glmark2-es2-mir

    • Run the "smoke tests" to ensure the example clients work

      • $ mir-smoke-test-runner

      • Check the result is "I: Smoke testing complete with returncode 0"
  • Mir-on-KMS
    • Switch to VT4 and sign in

      • $ miral-app -qt-mirclient -sdl2-mirclient

Process/Merges/TestPlans/Mir (last edited 2024-05-09 13:09:10 by alan-griffiths)