LaptopTestingTrackerSystem

Differences between revisions 14 and 15
Revision 14 as of 2010-10-19 14:23:46
Size: 3514
Editor: host65-220-dynamic
Comment:
Revision 15 as of 2010-10-20 18:02:28
Size: 4224
Editor: host65-220-dynamic
Comment:
Deletions are marked like this. Additions are marked like this.
Line 34: Line 34:
   1. System
   1. Input/output
   1. Networking
   1. Audio
   1. Video
   1. USB
   1. Firewire
   * System
   * Input/output
   * Networking
   * Audio
   * Video
   * USB
   * Firewire
Line 44: Line 44:
 * Laptop info (make model etc.) can be put in the '''Comment''' field already present in the tracker, with some small improvement, like make it mandatory, increase its size to contain useful hardware info. Alternatively (and much better) all this info could be added in some new and specific text fields to fit laptop testing needs. The user could be informed, with a note just alongside of the field, to fill it with the output of the following commands:
 * Laptop info needed can be the output of:
   * '''dmidecode -s system-manufacturer''' → Name of the manufacturer
   * '''dmidecode -s system-product-name''' && '''dmidecode -s system-version''' → Model of laptop
   * '''lspci''','''lsusb''', '''lshw -short''' → Hardware info
   * '''uname -a''' → Kernel used (if necessary)
   * etc.

 * Three different solutions are suggested to provide those:
  1. Put info in the existent '''Comment''' field in the test report increasing its size to contain what necessary. Alternatively (and much better) all this info could be added in some new and specific text fields to fit laptop testing needs. The user could be informed, with a note just alongside of the field. Data should be shared through the tasks/testcases.The following mockup explain this solution.

  {{attachment:mockup report 1.png}}

  2. Add new fields about laptop hardware in the profile page so there is no need to fill all field for each report done. This solution require to make those profile fields visible to anyone. If someone have more than one laptop to test, he has to create multiple profiles, one for each laptop.
 
  {{attachment:mockup login 2.png}}
Line 46: Line 61:
  1. '''dmidecode -s system-manufacturer''' → Name of the manufacturer
  1. '''dmidecode -s system-product-name''' && '''dmidecode -s system-version''' → Model of laptop
  1. '''lspci''','''lsusb''', '''lshw -short''' → Hardware info
  1. '''uname -a''' → Kernel used
  1. etc.
 
 * These info should be shared through the tasks/testcases.
  3. This would be the best solution, but the more invasive one. Laptop hardware info have to be reported in the profile page but it's possible to add more than one laptop per profile. The tested laptop need to be selected in the report page.

  {{attachment:mockup profile 3.png}} {{attachment:mockup report 3.png}}

  

Summary

  • This spec is about adding a new laptop testing section integrated in the QA Tracker website.

Rationale

  • The Laptop Testing is a community driven project started during Lucid development (from Alpha 3)
  • Now testing work uses specific testcases that verifies laptop devices/component functionality.
  • Results are collected and organized using Wiki pages and this lead to a lot of manual actions and limitations.
  • Now a lot of reports are useless (e.g. people mark a test as Failed but they don't report a bug or add a link to it)

Use Cases

  • Richard want to test his laptop. By now he follows a testcase and report the results of his tests filling some tables in wiki pages. He has to put in manually a lot of info like
    1. Testcase code
    2. Result of the test properly formatted with colors and a link to any bug found, paying attention to put it in the right milestone column.
    3. His name with a link to the launchpad account, the milestone tested and a link to the his laptop wiki page.
  • With the new Laptop Tracker he would just need to register to the QA Tracker once, test any milestone he wants filling just the Comment/info fields and the bug numbers.

Design

The website interface could be the same used by now for the other QA testing project (ISO, Desktop, Multitouch etc.), reserving laptop.qa.ubuntu.com as URL for the site.

Implementation

  • Create a task, on the first page, for each piece of laptop hardware, like
    • System
    • Input/output
    • Networking
    • Audio
    • Video
    • USB
    • Firewire
  • For each subsection provide relative testcases with a link to the current ISO build and the instruction to perform the test that point to the testcase itself.

  • As for other testing project, each bug reported is automatically linked to launchpad and it would be really easy to adapt a tag system.
  • Laptop info needed can be the output of:
    • dmidecode -s system-manufacturer → Name of the manufacturer

    • dmidecode -s system-product-name && dmidecode -s system-version → Model of laptop

    • lspci,lsusb, lshw -short → Hardware info

    • uname -a → Kernel used (if necessary)

    • etc.
  • Three different solutions are suggested to provide those:
    1. Put info in the existent Comment field in the test report increasing its size to contain what necessary. Alternatively (and much better) all this info could be added in some new and specific text fields to fit laptop testing needs. The user could be informed, with a note just alongside of the field. Data should be shared through the tasks/testcases.The following mockup explain this solution.

      mockup report 1.png

    2. Add new fields about laptop hardware in the profile page so there is no need to fill all field for each report done. This solution require to make those profile fields visible to anyone. If someone have more than one laptop to test, he has to create multiple profiles, one for each laptop.

      mockup login 2.png

    3. This would be the best solution, but the more invasive one. Laptop hardware info have to be reported in the profile page but it's possible to add more than one laptop per profile. The tested laptop need to be selected in the report page.

      mockup profile 3.png mockup report 3.png

  • In this way we can automatically have a database in which data could be aggregated and filtered, really useful to testers and developers.

UI Changes

  • Very little, the Laptop Tracker will have the same structure of the others.

Code Changes

  • As for the UI, the Code would be the same implemented in other trackers, some adjustments are probably needed.


CategorySpec

QATeam/Specs/LaptopTestingTrackerSystem (last edited 2010-10-20 19:58:31 by 94)