Meeting started by gema at 17:00:29 UTC. The full logs are available at http://ubottu.com/meetingology/logs/ubuntu-meeting/2011/ubuntu-meeting.2011-11-30-17.00.log.html .
Meeting summary
- Discuss new agenda
ACTION: gema to add lubuntu and Xubuntu testing updates to the agenda (gema, 17:08:59)
ACTION: patrickmw to publish a list of launchpad projects that conform our automated testing in jenkins (gema, 17:16:20)
- Blueprints Update for Precise
https://blueprints.launchpad.net/ubuntu/+spec/other-p-builds-smoke-testing (gema, 17:11:26)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-boot-speed-testing (gema, 17:21:09)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-kernel-sru (gema, 17:22:30)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-standard-sru-testing (gema, 17:24:19)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-test-case-management-tool (gema, 17:25:20)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-qa-regression-testing (gema, 17:26:37)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-automated-test-submissions (gema, 17:28:54)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-backlog (gema, 17:29:37)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-test-case-definition (gema, 17:30:38)
LINK: https://wiki.ubuntu.com/QATeam/TestCase (gema, 17:32:05)
https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-metrics (gema, 17:32:49)
- Alpha-1 Testing
- Other Topics
Meeting ended at 17:43:46 UTC.
Action items
- gema to add lubuntu and Xubuntu testing updates to the agenda
- patrickmw to publish a list of launchpad projects that conform our automated testing in jenkins
Action items, by person
- gema
- * gema to add lubuntu and Xubuntu testing updates to the agenda
- patrickmw
- * patrickmw to publish a list of launchpad projects that conform our automated testing in jenkins
People present (lines said)
- gema (104)
- jibel (24)
- alourie (17)
- patrickmw (16)
- charlie-tca (8)
- nuclearbob (7)
- meetingology (5)
- phillw (4)
- mike-gabriel (2)
- ubottu (1)
Full Log
17:00:29 <gema> #startmeeting QA Meeting
17:00:29 <meetingology> Meeting started Wed Nov 30 17:00:29 2011 UTC. The chair is gema. Information about MeetBot at http://wiki.ubuntu.com/AlanBell/mootbot.
17:00:29 <meetingology>
17:00:29 <meetingology> Available commands: #accept #accepted #action #agree #agreed #chair #commands #endmeeting #endvote #halp #help #idea #info #link #lurk #meetingname #meetingtopic #nick #progress #rejected #replay #restrictlogs #save #startmeeting #subtopic #topic #unchair #undo #unlurk #vote #voters #votesrequired
17:00:46 <gema> hi everyone and welcome to the new QA meeting
17:01:05 <gema> I have seen jibel, nuclearbob and charlie-tca already present, anyone else?
17:01:15 * phillw is here
17:01:23 <patrickmw> o/
17:01:32 <gema> hi phillw and patrickmw !
17:01:52 <gema> ok, so we will get started and welcome anyone that joins later 17:02:06 * alourie is present
17:02:15 <gema> since this is a new meeting, we don't have previous actions (hi alourie
17:02:15 <alourie> but only as a listener for now
17:02:21 <gema> alourie: no problem
17:02:23 <alourie> gema: no problem
17:02:28 <alourie> and hi
17:02:44 <gema> let's get on discussing the agenda from now on
17:02:52 <gema> #topic Discuss new agenda
17:03:20 <gema> you can see a proposal of agenda that I put together for today in the meeting page: https://wiki.ubuntu.com/QATeam/Meetings
17:03:41 <gema> this is just for today, but I think the blueprints update is something we should keep
17:03:53 <gema> do you guys have more topics to add to the agenda?
17:04:50 <gema> charlie-tca: would you like to have a section where you give an update regarding the testing for your distro?
17:05:06 <gema> if so, how shall we name that item?
17:05:23 <charlie-tca> Not today
17:05:31 <gema> ok, but going forward?
17:06:07 <charlie-tca> If it will be benificial to know what the Xubuntu tests show, yes
17:06:42 <phillw> we can do the same for lubuntu, if our team wishes so (we have a meeting tonight, so I will ask their views).
17:06:44 <gema> I believe it is important to see the correlation yes
17:06:53 <gema> ok, phillw
17:07:21 <gema> so I will add a section for status of the different derivatives as well as for Ubuntu
17:07:32 <gema> well, for now for Xubuntu and lubuntu
17:07:34 <charlie-tca> I cut a finger bad yesterdAY, am only partly here today
17:07:45 <gema> charlie-tca: I am sorry to hear
17:08:03 <phillw> sorry to hear charlie-tca
17:08:04 <charlie-tca> Thanks. Will do my beST ANYway
17:08:16 <gema> no worries, we read you very well, take care
17:08:59 <gema> #action gema to add lubuntu and Xubuntu testing updates to the agenda 17:08:59 * meetingology gema to add lubuntu and Xubuntu testing updates to the agenda
17:09:12 <gema> anything else you'd like to add/remove from the current proposed agenda?
17:10:33 <gema> ok, so we'll leave there for now and review it as we go along, then
17:10:54 <gema> #topic Blueprints Update for Precise
17:11:13 <gema> now we'll go through all the blueprints that we are working on and give a quick update on them any questions fire as we go along so that we don't lose context
17:11:26 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-builds-smoke-testing
17:11:40 <gema> we have made available this page for everyone to see Precise automated testing results: https://jenkins.qa.ubuntu.com/view/Precise/
17:11:52 <gema> patrickmw: do you want to explain briefly what is there?
17:12:03 <patrickmw> sure
17:13:10 <patrickmw> currently there are the automated ISO installer tests, DX unit tests, unity merge tests, boot speed tests and I'm sure I'm missing something
17:13:25 <patrickmw> more builds get added weekly
17:13:35 <patrickmw> ah upgrade tests
17:13:39 <alourie> o/
17:13:46 <gema> go ahead, alourie
17:14:13 <alourie> is there a way to see these tests? To find out what is being done and how to participate in them, if possible?
17:14:23 <alourie> to contribute?
17:14:24 <alourie> ..
17:14:29 <patrickmw> yes
17:15:08 <patrickmw> I don't there is a central location, but we can list the launchpad projects on the wiki
17:15:19 <alourie> that'd be great
17:15:43 <gema> can I give you an action to compile that list to you patrickmw?
17:15:46 <patrickmw> yes
17:16:11 <jibel> o/ (question for alourie )
17:16:15 <alourie> jibel: sure
17:16:20 <gema> #action patrickmw to publish a list of launchpad projects that conform our automated testing in jenkins 17:16:20 * meetingology patrickmw to publish a list of launchpad projects that conform our automated testing in jenkins
17:16:27 <gema> go for it jibel
17:16:44 <jibel> which type of tests would you like to contribute to ?
17:17:02 <jibel> iso testing, package testing, ... ?
17:17:40 <alourie> jibel: well, anything. I just want this all to be as transparent as possible for possible contributors to join
17:17:51 <alourie> me including
17:17:57 <jibel> ok thanks
17:18:22 <alourie> I would be probably good for ISO testing
17:18:35 <alourie> but others may be more apt for other types
17:18:39 <alourie> ..
17:18:55 <gema> excellent, alourie, thanks for the idea and for wanting to contribute
17:19:01 <gema> we need as much help as we can get
17:19:04 <alourie> sure
17:19:25 <gema> so there is more stuff going on in this blueprint.. let me see
17:19:36 <gema> we are in the process of updating the documentation to be able to interpret the results and troubleshoot failures (information available in the blueprint)
17:19:55 <gema> we also are working on a new tagging scheme that will allow us to assess the quality of the automated testing, we are going to start using
17:20:04 <gema> in the canonical-platform-qa team, these tags for the automated testing: https://wiki.ubuntu.com/QATeam/AutomatedTesting/TestingTypeAndBugTracking
17:20:25 <gema> we want to make sure we can assess the quality of these tests we are going to be running and improve them over time
17:20:37 <gema> that's all I have, anything else anyone?
17:21:01 <gema> good, moving on then
17:21:09 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-boot-speed-testing
17:21:14 <gema> patrickmw ?
17:21:24 <patrickmw> * Results available here: http://reports.qa.ubuntu.com/reports/boot-speed/
17:21:24 <patrickmw> * Jobs available here: https://jenkins.qa.ubuntu.com/view/Precise%20Boot%20Speed/
17:21:25 <patrickmw> * Job failures due to NFS boot breaking on yesterdays ISOs. Bug submitted.
17:21:25 <patrickmw> * Currently generating benchmark bootcharts for each system (lucid, maverick, natty, oneiric) and they will be available on the Boot Speed Report this week
17:21:25 <patrickmw> * Following up on NFS Boot bug and will try to run boot speed tests today
17:21:36 <patrickmw> ..
17:21:55 <gema> cool, let's give some time to people to read in case there is any question
17:22:22 <gema> nothing.. then moving on
17:22:30 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-kernel-sru
17:22:41 <gema> hggdh: do you have an update on this?
17:23:08 * alourie has to leave to put the baby to sleep, hopefully get back in time.
17:23:52 <gema> what I know is what is on the blueprint, that sconklin is working on running rteval tests and trying to package them
17:24:06 <gema> I will try to get more feedback for next week
17:24:19 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-standard-sru-testing
17:24:23 <gema> jibel ?
17:25:07 <jibel> nothing from me on this topic this week
17:25:12 <gema> ok
17:25:20 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-test-case-management-tool
17:25:46 <gema> jibel installed an internal instance of litmus and we are evaluating its viability to use for handling our test cases,
17:25:56 <gema> we are in the process of setting up an instance that the community can also use and evaluate but we are undergoing review of the tool, etc, by the IS team
17:26:23 <gema> it will hopefully be ready soon and we will let you know in this meeting
17:26:37 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-qa-regression-testing
17:26:40 <gema> nuclearbob: ?
17:27:19 <nuclearbob> I've got an autotest package building in my ppa
17:27:55 <nuclearbob> I'm getting that improved and tested on openstack instances, once we get the new lab hardware in, we should be able to get those tests running automatically on new instances ona regular basis
17:28:07 <nuclearbob> and we can get xml output from that to feed into jenkins
17:28:21 <gema> so we will be able to see results in jenkins then
17:28:28 <nuclearbob> yep
17:28:33 <gema> excellent, thanks
17:28:39 <gema> anything else from you?
17:28:42 <nuclearbob> nope
17:28:54 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-automated-test-submissions
17:29:01 <gema> patrickmw: ?
17:29:11 <patrickmw> work has started, nothing to report
17:29:21 <gema> ok, thanks
17:29:37 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-backlog
17:29:48 <gema> this blueprint is to keep track of all sorts of bits and pieces that we are doing but are not part of the big items we are working on
17:29:56 <gema> if there is any question please send us an email and we'll address it
17:30:03 <gema> amongst other things we are going to be rewriting the bits and pieces that are obsolete in the ubuntu QA wiki, if anyone wants to collaborate,
17:30:12 <gema> you are more than welcome!
17:30:28 <gema> just let us know so that we can coordinate the effort
17:30:38 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-test-case-definition
17:30:46 <gema> we discussed a test case definition at UDS and I proposed it to the CoP in canonical, they were happy with it and decided to embrace
17:30:56 <gema> that test case definition and start using it widely
17:31:02 <gema> so any test cases from now on will probably have that format
17:31:14 <gema> this blueprint is finished now, so I will make it disappear from our list of topics to discuss
17:31:15 <charlie-tca> o/
17:31:20 <gema> go ahead, charlie-tca
17:31:39 <charlie-tca> Is that format available somwplace for community to use?
17:31:49 <gema> indeed, just a sec
17:32:05 <gema> https://wiki.ubuntu.com/QATeam/TestCase
17:32:20 <charlie-tca> Thank you
17:32:29 <gema> we will be putting all the links to all the new content in place, because the wiki is becoming very difficult to navigate
17:32:33 <gema> no problem
17:32:49 <gema> #subtopic https://blueprints.launchpad.net/ubuntu/+spec/other-p-qa-metrics
17:33:00 <gema> we haven't started working on this yet, so nothing to report this week
17:33:15 <gema> that is it in terms of blueprints, now the big topic of the week
17:33:22 <gema> #topic Alpha-1 Testing
17:33:29 <gema> jibel: ?
17:34:02 <jibel> alpha 1 is due tomorrow, coverage could be better, here it is:
17:34:11 <jibel> Edubuntu 50.00%
17:34:11 <jibel> Kubuntu 5.56%
17:34:11 <jibel> Lubuntu 42.86%
17:34:16 <jibel> Mythbuntu Untested
17:34:20 <jibel> Ubuntu 56.63%
17:34:20 <jibel> Ubuntu Server 80.00%
17:34:20 <jibel> Xubuntu 50.00%
17:34:33 <jibel> For Ubuntu, architectures mac and powerpc are untested which explains the low coverage.
17:34:45 <jibel> Derivatives (especially Kubuntu) need your help for A1 testing.
17:34:51 <jibel> No release blocker bug found at the moment.
17:35:04 <jibel> The list of defects is available at http://91.189.93.73/qatracker/reports/defects/opened
17:35:30 <jibel> One is particularly annoying (bug 894768) it's easily reproducible in VMs but we have one report where it fails on hardware.
17:35:31 <ubottu> Launchpad bug 894768 in linux (Ubuntu Precise) "Installation randomly fails with: File "/usr/lib/ubiquity/ubiquity/install_misc.py", line 621, in copy_file targetfh.write(buf) IOError: [Errno 22] Invalid argument " [High,In progress] https://launchpad.net/bugs/894768
17:35:45 <jibel> If you've spare hardware and can install Ubuntu Precise Desktop _i386_ on it, then you can try to confirm this bug. that would help a lot.
17:36:14 <jibel> For this milestone we are using a new version of the iso tracker rewritten in Drupal 7, thanks to stgraber
17:36:26 <jibel> Details on ubuntu-devel mailing list https://lists.ubuntu.com/archives/ubuntu-devel/2011-November/034495.html
17:36:31 <jibel> ..
17:36:33 <jibel> questions ?
17:36:40 <jibel> or comments
17:37:36 <gema> doesn't look like it
17:37:40 <gema> thanks for the update, jibel
17:37:53 <mike-gabriel> help
17:37:59 <mike-gabriel> ignore...
17:38:13 <gema> ok...
17:38:26 <gema> so moving on
17:38:33 <gema> #topic Other Topics
17:38:48 <gema> any other topics or issues you'd like to bring up?
17:39:33 <gema> regarding the chairing of the meeting, I think we shouldn't force people to do it with a shuff
17:39:44 <gema> if someone wants they can, if not, I will be doing it
17:40:03 <gema> or if I am not able to , I hope someone will volunteer
17:40:20 <gema> but I think forcing people to chair may have detracted some collaborators from showing up
17:40:23 <gema> just a theory
17:40:55 <phillw> gema: I'll cover chairing if needed in an emergency
17:41:00 <gema> I will try to put an agenda that makes sense for next week and then I will offer the chairing of the next meeting in case anyone wants to do it the week after next
17:41:04 <gema> thanks a lot, phillw
17:41:35 <gema> ok, so any thoughts regarding the new format, better, worse, are we missing anything?
17:41:55 <patrickmw> its good
17:41:58 <nuclearbob> yeah
17:42:09 <nuclearbob> I think if we're missing anything it'll come up and we can add it
17:42:25 <gema> yep, I am very glad that so many new faces were here today
17:42:38 <charlie-tca> +1
17:42:52 <gema> let's keep the momentum going and see if we can build a good QA community around this meeting
17:43:11 <gema> thank you everyone for your time, see you next week!
17:43:46 <gema> #endmeeting
Generated by MeetBot 0.1.5 (http://wiki.ubuntu.com/AlanBell/mootbot)