== Dev Week -- Q&A about test automation -- gema -- Thu, Aug 30th, 2012 == {{{#!irc [16:30] ok, so I wanted to have time to talk about testing and automation in a more generic way [16:30] Logs for this session will be available at http://irclogs.ubuntu.com/2012/08/30/%23ubuntu-classroom.html following the conclusion of the session. [16:31] not just utah, but discuss options that people have when considering automating testing for their applications/packages [16:31] do you guys have any question that needs addressing? [16:32] or want to know anything about how we are running all the automated tests you see in jenkins? [16:34] marcosb asked: say frameworks for automatized test for Linux. [16:35] ok, marcosb, let's see [16:35] I have already spoken about UTAH [16:35] we have also in the ubuntu world autopilot [16:36] you can use Xpresser [16:36] you can even use checkbox for some existing test cases and certification [16:37] marcosb: do you have any particular need to address so that I can give you a better answer? [16:38] please, feel free to ask questions in this channel directly [16:38] since this is more of a round table kind of session [16:38] it makes sense [16:38] no need to prefix with QUESTION: [16:39] sure gema, is nicolas skeggs part of your team?, or we have several testing teams here? [16:39] chilicuil: nicholas skaggs is the QA Community coordinator [16:39] so basically my team work focussed on automation and we also do manual testing during milestones [16:40] which is what nicholas is coordinating [16:40] so we work directly with nicholas in things that are open initiatives [16:40] and just work in canonical creating test cases that nicholas and you guys can use to drive your testing later [16:40] we do both things [16:40] nick is not in our team but we talk on daily basis and collaborate [16:41] marcosb asked: No just interested about possibilites :) [16:42] marcosb: ack [16:42] chilicuil: do you collaborate on the ubuntu QA team? [16:42] gema: not yet [16:43] chilicuil: we'll be happy to have you onboard whenever you want :) [16:43] I was just wondering why I've heart about UTAH in the mails nicolas send almost every day =) [16:43] I've not* [16:43] chilicuil: because utah is in the process of being created, we are not fully in production yet [16:43] so nicholas cannot still use our runlists [16:44] but believe me he is asking me on regular basis :) [16:44] that answer my question, I hope to join u soon [16:44] excellent [16:44] any other questions / concerns? [16:46] well, we have still some minutes to go, so let me know if you guys have anything [16:46] i was wondering what timezone the schedule for classes is in, i looked at the link provided here. [16:47] for future reference [16:47] wan26: the schedule is in UTC i think [16:47] (GMT +- 0) [16:47] yes, that confused me too [16:47] "Events shown in time zone: GMT (no daylight saving)" [16:47] Thank you :) [16:49] so if you guys want to have a look at results of our automated testing, feel free to look at jenkins [16:50] https://jenkins.qa.ubuntu.com/ [16:50] we are working on a different view for results, but for now jenkins does the job [16:50] There are 10 minutes remaining in the current session. [16:51] and if you want to collaborate with QA for Ubuntu, you can start on the wiki of the QA Team [16:51] https://wiki.ubuntu.com/QATeam/ [16:52] so if you guys do not have any more questions on QA, make sure you stay tuned for the next session, which is about WebApps [16:52] in under 10 minutes [16:53] thanks a lot gema, I feel me a little bit lost with jenkins so I think I'll check it out before joining the team [16:53] we'll also be having a Developers Roundtable, where you'll be able to ask questions, share your experiences, and bring ideas about development :) [16:54] chilicuil: no worries about jenkins [16:54] chilicuil: to be able to help you only need to know how to install ubuntu and have some machine or VM to do it [16:54] jenkins is automated testing, it is what my team and others in Canonical do [16:54] but people from the community can also help by testing images [16:54] during milestones [16:55] http://iso.qa.ubuntu.com/ [16:55] have a look here ^ [16:55] no need to understand jenkins for that :) [16:55] There are 5 minutes remaining in the current session. [16:56] I'll do gema, I just though I need to make sense of the results jenkins gave [16:56] and if you wanted to know, say.. how quantal's image today is doing, you'd go here: [16:56] https://jenkins.qa.ubuntu.com/view/Quantal/view/ISO%20Testing%20Dashboard/ [16:56] and you see what image is being tested in the description [16:56] and if it is sort of good or not [16:56] it is just an indication that it is worth installing [16:56] and doing further testing [16:56] on it [16:56] Is this to gather as much data as possible for compatibility? Looks interesting [16:57] wan26: we are not doing compatibility testing yet [16:57] we still have to cover the basis of functional! [16:57] got it, so if I see an image with lots of failures is it good to test?, in order to file bugs for example? [16:57] chilicuil: the other way around [16:57] when the automated testing is all red [16:57] aha I see [16:57] it is not worth for you to try [16:57] because it will probably not work [16:57] you are welcome to, but you may encounter problems [16:58] when things are green in the automated world [16:58] then it is worth for people with brains to try and install [16:58] because that finds problems [16:58] I'll stick with the iso.qa.ubuntu.com pagen then =) [16:58] that the robot cannot find [16:58] chilicuil: good choice :) [16:58] we are wrapping up this session guys, we are in #ubuntu-testing if you want to continue this conversation [16:59] or ask anything in the future [16:59] a pleasure talking to you! [16:59] have a nice day gema, thanks for sharing UTAH with us [17:00] thanks [17:00] thank you for listening :) }}}