08:00:20 <gmann> #startmeeting qa
08:00:21 <openstack> Meeting started Thu Aug 24 08:00:20 2017 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.
08:00:22 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
08:00:25 <openstack> The meeting name has been set to 'qa'
08:00:43 <gmann> who all are here today?
08:00:55 <blancos> o/
08:01:05 <zhufl1> o/
08:01:14 <UdayT> o/
08:01:33 <andreaf> o/
08:02:31 <gmann> let's start
08:02:43 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_August_24th_2017_.280800_UTC.29
08:02:51 <gmann> today agenda ^^
08:02:57 <chandankumar> gmann: andreaf zhufl1 \o/
08:03:15 <gmann> #topic Previous Meeting Action review
08:03:17 <andreaf> \o
08:03:28 <martinkopec> o/
08:03:40 <gmann> long pending AI for me
08:03:47 <gmann> #Action gmann to send ML for upcoming removal of deprecated interfaces and its affect on stable branches
08:04:13 <gmann> i have not sent mail yet. i will be able to get all data and send by next week
08:04:35 <gmann> #action gmann to send ML for upcoming removal of deprecated interfaces and its affect on stable branches
08:04:47 <gmann> #topic PTG
08:04:47 <andreaf> gmann: thanks - that would be really useful
08:05:21 <gmann> andreaf, yea, did not find time actually. we should remove those long pending things soon
08:05:32 <gmann> #link https://etherpad.openstack.org/p/qa-queens-ptg
08:05:38 <gmann> ^^ PTG etherpad
08:05:52 <chandankumar> I will be not able to make it to PTG, for tempest plugin split help, tosky and dmellado will be helping there
08:06:17 <andreaf> chandankumar: sorry you won't be there
08:06:24 <gmann> chandankumar, yea. visa things are hard.
08:06:28 <dmellado> o/ I'll be around, for chandan blame Trump...
08:06:47 * gmann saw afazekas coming. hope to meet him this time :)
08:06:58 <gmann> dmellado, :) nice
08:07:16 <chandankumar> forgot about that, also you can pull afazekas in the tempest plugin split also
08:07:24 <gmann> we need more proposal ideas as not much as of now
08:07:25 <andreaf> dmellado: yeah great to meet you there
08:07:43 <dmellado> I'm also interested on getting feedback on how to handle k8s python client
08:07:52 <dmellado> and some mixed-up k8s/openstack testing
08:08:05 <dmellado> I'll be putting something there, but for now I'm getting back to my meeting, folks
08:08:07 <andreaf> dmellado: did you propose a session about that?
08:08:09 <dmellado> great seeing you there!!!
08:08:12 <dmellado> I did, IIRC
08:08:19 <gmann> dmellado, that is gone things right we will be using client from k8s side
08:08:21 <andreaf> dmellado: great thanks
08:09:04 <andreaf> dmellado: that would be a very interesting topic, and I would love to see some real life use cases of openstack/k8s cross testing
08:09:21 <gmann> dmellado, you mean to add in tempest service client?
08:09:41 <dmellado> yeah I was thinking about if that'd be useful
08:09:48 <dmellado> and also would love feedback about some mixed scenario tests
08:09:51 <gmann> andreaf, for kuryr testing it will be useful
08:10:01 <gmann> dmellado, nice
08:10:07 <dmellado> andreaf: you can see my kuryr tempest plugin, for example
08:10:13 <dmellado> I'll be adding quite some more tests to it
08:10:13 <gmann> yea
08:10:29 <andreaf> gmann, dmellado: cool I'll look into it
08:10:32 * dmellado gets pulled again, pls ping me later at #openstack-qa if you need me
08:10:40 <gmann> dmellado, sure thanks
08:10:53 <chandankumar> dmellado: your expertize will help us in adding different ci to any particular tempest plugin for full coverage of a project
08:11:27 * afazekas gmann: me too
08:11:34 <gmann> i will be setting up the tacker plugin during PTG, as very less testing for tacker in gate mainly scenario things
08:12:00 <gmann> add more and more sessions on etherpad
08:12:26 <gmann> andreaf, any deadline for that as we are just 2 week far from PTG ?
08:12:36 <andreaf> gmann: nice you can track that on the etherpad (the tacker plugin)
08:12:54 <gmann> andreaf, sure
08:13:16 <andreaf> gmann: just make sure we come prepared for the various sessions
08:13:17 <chandankumar> gmann: andreaf i will create a wiki page today to track all plugin status with their respective
08:13:33 <chandankumar> and will send a mail to openstack-dev so that people can update it.
08:13:54 <gmann> andreaf, sure
08:14:04 <andreaf> gmann: I will start this week to formalise a bit more the etherpad and add extra etherpard for each sessions - but everyone can make one for their sessions - start adding more notes for the discussion
08:14:10 <chandankumar> andreaf: can i also announce also about Walkthrough: migrating a plugin from in-tree to own repo (andreaf) topic through the sam email?
08:14:25 <chandankumar> so that people can attend it
08:14:25 <gmann> andreaf, cool
08:15:59 <gmann> chandankumar, +1 for wiki on plugin things. it will be useful to track those
08:16:11 <andreaf> chandankumar: link?
08:16:27 <chandankumar> andreaf: creating right now, will pass you after meeting
08:16:34 <andreaf> chandankumar: ok
08:16:56 <andreaf> one last thing on my side
08:17:11 <andreaf> during PTG we'll have the opportunity to take a team photo again
08:17:19 <andreaf> so it's either Tue or Wed
08:17:27 <gmann> andreaf, help hours will be fish ball room or traning type or design discussion kind ?
08:17:34 <andreaf> I would say Wed
08:18:09 <gmann> andreaf, +1, for photo
08:18:20 * gmann i can compare my beard growth from last PTG :)
08:18:31 <andreaf> gmann: that's a good question - I understand they will be design discussion kind - but I need to check with ttx
08:18:40 <gmann> andreaf, ok
08:19:19 <andreaf> ok I'll just book a slot for the photo and put it on the etherpad
08:19:28 <gmann> k
08:19:34 <gmann> anything else on PTG ?
08:19:53 <gmann> #topic Gate Stability
08:20:22 <gmann> not much failure on gate #link https://goo.gl/ptPgEw
08:20:54 <gmann> any known issue on gate anyone want to discuss
08:22:01 <gmann> #topic Specs Reviews
08:22:19 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z
08:22:47 <gmann> this is key work before PTG. start reviewing/ adding spec for your topic going to be discussed in PTG
08:23:39 <gmann> dmellado, it will be nice if you can come up with k8s spec. it will be helpful for discussion
08:23:58 <dmellado> gmann: sure, I'll be writing something as a draft before the PTG
08:24:05 <gmann> dmellado, thanks.
08:24:05 <dmellado> so we could discuss it and start implementation
08:24:11 <gmann> +1
08:24:26 <gmann> anything else on spec side ?
08:25:03 <gmann> #topic Tempest
08:25:16 <gmann> #link https://review.openstack.org/#/q/project:openstack/tempest+status:open
08:25:52 <gmann> andreaf big patch is merged #link https://review.openstack.org/#/c/493668/
08:26:20 <andreaf> yeah thanks for that everyone, now let's all go and rebase :(
08:26:22 <gmann> this is patrole fix - #link https://review.openstack.org/#/c/497013/
08:26:25 <andreaf> :P
08:26:45 <andreaf> #link https://review.openstack.org/#/c/497013/ Patrole fix
08:28:07 <gmann> andreaf, just fixed the comment
08:28:24 <andreaf> thanks
08:28:35 <gmann> i do not want to remove the check as we can uncomment it with correct function once tempest is released
08:29:09 <andreaf> gmann: we could leave it uncommented - it doesn't harm
08:29:39 <gmann> patrole take tempest from pip?
08:30:54 <gmann> it would not fail in patrole ?
08:31:55 <andreaf> ok I see - then I would just remove it completely - but it's ok as is as well
08:31:56 <andreaf> as is in your patch I mean
08:32:06 <gmann> k
08:32:41 <gmann> blancos, please check this - https://review.openstack.org/#/c/497013/
08:33:04 <gmann> next is - Test.py as stable
08:33:07 <gmann> #link https://etherpad.openstack.org/p/tempest-test-module-stable
08:33:17 <blancos> gmann Will do. Thank you
08:33:47 <gmann> blancos, thanks
08:33:48 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:test_module_stable
08:33:58 <andreaf> Thanks gmann
08:34:14 <andreaf> I just rebased the series after the decorator move
08:34:21 <andreaf> and I keep adding to it
08:34:30 <andreaf> mostly docstings and unit tests now
08:34:31 <gmann> andreaf, you did rebase. nice
08:35:01 <gmann> andreaf, thanks
08:35:26 <andreaf> my plan it to change as little as possible of the current implementation
08:35:56 <andreaf> there are a few tiny inconsistencies but we can fix them over time
08:36:12 <gmann> andreaf, ok, you want to declare it stable after PTG or before.
08:36:15 <andreaf> like if you request admin or alt and they are not available we skip, but if you request credentials by role and they are not available we fail
08:36:43 <andreaf> gmann: at this rate I'm doubting before PTG will make it in time - but I'm trying
08:36:54 <andreaf> gmann: one open point is the swift client
08:37:18 <gmann> andreaf, because i think not much people commenting on etherpad #link https://etherpad.openstack.org/p/tempest-test-module-stable
08:37:26 <andreaf> gmann: we cannot declare clients.py stable without the swift client I think and we cannot declare test.py stable without clients.py
08:38:01 <gmann> may be discussing or going through that in PTG also good to get more feedback and thoughts
08:38:11 <andreaf> gmann: yeah I need to update it with the latest patches - not sure there is much more to be discussed on the etherpad
08:38:33 <gmann> andreaf, ah, that is my side things for swift client
08:38:47 <gmann> andreaf, let's see if i can make those before PTG
08:39:06 <andreaf> gmann: sure sounds like a good plan - I would like to get as further as possible anyways before PTG we can hold off the "declare as stable" patch and do a review at the PTG
08:39:23 <gmann> andreaf, +1
08:39:54 <andreaf> gmann: yeah if you need help with those let us know it doesn't have to be all on your shoulders
08:40:13 <andreaf> but in general I would like to think that in queens we can focus on something different from making stable interfaces
08:40:44 <andreaf> sure there'll be a few more things here and there but if we cover 90%+ of what plugins use we are in a good position I think
08:41:02 <gmann> andreaf, sure, i just have some nova PoC patches and this one. i will ask for help if needed or i get delay for those
08:41:41 <gmann> andreaf, yea that will be big relief for us. not fixing plugins all time
08:42:40 <gmann> next is Bug Triage.
08:42:45 <gmann> #link https://etherpad.openstack.org/p/pike-qa-bug-triage
08:42:58 <gmann> #link https://etherpad.openstack.org/p/tempest-weekly-bug-report
08:43:11 <gmann> this week zhufl1 turn
08:43:15 <gmann> zhufl1, go ahead
08:43:20 <zhufl1> yeah
08:44:17 <zhufl1> I put those may need discussion on bug report
08:45:20 <gmann> zhufl1, ok
08:45:32 <gmann> zhufl1, anything interesting bug etc
08:45:50 <zhufl1> seems not
08:45:54 <gmann> ok
08:45:57 <gmann> zhufl1, thanks
08:46:02 <zhufl1> :)
08:46:18 <gmann> next turn is chandankumar (again :))
08:46:40 <gmann> #topic Patrole
08:46:52 <gmann> #link https://review.openstack.org/#/q/project:openstack/patrole
08:47:31 <gmann> blancos, your turn
08:47:58 <blancos> We have a few open reviews we wouldn't mind having some extra eyes on
08:48:10 <gmann> ok
08:48:15 <blancos> #link https://review.openstack.org/#/q/project:openstack/patrole+status:open
08:48:30 <gmann> i think we should review this spec before PTG for patrole-
08:48:31 <blancos> I know Felipe also has some topics he's looking to bring up at the PTG to get feedback on
08:48:32 <gmann> #link https://review.openstack.org/#/c/461140/
08:48:39 <gmann> blancos, nice
08:49:15 <blancos> gmann Yes, we're pretty excited about that one :) It'll really help with testing certain APIs
08:49:34 <blancos> (and I think that's about it for Patrole)
08:49:39 <gmann> sure.
08:50:02 <gmann> blancos, thanks
08:50:28 <gmann> i will discuss the patrole job on nova in PTG
08:50:45 <blancos> gmann Okay, thank you
08:50:56 <gmann> because that spec is not reviewed by anyone else
08:51:14 <gmann> anything else on patrols ?
08:51:30 <blancos> No, I think that's it
08:51:56 <gmann> #topic Critical Reviews
08:52:09 <gmann> i think we mostly covered this
08:52:23 <gmann> but if anyone else have any more priority reviews
08:53:59 <gmann> we have 6 min left let's jump to open
08:54:06 <gmann> #topic Open Discussion
08:54:11 <ildikov> hi
08:54:16 <ildikov> I have a quick question
08:54:18 <gmann> ildikov, hi
08:54:37 <ildikov> a few OPNFV folks reached out to me, their test group plans trying to setup resiliency/long duration/robustness/stress tests in OPNFV
08:55:08 <ildikov> and they are interested in collaborating with us and learning about what we are doing in this area
08:55:24 <gmann> ildikov, nice.
08:55:29 <ildikov> so I wanted to ask whether that is in scope in any extent?
08:55:50 <gmann> ildikov, anyone from them joining PTG? i know R Mibu not coming
08:56:17 <ildikov> I will ask, not sure whether anyone from the testing teams is coming
08:56:18 <gmann> ildikov, one of them we are going to discuss about robust testing in PTG
08:56:35 <ildikov> gmann: is it ok, if I add you to the mail thread?
08:56:52 <gmann> ildikov, and stress one  we have in private repo and i can try to add in qa project
08:56:56 <gmann> ildikov, sure
08:57:06 <ildikov> that sounds pretty good, the PTG would be a great forum to move discussions forward
08:57:10 <andreaf> ildikov: I'm happy to be in the loop as well
08:57:23 <gmann> ildikov, overall we have scope with tempest plugin, if tests not under tempest it can be done with tempest plugin
08:57:24 <ildikov> andreaf: awesome, thanks
08:57:30 <gmann> ildikov, yea add andreaf also
08:57:44 <gmann> we can further discuss the direction
08:57:56 <UdayT> Hi
08:58:05 <ildikov> that's great, I know it came up earlier, but wasn't sure where things stand at the moment and what our capacity is, etc.
08:58:23 <gmann> ildikov, thanks for information and it one of our agenda of cross community testing
08:58:27 <gmann> UdayT, HI
08:58:29 <ildikov> I will add you to the mail thread and ask back about who's coming to the PTG
08:58:35 <UdayT> I have a question/need for direction ?
08:58:44 <gmann> ildikov, COOL
08:58:56 <ildikov> gmann: +1 for cross-community testing
08:58:57 <gmann> UdayT, please go ahead
08:58:58 <UdayT> Wanted to push a commit for a scenario test involving Nova, Glance and  Neutron (with CPU pinning/SRIOV).
08:59:05 <gmann> 1 min left
08:59:12 <UdayT> I only found this https://docs.openstack.org/tempest/latest/field_guide/scenario.html.
08:59:16 <gmann> UdayT, ok
08:59:18 <UdayT> Can you help me with  some direction please ?
08:59:41 <UdayT> Specifically my test is for After reaching max VCPU for a particular host, that we can spin up the same number of new VMs after terminating the same number of ACTIVE VMs on that host.
08:59:44 <gmann> UdayT, sure, can we discuss on qa channel
08:59:57 <gmann> time up let;s move to qa
09:00:01 <andreaf> yeah let
09:00:06 <gmann> UdayT, ll discuss on qa channel
09:00:08 <andreaf> let's move the the qa channel
09:00:10 <gmann> thanks all for joining
09:00:11 <gmann> #endmeeting