08:59:58 <gmann> #startmeeting qa 08:59:59 <openstack> Meeting started Thu Jun 30 08:59:58 2016 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:00:01 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:00:03 <openstack> The meeting name has been set to 'qa' 09:00:09 <gmann> hi who's here for today? 09:00:25 <masayukig> o/ 09:00:28 <itzkb_> hi 09:00:39 <dmellado> \o 09:00:51 <gmann> masayukig: dmellado itzkb_ hi 09:01:09 <gcheresh> hi 09:01:14 <dmellado> hi everyone 09:01:18 <masayukig> gmann : hi, thank you for hosting today :) 09:01:29 <gmann> np 09:01:36 <gmann> let's start 09:01:49 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_June_30th_2016_.280900_UTC.29 09:02:01 <gmann> ^^ today agenda 09:02:35 <gmann> #topic Specs Reviews 09:03:06 <gmann> sorry let's first go through the Newton priority 09:03:16 <gmann> #topic Newton Priorities 09:03:24 <masayukig> sure 09:03:25 <gmann> #link https://etherpad.openstack.org/p/newton-qa-newton-priorities 09:03:40 <dmellado> no prob gmann 09:04:00 <gmann> first one Cleanup - andreaf 09:04:27 <andreaf> o/ 09:04:34 <gmann> andreaf: any new update on this 09:04:39 <gmann> andreaf: nice timing 09:04:43 <dmellado> hi andreaf 09:05:37 <andreaf> gmann: not much on that yet 09:05:44 <gmann> andreaf: ok 09:06:20 <gmann> andreaf: i think mostly like client variable renaming etc after client refactor BP right 09:06:33 <andreaf> gmann: right 09:06:36 <gmann> k 09:06:49 <gmann> next openstack-health 09:06:53 <gmann> masayukig: your turn 09:07:37 <masayukig> sure, but there's not so much progress this time, actually.. 09:08:26 <masayukig> one thing is 09:09:01 <masayukig> added "likely bugs" link to launchpad on the top page 09:09:49 <gmann> masayukig: where exactly ? 09:10:30 <masayukig> on http://status.openstack.org/openstack-health/#/ "Failed Tests in Last 10 Failed Runs" - "Likely Bugs" column 09:11:06 <masayukig> I think there's only '-' because no e-r bugs right now. 09:11:27 <gmann> masayukig: nice 09:11:45 <masayukig> that's all from me, so far. 09:11:59 <gmann> masayukig: ok 09:12:03 <gmann> thanks 09:12:22 <gmann> next is Remaining CLI work 09:12:57 <gmann> mtreinish: has patches up for review 09:13:00 <gmann> #link https://review.openstack.org/#/q/project:openstack/tempest+branch:master+topic:bp/tempest-run-cmd 09:13:37 <gmann> i think nice progress on that 09:13:40 <gmann> next Negative Test (chrishoge, oomichi) 09:13:56 <gmann> saw this patch for that - https://review.openstack.org/#/c/333618/ 09:13:56 <patchbot> gmann: patch 333618 - tempest - Add guidance on negative tests in HACKING.rst (MERGED) 09:14:11 * gmann wow patchbot 09:14:29 * masayukig also surprised :) 09:14:41 <gmann> in this i did not find much details about what is criteria of negative tests addition 09:15:12 <gmann> i think we discussed in Austin that, we need clear guidelines for those 09:15:32 <dmellado> gmann: +1 09:15:36 <gmann> hope to see more patches from oomichi or Chris on that 09:15:44 <dmellado> it's not really clear what would be the option to Tempest on that... 09:15:49 <masayukig> gmann : +1 09:15:53 <gmann> dmellado: yea 09:16:48 <gmann> and that would not be easy to define the criteria but we should have something 09:17:30 <masayukig> gmann : agree 09:17:35 <gmann> Next item is - tempest-lib/plugin (gmann) 09:17:45 <gmann> this one is more generic for lib interfaces 09:17:53 <gmann> for service clients- 09:18:05 <gmann> image and identity v2 are moved in lib 09:18:19 <gmann> oomichi: might release the version soon 09:18:52 <gmann> on identity v2 client, some of them we kept in tempest path also not to break neutron etc 09:19:27 <gmann> on release of those as lib interface we can remove those after fixing project using old path 09:20:20 <gmann> Next is Client Manager Refactor 09:20:26 <gmann> andreaf: your turn 09:20:38 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/client-manager-refactor 09:20:55 <gmann> i think you updated those 09:22:12 <andreaf> gmann: yes 09:22:29 <itzkb_> gmann: Where can I find some explanation about this topic? 09:22:31 <andreaf> gmann: the first patch merged - this one is ready https://review.openstack.org/#/c/326667/28 09:22:31 <patchbot> andreaf: patch 326667 - tempest - Factor up (most) CONF value in clients.Manager 09:22:44 <gmann> andreaf: cool 09:23:02 <gmann> itzkb_: you mean Newton priority or client refactor? 09:23:11 <andreaf> gmann: I need still some work on the 2nd patch but I would like to get feedback on the general direction of the patches 09:23:17 <andreaf> gmann: so reviews are welcome 09:23:20 <itzkb_> gmann: client refactor 09:23:23 <gmann> great 09:24:02 <gmann> itzkb_: spec link - https://specs.openstack.org/openstack/qa-specs/specs/tempest/client-manager-refactor.html 09:24:10 <gmann> itzkb_: and on going patches 09:24:20 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/client-manager-refactor 09:24:25 <itzkb_> gmann: thanks 09:24:31 <andreaf> itzkb_: what I'm working on is the client manager refactor, not the client refactor - I'm preparing a client manager that can be exposed as a stable interface to be used by plugins 09:24:31 <gmann> itzkb_: and ping andreaf for more info :) 09:25:05 <dmellado> itzkb_: I told you about this, remember xD 09:25:07 <gmann> andreaf: i will review those tomorrow 09:25:22 <itzkb_> dmellado: yeah ,Just need to figure this out 09:25:32 <gmann> and let's review and get those in or provide feedback 09:25:33 <andreaf> itzkb_: atm most plugins use either manager.Manager or clients.Manager - but they are not stable interfaces 09:26:14 <dmellado> andreaf: any plan to stabilize also the dynamic cred provider? 09:26:22 <dmellado> manila guys were complaining about that 09:26:37 <dmellado> that's why they 'pin' a tempest commit, which is quite annoying 09:26:45 <gmann> dmellado: complaining on interface change? 09:26:59 <dmellado> complaining on tempest not providing stable enough interfaces 09:27:00 <andreaf> dmellado: yes I've been working on that as well - but the dynamic creds provider uses clients which are not stable yet (identity) and the client manager 09:27:21 <dmellado> andreaf: I see, thanks for the update! 09:27:43 <andreaf> dmellado: but I already did a lot of cleanup work in that area already in mitaka times 09:28:12 <dmellado> andreaf: in any case I guess that'd be solve by having the tempest plugin on its own repo too 09:28:20 <dmellado> but anyway, same war as always xD 09:29:31 <gmann> dmellado: yea, it will take time to get all required interfaces as stable 09:29:58 <gmann> let's move on 09:30:01 <gmann> #topic Specs Reviews 09:30:09 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z 09:30:22 <gmann> i saw a new one - https://review.openstack.org/#/c/314704/2/specs/other/policy-testing-on-apis.rst 09:30:22 <patchbot> gmann: patch 314704 - qa-specs - Policy testing APIs 09:30:38 <gmann> seems like new project for policy things 09:31:00 <gmann> mtreinish reviewed that seems. 09:31:18 <gmann> i have not looked into the detail yet 09:32:17 <gmann> seems like testing tempest for all user roles and consider 403 as pass 09:32:49 <masayukig> seems interesting, I'll have a look 09:33:24 <gmann> yea but thats like testing running tempest for all possible combination of policy.json 09:34:01 <gmann> but we cover all tests runs under different type of role like admin owner etc 09:34:32 <masayukig> ok 09:36:02 <gmann> but that can be benefit to capture if any API interacting with multiple service/backend and those have not been honoring the policy.json and have hard coded rule etc 09:36:08 <gmann> just a thought 09:36:14 <gmann> but let's review that 09:36:45 <gmann> anything on spec from anyone 09:37:34 <gmann> ok. let's jump to next 09:37:41 <gmann> #topic Tempest 09:38:36 <gmann> anything new from anyone? 09:39:04 <gmann> i do not have any new to discuss on this 09:39:27 <masayukig> same here 09:39:59 <gmann> one was mtreinish removed the trove tests from tempest 09:40:16 <gmann> and we left with Sahara, Heat and ironic now 09:40:20 <gmann> good move 09:40:41 <masayukig> yeah, is there a list for it? 09:40:49 <tosky> sahara are in fact already moved, and now also on the CI too 09:40:56 <dmellado> oh, hi tosky 09:41:04 <dmellado> I was about to mention that ;) 09:41:07 <masayukig> cool 09:41:23 <gmann> tosky: cool 09:41:35 <gmann> Thanks :) 09:42:21 <andreaf> tosky: so tests can be removed from tempest now? 09:42:42 <gmann> tosky: these one- https://github.com/openstack/tempest/tree/master/tempest/api/data_processing 09:42:54 <tosky> yes, they can; I can put up a review if you want 09:43:33 <tosky> yes, those (see sahara-tests, under sahara_tenpest_plugin) 09:43:34 <gmann> tosky: yea sure, will be nice to review 09:43:44 <andreaf> tosky: that would be nice - we need to remove all references to sahara as well, you can look at the trove removal patch for reference 09:43:57 <tosky> sure 09:44:17 <gmann> tosky: https://review.openstack.org/#/c/302473/ 09:44:17 <tosky> but also the client? 09:44:17 <patchbot> gmann: patch 302473 - tempest - Remove trove tests from tempest (MERGED) 09:44:24 <gmann> tosky: yes 09:44:38 <tosky> uh, that one was not.moved 09:44:38 <masayukig> please read http://docs.openstack.org/developer/tempest/test-removal.html when you remove tests :) 09:44:46 <andreaf> #link: trove removal patch: https://review.openstack.org/#/c/302473/ 09:44:46 <patchbot> andreaf: patch 302473 - tempest - Remove trove tests from tempest (MERGED) 09:45:15 <gmann> tosky: you mean service clients are not moved? 09:45:25 <tosky> yes 09:45:51 <gmann> tosky: so Sahara plugin use the service clients from tempest. 09:46:45 <tosky> exactly - I wa waiting for.client stabilization 09:48:10 <tosky> what shoul I do then? Keep using the one in tempest for noe? 09:48:11 <gmann> tosky: i feel you can move and later use client manager for registration as andreaf doing that 09:48:56 <gmann> tosky: and till then use the manager class as other plugin doing as of now 09:49:03 <andreaf> tosky, gmann: yes that would be nice - I can help out with using the new interface once it's ready 09:49:20 <gmann> andreaf: great. 09:49:38 <gmann> tosky: shot a patch, we can help if anything missing 09:49:57 <tosky> ok, let's talk post-meeting 09:50:03 <tosky> thanks 09:50:07 <gmann> tosky: cool, Thanks 09:50:17 <gmann> I think we already discussed openstack-health 09:50:21 <gmann> #topic Critical Reviews 09:50:34 <gmann> any key reviews to be done on priority? 09:52:05 <gmann> ok 8 min left 09:52:11 <gmann> let's move to open 09:52:13 <gmann> #topic open 09:52:29 <gmann> anything else to discuss than in agenda 09:52:51 <masayukig> so, https://wiki.openstack.org/wiki/Sprints/QAInfraNewtonSprint 09:53:12 <dmellado> gmann: yep, from my side I've been trying to get some help on the class squash 09:53:15 <dmellado> without that many success 09:53:30 <gmann> dmellado: ohk, no prob 09:53:31 <dmellado> I'll be going to the cycle and will try to get that done there 09:53:38 <gmann> dmellado: cool 09:53:39 <dmellado> mid-cycle 09:53:42 <masayukig> I think we should put topics on the page. 09:53:48 <masayukig> if we have 09:54:05 <gmann> masayukig: ah nice catch :) 09:54:15 <gmann> AI for oomichi 09:54:28 <gmann> #action oomichi to add topic for mid-cycle 09:54:32 <dmellado> also times 09:54:34 <dmellado> ;) 09:54:49 <gmann> but all are welcome to add their topic which you are going to work on those 09:54:57 <gmann> dmellado: :) 09:55:08 <dmellado> ;) 09:55:58 <gmann> anything else or close the meeting 09:56:20 <dmellado> fine for me 09:56:23 <dmellado> thanks everyone! 09:56:27 <masayukig> thanks! 09:56:28 <gmann> Thanks all for joining. 09:56:38 <gmann> #endmeeting