09:00:40 <gmann> #startmeeting qa 09:00:41 <openstack> Meeting started Thu Dec 13 09:00:40 2018 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:00:42 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:00:44 <openstack> The meeting name has been set to 'qa' 09:00:47 <gmann> who all here today ? 09:01:09 <mbindlish> hi 09:05:13 <gmann> mbindlish: hi 09:05:15 <gmann> let's start 09:05:23 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours 09:05:31 <gmann> ^^ updated the agenda 09:05:45 <gmann> #topic Announcement and Action Item (Optional) 09:06:38 <gmann> announcement is about moving the devstack/tempest base jobs to Bionic. patches are merged and till now it is running smoothly 09:06:58 <gmann> at least we have not heard any issue due to bionic 09:07:09 <gmann> #topic Stein Priority Items progress 09:07:10 <mbindlish> +1 09:07:20 <gmann> #link https://etherpad.openstack.org/p/qa-stein-priority 09:07:41 <gmann> 1. Planning for Patrole Stable release - felipemonteiro, gmann 09:08:04 <gmann> i need to check the items pending for that and check with felipe on those. 09:08:17 <gmann> 2. Zuul v3 native jobs - tosky 09:09:37 <gmann> devstack patch is merged for this. last i talk to tosky, he will continue on this once he finish his priority sahara work. 09:10:20 <gmann> i am jumping to 6 directly as i did not see any updates on others 09:10:21 <gmann> 6. Tempest CLI unit tests improvement - mguiney, mbindlish 09:10:31 <gmann> mbindlish: what is status and what all pending on this ? 09:11:01 <mbindlish> currently working on account generator, already finished for tempest workspace and tempest run 09:11:27 <gmann> did we finish all the scenario for tempest workspace and run ? 09:12:02 <mbindlish> let me check for tempest run..90% are completed...but completed for workspace 09:12:08 <openstackgerrit> Yang Youseok proposed openstack/os-testr master: Add --failing option to run only failed testcases https://review.openstack.org/624893 09:12:13 <gmann> all the scenario i mean all possible combination of all possible param of those CLI in term of positive and negative behaviour 09:13:01 <mbindlish> I think i have done. but will check again all items, if found anything miss, will add them 09:13:11 <gmann> ok, thanks 09:14:23 <gmann> mbindlish: also, are you topicing all your CLI test changes to this BP - https://review.openstack.org/#/q/topic:bp/tempest-cli-unit-test-coverage+(status:open+OR+status:merged) 09:14:32 <gmann> i am seeing only 3 patch ^^ 09:15:16 <mbindlish> @gmann https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage 09:15:36 <mbindlish> Anything else need to add somewhere 09:15:46 <mbindlish> In this link, mentioned all the pushed patches 09:16:05 <gmann> ok 09:16:26 <gmann> 7. Proper handling of interface/volume/pci devece attach/detach hotplug/unplug in tempest - afazekas 09:16:33 <gmann> i think this is done. afazekas ? 09:16:54 <gmann> 11 Migration from Launchpad to storyboard - gmann 09:17:08 <gmann> i have added the story for required itesm 09:17:38 <gmann> - Response Scema validation for other component like cinder -zhufl 09:17:55 <gmann> she has good progress on this but we are holding that till we hear form interop team 09:18:12 <gmann> i will ping interop team to respond on this after mark reply 09:18:33 <gmann> that's all from stein tracking 09:18:40 <gmann> #topic OpenStack Events Updates and Planning 09:19:07 <gmann> next will be Denver summit and PTG in April end 2019. so we have time so skipping that as of now 09:19:19 <gmann> #topic Sub Teams highlights (Sub Teams means individual projects under QA program) 09:19:30 <gmann> Tempest 09:19:53 <gmann> #link https://review.openstack.org/#/q/project:openstack/tempest+status:open 09:20:01 <gmann> open reviews 09:20:05 <gmann> patrole 09:20:16 <gmann> mbindlish: anything you following in patrole ? 09:20:36 <mbindlish> not yet in patrole 09:20:52 <gmann> ok, did you start the patrole coverage for neutron ? 09:21:08 <mbindlish> currently focusing in tempest cli 09:21:13 <gmann> k 09:21:13 <mbindlish> have to start for patrole 09:21:49 <gmann> #topic Bug Triage 09:22:01 <gmann> mbindlish: your turn 09:22:04 <mbindlish> https://etherpad.openstack.org/p/QA-Stein-Bug-Triage 09:22:31 <mbindlish> First 4 we already discussed 09:23:00 <mbindlish> 5th was also discussed but you have to add some concluded comment on that 09:23:15 <gmann> mbindlish: progress on L9 is of this week ? 09:24:13 <mbindlish> new bugs reduced to 32 from 34 09:24:44 <gmann> and is it whole QA or just tempest ? 09:24:55 <mbindlish> this is tempest 09:25:08 <mbindlish> I have to add for complete QA, I forgot 09:25:24 <mbindlish> will add in next week's report for complete QA 09:26:19 <gmann> i need to find out what all sub project you can add but at least tempest, devstack, grenade, patrole etc 09:27:00 <gmann> mbindlish: go ahead 09:27:05 <mbindlish> sure, i will add these 09:27:36 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1708550 09:27:37 <openstack> Launchpad bug 1708550 in tempest "Some network tests do not use preprovisioned networks" [Undecided,New] 09:27:47 <mbindlish> you need to add concluded comment on this 09:27:54 <mbindlish> from last week discussion 09:28:35 <gmann> ok. 09:29:01 <mbindlish> next is: 09:29:02 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1710845 09:29:03 <openstack> Launchpad bug 1710845 in tempest "Sometimes tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops fail via port in state Down" [Undecided,New] - Assigned to Sofiia Andriichenko (sandriichenko) 09:29:48 <mbindlish> seems no progress on this 09:30:01 <mbindlish> assigned to Sofiia 09:30:55 <gmann> mbindlish: what is on this? i saw many patches and comement on this 09:31:08 <gmann> mbindlish: is it confirmed ? 09:32:22 <mbindlish> When I tried, no problem was occured 09:32:38 <mbindlish> but seems some times this issue occur due to time 09:32:38 <gmann> you are saying it is not reproducible ? 09:33:00 <mbindlish> may be not always, sometimes it can occur 09:33:38 <gmann> means it is reproducible. then did you find what is issue on this ? 09:33:38 <mbindlish> so need to try its run multiple times 09:33:41 <gmann> any investigation 09:34:32 <gmann> because asking author might not get much response. i feel triage more like doing complete investigation from our side and if anything needed then, mark it as incomplete 09:34:55 <mbindlish> let me try it more 2-3 times 09:35:17 <mbindlish> will confirm the neccasry action for confirm or incomplete 09:35:25 <gmann> also check from those patches - what there were fixing, what comments from reviewer, why they got abandon 09:36:18 <mbindlish> fine 09:36:25 <gmann> let's move next to bug 09:37:00 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1726462 09:37:01 <openstack> Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] 09:38:18 <mbindlish> no assignee of this 09:38:34 <gmann> but is it triaged ? which side issue is ? 09:38:38 <mbindlish> harbott confirm, this issue is hitting 09:39:03 <gmann> yeah, i see cinder, neutron and tempest. 09:40:10 <mbindlish> currently not investigated by me, which side it belongs too 09:40:46 <gmann> k, let's check what is issue, is it service side or test side 09:40:56 <mbindlish> but as per harbott..it is related to neutron 09:41:13 <gmann> ok, slaweq can check ^^ 09:41:43 <gmann> description says it is vol availability but i have not checked the details 09:41:55 <slaweq> gmann: hi, what I should check? 09:42:22 <gmann> slaweq: this one https://bugs.launchpad.net/tempest/+bug/1726462 09:42:23 <openstack> Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] 09:43:10 <gmann> it is marked confirmed on neutron. 09:43:45 <slaweq> yes, I saw it from time to time in neutron jobs 09:43:55 <gmann> same doubt as frickler mentioned, why neutron is confrmed on this 09:43:57 <slaweq> but I don't have any specific examples now 09:44:08 <slaweq> I don't know TBH :) 09:44:10 <gmann> i think cinder bug 09:44:31 <gmann> slaweq: ok. can you mark neutron triage accordingly. because it is confusing otherwise :) 09:44:33 <slaweq> yes, for me it's clearly cinder issue 09:44:38 <gmann> yeah me too 09:44:44 <slaweq> done 09:44:49 <gmann> slaweq: thanks. 09:45:01 <openstackgerrit> Brin Zhang proposed openstack/tempest master: Add unittest for types_client https://review.openstack.org/622955 09:45:12 <mbindlish> moving to next 09:45:15 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1728886 09:45:16 <openstack> Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] 09:45:22 <gmann> slaweq: you marked Triaged ? or invalid 09:45:32 <slaweq> triaged as You said 09:46:19 <gmann> triaged i means mark to real state, invalid, incomplete, confirmed etc 09:46:26 <slaweq> ahh, ok 09:46:28 <slaweq> sorry 09:46:33 <gmann> not as Triaged state :) it is confusign 09:47:08 <slaweq> ok, set to invalid 09:47:22 <gmann> slaweq: thanks again 09:47:27 <slaweq> yw 09:47:29 <gmann> mbindlish: next one 09:47:39 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1728886 09:47:40 <openstack> Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] 09:48:49 <gmann> slaweq: again for you to get more input ^^, but not now when ever you have time 09:50:26 <gmann> next 09:50:34 <mbindlish> moving to next 09:50:35 <mbindlish> https://bugs.launchpad.net/tempest/+bug/1733498 09:50:37 <openstack> Launchpad bug 1733498 in tempest "image.v1.test_image_members failed for “The success code is different than the expected one“" [Undecided,New] - Assigned to Ghanshyam Mann (ghanshyammann) 09:51:13 <gmann> yeah this one i think i remember, I need to add the v1 tests on separate job 09:51:20 <gmann> i will check the state of that patch 09:52:12 <mbindlish> ok 09:52:12 <gmann> i think few tests were failing for v1 but i did not check the state later 09:53:19 <mbindlish> next: https://bugs.launchpad.net/tempest/+bug/1741373 09:53:20 <openstack> Launchpad bug 1741373 in tempest "create network resource crashes with dynmaic creds" [Undecided,New] 09:54:24 <mbindlish> there is no update on this from long time 09:54:50 <gmann> mbindlish: same thing, is this happening on gate or were you able reproduce locally ? 09:55:51 <mbindlish> I personaly not tried to reproduce this issue, i will check this in this week 09:56:00 <gmann> k 09:56:35 <mbindlish> next: https://bugs.launchpad.net/tempest/+bug/1756262 09:56:36 <openstack> Launchpad bug 1756262 in tempest "auth_method is not getting set during tempest run using stestr" [Undecided,New] 09:56:51 <mbindlish> I treid to reproduce it, but not reproducible 10:00:04 <gmann> yeah, we take auth_method in considration and only keypair is supported as of now 10:00:08 <gmann> i will also comment on that 10:00:13 <gmann> time is up seem 10:00:23 <mbindlish> yeah 10:00:38 <gmann> mbindlish: thanks, let's work on bug things as we discussed today 10:00:43 <gmann> #topic Critical Reviews 10:00:45 <mbindlish> sure 10:00:48 <gmann> any critical review ? 10:01:04 <mbindlish> not from my side 10:01:07 <gmann> #topic Open Discussion 10:01:21 <gmann> one bug is listed there- 10:01:29 <gmann> This bug https://bugs.launchpad.net/tempest/+bug/1783369 is not seen with Swift but affects testing Ceph RGW; anybody willing to look into it? [gfidente] 10:01:30 <openstack> Launchpad bug 1783369 in tempest "Some ojectstorage tests use skip_path() and assume swift is deployed on the /" [Undecided,Confirmed] 10:02:36 <gmann> need to investigate this first, nothing to discuss as of now i think 10:02:51 <gmann> thanks for joining, that's it form today office hour 10:02:54 <gmann> #endmeeting