09:01:46 #startmeeting qa 09:01:46 Meeting started Thu Jul 26 09:01:46 2018 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:01:48 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:01:50 The meeting name has been set to 'qa' 09:01:52 hi 09:01:55 PING LIST- gmann, andreaf, masayukig, chandankumar, felipemonteiro, frickler, mbindlish 09:02:00 who all here today 09:02:05 o/ 09:03:43 let's start 09:03:51 k 09:03:56 #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours 09:04:05 today agenda ^^ 09:04:14 #topic Announcement and Action Item (Optional) 09:04:43 1 announcement -bashate is released 09:04:45 #link https://review.openstack.org/#/c/583809/ 09:05:02 also added bashate as independent release model 09:05:46 AI 09:05:56 cool 09:06:05 there was 1 action item from last to last meeting 09:06:06 #link http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-07-12-09.00.html 09:06:25 1. gmann to track each planned item and send ML for more volunteer etc 09:06:46 i have not sent mail but got BP registered on LP and people can work on those 09:07:15 1 is about filling the schema in microversion which will be pretty easy and straight forward 09:07:26 and other is CLI unit test which we will talk later 09:07:36 so with that i am closing this action item 09:08:15 ++ 09:08:28 as this is end of cycle, we need to be more active on such item in starting of stein 09:08:59 one more announcement 09:09:27 * masayukig should be active more at least :-p 09:09:43 mbindlish: is going to work in QA and help us for tempest and other project work 09:09:50 let's welcome mbindlish . 09:10:18 awesome! 09:10:23 thanks :) 09:10:46 that's all om announcement and AI 09:10:55 #topic Rocky Priority Items progress 09:11:07 #link https://etherpad.openstack.org/p/qa-rocky-priorities-tracking 09:11:28 1. Zuul v3 native jobs - andreaf 09:11:43 no progress on this from couple of weeks. 09:11:52 2. Remove Deprecated APIs tests from Tempest. - gmann 09:12:13 same on this too. this is not much left and i will complete this in next week as nova FF is done 09:12:35 - Tempest Microversion testing fixes - gmann 09:13:18 zhufl registered BP for this 09:13:20 #link https://blueprints.launchpad.net/tempest/+spec/full-schema-for-all-microversions 09:13:32 most of part was done but still need more trivial fixes 09:14:12 my idea is to open this BP every cycle to track the schema filling work. 09:14:40 and on this we can get more volunteer. and this cycle also i asked few of them 09:15:11 other things like scenario manager refactoring etc not in good progress 09:15:15 4. Running patrole on gate- felipemonteiro 09:15:48 there are good progress on doc part and i need to do more review there. at least to get multi policy things done in Rocly 09:16:09 moving directly to 6 09:16:10 6. Tempest CLI unit tests improvement - mguiney, mbindlish 09:16:39 i registered a BP for this work with all background information and example 09:16:41 #link https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage 09:16:50 mbindlish volunteered to work on this 09:17:09 nice! 09:17:11 mbindlish: check the BP and ask if any query you have. 09:17:23 ok @gmann 09:17:35 we hope you to write lot of test case including positive and negative 09:17:47 sure 09:18:12 i have mentioned the example there like how we broke CLI previously which will be easy to understand what kind of testing we are lacking 09:19:33 mbindlish: what is your launch [ad ID so that i can assign hat to you 09:19:53 i found 2 manikbindlish and manikbindlish19 09:19:59 which one is you 09:20:00 let me check 09:20:23 manikbindlish 09:21:22 Console logs not available after 20:41s for tempest-full 576236,14,b9fe178 09:21:25 ok i have assigned to you 09:22:41 8. Future of OpenStack-Health - masayukig 09:22:53 masayukig: anything you want to update on this 09:24:16 I have nothing particular for now. There are some patches from Trevor, can you look at them if you have time :) 09:24:39 difficult for me to review :) 09:25:06 heh 09:25:22 let's move next 09:25:34 #topic OpenStack Events Updates and Planning 09:25:46 Etherpad: #link https://etherpad.openstack.org/p/qa-stein-ptg 09:26:20 we have etherpad for stein PTG planning ^^ 09:27:21 i added 1 more item about plugins service clients interface usage 09:27:24 #link http://lists.openstack.org/pipermail/openstack-dev/2018-July/132419.html 09:27:30 this mailing list ^^ 09:27:52 add topic ideas which are want to cover in PTG 09:28:07 thanks, I'll check and add some 09:28:29 masayukig: thanks 09:28:59 #topic Sub Teams highlights (Sub Teams means individual projects under QA program) 09:29:09 Tempest 09:29:18 #link https://review.openstack.org/#/q/project:openstack/tempest+status:open 09:30:36 finally we merged the neutron skip tests needed for neutron filter validation feature 09:30:57 other is ongoing review in tempest. 09:31:17 let us know if anything urgent we need to get in for Rocky release 09:31:28 Patrole 09:31:34 this we already covered 09:31:54 any other updates from any subteam 09:32:23 nope(?) 09:33:00 ok let's move then 09:33:53 #topic Bug Triage 09:34:57 as you might know we have gate very unstable since couple of weeks 09:35:08 one regular issue is test timeout 09:35:22 matt opened a bug for this 09:35:27 #link https://bugs.launchpad.net/tempest/+bug/1783405 09:35:27 Launchpad bug 1783405 in tempest "Slow tests randomly timing out jobs (which aren't marked slow)" [High,Confirmed] - Assigned to Ghanshyam Mann (ghanshyammann) 09:35:34 yeah 09:35:44 this is high priority bug more details on ML 09:35:46 #link http://lists.openstack.org/pipermail/openstack-dev/2018-July/132447.html 09:36:26 thee are many test which are slow and should be marked as slow so that they can be excluded from regular tempest-full job 09:37:06 for audit and mark tests slow i have created a ethercalc to collect the time data 09:37:09 #link https://ethercalc.openstack.org/dorupfz6s9qt 09:37:18 masayukig: i saw you already voted there 09:37:22 thanks for that 09:37:30 gmann: yeah, so, I feel over 100s is long enough 09:37:31 ? 09:38:02 or 120s or more? 09:38:03 depends on tests and scenario. 09:38:08 k 09:38:08 i though or 120 09:38:14 thought 09:38:29 but let's get more feedback and voting on that and then we can decide 09:38:58 ok, but should we mark 'slow' asap? 09:39:29 as matt mentioned in ML, personality tests can be marked as slow as they takes time and API is deprecated in nova 09:39:33 i agree on that 09:39:51 masayukig: i think so but based on feedback, 09:40:18 today is FF and if those tests create too much issues on gate for RC releases then we need 09:40:33 otherwise i do not want to take decision in hurry 09:40:43 yeah, my concern is that it blocks the gate 09:41:18 yeah, if it keep blocking gate then yes 09:41:45 the avg time i took is for 14 days which might be less? 09:42:00 Console logs not available after 20:37s for legacy-tempest-dsvm-neutron-src 585850,1,8e3114d 09:42:04 or we should consider months or 3 months 09:42:26 I think 14 days is enough 09:43:02 ok, while marking slow we can anyways check old data also for double check 09:43:10 I guess it might be slower than usual, though 09:43:43 And, the patch should be simple and easy. We can merge it soon. 09:43:52 yeah 09:44:00 next bug is critical 09:44:04 #link https://bugs.launchpad.net/tempest/+bug/1739829 09:44:04 Launchpad bug 1739829 in tempest "tempest-full job failing in stable/pike with 404 from keystone during tempest verify-config" [Critical,In progress] - Assigned to Andreas Jaeger (jaegerandi) 09:45:14 execuse me, sir, I would like to ask about the devstack@q-agt service. Has this error been solved? http://paste.openstack.org/show/726672/ 09:46:29 i am not sure if that if fixed 09:46:53 by this https://review.openstack.org/#/c/531305/ 09:47:14 anyway i will double confirm that before closing it 09:47:56 gmann: yeah, The patch says partial-bug 09:48:17 masayukig: ok, need to check what left on pike porting 09:49:06 yeah 09:49:12 BrinZhang: there are no error on gate are you getting this on master ? 09:49:24 yes 09:49:57 gmann: this on devstack 09:50:49 with ovs agent right 09:51:22 I am not aware of that, may be frickler can help ^^ 09:52:26 on bug triage there are many bugs in New state. 09:53:01 :( 09:53:02 we will keep triaging those and mainly keep eyes on gate as Rocky release time 09:53:25 yeah.. 09:53:25 moving to open discussion 09:53:28 #topic Open Discussion 09:53:44 anything else to discuss ? 09:53:54 hi, i have couple of questions... 09:54:24 I get the following error inconsistently when i run the tempest for some tests: 09:54:30 `testtools.matchers._impl.MismatchError: ['tmpbAE3za'] matches Contains('tmpbAE3za')` 09:54:45 why this happens and how do i resolve it? 09:55:21 viks_: do you have full traceback 09:57:12 let me check quickly... 09:57:44 and also what test is this 09:57:58 anyways we can discuss that after office hour also 09:58:13 anything else ? any critical review 09:58:36 ok 09:59:32 let's close it then 09:59:42 thanks everyone fro joining 09:59:46 gmann: thanks! 09:59:48 #endmeeting