Thursday, 2018-11-01

*** aojea has quit IRC00:00
*** markvoelker has quit IRC00:01
*** brinzhang has joined #openstack-qa00:14
*** slaweq has quit IRC00:15
openstackgerritFelipe Monteiro proposed openstack/patrole master: trivial: Correct base class name in hacking check  https://review.openstack.org/61465500:46
*** cshen has joined #openstack-qa00:50
*** cshen has quit IRC00:54
*** hongbin has joined #openstack-qa01:24
openstackgerritMerged openstack/patrole master: hacking: Add hacking rule for plugin rbac test class names  https://review.openstack.org/61220201:26
openstackgerritinspurericzhang proposed openstack/tempest master: [Trivial Fix] modify spelling error of "resource"  https://review.openstack.org/61466701:46
*** markvoelker has joined #openstack-qa02:03
*** rh-jelabarre has quit IRC02:34
*** markvoelker has quit IRC02:35
*** cshen has joined #openstack-qa02:51
*** cshen has quit IRC02:55
*** dustins has joined #openstack-qa03:15
*** icey has quit IRC03:18
openstackgerritGhanshyam Mann proposed openstack/tempest master: Implement system-scoping in tempest auth clients  https://review.openstack.org/60490903:20
*** icey has joined #openstack-qa03:23
*** dustins has quit IRC03:25
openstackgerritFelipe Monteiro proposed openstack/patrole master: refactor: Rename PluginRbacTest => ExtRbacTest  https://review.openstack.org/61468703:32
*** markvoelker has joined #openstack-qa03:32
openstackgerritFelipe Monteiro proposed openstack/patrole master: refactor: Rename PluginRbacTest => ExtRbacTest  https://review.openstack.org/61468703:33
*** ramishra has joined #openstack-qa03:56
*** markvoelker has quit IRC04:06
*** hongbin has quit IRC04:37
*** cshen has joined #openstack-qa04:51
*** cshen has quit IRC04:56
*** markvoelker has joined #openstack-qa05:02
*** markvoelker has quit IRC05:36
*** agurenko has joined #openstack-qa06:11
*** cshen has joined #openstack-qa06:15
*** agurenko has quit IRC06:20
*** cshen has quit IRC06:21
*** chkumar|off is now known as chandankumar06:21
*** agurenko has joined #openstack-qa06:22
*** markvoelker has joined #openstack-qa06:33
*** cshen has joined #openstack-qa06:43
*** gkadam has joined #openstack-qa06:58
*** brinzhang has quit IRC07:01
*** brinzhang has joined #openstack-qa07:02
*** icey has quit IRC07:04
*** markvoelker has quit IRC07:05
*** cshen has quit IRC07:08
openstackgerritNguyen Phuong An proposed openstack-dev/devstack master: WIP: switching deploy neutron-server from eventlet to uwsgi  https://review.openstack.org/59551307:11
*** icey_ has joined #openstack-qa07:12
*** cshen has joined #openstack-qa07:14
*** icey_ is now known as icey07:14
*** cshen has quit IRC07:19
*** cshen has joined #openstack-qa07:34
*** cshen has quit IRC07:39
*** pcaruana|elisa| has joined #openstack-qa07:40
*** aojea has joined #openstack-qa07:41
*** ramishra has quit IRC07:45
*** ramishra has joined #openstack-qa07:46
*** slaweq has joined #openstack-qa07:59
*** pcaruana|elisa| has quit IRC07:59
*** markvoelker has joined #openstack-qa08:03
*** pcaruana has joined #openstack-qa08:05
*** cshen has joined #openstack-qa08:06
*** shardy has joined #openstack-qa08:08
*** shardy_ has joined #openstack-qa08:08
*** shardy_ has quit IRC08:10
*** shardy_ has joined #openstack-qa08:11
*** aojea has quit IRC08:11
*** slaweq has quit IRC08:18
*** markvoelker has quit IRC08:36
*** cshen has quit IRC08:38
*** aojea has joined #openstack-qa08:46
*** cshen has joined #openstack-qa08:48
*** aojea has quit IRC08:59
*** aojea has joined #openstack-qa09:00
gmannQA office hour time09:01
gmann#startmeeting qa09:02
openstackMeeting started Thu Nov  1 09:02:06 2018 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.09:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.09:02
*** openstack changes topic to " (Meeting topic: qa)"09:02
openstackThe meeting name has been set to 'qa'09:02
gmannwho all here today09:02
gmannPING LIST- gmann, andreaf, masayukig, chandankumar, felipemonteiro, frickler, mbindlish09:02
gmannseems like no one here.09:07
gmanni will be around for any discussion.09:07
*** aojea has quit IRC09:13
frickleroh, dst has ended, I need to update my mental calendar ;)09:19
fricklerso if nothing else is on the table, we could shortly discuss how to continue with the bionic migration09:21
gmannfrickler: not ended :) i kept it open09:21
gmannfrickler: yeah09:21
gmanni have not checked the patch result09:21
fricklermy idea that we should merge https://review.openstack.org/610977 , the basic devstack patch, so that other projects can depend on that09:21
fricklerI also did some fixes for devstack-plugin-ceph that could be reviewed https://review.openstack.org/61159409:22
fricklerthey pass the corresponding bionic checks in https://review.openstack.org/#/c/611570/09:22
fricklerI'll update https://etherpad.openstack.org/p/devstack-bionic with that09:23
gmannfrickler: how you want to go 1. provide the new jobs and ask project to switch their job with new base job, or 2. test base job with bionic (610977 ) and ask project to alert that existing devstack base jobs are working fine on bionic and we are going to migrate the base job to Bionic so tell us if any risk09:25
fricklerthe main open question for me is whether we should change the main devstack job that most other jobs inherit from at some point soon, or whether we should wait for most projects to have changed to running devstack-bionic first. the latter option would probably delay the switch to the beginning of the next cycle09:26
fricklergmann: yeah, that's more or less what I was typing in parallel ;)09:26
gmannyea but first one will take lot of effort and time to switch09:26
fricklerI think 1. is the safer option09:26
*** masayukig[m] has joined #openstack-qa09:27
fricklerprobably I should write up a mail about it and ask for wider feedback on the ml09:27
gmannit is safer but only concern is it will need every project job to change.09:27
gmannfrickler: +1, that will be better way.09:28
gmannbecause that goes with tempest base job also tempest-full etc09:28
fricklerI also more or less decided not to touch the legacy jobs, i.e. those autoconverted from zuul v209:29
gmannmake sense. most of legacy job on tempest, nova is migrated but not the same case for all the projetcs09:30
fricklerlooking at nova and cinder I found that all jobs are either based on tempest or are legacy, so nothing I could update there directly. so either we just switch tempest or we introduce tempest-bionic-* jobs and use them in nova+cinder09:32
*** markvoelker has joined #openstack-qa09:33
gmanni prefer to migrate the tempest-full but after testing the project gate. but again if majority agree on that09:33
gmannasking on ML is better way.09:34
gmanndo you know how it was done in past? infra did migrate existign jobs or did migration by providing the 2 set of jobs09:34
fricklerI don't remember what was done to migrate from trusty to xenial, I also wasn't infra-root back then09:36
gmannok, anyways let's check both approach on ML and we can proceed.09:36
gmanni can push few project specific patch also for reference and will add in etherpad09:37
fricklero.k., I'll set up a draft on the etherpad and let you crosscheck before sending it out09:37
gmann#action frickler to send ML to check appropriate approach   for job migration to Bionic09:38
gmannfrickler: +109:38
fricklerclarkb: ianw: maybe you also have some opinion on this that we should take into account ^^09:38
frickleror any other devstack reviewers for that matter09:39
*** e0ne has joined #openstack-qa09:43
gmannfrickler: for legacy one, when project start migrating them to zuulv3 they should go on bionic based job (irrespective of either approach we decide)09:52
fricklergmann: yes, I should mention that in the mail, too. but again it would the good to have the devstack patch merged for that09:53
gmann+109:53
gmannbut devstack patch we can merge based on approach we select. if we go for second approach then we do not need to merge this right09:53
fricklerI was also just thinking whether for devstack-plugin-ceph we should keep jobs running for both xenial and bionic for the time being. I would amend https://review.openstack.org/611570 accordingly09:54
fricklergmann: I think we still should merge https://review.openstack.org/610977 first and then have a second patch on top of it that switches the devstack job to bionic and creates a devstack-xenial "legacy v3" job09:55
fricklergmann: I can set up the latter for demonstration how it would look like09:55
gmannhumm, but we end up undo the  changes (other than openstack-two-node-bionic) in 611570 if we go for second approach09:56
gmannfrickler: also what is benefit of having both job, xenial and bionic ?09:57
gmannfrickler: we can use the unmerged patch also for demonstration. But if you really want to show the merged one then we can merge and undo if we go for second approach.09:58
fricklergmann: maybe it turns out that a project needs more time to migrate to bionic, so we could offer them a fallback09:59
gmannfrickler: sure, so that will be our question in ML and then we can merge accordingly.09:59
gmannfrickler: i think i mixed 610977 and 611570.10:00
fricklergmann: o.k., so lets wait for feedback on the ml first10:00
* frickler needs to go for another meeting, will check back later10:00
gmannfrickler: 611570 lgtm to merge and we can merge that if you can split 610977 with doing openstack-two-node-bionic as alone and other changes as separate10:00
gmannfrickler: i see 611570 is only single node. i am reviewing that now10:02
gmann#endmeeting10:04
*** openstack changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/"10:04
openstackMeeting ended Thu Nov  1 10:04:28 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)10:04
openstackMinutes:        http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-11-01-09.02.html10:04
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-11-01-09.02.txt10:04
openstackLog:            http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-11-01-09.02.log.html10:04
*** markvoelker has quit IRC10:07
gmannfrickler: 611570 lgtm but you need to remove the Depends-On10:09
*** chandankumar has quit IRC10:09
*** chandankumar has joined #openstack-qa10:30
*** e0ne has quit IRC10:32
*** e0ne has joined #openstack-qa10:36
*** agurenko has quit IRC10:37
*** agurenko has joined #openstack-qa10:39
*** dave-mccowan has joined #openstack-qa10:46
fricklergmann: I think I'd still like to wait with merging 611570, since if we change tempest-full-* to run on bionic soon, we will not need it at all10:47
*** markvoelker has joined #openstack-qa11:04
*** pcaruana has quit IRC11:05
*** markvoelker has quit IRC11:36
*** gkadam has quit IRC11:46
*** gkadam has joined #openstack-qa11:50
*** cshen has quit IRC11:50
*** cshen has joined #openstack-qa11:52
*** pcaruana has joined #openstack-qa11:52
openstackgerritMerged openstack/tempest master: [Trivial Fix] modify spelling error of "resource"  https://review.openstack.org/61466711:56
openstackgerritMerged openstack/tempest master: Update REVIEWING docs with fast-track approval process  https://review.openstack.org/60298111:56
*** gkadam_ has joined #openstack-qa12:04
*** gkadam has quit IRC12:07
*** rh-jelabarre has joined #openstack-qa12:15
*** raildo has joined #openstack-qa12:17
*** markvoelker has joined #openstack-qa12:31
*** brinzhang has quit IRC12:40
fungifrickler: gmann: for trusty->xenial transition we set up new non-voting xenial-based jobs and asked projects to switch them to voting and remove the trusty-based jobs once they were passing for their projects. as you can imagine, some projects were on the ball and others procrastinated or prioritized other work so that we eventually released while different projects were testing on different platforms.12:40
fungiit was suboptimal and led to lots of breakage because the projects testing on xenial were free to merge changes which caused them to break integration testing for projects still stuck on trusty12:40
fungiin contrast, for the precise->trusty transition we set up non-voting trusty-based jobs and gave projects multiple warnings/reminders that we were going to switch them all over to voting on trusty on a certain deadline. projects who heeded that warning and got their trusty jobs working ahead of the deadline fared well, others who ignored the warning found that after the deadline they couldn't merge12:43
fungianything until they got their code working on trusty, which forced their hand12:43
fungiobviously both approaches have positive and negative aspects12:44
fricklerso we have prior art for both options, which is good on one hand, but doesn't help that much with choosing one of them ;)12:49
*** e0ne has quit IRC12:55
*** yamamoto has quit IRC12:56
*** gkadam_ has quit IRC12:57
*** cshen has quit IRC13:01
*** yamamoto has joined #openstack-qa13:14
*** noama has joined #openstack-qa13:19
*** cshen has joined #openstack-qa13:24
lbragstadgmann http://logs.openstack.org/09/604909/10/check/tempest-multinode-full/8c67f1a/job-output.txt.gz#_2018-11-01_04_57_30_087344 doesn't look related to the change, i assume it's transient?13:27
*** awaugama has joined #openstack-qa13:28
*** mriedem has joined #openstack-qa13:28
*** cshen has quit IRC13:29
fricklerlbragstad: that message is not really a fatal error, rather a cosmetic warning. the failure for that job is the tempest error earlier http://logs.openstack.org/09/604909/10/check/tempest-multinode-full/8c67f1a/job-output.txt.gz#_2018-11-01_04_53_03_55452013:32
fricklerlbragstad: and the volume snapshot tests sadly are a bit unstable indeed, would be really nice if cinder folks could improve that13:34
lbragstadoh nice13:34
*** dustins has joined #openstack-qa13:34
lbragstadwell - not nice per se, but nice to know the real cause :)13:34
lbragstadthanks frickler13:34
*** cshen has joined #openstack-qa13:40
*** e0ne has joined #openstack-qa13:40
gmannfungi: thanks, those are good information and helpful to decide the strategy13:41
gmannfrickler: i think we might face same issue in option1. let's see on ML how project are more comfortable with.13:43
gmannfrickler: as we are not going to migrate the legacy job, we should be good to confirm the testing well before we merge the base job migration13:46
*** cshen has quit IRC13:48
smcginnisfrickler: Which volume snapshot tests?13:53
fricklersmcginnis: see the link above for an example. I don't have exact data, but my experience in that last months is that when there are sporadic failures on tempest-full-based jobs, most of them are volume-related and mostly involving backups and/or snapshots13:57
smcginnisOK, I wasn't aware of anything. I'll try to dig into that a little later.13:59
*** ramishra has quit IRC14:02
fricklersmcginnis: I just went through five latest gate failures I could find, skipping the known current neutron regression14:07
fricklersmcginnis: three out of five seem to be on cinder: https://etherpad.openstack.org/p/gate-failures14:07
smcginnisfrickler: Thanks, that will help. I'll investigate those.14:08
fricklersmcginnis: thanks. I was mostly assuming that those were known issues14:09
*** e0ne_ has joined #openstack-qa14:09
*** e0ne has quit IRC14:10
*** gkadam has joined #openstack-qa14:13
*** Luzi has joined #openstack-qa14:27
openstackgerritFelipe Monteiro proposed openstack/patrole master: trivial: Correct base class name in hacking check  https://review.openstack.org/61465514:32
*** cshen has joined #openstack-qa14:33
openstackgerritFelipe Monteiro proposed openstack/patrole master: trivial: Correct base class name in hacking check  https://review.openstack.org/61465514:35
*** mvkr has quit IRC14:40
*** Luzi has quit IRC14:44
*** gkadam has quit IRC15:09
*** mvkr has joined #openstack-qa15:11
*** e0ne_ has quit IRC15:34
*** e0ne has joined #openstack-qa15:34
openstackgerritFelipe Monteiro proposed openstack/patrole master: trivial: Add hacking checks to irrelevant-files in .zuul.yaml  https://review.openstack.org/61479215:36
openstackgerritFelipe Monteiro proposed openstack/patrole master: trivial: Add hacking checks to irrelevant-files in .zuul.yaml  https://review.openstack.org/61479215:37
clarkbgmann: frickler yup basically what fungi said15:55
clarkbiirc when precise -> trusty happened we tested things upfront and most stuff was working so we just switched. What happened with trusty -> xenial was a lot of things did not work when we tested them and debugging that was well ebyond the scope of the infra team so we pushed it down into individual projects15:55
clarkbthis wasn't super surprising because xenial changed a lot of stuff (systemd etc)15:56
clarkbbionic should be less drastic of a change so hopefully the migration is more smooth15:56
fungii'm still a favor of the forcing a coordinated change15:57
clarkbfungi: ya I think xenial -> bionic being less drastic means we can force a coordinated change with less fallout than what we ran into with xenial. I'm in favor15:57
fungimake the jobs available, tell projects to check that things are working, and schedule a date to make the switch15:58
fungidon't give them an option of opting out, or else it will drag on indefinitely15:58
*** cshen has quit IRC16:25
*** dustins has quit IRC16:25
*** e0ne has quit IRC16:26
*** slaweq has joined #openstack-qa16:29
*** cshen has joined #openstack-qa16:41
*** cshen has quit IRC16:47
*** sshnaidm|ruck is now known as sshnaidm|afk16:48
*** cshen has joined #openstack-qa16:51
*** cshen has quit IRC16:56
*** slaweq has quit IRC17:27
*** e0ne has joined #openstack-qa17:31
*** e0ne has quit IRC17:47
*** cshen has joined #openstack-qa17:48
*** yamamoto has quit IRC17:49
*** e0ne has joined #openstack-qa17:59
*** sshnaidm|afk is now known as sshnaidm|off18:00
*** e0ne has quit IRC18:02
*** e0ne has joined #openstack-qa18:05
*** e0ne has quit IRC18:07
*** yamamoto has joined #openstack-qa18:17
*** yamamoto has quit IRC18:17
*** mvkr has quit IRC18:47
*** yamamoto has joined #openstack-qa18:53
*** yamamoto has quit IRC19:00
*** pcaruana has quit IRC19:05
openstackgerritMykola Yakovliev proposed openstack/patrole master: RequirementsAuthority multi role support enhancement  https://review.openstack.org/61438619:42
openstackgerritArtom Lifshitz proposed openstack/tempest master: Deprecate available filters in favor of enabled  https://review.openstack.org/57020719:42
*** mvkr has joined #openstack-qa19:51
*** lifeless has joined #openstack-qa19:56
lifelessmtreinish: I'm fine with just removing the Makefile bits that refer to the install etc of Python code; or perhaps just invoke setup.py from it19:56
lifelessmtreinish: does that answer your q ?19:57
*** cshen has quit IRC19:57
*** agurenko has quit IRC19:57
mtreinishlifeless: yeah that does, thanks19:59
mtreinishI'll have to brush up on my automake though, it's been a while since I used it :)20:00
*** dustins has joined #openstack-qa20:05
lifeless:)20:06
lifelessmetoo20:06
*** dustins has quit IRC20:06
*** dustins has joined #openstack-qa20:06
*** dustins has quit IRC20:07
*** dustins has joined #openstack-qa20:08
*** cshen has joined #openstack-qa20:09
*** e0ne has joined #openstack-qa20:11
openstackgerritMykola Yakovliev proposed openstack/tempest master: Narrow random IP selection to skip IPs taken by Contrail  https://review.openstack.org/61486620:27
*** e0ne has quit IRC20:28
*** dave-mccowan has quit IRC20:32
*** slaweq has joined #openstack-qa20:50
*** awaugama has quit IRC21:19
*** raildo has quit IRC21:25
*** dustins has quit IRC21:31
*** slaweq has quit IRC21:36
*** mriedem has quit IRC22:23
*** cshen has quit IRC22:56
*** yamamoto has joined #openstack-qa22:57
*** yamamoto has quit IRC23:02
*** noama has quit IRC23:14
*** mvkr has quit IRC23:22
*** mvkr has joined #openstack-qa23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!