| *** ociuhandu has joined #openstack-meeting | 00:10 | |
| *** ociuhandu has quit IRC | 00:15 | |
| *** mattw4 has quit IRC | 00:23 | |
| *** macz has quit IRC | 00:39 | |
| *** gyee has quit IRC | 00:42 | |
| *** markvoelker has joined #openstack-meeting | 00:46 | |
| *** markvoelker has quit IRC | 00:48 | |
| *** markvoelker has joined #openstack-meeting | 00:49 | |
| *** diablo_rojo has quit IRC | 00:57 | |
| *** markvoelker has quit IRC | 00:59 | |
| *** markvoelker has joined #openstack-meeting | 00:59 | |
| *** markvoelker has quit IRC | 01:04 | |
| *** markvoelker has joined #openstack-meeting | 01:07 | |
| *** senrique_ has joined #openstack-meeting | 01:14 | |
| *** yamamoto has joined #openstack-meeting | 01:15 | |
| *** markvoelker has quit IRC | 01:17 | |
| *** markvoelker has joined #openstack-meeting | 01:18 | |
| *** bobh has joined #openstack-meeting | 01:19 | |
| *** njohnston_ has quit IRC | 01:20 | |
| *** markvoelker has quit IRC | 01:23 | |
| *** hongbin has joined #openstack-meeting | 01:35 | |
| *** rfolco has quit IRC | 01:41 | |
| *** mhen has quit IRC | 01:43 | |
| *** markvoelker has joined #openstack-meeting | 01:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:48 | |
| *** senrique_ has quit IRC | 02:01 | |
| *** baojg has joined #openstack-meeting | 02:02 | |
| *** apetrich has quit IRC | 02:10 | |
| *** yamamoto has quit IRC | 02:19 | |
| *** markvoelker has quit IRC | 02:20 | |
| *** markvoelker has joined #openstack-meeting | 02:22 | |
| *** bobh has quit IRC | 02:23 | |
| *** lseki has quit IRC | 02:28 | |
| *** jamesmcarthur has quit IRC | 02:30 | |
| *** larainema has joined #openstack-meeting | 02:33 | |
| *** macz has joined #openstack-meeting | 02:36 | |
| *** rbudden has joined #openstack-meeting | 02:36 | |
| *** macz has quit IRC | 02:41 | |
| *** yamamoto has joined #openstack-meeting | 03:03 | |
| *** igordc has quit IRC | 03:31 | |
| *** armax has quit IRC | 03:41 | |
| *** hongbin has quit IRC | 03:46 | |
| *** ykatabam has joined #openstack-meeting | 03:49 | |
| *** tpatil has joined #openstack-meeting | 03:56 | |
| *** shilpasd has joined #openstack-meeting | 03:56 | |
| samP | #startmeeting masakari | 04:01 |
|---|---|---|
| openstack | Meeting started Tue Sep 10 04:01:29 2019 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:01 |
| *** openstack changes topic to " (Meeting topic: masakari)" | 04:01 | |
| openstack | The meeting name has been set to 'masakari' | 04:01 |
| samP | Hi all for masakari | 04:01 |
| tpatil | Hi | 04:01 |
| shilpasd | Hi all | 04:01 |
| samP | tpatil: Hi | 04:01 |
| samP | shilpasd: Hi | 04:01 |
| samP | #topic Critical bugs and patches | 04:02 |
| *** openstack changes topic to "Critical bugs and patches (Meeting topic: masakari)" | 04:02 | |
| samP | Any critical bugs or patches need to discuss here? | 04:02 |
| shilpasd | observed zuul failure because of novaclient.exceptions.EndpointNotFound removal | 04:03 |
| shilpasd | on patch https://review.opendev.org/#/c/673526/ | 04:03 |
| shilpasd | this patch is for https://bugs.launchpad.net/horizon/+bug/1838417 | 04:04 |
| openstack | Launchpad bug 1838417 in masakari "Notification related functional tests fails randomly due to KeyError" [Undecided,In progress] - Assigned to Shilpa Devharakar (shilpasd) | 04:04 |
| shilpasd | observed masakri refers novaclient version 9.1.0 and we have 15.0.0 running as latest | 04:05 |
| *** nitinuikey has joined #openstack-meeting | 04:05 | |
| tpatil | in requirements.txt, novaclient >=9.1.0 | 04:06 |
| samP | shilpasd: that novaclient version 9.1.0 is set as a requirement for masakari? | 04:06 |
| samP | tpatil: thanks | 04:06 |
| tpatil | so the question is do we need to upgrade the novaclient lower_constraints to 15.0.0 | 04:08 |
| shilpasd | tpatil: thanks | 04:08 |
| tpatil | looking at the code, there is no need to do that as it will always install the newer version 15.0.0 and even if 9.1.0 is installed, it won't cause issue as we are now using NotFound exception instead of EndpointNotFound | 04:09 |
| tpatil | NotFound exception is present in 9.1.0 | 04:09 |
| samP | tpatil: got it. then no problem. | 04:11 |
| tpatil | samP: OK, thanks | 04:11 |
| tpatil | New bug : https://bugs.launchpad.net/masakari/+bug/1843035 | 04:11 |
| openstack | Launchpad bug 1843035 in masakari "masakari sets node as "under maintenance" and does not evacuate" [Undecided,New] | 04:11 |
| samP | tpatil: thanks. I wanted to bring this up | 04:11 |
| samP | tpatil: can you please reproduce this issue? | 04:13 |
| tpatil | first let me understand the steps | 04:14 |
| tpatil | after nova-compute service and pacemaker remote is restarted, the processes are kill using -9 | 04:15 |
| tpatil | when the node comes up again, means user is reboot the compute node? | 04:15 |
| tpatil | s/reboot/rebooting | 04:15 |
| tpatil | I have posted this comment on the LP bug | 04:17 |
| samP | it seems like user/operator bring it up manually | 04:18 |
| samP | and, I can not access to the log files links in the LP bug | 04:19 |
| tpatil | and after that, operator will set on_maintenance flag to False | 04:19 |
| tpatil | If the on_maintenance flag is set to True, then evacuated won't be performed. | 04:20 |
| tpatil | becoz of HostOnMaintenanceError | 04:21 |
| tpatil | we have added this business rule | 04:21 |
| samP | tpatil: correct. | 04:22 |
| tpatil | and I think same error masakarihostmonitor must be logging as well as it's not able to send the notification successfully. | 04:22 |
| samP | tpatil: why masakarihostmonitor? | 04:23 |
| samP | you mean the masakarihostmonitor process in the on_maintenance node? | 04:24 |
| tpatil | for this bug, I think bug reporter is imitating the scenario but in real case, hostmonitor will log this error from another compute node | 04:25 |
| tpatil | it all depends on pacemaker cluster node status | 04:26 |
| *** rbudden has quit IRC | 04:27 | |
| *** rbudden has joined #openstack-meeting | 04:27 | |
| *** rbudden has joined #openstack-meeting | 04:27 | |
| *** rbudden has joined #openstack-meeting | 04:28 | |
| samP | Anyway, not evacuating in the on-maintenance mode it not a bug. That is how it works. | 04:29 |
| *** ykatabam has quit IRC | 04:29 | |
| *** rbudden has quit IRC | 04:29 | |
| tpatil | Correct | 04:29 |
| samP | The question is whether repoter wants to change it or not. | 04:29 |
| tpatil | I also want to check the masakari logs | 04:30 |
| samP | Problem is, we don't have access to those | 04:30 |
| *** ociuhandu has joined #openstack-meeting | 04:30 | |
| *** ykatabam has joined #openstack-meeting | 04:31 | |
| samP | I left a comment for that | 04:32 |
| tpatil | ok, thanks | 04:32 |
| *** ociuhandu has quit IRC | 04:34 | |
| samP | Any other issues? | 04:35 |
| tpatil | No | 04:35 |
| samP | thanks | 04:36 |
| samP | #topic Train work items | 04:36 |
| *** openstack changes topic to "Train work items (Meeting topic: masakari)" | 04:36 | |
| samP | please share if you hae any update on train work items | 04:36 |
| *** Luzi has joined #openstack-meeting | 04:36 | |
| *** macz has joined #openstack-meeting | 04:37 | |
| shilpasd | regarding masakari documentation, internal review implementation is in progress, will upload patch to community gerrit today | 04:37 |
| samP | shilpasd: thanks | 04:37 |
| tpatil | shilpasd: what about masakarimonitors? | 04:38 |
| shilpasd | will try to upload for monitors by tomorrow | 04:39 |
| shilpasd | to community gerrit | 04:39 |
| tpatil | shilpasd: Ok, Thanks | 04:40 |
| *** macz has quit IRC | 04:41 | |
| samP | shilpasd: tpatil: thanks | 04:43 |
| *** igordc has joined #openstack-meeting | 04:44 | |
| samP | Any other updates? | 04:44 |
| samP | if not we could finish todays's meeting | 04:44 |
| tpatil | No other updates from my side | 04:45 |
| samP | tpatil: Thanks | 04:45 |
| samP | OK then, let's finish today's meeting. | 04:45 |
| shilpasd | thanks all | 04:45 |
| samP | Thanks all | 04:45 |
| samP | #endmeeting | 04:46 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:46 | |
| openstack | Meeting ended Tue Sep 10 04:46:10 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:46 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-09-10-04.01.html | 04:46 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-09-10-04.01.txt | 04:46 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-09-10-04.01.log.html | 04:46 |
| *** tpatil has quit IRC | 04:47 | |
| *** markvoelker has quit IRC | 04:48 | |
| *** shilpasd has quit IRC | 04:59 | |
| *** ricolin has joined #openstack-meeting | 05:00 | |
| *** dkushwaha has joined #openstack-meeting | 05:04 | |
| *** markvoelker has joined #openstack-meeting | 05:26 | |
| *** markvoelker has quit IRC | 05:30 | |
| *** ralonsoh has joined #openstack-meeting | 05:38 | |
| *** pots has quit IRC | 05:42 | |
| *** links has joined #openstack-meeting | 05:47 | |
| *** browny has joined #openstack-meeting | 06:03 | |
| *** shubham_potale has joined #openstack-meeting | 06:12 | |
| *** nitinuikey has quit IRC | 06:14 | |
| *** dklyle has quit IRC | 06:20 | |
| *** dklyle has joined #openstack-meeting | 06:21 | |
| *** kopecmartin|off is now known as kopecmartin | 06:26 | |
| *** jawad_axd has joined #openstack-meeting | 06:29 | |
| *** slaweq has joined #openstack-meeting | 06:41 | |
| *** shubham_potale has quit IRC | 06:48 | |
| *** shubham_potale has joined #openstack-meeting | 06:55 | |
| *** igordc has quit IRC | 07:00 | |
| *** tesseract has joined #openstack-meeting | 07:05 | |
| *** ykatabam has quit IRC | 07:05 | |
| *** ykatabam has joined #openstack-meeting | 07:06 | |
| *** ykatabam has quit IRC | 07:06 | |
| *** rcernin has quit IRC | 07:09 | |
| *** ociuhandu has joined #openstack-meeting | 07:14 | |
| *** ociuhandu has quit IRC | 07:21 | |
| *** yamamoto has quit IRC | 07:22 | |
| *** apetrich has joined #openstack-meeting | 07:24 | |
| *** yamamoto has joined #openstack-meeting | 07:30 | |
| *** tssurya has joined #openstack-meeting | 07:31 | |
| *** keiko-k has joined #openstack-meeting | 07:33 | |
| *** yamamoto has quit IRC | 07:34 | |
| *** apetrich has quit IRC | 07:39 | |
| *** macz has joined #openstack-meeting | 07:39 | |
| *** apetrich has joined #openstack-meeting | 07:40 | |
| *** tpatil has joined #openstack-meeting | 07:42 | |
| *** macz has quit IRC | 07:43 | |
| *** apetrich has quit IRC | 07:45 | |
| *** trident has quit IRC | 07:50 | |
| *** apetrich has joined #openstack-meeting | 07:52 | |
| *** lpetrut has joined #openstack-meeting | 07:55 | |
| *** trident has joined #openstack-meeting | 08:01 | |
| dkushwaha | #startmeeting tacker | 08:02 |
| openstack | Meeting started Tue Sep 10 08:02:43 2019 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:02 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:02 | |
| openstack | The meeting name has been set to 'tacker' | 08:02 |
| dkushwaha | #topic Roll Call | 08:02 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:02 | |
| *** keiko-k has quit IRC | 08:03 | |
| tpatil | Hi | 08:03 |
| hyunsikyang | Hi all | 08:03 |
| *** shubham_potale91 has joined #openstack-meeting | 08:04 | |
| *** shubham_potale91 has left #openstack-meeting | 08:04 | |
| *** shubham_potale has quit IRC | 08:05 | |
| dkushwaha | hello all | 08:05 |
| *** keiko-k has joined #openstack-meeting | 08:05 | |
| hyunsikyang | Hi dkushwaha | 08:05 |
| keiko-k | Hello | 08:05 |
| *** joxyuki has joined #openstack-meeting | 08:05 | |
| joxyuki | hi | 08:06 |
| *** e0ne has joined #openstack-meeting | 08:06 | |
| dkushwaha | #chair joxyuki | 08:06 |
| openstack | Current chairs: dkushwaha joxyuki | 08:06 |
| *** priteau has joined #openstack-meeting | 08:07 | |
| dkushwaha | #topic announcement | 08:07 |
| *** openstack changes topic to "announcement (Meeting topic: tacker)" | 08:07 | |
| *** shubham_potale has joined #openstack-meeting | 08:07 | |
| dkushwaha | We have to release client libs code freeze is in this week, so we needs to merge client code soon | 08:08 |
| dkushwaha | #topic BP | 08:09 |
| *** openstack changes topic to "BP (Meeting topic: tacker)" | 08:09 | |
| *** nitinuikey has joined #openstack-meeting | 08:09 | |
| dkushwaha | tpatil, any update from ur side on VNF package? | 08:09 |
| tpatil | dkushwaha: you have given one review comment on python-tackerclient patch: https://review.opendev.org/#/c/679956/2/tackerclient/osc/v1/vnfpkgm/vnf_package.py@54 | 08:09 |
| tpatil | as per ETSI specs, tenant_id or project_id cannot be passed in the request body when you create a VNF package | 08:10 |
| tpatil | we are getting the project_id that is available in the tacker context and setting it during creation of vnf package in tacker-api service | 08:11 |
| *** keiko-k has quit IRC | 08:12 | |
| dkushwaha | tpatil, not sure why we can passe it. This way we may loose multi-tenancy | 08:12 |
| *** nnsingh has joined #openstack-meeting | 08:12 | |
| dkushwaha | IMO, its beeter to get in as additional params | 08:13 |
| tpatil | with tacker context, multi-tenancy will be retain | 08:13 |
| *** keiko-k has joined #openstack-meeting | 08:13 | |
| tpatil | becoz it all works using token, when you get a token you need to specify username, password and project name | 08:13 |
| *** keiko-k has quit IRC | 08:14 | |
| tpatil | In tacker case, endpoint doesn't include tenant_id, but in other projects it's there. | 08:15 |
| *** keiko-k has joined #openstack-meeting | 08:15 | |
| dkushwaha | tpatil, ok, lets go with current way, we needs to check it again and we may keep it as further AI | 08:15 |
| hyunsikyang | I will comeback soon | 08:16 |
| tpatil | dkushwaha: Sure, Thanks | 08:16 |
| dkushwaha | rest parts looks fine to me, and just reviewing https://review.opendev.org/#/c/679958/ | 08:17 |
| tpatil | dkushwaha: let me confirm, so there is no need to add tenant_id for this release, correct? | 08:17 |
| dkushwaha | tpatil, IMO we need to add it | 08:18 |
| dkushwaha | but might be we can check it later | 08:18 |
| dkushwaha | yea, i mean not needed in this release | 08:19 |
| tpatil | dkushwaha: Understood, Thanks | 08:19 |
| *** ociuhandu has joined #openstack-meeting | 08:20 | |
| dkushwaha | joxyuki, please help to review https://review.opendev.org/#/q/topic:bp/tosca-csar-mgmt-driver+project:openstack/python-tackerclient | 08:20 |
| dkushwaha | so that we can get it in soon | 08:21 |
| tpatil | dkushwaha: Talking about tosca-parser, we have got two +2 but workflow is not yet set. | 08:21 |
| dkushwaha | tpatil, yea i seen it, i will ask them to get it in | 08:22 |
| tpatil | dkushwaha: Thanks, some of the unit tests are failing becoz it depends on the tosca-parser changes | 08:23 |
| *** nnsingh46 has joined #openstack-meeting | 08:23 | |
| *** panda|rover has quit IRC | 08:23 | |
| tpatil | #link : https://review.opendev.org/#/c/675600/ | 08:23 |
| *** shubham_potale34 has joined #openstack-meeting | 08:24 | |
| *** shubham_potale34 has quit IRC | 08:24 | |
| *** panda has joined #openstack-meeting | 08:24 | |
| dkushwaha | #topic Open Discussion | 08:25 |
| *** openstack changes topic to "Open Discussion (Meeting topic: tacker)" | 08:25 | |
| *** ociuhandu has quit IRC | 08:25 | |
| *** shubham_potale48 has joined #openstack-meeting | 08:25 | |
| *** nnsingh has quit IRC | 08:26 | |
| *** ociuhandu has joined #openstack-meeting | 08:26 | |
| dkushwaha | tpatil, ok, lets wait to merge tosca patch. | 08:26 |
| *** shubham_potale30 has joined #openstack-meeting | 08:26 | |
| *** shubham_potale30 has left #openstack-meeting | 08:26 | |
| *** shubham_potale has quit IRC | 08:26 | |
| dkushwaha | I do not have other topics to discuss now | 08:27 |
| hyunsikyang | I have a one question:) | 08:27 |
| hyunsikyang | Anyway, we implement tacker-fenix integration. So we uploaded it. https://review.opendev.org/#/c/681157/ | 08:28 |
| hyunsikyang | as a WIP. | 08:28 |
| dkushwaha | hyunsikyang, thanks for update. | 08:28 |
| hyunsikyang | But, I just want to ask your guys about alarm url. | 08:29 |
| dkushwaha | hyunsikyang, please go ahead your question | 08:29 |
| hyunsikyang | we implemented it to create alarm url for each VDU. | 08:29 |
| hyunsikyang | At the first time, we just think that VNF maintenance happen by each VNF unit. | 08:30 |
| *** ociuhandu has quit IRC | 08:30 | |
| *** ociuhandu has joined #openstack-meeting | 08:30 | |
| hyunsikyang | but, IMO, when we think about multi VDU in one VNF, it should manage for each VDU. | 08:30 |
| *** shubham_potale has joined #openstack-meeting | 08:31 | |
| hyunsikyang | What your guys think about it? | 08:31 |
| dkushwaha | hyunsikyang, I think maintenance work will be done at VNF level, not for a single instance but for all instances in VNF | 08:34 |
| dkushwaha | hyunsikyang, caould you please explains some use cases where it needed at specific VDUs | 08:35 |
| dkushwaha | ? | 08:35 |
| hyunsikyang | In the ETSI standard, one of the example is vEPC for VNF. | 08:36 |
| *** keiko-k has quit IRC | 08:36 | |
| hyunsikyang | It means that each VDU is one of the component of vEPC. To support maintanance for each component, I think each VDU needs maintenance. | 08:37 |
| *** keiko-k has joined #openstack-meeting | 08:37 | |
| hyunsikyang | BUt, we also consider maintenance as a VNF level, too. | 08:37 |
| hyunsikyang | Other question, Do you think multi VDU deployed to different host? | 08:38 |
| hyunsikyang | CAN I THINK VDU AS A vnfc? | 08:39 |
| dkushwaha | hyunsikyang, yes a VNF can multiple VDUs/vnfc | 08:40 |
| joxyuki | for the first question, yes. VDUs can be deployed to different host. | 08:40 |
| *** ociuhandu has quit IRC | 08:40 | |
| hyunsikyang | I think so. | 08:41 |
| *** ociuhandu has joined #openstack-meeting | 08:41 | |
| dkushwaha | hyunsikyang, As per your current spec, we needs to apply same maintenance policies for each instances in VNFs | 08:43 |
| hyunsikyang | what is the mean of each instance? | 08:44 |
| hyunsikyang | only for VNF? | 08:44 |
| *** ociuhandu has quit IRC | 08:44 | |
| dkushwaha | hyunsikyang, i mean the each VDUs | 08:45 |
| dkushwaha | maintenance should be true inside each VDU | 08:45 |
| hyunsikyang | ok | 08:46 |
| hyunsikyang | thanks | 08:46 |
| hyunsikyang | So if we also consider maintenance for VNF level, we will add that function for vnf url | 08:48 |
| hyunsikyang | we will think about it:) | 08:48 |
| hyunsikyang | thanks all | 08:48 |
| dkushwaha | hyunsikyang, +1 | 08:48 |
| dkushwaha | hyunsikyang, JangwonLee, I will be great if you add test cases in your patch. | 08:49 |
| *** yaawang_ has joined #openstack-meeting | 08:49 | |
| *** yaawang has quit IRC | 08:49 | |
| *** nnsingh46 has quit IRC | 08:50 | |
| dkushwaha | Do we have anything else to discuss? otherwise we can close this meeting | 08:50 |
| dkushwaha | Thanks Folks | 08:52 |
| dkushwaha | Closing this meeting | 08:52 |
| dkushwaha | #endmeeting | 08:52 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:52 | |
| openstack | Meeting ended Tue Sep 10 08:52:42 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:52 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-10-08.02.html | 08:52 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-10-08.02.txt | 08:52 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-09-10-08.02.log.html | 08:52 |
| *** keiko-k has quit IRC | 08:54 | |
| *** tpatil has quit IRC | 08:54 | |
| *** yamamoto has joined #openstack-meeting | 08:56 | |
| *** ykatabam has joined #openstack-meeting | 09:08 | |
| *** ykatabam has quit IRC | 09:13 | |
| *** rfolco has joined #openstack-meeting | 09:14 | |
| *** yamamoto has quit IRC | 09:17 | |
| *** tetsuro has joined #openstack-meeting | 09:18 | |
| *** ykatabam has joined #openstack-meeting | 09:20 | |
| *** yaawang_ has quit IRC | 09:33 | |
| *** yaawang has joined #openstack-meeting | 09:33 | |
| *** boxiang has joined #openstack-meeting | 09:35 | |
| *** yaawang has quit IRC | 09:37 | |
| *** yaawang has joined #openstack-meeting | 09:37 | |
| *** rcernin has joined #openstack-meeting | 09:39 | |
| *** yaawang has quit IRC | 09:41 | |
| *** yaawang has joined #openstack-meeting | 09:43 | |
| *** dklyle has quit IRC | 10:03 | |
| *** dklyle has joined #openstack-meeting | 10:04 | |
| *** ykatabam has quit IRC | 10:09 | |
| *** apetrich has quit IRC | 10:10 | |
| *** markvoelker has joined #openstack-meeting | 10:16 | |
| *** tetsuro has quit IRC | 10:17 | |
| *** markvoelker has quit IRC | 10:21 | |
| *** macz has joined #openstack-meeting | 10:25 | |
| *** ykatabam has joined #openstack-meeting | 10:28 | |
| *** macz has quit IRC | 10:30 | |
| *** jawad_axd has quit IRC | 10:40 | |
| *** markvoelker has joined #openstack-meeting | 10:55 | |
| *** ociuhandu has joined #openstack-meeting | 11:00 | |
| *** markvoelker has quit IRC | 11:00 | |
| *** ociuhandu has quit IRC | 11:01 | |
| *** ociuhandu has joined #openstack-meeting | 11:07 | |
| *** larainema has quit IRC | 11:15 | |
| *** nitinuikey has quit IRC | 11:16 | |
| *** ykatabam has left #openstack-meeting | 11:17 | |
| *** jawad_axd has joined #openstack-meeting | 11:20 | |
| *** priteau has quit IRC | 11:38 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:54 | |
| *** raildo has joined #openstack-meeting | 11:55 | |
| *** markvoelker has joined #openstack-meeting | 12:04 | |
| *** jamesmcarthur has quit IRC | 12:08 | |
| *** apetrich has joined #openstack-meeting | 12:12 | |
| *** njohnston has joined #openstack-meeting | 12:13 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:13 | |
| *** jamesmcarthur has quit IRC | 12:24 | |
| *** Lucas_Gray has joined #openstack-meeting | 12:25 | |
| *** macz has joined #openstack-meeting | 12:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:26 | |
| *** jamesmcarthur has quit IRC | 12:29 | |
| *** hyunsikyang__ has joined #openstack-meeting | 12:30 | |
| *** macz has quit IRC | 12:30 | |
| *** Lucas_Gray has quit IRC | 12:32 | |
| *** Wryhder has joined #openstack-meeting | 12:32 | |
| *** Wryhder is now known as Lucas_Gray | 12:33 | |
| *** hyunsikyang has quit IRC | 12:33 | |
| *** apetrich has quit IRC | 12:33 | |
| *** mriedem has joined #openstack-meeting | 12:55 | |
| *** rbudden has joined #openstack-meeting | 12:57 | |
| *** lseki has joined #openstack-meeting | 13:02 | |
| *** macz has joined #openstack-meeting | 13:03 | |
| *** enriquetaso has joined #openstack-meeting | 13:04 | |
| *** macz has quit IRC | 13:07 | |
| *** eharney has joined #openstack-meeting | 13:12 | |
| *** rubasov has quit IRC | 13:21 | |
| *** Luzi has quit IRC | 13:32 | |
| *** bbowen_ has joined #openstack-meeting | 13:35 | |
| *** carloss has joined #openstack-meeting | 13:36 | |
| *** bbowen__ has joined #openstack-meeting | 13:37 | |
| *** bbowen has quit IRC | 13:37 | |
| *** bbowen_ has quit IRC | 13:39 | |
| *** eharney has quit IRC | 13:42 | |
| *** jawad_axd has quit IRC | 13:43 | |
| *** rcernin has quit IRC | 13:45 | |
| *** jawad_axd has joined #openstack-meeting | 13:45 | |
| *** jawad_axd has quit IRC | 13:45 | |
| *** jawad_axd has joined #openstack-meeting | 13:49 | |
| *** jawad_axd has quit IRC | 13:53 | |
| *** tidwellr has joined #openstack-meeting | 13:53 | |
| *** eharney has joined #openstack-meeting | 13:55 | |
| *** rubasov has joined #openstack-meeting | 13:56 | |
| *** mlavalle has joined #openstack-meeting | 13:56 | |
| *** ociuhandu has quit IRC | 13:57 | |
| *** ociuhandu has joined #openstack-meeting | 13:58 | |
| *** lajoskatona has joined #openstack-meeting | 13:59 | |
| *** boden has joined #openstack-meeting | 14:00 | |
| *** shintaro has joined #openstack-meeting | 14:00 | |
| slaweq | #startmeeting networking | 14:00 |
| openstack | Meeting started Tue Sep 10 14:00:30 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| slaweq | hi | 14:00 |
| *** openstack changes topic to " (Meeting topic: networking)" | 14:00 | |
| openstack | The meeting name has been set to 'networking' | 14:00 |
| lajoskatona | Hi | 14:00 |
| rubasov | hi | 14:00 |
| tidwellr | hi | 14:00 |
| mlavalle | o/ | 14:00 |
| ralonsoh | hi | 14:00 |
| njohnston | o/ | 14:01 |
| bcafarel | o/ | 14:01 |
| slaweq | ok, I think we can start | 14:01 |
| slaweq | #topic Announcements | 14:01 |
| *** openstack changes topic to "Announcements (Meeting topic: networking)" | 14:01 | |
| slaweq | T-3 milestone and feature freeze is this week | 14:02 |
| slaweq | #link https://releases.openstack.org/train/schedule.html | 14:02 |
| slaweq | so no new features merged after this week until Train branch will be created | 14:02 |
| *** ociuhandu has quit IRC | 14:03 | |
| amotoki | hi | 14:03 |
| slaweq | It is also week of final release for client libraries | 14:03 |
| slaweq | hi amotoki | 14:03 |
| slaweq | amotoki: so I think we should release final python-neutronclient version for Train this week, right? | 14:04 |
| amotoki | slaweq: yes, I will check it soon | 14:04 |
| slaweq | amotoki: thx a lot | 14:04 |
| slaweq | ok, next announcement | 14:04 |
| slaweq | PTL and TC nominations and (no) elections are done | 14:04 |
| slaweq | http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009072.html | 14:05 |
| slaweq | congrats to our new TC member njohnston :) | 14:05 |
| njohnston | o/ | 14:05 |
| mlavalle | Congratulations to our next PTL, slaweq ! | 14:05 |
| slaweq | and amotoki who is now Horizon PTL :) | 14:05 |
| ralonsoh | njohnston, congrats!! | 14:05 |
| ralonsoh | and amotoki ! | 14:05 |
| njohnston | congrats to all - we have an incredible team of people | 14:05 |
| amotoki | njohnston and slaweq: congrats | 14:05 |
| mlavalle | congrats to njohnston | 14:05 |
| slaweq | and of course Thank You mlavalle for all Your hard work as PTL | 14:05 |
| tidwellr | +1 | 14:06 |
| njohnston | +1000 | 14:06 |
| ralonsoh | +1 | 14:06 |
| amotoki | +1000 :) | 14:06 |
| lajoskatona | +1 | 14:06 |
| mlavalle | all the succeses were thanks to you | 14:06 |
| mlavalle | all | 14:06 |
| mlavalle | and the failures are all mine :-) | 14:06 |
| haleyb | +2 +W | 14:06 |
| slaweq | LOL | 14:06 |
| bcafarel | congrats all new and former "titles" :) | 14:06 |
| haleyb | not about the failures of course | 14:06 |
| mlavalle | LOL | 14:07 |
| slaweq | ok, next one | 14:07 |
| slaweq | Shanghai PTG planning etherpad | 14:07 |
| slaweq | https://etherpad.openstack.org/p/Shanghai-Neutron-Planning | 14:07 |
| slaweq | PTG will be in less than 2 months so please start thinking about topics and add them to etherpad | 14:07 |
| slaweq | and speaking about etherpads | 14:08 |
| slaweq | last week we created brainstorming etherpad for potential forum sessions' topics | 14:08 |
| tidwellr | any thoughts on remote PTG participation? | 14:08 |
| slaweq | https://etherpad.openstack.org/p/neutron-shanghai-forum-brainstorming | 14:08 |
| mlavalle | tidwellr: yes, we are exploring options | 14:08 |
| mlavalle | going back to the forum etherpad | 14:09 |
| slaweq | ok, thx mlavalle | 14:10 |
| mlavalle | slaweq and I added some topics there | 14:10 |
| mlavalle | we have a tight deadline to propose them | 14:10 |
| mlavalle | Sep 20th, I think | 14:10 |
| slaweq | correct | 14:10 |
| mlavalle | so I.d say our internal deadline shoud be next Monday | 14:10 |
| *** moguimar has quit IRC | 14:11 | |
| slaweq | mlavalle++ | 14:11 |
| *** hyunsikyang has joined #openstack-meeting | 14:11 | |
| mlavalle | ay that point we make a final decision and propose the topics | 14:11 |
| slaweq | I was thinking that we can discuss final proposals on team meeting next monday | 14:11 |
| *** brinzhang has quit IRC | 14:11 | |
| mlavalle | so if you have any ideas, this the week to dump them in the etherpad | 14:11 |
| mlavalle | slaweq: yes, let's do that | 14:12 |
| *** brinzhang has joined #openstack-meeting | 14:12 | |
| mlavalle | so I will leave the topic I added to the on demand agenda section | 14:12 |
| *** moguimar has joined #openstack-meeting | 14:12 | |
| mlavalle | we can skip it today | 14:12 |
| mlavalle | since we alreade talked about it | 14:12 |
| slaweq | thx mlavalle | 14:12 |
| slaweq | about ideas, please wrote them to etherpad even if You will not be there or You don't want/can't moderate such session | 14:13 |
| slaweq | :) | 14:13 |
| slaweq | ok, and the last one announcement for today: | 14:13 |
| slaweq | Train PTG summary: http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006408.html (just as a reminder) | 14:13 |
| slaweq | any other announcements from the team? | 14:14 |
| *** hyunsikyang__ has quit IRC | 14:14 | |
| slaweq | ok, lets move on than | 14:15 |
| slaweq | #topic Blueprints | 14:15 |
| *** openstack changes topic to "Blueprints (Meeting topic: networking)" | 14:15 | |
| slaweq | blueprints targeted for T-3 https://launchpad.net/neutron/+milestone/train-3 | 14:15 |
| slaweq | any updates about them? | 14:16 |
| njohnston | No update for ethertype; I hope to do some serious work on it for this week but I am in doubt that it will make Train | 14:16 |
| rubasov | the extraroute stuff is currently held up by rechecks on this: https://review.opendev.org/680980 | 14:17 |
| slaweq | according to extraroute, it looks for me that we are only missing https://review.opendev.org/#/c/670851/ | 14:18 |
| slaweq | is that right? | 14:18 |
| rubasov | reviewers please keep in mind that the whole topic is quite well reviewed but it looks bad (zuul -1s) because of unmerged cross-repo dependencies | 14:18 |
| slaweq | and this can be done when we will bump neutron-lib version in neutron, right? | 14:18 |
| amotoki | rubasov: I think requirements bump can be done in parallel. | 14:18 |
| amotoki | we need both but it is not a blocker except lower-constraints job | 14:19 |
| rubasov | slaweq: and then these: https://review.opendev.org/#/q/status:open+topic:extraroute | 14:19 |
| mlavalle | rubasov: so if we take this as a feature freeze exception, are you willing to continue pushing it? | 14:19 |
| rubasov | mlavalle: absolutely | 14:20 |
| rubasov | thank you | 14:20 |
| slaweq | rubasov: but in this list there is only this one neutron patch which I mentioned | 14:20 |
| slaweq | and python-neutronclient | 14:20 |
| slaweq | other than that, those are patches to heat and OSC | 14:20 |
| rubasov | neutronclient is a dependency for heat | 14:20 |
| rubasov | sdk and asc is more important from neutron perspective | 14:20 |
| rubasov | for cli of course | 14:20 |
| mlavalle | but neutron cleint has already W+, right? | 14:21 |
| rubasov | sdk and osc ^^^ | 14:21 |
| rubasov | mlavalle: yes | 14:21 |
| mlavalle | so if we focus on getting that lib patch | 14:21 |
| mlavalle | plus the neutron patch, we did our bit, coorect? | 14:21 |
| amotoki | osc and neutronclient patches depend on neutron implementation, right? | 14:22 |
| amotoki | s/osc/sdk/ | 14:22 |
| rubasov | ideally: bump+neutron+sdk+osc | 14:22 |
| rubasov | amotoki: yes | 14:22 |
| mlavalle | I am just trying to highlight what the neutron team controls | 14:22 |
| amotoki | so, this week is the freeze week for sdk + neutronclent, so we need to get the neutron patch merged soon to land them. | 14:23 |
| rubasov | mlavalle: understood | 14:23 |
| mlavalle | and that is the neutron-lib and the neutron patches, correct? | 14:23 |
| rubasov | then bump+neutron | 14:23 |
| mlavalle | cool | 14:23 |
| mlavalle | njohnston: let's revisit the ethertypes during the drivers meeting on Friday, ok? | 14:24 |
| mlavalle | we make a decision then | 14:24 |
| slaweq | so lets focus on this bump neutron-lib patch and neutron patch then - I hope gate will be unblocked today | 14:24 |
| rubasov | with urls: https://review.opendev.org/680980 and https://review.opendev.org/670851 | 14:24 |
| njohnston | mlavalle: sounds good | 14:24 |
| rubasov | thank you everybody | 14:24 |
| amotoki | is the heat patch targeted for Ussuri or do they consider FFE? | 14:24 |
| *** Lucas_Gray has quit IRC | 14:24 | |
| rubasov | amotoki: I don't know at the moment | 14:25 |
| amotoki | it affects the importance on SDK merge. | 14:25 |
| *** Lucas_Gray has joined #openstack-meeting | 14:25 | |
| amotoki | rubasov: okay, so it looks like we can defer SDK stuffs to Ussuri. | 14:25 |
| *** shintaro has quit IRC | 14:25 | |
| mlavalle | I know we are trying to think as a broader community.... | 14:26 |
| rubasov | amotoki: sdk is actually not a dependency for heat | 14:26 |
| mlavalle | but this extension has value in itself, regardless of whether we land the corresponding part in heat, right? | 14:26 |
| rubasov | it is a dependency for osc | 14:26 |
| rubasov | mlavalle: yes | 14:26 |
| mlavalle | so for this week, in the neutron team let's focus on landing the extension | 14:27 |
| rubasov | it feels like I should have a put an ascii art of the dependency tree in the commit messages :-) | 14:27 |
| amotoki | heat --> neutronclient --> neutron --> req bump | 14:28 |
| slaweq | mlavalle: sounds good, and lets check if we have all what's needed on friday's drivers meeting | 14:28 |
| amotoki | osc --> openstacksdk --> neutron | 14:28 |
| slaweq | will that be ok? | 14:28 |
| rubasov | amotoki: yes | 14:28 |
| slaweq | or do we need to release neutronclient on Thursday? | 14:28 |
| rubasov | slaweq: will attend | 14:28 |
| amotoki | neutronclient release can wait till Thur and if the neutron patch lands we can adjust the commit hash. | 14:28 |
| slaweq | ok | 14:29 |
| amotoki | I see three small commits in neutornclient since the last release | 14:29 |
| slaweq | so we have plan for this one :) | 14:29 |
| amotoki | so it looks better to release the client. | 14:29 |
| *** Lucas_Gray has quit IRC | 14:30 | |
| slaweq | for other BPs, we will have to move them to Ussuri cycle, right? | 14:31 |
| *** armax has joined #openstack-meeting | 14:31 | |
| mlavalle | yes | 14:31 |
| mlavalle | but let's wait until Friday | 14:32 |
| slaweq | mlavalle: sure :) | 14:32 |
| slaweq | ok, next topic | 14:32 |
| slaweq | #topic Community goals | 14:32 |
| *** openstack changes topic to "Community goals (Meeting topic: networking)" | 14:32 | |
| slaweq | any updates about python3 or pdf docs? | 14:32 |
| *** ociuhandu has joined #openstack-meeting | 14:32 | |
| *** ociuhandu has quit IRC | 14:33 | |
| bcafarel | I saw some additional pdf docs merged I think | 14:33 |
| njohnston | lajoskatona: How are things with python3 for networking-odl CI jobs, especially https://review.opendev.org/#/c/672925/ ? | 14:33 |
| *** ociuhandu has joined #openstack-meeting | 14:33 | |
| amotoki | Re pdf docs, we succeeded to have pathces for all stadium repos :) | 14:34 |
| amotoki | I think they are not urgent as they are doc changes. | 14:34 |
| amotoki | I added the review links to the meeting wiki | 14:35 |
| lajoskatona | njohston: that one is still failing, I have to ping again the ODL team about that | 14:35 |
| slaweq | amotoki: only urgency which I see is that this week is also "Train Community Goals Completed" | 14:35 |
| slaweq | so my assumption is that it should be finished this week | 14:35 |
| slaweq | but we can easily finish it later for stadium projects | 14:35 |
| lajoskatona | njohston: thanks to the reviews other jobs are now in quite good sape | 14:35 |
| amotoki | not till the release date? | 14:35 |
| amotoki | ah, I found https://releases.openstack.org/train/schedule.html#t-goals-complete | 14:36 |
| *** ianychoi_ is now known as ianychoi | 14:37 | |
| slaweq | amotoki: yes, that was the link I was referring to | 14:37 |
| *** Lucas_Gray has joined #openstack-meeting | 14:37 | |
| *** ociuhandu has quit IRC | 14:37 | |
| amotoki | re the pdf goal, I will discuss it with asettle later. she is the goal champion. | 14:37 |
| slaweq | ok, thx amotoki | 14:38 |
| *** artom has quit IRC | 14:38 | |
| slaweq | according to IPv6-Only Deployments in Neutron we are good | 14:38 |
| mlavalle | cool | 14:38 |
| *** artom has joined #openstack-meeting | 14:38 | |
| slaweq | there are WIP patches for networking-ovn and networking-odl now | 14:38 |
| amotoki | community goals are tracked by storyboard, so we can update the corresponding stories. | 14:38 |
| *** ociuhandu has joined #openstack-meeting | 14:39 | |
| slaweq | tidwellr: can You check if we would need similar IPv6 only job for neutron-dynamic-routing also? | 14:39 |
| tidwellr | slaweq: I'll double-check | 14:40 |
| tidwellr | we might not need one though | 14:40 |
| slaweq | thx tidwellr | 14:40 |
| slaweq | I will also email tmorin with similar question about networking-bagpipe | 14:40 |
| slaweq | ok, let's move on | 14:41 |
| slaweq | #topic Bugs | 14:41 |
| *** openstack changes topic to "Bugs (Meeting topic: networking)" | 14:41 | |
| slaweq | our bug deputy last week was njohnston | 14:41 |
| slaweq | he sent summary in Bugs report for week of September 2nd: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009261.html | 14:41 |
| slaweq | this week our bug deputy is mlavalle so we are in very good hands :) | 14:42 |
| njohnston | Much gate turmoil last week | 14:42 |
| mlavalle | let's see if I don't wreck the house ;-) | 14:42 |
| njohnston | thanks rubasov for taking https://bugs.launchpad.net/neutron/+bug/1843285 | 14:43 |
| openstack | Launchpad bug 1843285 in neutron "Trunk scenario test test_subport_connectivity failing with iptables_hybrid fw driver" [High,In progress] - Assigned to Bence Romsics (bence-romsics) | 14:43 |
| njohnston | but https://bugs.launchpad.net/neutron/+bug/1843290 is still unassigned | 14:43 |
| openstack | Launchpad bug 1843290 in neutron "Remove network flavor profile fails" [High,New] | 14:43 |
| rubasov | njohnston: of course | 14:43 |
| njohnston | and while the report indicates https://bugs.launchpad.net/neutron/+bug/1843282 is complete; the CI is still failing. slaweq pushed a change to make some CI nonvoting as a result https://review.opendev.org/#/c/681186/ | 14:43 |
| openstack | Launchpad bug 1843282 in neutron "Rally CI not working since jsonschema version bump" [High,Fix released] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:43 |
| *** e0ne has quit IRC | 14:44 | |
| ralonsoh | once rally releases a new version, we'll have rally-openstack working again | 14:44 |
| *** e0ne has joined #openstack-meeting | 14:44 | |
| njohnston | and one bug I was not able to reproduce properly, so if someone is familiar with the network ip availability API: https://bugs.launchpad.net/neutron/+bug/1843211 | 14:45 |
| openstack | Launchpad bug 1843211 in neutron "network-ip-availabilities' result is not correct when the subnet has no allocation-pool" [Undecided,New] | 14:45 |
| njohnston | those are the highlights of outstanding issues | 14:45 |
| amotoki | njohnston: I will check it. | 14:46 |
| slaweq | thx njohnston for update | 14:46 |
| njohnston | thank you amotoki | 14:46 |
| slaweq | ok, let's move on than | 14:47 |
| slaweq | #topic neutron-lib | 14:47 |
| *** openstack changes topic to "neutron-lib (Meeting topic: networking)" | 14:47 | |
| slaweq | boden: any updates? | 14:47 |
| boden | hi | 14:47 |
| *** jamesmcarthur has joined #openstack-meeting | 14:47 | |
| boden | no technical updates from me, but I did want to mention that due to a change in focus, I won't have much time to work on neutron-lib moving forward | 14:48 |
| boden | that said, there's still plenty of neutron-lib work left... if anyone wants to pick it up, I'm available to help ramp someone else up | 14:48 |
| mlavalle | is this change in your focus imediate or is there going to be a transition period? | 14:49 |
| boden | it's immediate, but as I mentioned I still have some cycles here and there. | 14:49 |
| boden | I think the neutron-lib work is at a good point for this anyway; there's nothing much I'm aware of in neutron-lib that's pending consumption in neutron | 14:50 |
| mlavalle | in that case, I'll send a message to the ML indicating that we need a new neutron-lib champion | 14:50 |
| boden | I do have some pending consumption patches out there, but they have been slow moving... some dating back months and month | 14:50 |
| njohnston | thank you boden for the incredible quantity and quality of work you have done over the years | 14:50 |
| boden | welcome... I'll still be around so feel free to ping me for reviews, etc.. | 14:51 |
| mlavalle | would you be able to respond to that message indicating whan needs to be done forward and the priorities? | 14:51 |
| boden | mlavalle I can, but we've had a list out there for a long time now | 14:51 |
| boden | https://etherpad.openstack.org/p/neutron-lib-volunteers-and-punch-list | 14:52 |
| mlavalle | ok, just point to the list in that case in your response | 14:52 |
| boden | nothing changed here; all still valid | 14:52 |
| slaweq | boden: that's sad news but I understand it, thx a lot for all this hard work on neutron-lib | 14:52 |
| mlavalle | ok, nevermind, I'll point to it in my message | 14:52 |
| *** Lucas_Gray has quit IRC | 14:52 | |
| mlavalle | and yes, I join the rest of the team in thanking for all your efforts.... | 14:52 |
| boden | been my pleasure | 14:53 |
| mlavalle | and wishing you good luck in your future endeavours | 14:53 |
| boden | thank you | 14:53 |
| bcafarel | indeed thanks a lot for all the work you've completed there boden! | 14:54 |
| slaweq | ok, let's move on than | 14:54 |
| slaweq | #topic On demand agenda | 14:54 |
| *** openstack changes topic to "On demand agenda (Meeting topic: networking)" | 14:54 | |
| slaweq | in the meeting agenda there is only one item from mlavalle but we already talked about it | 14:54 |
| mlavalle | we'll keep it for next week | 14:54 |
| slaweq | anyone has anything else to talk about? | 14:54 |
| slaweq | we have 5 minutes | 14:54 |
| slaweq | ok, if not, I will end this meeting here | 14:55 |
| slaweq | thx for attending | 14:56 |
| slaweq | and have a great week | 14:56 |
| slaweq | #endmeeting | 14:56 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:56 | |
| slaweq | o/ | 14:56 |
| openstack | Meeting ended Tue Sep 10 14:56:07 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:56 |
| mlavalle | o/ | 14:56 |
| ralonsoh | bye | 14:56 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-09-10-14.00.html | 14:56 |
| njohnston | o/ | 14:56 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-09-10-14.00.txt | 14:56 |
| amotoki | thanks all | 14:56 |
| rubasov | bye | 14:56 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/networking/2019/networking.2019-09-10-14.00.log.html | 14:56 |
| *** boden has left #openstack-meeting | 14:56 | |
| lajoskatona | o/ | 14:58 |
| bcafarel | o/ | 14:58 |
| ralonsoh | #startmeeting neutron_qos | 15:01 |
| openstack | Meeting started Tue Sep 10 15:01:38 2019 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: neutron_qos)" | 15:01 | |
| openstack | The meeting name has been set to 'neutron_qos' | 15:01 |
| ralonsoh | Hello | 15:01 |
| *** diablo_rojo has joined #openstack-meeting | 15:01 | |
| ralonsoh | I don't know if David is going to join us today (I think he is in PTO) | 15:02 |
| ralonsoh | ok, so the only item in the agenda is | 15:03 |
| ralonsoh | #link https://blueprints.launchpad.net/neutron/+spec/neutron-classifier-neutron-qos | 15:03 |
| ralonsoh | patches: https://review.opendev.org/#/q/topic:qos-classifier+(status:open+OR+status:merged) | 15:03 |
| ralonsoh | the first one, the spec | 15:04 |
| ralonsoh | #link https://review.opendev.org/#/c/678865/ | 15:04 |
| ralonsoh | and then, the introduction of the NC in Neutron | 15:04 |
| ralonsoh | n-lib: #link https://review.opendev.org/#/c/670049/ | 15:04 |
| ralonsoh | neutron: #link https://review.opendev.org/#/c/670050/ | 15:04 |
| ralonsoh | because David is not here, we can continue the discussion in gerrit | 15:05 |
| slaweq | I was reviewing spec for this recently | 15:05 |
| slaweq | David answered me but I didn't have time to read it carefully yet | 15:05 |
| ralonsoh | me too, I think he needs to specify a bit the purpose | 15:05 |
| ralonsoh | and, btw, he needs first to migrate the NC code to Neutron | 15:06 |
| ralonsoh | at that's a big piece of code | 15:06 |
| ralonsoh | (previous links) | 15:06 |
| *** jawad_axd has joined #openstack-meeting | 15:06 | |
| ralonsoh | then, once the NC code is merged, there is a POC of the classification using DSCP | 15:07 |
| ralonsoh | #link https://review.opendev.org/#/c/636333/ | 15:07 |
| ralonsoh | the next patch should be the back-end implementation | 15:07 |
| ralonsoh | and that's all for today | 15:07 |
| slaweq | that was quick :) | 15:07 |
| ralonsoh | something else on this RFE? | 15:08 |
| ralonsoh | (not approved yet) | 15:08 |
| slaweq | not from my side | 15:08 |
| ralonsoh | ok | 15:08 |
| ralonsoh | #topic Open Discussion | 15:08 |
| *** openstack changes topic to "Open Discussion (Meeting topic: neutron_qos)" | 15:08 | |
| ralonsoh | and something else to add in general, about QoS? | 15:08 |
| slaweq | nope | 15:08 |
| ralonsoh | thanks slaweq! | 15:08 |
| ralonsoh | see you later | 15:08 |
| slaweq | thx ralonsoh :) | 15:08 |
| ralonsoh | #endmeeting | 15:09 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:09 | |
| slaweq | see You on next meeting | 15:09 |
| openstack | Meeting ended Tue Sep 10 15:09:01 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:09 |
| slaweq | :) | 15:09 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-09-10-15.01.html | 15:09 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-09-10-15.01.txt | 15:09 |
| slaweq | o/ | 15:09 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_qos/2019/neutron_qos.2019-09-10-15.01.log.html | 15:09 |
| *** tssurya has quit IRC | 15:13 | |
| *** ociuhandu has quit IRC | 15:19 | |
| *** ociuhandu has joined #openstack-meeting | 15:19 | |
| *** links has quit IRC | 15:22 | |
| *** ociuhandu has quit IRC | 15:22 | |
| *** ociuhandu has joined #openstack-meeting | 15:23 | |
| *** ociuhandu has quit IRC | 15:28 | |
| *** ociuhandu has joined #openstack-meeting | 15:31 | |
| *** macz has joined #openstack-meeting | 15:35 | |
| *** gyee has joined #openstack-meeting | 15:35 | |
| *** ociuhandu has quit IRC | 15:38 | |
| *** browny_ has joined #openstack-meeting | 15:40 | |
| *** apetrich has joined #openstack-meeting | 15:41 | |
| *** browny has quit IRC | 15:42 | |
| *** ociuhandu has joined #openstack-meeting | 15:47 | |
| *** mattw4 has joined #openstack-meeting | 15:48 | |
| *** ociuhandu has quit IRC | 15:58 | |
| *** ociuhandu has joined #openstack-meeting | 15:58 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Sep 10 16:00:15 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| slaweq | welcome again | 16:00 |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| ralonsoh | hi | 16:00 |
| slaweq | mlavalle will not be here today | 16:01 |
| slaweq | but lets wait few more minutes for njohnston bcafarel and others | 16:01 |
| * slaweq will be back in 2 minutes | 16:01 | |
| bcafarel | o/ sorry did not see the time | 16:01 |
| clarkb | really quickly I wanted to point out that some of octavia's CI problems were due to an ubuntu kernel bug in ovs that was causing the kernel to panic. Its possible neutron and others are seeing that too (if the job is retried) | 16:02 |
| clarkb | that bug has been fixed we need to update our mirrors and rebuild images (complicated by a fileserver outage the other day we are still trying to recover from) | 16:02 |
| *** ociuhandu has quit IRC | 16:02 | |
| *** ociuhandu has joined #openstack-meeting | 16:03 | |
| slaweq | ok, I'm back | 16:03 |
| johnsom | #link https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1842447 | 16:03 |
| openstack | Launchpad bug 1842447 in linux (Ubuntu) "Kernel Panic with linux-image-4.15.0-60-generic when specifying nameserver in docker-compose" [Undecided,Confirmed] | 16:03 |
| johnsom | fyi | 16:03 |
| slaweq | clarkb: johnsom thx for heads up | 16:03 |
| johnsom | I was going to ask after my meeting as we are not seeing new images today | 16:03 |
| slaweq | but I didn't saw it in neutron jobs (yet) | 16:03 |
| slaweq | but we will keep an eye on it for sure :) | 16:04 |
| slaweq | ok, let's get going with meeting agenda | 16:04 |
| slaweq | #topic Actions from previous meetings | 16:04 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:04 | |
| slaweq | first one | 16:04 |
| slaweq | mlavalle to continue investigating router migrations issue | 16:04 |
| slaweq | he told me that he is still investigating | 16:05 |
| slaweq | so I will just assign it to him for next week too | 16:05 |
| slaweq | #action mlavalle to continue investigating router migrations issue | 16:05 |
| slaweq | next one | 16:05 |
| slaweq | slaweq to check reasons of failures of neutron-tempest-plugin-scenario-openvswitch job | 16:05 |
| slaweq | I didn't have time but it looks much better now so I hope we will be good with this job :) | 16:05 |
| slaweq | next one | 16:05 |
| slaweq | ralonsoh to report bug and investigate failing test_get_devices_info_veth_different_namespaces functional test | 16:05 |
| njohnston | o/ sorry I am late | 16:06 |
| ralonsoh | slaweq, that's solved in your patch | 16:06 |
| slaweq | ahh, right :) | 16:06 |
| slaweq | ok | 16:06 |
| slaweq | thx ralonsoh | 16:06 |
| ralonsoh | np! | 16:06 |
| *** tesseract has quit IRC | 16:06 | |
| slaweq | ok, next one | 16:06 |
| slaweq | slaweq to check reason of failure neutron.tests.functional.agent.test_firewall.FirewallTestCase.test_rule_ordering_correct | 16:06 |
| slaweq | It was the issue which should be fixed with https://review.opendev.org/#/c/679428/ | 16:06 |
| slaweq | so nothing more to check there | 16:06 |
| slaweq | and the last one | 16:07 |
| slaweq | slaweq to add mariadb periodic job | 16:07 |
| slaweq | I proposed https://review.opendev.org/681202 | 16:07 |
| slaweq | but it also requires https://review.opendev.org/#/c/681200/1 and https://review.opendev.org/#/c/681201/ | 16:07 |
| ralonsoh | +1 to this | 16:07 |
| slaweq | ralonsoh: lets first check if that will work as expected :) | 16:08 |
| slaweq | I will continue this work during next week | 16:08 |
| *** lajoskatona has left #openstack-meeting | 16:08 | |
| slaweq | ok, lets move on to the next topic than | 16:08 |
| slaweq | #topic Stadium projects | 16:08 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:08 | |
| slaweq | Python 3 migration | 16:08 |
| slaweq | Stadium projects etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:08 |
| slaweq | I think we already talked about it on neutron meeting | 16:08 |
| njohnston | +1 | 16:08 |
| slaweq | njohnston: anything You want to add about it? | 16:09 |
| njohnston | slaweq: Just that I have not had a chance to check in with yamamoto about midonet | 16:09 |
| njohnston | that's all | 16:10 |
| slaweq | ok, yes, midonet is the last "almost not touched" one, right? | 16:10 |
| njohnston | yes | 16:10 |
| njohnston | I rarely see yamamoto online it seems | 16:10 |
| slaweq | we still have some time but IMO we should finish this work before end of this year | 16:10 |
| slaweq | as python 2 is EOL at 1.1.2020 | 16:10 |
| slaweq | ok, and second stadium projects topic | 16:11 |
| slaweq | tempest-plugins migration | 16:11 |
| slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:11 |
| slaweq | I know that tidwellr is doing some progress with neutron-dynamic-routing still | 16:11 |
| slaweq | tidwellr: do You need help on this? | 16:11 |
| njohnston | same state as last week I believe; vpnaas is -W from mlavalle | 16:12 |
| *** browny has joined #openstack-meeting | 16:12 | |
| *** lpetrut has quit IRC | 16:12 | |
| njohnston | tidwellr did mention on his review that he was seeing worrisome errors from neutron https://review.opendev.org/#/c/652099 | 16:12 |
| *** browny_ has quit IRC | 16:13 | |
| slaweq | yes, I saw 1 error on this patch today | 16:13 |
| *** mattw4 has quit IRC | 16:14 | |
| slaweq | ok, tidwellr if You would need any help, please ping me :) | 16:14 |
| *** bbowen__ has quit IRC | 16:14 | |
| slaweq | anything else You want to talk regarding stadium projects CI today? | 16:14 |
| tidwellr | slaweq: I'm looking into it, but I could use some help | 16:15 |
| tidwellr | I thought it would be simple, but these issue aren't seeming so simple anymore :) | 16:15 |
| slaweq | tidwellr: ok, I will try to look into it this week too | 16:15 |
| njohnston | nothing else from me | 16:15 |
| slaweq | and interesting question is why it's not failing in old, legacy jobs | 16:16 |
| *** kopecmartin is now known as kopecmartin|off | 16:16 | |
| tidwellr | slaweq: I'm seeing intermittent failures where BGP peering simply doesn't start, but then on a recheck everything begins peering and the test in question passes | 16:17 |
| *** e0ne has quit IRC | 16:18 | |
| tidwellr | but we don't see this behavior with the legacy jobs in neutron-dynamic-routing | 16:18 |
| slaweq | BGP peering is something run in docker container, right? | 16:18 |
| tidwellr | BGP agent peers with docker container | 16:18 |
| slaweq | ok, I will take a look into logs | 16:18 |
| tidwellr | the BGP agent will always be the one to initiate the peering | 16:18 |
| slaweq | maybe I will find something | 16:19 |
| tidwellr | good luck :) | 16:19 |
| slaweq | thx tidwellr :) | 16:19 |
| slaweq | and thx for working on this | 16:19 |
| slaweq | ok, lets move on | 16:19 |
| slaweq | next topic | 16:19 |
| slaweq | #topic Grafana | 16:19 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:19 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:19 |
| slaweq | (sorry that I forgot sent it at the beginning) | 16:19 |
| slaweq | currently we have 2 main issues in CI | 16:20 |
| slaweq | 1. problems with rally | 16:21 |
| slaweq | which is failing 100% times due to jsonschema versions mismatch | 16:21 |
| slaweq | 2. neutron-tempest-iptables_hybrid-fedora which is even not starting (RETRY LIMIT) 100% times | 16:22 |
| slaweq | because we were running it on F28 which is now EOL and there is no repositories for it anymore | 16:22 |
| slaweq | for both cases there are patches to fix them | 16:22 |
| slaweq | for rally issue we are waiting for new rally release | 16:22 |
| ralonsoh | one question, if possible (about Fedora issue) | 16:23 |
| slaweq | ralonsoh: sure | 16:23 |
| ralonsoh | why, instead of using F29 we don't try F30? | 16:23 |
| njohnston | slaweq: FOr Fedora issue, is this DNM patch the fix patch or is there a different one? | 16:24 |
| njohnston | https://review.opendev.org/#/c/681213/ | 16:24 |
| ralonsoh | yes, why don't we switch to F30? | 16:24 |
| ralonsoh | instead of F29 | 16:24 |
| ralonsoh | maybe Brian can help us (is not here now) | 16:24 |
| slaweq | my DNM patch was send only to test if haleyb's change to devstack will fix this job | 16:24 |
| ralonsoh | haleyb, yes he is! | 16:25 |
| slaweq | but it's not fix for the issue | 16:25 |
| njohnston | ah ok. | 16:25 |
| slaweq | fix is proposed by haleyb to devstack repo | 16:25 |
| slaweq | https://review.opendev.org/#/c/662529/5 | 16:25 |
| clarkb | re f30 I don't know that it is quite ready yet. We are adding it in nowish iirc | 16:25 |
| *** mattw4 has joined #openstack-meeting | 16:25 | |
| slaweq | according to comment from ianw there he had some issues with F30 | 16:25 |
| clarkb | (but once it is ready you should feel free to test on it) | 16:25 |
| haleyb | and doug is looking at the barbican failure today | 16:25 |
| slaweq | that's why we are changing for F29 now | 16:25 |
| ralonsoh | ooook, thanks!! | 16:25 |
| redrobot | haleyb, o/ | 16:26 |
| haleyb | i didn't see any f30 support, so stopped at f29 | 16:26 |
| ralonsoh | perfect | 16:26 |
| *** bbowen__ has joined #openstack-meeting | 16:26 | |
| slaweq | ralonsoh: njohnston is that clear for You now? | 16:27 |
| ralonsoh | it is, for sure | 16:27 |
| njohnston | slaweq: yes thanks | 16:27 |
| slaweq | great :) | 16:28 |
| slaweq | haleyb: thx for fixing this | 16:28 |
| haleyb | np, wish everything had merged sooner, started as a periodic ovn job failure | 16:28 |
| slaweq | but also to unblock our gates ASAP I sent today patch https://review.opendev.org/#/c/681186/ | 16:28 |
| slaweq | later we will be able to revert it when proper fixes in external repos will land | 16:29 |
| slaweq | ok | 16:29 |
| slaweq | other than those 2 issues, we are quite fine | 16:29 |
| slaweq | even functional/fullstack jobs are in quite good shape this week | 16:29 |
| *** ekcs has joined #openstack-meeting | 16:30 | |
| slaweq | and that's all from me according to grafana | 16:31 |
| slaweq | do You have anything else about grafana today? | 16:31 |
| njohnston | nope | 16:33 |
| slaweq | ok, lets move on | 16:33 |
| slaweq | #topic fullstack/functional | 16:33 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:33 | |
| *** mattw4 has quit IRC | 16:33 | |
| slaweq | I today found one new (for me) issue on functional tests | 16:33 |
| slaweq | and it happend at least twice | 16:33 |
| slaweq | it was on different tests | 16:33 |
| slaweq | but same error in test's log | 16:33 |
| slaweq | https://0668011f33af6364883c-c555fae2d8c498523cc4b2c363541725.ssl.cf1.rackcdn.com/679852/11/gate/neutron-functional/6b7c424/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase.test_arp_protection_port_security_disabled.txt.gz | 16:34 |
| slaweq | or | 16:34 |
| slaweq | https://148a66b404dde523de26-17406e3478c64e603d8ff3ea0aac16c8.ssl.cf5.rackcdn.com/680393/1/check/neutron-functional-python27/59e721e/controller/logs/dsvm-functional-logs/neutron.tests.functional.agent.linux.test_l3_tc_lib.TcLibTestCase.test_clear_all_filters.txt.gz | 16:34 |
| slaweq | did You saw something like that before? | 16:34 |
| njohnston | no, that is a new one for me... very strange... | 16:34 |
| ralonsoh | this can be (i guess) because you are deleting the qos registers | 16:34 |
| slaweq | tbh this ovsdb error may be redhearing as it could happend during cleanup | 16:35 |
| ralonsoh | and the rules are not there anymore | 16:35 |
| slaweq | but that's only thing which was common in those 2 failed tests for me | 16:35 |
| ralonsoh | yes, this could happen | 16:35 |
| ralonsoh | I can check this tomorrow | 16:35 |
| slaweq | thx ralonsoh | 16:35 |
| ralonsoh | do you have a bug ref? | 16:35 |
| slaweq | ralonsoh: no | 16:35 |
| ralonsoh | ok, I'll do it | 16:36 |
| slaweq | ok, thx a lot | 16:36 |
| slaweq | #action ralonsoh to report bug and check issue with ovsdb errors in functional tests | 16:36 |
| slaweq | and I also found (happend once) issue with killing external process during cleanup | 16:36 |
| slaweq | I reported it here New bug reported by me: https://bugs.launchpad.net/neutron/+bug/1843418 - not very urgent | 16:36 |
| openstack | Launchpad bug 1843418 in neutron "Functional tests shouldn't fail if kill command will have "no such process" during cleanup" [Medium,In progress] - Assigned to Slawek Kaplonski (slaweq) | 16:36 |
| slaweq | I know that bcafarel and ralonsoh already reviewed proposed patch | 16:37 |
| slaweq | I didn't had time to check those reviews yet | 16:37 |
| ralonsoh | slaweq, I propose to implement a os.kill() method with and wihtout privsep | 16:37 |
| ralonsoh | if root is True/False | 16:37 |
| ralonsoh | there are several places in Neutron where a shell to execute "kill" is spawned | 16:38 |
| slaweq | ralonsoh: that is good idea | 16:38 |
| slaweq | I will do it this way | 16:38 |
| ralonsoh | perfect! | 16:39 |
| *** igordc has joined #openstack-meeting | 16:39 | |
| bcafarel | that will be nice :) | 16:39 |
| njohnston | very good +1 | 16:39 |
| slaweq | thx a lot for this idea and reviewing patch | 16:39 |
| slaweq | that's all regarding functional/fullstack jobs from me | 16:40 |
| slaweq | anything else You want to add? | 16:40 |
| *** jawad_axd has quit IRC | 16:41 | |
| slaweq | ok, if not that was all from me for today | 16:41 |
| slaweq | as I don't have anything new regarding scenario jobs | 16:42 |
| slaweq | do You have anything else You want to talk about today? | 16:42 |
| slaweq | if not, I think I can give You back about 15 minutes :) | 16:42 |
| njohnston | o/ | 16:43 |
| bcafarel | yay | 16:43 |
| bcafarel | o/ | 16:43 |
| slaweq | ok, lets finish than | 16:43 |
| ralonsoh | bye | 16:43 |
| slaweq | thx for attending | 16:43 |
| slaweq | o/ | 16:43 |
| slaweq | #endmeeting | 16:43 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:43 | |
| openstack | Meeting ended Tue Sep 10 16:43:45 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:43 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-10-16.00.html | 16:43 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-10-16.00.txt | 16:43 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-09-10-16.00.log.html | 16:43 |
| *** igordc has quit IRC | 16:44 | |
| *** ociuhandu_ has joined #openstack-meeting | 17:00 | |
| *** ociuhandu has quit IRC | 17:03 | |
| *** brault has joined #openstack-meeting | 17:03 | |
| *** lettucefuzz has joined #openstack-meeting | 17:05 | |
| *** ociuhandu_ has quit IRC | 17:05 | |
| *** brault has quit IRC | 17:08 | |
| *** jamesmcarthur has quit IRC | 17:18 | |
| *** brault has joined #openstack-meeting | 17:22 | |
| *** brault has quit IRC | 17:27 | |
| *** njohnston is now known as njohnston|lunch | 17:30 | |
| *** ralonsoh has quit IRC | 17:32 | |
| *** ralonsoh has joined #openstack-meeting | 17:39 | |
| *** igordc has joined #openstack-meeting | 17:44 | |
| *** trident has quit IRC | 17:46 | |
| *** e0ne has joined #openstack-meeting | 17:46 | |
| *** igordc has quit IRC | 17:50 | |
| *** cheng1 has quit IRC | 17:51 | |
| *** lettucefuzz has quit IRC | 17:51 | |
| *** cheng1 has joined #openstack-meeting | 17:55 | |
| *** diablo_rojo has quit IRC | 17:55 | |
| *** igordc has joined #openstack-meeting | 17:57 | |
| *** trident has joined #openstack-meeting | 17:59 | |
| *** igordc has quit IRC | 18:06 | |
| *** igordc has joined #openstack-meeting | 18:06 | |
| *** igordc has quit IRC | 18:15 | |
| *** eharney has quit IRC | 18:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:18 | |
| *** ociuhandu has joined #openstack-meeting | 18:39 | |
| *** ociuhandu has quit IRC | 18:44 | |
| *** ralonsoh has quit IRC | 18:46 | |
| *** gyee has quit IRC | 18:49 | |
| *** gyee has joined #openstack-meeting | 18:50 | |
| *** Shrews has joined #openstack-meeting | 18:51 | |
| *** brinzhang has quit IRC | 18:54 | |
| *** brinzhang has joined #openstack-meeting | 18:54 | |
| *** panda is now known as panda|rover|off | 18:54 | |
| *** jamesmcarthur has quit IRC | 18:57 | |
| *** ricolin has quit IRC | 18:58 | |
| corvus | yes! | 19:00 |
| clarkb | you are here for the meeting? | 19:00 |
| fungi | deh'ya | 19:00 |
| ianw | hello | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Sep 10 19:01:11 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-September/006478.html Our Agenda | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| clarkb | no one objected to me holding the PTL baton for another cycle and I'm apparently PTL again :) | 19:02 |
| fungi | condolences | 19:02 |
| clarkb | as mentioned in my candidacy statement I'd like for this to be my last cycle. And will be more than happy to work with people to make such a transition easier | 19:02 |
| clarkb | The another announcement is there is an openstack foundation board meeting immediately after our meeting | 19:03 |
| corvus | related -- we should probably talk about opendev governance at some point | 19:03 |
| clarkb | corvus: ++ | 19:03 |
| corvus | (don't want to derail announcements, but i expect that's intertwined with the openstack-infra ptl issue) | 19:03 |
| clarkb | board meeting details here https://wiki.openstack.org/wiki/Governance/Foundation/10September2019BoardMeeting if you want to listen in. I'll do my best to avoid this meeting going long too | 19:03 |
| fungi | yes, i have a feeling if much of what we do became the jurisdiction of opendev, what's left and openstack-specific could maybe become a sig | 19:03 |
| clarkb | corvus: ya there is definitely interconnectedness | 19:04 |
| clarkb | fwiw I'd happily let someone else be opendev PTL (or whatever we end up calling it) too :) | 19:04 |
| clarkb | corvus: I'll scribble a note to get that ball rolling | 19:04 |
| clarkb | #topic Actions from last meeting | 19:05 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:05 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-03-19.01.txt minutes from last meeting | 19:05 |
| clarkb | I don't see any actions there. Also not sure about you but the last week has been one of fighting fires for me | 19:06 |
| clarkb | not much got done off of my normal TODO list. On the upside I think our log storage in swift should be much happier now and hopefully our jobs are slightly easier to debug when "networking" breaks | 19:06 |
| clarkb | #topic Priority Efforts | 19:07 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:07 | |
| clarkb | #topic OpenDev | 19:07 |
| *** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:07 | |
| clarkb | Maybe now is a good time to talk about what we think the next step on moving opendev governance forward is? | 19:07 |
| clarkb | I assume it will involve a discussion with the openstack TC of some sort | 19:07 |
| clarkb | fungi: ^ as our TC rep an thoughts on that? | 19:07 |
| fungi | well... | 19:08 |
| fungi | i'm technically no longer on the tc ;) | 19:08 |
| fungi | but still happy to provide guidance there | 19:08 |
| clarkb | oh right that also changed last week :) | 19:08 |
| fungi | and yes, the sooner we bring it up with them, the better | 19:09 |
| fungi | (for those who missed the openstack tc election, i stepped down to help make sure the election process went smoothly, since there were some significant tooling complexities due to scheduling constraints) | 19:09 |
| clarkb | fungi: is there a formal agenda we have to add ourselves to or is there still informal office horus we can show up to and discuss at? | 19:10 |
| corvus | you know me: the closer it resembles a self-organized collective, the better as far as i'm concerned :) | 19:10 |
| fungi | i recommend a thread on the openstack-discuss ml, with [tc][infra] in the subject | 19:10 |
| clarkb | fungi: ok I can draft an email for that on etherpad and we can decide when it is ready to be sent | 19:10 |
| fungi | sounds great! | 19:11 |
| *** eharney has joined #openstack-meeting | 19:11 | |
| fungi | but yeah, the tc formally meets infrequently to satisfy requirements in the osf bylaws, and treats those meetings mostly as a reporting outlet | 19:11 |
| corvus | i think the main thing is it won't be *under* the tc (or any foundation project), but we want involvement from them; so figuring out what form that involvement should take is a big question i think. | 19:11 |
| clarkb | corvus: ++ | 19:11 |
| fungi | exactly | 19:12 |
| clarkb | and I'm not sure we need to have that answer before kicking off a thread to discuss it, though some ideas will likely help guide discussion in a productive manner | 19:12 |
| corvus | yeah, for something like that "how would you like to be involved" is a fine open-ended question to ask i think | 19:12 |
| fungi | i wholeheartedly concur | 19:13 |
| corvus | maybe worth sending the same email to all the osf projects? | 19:13 |
| fungi | or at least a similar e-mail, sure | 19:13 |
| fungi | the degree to which we're involved in and assisting each of them and with what tends to differ | 19:13 |
| fungi | though i expect what we want to offer all of them is roughly the same | 19:14 |
| corvus | and our interest in their participation is probably roughly equal :) | 19:14 |
| clarkb | ++ | 19:14 |
| fungi | absolutely | 19:14 |
| fungi | or at least proportional | 19:14 |
| corvus | non-zero | 19:15 |
| clarkb | I think that gives us a really good starting point to being a draft and sort out details together there | 19:15 |
| clarkb | s/being/begin/ | 19:15 |
| corvus | i'm a draft | 19:15 |
| clarkb | on nitrous? | 19:16 |
| fungi | sounds like we all are | 19:16 |
| corvus | clarkb: yes, i'm also a drift | 19:16 |
| clarkb | Alright any other opendev related business or should we move on? | 19:16 |
| corvus | ++ | 19:17 |
| clarkb | #topic Update Config Management | 19:17 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:17 | |
| fungi | none here | 19:17 |
| clarkb | One thing I managed to get off of my todo list was merging and monitoring and applying mordreds config updates for Gerrit | 19:18 |
| clarkb | Our gerrits should no longer do full replication on restart | 19:18 |
| * fungi celebrates | 19:18 | |
| corvus | yay! and the ssh timeout too, right? | 19:18 |
| clarkb | and they have hour long ssh timeouts (I even tested this on review-dev with a stream-events connection. I don't think review.o.o is ever idle long enough to hit that so will depend on sad clients) | 19:18 |
| clarkb | corvus: yup | 19:19 |
| fungi | granted, the upcoming rename restart will still need a reindex | 19:19 |
| corvus | fungi: yeah, we can target just the renamed projects though for that i think? | 19:19 |
| fungi | oh, wait, replication | 19:19 |
| fungi | right | 19:19 |
| clarkb | ya we can do targetted replication | 19:19 |
| clarkb | and reindexing is online | 19:19 |
| fungi | i think the rename process doesn't need rereplication | 19:19 |
| clarkb | shouldn't | 19:20 |
| *** pcaruana has quit IRC | 19:20 | |
| fungi | gerrit needs reindexing, but that only happens automatically on restarts for upgrades | 19:20 |
| fungi | i was confusing the two. sorry! | 19:20 |
| clarkb | Any other config management related business? | 19:20 |
| fungi | nada | 19:20 |
| clarkb | #topic Storyboard | 19:21 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:21 | |
| clarkb | fungi: diablo_rojo_phon any news to share? | 19:21 |
| fungi | i've been entirely disconnected for the past week, so while i don't think so i really don't know | 19:21 |
| clarkb | silly hurricanes interrupting work | 19:21 |
| fungi | they should do a better job of scheduling those, yes | 19:22 |
| fungi | diablo_rojo_phon: may also not be on hand at the moment | 19:23 |
| fungi | SotK: ? | 19:23 |
| fungi | guessing we can move on. i'll hopefully have things to talk about next week as i get back into gear | 19:24 |
| clarkb | k | 19:24 |
| clarkb | #topic General Topics | 19:24 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:24 | |
| clarkb | #link https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup | 19:24 |
| clarkb | First up is server cleanups | 19:24 |
| clarkb | I don't expect much movement happened on the wiki what with hurricanes and other fires | 19:25 |
| clarkb | for static.o.o I think we now have a relatively complete list of tasks to be able to delete that server | 19:25 |
| clarkb | #link https://etherpad.openstack.org/p/static-services Sign up for tasks | 19:25 |
| fungi | i've been pretty useless for the last week, yes, apologies | 19:25 |
| clarkb | thank you ajaeger for jumping on that already. If the rest of us can grab one or two of those we should be able to make good progress on it | 19:25 |
| clarkb | ianw: ^ did you have anything else to add re static.o.o and your auditing? | 19:26 |
| ianw | no; we didn't really come to a conclusion on the redirects ... but we can defer that until the harder things like afs publishing are done | 19:26 |
| clarkb | ok | 19:27 |
| clarkb | That is a good transition into the next topic: AFS stability | 19:27 |
| clarkb | we discovered that afs02.dfw.o.o was very unhappy last week. It looked like fallout from a live migration based on console content (I seem to recall similar messages from hosts that we were told had been migrated) | 19:27 |
| clarkb | corvus rebooted it | 19:28 |
| clarkb | unfortunately that left some volumes locked. ianw has since fixed all of those but the opensuse mirror volume (is that correct?) | 19:28 |
| clarkb | I have also turned mirror-update.openstack.org back on but left mirror-update.opendev.org alone | 19:28 |
| corvus | oh, huh, i thought i checked that after rebooting | 19:28 |
| corvus | what steps should we have done after the reboot? | 19:28 |
| clarkb | ianw: ^ can fill us in on his investigation and next steps | 19:29 |
| ianw | yes the opensuse mirror had a release error; something we've seen before and made a thread about on openafs lists (see updates in #openstack-infra) | 19:29 |
| *** mattw4 has joined #openstack-meeting | 19:29 | |
| ianw | i've tried the salvage recovery steps they suggest and an re-running the opensuse release | 19:29 |
| clarkb | corvus: I believe that subsequent vos releases ended up timing out their auth (and this may have happend after the reboot) | 19:30 |
| ianw | corvus: i think maybe everything needed to recreate r/o and everything timed out | 19:30 |
| ianw | or what clarkb said :) | 19:30 |
| corvus | oh. huh. wonder why it needed to redo r/o | 19:31 |
| clarkb | so ya immediately after the reboot I think it was fine | 19:31 |
| corvus | so the short version of the recovery process is pause release activity before rebooting a server; after it boots, clean up any broken releases; perform a release on every volume manually on the db servers; unpause releases" ? | 19:32 |
| clarkb | corvus: yes I think that would do it mroe gracefully | 19:32 |
| corvus | is there a doc update with that, or should i write that up real quick? | 19:33 |
| ianw | yeah, possibly -- here's where ubuntu went wrong : http://paste.openstack.org/show/774655/ | 19:33 |
| clarkb | corvus: I am not aware of a doc update for that yet. I think you can write it | 19:33 |
| *** mattw4 has quit IRC | 19:33 | |
| ianw | so it's not exactly like "recreating r/o" | 19:33 |
| ianw | i haven't audited the logs of all the other ones to see what happened, but we could | 19:34 |
| clarkb | sounds like that may be it for this topic? lets move on as I want to finish before 2000UTC | 19:36 |
| clarkb | Next up is project renaming on Monday at 1400UTC that is 7am Pacific | 19:36 |
| clarkb | #link https://etherpad.openstack.org/project-renames-2019-09-10 Planning document | 19:37 |
| *** panda|rover|off has quit IRC | 19:37 | |
| clarkb | I've just started editing ^ based on the one we did at the end of may | 19:37 |
| clarkb | from that I need to write a chagne for the repos.yaml content | 19:37 |
| clarkb | and need to get the project-config rename chagnes in order | 19:37 |
| clarkb | One question I did have is whether or not the libification of gitea management affects our rename playbook at all | 19:37 |
| clarkb | I don't think it does because rename playbook should call into that like the normal ansible runs do too | 19:38 |
| clarkb | but I'll look at that as well | 19:38 |
| corvus | #link https://review.opendev.org/681338 Add docs for recovering an OpenAFS fileserver | 19:38 |
| *** panda has joined #openstack-meeting | 19:38 | |
| clarkb | monty said he would be around monday and early pacific time would work for him. fungi I think you said that works too, does it still work post hurricane? | 19:39 |
| clarkb | (and anyone else should feel free to help too :) ) | 19:40 |
| fungi | yeah, it's fine. i'll be here with bells on | 19:40 |
| clarkb | great I'll see you all there then | 19:40 |
| clarkb | Next up is volume of ara file in ara reports is making ceph sad | 19:41 |
| clarkb | Wanted to bring this up to cover the changes we made really quickly | 19:41 |
| clarkb | first corvus updated the zuul dashboard to largely cover our needs there via the job output json file | 19:41 |
| clarkb | corvus: do we still need to get that fix for handlers merged? or do we just need an executor erstart for that? | 19:42 |
| corvus | er 1 sec; i'm unprepared :) | 19:42 |
| corvus | https://review.opendev.org/680726 is unmerged, but not very important | 19:43 |
| clarkb | interseting that zuul didn't enqueue it when its parent merged | 19:44 |
| corvus | the current output is misleading if ansible "handler" tasks are used, but they don't get used that often in the main body of jobs | 19:44 |
| clarkb | in any case we stopped running ara for every job | 19:44 |
| clarkb | nested ara runs are still there but the root report is no longer a thing | 19:44 |
| clarkb | that should cut back on our total object count for log files in swift/ceph | 19:44 |
| corvus | clarkb: it did; but zuul's gate pipeline doesn't honor 'recheck' | 19:44 |
| clarkb | the other major chagne we made was to shard logs into containers based on the first three chars of the build uuid | 19:44 |
| clarkb | we should get 4096 containers in each cloud region to shard logs into as a result | 19:45 |
| clarkb | hopeflly that spreads things out well | 19:45 |
| clarkb | corvus: ah | 19:45 |
| clarkb | and as of this mornign all swifts are back in service | 19:45 |
| corvus | i still consider the current state an emergency fix... and we should figure out what to do about nested aras | 19:45 |
| clarkb | corvus: k | 19:45 |
| clarkb | vexxhost is the last remaining cloud we've kept out (it is ceph) | 19:45 |
| clarkb | I think as soon as mnaser is ready for us to try using vexxhost again we can go ahead and do that | 19:46 |
| corvus | we know that we have reduced the file count by turning off the zuul-ara, but we don't know what proportion of the files that was compared to nested-ara -- meaning we don't know how much of an impact the nested-aras will continue to be | 19:47 |
| corvus | i suspect it's still significant, and if so, it would be good to come up with another option there | 19:47 |
| clarkb | correct. We have also removed hot containers like periodic/ by replacing them with the build uuid sharded containers | 19:47 |
| corvus | there was an etherpad with ideas, right? | 19:48 |
| corvus | dmsimard: ping | 19:48 |
| clarkb | #link https://etherpad.openstack.org/p/Vz5IzxlWFz ARA file count reduction ideas | 19:48 |
| corvus | i feel like #2 isn't worth the gain | 19:49 |
| fungi | yeah, i got the impression some of those nested aras reported on orders of magnitude more ansible tasks than our job ara | 19:49 |
| corvus | if that's the case, then turning off zuul-ara may not change as much as we'd hoped. | 19:49 |
| clarkb | fungi: but we run an order of magnitude fewer jobs for them (I think) | 19:49 |
| corvus | maybe that cancels out? | 19:49 |
| fungi | the number of tasks involved in, e.g., deploying a complete openstack is waaaay more than to run a typical zuul job | 19:50 |
| fungi | but yes, hard to know due to the difference in frequency | 19:50 |
| clarkb | nested ara is just system-config jobs, osa, and tripleo | 19:50 |
| clarkb | (at least those are the ones I know of) | 19:50 |
| corvus | it's "just tripleo" i'm worried about :) | 19:50 |
| clarkb | ya that could be significant (though their use of resources is more due to running long multinode jobs than many many jobs I think) | 19:51 |
| corvus | looking at the etherpad, broadly, i see only two ways to improve this: 1) use a static server; 2) do more in javascript | 19:51 |
| dmsimard | hi, I'm here | 19:51 |
| fungi | those were basically the two possible roads i was aware of | 19:51 |
| fungi | do more server-side (so not in swift since we can't provide our own swift middleware), or do more on the client side (so probably with js) | 19:52 |
| corvus | if we need to do something urgently, #1 (static server) is probably the only thing that will do. if our effort so far has given us some breathing room, we can look into #2 (javascript development) | 19:52 |
| clarkb | corvus: I think the current swift clouds have no problem with the existing setup (at least I've not heard complaints) | 19:53 |
| clarkb | corvus: given that I think we do have breathing room | 19:53 |
| dmsimard | using the sqlite middleware is my preferred option, it was designed to solve this exact problem | 19:53 |
| dmsimard | I do not have the javascript skills to take on the other option | 19:53 |
| fungi | we'll presumably know more for sure as we approach our retention | 19:53 |
| fungi | about whether it's a strain on them | 19:54 |
| clarkb | fungi: ya and donnyd can likely give us detailed info | 19:54 |
| corvus | i'm not opposed to using a static server; i'm opposed to being personally responsible for sysadmining one | 19:54 |
| clarkb | https://grafana.fortnebula.com/d/9MMqh8HWk/openstack-utilization?orgId=2&refresh=30s publishes swift info from FN | 19:55 |
| corvus | i'm over-extended (as i think the team is), so i'm trying to simplify both the system and our responsibilities, so i'd still like to avoid that if possible | 19:55 |
| donnyd | yea, and there is little in the way of load on those swift servers | 19:55 |
| clarkb | corvus: ++ also we've found that there are problems with sysadmining such a system even if we have all the time to do it | 19:55 |
| donnyd | I can also grab any other stats needed and publish them | 19:55 |
| clarkb | particularly around device limits and volume attachments (one alternative we considered was ceph but if it has problems with the object store version of this will it have problems with the block/fs version?) | 19:56 |
| donnyd | i am 2x on objects, so what you see there you can /2 | 19:56 |
| corvus | dmsimard: we talked about maybe zuul and ara sharing some react widgets... maybe we can find a way to combine zuul's "load data from json" approach with ara? | 19:57 |
| donnyd | I am about to move swift to nvme so it really won't matter on my end at all | 19:57 |
| clarkb | (as a timecheck we have just under 3 minutes left in the meeting but this was the agenda so we can talk about ara until then) | 19:57 |
| clarkb | more than happy to have further discussion in #openstack-infra on this topic or any other afterwards too | 19:57 |
| corvus | dmsimard: i don't know what that looks like, or how to do it, but i feel like there should be something we can do to start converging | 19:58 |
| dmsimard | corvus: yes, I believe it was tristanC who came up with that. I'll be at the office with him tomorrow, will bring it up. | 19:58 |
| corvus | dmsimard: cool -- why don't the 2 of you bat around some ideas, and then maybe the 3 of us can have a conference call or something afterwords? | 19:59 |
| dmsimard | sounds like a plan | 20:00 |
| clarkb | and we are at time. Thank you everyone! | 20:00 |
| clarkb | #endmeeting | 20:00 |
| corvus | (others welcome too of course; mostly just trying to get some effective brainstorming/design time to get something started) | 20:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
| openstack | Meeting ended Tue Sep 10 20:00:10 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-10-19.01.html | 20:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-10-19.01.txt | 20:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-09-10-19.01.log.html | 20:00 |
| corvus | dmsimard: thanks! | 20:00 |
| *** Shrews has left #openstack-meeting | 20:00 | |
| fungi | tank yuh, clarkb! | 20:00 |
| *** enriquetaso has quit IRC | 20:15 | |
| *** e0ne has quit IRC | 20:19 | |
| *** ociuhandu has joined #openstack-meeting | 20:37 | |
| *** ociuhandu has quit IRC | 20:52 | |
| *** ociuhandu has joined #openstack-meeting | 20:53 | |
| *** ociuhandu has quit IRC | 20:57 | |
| *** shubham_potale has quit IRC | 21:02 | |
| *** raildo has quit IRC | 21:06 | |
| *** hemna has joined #openstack-meeting | 21:29 | |
| *** hemna has quit IRC | 21:34 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:35 | |
| *** mriedem has quit IRC | 21:37 | |
| *** aloga has quit IRC | 21:45 | |
| *** hemna has joined #openstack-meeting | 21:57 | |
| *** jamesmcarthur has quit IRC | 22:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:15 | |
| *** jamesmcarthur has quit IRC | 22:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:18 | |
| *** slaweq has quit IRC | 22:21 | |
| *** jamesmcarthur has quit IRC | 22:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:24 | |
| *** panda has quit IRC | 22:26 | |
| *** panda has joined #openstack-meeting | 22:28 | |
| *** aloga has joined #openstack-meeting | 22:29 | |
| *** ociuhandu has joined #openstack-meeting | 22:30 | |
| *** ociuhandu has quit IRC | 22:35 | |
| *** jamesmcarthur has quit IRC | 22:37 | |
| *** brault has joined #openstack-meeting | 22:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:44 | |
| *** hemna has quit IRC | 22:50 | |
| *** mattw4 has joined #openstack-meeting | 22:55 | |
| *** jamesmcarthur has quit IRC | 22:57 | |
| *** brault has quit IRC | 22:59 | |
| *** rcernin has joined #openstack-meeting | 22:59 | |
| *** mattw4 has quit IRC | 23:00 | |
| *** macz has quit IRC | 23:05 | |
| *** slaweq has joined #openstack-meeting | 23:11 | |
| *** slaweq has quit IRC | 23:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:18 | |
| *** jamesmcarthur has quit IRC | 23:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:23 | |
| *** _pewp_ has joined #openstack-meeting | 23:24 | |
| *** jamesmcarthur has quit IRC | 23:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:31 | |
| *** ykatabam has joined #openstack-meeting | 23:32 | |
| *** mlavalle has quit IRC | 23:37 | |
| *** jamesmcarthur has quit IRC | 23:41 | |
| *** mtreinish has quit IRC | 23:43 | |
| *** mtreinish has joined #openstack-meeting | 23:48 | |
| *** ykatabam has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!