| *** _alastor_ has quit IRC | 00:02 | |
| *** jesusaur has quit IRC | 00:02 | |
| *** tetsuro has joined #openstack-meeting | 00:04 | |
| *** cloudrancher has quit IRC | 00:08 | |
| *** cloudrancher has joined #openstack-meeting | 00:09 | |
| *** gouthamr has left #openstack-meeting | 00:14 | |
| *** gouthamr has joined #openstack-meeting | 00:14 | |
| *** slaweq has joined #openstack-meeting | 00:16 | |
| *** mriedem_away has quit IRC | 00:23 | |
| *** jesusaur has joined #openstack-meeting | 00:23 | |
| *** slaweq has quit IRC | 00:24 | |
| *** ijw has quit IRC | 00:28 | |
| *** ijw has joined #openstack-meeting | 00:29 | |
| *** Liang__ has joined #openstack-meeting | 00:32 | |
| *** armstrong has quit IRC | 00:34 | |
| *** longkb has joined #openstack-meeting | 00:39 | |
| *** longkb has quit IRC | 00:39 | |
| *** _alastor_ has joined #openstack-meeting | 00:54 | |
| *** _alastor_ has quit IRC | 00:59 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:04 | |
| *** jamesmcarthur has quit IRC | 01:08 | |
| *** slaweq has joined #openstack-meeting | 01:16 | |
| *** slaweq has quit IRC | 01:24 | |
| *** ijw has quit IRC | 01:47 | |
| *** ijw has joined #openstack-meeting | 01:48 | |
| *** ijw has quit IRC | 01:52 | |
| *** hongbin has joined #openstack-meeting | 01:55 | |
| *** slaweq has joined #openstack-meeting | 02:13 | |
| *** bzhao__ has joined #openstack-meeting | 02:20 | |
| *** slaweq has quit IRC | 02:24 | |
| *** bzhao__ has quit IRC | 02:27 | |
| *** bzhao__ has joined #openstack-meeting | 02:34 | |
| *** cloudrancher has quit IRC | 02:38 | |
| *** cloudrancher has joined #openstack-meeting | 02:39 | |
| *** psachin has joined #openstack-meeting | 02:40 | |
| *** yamahata has quit IRC | 02:41 | |
| *** iyamahat_ has quit IRC | 02:41 | |
| *** mhen has quit IRC | 02:43 | |
| *** mhen has joined #openstack-meeting | 02:47 | |
| *** whoami-rajat has joined #openstack-meeting | 02:50 | |
| *** ijw has joined #openstack-meeting | 02:56 | |
| *** tashiromt__ has joined #openstack-meeting | 02:59 | |
| *** ijw has quit IRC | 03:01 | |
| *** tashiromt__ has quit IRC | 03:03 | |
| *** Liang__ is now known as LiangFang | 03:06 | |
| *** dtroyer has quit IRC | 03:10 | |
| *** slaweq has joined #openstack-meeting | 03:16 | |
| *** artom has quit IRC | 03:21 | |
| *** artom has joined #openstack-meeting | 03:24 | |
| *** slaweq has quit IRC | 03:24 | |
| *** sridharg has joined #openstack-meeting | 03:33 | |
| *** ijw has joined #openstack-meeting | 03:34 | |
| *** ijw has quit IRC | 03:39 | |
| *** diablo_rojo has quit IRC | 03:42 | |
| *** tpatil has joined #openstack-meeting | 03:52 | |
| *** tashiromt has joined #openstack-meeting | 03:59 | |
| tpatil | Today Sampath might join late or skip this meeting as he is busy in attending some conference. So I will chair today's Masakari meeting | 04:01 |
|---|---|---|
| tpatil | #startmeeting Masakari | 04:01 |
| openstack | Meeting started Tue Nov 27 04:01:15 2018 UTC and is due to finish in 60 minutes. The chair is tpatil. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:01 |
| *** openstack changes topic to " (Meeting topic: Masakari)" | 04:01 | |
| openstack | The meeting name has been set to 'masakari' | 04:01 |
| tpatil | #topic Bugs (stuck/critical) | 04:01 |
| *** openstack changes topic to "Bugs (stuck/critical) (Meeting topic: Masakari)" | 04:01 | |
| tpatil | Last week this patch was merged : https://review.openstack.org/#/c/615752/ | 04:02 |
| tpatil | Need to confirm if this issue is present in stable branch Rocky release | 04:02 |
| tpatil | Sampath was going to check it at his end | 04:03 |
| *** sagara has joined #openstack-meeting | 04:04 | |
| tpatil | Since he is not here, I will ask him about this status later | 04:04 |
| *** hongbin has quit IRC | 04:06 | |
| tpatil | Do you want to discuss about any other critical bugs? | 04:06 |
| *** tashiromt_ has joined #openstack-meeting | 04:07 | |
| tpatil | Ok. Moving ahead | 04:08 |
| tpatil | #topic Stein Work Items | 04:08 |
| *** openstack changes topic to "Stein Work Items (Meeting topic: Masakari)" | 04:08 | |
| tpatil | Add functional tests to openstacksdk | 04:09 |
| *** iyamahat has joined #openstack-meeting | 04:09 | |
| tpatil | Two days ago, patch proposed to add functional tests in openstacksdk got merged | 04:10 |
| tpatil | #link https://review.openstack.org/#/c/615744/ | 04:10 |
| tpatil | Now, need to work on adding detailed functional tests in masakari | 04:10 |
| *** tashiromt has quit IRC | 04:10 | |
| *** slaweq has joined #openstack-meeting | 04:11 | |
| sagara | tpatil: Are there other work items? | 04:13 |
| tpatil | Notification implementation | 04:13 |
| tpatil | Few unit tests are failing, team is working on looking into this issue | 04:14 |
| tpatil | will propose the patches as soon as it is done | 04:14 |
| *** ShilpaSD has joined #openstack-meeting | 04:14 | |
| tpatil | That's all update from my end about stein work items | 04:14 |
| sagara | tpatil: Thanks | 04:15 |
| tpatil | If no other topic is left for discussion, let's end this meeting early | 04:16 |
| sagara | tpatil: From my side, nothing. | 04:17 |
| tpatil | OK, let's end this meeting | 04:17 |
| tpatil | Thank you, All | 04:18 |
| tpatil | #endmeeting | 04:18 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:18 | |
| openstack | Meeting ended Tue Nov 27 04:18:05 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:18 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-11-27-04.01.html | 04:18 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-11-27-04.01.txt | 04:18 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-11-27-04.01.log.html | 04:18 |
| *** sagara has quit IRC | 04:18 | |
| *** tashiromt_ has quit IRC | 04:22 | |
| *** slaweq has quit IRC | 04:24 | |
| *** yamahata has joined #openstack-meeting | 04:27 | |
| *** janki has joined #openstack-meeting | 04:49 | |
| *** ijw has joined #openstack-meeting | 04:50 | |
| *** tpatil has quit IRC | 04:52 | |
| *** ijw has quit IRC | 04:55 | |
| *** ijw has joined #openstack-meeting | 05:10 | |
| *** ijw has quit IRC | 05:14 | |
| *** ijw has joined #openstack-meeting | 05:28 | |
| *** ijw has quit IRC | 05:33 | |
| *** ijw has joined #openstack-meeting | 05:47 | |
| *** ijw has quit IRC | 05:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:04 | |
| *** ijw has joined #openstack-meeting | 06:06 | |
| *** jamesmcarthur has quit IRC | 06:09 | |
| *** ijw has quit IRC | 06:10 | |
| *** slaweq has joined #openstack-meeting | 06:11 | |
| *** slaweq has quit IRC | 06:24 | |
| *** _alastor_ has joined #openstack-meeting | 06:35 | |
| *** arne_wiebalck_ has joined #openstack-meeting | 06:36 | |
| *** arne_wiebalck_ has quit IRC | 06:37 | |
| *** _alastor_ has quit IRC | 06:40 | |
| *** Luzi has joined #openstack-meeting | 06:45 | |
| *** rcernin has quit IRC | 06:58 | |
| *** dkushwaha has joined #openstack-meeting | 07:02 | |
| *** jawad_axd has joined #openstack-meeting | 07:16 | |
| *** aojea has joined #openstack-meeting | 07:21 | |
| *** pcaruana has joined #openstack-meeting | 07:23 | |
| *** kopecmartin|off is now known as kopecmartin | 07:26 | |
| *** slaweq has joined #openstack-meeting | 07:42 | |
| *** bhagyashris has joined #openstack-meeting | 07:52 | |
| *** joxyuki has joined #openstack-meeting | 07:53 | |
| *** phuoc has joined #openstack-meeting | 07:59 | |
| *** longkb has joined #openstack-meeting | 08:00 | |
| *** YanXing_an has joined #openstack-meeting | 08:02 | |
| dkushwaha | #startmeeting tacker | 08:03 |
| openstack | Meeting started Tue Nov 27 08:03:10 2018 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:03 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:03 | |
| openstack | The meeting name has been set to 'tacker' | 08:03 |
| phuoc | hi | 08:03 |
| dkushwaha | #topic Roll Call | 08:03 |
| *** tpatil has joined #openstack-meeting | 08:03 | |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:03 | |
| YanXing_an | hi | 08:03 |
| phuoc | o/ | 08:03 |
| dkushwaha | who is here for Tacker weekly meeting ? | 08:03 |
| bhagyashris | O/ | 08:04 |
| dkushwaha | hello YanXing_an phuoc | 08:04 |
| dkushwaha | ok lets start | 08:05 |
| dkushwaha | #chair phuoc YanXing_an | 08:05 |
| openstack | Current chairs: YanXing_an dkushwaha phuoc | 08:05 |
| dkushwaha | #topic BerlinSummit | 08:05 |
| *** openstack changes topic to "BerlinSummit (Meeting topic: tacker)" | 08:05 | |
| dkushwaha | I missed the all core members this time. As no one in summit this time | 08:06 |
| joxyuki | hi | 08:07 |
| dkushwaha | hope to see in next summit :) | 08:07 |
| dkushwaha | hi joxyuki | 08:07 |
| phuoc | me too | 08:08 |
| YanXing_an | wish being there in next summit | 08:08 |
| dkushwaha | I had been asked a question in summit regarding Tacker deployment on container. but I had not tried it, so i was not able to explain it that time. Is anyone deployed on container? | 08:09 |
| *** hadai has joined #openstack-meeting | 08:09 | |
| phuoc | users can use kolla to deploy tacker on container | 08:09 |
| dkushwaha | phuoc, yea I see. have you tried? | 08:10 |
| phuoc | not yet | 08:11 |
| dkushwaha | ok, i will try some days. | 08:11 |
| phuoc | but I will try it soon | 08:11 |
| dkushwaha | phuoc, cool | 08:11 |
| phuoc | kolla seems to be good for deploying openstack | 08:11 |
| dkushwaha | phuoc, yea, so many attendees joined kolla project onboarding & update session this time. and room was almost packed | 08:12 |
| *** tssurya has joined #openstack-meeting | 08:13 | |
| dkushwaha | ok, move on. | 08:13 |
| dkushwaha | #topic BPs | 08:13 |
| *** openstack changes topic to "BPs (Meeting topic: tacker)" | 08:13 | |
| dkushwaha | seems multiple patches on test-addition-refactoring | 08:14 |
| dkushwaha | That is great | 08:15 |
| dkushwaha | YanXing_an, Thanks for leading this BP | 08:15 |
| YanXing_an | https://etherpad.openstack.org/p/test-addition-refactoring | 08:15 |
| YanXing_an | you can see the detail plan and the status | 08:16 |
| phuoc | that looks good to me | 08:17 |
| joxyuki | great | 08:17 |
| dkushwaha | YanXing_an, nice work | 08:17 |
| YanXing_an | :) | 08:18 |
| dkushwaha | YanXing_an, could you please prioritize skipped cases. I think it will help to reduces some rework | 08:18 |
| dkushwaha | YanXing_an, as in point 3 | 08:18 |
| YanXing_an | dkushwaha, sure, these skipped case will be reopened during point 2, and will have high priority | 08:20 |
| *** lpetrut has joined #openstack-meeting | 08:21 | |
| dkushwaha | YanXing_an, Thanks | 08:21 |
| dkushwaha | phuoc, do you have something to talk ? | 08:22 |
| *** priteau has joined #openstack-meeting | 08:23 | |
| phuoc | dkushwaha, I plan to help force delete resources | 08:23 |
| phuoc | I will upload some patches soon | 08:23 |
| dkushwaha | phuoc, sounds good. | 08:23 |
| tpatil | phouc: Will it delete resource from heat as well or only tacker? | 08:24 |
| tpatil | phuoc: Sorry to misspell your name | 08:24 |
| dkushwaha | phuoc, i had just submited initial draft on spec, | 08:24 |
| dkushwaha | phuoc, https://review.openstack.org/#/c/602528/ | 08:25 |
| phuoc | dkushwaha, I will look at it | 08:25 |
| tpatil | We are also trying to fix one similar issue : https://review.openstack.org/#/c/618086/ | 08:25 |
| tpatil | Got one comment from Yan Xing an, will address his comment soon | 08:26 |
| tpatil | phuoc: Please take a look at this patch and give us your feedback | 08:26 |
| phuoc | tpatil, I saw your patch | 08:26 |
| tpatil | phuoc: We will upload a new PS which will cover interacting with heat to ensure all resources from VIM are deleted before deleting the VNF | 08:27 |
| phuoc | I will add --force in tacker delete commands first | 08:28 |
| phuoc | tpatil, and I will make it compatible with your patch too | 08:28 |
| *** ralonsoh has joined #openstack-meeting | 08:29 | |
| tpatil | phuoc: Ok, Great. Thank you | 08:29 |
| phuoc | np :) | 08:31 |
| dkushwaha | tpatil, phuoc IMO, force-delete should be for the case only when normal delete not able to clean the resources. So even there any error from backend(i.e. heat), it should move forward and clean entries from tacker | 08:33 |
| phuoc | yes, it should cover all cases, in which we cant not remove resources | 08:35 |
| YanXing_an | dkushwaha, agree with you, force-delete hardly fail to delete | 08:36 |
| tpatil | dkushwaha: Yes, I have understood it but it's also important to delete the heat resources before actually cleaning entries from tacker. That's my main point. Otherwise as an operator, those resource would need to be cleaned up manually | 08:36 |
| *** ijw has joined #openstack-meeting | 08:36 | |
| dkushwaha | another thing is, we can not control all the external behavior where normal workflow failed. So instead of blocking to delete from backend, we can just log error message and move forward step | 08:37 |
| tpatil | Some indication to operator is useful. Maybe an event will do with info like stack id or whatever. | 08:39 |
| phuoc | yes, we may log heat and mistral resource to let users delete it manually | 08:39 |
| dkushwaha | phuoc, +1 | 08:39 |
| dkushwaha | tpatil, yes, but my point is, we might stuck in never ending loop, so for cleaner approach, just request to delete, if fail from backend, log error message, and then clean from tacker side. | 08:41 |
| *** ijw has quit IRC | 08:41 | |
| dkushwaha | moving on | 08:43 |
| dkushwaha | joxyuki, do you have something to talk ? | 08:43 |
| joxyuki | nothing from me | 08:44 |
| tpatil | dkushwaha: sounds good to me | 08:44 |
| bhagyashris | Hi | 08:44 |
| bhagyashris | As comment given on patch https://review.openstack.org/#/c/612595/9 and discussion in the summit : ”vdu_autoheal" monitoring policy action implementation | 08:44 |
| bhagyashris | should be as per ETSI standard HealVnfRequest interface https://www.etsi.org/deliver/etsi_gs/NFV-SOL/001_099/003/02.05.01_60/gs_NFV-SOL003v020501p.pdf | 08:44 |
| *** irclogbot_1 has quit IRC | 08:44 | |
| bhagyashris | Started working on the same but have some quires detail description is at : http://paste.openstack.org/show/735705/ and http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000172.html so needs some feedback and inputs. | 08:44 |
| phuoc | bhagyashris, IMO in tosca.datatypes.nfv.VnfHealOperationConfiguration, there are missing actions on it | 08:47 |
| joxyuki | bhasyashris, I will investigate and reply to your query. | 08:48 |
| *** irclogbot_1 has joined #openstack-meeting | 08:48 | |
| dkushwaha | bhagyashris, after summit i just joined my work yesterday, and unfortunately I could not look into that. I will check and respond. | 08:48 |
| bhagyashris | ok | 08:49 |
| YanXing_an | bhagyashris, what's the difference between VnfHealRequest with alarm monitor | 08:49 |
| bhagyashris | Thank you :) | 08:49 |
| joxyuki | phouc, additional parameters such as action can be defined as a parameter. | 08:49 |
| *** tssurya has quit IRC | 08:49 | |
| phuoc | joxyuki, yes, we should have to define them | 08:50 |
| joxyuki | main oi | 08:50 |
| joxyuki | sorry | 08:50 |
| joxyuki | move on | 08:51 |
| dkushwaha | #topic Open Discussion | 08:52 |
| *** openstack changes topic to "Open Discussion (Meeting topic: tacker)" | 08:52 | |
| dkushwaha | no any update from my side | 08:53 |
| YanXing_an | my team have a focus time before the end of this year, so i wish we can finish all UT case refactoring in next month, so it’s very kindly to review all patches and give feedback, thanks. | 08:53 |
| *** irclogbot_1 has quit IRC | 08:53 | |
| dkushwaha | sure YanXing_an , and thanks again for being more active on that | 08:54 |
| dkushwaha | Do we have something to talk now? otherwise we can close this meeting. | 08:55 |
| dkushwaha | ok, Thanks to all Folks :) | 08:56 |
| dkushwaha | Closing this meeting for now | 08:56 |
| *** joxyuki has left #openstack-meeting | 08:57 | |
| dkushwaha | #endmeeting | 08:57 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:57 | |
| openstack | Meeting ended Tue Nov 27 08:57:05 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:57 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-11-27-08.03.html | 08:57 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-11-27-08.03.txt | 08:57 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-11-27-08.03.log.html | 08:57 |
| *** ijw has joined #openstack-meeting | 08:57 | |
| *** irclogbot_1 has joined #openstack-meeting | 08:57 | |
| *** tssurya has joined #openstack-meeting | 09:01 | |
| *** ijw has quit IRC | 09:01 | |
| *** tpatil has quit IRC | 09:02 | |
| *** rossella_s has joined #openstack-meeting | 09:04 | |
| *** hadai has quit IRC | 09:14 | |
| *** shrasool has joined #openstack-meeting | 09:17 | |
| *** dmacpher has joined #openstack-meeting | 09:19 | |
| *** YanXing_an has quit IRC | 09:20 | |
| *** bhagyashris has quit IRC | 09:44 | |
| *** dkushwaha has left #openstack-meeting | 09:47 | |
| *** longkb has quit IRC | 09:52 | |
| *** erlon has joined #openstack-meeting | 10:26 | |
| *** _alastor_ has joined #openstack-meeting | 10:37 | |
| *** _alastor_ has quit IRC | 10:41 | |
| *** jlvillal has joined #openstack-meeting | 10:58 | |
| *** LiangFang has quit IRC | 11:11 | |
| *** electrofelix has joined #openstack-meeting | 11:17 | |
| *** phuoc has left #openstack-meeting | 11:17 | |
| *** dosaboy has quit IRC | 11:24 | |
| *** dosaboy has joined #openstack-meeting | 11:31 | |
| *** sambetts_ is now known as sambetts|afk | 11:32 | |
| *** raildo has joined #openstack-meeting | 11:37 | |
| *** armstrong has joined #openstack-meeting | 11:43 | |
| *** rfolco is now known as rfolco_doctor | 11:45 | |
| *** janki has quit IRC | 11:59 | |
| *** tetsuro has quit IRC | 12:13 | |
| *** yamamoto has quit IRC | 12:16 | |
| *** yamamoto has joined #openstack-meeting | 12:16 | |
| *** shrasool has quit IRC | 12:27 | |
| *** Luzi has quit IRC | 12:32 | |
| *** Luzi has joined #openstack-meeting | 12:47 | |
| *** erlon has quit IRC | 12:48 | |
| *** vishalmanchanda has joined #openstack-meeting | 12:48 | |
| *** takamatsu has quit IRC | 12:58 | |
| *** erlon has joined #openstack-meeting | 12:59 | |
| *** aojeagarcia has joined #openstack-meeting | 13:09 | |
| *** aojea has quit IRC | 13:09 | |
| *** shrasool has joined #openstack-meeting | 13:14 | |
| *** takamatsu has joined #openstack-meeting | 13:21 | |
| *** _alastor_ has joined #openstack-meeting | 13:31 | |
| *** takamatsu has quit IRC | 13:37 | |
| *** takamatsu has joined #openstack-meeting | 13:43 | |
| *** jhesketh_ has joined #openstack-meeting | 13:44 | |
| *** whoami-rajat has quit IRC | 13:49 | |
| *** jhesketh has quit IRC | 13:50 | |
| *** armstrong has quit IRC | 13:53 | |
| *** davidsha has joined #openstack-meeting | 13:53 | |
| *** bobh has joined #openstack-meeting | 14:14 | |
| *** cloudrancher has quit IRC | 14:15 | |
| *** cloudrancher has joined #openstack-meeting | 14:15 | |
| *** mriedem has joined #openstack-meeting | 14:18 | |
| *** eharney has joined #openstack-meeting | 14:19 | |
| *** dustins has joined #openstack-meeting | 14:20 | |
| *** _alastor_ has quit IRC | 14:33 | |
| *** hongbin has joined #openstack-meeting | 14:41 | |
| *** rfolco_doctor is now known as rfolco | 14:53 | |
| *** awaugama has joined #openstack-meeting | 14:59 | |
| *** awaugama has quit IRC | 14:59 | |
| *** edmondsw has joined #openstack-meeting | 14:59 | |
| *** awaugama has joined #openstack-meeting | 15:01 | |
| *** ianychoi_ is now known as ianychoi | 15:06 | |
| *** lpetrut has quit IRC | 15:18 | |
| *** eharney has quit IRC | 15:19 | |
| *** eharney has joined #openstack-meeting | 15:26 | |
| *** mjturek has joined #openstack-meeting | 15:30 | |
| *** jawad_axd has quit IRC | 15:49 | |
| *** jawad_axd has joined #openstack-meeting | 15:50 | |
| *** Luzi has quit IRC | 15:51 | |
| *** dtrainor__ is now known as dtrainor | 15:52 | |
| *** jawad_axd has quit IRC | 15:55 | |
| *** ttsiouts has joined #openstack-meeting | 15:58 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Nov 27 16:00:18 2018 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| slaweq | hi | 16:00 |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| bcafarel | o/ | 16:00 |
| slaweq | let's wait few minutes for the others | 16:01 |
| *** njohnston has joined #openstack-meeting | 16:02 | |
| hongbin | o/ | 16:02 |
| *** dansmith has quit IRC | 16:02 | |
| slaweq | I pinged them on openstack-neutron channel | 16:02 |
| njohnston | o/ | 16:02 |
| *** dansmith has joined #openstack-meeting | 16:02 | |
| *** diablo_rojo has joined #openstack-meeting | 16:02 | |
| *** mlavalle has joined #openstack-meeting | 16:03 | |
| mlavalle | sorry, I thought it was 1 hour from now | 16:03 |
| mlavalle | not used to winter time yet | 16:04 |
| slaweq | :) | 16:04 |
| bcafarel | :) | 16:04 |
| slaweq | ok, so lets start | 16:04 |
| slaweq | #topic Actions from previous meetings | 16:04 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:04 | |
| slaweq | mlavalle to continue tracking not reachable FIP in trunk tests | 16:04 |
| mlavalle | yes | 16:04 |
| mlavalle | that entails merging https://review.openstack.org/#/c/618750 | 16:04 |
| *** cloudrancher has quit IRC | 16:04 | |
| slaweq | this was added only to not forget about it IIRC, as we first want to get my patch merged | 16:05 |
| mlavalle | (I just approved it) | 16:05 |
| slaweq | right mlavalle :) | 16:05 |
| slaweq | thx | 16:05 |
| mlavalle | and then looking at the effects for some days | 16:05 |
| slaweq | so I will add this action for next week too to remember it, ok? | 16:05 |
| mlavalle | yes | 16:05 |
| slaweq | #action mlavalle to continue tracking not reachable FIP in trunk tests | 16:05 |
| slaweq | thx | 16:05 |
| *** cloudrancher has joined #openstack-meeting | 16:05 | |
| slaweq | that was quick :) | 16:05 |
| slaweq | next one | 16:05 |
| slaweq | slaweq to check which experimental jobs can be removed | 16:05 |
| mlavalle | I was actually going to ping you.... | 16:05 |
| slaweq | why? | 16:06 |
| mlavalle | do you have a pointer to a traceback of the failute that the patch^^ is supposed to fix | 16:06 |
| mlavalle | ? | 16:06 |
| slaweq | sure | 16:06 |
| *** munimeha1 has joined #openstack-meeting | 16:06 | |
| slaweq | there is a lot of such issues recently | 16:06 |
| mlavalle | I want to see if I find it in the trunk test failure | 16:07 |
| slaweq | e.g. http://logs.openstack.org/23/619923/2/check/neutron-tempest-dvr-ha-multinode-full/e356b9a/logs/subnode-2/screen-q-l3.txt.gz?level=ERROR | 16:07 |
| slaweq | and it happens in different tests, not only in trunk | 16:07 |
| mlavalle | exactly, that is what I was looking for | 16:07 |
| slaweq | it's general problem with FIP connectivity | 16:08 |
| mlavalle | thanks | 16:08 |
| slaweq | yw | 16:08 |
| slaweq | ok, so going back to not needed experimental jobs | 16:08 |
| haleyb | slaweq: sorry, i need to help a repair man here, just assign me some tasks :) | 16:08 |
| slaweq | I did patch to remove some of them: https://review.openstack.org/619719 | 16:08 |
| slaweq | haleyb: sure - that we can do definitelly | 16:09 |
| mlavalle | we are all repair men here | 16:09 |
| mlavalle | haleyb: ^^^^ | 16:09 |
| slaweq | #action haleyb takes all this week :D | 16:09 |
| njohnston | lol | 16:09 |
| slaweq | mlavalle: please take a look at this patch https://review.openstack.org/619719 - it has already +2 from haleyb | 16:10 |
| mlavalle | slaweq: added to the pile | 16:10 |
| slaweq | mlavalle: thx | 16:10 |
| slaweq | ok, moving on | 16:10 |
| slaweq | next one was: slaweq to start migrating neutron CI jobs to zuul v3 syntax | 16:10 |
| slaweq | I opened bug for that https://bugs.launchpad.net/neutron/+bug/1804844 | 16:11 |
| openstack | Launchpad bug 1804844 in neutron "CI jobs definitions should be migrated to Zuul v3 syntax" [Low,Confirmed] - Assigned to Slawek Kaplonski (slaweq) | 16:11 |
| *** _alastor_ has joined #openstack-meeting | 16:11 | |
| slaweq | And I pushed first patch for functional tests but it’s WIP now: https://review.openstack.org/#/c/619742/ | 16:11 |
| *** jamesmcarthur has joined #openstack-meeting | 16:11 | |
| njohnston | thanks for working on that | 16:11 |
| slaweq | so if someone wants to work on migration for some job, please feel free to do it and push patch related to this bug | 16:11 |
| slaweq | it is in fact a lot of patches to do but I though that one bug to track them all will be enough | 16:12 |
| mlavalle | good idea | 16:12 |
| slaweq | ok, next one | 16:13 |
| slaweq | njohnston to switch neutron to use integrated-gate-py35 with grenade-py3 job instead of our neutron-grenade job | 16:13 |
| slaweq | njohnston: any update on this one? | 16:14 |
| njohnston | So the grenade-py3 job is already in check and gate queue. I am watching it for a few runs | 16:14 |
| njohnston | Just for due diligence, then I'll push up a. change to disable neutron-grenade. | 16:15 |
| slaweq | where it is in gate alreade? | 16:16 |
| slaweq | *already | 16:16 |
| slaweq | I don't see it | 16:16 |
| njohnston | it is inherited from one of the templates we include | 16:16 |
| njohnston | but if you look at any neutron job in zuul.openstack.org you'll see grenade-py3 | 16:17 |
| slaweq | ahh, ok | 16:18 |
| slaweq | I see it now | 16:18 |
| slaweq | so we only need to remove neutron-grenade job now and we will be done with this, right? | 16:18 |
| njohnston | yep! | 16:19 |
| slaweq | good | 16:19 |
| slaweq | will You do it this week? | 16:19 |
| njohnston | I should have the change up within the hour | 16:19 |
| slaweq | #action njohnston to remove neutron-grenade job from neutron's CI queues | 16:19 |
| slaweq | thx njohnston | 16:19 |
| njohnston | just waiting for the job I am watching to finish | 16:19 |
| slaweq | ok | 16:20 |
| slaweq | so lets move on to the next onw | 16:20 |
| slaweq | *one | 16:20 |
| slaweq | slaweq to check bug 1798475 | 16:20 |
| openstack | bug 1798475 in neutron "Fullstack test test_ha_router_restart_agents_no_packet_lost failing" [High,Confirmed] https://launchpad.net/bugs/1798475 | 16:20 |
| slaweq | I sent patch to store all journal logs in fullstack results: https://review.openstack.org/#/c/619935/ | 16:20 |
| slaweq | I hope this will help to debug this issue as we will be able to see what is keepalived doing then. | 16:20 |
| mlavalle | I'll review it today | 16:20 |
| slaweq | in the future when jobs will be migrated to zuulv3 format I think this can be added as role and added to all jobs as it can be helpful with some keepalived or dnsmasq logs | 16:21 |
| njohnston | it's a great idea regardless | 16:21 |
| mlavalle | yeap | 16:21 |
| slaweq | but for now I want it only in fullstack job as first step | 16:21 |
| *** artom has quit IRC | 16:22 | |
| slaweq | #action slaweq to continue debugging bug 1798475 when journal log will be available in fullstack tests | 16:22 |
| openstack | bug 1798475 in neutron "Fullstack test test_ha_router_restart_agents_no_packet_lost failing" [High,Confirmed] https://launchpad.net/bugs/1798475 | 16:22 |
| *** artom has joined #openstack-meeting | 16:22 | |
| slaweq | ok, lets move on | 16:22 |
| *** eharney has quit IRC | 16:23 | |
| slaweq | slaweq to check why db_migration functional tests don't have logs | 16:23 |
| slaweq | patch https://review.openstack.org/619266 | 16:23 |
| *** armax has quit IRC | 16:23 | |
| slaweq | it's merged already | 16:23 |
| slaweq | so now we should have logs from all functional tests in job results | 16:23 |
| slaweq | next one was: | 16:24 |
| slaweq | njohnston to remove neutron-fullstack-python36 from grafana dashboard | 16:24 |
| njohnston | One side note on the removal of the neutron-grenade job; that job is actually in the check and gate queue for the grenade project so I'll push a change in grenade to remove those first, and use a Depends-On to make sure that goes through before the neutron change | 16:24 |
| njohnston | Regarding neutron-fullstack-python36, I remember adding it, but when I went to project-config I could find no reference to it. So that is a no-op. | 16:25 |
| slaweq | ahh, that's good | 16:26 |
| slaweq | so it's done :) | 16:26 |
| slaweq | thx njohnston for checking it | 16:26 |
| slaweq | ok, so that was all actions for today | 16:26 |
| mlavalle | fwiw | 16:26 |
| slaweq | anything else to add or can we move on? | 16:27 |
| mlavalle | nothing from me | 16:27 |
| slaweq | ok, so next topic then | 16:27 |
| slaweq | #topic Python 3 | 16:27 |
| *** openstack changes topic to "Python 3 (Meeting topic: neutron_ci)" | 16:27 | |
| slaweq | njohnston: bcafarel any updates from You? | 16:27 |
| bcafarel | from next week not much I think | 16:28 |
| bcafarel | *previous | 16:28 |
| bcafarel | slaweq: except someone digging into functional tests for py3 | 16:28 |
| *** apetrich has quit IRC | 16:28 | |
| slaweq | ok, about this functional tests it is real problem | 16:29 |
| njohnston | nothing from me because of PTO | 16:29 |
| slaweq | I pushed today some DNM patch to test those tests with less output: https://review.openstack.org/#/c/620271/ | 16:29 |
| slaweq | and indeed it was better | 16:30 |
| *** lpetrut has joined #openstack-meeting | 16:30 | |
| slaweq | but not perfect | 16:30 |
| slaweq | I also talked with mtreinish about it and he told me that it's know issue with stestr and too much output from tests | 16:30 |
| bcafarel | :/ | 16:30 |
| njohnston | :-[ | 16:30 |
| slaweq | so based on his comments I think that only workaround for this is to make somehow that our tests will produce less on stdout/stderr | 16:31 |
| slaweq | also in my DNM patch I had 3 tests failing: http://logs.openstack.org/71/620271/2/check/neutron-functional/a7fd8ea/logs/testr_results.html.gz | 16:31 |
| slaweq | it looks for me that it's related to issue with SIGHUP | 16:32 |
| slaweq | so I'm not sure if we shouldn't skip/mark as usnstable those tests for now | 16:32 |
| slaweq | I will try once again this DNM patch but with those 3 tests marked as unstable to check how it will be then | 16:33 |
| slaweq | and we will see then | 16:33 |
| slaweq | if anyone has some idea how to fix/workaround this problem, that would be great | 16:34 |
| slaweq | patch to switch functional tests to py3 is here: https://review.openstack.org/#/c/577383/ | 16:34 |
| bcafarel | sounds good, we do have https://bugs.launchpad.net/neutron/+bug/1780139 open for the SIGHUP issue | 16:34 |
| openstack | Launchpad bug 1780139 in neutron "Sending SIGHUP to neutron-server process causes it to hang" [Undecided,Triaged] - Assigned to Bernard Cafarelli (bcafarel) | 16:34 |
| slaweq | so thats all from me about py3 | 16:36 |
| slaweq | njohnston: do You know how many other jobs we still should switch to py3? | 16:36 |
| bcafarel | slaweq: maybe worth going through https://bugs.launchpad.net/cinder/+bug/1728640 and see if we can grab some ideas, like this "Make test logging setup fixture disable future setup" | 16:37 |
| openstack | Launchpad bug 1728640 in Cinder "py35 unit test subunit.parser failures" [Critical,Fix released] - Assigned to Sean McGinnis (sean-mcginnis) | 16:37 |
| slaweq | yes, that is very similar issue to what we have with functional tests now :) | 16:38 |
| slaweq | I will check that this week | 16:38 |
| njohnston | I believe the multinode grenade jobs still need to be switched, at a minimum; grenade-py3 does not relieve us of those sadly | 16:38 |
| njohnston | I'll have to check the etherpad | 16:38 |
| slaweq | #action slaweq to continue fixing funtional-py3 tests | 16:38 |
| slaweq | ok, thx njohnston | 16:39 |
| njohnston | #action njohnston to research py3 conversion for neutron grenade multinode jobs | 16:39 |
| slaweq | I will also check neutron-tempest-plugin jobs then | 16:39 |
| slaweq | #action slaweq to convert neutron-tempest-plugin jobs to py3 | 16:39 |
| slaweq | ok, can we go on to the next topic then? | 16:40 |
| mlavalle | I think so | 16:40 |
| njohnston | go ahead | 16:40 |
| slaweq | #topic Grafana | 16:40 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:40 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:40 |
| *** tpsilva has joined #openstack-meeting | 16:41 | |
| slaweq | gate queue wasn't busy last week as there was not too many people with +2 power available :) | 16:41 |
| *** shrasool has quit IRC | 16:42 | |
| mlavalle | yeap | 16:42 |
| slaweq | We have Neutron-tempest-dvr-ha-multinode-full and Neutron-tempest-plugin-dvr-multinode-scenario failing on 100% again | 16:42 |
| *** apetrich has joined #openstack-meeting | 16:42 | |
| slaweq | but from what I was checking it's very often this issue with snat namespace, which should be fixed by https://review.openstack.org/#/c/618750/ | 16:43 |
| slaweq | so we should be better next week I hope | 16:43 |
| slaweq | From other things, I spotted again couple of issues with cinder backups, like: | 16:43 |
| slaweq | http://logs.openstack.org/64/617364/19/check/tempest-slow/18519dc/testr_results.html.gz | 16:44 |
| mlavalle | yeah, let's track the effect of that | 16:44 |
| slaweq | http://logs.openstack.org/87/609587/11/check/tempest-multinode-full/2a5c5a1/testr_results.html.gz | 16:44 |
| slaweq | I will report this as a cinder bug today | 16:44 |
| mlavalle | slaweq: and I know I have an email from you with cinder failures | 16:44 |
| mlavalle | I will talk to Jay and Sean this week | 16:45 |
| slaweq | from other things, we still have from time to time failures in functional tests (db-migrations timeout) and fullstack tests (this issue with keepalived mostly) and I'm trying to find out what is going on with both of them | 16:45 |
| slaweq | thx mlavalle :) | 16:45 |
| slaweq | one more thing related to grafana | 16:46 |
| slaweq | We should add to grafana 2 new jobs: | 16:46 |
| slaweq | networking-ovn-tempest-dsvm-ovs-release | 16:46 |
| slaweq | Tempest-slow | 16:46 |
| slaweq | any volunteer for that? :) | 16:46 |
| njohnston | sure | 16:46 |
| slaweq | thx njohnston :) | 16:46 |
| njohnston | #action njohnston add tempest-slow and networking-ovn-tempest-dsvm-ovs-release to grafana | 16:47 |
| slaweq | ok, lets move on then | 16:47 |
| slaweq | #topic Tempest/Scenario | 16:47 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 16:47 | |
| slaweq | I today found out that we have job neutron-tempest-dvr in our queue | 16:47 |
| slaweq | and it looks that it is single node dvr job | 16:48 |
| slaweq | is it intentional? do we want to keep it like that? | 16:48 |
| slaweq | It looks the same as neutron-tempest-dvr-ha-multinode-full job in fact | 16:48 |
| njohnston | ISTR some discussion about this a long time ago, like in the newton timeframe | 16:48 |
| slaweq | only difference is that this multinode job is non-voting | 16:48 |
| *** jamesmcarthur has quit IRC | 16:48 | |
| njohnston | I think the goal was for the multinode job to end up being the voting one | 16:49 |
| mlavalle | yes, I think I have the same recollection | 16:49 |
| *** jamesmcarthur has joined #openstack-meeting | 16:49 | |
| mlavalle | we can discuss in the L3 meeting | 16:49 |
| njohnston | +1 | 16:49 |
| slaweq | njohnston: that is not possible to have multinode job voting now ;) | 16:49 |
| slaweq | ok, mlavalle please then add this to L3 meeting agenda if You can | 16:50 |
| hongbin | does the multinode job stable enough? | 16:50 |
| mlavalle | yes | 16:50 |
| mlavalle | hongbin: not even close | 16:50 |
| slaweq | #action mlavalle to discuss about neutron-tempest-dvr job in L3 meeting | 16:50 |
| slaweq | hongbin: it depends what You mean by stable | 16:50 |
| slaweq | it's very stable now as it is on 100% of failures all the time :P | 16:51 |
| hongbin | slaweq: if it doesn't block the merging too much after turning into voting, then it is fine | 16:51 |
| slaweq | hongbin: it will block everything currently but I agree that we should focus on stabilize it | 16:52 |
| slaweq | and we are working on it since some time | 16:52 |
| hongbin | ack | 16:52 |
| slaweq | ok, lets move on then | 16:53 |
| slaweq | #topic Periodic | 16:53 |
| *** openstack changes topic to "Periodic (Meeting topic: neutron_ci)" | 16:53 | |
| slaweq | I just want to mention that we still have neutron-tempest-postgres-full failing all the time | 16:53 |
| slaweq | but it's nova issue | 16:53 |
| slaweq | bug reported: https://bugs.launchpad.net/nova/+bug/1804271 | 16:53 |
| openstack | Launchpad bug 1804271 in OpenStack Compute (nova) "nova-api is broken in postgresql jobs" [High,In progress] - Assigned to Matt Riedemann (mriedem) | 16:53 |
| slaweq | Fix in progress: https://review.openstack.org/#/c/619061/ | 16:53 |
| slaweq | so we should be good when this will be merged | 16:53 |
| mriedem | slaweq: here is a tip, | 16:54 |
| mriedem | show up in the nova channel and ask that another core look at that already +2ed fix for the postgres job | 16:54 |
| mriedem | i would, but i've already spent some review request karma today | 16:54 |
| slaweq | mriedem: ok, I will :) | 16:54 |
| slaweq | thx | 16:54 |
| slaweq | last topic then | 16:55 |
| slaweq | #topic Open discussion | 16:55 |
| *** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)" | 16:55 | |
| slaweq | anyone wants to discuss about anything? | 16:55 |
| hongbin | i have one | 16:56 |
| slaweq | go on hongbin | 16:56 |
| hongbin | i don't like the long list of extensions in zuul job, so i propose a patch: https://review.openstack.org/#/c/619642/ | 16:56 |
| hongbin | i want to know if this is what you guys prefer to do? | 16:56 |
| hongbin | or it is not a good idea | 16:57 |
| slaweq | yes, IMO that it easier to read in diff | 16:57 |
| bcafarel | it certainly better fits the screen | 16:57 |
| njohnston | Would it be possible to use reusable snippets like we do with *tempest-irrelevant-files now? | 16:58 |
| *** vishalmanchanda has quit IRC | 16:58 | |
| hongbin | yes, it possibly will fix the frequeent merge conflict between patches | 16:58 |
| slaweq | hongbin: njohnston: great ideas | 16:58 |
| *** mordred has joined #openstack-meeting | 16:58 | |
| hongbin | njohnston: i am not sure, because the list of extensions look different between jobs | 16:58 |
| slaweq | hongbin: not all jobs | 16:59 |
| slaweq | You can define snippet "per branch" and reuse them if necessary | 16:59 |
| slaweq | at least for master branch it should be fine | 16:59 |
| *** gyee has joined #openstack-meeting | 16:59 | |
| hongbin | yes, we can possibly consolidate the stable branch list | 16:59 |
| hongbin | i will look into that | 16:59 |
| slaweq | ok, we have to finish now | 17:00 |
| slaweq | thx for attending | 17:00 |
| slaweq | #endmeeting | 17:00 |
| njohnston | thanks all | 17:00 |
| slaweq | o/ | 17:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
| openstack | Meeting ended Tue Nov 27 17:00:23 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-11-27-16.00.html | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-11-27-16.00.txt | 17:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-11-27-16.00.log.html | 17:00 |
| bcafarel | o/ | 17:00 |
| mlavalle | o/ | 17:01 |
| *** lpetrut has quit IRC | 17:01 | |
| *** ttsiouts has quit IRC | 17:06 | |
| *** ttsiouts has joined #openstack-meeting | 17:07 | |
| *** lpetrut has joined #openstack-meeting | 17:10 | |
| *** jawad_axd has joined #openstack-meeting | 17:11 | |
| *** ttsiouts has quit IRC | 17:11 | |
| *** jawad_axd has quit IRC | 17:15 | |
| *** diablo_rojo has quit IRC | 17:19 | |
| *** psachin has quit IRC | 17:21 | |
| *** apetrich has quit IRC | 17:30 | |
| *** dmacpher has quit IRC | 17:32 | |
| *** mlavalle has left #openstack-meeting | 17:32 | |
| *** zaneb has quit IRC | 17:34 | |
| *** diablo_rojo has joined #openstack-meeting | 17:35 | |
| *** davidsha has quit IRC | 17:37 | |
| *** apetrich has joined #openstack-meeting | 17:50 | |
| *** imacdonn has quit IRC | 17:54 | |
| *** imacdonn has joined #openstack-meeting | 17:55 | |
| *** ijw has joined #openstack-meeting | 17:56 | |
| *** jawad_axd has joined #openstack-meeting | 17:57 | |
| *** yamahata has quit IRC | 17:58 | |
| *** iyamahat has quit IRC | 17:58 | |
| *** zaneb has joined #openstack-meeting | 18:01 | |
| *** ijw has quit IRC | 18:02 | |
| *** bnemec has quit IRC | 18:06 | |
| *** bnemec has joined #openstack-meeting | 18:06 | |
| *** sridharg has quit IRC | 18:09 | |
| *** kopecmartin is now known as kopecmartin|off | 18:16 | |
| *** gary_perkins has quit IRC | 18:17 | |
| *** iyamahat has joined #openstack-meeting | 18:18 | |
| *** gary_perkins has joined #openstack-meeting | 18:18 | |
| *** bobh has quit IRC | 18:32 | |
| *** lpetrut has quit IRC | 18:33 | |
| *** armax has joined #openstack-meeting | 18:37 | |
| *** yamahata has joined #openstack-meeting | 18:37 | |
| *** zbitter has joined #openstack-meeting | 18:49 | |
| *** tssurya has quit IRC | 18:50 | |
| *** zaneb has quit IRC | 18:52 | |
| *** shrasool has joined #openstack-meeting | 18:53 | |
| *** Linkid has quit IRC | 18:54 | |
| *** eharney has joined #openstack-meeting | 18:54 | |
| *** Shrews has joined #openstack-meeting | 18:55 | |
| *** dmsimard has joined #openstack-meeting | 18:59 | |
| clarkb | anyone here for the infra meeting? | 19:00 |
| corvus | ye | 19:00 |
| ianw | o/ | 19:00 |
| dmsimard | \o | 19:00 |
| frickler | o/ | 19:00 |
| Shrews | hola | 19:00 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Nov 27 19:01:18 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| rfolco | o/ | 19:01 |
| clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| gary_perkins | Hi o/ | 19:01 |
| clarkb | The only announcement I have is that openstack-discuss is replacing a bunch of openstack mailing lists that will be retired in 6 days. Please subscribe if you haven't already | 19:02 |
| clarkb | fungi: ^ anything else to add to that? | 19:02 |
| *** zbitter is now known as zaneb | 19:02 | |
| clarkb | probably worth mentioning here as well that I've picked up some sort of infant/toddler plague over the weekend so may not be 100% the next few days | 19:03 |
| clarkb | #topic Actions from last meeting | 19:04 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:04 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-11-20-19.01.txt minutes from last meeting | 19:04 |
| clarkb | it was a slow week due to the US holiday so not much there. However I did want to double check on the pypi cleanup | 19:05 |
| clarkb | ianw: ^ any update on that or help that can be provided? | 19:05 |
| *** jawad_axd has quit IRC | 19:05 | |
| ianw | i got the reviews on the removal of the symlink from the mirrors yesterday, and just left it to make sure there wasn't any issues popping up | 19:06 |
| ianw | which i'm guessing no from scrollback :) so i'll clear it out probably today | 19:06 |
| clarkb | great, then fallout from that is fedora 29 mirroring? | 19:07 |
| *** ralonsoh has quit IRC | 19:07 | |
| ianw | fedora29 we merged our client-side fix to ignore the upstream permissions | 19:07 |
| ianw | however i'd like some eyes on https://review.openstack.org/#/c/618416/ to remove f27 which will also free up space | 19:08 |
| clarkb | #link https://review.openstack.org/#/c/618416/ cleanup f27 mirrors to free up afs disk space | 19:08 |
| ianw | out of an abundance of caution i depended that on https://review.openstack.org/#/c/614375/ to remove f27 from nodepool too | 19:09 |
| fungi | whoops! i got distracted replying to someone's e-mail, sorry. no nothing to add on the ml merger | 19:09 |
| clarkb | #topic Specs approval | 19:09 |
| *** openstack changes topic to "Specs approval (Meeting topic: infra)" | 19:10 | |
| clarkb | I don't think there are specs ready for approval but did want to call out a couple specs that could use your review/attention | 19:10 |
| clarkb | #link https://review.openstack.org/#/c/607377/ Storyboard attachments spec | 19:10 |
| Shrews | ianw: i +A'd 614375 | 19:10 |
| *** jlvillal has left #openstack-meeting | 19:11 | |
| clarkb | #link https://review.openstack.org/#/c/581214/ Anomaly detection in CI jobs. This one is still marked as a draft but tristanC and dirk demoed their work in berlin and its really neat (and I think very useful) stuff | 19:11 |
| clarkb | if you've got a momemnt to review those it would be very much appreciated | 19:11 |
| clarkb | #topic Priority Efforts | 19:11 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:11 | |
| clarkb | #topic Storyboard | 19:11 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:11 | |
| clarkb | Other than the attachments spec is there other work or items that the infra team should be aware of here? | 19:12 |
| diablo_rojo | Looks like I have a few comments to address on the spec, but if anyone else wants to pile on before I update it, feel free! | 19:13 |
| mordred | o/ | 19:13 |
| diablo_rojo | At the summit we had talked about moving the db to a different node? | 19:13 |
| * diablo_rojo rakes brain for other things.. | 19:13 | |
| clarkb | the db is currently a trove instance right? are we talking about a new trove instance or a self managed database server? | 19:14 |
| fungi | yes | 19:15 |
| fungi | we were talking about possibly moving to a local mysql server on the sb instance | 19:15 |
| fungi | to reduce round-trip latency on queries | 19:15 |
| clarkb | gotcha | 19:15 |
| *** jawad_axd has joined #openstack-meeting | 19:16 | |
| fungi | though some sort of query caching might also bring similar performance benefits | 19:16 |
| *** tobiash has joined #openstack-meeting | 19:16 | |
| mordred | well, having the server locally would make it easier to diagnose what's going on too | 19:16 |
| fungi | ultimately, i expect we just need someone with competence in the field to help perform some query profiling and help make them more efficient | 19:16 |
| clarkb | #info Storyboard could use someone with mysql/database skillz to profile queries and help make them more efficient | 19:17 |
| diablo_rojo | yes plz | 19:17 |
| fungi | i'll set up a modest shrine in my hallway dedicated to their worship | 19:17 |
| *** erlon has quit IRC | 19:17 | |
| diablo_rojo | I will put their picture on my wall next to my top monitor | 19:18 |
| clarkb | anything else storyboard before we move to the next item? | 19:18 |
| corvus | did we ever get past the testing issue? | 19:18 |
| corvus | i tried to pitch in, but never got any help on this: https://review.openstack.org/553102 | 19:18 |
| fungi | no, we were hoping to get some intern/mentee vigor on rewriting the test framework to be maintainable i think | 19:19 |
| diablo_rojo | I have not had time to dig in yet :/ | 19:19 |
| clarkb | #link https://review.openstack.org/#/c/553102/ corvus attempt to improve testing of storyboard subscribers. Could use help | 19:19 |
| * diablo_rojo opens corvus's link | 19:19 | |
| corvus | i think it would be a lot easier (read: "possible") to make database improvements to storyboard if the subsystem were testable. but i can't make heads or tails of it. :( | 19:19 |
| *** zaneb has quit IRC | 19:20 | |
| diablo_rojo | corvus, I will add it to my todolist. | 19:20 |
| diablo_rojo | I'll see if I can get some SotK eyes on it too | 19:20 |
| clarkb | diablo_rojo: thanks | 19:21 |
| corvus | i feel pretty sure i would be able to contribute bite-sized improvements, but i don't think i have time for a subsystem overhaul :( | 19:22 |
| clarkb | #topic Update Config Management | 19:23 |
| diablo_rojo | corvus, I can say I greatly appreciate anything and everything you do for StoryBoard no matter how big or small :) | 19:23 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:23 | |
| clarkb | (sorry for moving on but seems like we have a plan forward on last item and we have other agenda items to cover) | 19:23 |
| corvus | diablo_rojo: :) | 19:23 |
| diablo_rojo | clarkb, no worries | 19:24 |
| corvus | yeah, i don't mean to derail, just thought i'd mention it because it may facilitate new contributions in the db area | 19:24 |
| clarkb | ++ | 19:24 |
| *** electrofelix has quit IRC | 19:25 | |
| clarkb | ok updating config management | 19:26 |
| clarkb | I think the bulk of the work happening here now is with ianw's graphite docker chain | 19:26 |
| * mordred needs to read it | 19:26 | |
| clarkb | last week I had become concerned that we had an iptables problem, but mordred reminded me that we plan to not network namespace | 19:26 |
| corvus | does that affect https://review.openstack.org/605585 ? | 19:27 |
| clarkb | corvus: it shouldn't the network namespace disablement is a container creation argument/option aiui | 19:27 |
| clarkb | corvus: getting a docker in place should be the same either way | 19:27 |
| mordred | well - I think we might not want to disable the iptables tests though | 19:28 |
| corvus | right, but my -1 on that was mostly because ^ | 19:28 |
| clarkb | mordred: corvus yes the -1 is still valid. I think we should assert that our rules end up in place as expected | 19:28 |
| mordred | ++ | 19:28 |
| corvus | i guess my question is, does the new thinking on namespaces mean that most of that iptables complexity goes away and we don't really need to change anything about it? | 19:28 |
| mordred | that way we can also verify that non-network-namepsaced containers work properly and the iptables stuff doesn't go to the bad place | 19:28 |
| mordred | corvus: yah. I think so | 19:29 |
| clarkb | sort of, docker will still try to manage the iptables rules | 19:29 |
| clarkb | the base set happen from the daemon starting | 19:29 |
| clarkb | however it shouldn't create any container specific rules because we use the host namespace | 19:29 |
| clarkb | (so our testing will have to accomodate that those rules may exist) | 19:29 |
| mordred | agree. we still want the tests to test that docker isn't breaking what we're doing with iptables | 19:29 |
| corvus | ok, so we still need some iptables changes, but we should be able to modify our tests to accomodate that | 19:30 |
| corvus | (rather than drop them) | 19:30 |
| mordred | yah | 19:30 |
| clarkb | yes to our test accomodating that. I'm not sure we need to change anything in how we iptables? | 19:30 |
| mordred | well, we may need some iptables changes - we may not | 19:30 |
| mordred | what clarkb said | 19:30 |
| corvus | sorry, i guess i meant iptables-testing-related changes | 19:30 |
| *** zaneb has joined #openstack-meeting | 19:31 | |
| corvus | not changes to our base iptables roles | 19:31 |
| mordred | we _shouldn't_ need to care about docker iptables - but should is dangerous :) | 19:31 |
| clarkb | the important thing here is our tests can ensure that docker doesn't suddenly stop being nice to our rules | 19:31 |
| clarkb | and if that changes we should notice via the testing | 19:31 |
| clarkb | so ++ to testing it | 19:31 |
| mordred | ++ | 19:31 |
| clarkb | as far as other work I think cmurphy has a stack at topic:puppet-4 that could use second reviewers (I have reviewed a bunch last week?) | 19:32 |
| clarkb | and the other standout item for this topic is zuul doing CD. I think my changes to add a zuul cd user to bridge are still outstanding if we want to pick that back up again | 19:32 |
| mordred | I feel like there was something else blocking zuul cd ... but that was just the per-project key we landed ages ago perhaps? | 19:34 |
| clarkb | mordred: ya I think that was the major blcoker and now its getting ssh into bridge working (whcih is what my changes will allow for) | 19:35 |
| mordred | sweet | 19:36 |
| clarkb | mordred: please do go review ianw's stack though I think its gets some major chunks of the docker story into place for us | 19:36 |
| clarkb | #topic General Topics | 19:37 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:37 | |
| clarkb | ianw had some good comments on how a weekly standing meeting has been useful for cross timezone coordination | 19:37 |
| corvus | i think this is a good use of time | 19:38 |
| clarkb | I proposed a slight modification of my proposal from last week where instead of cancelling the meeting if there are no agenda updates we can cover the standing topics (our priority items mostly) | 19:38 |
| ianw | ++ | 19:38 |
| clarkb | but retain the 24 hour agenda update so that people can selectively skip the meeting if that helps them get dinner or sleep | 19:38 |
| clarkb | I think this gives us a good balance between making it easiser for people to prepare and possibly skip meetings while still having the sync up regularly | 19:39 |
| fungi | i agree | 19:39 |
| mordred | ++ | 19:39 |
| *** cloudrancher has quit IRC | 19:39 | |
| clarkb | Going forward I'm going to try and be better about sending out a 24 hour pre notice with the agenda copied in | 19:40 |
| *** cloudrancher has joined #openstack-meeting | 19:40 | |
| clarkb | then its clear to anyone following the list that 1) there is a meeting happening and 2) this is what is going to occur | 19:40 |
| clarkb | but maybe we'll find that is just noise. Willing to try it though | 19:40 |
| *** cloudrancher has quit IRC | 19:40 | |
| ianw | that sounds good; i think that as i mentioned a bit more structure with dates in the wiki page might help too | 19:41 |
| *** cloudrancher has joined #openstack-meeting | 19:41 | |
| clarkb | ianw: ++ and I think it was you that suggested cleaning up the agenda as part of the meeting? I worry we won't have time for that but I can take it as a chair item to use the 10 minutes after a meeting to do that | 19:41 |
| ianw | either or, it can just get a bit confusing as to what's been discussed and what's upcoming on the wiki | 19:42 |
| clarkb | that is a good point | 19:42 |
| clarkb | next is a holdover from last week but I kept it because still relevant today. We have good news on the opendev.org DNS situation. Our dns servers are now the dns servers for this domain | 19:43 |
| *** b1airo has joined #openstack-meeting | 19:43 | |
| clarkb | We are waiting on them to create the DS record so that dnssec is happy but finally jamesmcarthur got through to the registrar :) | 19:43 |
| corvus | never make jamesmcarthur mad | 19:44 |
| jamesmcarthur | lol | 19:44 |
| clarkb | corvus: ^ assuming dnssec is working in the next day as we've been told is the next step there to migrate zuul-ci.org to the new servers? | 19:44 |
| fungi | you won't like him when he's angry! ;) | 19:44 |
| jamesmcarthur | it takes a lot, but eventually i get pushed over the edge | 19:44 |
| fungi | also, he needs to stop ripping his shirts | 19:44 |
| corvus | clarkb: maybe set up a static website first, exercise it hosting opendev.org a bit, then move zuul-ci.org over i think | 19:45 |
| clarkb | that seems reasonable. And after that clean up the old dns servers. | 19:45 |
| corvus | yep | 19:45 |
| clarkb | and from there we can start tackling the actual migrationy bits of this process | 19:45 |
| fungi | yes, i think the opendev-website repo is likely the next one on the docket after zone-opendev.org | 19:45 |
| clarkb | #info opendev-website next after zone-opendev.org and associated DNS registrar situation is sorted | 19:46 |
| clarkb | #topic Open Discussion | 19:47 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:47 | |
| clarkb | We've got a bit of time (not surprising given the very short week last week for some of us). Feel free to bring up other topics. | 19:47 |
| ianw | since we were talking about fedora29, there's a surprisingly large stack of stuff related in https://review.openstack.org/#/q/topic:fedora29+(status:open+OR+status:merged) | 19:47 |
| clarkb | One I've got is should we remove the open discussion item from the agenda? so that we don't sneak things into the agenda after someone has decided it is safe to sleep in? | 19:48 |
| ianw | mostly related to getting glean plugged in with networkmanager on redhat rpm platforms | 19:48 |
| ianw | reviews welcome, but ci looking good | 19:48 |
| fungi | i'm good with dropping open discussion. that's basically 95% of the #openstack-infra channel's purpose anyway | 19:48 |
| frickler | clarkb: IMO discussing things when there is time is fine, but avoid decision making? | 19:48 |
| ianw | ++, it's usually mostly a ad-hoc call for reviews? (e.g. mine :) | 19:49 |
| clarkb | frickler: works for me | 19:50 |
| fungi | i wouldn't mind seeing topical entries for the "standing" items on the agenda too, but wouldn't want to make a lot of extra work for the chair | 19:50 |
| clarkb | ianw: the comments at https://review.openstack.org/#/c/618964/7..11/glean/init/glean-nm%2540.service have me slightly confused. My local xenial install doesn't have an /etc/sysconfig/network | 19:52 |
| clarkb | that said glean-nm should only be used by red hatty things in the current setup so this is fine I think | 19:52 |
| clarkb | fungi: I think if the chair or others have time to add topical items to the standing items that would be much appreciated | 19:53 |
| clarkb | but I also don't think it is necessary particularly since that is our sanity check catch up period | 19:53 |
| ianw | clarkb: /etc/sysconfig/network/ifcfg-* is what glean will write out on Xenial systems | 19:54 |
| *** aojeagarcia has quit IRC | 19:55 | |
| clarkb | ianw: I think that is for suse? | 19:55 |
| clarkb | and debuntu writes to /etc/networking/interfaces | 19:55 |
| ianw | oh, hrm, yes maybe. what's the xenial path then? | 19:56 |
| fungi | it's /etc/network/interfaces(.d/something) | 19:56 |
| clarkb | ya the per interface stuff goes into interfaces.d/something | 19:56 |
| ianw | yeah, sorry i mean do we not have a xenial service file? | 19:56 |
| fungi | ifupdown? | 19:57 |
| ianw | in the install, we only do "if (os.path.exists('/usr/lib/systemd/system')" then install the service ... | 19:58 |
| fungi | ahh, networking | 19:58 |
| clarkb | ianw: I think that condition is broken on xenial so glean will run each time? | 19:58 |
| fungi | is /etc/init/networking.conf what you mean by "service file"? | 19:58 |
| clarkb | I think the systemd unit file that glean installs | 19:59 |
| ianw | clarkb: hrm, yes maybe xenial is falling through ... let's follow up in infra ... | 19:59 |
| clarkb | ianw: see you there | 19:59 |
| clarkb | and with that we are out of time | 19:59 |
| clarkb | thank you everyone | 19:59 |
| fungi | thanks clarkb! | 19:59 |
| clarkb | #endmeeting | 19:59 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:59 | |
| openstack | Meeting ended Tue Nov 27 19:59:43 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-11-27-19.01.html | 19:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-11-27-19.01.txt | 19:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-11-27-19.01.log.html | 19:59 |
| *** cloudrancher has quit IRC | 20:00 | |
| *** cloudrancher has joined #openstack-meeting | 20:00 | |
| *** _hemna has quit IRC | 20:04 | |
| *** dustins has quit IRC | 20:06 | |
| *** jamesmcarthur has quit IRC | 20:13 | |
| *** tobiash has left #openstack-meeting | 20:19 | |
| *** awaugama has quit IRC | 20:21 | |
| *** Shrews has left #openstack-meeting | 20:26 | |
| *** imacdonn has quit IRC | 20:37 | |
| *** imacdonn has joined #openstack-meeting | 20:37 | |
| *** slaweq_ has joined #openstack-meeting | 20:44 | |
| *** eharney has quit IRC | 20:45 | |
| *** oneswig has joined #openstack-meeting | 20:55 | |
| *** rossella_s has quit IRC | 20:57 | |
| *** jawad_axd has quit IRC | 20:58 | |
| oneswig | b1airo: would you like to do the honours? | 20:59 |
| oneswig | you there? | 21:00 |
| oneswig | #startmeeting scientific-sig | 21:00 |
| openstack | Meeting started Tue Nov 27 21:00:41 2018 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
| oneswig | you snooze you lose! | 21:00 |
| *** trandles has joined #openstack-meeting | 21:00 | |
| oneswig | #link Agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_November_27th_2018 | 21:01 |
| b1airo | howdy | 21:01 |
| oneswig | Greetings Americans, I trust Thanksgiving was good | 21:01 |
| oneswig | hey b1airo, g'day | 21:01 |
| trandles | omnomnom | 21:01 |
| oneswig | #chair b1airo | 21:01 |
| openstack | Current chairs: b1airo oneswig | 21:01 |
| * b1airo has the power! | 21:01 | |
| *** janders has joined #openstack-meeting | 21:02 | |
| janders | g'day everyone | 21:02 |
| oneswig | I'm on a train, wifi's likely to get interesting as we move | 21:02 |
| b1airo | hi janders | 21:02 |
| oneswig | g'day janders | 21:02 |
| oneswig | #topic SC roundup | 21:02 |
| *** openstack changes topic to "SC roundup (Meeting topic: scientific-sig)" | 21:02 | |
| janders | hey Blair - how was SC? | 21:02 |
| oneswig | How indeed? | 21:02 |
| b1airo | good. that enough...? :-P | 21:03 |
| *** slaweq_ has quit IRC | 21:03 | |
| oneswig | How did Wojtek break his leg, can you share that? | 21:03 |
| b1airo | the container sessions outnumbered the cloud sessions this year | 21:03 |
| janders | sounds like Berlin :) | 21:04 |
| b1airo | i can share a video of him in emergency. but actually the incident was pretty lame, he must just be getting old | 21:04 |
| janders | Is SC changing name anytime soon? | 21:04 |
| oneswig | Anything on Charliecloud trandles? | 21:04 |
| b1airo | one particular thing on the container front that i found interesting was an understanding of Docker's strategy in the HPC space... | 21:05 |
| trandles | Nothing interesting on Charliecloud. Just more progress going into supporting what seems like an increasing number of MPI implementations and interconnects | 21:05 |
| trandles | b1airo: you have an understanding of docker's HPC strategy? I don't and I've been talking to them for the past year. :( | 21:06 |
| trandles | although, I get different strategies from different people within docker | 21:06 |
| oneswig | Docker's strategy right now is to marvel at that bright light at the end of the tunnel, it seems | 21:06 |
| oneswig | ... and wonder what the chuffing noise might be... | 21:07 |
| trandles | oneswig: that's my impression as well | 21:07 |
| janders | I hope the strategy is not "we don't care and keep going our own way, the HPC folks will figure it out" | 21:07 |
| b1airo | basically, because everyone in research and big HPC wants stuff for free, Docker Inc can't commit engineering to related feature development. So Christian's strategy is to go after ML workloads in enterprise, supporting GPU, then MPI, and presto - HPC is supported. | 21:07 |
| b1airo | that's the simplistic version | 21:08 |
| janders | it's a bit like RHAT&mlnx, HPC, SRIOV and Telco | 21:08 |
| trandles | last I heard from Christian is "we'll replace [slurm|pbs|torque|etc] with docker swarm, voila!" | 21:08 |
| oneswig | MPI support that I've seen (kubeflow's mpi-operator) isn't going to scale - but that doesn't mean it will always be like that | 21:08 |
| b1airo | there is also some uid/gid mapping stuff they have in the works for FS namespaces, i guess that will be a "within this container, squash all I/O to this volume to these IDs" | 21:09 |
| trandles | Well, LANL's position is that money, power, and cooling aren't going to scale much further so we might as well tackle trying to get better than 1% efficiency from our platforms | 21:10 |
| oneswig | That has bitten us | 21:10 |
| oneswig | 1%? Sounds like my household finances. | 21:10 |
| b1airo | trandles: lol, that'll never catch on | 21:10 |
| trandles | we're seeing something around 3-6% efficiency with our new ARM systems | 21:10 |
| janders | have you guys heard anything interesting from the other side ( [slurm|pbs|torque|etc] )? | 21:11 |
| b1airo | didn't you hear Trump, he doesn't believe climate change will have any economic impacts, and besides, it was cold last weekend | 21:11 |
| janders | are they looking at running their own components containerised - and consuming k8s resources? | 21:11 |
| trandles | I had lunch == no one is hungry any more! | 21:11 |
| janders | b1airo: damn right! It's bloody cold here despite we're almost in December.. burn more coal, quickly! | 21:12 |
| b1airo | trandles: more seriously though, what is your definition of efficiency for these purposes? | 21:12 |
| trandles | janders: I haven't heard much of anything from the resource manager side RE: containers | 21:12 |
| oneswig | janders: that sounds a little far fetched - apart from for univa grid engine, who have done something likethat | 21:12 |
| janders | yeah I hear those vendors trying to orchestrate docker themselves - which I find retarded | 21:12 |
| b1airo | there was one suggestion during the Q&A in one of the BoFs that Slurm should support one of the OCI interfaces (whichever one is responsible for launching containers) | 21:13 |
| b1airo | there was one interesting suggestion during the Q&A in one of the BoFs - that Slurm should support one of the OCI interfaces (whichever one is responsible for launching containers) | 21:13 |
| janders | have slurm run containers for HPC and k8s run containers for non-hpc within a single site sounds anything but efficient | 21:13 |
| trandles | b1airo: application performance as percent of theoretical peak IIRC...looking for that now... | 21:13 |
| oneswig | Were there new faces for OpenStack at SC? | 21:13 |
| b1airo | oneswig: yes, both in the audience and on the panel, but mostly that was because half of them were container peeps | 21:14 |
| trandles | bigger problem is no one knows how to launch MPI applications at scale but the existing resource managers (kinda) and the MPI implementations (for now) | 21:14 |
| *** raildo has quit IRC | 21:14 | |
| oneswig | your caveats, most beguiling... | 21:15 |
| oneswig | care to elaborate? | 21:15 |
| trandles | in the OpenMPI space, it sounds like before long no one will be able to launch anything...orte is dead, PMIx is almost unsupported, and mpirun is deprecated | 21:15 |
| oneswig | I hadn't realised that pmix is itself written like an hpc application | 21:15 |
| trandles | b1airo: did you or anyone you know attend the OpenMPI BoF? I wasn't there long enough. Rumor had it lots of folks were showing up to make a stink about the lack of future for things like mpirun | 21:16 |
| oneswig | sounds awkward | 21:17 |
| b1airo | unfortunately not trandles , sounds like i missed out though. it's possible one of the Monash folks did (will ask)... | 21:17 |
| trandles | at LANL, we use slurm's support of PMI2 to use srun to wire up the job | 21:17 |
| trandles | not sure what IBM is doing RE: jsrun and lrun | 21:17 |
| trandles | but they have Spectrum-MPI anyway | 21:18 |
| oneswig | trandles: that's what I tend to use for openhpc and slurm | 21:18 |
| oneswig | (pmi2) | 21:18 |
| oneswig | We should also round up the OpenStack summit activity | 21:18 |
| oneswig | Ready to flip over? | 21:19 |
| trandles | one last thing | 21:19 |
| oneswig | go for it, columbo | 21:19 |
| trandles | without details, I get the impression that some vendors are looking to implement container-launching plugins for resource managers | 21:19 |
| b1airo | oneswig: i'm afraid my memory of the session needs jogging slightly - it was on the afternoon following my night in the hospital with Wojtek, so i was a little spacey. there was not a lot of OpenStack specific conversation though, more general higher-level cloud workload issues. a couple of the people asking questions had some very... strange... problems too (of the "i can't believe you ended up here" nature) | 21:20 |
| trandles | and it's not like "have slurm run docker" it's more like "slurm job_launch plugin that makes the right syscalls to set up the namespaces" | 21:20 |
| *** imacdonn has quit IRC | 21:20 | |
| janders | trandles: this is good to hear! :) | 21:21 |
| oneswig | trandles: will all those people who bemoaned the docker daemon's root privilege now turn on slurmd, I wonder? | 21:21 |
| b1airo | good question oneswig | 21:21 |
| trandles | slurmd already does things on behalf of the user | 21:21 |
| trandles | ie. the user doesn't need sudo to use slurm ;) | 21:21 |
| oneswig | indeed, and gets little of the flak that docker gets | 21:22 |
| trandles | maybe if docker didn't require sudo (or setuid) and direct user control it would be different | 21:22 |
| b1airo | is that just because some of Slurm's guts are setuid ? | 21:22 |
| oneswig | anyway, trandles, you've got a pretty good implementation of container launch, do you think it will come in? | 21:23 |
| trandles | maybe...I certainly hope so | 21:23 |
| oneswig | trandles: fair point on the direct user control | 21:23 |
| oneswig | OK, move on? | 21:24 |
| trandles | anyway, that's all I got...Berlin? | 21:24 |
| *** imacdonn has joined #openstack-meeting | 21:24 | |
| oneswig | #topic Berlin roundup | 21:24 |
| *** openstack changes topic to "Berlin roundup (Meeting topic: scientific-sig)" | 21:24 | |
| *** _hemna has joined #openstack-meeting | 21:24 | |
| oneswig | janders: we had a pretty vibrant meeting this time round, wouldn't you say? | 21:24 |
| oneswig | more than half the crowd were there for the first time | 21:24 |
| oneswig | The room was full, I'd guess 70 upwards | 21:25 |
| janders | oneswig: I think we can definitely say that! | 21:25 |
| oneswig | perhaps even 100 | 21:25 |
| janders | it almost felt like we need a bigger room | 21:25 |
| oneswig | what was interesting was that the majority of attendees had bioinformatics use cases | 21:25 |
| janders | if we weren't that far from all the other presentations we would likely get few more people :) | 21:26 |
| oneswig | some HEP, some generic university workloads, some AI/ML | 21:26 |
| janders | true, however looking back at the last five years of OpenStacking I think nearly all of my "interesting" users were from the bioinformatics domain | 21:26 |
| oneswig | There's continuing interest in how to manage sensitive data, particularly from them. | 21:27 |
| b1airo | it's slightly depressing that so many people need a whole different infrastructure approach just to make bioinformaticians happy | 21:27 |
| oneswig | I don't think it's different, just different processes | 21:27 |
| b1airo | i could be projecting some current frustration with supporting the Genomics community down here | 21:28 |
| janders | b1airo: other than the storage backend, what differences are you thinking? | 21:28 |
| oneswig | There's a lot of common ground around questions like how to implement a safe haven | 21:28 |
| *** martial__ has joined #openstack-meeting | 21:28 | |
| *** eharney has joined #openstack-meeting | 21:28 | |
| oneswig | Somebody today made the point it's just like data in banking (or similar), really | 21:28 |
| martial__ | (sorry computer issues) | 21:29 |
| *** yamamoto has quit IRC | 21:29 | |
| oneswig | hey martial__ | 21:29 |
| oneswig | you're growing underscores again! | 21:29 |
| oneswig | #chair martial__ | 21:29 |
| openstack | Current chairs: b1airo martial__ oneswig | 21:29 |
| martial__ | I know, fun times :) | 21:29 |
| oneswig | We had a visit today to our office from a team from Monash - Komathy and Jerico | 21:29 |
| oneswig | Had a really useful discussion with them on where they are and what they need | 21:30 |
| oneswig | They are keen to make contact with fellow travellers from the US. They've been speaking with half a dozen or so around Europe and the UK on their tour | 21:30 |
| *** tpsilva has quit IRC | 21:31 | |
| oneswig | Ah, I should update the topic | 21:31 |
| oneswig | #topic fellow travellers for controlled-access data | 21:31 |
| *** openstack changes topic to "fellow travellers for controlled-access data (Meeting topic: scientific-sig)" | 21:31 | |
| oneswig | trandles: I imagine sensitive data handling is totally different in your domain | 21:32 |
| trandles | oneswig: I think those folks need to make contact with Khalil and his federation efforts | 21:32 |
| trandles | hrm, for us it's a pain in the arse | 21:32 |
| oneswig | Does ORCA cover that kind of use case? | 21:33 |
| oneswig | martial__: ? | 21:33 |
| martial__ | (sorry was looking into logs of crash) | 21:33 |
| oneswig | you're not in the car, I hope? | 21:34 |
| martial__ | (no, computer reboot) | 21:34 |
| oneswig | just checking :-) | 21:34 |
| martial__ | so Khalil and the ORCA people do not cover the conversation about data sensitivity | 21:34 |
| martial__ | it covers the case of access of information and it can be either an RBAC or ACL solution | 21:35 |
| oneswig | ah ok | 21:35 |
| trandles | I'm not sure how they can work on federation without considering data sensitivity | 21:35 |
| martial__ | not sure if those overlap with your definition of sensitivity? | 21:36 |
| martial__ | (use case of) | 21:36 |
| oneswig | I guess the first use case is to enable sharing, and the follow-up use case becomes how to control it | 21:36 |
| b1airo | i went to the federation panel at SC, but to be perfectly honest it still seems very academic | 21:37 |
| martial__ | the idea that a user has access to a subset of data if controlled by who this user is per its access rights | 21:37 |
| martial__ | it closer to ACLs type | 21:38 |
| oneswig | b1airo: from an OpenStack perspective there are many gaps for federated users, agreed | 21:38 |
| martial__ | OpenStack has federated users (keystone to keystone) | 21:38 |
| oneswig | It does indeed, but (for example) they cannot create heat stacks or use application credentials | 21:39 |
| oneswig | a federated user is a bit ghostly | 21:39 |
| martial__ | no, indeed | 21:39 |
| janders | oneswig: I wasn't aware of that. What are the reasons? Bugs in heat? Else? | 21:40 |
| martial__ | the concept of the work done for ORCA is the use of the IEEE P2302 model to drive an implementation (proof of concept) | 21:40 |
| martial__ | that allows clouds to interconnect | 21:40 |
| oneswig | It relates to trusts in Keystone janders | 21:40 |
| oneswig | beyond that I am not sure but people on ou team have been through the issues. | 21:41 |
| martial__ | their is an "agent" to communicate rights, roles and privileges for the users from a remote cloud to the local cloud | 21:41 |
| martial__ | (the "cloud broker" in a way) | 21:41 |
| janders | right... one would think that a user holds a token or he/she doesn't - so every service works or no service works | 21:41 |
| oneswig | martial__: ORCA is working on a poc implementation? | 21:41 |
| janders | but I guess that was pretty naive and the reality is much less binary | 21:41 |
| janders | :) | 21:41 |
| martial__ | so IEEE P2302 is getting a NIST SP500 in the draft in the coming month | 21:42 |
| janders | noted! thank you, knowing this will help me stay out of trouble down the track | 21:42 |
| oneswig | janders: I think it relates to actions performed in the user's name when they've gone home for the night, my understanding of it | 21:42 |
| martial__ | ORCA will benefit from it and there was a big effort of integrating sites while at SC18 in the framework to help dive this POC | 21:43 |
| oneswig | good to hear there is some forward progress for them | 21:44 |
| oneswig | anyway, I feel we should do what we can to gather interested parties around best practice for sensitive data. | 21:44 |
| martial__ | yes, Stig, I agree | 21:44 |
| oneswig | Seems we are light on the ground today but if we can tap a few regulars, perhaps | 21:44 |
| martial__ | although ORCA is "for academic use" so less issue of data sensitivity (we are not talking Secret, TS, ... are we?) | 21:45 |
| oneswig | The other area of interest from the SIG session - a new one for our discussions to date - best practice for AI/ML | 21:45 |
| trandles | martial__: it doesn't have to venture into classifications, it can be simple export control | 21:46 |
| oneswig | I wasn't sure what demands that entails | 21:46 |
| *** pcaruana has quit IRC | 21:46 | |
| oneswig | but then I met a guy from sweden wanting to put 8x100G networking into each GPU node... | 21:46 |
| *** priteau has quit IRC | 21:47 | |
| b1airo | sorry, sidetracked in another meeting on Zoom... | 21:47 |
| oneswig | np, hope you're not sharing your desktop :-) | 21:47 |
| b1airo | related to the federated roles, privileges etc discussion above. sounds like what SciTokens might be designed to help with | 21:48 |
| b1airo | oneswig: me too! | 21:48 |
| oneswig | the AI use case is tangential to our cohort but becoming increasingly used at a platform level by users I'm aware of | 21:49 |
| oneswig | we may not realise our infra is already doing this kind of work... | 21:49 |
| oneswig | OK, I forgot the other matter arising (from Pawsey) | 21:50 |
| oneswig | Anyone using Manila to manage Lustre? Or interested in doing so? | 21:50 |
| oneswig | #topic manila and lustre | 21:51 |
| *** openstack changes topic to "manila and lustre (Meeting topic: scientific-sig)" | 21:51 | |
| martial__ | yes, we have looking into SciTokens indeed | 21:51 |
| oneswig | martial__: is that you with your ORCA hat on? | 21:51 |
| martial__ | nah, the P2302. We have a ton of conversation on the different models out there ... it needs to "interconnect" after all :) | 21:53 |
| oneswig | There was some interest in orchestrating dynamic shares on Lustre filesystems using Manila. I'm aware of a few people interested in pursuing it. | 21:54 |
| oneswig | This was raised last week on the EMEA session | 21:54 |
| janders | just from my perspective, doing it via NFS is less interesting | 21:55 |
| *** shrasool has quit IRC | 21:55 | |
| oneswig | I agree that the native transport makes most sense, given the effort of getting Lustre to that point. | 21:56 |
| janders | I hope to look at BeeGFS as nova/glance/cinder/manila/swift backend instead (sorry I haven't managed to get back to you on this oneswig - chasing up some other things this week) | 21:56 |
| oneswig | janders: np, we've all got stuff to do :-) | 21:56 |
| janders | native Lustre orchestration could also be of strong interest to us, depending on the outcomes of a tender | 21:56 |
| janders | we have BeeGFS for sure, Lustre might or might not come into play | 21:57 |
| oneswig | janders: may the best filesystem win :-) | 21:57 |
| trandles | gotta run to another meeting, toodle pip | 21:57 |
| oneswig | cheers trandles | 21:57 |
| *** trandles has quit IRC | 21:57 | |
| janders | GPFS would be another area of interest, though I feel that BeeGFS might be better going forward | 21:57 |
| janders | oneswig: exactly! :) | 21:58 |
| oneswig | I'm sure you're not the only one weighing these things up | 21:58 |
| janders | indeed | 21:58 |
| oneswig | OK, we are nearly out of time | 21:58 |
| oneswig | final thoughts? | 21:58 |
| janders | I'm good. Thank you all! | 21:59 |
| oneswig | I'll mail openstack-discuss to try to gather more interest on the data | 21:59 |
| *** jmlowe has joined #openstack-meeting | 21:59 | |
| oneswig | OK y'all, thanks and goodnight | 21:59 |
| martial__ | cool, thanks :) | 21:59 |
| oneswig | #endmeeting | 21:59 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:59 | |
| openstack | Meeting ended Tue Nov 27 21:59:55 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-27-21.00.html | 21:59 |
| oneswig | until next week | 21:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-27-21.00.txt | 22:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-27-21.00.log.html | 22:00 |
| b1airo | ah, my last messages got lost | 22:00 |
| b1airo | we need to update the mailing list references on the wiki | 22:00 |
| *** oneswig has quit IRC | 22:00 | |
| *** slaweq has quit IRC | 22:03 | |
| *** yamamoto has joined #openstack-meeting | 22:07 | |
| *** yamamoto has quit IRC | 22:18 | |
| *** slaweq has joined #openstack-meeting | 22:19 | |
| *** slaweq has quit IRC | 22:24 | |
| *** shrasool has joined #openstack-meeting | 22:28 | |
| *** shrasool has quit IRC | 22:39 | |
| *** munimeha1 has quit IRC | 22:45 | |
| *** rossella_s has joined #openstack-meeting | 22:46 | |
| *** shrasool has joined #openstack-meeting | 22:46 | |
| *** shrasool has quit IRC | 22:46 | |
| *** janders has quit IRC | 22:48 | |
| *** iyamahat_ has joined #openstack-meeting | 22:53 | |
| *** eharney has quit IRC | 22:54 | |
| *** priteau has joined #openstack-meeting | 22:54 | |
| *** iyamahat has quit IRC | 22:56 | |
| *** radeks has quit IRC | 22:57 | |
| *** rcernin has joined #openstack-meeting | 22:57 | |
| *** iyamahat_ has quit IRC | 22:58 | |
| *** iyamahat has joined #openstack-meeting | 22:58 | |
| *** priteau has quit IRC | 22:58 | |
| *** dtroyer has joined #openstack-meeting | 23:02 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:14 | |
| *** mjturek has quit IRC | 23:16 | |
| *** jamesmcarthur has quit IRC | 23:18 | |
| *** rossella_s has quit IRC | 23:23 | |
| *** slaweq has joined #openstack-meeting | 23:29 | |
| *** slaweq has quit IRC | 23:33 | |
| *** yamamoto has joined #openstack-meeting | 23:34 | |
| *** mriedem has quit IRC | 23:46 | |
| *** armax has quit IRC | 23:49 | |
| *** jhesketh_ is now known as jhesketh | 23:51 | |
| *** armax has joined #openstack-meeting | 23:52 | |
| *** iyamahat has quit IRC | 23:54 | |
| *** diablo_rojo has quit IRC | 23:57 | |
| *** hongbin has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!