| *** lseki has quit IRC | 00:01 | |
| *** Lucas_Gray has joined #openstack-meeting | 00:09 | |
| *** markvoelker has joined #openstack-meeting | 00:15 | |
| *** markvoelker has quit IRC | 00:20 | |
| *** markvoelker has joined #openstack-meeting | 00:22 | |
| *** mriedem_afk has quit IRC | 00:30 | |
| *** enriquetaso has quit IRC | 00:33 | |
| *** bbowen has joined #openstack-meeting | 00:40 | |
| *** liuyulong has quit IRC | 00:42 | |
| *** bnemec has quit IRC | 00:45 | |
| *** rfolco has joined #openstack-meeting | 00:49 | |
| *** rcernin has joined #openstack-meeting | 00:51 | |
| *** brinzhang has joined #openstack-meeting | 00:53 | |
| *** bnemec has joined #openstack-meeting | 00:56 | |
| *** bnemec has quit IRC | 01:07 | |
| *** Liang__ has joined #openstack-meeting | 01:10 | |
| *** brinzhang_ has joined #openstack-meeting | 01:11 | |
| *** brinzhang has quit IRC | 01:14 | |
| *** anastzhyr has quit IRC | 01:26 | |
| *** nanzha has joined #openstack-meeting | 01:30 | |
| *** brinzhang has joined #openstack-meeting | 01:34 | |
| *** brinzhang_ has quit IRC | 01:36 | |
| *** rfolco has quit IRC | 01:42 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:53 | |
| *** jamesmcarthur has quit IRC | 01:53 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:53 | |
| *** Lucas_Gray has quit IRC | 01:56 | |
| *** brinzhang_ has joined #openstack-meeting | 02:05 | |
| *** brinzhang_ has quit IRC | 02:05 | |
| *** yaawang_ has quit IRC | 02:06 | |
| *** yaawang_ has joined #openstack-meeting | 02:06 | |
| *** brinzhang has quit IRC | 02:08 | |
| *** apetrich has quit IRC | 02:10 | |
| *** jamesmcarthur has quit IRC | 02:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:27 | |
| *** jamesmcarthur has quit IRC | 02:28 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:28 | |
| *** jamesmcarthur has quit IRC | 02:29 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:37 | |
| *** jamesmcarthur has quit IRC | 02:42 | |
| *** ricolin has joined #openstack-meeting | 02:55 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:00 | |
| *** pleia2 has quit IRC | 03:04 | |
| *** jamesmcarthur has quit IRC | 03:08 | |
| *** yaawang_ has quit IRC | 03:08 | |
| *** yaawang_ has joined #openstack-meeting | 03:08 | |
| *** pleia2 has joined #openstack-meeting | 03:13 | |
| *** ykatabam has quit IRC | 03:22 | |
| *** dmacpher__ has joined #openstack-meeting | 03:23 | |
| *** dmacpher_ has quit IRC | 03:25 | |
| *** ykatabam has joined #openstack-meeting | 03:25 | |
| *** psachin has joined #openstack-meeting | 03:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:42 | |
| *** larainema has joined #openstack-meeting | 03:55 | |
| *** Liang__ is now known as LiangFang | 04:05 | |
| *** rbudden has quit IRC | 04:09 | |
| *** igordc has quit IRC | 04:15 | |
| *** diablo_rojo has quit IRC | 04:17 | |
| *** pcaruana has joined #openstack-meeting | 04:18 | |
| *** jamesmcarthur has quit IRC | 04:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:37 | |
| *** jamesmcarthur has quit IRC | 04:43 | |
| *** markvoelker has quit IRC | 04:45 | |
| *** lbragstad has quit IRC | 04:53 | |
| *** lbragstad has joined #openstack-meeting | 04:53 | |
| *** dmsimard has quit IRC | 04:54 | |
| *** dansmith has quit IRC | 04:54 | |
| *** dmsimard has joined #openstack-meeting | 04:54 | |
| *** ianw has quit IRC | 04:54 | |
| *** ianw_ has joined #openstack-meeting | 04:55 | |
| *** dansmith has joined #openstack-meeting | 04:55 | |
| *** ianw_ is now known as ianw | 04:56 | |
| *** Luzi has joined #openstack-meeting | 05:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:05 | |
| *** jamesmcarthur has quit IRC | 05:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:19 | |
| *** jamesmcarthur has quit IRC | 05:24 | |
| *** ociuhandu has joined #openstack-meeting | 05:26 | |
| *** ociuhandu has quit IRC | 05:31 | |
| *** sridharg has joined #openstack-meeting | 05:33 | |
| *** brinzhang has joined #openstack-meeting | 05:34 | |
| *** links has joined #openstack-meeting | 05:37 | |
| *** brinzhang has quit IRC | 05:39 | |
| *** takamatsu has quit IRC | 05:47 | |
| *** jawad_axd has joined #openstack-meeting | 05:59 | |
| *** jawad_ax_ has joined #openstack-meeting | 06:03 | |
| *** jawad_axd has quit IRC | 06:03 | |
| *** lpetrut has joined #openstack-meeting | 06:04 | |
| *** lpetrut has quit IRC | 06:05 | |
| *** lpetrut has joined #openstack-meeting | 06:05 | |
| *** jawad_ax_ has quit IRC | 06:07 | |
| *** whoami-rajat has joined #openstack-meeting | 06:12 | |
| *** jawad_axd has joined #openstack-meeting | 06:14 | |
| *** ykatabam has quit IRC | 06:15 | |
| *** janki has joined #openstack-meeting | 06:18 | |
| *** rcernin has quit IRC | 06:18 | |
| *** nanzha has quit IRC | 06:26 | |
| *** nanzha has joined #openstack-meeting | 06:28 | |
| *** LiangFang has quit IRC | 06:29 | |
| *** Liang__ has joined #openstack-meeting | 06:29 | |
| *** markvoelker has joined #openstack-meeting | 06:46 | |
| *** markvoelker has quit IRC | 06:51 | |
| *** trident has quit IRC | 06:55 | |
| *** slaweq has joined #openstack-meeting | 06:55 | |
| *** trident has joined #openstack-meeting | 06:58 | |
| *** gibi_off is now known as gibi | 07:02 | |
| *** links has quit IRC | 07:04 | |
| *** jraju__ has joined #openstack-meeting | 07:04 | |
| *** jraju__ is now known as links | 07:07 | |
| *** tesseract has joined #openstack-meeting | 07:09 | |
| *** takamatsu has joined #openstack-meeting | 07:18 | |
| *** ttsiouts has joined #openstack-meeting | 07:18 | |
| *** ttsiouts has quit IRC | 07:38 | |
| *** ttsiouts has joined #openstack-meeting | 07:39 | |
| *** ttsiouts has quit IRC | 07:43 | |
| *** Liang__ has quit IRC | 07:44 | |
| *** rpittau|afk is now known as rpittau | 07:52 | |
| *** ttsiouts has joined #openstack-meeting | 07:53 | |
| *** ralonsoh has joined #openstack-meeting | 07:57 | |
| *** tssurya has joined #openstack-meeting | 07:59 | |
| *** e0ne has joined #openstack-meeting | 08:01 | |
| *** ociuhandu has joined #openstack-meeting | 08:06 | |
| *** ociuhandu has quit IRC | 08:15 | |
| *** e0ne_ has joined #openstack-meeting | 08:17 | |
| *** e0ne has quit IRC | 08:17 | |
| *** whoami-rajat has quit IRC | 08:22 | |
| *** kopecmartin|off is now known as kopecmartin | 08:23 | |
| *** takamatsu has quit IRC | 08:32 | |
| *** ociuhandu has joined #openstack-meeting | 08:40 | |
| *** ociuhandu has quit IRC | 08:42 | |
| *** zbr has quit IRC | 09:07 | |
| *** janki has quit IRC | 09:09 | |
| *** zbr has joined #openstack-meeting | 09:10 | |
| *** e0ne has joined #openstack-meeting | 09:10 | |
| *** e0ne_ has quit IRC | 09:11 | |
| *** ociuhandu has joined #openstack-meeting | 09:21 | |
| *** ociuhandu has quit IRC | 09:25 | |
| *** ociuhandu has joined #openstack-meeting | 09:31 | |
| *** ociuhandu has quit IRC | 09:32 | |
| *** ociuhandu has joined #openstack-meeting | 09:33 | |
| *** ricolin has quit IRC | 09:50 | |
| *** brinzhang has joined #openstack-meeting | 09:57 | |
| *** Luzi has quit IRC | 10:00 | |
| *** whoami-rajat has joined #openstack-meeting | 10:00 | |
| *** ykatabam has joined #openstack-meeting | 10:25 | |
| *** ociuhandu has quit IRC | 10:27 | |
| *** ociuhandu has joined #openstack-meeting | 10:27 | |
| *** ttsiouts has quit IRC | 10:30 | |
| *** ttsiouts has joined #openstack-meeting | 10:31 | |
| *** brinzhang_ has joined #openstack-meeting | 10:34 | |
| *** ttsiouts has quit IRC | 10:36 | |
| *** brinzhang has quit IRC | 10:36 | |
| *** brinzhang has joined #openstack-meeting | 10:37 | |
| *** brinzhang_ has quit IRC | 10:38 | |
| *** Luzi has joined #openstack-meeting | 10:44 | |
| *** dmellado has quit IRC | 10:55 | |
| *** dmellado has joined #openstack-meeting | 10:57 | |
| *** brinzhang_ has joined #openstack-meeting | 10:57 | |
| *** brinzhang_ has quit IRC | 10:58 | |
| *** brinzhang has quit IRC | 11:00 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:00 | |
| *** jamesmcarthur has quit IRC | 11:04 | |
| *** ykatabam has quit IRC | 11:19 | |
| *** ttsiouts has joined #openstack-meeting | 11:33 | |
| *** hyunsikyang has quit IRC | 11:41 | |
| *** ttsiouts has quit IRC | 11:44 | |
| *** ttsiouts has joined #openstack-meeting | 11:45 | |
| *** dviroel has joined #openstack-meeting | 11:45 | |
| *** ociuhandu has quit IRC | 11:47 | |
| *** ociuhandu has joined #openstack-meeting | 11:48 | |
| *** Luzi has quit IRC | 11:48 | |
| *** markvoelker has joined #openstack-meeting | 11:48 | |
| *** ttsiouts has quit IRC | 11:49 | |
| *** ociuhandu has quit IRC | 11:54 | |
| *** raildo has joined #openstack-meeting | 11:56 | |
| *** ociuhandu has joined #openstack-meeting | 12:03 | |
| *** Luzi has joined #openstack-meeting | 12:04 | |
| *** ociuhandu has quit IRC | 12:11 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:11 | |
| *** ociuhandu has joined #openstack-meeting | 12:11 | |
| *** njohnston_ is now known as njohnston | 12:16 | |
| *** ociuhandu has quit IRC | 12:16 | |
| *** rfolco has joined #openstack-meeting | 12:23 | |
| *** larainema has quit IRC | 12:26 | |
| *** takamatsu has joined #openstack-meeting | 12:35 | |
| *** jamesmcarthur has quit IRC | 12:36 | |
| *** brinzhang has joined #openstack-meeting | 12:37 | |
| *** mriedem has joined #openstack-meeting | 12:42 | |
| *** number80 has joined #openstack-meeting | 12:44 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:45 | |
| *** eharney has quit IRC | 12:45 | |
| *** Luzi has quit IRC | 12:48 | |
| *** Luzi has joined #openstack-meeting | 12:49 | |
| *** whoami-rajat has quit IRC | 12:50 | |
| *** whoami-rajat has joined #openstack-meeting | 12:52 | |
| *** brinzhang_ has joined #openstack-meeting | 12:54 | |
| *** dmsimard has quit IRC | 12:54 | |
| *** takashin has joined #openstack-meeting | 12:54 | |
| *** ttsiouts has joined #openstack-meeting | 12:54 | |
| *** tetsuro has quit IRC | 12:55 | |
| *** dmsimard has joined #openstack-meeting | 12:55 | |
| *** tetsuro has joined #openstack-meeting | 12:55 | |
| *** brinzhang has quit IRC | 12:56 | |
| *** lseki has joined #openstack-meeting | 13:00 | |
| *** rfolco is now known as rfolco|ruck | 13:03 | |
| *** rbudden has joined #openstack-meeting | 13:03 | |
| *** ttsiouts has quit IRC | 13:06 | |
| *** ttsiouts has joined #openstack-meeting | 13:07 | |
| *** ociuhandu has joined #openstack-meeting | 13:09 | |
| *** ttsiouts has quit IRC | 13:11 | |
| *** takamatsu has quit IRC | 13:12 | |
| *** ttsiouts has joined #openstack-meeting | 13:14 | |
| *** eharney has joined #openstack-meeting | 13:30 | |
| *** lbragsta_ has joined #openstack-meeting | 13:43 | |
| *** efried has joined #openstack-meeting | 13:46 | |
| *** efried is now known as efried_afk | 13:46 | |
| *** brinzhang has joined #openstack-meeting | 13:47 | |
| *** brinzhang_ has quit IRC | 13:50 | |
| *** diconico07 has joined #openstack-meeting | 13:51 | |
| *** jawad_axd has quit IRC | 13:52 | |
| *** jawad_axd has joined #openstack-meeting | 13:54 | |
| *** ociuhandu has quit IRC | 13:57 | |
| *** Luzi has quit IRC | 13:57 | |
| *** jawad_axd has quit IRC | 13:58 | |
| *** cdent has joined #openstack-meeting | 13:59 | |
| mriedem | #startmeeting nova | 14:00 |
|---|---|---|
| openstack | Meeting started Thu Oct 17 14:00:11 2019 UTC and is due to finish in 60 minutes. The chair is mriedem. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: nova)" | 14:00 | |
| openstack | The meeting name has been set to 'nova' | 14:00 |
| takashin | o/ | 14:00 |
| melwitt | o/ | 14:00 |
| cdent | o. | 14:00 |
| mriedem | efried is shuttling kids atm | 14:00 |
| * cdent is only barely here | 14:00 | |
| stephenfin | o/ | 14:00 |
| dansmith | o/ | 14:00 |
| gmann | o/ | 14:00 |
| mriedem | #link agenda https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | 14:01 |
| mriedem | #topic Last meeting | 14:01 |
| *** openstack changes topic to "Last meeting (Meeting topic: nova)" | 14:01 | |
| mriedem | #link Minutes from last meeting: http://eavesdrop.openstack.org/meetings/nova/2019/nova.2019-10-03-14.00.html | 14:01 |
| mriedem | actions: | 14:01 |
| mriedem | #link db migration placeholders (merged) https://review.opendev.org/#/c/686411/ (done) | 14:01 |
| mriedem | #link SEV bug warning patch https://review.opendev.org/#/c/686414/ (done) | 14:01 |
| mriedem | #link update contributor guide https://review.opendev.org/#/c/685630/ - done but more could be done | 14:01 |
| mriedem | #topic Release News | 14:01 |
| *** openstack changes topic to "Release News (Meeting topic: nova)" | 14:02 | |
| mriedem | Train is released, stable/train is open for business. | 14:02 |
| mriedem | #link Nova Ussuri schedule https://wiki.openstack.org/wiki/Nova/Ussuri_Release_Schedule | 14:02 |
| mriedem | any questions about release stuff? | 14:02 |
| dansmith | hmm, | 14:02 |
| dansmith | so the compute alias patch finally landed, I guess I should propose that to train as well | 14:02 |
| *** ociuhandu has joined #openstack-meeting | 14:02 | |
| mriedem | i think it's optional, | 14:02 |
| mriedem | when looking at stein and rocky, we did one of those in it's target release and one after | 14:03 |
| mriedem | but didn't backport | 14:03 |
| mriedem | i can't remember which | 14:03 |
| mriedem | it doesn't hurt to backport either so whatever | 14:03 |
| dansmith | it is not critical, but it's confusing for it to not be consistent, just not a huge deal to hold it up | 14:03 |
| dansmith | yeha | 14:03 |
| mriedem | moving on | 14:04 |
| mriedem | #topic Summit/PTG Planning | 14:04 |
| *** openstack changes topic to "Summit/PTG Planning (Meeting topic: nova)" | 14:04 | |
| mriedem | Ussuri scope containment, | 14:04 |
| mriedem | #link Spec template update for "core liaison" is merged https://review.opendev.org/#/c/685857/ | 14:04 |
| mriedem | ^ had 2 cores vote on it so that makes 3 total that are aware of the new spec process, | 14:04 |
| mriedem | if people have issues with what was merged they can propose amendments | 14:05 |
| * mriedem doesn't know what the new process is yet either really | 14:05 | |
| mriedem | questions? | 14:05 |
| dansmith | lol | 14:05 |
| gmann | so we still waiting for new process of spec selection right ? | 14:05 |
| *** jawad_axd has joined #openstack-meeting | 14:05 | |
| gmann | core liaison is just for adding liaison things not the new process | 14:06 |
| dansmith | not really "waiting" I don't think.. specs are being approved and implemented | 14:06 |
| mriedem | you mean the capping | 14:06 |
| gmann | yeah | 14:06 |
| gmann | or we dropped the idea of capping | 14:06 |
| mriedem | i want to say eric intends on capping things as we get closer to a freeze date but not sure | 14:06 |
| mriedem | i don't think he dropped the idea of capping | 14:06 |
| mriedem | but i also haven't been paying much attention to it either so you'd have to ask eric | 14:06 |
| gmann | ok | 14:07 |
| mriedem | #topic Stable branch status | 14:07 |
| *** openstack changes topic to "Stable branch status (Meeting topic: nova)" | 14:07 | |
| mriedem | as i said stable/train is open and i've been +2ing changes | 14:07 |
| mriedem | #link stable/train: https://review.openstack.org/#/q/status:open+(project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/nova)+branch:stable/train | 14:07 |
| mriedem | we just recently-ish did a stein release, | 14:07 |
| mriedem | #link stable/stein: https://review.openstack.org/#/q/status:open+(project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/nova)+branch:stable/stein | 14:07 |
| *** ociuhandu has quit IRC | 14:07 | |
| mriedem | we did a rocky release last week, | 14:07 |
| mriedem | #link stable/rocky: https://review.openstack.org/#/q/status:open+(project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/nova)+branch:stable/rocky | 14:07 |
| mriedem | and we need to flush queens and do a release soon, | 14:08 |
| mriedem | #link stable/queens: https://review.openstack.org/#/q/status:open+(project:openstack/os-vif+OR+project:openstack/python-novaclient+OR+project:openstack/nova)+branch:stable/queens | 14:08 |
| mriedem | queens goes into extended maintenance in a couple of weeks | 14:08 |
| mriedem | oct 25 to be exact | 14:08 |
| *** brinzhang_ has joined #openstack-meeting | 14:08 | |
| mriedem | #help review stable/queens backports so we can flush the queue and do a final release before extended maintenance | 14:08 |
| mriedem | note that some of the things proposed to queens are yet to be merged on the newer branches - basically everything gibi is pushing :) | 14:09 |
| mriedem | questions about stable? | 14:09 |
| mriedem | #topic Bugs (stuck/critical) | 14:09 |
| *** openstack changes topic to "Bugs (stuck/critical) (Meeting topic: nova)" | 14:09 | |
| mriedem | there is 1 critical bug, | 14:09 |
| mriedem | #link https://bugs.launchpad.net/nova/+bug/1848499 | 14:09 |
| openstack | Launchpad bug 1848499 in OpenStack Compute (nova) "tests fail with networkx 2.4: "AttributeError: 'DiGraph' object has no attribute 'node'"" [Critical,In progress] - Assigned to Balazs Gibizer (balazs-gibizer) | 14:09 |
| mriedem | gibi has a patch: https://review.opendev.org/#/c/689152/ | 14:10 |
| mriedem | but we're totally blocked in the gate until that lands | 14:10 |
| mriedem | so hold your rechecks | 14:10 |
| mriedem | #link 85 new untriaged bugs (+11 since the last meeting): https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New | 14:10 |
| dansmith | so, | 14:10 |
| dansmith | that was not the failure I saw and rechecked for | 14:10 |
| mriedem | yeah it is | 14:10 |
| dansmith | there were like five powervm unit fails | 14:10 |
| mriedem | it's the powervm driver tests, | 14:10 |
| mriedem | which use taskflow, | 14:10 |
| mriedem | which uses networkx | 14:10 |
| dansmith | oh, jeez, okay | 14:10 |
| mriedem | which just released and is uncapped | 14:11 |
| mriedem | turbugen | 14:11 |
| *** bnemec has joined #openstack-meeting | 14:11 | |
| mriedem | as seen from the numbers above we're falling behind in bug triage, | 14:11 |
| mriedem | #link 9 untagged untriaged bugs (+6 since the last meeting): https://bugs.launchpad.net/nova/+bugs?field.tag=-*&field.status%3Alist=NEW | 14:11 |
| mriedem | #link bug triage how-to: https://wiki.openstack.org/wiki/Nova/BugTriage#Tags | 14:11 |
| mriedem | #help need help with bug triage | 14:11 |
| *** brinzhang has quit IRC | 14:12 | |
| mriedem | we do have a few random oslo.messaging/conductor related bugs sitting in triage that i don't know what to do with | 14:12 |
| mriedem | since they are like, "rpc something, service crashed" | 14:12 |
| mriedem | *shrug* | 14:12 |
| efried_afk | o/ sorry folks | 14:12 |
| * efried_afk catches up | 14:12 | |
| *** efried_afk is now known as efried | 14:12 | |
| mriedem | efried_afk: we're at gate status, you want me to just keep going? | 14:12 |
| mriedem | efried: ^ | 14:13 |
| mriedem | #topic Gate status | 14:13 |
| *** openstack changes topic to "Gate status (Meeting topic: nova)" | 14:13 | |
| mriedem | #link check queue gate status http://status.openstack.org/elastic-recheck/index.html | 14:13 |
| mriedem | so we obviously have a few gate bugs, the one above being the main issue, | 14:13 |
| mriedem | http://status.openstack.org/elastic-recheck/index.html#1844929 is our other major gate bug, | 14:13 |
| mriedem | for which i don't have an answer | 14:13 |
| mriedem | i have a couple of patches up to grenade and devstack gate to try and get more detailed mysql logs to see why mysql connections are getting aborted, | 14:14 |
| mriedem | but those patches aren't working yet and i haven't been prioritizing it | 14:14 |
| mriedem | so if someone can help that'd be cool | 14:14 |
| efried | mriedem: yes please and thanks. | 14:14 |
| mriedem | #link 3rd party CI status (seems to be back in action) http://ciwatch.mmedvede.net/project?project=nova | 14:14 |
| mriedem | not much to report on 3rd party ci status except i'm sure some jobs are still not working, | 14:15 |
| *** ociuhandu has joined #openstack-meeting | 14:15 | |
| mriedem | and i reported a thing to the hyper-v guys last week and it was already fixed by the time i reported it so thanks to them for being on top of their game | 14:15 |
| mriedem | #topic Reminders | 14:15 |
| *** openstack changes topic to "Reminders (Meeting topic: nova)" | 14:15 | |
| mriedem | there is nothing in the agenda for reminders | 14:15 |
| mriedem | #topic Sub/related team Highlights | 14:16 |
| *** openstack changes topic to "Sub/related team Highlights (Meeting topic: nova)" | 14:16 | |
| mriedem | Placement (cdent/tetsuro) ? | 14:16 |
| mriedem | i was just going to note https://review.opendev.org/#/c/688969/ if there was nothing else | 14:16 |
| cdent | tetsuro: posted an email about ptg topics for people who will be there | 14:16 |
| mriedem | as i said on there i'm a .5 meh | 14:16 |
| cdent | melwitt made some updates to the consumer types stuff (thank you!) | 14:16 |
| cdent | that's all I know | 14:16 |
| mriedem | ack, | 14:17 |
| efried | #link placement ptg http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010182.html | 14:17 |
| efried | #link placement ptg etherpad https://etherpad.openstack.org/p/placement-shanghai-ptg | 14:17 |
| melwitt | yeah, I just addressed my own test comments. stack has passed CI | 14:17 |
| efried | re COMPUTE_NODE patch, if we can get that merged and released, I can roll up two versions in the placement catch-up. | 14:18 |
| gibi | efried: I will look at it soon ^^ | 14:18 |
| efried | thx | 14:18 |
| mriedem | dansmith: just so you're aware, and i don't remember if there is any reason not to do this, | 14:18 |
| *** lpetrut has quit IRC | 14:18 | |
| mriedem | but that patch is to add a generic COMPUTE_NODE trait to more easily filter compute node resource providers, like in sylvain's audit CLI | 14:18 |
| mriedem | i feel like we've talked about this a few times over the years but just never did it for whatever reason | 14:19 |
| *** zaneb has quit IRC | 14:19 | |
| mriedem | moving on to, | 14:19 |
| mriedem | API (gmann) | 14:19 |
| gmann | I have not started updates for ussuri yet (may be after PTG I will collect the API works and status) | 14:19 |
| gmann | and reminder for review on policy spec - https://review.opendev.org/#/c/686058/ | 14:19 |
| gmann | that's all from me today. | 14:20 |
| mriedem | ok | 14:20 |
| mriedem | #topic Stuck Reviews | 14:20 |
| *** openstack changes topic to "Stuck Reviews (Meeting topic: nova)" | 14:20 | |
| *** jamesmcarthur has quit IRC | 14:20 | |
| mriedem | nothing in the agenda | 14:20 |
| mriedem | #topic Review status page | 14:20 |
| *** openstack changes topic to "Review status page (Meeting topic: nova)" | 14:20 | |
| mriedem | #link http://status.openstack.org/reviews/#nova | 14:20 |
| mriedem | Count: 456 (-1); Top score: 2133 (+42) | 14:20 |
| mriedem | #help Pick a patch near the top, shepherd it to closure | 14:20 |
| mriedem | just a reminder on ^, | 14:20 |
| mriedem | if you abandon a change, update the related bug (mark it invalid if it's invalid, etc) | 14:21 |
| mriedem | #topic Open discussion | 14:21 |
| *** openstack changes topic to "Open discussion (Meeting topic: nova)" | 14:21 | |
| mriedem | since we skipped last week's meeting we have a lot more than usual items here | 14:21 |
| mriedem | #help Volunteer core(s) for "Meet the Project Leaders" in Shanghai | 14:21 |
| mriedem | i think that is done | 14:21 |
| mriedem | efried: ^? | 14:21 |
| efried | ... | 14:21 |
| mriedem | i thought stephenfin and gibi were signing up for all outreach work | 14:22 |
| efried | Yup, bauzas and stephenfin have volunteered | 14:22 |
| mriedem | ok | 14:22 |
| gmann | #link https://etherpad.openstack.org/p/meet-the-project-leaders | 14:22 |
| gibi | I can be there if needed | 14:22 |
| gmann | stephenfin | 14:22 |
| efried | thanks for that | 14:22 |
| mriedem | i'm assuming alex_xu will also be at the summit...? | 14:22 |
| gmann | both | 14:22 |
| mriedem | seems like it would be good to have the one chinese nova core involved in that stuff while in china :) | 14:22 |
| stephenfin | yes, yes it would | 14:23 |
| mriedem | #help Volunteer for interop guidelines | 14:23 |
| mriedem | #link http://paste.openstack.org/raw/781768/ | 14:23 |
| mriedem | not sure if anyone signed up for this, | 14:23 |
| mriedem | FWIW I think this is the last time we added anything and it was the first time we added a guideline that depended on a microversion: https://review.opendev.org/509955/ | 14:23 |
| mriedem | that was adding the 2.2 keypair type microversion to interop | 14:24 |
| mriedem | that microversion was added in kilo.... | 14:24 |
| mriedem | so you can see how far behind the guidelines are compared to the compute API | 14:24 |
| mriedem | i'm not signing up, but if someone is interested you could just look for something newer than kilo that would be non-admin and hypervisor-agnostic as a potential guideline | 14:25 |
| mriedem | moving on, | 14:25 |
| mriedem | #link in-place numa rebuild https://blueprints.launchpad.net/nova/+spec/inplace-rebuild-of-numa-instances | 14:25 |
| mriedem | sean-k-mooney: ^ | 14:25 |
| mriedem | i'm not sure why that's a blueprint rather than a bug? | 14:25 |
| sean-k-mooney | ya so its acatully 2 bugs | 14:26 |
| gmann | for interop microversion, interop question was for corresponding tempest tests and we said we have exiting tests and if no tests then it can be added | 14:26 |
| sean-k-mooney | i create a blue pritn just to group them together | 14:26 |
| sean-k-mooney | https://review.opendev.org/#/c/687957/ is 99% of the work addressing https://bugs.launchpad.net/nova/+bug/1763766 | 14:26 |
| openstack | Launchpad bug 1763766 in OpenStack Compute (nova) "nova needs to disallow resource consumption changes on image rebuild" [Medium,In progress] - Assigned to sean mooney (sean-k-mooney) | 14:26 |
| sean-k-mooney | the final step is skiping the numa toplogy filer on rebuild | 14:27 |
| efried | if it's bugs, do it as bugs, save some paperwork. | 14:27 |
| mriedem | you also can't backport blueprints generally | 14:27 |
| mriedem | so i'd nack the blueprint | 14:27 |
| sean-k-mooney | i just wanted to make sure people were ok with that apparch | 14:27 |
| gibi | if this is more than one bug I think having a bp helps to track the work | 14:27 |
| dansmith | this is a pretty big change though | 14:27 |
| dansmith | the bugs are more "this was never implemented" which we've previously said are not good bugs | 14:28 |
| sean-k-mooney | dansmith: not really well feature wise maybe | 14:28 |
| sean-k-mooney | code wise its small | 14:28 |
| dansmith | sean-k-mooney: I know | 14:28 |
| dansmith | seems like a BP to me | 14:28 |
| sean-k-mooney | ya which is the main reason i filled the blueprint | 14:28 |
| sean-k-mooney | so honestly i dont mind either way | 14:29 |
| sean-k-mooney | but im tracking it as an RFE downstream | 14:29 |
| mriedem | regarding changing rebuild to explicitly fail, | 14:29 |
| mriedem | we did that as a bug fix for volume-backed servers when the image changes, | 14:30 |
| mriedem | because we used to silently allow that and the image in the root volume never changed and confused everyone | 14:30 |
| mriedem | is this like that? | 14:30 |
| sean-k-mooney | yep exactly | 14:30 |
| sean-k-mooney | we do a noop claim | 14:30 |
| sean-k-mooney | so the numa toplogy does not change | 14:30 |
| sean-k-mooney | untill you do a move operation | 14:30 |
| mriedem | but the image might have a different topology | 14:30 |
| sean-k-mooney | yep | 14:31 |
| mriedem | i would only question if people have been relying on that behavior such that it's now a "feature", | 14:31 |
| mriedem | i.e. rebuild with new image with new topology and then migrate | 14:31 |
| mriedem | dansmith: is that your concern? ^ | 14:32 |
| *** takamatsu has joined #openstack-meeting | 14:32 | |
| sean-k-mooney | i debated adding a workaround config option to allow that for backport reaons. but going forword i would prefer not to support that | 14:32 |
| sean-k-mooney | kind of like the numa migration | 14:32 |
| dansmith | mriedem: no, I don't really have any concerns, I just think that it makes sense to call this a blueprint/feature addition | 14:33 |
| dansmith | "foo is not implemented" is not a bug to me | 14:33 |
| dansmith | which we've said several times | 14:33 |
| dansmith | but we've already spent too much time on it here, so I'd say call it a pink elephant if you want, let's just move on and do it | 14:34 |
| mriedem | ok moving on, i left some thoughts in the patch | 14:34 |
| mriedem | (melwitt) requesting approval for specless blueprint: https://blueprints.launchpad.net/nova/+spec/policy-rule-for-host-status-unknown | 14:35 |
| melwitt | yeah, this is the same blueprint from last cycle that I had asked about. adding a new policy rule | 14:35 |
| mriedem | assuming melwitt's patch matches the conditions set in the blueprint whiteboard the last time we talked about this, | 14:35 |
| mriedem | i don't see why we wouln't approve | 14:35 |
| melwitt | yes, the patch is implemented as described by mriedem in the bp whiteboard | 14:35 |
| mriedem | then i'm +1 to approve | 14:36 |
| mriedem | gibi also said he was ok with it in the bp | 14:36 |
| mriedem | and i'm assuming efried is as well | 14:36 |
| mriedem | so barring any objections i'll approve after the meeting | 14:36 |
| efried | go for it | 14:36 |
| melwitt | thank you | 14:37 |
| *** links has quit IRC | 14:37 | |
| mriedem | (stephenfin) approval for specless blueprint: https://blueprints.launchpad.net/nova/+spec/remove-xvpvncproxy | 14:37 |
| *** jawad_axd has quit IRC | 14:37 | |
| * stephenfin perks up | 14:37 | |
| gibi | ok with me | 14:37 |
| stephenfin | only complication is that there's an API here | 14:37 |
| stephenfin | but we've removed (HTTP Gone) nova-network APIs in the past without specs so it should be okay, imo | 14:38 |
| melwitt | this would be done similar to how you removed os-cells right? is there anything different | 14:38 |
| mriedem | just a 410, it's the same | 14:38 |
| stephenfin | nah, same thing | 14:38 |
| melwitt | ok, then yeah seems fine to me | 14:38 |
| mriedem | BobBall said in the mailing list before/around the denver ptg that no one is probably using this right? | 14:38 |
| stephenfin | correct. I've a patch up and have linked to those discussions from it | 14:38 |
| mriedem | of course we don't know who uses xenserver, they seem to randomly show up | 14:38 |
| stephenfin | we also included it in reno, and they have another option (noVNC) | 14:39 |
| mriedem | the only point i wasn't clear on from bob's email was a replacement for this | 14:39 |
| stephenfin | noVNC | 14:39 |
| mriedem | ah | 14:39 |
| mriedem | ok | 14:39 |
| melwitt | yeah what I recall from the ML thread, it is safe to remove and an old legacy thing | 14:39 |
| mriedem | alright so barring objections (again) i'll approve after the meeting | 14:39 |
| mriedem | (mriedem): Need to discuss options for https://bugs.launchpad.net/nova/+bug/1847367 | 14:40 |
| openstack | Launchpad bug 1847367 in OpenStack Compute (nova) "Images with hw:vif_multiqueue_enabled can be limited to 8 queues even if more are supported" [Undecided,Confirmed] | 14:40 |
| *** gyee has joined #openstack-meeting | 14:40 | |
| *** ttsiouts has quit IRC | 14:40 | |
| mriedem | so apparently we have hard-coded some tap queue limits in the libvirt driver vif module based on kernel version, | 14:40 |
| sean-k-mooney | mriedem: thats on my dodo list for this week | 14:40 |
| mriedem | keep your doodoo to yourself sean | 14:40 |
| sean-k-mooney | :) | 14:41 |
| efried | hah, I need to call it my dodo list. Work that's extinct. | 14:41 |
| mriedem | but centos has a patched kernel that allows more than what we have hard-coded | 14:41 |
| mriedem | i don't really want distro-specific checks in our code, | 14:41 |
| sean-k-mooney | am its a long know bug | 14:41 |
| sean-k-mooney | basically the limit should never have applied to vhost-user ports | 14:41 |
| mriedem | so another option is just having a workaround flag to allow deployers to set the value | 14:41 |
| stephenfin | yet another is that we just document this | 14:42 |
| mriedem | document what | 14:42 |
| mriedem | ? | 14:42 |
| melwitt | is it an option that we expect to eventually remove? that's the usual condition for [workarounds] | 14:42 |
| stephenfin | that some distros are broken | 14:42 |
| stephenfin | you want the fix, go bug your vendor to backport the fix a lá CentOS | 14:42 |
| stephenfin | assuming I've understood it correctly | 14:42 |
| sean-k-mooney | well the issue is that rhel/centos backported chagnes form the 4.x kernel | 14:42 |
| stephenfin | ah, wait, yeah, other way round | 14:43 |
| stephenfin | ignore me | 14:43 |
| melwitt | I think it's the opposite? we hard-coded something based on kernel version | 14:43 |
| melwitt | yeah | 14:43 |
| sean-k-mooney | yes | 14:43 |
| *** ttsiouts has joined #openstack-meeting | 14:43 | |
| *** sridharg has quit IRC | 14:43 | |
| mriedem | melwitt: idk what the timeline would be for removal, | 14:43 |
| sean-k-mooney | so we could add a workaorund flag for it as mriedem suggested | 14:43 |
| mriedem | we don't really require min versions of kernels | 14:43 |
| diconico07 | unless there is some procfile or sysfile magic to do here this is the best solution imo | 14:43 |
| mriedem | if not a workaround flag, it'd be a libvirt group flag | 14:43 |
| mriedem | i would default to None to let nova decide but allow you to override if you're using a patched kernel | 14:44 |
| mriedem | are people ok with that? | 14:44 |
| sean-k-mooney | this is also applied to vhost-user ports today which it should nerver have been applie too so that is what i planned to work on tomorrow | 14:44 |
| stephenfin | wfm | 14:44 |
| sean-k-mooney | mriedem: that works for me | 14:45 |
| mriedem | sean-k-mooney: ok so you can mention vhostuser ports in the bug report i guess, sounds like those are separate changes | 14:45 |
| melwitt | yeah. I can't decide whether it should be [workarounds] or not, but config option seems like the best way | 14:45 |
| mriedem | #agree add libvirt group option to override max tap limit for bug 1847367 | 14:45 |
| openstack | bug 1847367 in OpenStack Compute (nova) "Images with hw:vif_multiqueue_enabled can be limited to 8 queues even if more are supported" [Undecided,Confirmed] https://launchpad.net/bugs/1847367 | 14:45 |
| sean-k-mooney | mriedem: we applie the kernel limit to vhoust-user ports too | 14:45 |
| sean-k-mooney | so ya its a sperate but related issue | 14:45 |
| sean-k-mooney | mriedem: do you want me to take this | 14:45 |
| mriedem | sean-k-mooney: you're talking to me about this like i know anything about vhostuser limits and max tap queues | 14:45 |
| sean-k-mooney | since i was going to fix it for vhostuser anyway | 14:45 |
| mriedem | moving on | 14:45 |
| mriedem | sean-k-mooney: separate bugs | 14:46 |
| mriedem | just report a different bug | 14:46 |
| sean-k-mooney | ok | 14:46 |
| mriedem | (mriedem): Do we have a particular stance on features to the libvirt driver for non-integration tested configurations, e.g. lxc [ https://review.opendev.org/#/c/667976/ ] and xen [ https://review.opendev.org/#/c/687827/ ], meaning if they are trivial enough do we just say the driver's quality warning on startup is sufficient to let them land since these are changes from casual contributors scratching an itch? | 14:46 |
| mriedem | maybe ^ should be in the ML | 14:46 |
| efried | yeah, that's a weird one. | 14:47 |
| mriedem | but these examples seem trivial enough to me to fall under part-time hobby contributor scratching an itch | 14:47 |
| stephenfin | probably, yeah | 14:47 |
| melwitt | yeah, maybe good for ML | 14:47 |
| mriedem | so saying "3rd party ci or die" won't fly | 14:47 |
| stephenfin | but with that said | 14:47 |
| *** ricolin has joined #openstack-meeting | 14:47 | |
| melwitt | and I agree, if trivial then ok to land | 14:47 |
| stephenfin | if it doesn't impact _other_ drivers, go nuts, I say | 14:47 |
| mriedem | #action mriedem to ask on the ML about accepting trivial feature patches for driver configs that don't get integration testing | 14:48 |
| diconico07 | There is already a notice saying these drivers aren't integration tested | 14:48 |
| mriedem | i know, hence the "quality warning" thing in my line above | 14:48 |
| clarkb | also we can test lc and xen upstream I think (xen might require some hax though) | 14:48 |
| clarkb | *lxc | 14:48 |
| mriedem | clarkb: "can" and "who is going to do and maintain that" are different things | 14:48 |
| sean-k-mooney | clarkb: we could test xen more siplely if we had a xen image/lable | 14:49 |
| mriedem | moving on, | 14:49 |
| mriedem | final item, | 14:49 |
| mriedem | (melwitt): requesting approval for specless blueprint: https://blueprints.launchpad.net/nova/+spec/nova-manage-db-purge-task-log | 14:49 |
| mriedem | melwitt: i left a comment in there, | 14:49 |
| clarkb | I get that but telling soneone they can write a job is way easier that run an entore ci system | 14:49 |
| mriedem | smells like a bug | 14:49 |
| melwitt | I MLed about this awhile back | 14:49 |
| melwitt | orly? I'm happy to treat it as a bug | 14:50 |
| mriedem | the bug is that these records pile up and you have to go directly to the db to clean them up | 14:50 |
| mriedem | it's somewhere in between a super low priority bug and a feature i guess | 14:50 |
| mriedem | anyway, i'd probably just create a wishlist bug for it? idk what others think | 14:51 |
| melwitt | our customers are using the task_log stuff by way of telemetry always enabling the audit API, so we have a lot of people affected by the record build up. and there are enough of them not otherwise truncating the table, it's all been one-offs | 14:51 |
| mriedem | we don't have great process rules around adding ops tooling things for nova clis | 14:51 |
| melwitt | ok. I'm good either way so if ppl prefer a wishlist bug, I can do that | 14:51 |
| mriedem | i'm ok with a bug but others can overrule | 14:51 |
| mriedem | maybe lobby for opions in -nova after the meeting, let efried decide | 14:52 |
| mriedem | anything else? | 14:52 |
| melwitt | ok | 14:52 |
| mriedem | ok thanks for hanging in there everyone | 14:52 |
| mriedem | #endmeeting | 14:52 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:53 | |
| openstack | Meeting ended Thu Oct 17 14:52:59 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:53 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/nova/2019/nova.2019-10-17-14.00.html | 14:53 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/nova/2019/nova.2019-10-17-14.00.txt | 14:53 |
| efried | mriedem: thanks for covering. | 14:53 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/nova/2019/nova.2019-10-17-14.00.log.html | 14:53 |
| *** takashin has left #openstack-meeting | 14:53 | |
| *** gagehugo has joined #openstack-meeting | 14:53 | |
| *** efried is now known as efried_afk | 14:53 | |
| mriedem | np | 14:56 |
| *** mhen has joined #openstack-meeting | 15:01 | |
| gagehugo | #startmeeting security | 15:01 |
| openstack | Meeting started Thu Oct 17 15:01:15 2019 UTC and is due to finish in 60 minutes. The chair is gagehugo. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| *** openstack changes topic to " (Meeting topic: security)" | 15:01 | |
| openstack | The meeting name has been set to 'security' | 15:01 |
| gagehugo | #link https://etherpad.openstack.org/p/security-agenda agenda | 15:01 |
| fungi | greetings | 15:01 |
| *** andrebeltrami has joined #openstack-meeting | 15:03 | |
| *** diablo_rojo has joined #openstack-meeting | 15:03 | |
| gagehugo | light agenda today | 15:03 |
| fungi | i've been wrapped up in other things this past week, so not sure what there is to discuss | 15:05 |
| gagehugo | same | 15:05 |
| fungi | though we skipped last week | 15:05 |
| gagehugo | a busy october unfortunately | 15:05 |
| fungi | so we could talk about the octavia ossa | 15:06 |
| fungi | that was week before last | 15:06 |
| gagehugo | sure | 15:06 |
| fungi | #link https://security.openstack.org/ossa/OSSA-2019-005.html OSSA-2019-005: Octavia Amphora-Agent not requiring Client-Certificate | 15:07 |
| fungi | i thought this was actually a really cool first | 15:07 |
| gagehugo | yeah, the team there managed the process themselves for the most part | 15:07 |
| fungi | the octavia team followed the openstack vmt's process themselves, since that deliverable doesn't have a vulnerability:managed governance tag | 15:07 |
| fungi | so, yeah, the vmt just reviewed the ossa, octavia took care of the rest | 15:08 |
| fungi | it can't have been easy, so big kudos to them | 15:08 |
| njohnston | fungi: I'll pass it on! Very cool. | 15:08 |
| * njohnston works closely with those folks | 15:09 | |
| johnsom | o/ | 15:09 |
| fungi | also i think it's our first ossa to link a story in storyboard instead of a bug in launchpad | 15:09 |
| gagehugo | \o/ | 15:10 |
| *** nanzha has quit IRC | 15:11 | |
| *** dmsimard has quit IRC | 15:11 | |
| fungi | in more general news, there's quite a few patches proposed/merged/released for security hardening opportunities this month: | 15:11 |
| fungi | #link http://lists.openstack.org/pipermail/openstack-security/2019-October/thread.html | 15:11 |
| fungi | not sure if anyone has any in particular they want to call out | 15:12 |
| *** dmsimard has joined #openstack-meeting | 15:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:12 | |
| fungi | #link https://launchpad.net/bugs/1842749 CSV Injection Possible in Compute Usage History | 15:13 |
| openstack | Launchpad bug 1842749 in OpenStack Dashboard (Horizon) "CSV Injection Possible in Compute Usage History" [High,Fix released] - Assigned to Adam Harwell (adam-harwell) | 15:13 |
| *** nanzha has joined #openstack-meeting | 15:13 | |
| fungi | that one was determined to be a security hardening opportunity 5 days ago, and the fix for it merged to master a few days later | 15:14 |
| * gagehugo will take a look | 15:15 | |
| gagehugo | oh that's the windows one | 15:15 |
| fungi | yeah, i thought that was a rather obscure report, but nice to see folks thinking creatively about attack vectors | 15:16 |
| *** cdent has left #openstack-meeting | 15:17 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 15:17 | |
| *** mattw4 has joined #openstack-meeting | 15:18 | |
| gagehugo | yeah, it's valid | 15:18 |
| fungi | what with everyone focused on train release prep the past few weeks, i expect there's just not much for us to talk about today | 15:21 |
| gagehugo | anything else for this week? | 15:21 |
| gagehugo | probbaly | 15:21 |
| gagehugo | probably* | 15:21 |
| *** jamesmcarthur has quit IRC | 15:21 | |
| gagehugo | We can go ahead and cancel the meeting during the summit as well | 15:21 |
| fungi | that's likely for the best. thursday the 7th | 15:22 |
| fungi | of november | 15:23 |
| fungi | i also doubt i'll be around for the meeting thursday october 31st as i'll be on my way to catch a flight to shanghai | 15:23 |
| fungi | technically the one on november 7 is during the ptg not the summit, but close enough | 15:24 |
| gagehugo | yeah | 15:24 |
| gagehugo | I'll also be out the 21st of Nov | 15:24 |
| fungi | it's getting to be that time of year | 15:24 |
| *** igordc has joined #openstack-meeting | 15:24 | |
| gagehugo | yup | 15:25 |
| gagehugo | winter is coming | 15:25 |
| fungi | so anyway, plan to meet next week as usual, i'll miss the week after that, and then the following week is summit/ptg | 15:25 |
| gagehugo | sounds good | 15:25 |
| gagehugo | anything else? floor is open | 15:26 |
| gagehugo | thanks everyone, have a good rest of the week! | 15:28 |
| gagehugo | #endmeeting | 15:28 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:28 | |
| openstack | Meeting ended Thu Oct 17 15:28:57 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:28 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/security/2019/security.2019-10-17-15.01.html | 15:29 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/security/2019/security.2019-10-17-15.01.txt | 15:29 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/security/2019/security.2019-10-17-15.01.log.html | 15:29 |
| *** zbr has quit IRC | 15:29 | |
| *** zbr__ has joined #openstack-meeting | 15:29 | |
| fungi | thanks gagehugo! | 15:29 |
| *** e0ne has quit IRC | 15:29 | |
| *** jawad_axd has joined #openstack-meeting | 15:32 | |
| *** enriquetaso has joined #openstack-meeting | 15:33 | |
| *** jamesmcarthur_ has quit IRC | 15:33 | |
| *** nanzha has quit IRC | 15:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:49 | |
| *** brinzhang_ has quit IRC | 15:49 | |
| *** whoami-rajat has quit IRC | 15:50 | |
| *** brinzhang_ has joined #openstack-meeting | 15:50 | |
| *** brinzhang_ has quit IRC | 15:51 | |
| *** nanzha has joined #openstack-meeting | 15:52 | |
| *** ttsiouts has quit IRC | 15:54 | |
| *** donghao has joined #openstack-meeting | 15:55 | |
| *** tssurya has quit IRC | 16:00 | |
| *** enriquetaso has quit IRC | 16:02 | |
| *** armstrong has joined #openstack-meeting | 16:02 | |
| *** efried_afk is now known as efried | 16:02 | |
| *** rsimai_away is now known as rsimai | 16:08 | |
| *** rsimai is now known as rsimai_away | 16:08 | |
| *** ociuhandu_ has joined #openstack-meeting | 16:23 | |
| *** ociuhandu has quit IRC | 16:26 | |
| *** markvoelker has quit IRC | 16:26 | |
| *** rpittau is now known as rpittau|afk | 16:27 | |
| *** nanzha has quit IRC | 16:27 | |
| *** ociuhandu_ has quit IRC | 16:30 | |
| *** lpetrut has joined #openstack-meeting | 16:39 | |
| *** lpetrut has quit IRC | 16:40 | |
| *** lpetrut has joined #openstack-meeting | 16:40 | |
| *** geguileo has quit IRC | 16:46 | |
| *** enriquetaso has joined #openstack-meeting | 17:00 | |
| *** lpetrut has quit IRC | 17:01 | |
| *** markvoelker has joined #openstack-meeting | 17:05 | |
| *** zaneb has joined #openstack-meeting | 17:11 | |
| *** enriquetaso has quit IRC | 17:22 | |
| *** lpetrut has joined #openstack-meeting | 17:37 | |
| *** ociuhandu has joined #openstack-meeting | 17:38 | |
| *** zaneb has quit IRC | 17:41 | |
| *** enriquetaso has joined #openstack-meeting | 17:45 | |
| *** psachin has quit IRC | 17:46 | |
| *** armax has quit IRC | 17:48 | |
| *** andrebeltrami has quit IRC | 17:52 | |
| *** jamesmcarthur has quit IRC | 17:55 | |
| *** mriedem has quit IRC | 17:55 | |
| *** mriedem has joined #openstack-meeting | 17:56 | |
| *** jawad_axd has quit IRC | 17:59 | |
| SotK | #startmeeting storyboard | 18:02 |
| openstack | Meeting started Thu Oct 17 18:02:24 2019 UTC and is due to finish in 60 minutes. The chair is SotK. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:02 |
| *** openstack changes topic to " (Meeting topic: storyboard)" | 18:02 | |
| openstack | The meeting name has been set to 'storyboard' | 18:02 |
| diablo_rojo | o/ | 18:02 |
| SotK | #topic https://wiki.openstack.org/wiki/Meetings/StoryBoard Agenda | 18:02 |
| *** openstack changes topic to "https://wiki.openstack.org/wiki/Meetings/StoryBoard Agenda (Meeting topic: storyboard)" | 18:02 | |
| diablo_rojo | Heh, you mean link? ;) | 18:03 |
| *** enriquetaso has quit IRC | 18:03 | |
| SotK | #undo | 18:03 |
| openstack | Removing item from minutes: #topic https://wiki.openstack.org/wiki/Meetings/StoryBoard Agenda | 18:03 |
| SotK | its that kind of day | 18:03 |
| SotK | #link https://wiki.openstack.org/wiki/Meetings/StoryBoard Agenda | 18:03 |
| diablo_rojo | Nailed it :) | 18:04 |
| SotK | no announcements this week, and I assume the same for migration updates, since attachments aren't done yet | 18:04 |
| diablo_rojo | Correct | 18:05 |
| SotK | #topic PTG + Forum | 18:06 |
| *** openstack changes topic to "PTG + Forum (Meeting topic: storyboard)" | 18:06 | |
| SotK | #link https://www.openstack.org/ptg/#tab_schedule Schedule | 18:06 |
| SotK | we are on the schedule! | 18:06 |
| SotK | 10:30am on Wednesday | 18:06 |
| SotK | thanks for organising that diablo_rojo | 18:06 |
| diablo_rojo | No problem | 18:06 |
| diablo_rojo | We've got two hours | 18:06 |
| diablo_rojo | I figured that should be alright. | 18:06 |
| fungi | now if i just manage to get a visa so diablo_rojo isn't left answering questions alone | 18:06 |
| diablo_rojo | if we need more time we can always get more time friday | 18:07 |
| diablo_rojo | fungi, you assume they will actually honor my 10 year visa ;) | 18:07 |
| fungi | fair | 18:07 |
| SotK | I will be asleep I'm afraid | 18:08 |
| fungi | i'll be struggling to stay awake | 18:08 |
| diablo_rojo | SotK, no worries. I will give you the lowdown at the next meeting or right after | 18:08 |
| diablo_rojo | fungi, you and me both | 18:08 |
| fungi | no coffee allowed in the ptg rooms! :/ | 18:08 |
| diablo_rojo | fungi, yeah. Not sure how this venue gets away with that. | 18:09 |
| SotK | diablo_rojo: thanks | 18:09 |
| diablo_rojo | SotK, no problem | 18:09 |
| SotK | anything else PTGish to discuss? | 18:10 |
| *** jawad_axd has joined #openstack-meeting | 18:11 | |
| diablo_rojo | Ehhh I dont think so. | 18:11 |
| diablo_rojo | Its going to be a wait and see sort of thing | 18:11 |
| diablo_rojo | See who shows up that is | 18:11 |
| SotK | makes sense | 18:12 |
| SotK | hopefully it goes well :) | 18:12 |
| SotK | #topic In Progress Work | 18:12 |
| *** openstack changes topic to "In Progress Work (Meeting topic: storyboard)" | 18:12 | |
| SotK | to answer the question on the agenda, attachments are indeed still waiting for me | 18:12 |
| diablo_rojo | I guess we could send an email out to the discuss list annoucing we are doing onboarding there. | 18:12 |
| SotK | that's a good idea | 18:12 |
| diablo_rojo | I can do that in like a week or so. | 18:13 |
| diablo_rojo | SotK, is there anything we can do to help? | 18:13 |
| *** ociuhandu has quit IRC | 18:13 | |
| SotK | the main thing that needs doing is replacing swiftclient with openstack-sdk, but when I last tried openstack-sdk didn't work with the legacy swift auth used by the swift docker container I was using for testing | 18:15 |
| fungi | ahh, yeah, it probably wants keystone? | 18:16 |
| SotK | yeah I expect so | 18:16 |
| SotK | so its a matter of me hunting down some alternatives that allow me to set up keystone and swift for testing easily and reliably, ideally in docker with the rest of the things | 18:17 |
| diablo_rojo | Okay so kinda sounds like a one person job then? | 18:19 |
| SotK | indeed | 18:19 |
| fungi | there's likely already something like that available which zuul is using to test their swift integration | 18:19 |
| fungi | so may not require much hunting | 18:20 |
| SotK | sounds probable, I'll try to find time to look/ask about what they're doing soon and get things moving again | 18:20 |
| fungi | we can inquire in #zuul and probably get an answer, or i can go diving in the job configs | 18:20 |
| SotK | asking sounds easier, lets do it after this meeting I guess | 18:21 |
| fungi | wfm | 18:22 |
| SotK | we also still have slow queries | 18:23 |
| SotK | iirc the worst offender was the general story browsing query, which makes sense | 18:23 |
| SotK | I've not done any drilling down into the details of why though | 18:23 |
| diablo_rojo | If you want to try to point me somewhere to investigate I can try to info gather for you. | 18:24 |
| *** ociuhandu has joined #openstack-meeting | 18:26 | |
| fungi | if someone can give me the syntax for triggering that via the api, it'll probably speed up my ability to test the cache memory pressure theories too | 18:26 |
| SotK | I *think* the massive query was just the standard one generated by doing a GET on /api/v1/stories?limit=100 (with whatever extra filtering you fancy) | 18:28 |
| *** lbragsta_ has quit IRC | 18:29 | |
| SotK | my first port of call was going to be seeding my dev instance with enough data to replicate the slowness we see in production, and then experiment with changing https://opendev.org/opendev/storyboard/src/branch/master/storyboard/db/models.py#L450-L475 | 18:29 |
| *** armax has joined #openstack-meeting | 18:30 | |
| SotK | and/or adding some indexes to the relevant tables | 18:30 |
| SotK | (on task status for example) | 18:30 |
| fungi | cool, that helps | 18:30 |
| diablo_rojo | Noted. | 18:30 |
| fungi | running `time wget -qO/dev/null 'https://storyboard.openstack.org/api/v1/stories?limit=100'` gets me a baseline of "real 0m6.058s" at the moment | 18:31 |
| fungi | after the meeting i'll run a battery of those and take averages before and after restarts of apache, mysql and rabbit | 18:32 |
| *** zbr__ has quit IRC | 18:32 | |
| diablo_rojo | Sounds like a good plan to me. | 18:32 |
| SotK | nice, thanks | 18:32 |
| fungi | as well as record the timestamps so we can correlate to cacti graphs of memory utilization | 18:32 |
| fungi | (and i'll get some direct memory utilization numbers from the server before and after each as well) | 18:32 |
| *** zbr has joined #openstack-meeting | 18:33 | |
| diablo_rojo | Do we want to throw all this research in a single etherpad? | 18:33 |
| diablo_rojo | I feel like it would be good to have it all + links to other slowquery logs in a single place. | 18:34 |
| fungi | #link https://etherpad.openstack.org/storyboard-query-performance-analysis | 18:34 |
| fungi | i'll start doing it there | 18:34 |
| diablo_rojo | Beautiful. | 18:34 |
| SotK | excellent | 18:34 |
| diablo_rojo | Thanks fungi! | 18:35 |
| SotK | the agenda also mentions the multiple task race condition issue | 18:36 |
| SotK | iirc we fixed that but caused a new bug with the fix | 18:36 |
| SotK | new/similar | 18:36 |
| SotK | I think we'd come up with a solution but will need to dig in IRC logs to remember properly I expect | 18:36 |
| diablo_rojo | Oh okay I forgot the solution. | 18:37 |
| diablo_rojo | If we have one I can try to implement it. | 18:37 |
| fungi | yeah, i think the beer got to those memory cells for me | 18:38 |
| diablo_rojo | I would blame it on the 'too many things at once' state I live in | 18:38 |
| fungi | would similarly need to go hunting for discussion or at least the commit we thought was fixing it | 18:38 |
| fungi | was the fix one which came from an intern or prospective intern? i want to say it was | 18:38 |
| diablo_rojo | Oh maybe | 18:39 |
| diablo_rojo | I feel like I should do a pass over all the open patches from outreachy folks | 18:40 |
| diablo_rojo | reviews + updates | 18:40 |
| SotK | yeah, we just added an oslo_db decorator that handles retrying on deadlock | 18:40 |
| diablo_rojo | Oh thats easy. | 18:40 |
| SotK | but it moved the issue to somewhere else | 18:40 |
| diablo_rojo | Oh | 18:40 |
| fungi | i think it had to do with it all happening within a transaction? | 18:41 |
| SotK | yeah, something along those lines | 18:41 |
| *** armstrong has quit IRC | 18:41 | |
| fungi | so retrying didn't help because it was all in the context of the same transaction | 18:41 |
| diablo_rojo | Ah | 18:42 |
| diablo_rojo | That makes sense | 18:42 |
| fungi | but also, retrying in the face of contention is a hack | 18:43 |
| diablo_rojo | Yeah would be better to know what exactly is causing it. | 18:43 |
| *** gagehugo has left #openstack-meeting | 18:43 | |
| fungi | and i believe if that *had* actually "worked" it would have just shifted the limit on number of simultaneous tasks you can create to the number of retries you perform | 18:43 |
| SotK | indeed | 18:44 |
| fungi | so if you try 3 times then you'll break on simultaneous creation of 4 tasks | 18:45 |
| fungi | not really a solution | 18:45 |
| timburke | SotK, just catching up, but fwiw, swiftclient offers a v1password plugin for keystoneauth; i know i've had some success using it with openstackclient... might need https://review.opendev.org/#/c/687774/ though. but if the goal is to get rid of swiftclient *entirely*... i might not be in a position to help much ;-) | 18:46 |
| *** lpetrut has quit IRC | 18:46 | |
| fungi | i think the goal was to simplify testing/local dev implementation | 18:46 |
| fungi | but the result is going to need to work with clouds which provide keystone authentication, so we're probably better off doing a keystone+swift for that testing anyway | 18:47 |
| timburke | 👍 | 18:47 |
| *** jawad_axd has quit IRC | 18:50 | |
| SotK | indeed, keystone + swift makes sense really | 18:51 |
| SotK | we also wanted to discuss the js draft build issue | 18:51 |
| diablo_rojo | (8 min left) | 18:52 |
| fungi | yeah, i can cover that real quick | 18:52 |
| diablo_rojo | Yes please | 18:52 |
| fungi | since opendev moved from hosting build artifacts/logs on a static logs.openstack.org server to publishing them to (swift) object storage, we can no longer easily predict what hostnames those are going to be served from | 18:52 |
| *** ociuhandu has quit IRC | 18:52 | |
| fungi | the storyboard api is currently designed to require you to whitelist the domain names of such deployments both for cors middleware and for openid auth | 18:53 |
| fungi | because those domains are unpredictable, and because the storyboard-dev deployment they point to is not supposed to be used for sensitive information, i would like to basically turn off the cors and openid whitelisting for it | 18:54 |
| fungi | the easiest practical means of doing that is to allow the config fields for those to accept a wildcard indicator | 18:54 |
| fungi | as a naive first implementation i'd like to just make them consider '*' to mean any hostname should be considered valid | 18:55 |
| SotK | that seems like a good enough solution to me | 18:55 |
| fungi | it seems there was no disagreement in #storyboard when i suggested that, i just need to write the implementation. i've found what i believe are the affected codepaths | 18:56 |
| fungi | so it shouldn't take long | 18:56 |
| fungi | but would be nice to prioritize reviews of that once i get it proposed | 18:56 |
| fungi | as i gather it's blocking us from having confidence in our reviews of webclient changes | 18:57 |
| fungi | (also i think the change will be pretty simple) | 18:57 |
| fungi | anyway, that's all i've got on that topic | 18:57 |
| SotK | thanks fungi | 18:57 |
| SotK | I'll prioritize reviewing them when they're ready | 18:57 |
| fungi | appreciated. i'll try to get to that tomorrow | 18:58 |
| diablo_rojo | I am happy to review once I see the patches go up | 18:58 |
| diablo_rojo | SotK, after the meeting (while pinging the Zuul channel) would you mind reviewing that last show email patch I have out so that we can merge it? | 18:58 |
| diablo_rojo | (assuming its okay) | 18:58 |
| SotK | diablo_rojo: yeah sure | 18:59 |
| SotK | and we're pretty much out of time, thanks for coming folks | 18:59 |
| diablo_rojo | https://review.opendev.org/#/c/589713/ | 18:59 |
| fungi | yeah, attempting to review that is what reminded me of the draft breakage | 18:59 |
| diablo_rojo | SotK, ^^ | 18:59 |
| * SotK opens | 19:00 | |
| SotK | #endmeeting | 19:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:00 | |
| openstack | Meeting ended Thu Oct 17 19:00:16 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:00 |
| diablo_rojo | fungi, ahhhh yeah that makes sense | 19:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-10-17-18.02.html | 19:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-10-17-18.02.txt | 19:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-10-17-18.02.log.html | 19:00 |
| diablo_rojo | Thanks SotK! | 19:00 |
| fungi | thanks SotK! | 19:00 |
| *** tesseract has quit IRC | 19:07 | |
| *** rbudden has quit IRC | 19:12 | |
| *** lbragsta_ has joined #openstack-meeting | 19:17 | |
| *** lbragsta_ has quit IRC | 19:17 | |
| *** e0ne has joined #openstack-meeting | 19:25 | |
| *** e0ne has quit IRC | 19:34 | |
| *** ralonsoh has quit IRC | 19:47 | |
| *** pcaruana has quit IRC | 19:49 | |
| *** e0ne has joined #openstack-meeting | 19:52 | |
| *** e0ne has quit IRC | 19:53 | |
| *** bnemec has quit IRC | 20:03 | |
| *** bnemec has joined #openstack-meeting | 20:05 | |
| *** ricolin_ has joined #openstack-meeting | 20:06 | |
| *** ricolin has quit IRC | 20:09 | |
| *** efried is now known as efried_afk | 20:19 | |
| *** igordc has quit IRC | 20:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:32 | |
| *** mattw4 has quit IRC | 20:48 | |
| *** mattw4 has joined #openstack-meeting | 20:48 | |
| *** mriedem has quit IRC | 20:49 | |
| *** eharney has quit IRC | 20:49 | |
| *** e0ne has joined #openstack-meeting | 20:57 | |
| *** igordc has joined #openstack-meeting | 20:58 | |
| *** trident has quit IRC | 20:58 | |
| *** jamesmcarthur has quit IRC | 20:59 | |
| *** raildo has quit IRC | 21:01 | |
| *** igordc has quit IRC | 21:03 | |
| *** trident has joined #openstack-meeting | 21:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:08 | |
| *** panda has quit IRC | 21:08 | |
| *** igordc has joined #openstack-meeting | 21:09 | |
| *** lpetrut has joined #openstack-meeting | 21:11 | |
| *** panda has joined #openstack-meeting | 21:11 | |
| *** e0ne has quit IRC | 21:11 | |
| *** lbragstad has quit IRC | 21:14 | |
| *** rfolco|ruck has quit IRC | 21:17 | |
| *** lpetrut has quit IRC | 21:17 | |
| *** jamesmcarthur has quit IRC | 21:20 | |
| *** gyee has quit IRC | 21:20 | |
| *** ykatabam has joined #openstack-meeting | 21:22 | |
| *** lbragstad has joined #openstack-meeting | 21:24 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:28 | |
| *** jamesmcarthur has quit IRC | 21:36 | |
| *** rcernin has joined #openstack-meeting | 21:39 | |
| *** markvoelker has quit IRC | 21:39 | |
| *** rcernin has quit IRC | 21:53 | |
| *** slaweq has quit IRC | 21:56 | |
| *** rcernin has joined #openstack-meeting | 22:09 | |
| *** ricolin_ has quit IRC | 22:10 | |
| *** slaweq has joined #openstack-meeting | 22:12 | |
| *** mmethot_ has quit IRC | 22:13 | |
| *** slaweq has quit IRC | 22:16 | |
| *** armax has quit IRC | 22:17 | |
| *** rcernin has quit IRC | 22:27 | |
| *** rcernin has joined #openstack-meeting | 22:27 | |
| *** radeks has joined #openstack-meeting | 22:44 | |
| *** diablo_rojo has quit IRC | 22:44 | |
| *** diablo_rojo has joined #openstack-meeting | 22:49 | |
| *** jbadiapa has quit IRC | 22:50 | |
| *** kopecmartin is now known as kopecmartin|off | 22:56 | |
| *** radeks has quit IRC | 22:57 | |
| *** mattw4 has quit IRC | 22:58 | |
| *** mattw4 has joined #openstack-meeting | 22:59 | |
| *** jbadiapa has joined #openstack-meeting | 23:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:06 | |
| *** jbadiapa has quit IRC | 23:09 | |
| *** jbadiapa has joined #openstack-meeting | 23:16 | |
| *** jamesmcarthur has quit IRC | 23:29 | |
| *** Lucas_Gray has joined #openstack-meeting | 23:31 | |
| *** Lucas_Gray has quit IRC | 23:35 | |
| *** markvoelker has joined #openstack-meeting | 23:40 | |
| *** mattw4 has quit IRC | 23:41 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:42 | |
| *** Lucas_Gray has joined #openstack-meeting | 23:44 | |
| *** markvoelker has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!