Wednesday, 2017-03-15

*** woodard_ has quit IRC00:01
*** woodard has joined #openstack-meeting-400:01
*** revon has quit IRC00:03
*** marst has joined #openstack-meeting-400:04
*** uck has joined #openstack-meeting-400:07
*** uck_ has quit IRC00:07
*** yfauser has joined #openstack-meeting-400:08
*** armax has quit IRC00:10
*** yfauser has quit IRC00:12
*** Sukhdev has quit IRC00:12
*** uck has quit IRC00:22
*** reedip has joined #openstack-meeting-400:26
*** Syed__ has quit IRC00:35
*** bobh has quit IRC00:36
*** woodard has quit IRC00:37
*** erikmwilson has quit IRC00:37
*** woodard has joined #openstack-meeting-400:37
*** bobh has joined #openstack-meeting-400:38
*** erikmwilson has joined #openstack-meeting-400:39
*** woodard has quit IRC00:42
*** limao has joined #openstack-meeting-400:44
*** cjloader has joined #openstack-meeting-400:46
*** armax has joined #openstack-meeting-400:51
*** Julien-zte has joined #openstack-meeting-400:52
*** amotoki has joined #openstack-meeting-400:53
*** zhurong has joined #openstack-meeting-400:53
*** cjloader has quit IRC00:55
*** bobh has quit IRC00:55
*** erikmwilson has quit IRC01:07
*** erikmwilson has joined #openstack-meeting-401:08
*** yfauser has joined #openstack-meeting-401:09
*** yfauser has quit IRC01:14
*** unicell has quit IRC01:20
*** britthouser has joined #openstack-meeting-401:24
*** britthouser6 has quit IRC01:24
*** reedip has quit IRC01:25
*** yfauser has joined #openstack-meeting-401:31
*** yfauser has quit IRC01:36
*** cathrich_ has joined #openstack-meeting-401:43
*** s3wong has quit IRC01:56
*** lei-zh has joined #openstack-meeting-401:59
*** iyamahat has quit IRC02:00
*** lei-zh has quit IRC02:03
*** amotoki has quit IRC02:05
*** amotoki has joined #openstack-meeting-402:05
*** erikmwilson has quit IRC02:07
*** yamahata has quit IRC02:08
*** erikmwilson has joined #openstack-meeting-402:09
*** FrankZhang has joined #openstack-meeting-402:13
*** gongysh has joined #openstack-meeting-402:14
*** FrankZhang_ has joined #openstack-meeting-402:17
*** FrankZhang has quit IRC02:17
*** erikmwilson has quit IRC02:37
*** erikmwilson has joined #openstack-meeting-402:37
*** wxy_ has joined #openstack-meeting-402:44
*** hongbin has joined #openstack-meeting-402:56
*** FrankZhang_ has quit IRC03:01
*** markvoelker has quit IRC03:06
*** reedip has joined #openstack-meeting-403:06
*** erikmwil_ has joined #openstack-meeting-403:09
*** erikmwilson has quit IRC03:09
*** FrankZhang has joined #openstack-meeting-403:13
*** erikmwil_ has quit IRC03:17
*** FrankZhang has quit IRC03:18
*** pcarver has quit IRC03:19
*** unicell has joined #openstack-meeting-403:26
*** bobh has joined #openstack-meeting-403:26
*** Jeffrey4l has quit IRC03:28
*** amotoki has quit IRC03:32
*** pcarver has joined #openstack-meeting-403:32
*** yfauser has joined #openstack-meeting-403:33
*** tovin07_ has joined #openstack-meeting-403:33
*** yfauser has quit IRC03:38
*** bobh has quit IRC03:39
*** Jeffrey4l has joined #openstack-meeting-403:41
*** hongbin has quit IRC03:42
*** bobh has joined #openstack-meeting-403:49
*** amotoki has joined #openstack-meeting-403:49
*** amotoki has quit IRC03:50
*** woodard has joined #openstack-meeting-403:50
*** amotoki has joined #openstack-meeting-403:52
*** amotoki has quit IRC03:54
*** woodard has quit IRC03:55
*** links has joined #openstack-meeting-403:56
*** bobh has quit IRC03:57
*** Julien-zte has quit IRC04:03
*** bobh has joined #openstack-meeting-404:04
*** Julien-zte has joined #openstack-meeting-404:04
*** Julien-zte has quit IRC04:04
*** Julien-zte has joined #openstack-meeting-404:05
*** Julien-zte has joined #openstack-meeting-404:05
*** Julien-zte has quit IRC04:06
*** Julien-zte has joined #openstack-meeting-404:06
*** Julien-zte has quit IRC04:06
*** markvoelker has joined #openstack-meeting-404:07
*** Julien-zte has joined #openstack-meeting-404:07
*** rfolco has quit IRC04:10
*** bobh has quit IRC04:11
*** markvoelker has quit IRC04:13
*** psachin has joined #openstack-meeting-404:19
*** amotoki has joined #openstack-meeting-404:22
*** vks1 has joined #openstack-meeting-404:25
*** adisky_ has joined #openstack-meeting-404:26
*** gongysh has quit IRC04:39
*** amotoki has quit IRC04:39
*** qwebirc76200 has joined #openstack-meeting-404:44
*** premsankar has joined #openstack-meeting-404:45
*** anilvenkata has joined #openstack-meeting-404:47
*** yfauser has joined #openstack-meeting-404:52
*** yfauser has quit IRC04:57
*** psachin has quit IRC05:00
*** zhurong has quit IRC05:00
*** david-lyle has quit IRC05:04
*** psachin has joined #openstack-meeting-405:17
*** gongysh has joined #openstack-meeting-405:17
*** amotoki has joined #openstack-meeting-405:30
*** Julien-zte has joined #openstack-meeting-405:37
*** Julien-zte has quit IRC05:48
*** Julien-zte has joined #openstack-meeting-405:49
*** psachin has quit IRC05:49
*** Julien-zte has quit IRC05:51
*** Julien-zte has joined #openstack-meeting-405:52
*** psachin has joined #openstack-meeting-405:57
*** yamahata has joined #openstack-meeting-405:59
*** amotoki has quit IRC06:00
*** Julien-zte has quit IRC06:07
*** Julien-zte has joined #openstack-meeting-406:07
*** markvoelker has joined #openstack-meeting-406:09
*** yfauser has joined #openstack-meeting-406:10
*** amotoki has joined #openstack-meeting-406:11
*** markvoelker has quit IRC06:13
*** yfauser has quit IRC06:15
*** Julien-zte has quit IRC06:19
*** armax has quit IRC06:20
*** yfauser has joined #openstack-meeting-406:24
*** unicell1 has joined #openstack-meeting-406:29
*** unicell has quit IRC06:30
*** nkrinner_afk is now known as nkrinner06:36
*** yfauser_ has joined #openstack-meeting-406:36
*** yfauser has quit IRC06:38
*** SerenaFeng has joined #openstack-meeting-406:47
*** SerenaFeng has quit IRC06:48
*** SerenaFeng has joined #openstack-meeting-406:48
*** janki has joined #openstack-meeting-406:49
*** Julien-zte has joined #openstack-meeting-406:49
*** zhurong has joined #openstack-meeting-406:57
*** karthiks_afk is now known as karthiks07:01
*** unicell1 has quit IRC07:21
*** alexchadin has joined #openstack-meeting-407:26
*** gongysh has quit IRC07:34
*** janki is now known as janki|lunch07:34
*** wxy_ has quit IRC07:36
*** qwebirc76200 has quit IRC07:36
*** wxy has joined #openstack-meeting-407:36
*** wxy_ has joined #openstack-meeting-407:38
*** premsankar has quit IRC07:40
*** iyamahat has joined #openstack-meeting-407:42
*** wxy_ has quit IRC07:44
*** wxy_ has joined #openstack-meeting-407:44
*** trinaths has joined #openstack-meeting-407:45
*** ltomasbo|away is now known as ltomasbo07:45
*** gongysh has joined #openstack-meeting-407:50
*** trinaths has quit IRC07:52
*** woodard has joined #openstack-meeting-407:54
*** matrohon has joined #openstack-meeting-407:55
*** woodard has quit IRC07:58
*** eyalb has joined #openstack-meeting-408:00
*** dwj has joined #openstack-meeting-408:01
*** ifat_afek has joined #openstack-meeting-408:01
*** matrohon has quit IRC08:02
ifat_afekHi, are you in the middle of an ironic meeting? we are supposed to have a Vitrage meeting now08:02
ifat_afekUTC+208:02
ifat_afek8:00 UTC+208:02
*** alexey_weyl has joined #openstack-meeting-408:03
*** yujunz has joined #openstack-meeting-408:03
ifat_afek#startmeeting vitrage08:04
openstackMeeting started Wed Mar 15 08:04:03 2017 UTC and is due to finish in 60 minutes.  The chair is ifat_afek. Information about MeetBot at http://wiki.debian.org/MeetBot.08:04
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:04
*** openstack changes topic to " (Meeting topic: vitrage)"08:04
openstackThe meeting name has been set to 'vitrage'08:04
ifat_afekHi :-)08:04
yujunzHi08:04
alexey_weylHi08:04
eyalb\o08:04
*** elisha_r has joined #openstack-meeting-408:05
elisha_rhi08:05
*** pcaruana has joined #openstack-meeting-408:05
ifat_afekToday’s agenda:08:06
ifat_afek•Pike Design Sessions08:06
ifat_afek•Status and Updates08:06
ifat_afek•Boston Summit08:06
ifat_afek•Open Discussion08:06
ifat_afek#topic Pike Design Sessions08:06
*** openstack changes topic to "Pike Design Sessions (Meeting topic: vitrage)"08:06
ifat_afekI think that the Pike Design Sessions were very successful. Thanks to everyone who contributed!08:06
ifat_afekThe etherpad with the discussions summary:08:06
ifat_afek#link https://etherpad.openstack.org/p/vitrage-pike-design-sessions08:06
ifat_afek\08:06
yujunzIs the pike roadmap published? I mean the slides shown on the close08:07
*** dwj_ has joined #openstack-meeting-408:07
*** joedborg has joined #openstack-meeting-408:07
*** dwj has quit IRC08:08
ifat_afekI wrote it all in the etherpad, but did not publish anywhere else. I guess it belongs in Vitrage wiki page. I’ll update it after the wiki08:08
yujunzGot it08:09
yujunzStarting on L18408:09
ifat_afekRight08:09
*** markvoelker has joined #openstack-meeting-408:10
ifat_afek#topic Status and Updates08:10
*** openstack changes topic to "Status and Updates (Meeting topic: vitrage)"08:10
ifat_afekMy updates: Working on Doctor stuff. I finished writing the manual installation instructions, and it was merged08:10
ifat_afekI’m almost done with the test script as well.08:10
ifat_afek#link https://gerrit.opnfv.org/gerrit/#/c/28593/08:11
ifat_afek#link https://gerrit.opnfv.org/gerrit/#/c/28845/08:11
ifat_afekNote that Andrea Wisnyei is working on the “real” Vitrage installation guide.08:11
ifat_afekThat’s it for my updates08:11
eyalbI will update08:11
eyalbI have been working several days now to fix the puppet-openstack-integration for vitrage08:12
eyalbthe smoke test failed08:12
eyalbI did some fixes in vitrage tempest tests and in the puppet moudle08:12
eyalbI am waiting for the changes to be merged to RDO ci system and then I will recheck08:13
eyalbhopefully it will work this time :-)08:13
eyalbthats it08:13
ifat_afekGood luck ;-)08:13
*** markvoelker has quit IRC08:14
elisha_rI'll update for Anna Reznikov08:15
elisha_rShe pushed a BP for the Vitrage support for SNMP traps. I believe the code was pushed a week or two ago08:15
yujunzSNMP traps as a notifier, right?08:16
*** iyamahat has quit IRC08:17
elisha_rFor those who don't know, this means that if you activate this feature, you can get SNMPv2 traps sent to locations that the user defines08:17
elisha_ryup, it's another notifier08:17
elisha_rtraps will be generated whenever a vitrage deduced alarm is generated08:18
elisha_rnot for other alarms08:18
elisha_rlike Zabbix, nagios etc08:18
elisha_ranyhow, this feature should now be fully functional. See the BP for details.08:19
ifat_afekLinks to Anna’s changes:08:19
elisha_rI'm done08:19
ifat_afek#link https://review.openstack.org/#/c/437397/08:19
ifat_afek#link https://review.openstack.org/#/c/445574/08:19
ifat_afekelisha_r: thanks08:19
ifat_afekAnyone else has updates?08:20
yujunzI will08:20
alexey_weylI am still working on the 'not' operator for the templates and the evaluator08:20
alexey_weylHopefully it ill be done till the end of the week.08:20
yujunzMade some progress on mitmstack. It now supports multiplying the result of `nova list`08:21
alexey_weylI really want to finish it because it takes too much time already08:21
alexey_weylDone08:22
ifat_afekalexey_weyl: Great, thanks08:22
yujunzOk, I'll continue08:22
ifat_afekyujunz: So you mean it can already return 10000 fake vms?08:22
yujunzIf you have n vm, mitmstack can return n*m vms for you08:22
ifat_afekCool08:22
*** SerenaFeng has quit IRC08:22
yujunz#link https://github.com/mitmstack/cheat-the-client08:23
*** usman_ has joined #openstack-meeting-408:23
*** efoley__ has joined #openstack-meeting-408:23
yujunz#undo08:23
yujunz#link https://github.com/mitmstack/cheat-the-client/blob/master/multiply.py08:23
yujunzCurrently the it fakes only the 'id'08:24
yujunzSo we get different 'id' on the faked list08:24
yujunzA question on vitrage08:24
*** SerenaFeng has joined #openstack-meeting-408:24
yujunzdoes it supports http_proxy for the openstack endpoints08:24
eyalbI am not aware of such a feature08:25
ifat_afekyujunz: What do you mean exactly?08:25
*** salmankhan has joined #openstack-meeting-408:26
yujunzWhen vitrage requests vm list from nova, go through http_proxy if env var is set08:26
yujunznova client supports it well08:26
yujunz#link https://github.com/mitmstack/cheat-the-client#nova-list-multiplier08:26
yujunzNote the difference between first `nova list` and second one08:27
eyalbwhat ever url you define for vitrage in the catalog it will be used08:27
eyalbI will check the link08:27
*** iyamahat has joined #openstack-meeting-408:27
yujunzThe same url, but go through http proxy08:27
*** zhurong has quit IRC08:28
yujunznova client will check the environment var http_proxy to determine how to make the request08:28
eyalbno we don't support it08:28
yujunzI see08:28
ifat_afekyujunz: Is it supported in other projects?08:28
yujunznova client supports it well08:28
ifat_afekExcept Nova? I mean, is it something common?08:28
yujunzI didn't test other08:29
ifat_afekBecause we were not aware of it08:29
yujunzBut I assume it is a common feature08:29
ifat_afekAnd what is the goal - do you want Vitrage to call Nova via the proxy? or do you want to call Vitrage via the proxy?08:29
yujunzThe former08:30
yujunzvitrage call nova via proxy08:30
ifat_afekI guess in order to make it consistent with the result that mitmstack gets?08:30
ifat_afekAnd to allow mitmstack to mess with the results08:30
*** salmankhan has quit IRC08:31
yujunzKind of, force vitrage to go through mitmstack to nova08:31
yujunzsetting http_proxy is easiest to deploy08:31
*** yamahata has quit IRC08:31
ifat_afekOk08:31
ifat_afekI think I understand08:31
*** d0ugal has joined #openstack-meeting-408:31
yujunzI'll check and submit a patch to support http_proxy in vitrage08:32
ifat_afekOk08:32
yujunzIt won't be too difficult since it should be supported by most client library08:32
yujunzThat's all from my side08:32
eyalbI think it is supported by the requests library which we use08:32
*** iyamahat has quit IRC08:33
eyalbso maybe it is supported08:33
eyalbit needs to be checked08:33
eyalb#link http://docs.python-requests.org/en/latest/user/advanced/#proxies08:33
yujunzCould be. Not sure about the default behavior.08:33
ifat_afekAny other updates?08:34
*** salmankhan has joined #openstack-meeting-408:34
*** amotoki has quit IRC08:35
usman_Ifat: is there any comment or suggestion for virtual switch extension in Vitrage?08:35
ifat_afekusman_: Hi, I’m sorry but I still don’t have answer. I think the suggestion makes sense, but would like to discuss it with someone else (who is not in the IRC channel now)08:36
*** limao has quit IRC08:36
ifat_afekBTW, you can send it also to the general mailing list with [vitrage] in the title, if you want to hear other opinions08:37
*** limao has joined #openstack-meeting-408:37
*** alexchadin has quit IRC08:37
ifat_afekAnd in any case I will reply to your mail soon08:37
usman_Ifat: okay thanks08:37
ifat_afekAny other issues to discuss before I move on to the next topic?08:38
ifat_afek#topic Boston Summit08:38
*** openstack changes topic to "Boston Summit (Meeting topic: vitrage)"08:38
ifat_afekThere will be six Vitrage sessions in the Boston Summit!08:38
alexey_weylwohoooooooooooo08:39
eyalb\0/08:39
ifat_afekHere they are:08:39
alexey_weylWay the go Vitrage!!!08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/17926/beyond-automation-taking-vitrage-into-the-realm-of-machine-learning08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/17737/collectd-and-vitrage-integration-an-eventful-presentation08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/17928/the-vitrage-story-from-nothing-to-the-big-tent08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/17922/advanced-use-cases-for-root-cause-analysis08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/18067/get-hands-on-with-vitrage-the-fault-management-service-for-root-cause-analysis-and-deduced-alarms08:39
*** salmankhan has quit IRC08:39
ifat_afek#link https://www.openstack.org/summit/boston-2017/summit-schedule/events/18595/project-update-vitrage08:39
ifat_afekIn addition, we can (and should) suggest ideas for the Forum sessions. As far as I understood, a forum session is similar to the fishbowl session we had in Barcelona – a high level discussion, either about cross-project topics, or about a project specific issues08:40
yujunzcool08:40
ifat_afek#link https://wiki.openstack.org/wiki/Forum08:40
ifat_afekI created an etherpad for gathering ideas. Please add yours:08:40
ifat_afek#link https://etherpad.openstack.org/p/vitrage-boston-forum-ideas08:40
ifat_afekI just created the etherpad, didn’t have time to think of ideas yet…08:40
ifat_afekSorry for not talking, I was writing in the etherpad…08:44
ifat_afekMoving on08:45
ifat_afek#topic Open Discussion08:45
*** openstack changes topic to "Open Discussion (Meeting topic: vitrage)"08:45
ifat_afekThere is one issue I would like to raise – our review policy.08:45
ifat_afekUsually we write our comments, and wait for the committer to fix them08:46
ifat_afekOn other OpenStack projects, people write -1/-2 when they have comments. This prevents other reviewers from mistakenly merging a change that is not ready yet08:46
ifat_afekI think we should start replying with -1/-2 as well. What do you think?08:46
eyalb+108:46
eyalbuse more -108:46
alexey_weylI agree08:46
alexey_weyl+108:46
eyalb-2 is rarely used08:47
alexey_weylunless it is a very small issue I believe we can use 0 as well08:47
alexey_weylIn my opinion08:47
ifat_afekOk. That’s it for me. Anyone wants to discuss anything else?08:49
*** matrohon has joined #openstack-meeting-408:50
ifat_afekGoodbye then!08:50
eyalbbye08:51
alexey_weylsee ya08:51
*** alexey_weyl has quit IRC08:51
usman_bye08:51
ifat_afek#endmeeting08:51
*** openstack changes topic to " (Meeting topic: ironic_neutron)"08:51
openstackMeeting ended Wed Mar 15 08:51:25 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)08:51
openstackMinutes:        http://eavesdrop.openstack.org/meetings/vitrage/2017/vitrage.2017-03-15-08.04.html08:51
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/vitrage/2017/vitrage.2017-03-15-08.04.txt08:51
openstackLog:            http://eavesdrop.openstack.org/meetings/vitrage/2017/vitrage.2017-03-15-08.04.log.html08:51
*** eyalb has left #openstack-meeting-408:51
*** alexchadin has joined #openstack-meeting-408:54
*** ralonsoh has joined #openstack-meeting-408:55
*** Julien-zte has quit IRC08:56
*** Julien-zte has joined #openstack-meeting-409:00
*** bogdando has joined #openstack-meeting-409:01
*** yujunz has quit IRC09:09
*** bogdando has quit IRC09:19
*** bogdando has joined #openstack-meeting-409:19
*** zhurong has joined #openstack-meeting-409:28
*** Julien-zte has quit IRC09:33
*** dwj_ has quit IRC09:33
*** alexchadin has quit IRC09:36
*** neiljerram has joined #openstack-meeting-409:37
*** zhurong has quit IRC09:38
*** zhurong has joined #openstack-meeting-409:43
*** elisha_r has quit IRC09:46
*** zhurong has quit IRC09:53
*** dmellado has quit IRC09:54
*** rwallner has quit IRC09:54
*** ltomasbo has quit IRC09:54
*** ltomasbo|away has joined #openstack-meeting-410:00
*** dmellado has joined #openstack-meeting-410:02
*** ifat_afek has left #openstack-meeting-410:02
*** pbourke has quit IRC10:04
*** pbourke has joined #openstack-meeting-410:04
*** salmankhan has joined #openstack-meeting-410:05
*** limao has quit IRC10:05
*** tovin07_ has quit IRC10:05
*** limao has joined #openstack-meeting-410:05
*** SerenaFeng has quit IRC10:07
*** salmankhan has quit IRC10:09
*** limao has quit IRC10:10
*** markvoelker has joined #openstack-meeting-410:10
*** ltomasbo|away is now known as ltomasbo10:12
*** markvoelker has quit IRC10:15
*** rfolco has joined #openstack-meeting-410:19
*** joedborg has quit IRC10:26
*** sdague has joined #openstack-meeting-410:27
*** joedborg has joined #openstack-meeting-410:30
*** janonymous has joined #openstack-meeting-410:42
*** SerenaFeng has joined #openstack-meeting-410:55
*** janki|lunch has quit IRC10:59
*** janki|lunch has joined #openstack-meeting-411:00
*** rwallner has joined #openstack-meeting-411:00
*** gongysh has quit IRC11:01
*** Julien-zte has joined #openstack-meeting-411:01
*** SerenaFeng has quit IRC11:10
*** amotoki has joined #openstack-meeting-411:14
*** jchhatbar has joined #openstack-meeting-411:20
*** jchhatbar is now known as janki11:20
*** amotoki has quit IRC11:21
*** janki|lunch has quit IRC11:22
*** psachin has quit IRC11:30
*** psachin has joined #openstack-meeting-411:30
*** ralonsoh has quit IRC11:32
*** rwallner has quit IRC11:36
*** amotoki has joined #openstack-meeting-411:38
*** amotoki has quit IRC11:48
*** bobh has joined #openstack-meeting-411:54
*** bobh has quit IRC11:54
*** bobh has joined #openstack-meeting-411:55
*** alexchadin has joined #openstack-meeting-411:57
*** rwallner has joined #openstack-meeting-412:03
*** SerenaFeng has joined #openstack-meeting-412:08
*** vks1 has quit IRC12:11
*** markvoelker has joined #openstack-meeting-412:11
*** gongysh has joined #openstack-meeting-412:12
*** markvoelker has quit IRC12:16
*** bobh has quit IRC12:17
*** bobh has joined #openstack-meeting-412:19
*** SerenaFeng has quit IRC12:19
*** rbak_ has quit IRC12:19
*** rbak_ has joined #openstack-meeting-412:20
*** bobh has quit IRC12:26
*** shintaro has joined #openstack-meeting-412:27
*** Julien-zte has quit IRC12:32
*** woodard has joined #openstack-meeting-412:33
*** woodard has quit IRC12:35
*** woodard has joined #openstack-meeting-412:35
*** baoli has joined #openstack-meeting-412:36
*** cathrich_ has quit IRC12:36
*** markvoelker has joined #openstack-meeting-412:38
*** baoli has quit IRC12:39
*** baoli has joined #openstack-meeting-412:40
*** Julien-zte has joined #openstack-meeting-412:41
*** janonymous has quit IRC12:44
*** baoli has quit IRC12:44
*** klamath has joined #openstack-meeting-412:45
*** klamath has quit IRC12:45
*** klamath has joined #openstack-meeting-412:46
*** usman_ has quit IRC12:51
*** reedip has quit IRC12:52
*** SerenaFeng has joined #openstack-meeting-412:53
*** SerenaFeng has quit IRC12:54
*** wxy_ has quit IRC12:54
*** ostroverkhov has joined #openstack-meeting-412:54
*** reedip has joined #openstack-meeting-412:54
*** efoley_ has joined #openstack-meeting-412:55
*** wxy_ has joined #openstack-meeting-412:56
*** SerenaFeng has joined #openstack-meeting-412:57
*** efoley__ has quit IRC12:58
*** mriedem has joined #openstack-meeting-412:58
alex_xu#startmeeting nova api13:00
openstackMeeting started Wed Mar 15 13:00:03 2017 UTC and is due to finish in 60 minutes.  The chair is alex_xu. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
*** openstack changes topic to " (Meeting topic: nova api)"13:00
openstackThe meeting name has been set to 'nova_api'13:00
alex_xuwho is here today?13:00
gmanno/13:00
*** ostroverkhov has left #openstack-meeting-413:00
sdagueo/13:00
*** dtardivel has joined #openstack-meeting-413:00
*** efoley__ has joined #openstack-meeting-413:01
alex_xuI guess johnthetubaguy still in lunch13:01
johnthetubaguyo/13:01
alex_xuok :)13:01
alex_xu#topic priorities13:01
*** openstack changes topic to "priorities (Meeting topic: nova api)"13:01
alex_xu#link https://etherpad.openstack.org/p/pike-nova-priorities-tracking13:01
alex_xubeside policy, just want to mention, this API spec looks like very close https://review.openstack.org/26528213:02
*** links has quit IRC13:02
*** efoley__ has quit IRC13:02
*** efoley__ has joined #openstack-meeting-413:03
sdaguealex_xu: cool, will need to revisit that one13:03
johnthetubaguyoops, i should hit that one13:03
alex_xusdague: yea, just for you and johnthetubaguy :)13:03
johnthetubaguythere was another, just trying to find it13:04
*** efoley_ has quit IRC13:04
alex_xufor the policy, maybe we should adverties the doc one in the nova weekly meeting, that is simple and can be merge quick13:04
*** efoley__ has quit IRC13:04
*** efoley_ has joined #openstack-meeting-413:04
johnthetubaguy#link https://review.openstack.org/#/c/440580/13:04
johnthetubaguyalex_xu: a good idea, been trying to bug folks directly too13:04
*** SerenaFeng has quit IRC13:04
gmannthis one also very close, #link https://review.openstack.org/#/c/415315/13:05
alex_xuah, yea, i forget to revisit that one13:05
gmannjohnthetubaguy: you had +2 then some trivial updates13:05
*** jed56 has joined #openstack-meeting-413:06
alex_xuso we want to have a limit dict for the response of hints?13:06
*** jed56 has quit IRC13:06
*** jed56 has joined #openstack-meeting-413:06
alex_xuI guess no, that isn't match the request13:06
*** SerenaFeng has joined #openstack-meeting-413:06
alex_xugmann: thanks13:07
alex_xugmann: i put it in the therpad13:07
johnthetubaguyalex_xu: what limit do you mean?13:07
johnthetubaguyI think we have a limit on the size of the tag, and limit on the number of tags anyways, so that should just carry over here13:08
alex_xujohnthetubaguy: the scheduler hints schema have 'addtionalProperties': True13:08
johnthetubaguyoh right13:08
alex_xuthat means user can put anything into the hints, and that store in the db, and can be get from the response13:08
johnthetubaguywe left that as an extension point, mostly until we have traits sorted I guess13:08
alex_xuanother open metadata api13:08
johnthetubaguyyeah, it kinda is open13:08
johnthetubaguydo we limit the number of scheduler hits you can set?13:09
alex_xugood news, the hints can't update13:09
* mriedem sneaks in late13:09
johnthetubaguyalex_xu: yeah13:09
*** pmesserli has joined #openstack-meeting-413:09
alex_xuI think no, just limit by the length of request body13:09
johnthetubaguyhmm, probably should fix that up13:10
johnthetubaguytags has a limit of 5013:10
alex_xuthen I will drop in the question whether we need microversion :) i hate that question13:10
johnthetubaguyI think we can pretend its a security fix, but I am willing to have that shot down13:11
*** reedip has quit IRC13:11
*** liangy has joined #openstack-meeting-413:11
mriedemwhat is the question/issue?13:11
*** cathrichardson has joined #openstack-meeting-413:11
johnthetubaguybigger question, do we want to fix up the scheduler hint limit before we allow the adding of the GET api?13:12
johnthetubaguymriedem: scheduler hit spec, link is above13:12
mriedemright, but summarize?13:12
johnthetubaguyyou can set an unlimited number of hints today13:13
mriedemthis is the one that's proposing to return scheduler hints from the original instance build request right?13:13
johnthetubaguythen we start returning them too13:13
johnthetubaguyyeah13:13
mriedemso the GET response could have a million hints in it13:13
*** erikmwilson has joined #openstack-meeting-413:13
alex_xumriedem: the hints in the request is open for any key-value, and then can get from the API response from that spec13:13
*** baoli has joined #openstack-meeting-413:13
mriedemwhat is the size on the key/value?13:14
sdaguejohnthetubaguy: is there a reason why it's in the server document instead of dedicated sub resource?13:14
mriedemsdague: they're following the flavors spec13:14
mriedemflavors in server response13:14
alex_xuno limit as i know13:14
sdagueI get the idea of why we'd roll flavor up here, because everyone has flavors13:14
sdaguebut scheduler hints seem really specific, and only some percentage of applications is going to be using them13:15
mriedemalex_xu: what table stores scheduler hints anyway? request_specs?13:15
*** reedip has joined #openstack-meeting-413:15
*** cathrichardson has left #openstack-meeting-413:15
*** cdent has joined #openstack-meeting-413:15
johnthetubaguywe kinda agreed to it at the PTG, on the basis of what goes in, should usually come out somehow13:15
mriedem"somehow" could be a subresource,13:15
mriedemis i think sean's point13:15
sdagueright13:15
*** shintaro has quit IRC13:15
mriedemand doesn't clutter up the main, already large, response13:15
johnthetubaguyoh, I missed what you meant there, that does make sense13:16
sdagueI think the important difference between flavor and scheduler hints13:16
sdague*everyone* has a flavor13:16
johnthetubaguysdague: yeah, that makes good sense13:16
sdague*only some instances* have hints set13:16
johnthetubaguyI don't think its needed in /servers/detail either13:16
sdagueright13:16
* johnthetubaguy wishes he didn't always forget about the sub resource as an option13:17
sdaguejohnthetubaguy: the use case for this is?13:17
alex_xumriedem: yea, i guess in request spec13:17
* alex_xu always forget those detail13:17
mriedemsdague: rebuilding an instance using the same hints as before13:17
johnthetubaguysdague: I think it was launching another VM that is similar13:17
mriedemwas what i remember from the ptg13:17
mriedem*not rebuilding, duplicating13:18
johnthetubaguyor working out what state your instance groups are in, I guess13:18
johnthetubaguywell, server groups13:18
mriedemhmm,13:19
mriedemthe request_spec is not scoped to an instance,13:19
mriedemoh wait yes it is13:19
sdaguewhere is this sitting the db models?13:19
mriedemso we get the request_spec by instance_uuid from the api db,13:19
mriedemdeserialize the blob,13:20
mriedempull out the scheduler hints, and return those in the response13:20
mriedemso yeah there is no key/value size limit on the hints in the db13:20
alex_xucan we query the member of server-group by /server-groups api?13:20
johnthetubaguymriedem: yeah, I think thats all correct13:20
mriedemwe have some known in-tree hints in the json schema validation,13:20
mriedembut additionalProperties=True13:21
mriedemso it's totally open ended13:21
gmannyea13:21
johnthetubaguy+113:21
mriedemi could build a server with a million-char key/value13:21
johnthetubaguy+1 for that being the current state, not +1 for keeping it like that13:21
mriedemright, i'm just getting caught up,13:21
mriedemseems we should limit the size of the key/value in the request schema,13:21
johnthetubaguymriedem: thats probably a security related bug, all bit not a major one13:21
mriedemand as for the total number of hints per request, we could use quota like we do for metadata13:21
johnthetubaguymriedem: +1 I was suggesting we follow tags with a static 50 limit13:22
alex_xu+1 for a hard-code number13:22
johnthetubaguymetadata I think is a quota based limit, which feels like overkill as a starting point13:22
mriedemi was thinking metadata, which is i think 25513:22
sdaguemriedem: well, if this is just a GET, what is the limit concern?13:22
johnthetubaguymriedem: Oh, you mean the string lenght?13:22
*** vks1 has joined #openstack-meeting-413:22
mriedemjohnthetubaguy: yeah13:22
mriedemdo we leave the string length on the key/values unbounded?13:23
johnthetubaguymriedem: I was thinking the number of strings, but both need fixing I gues13:23
sdaguemriedem: it already is right?13:23
johnthetubaguymriedem: I thought the DB limited that, but maybe I miss-remembered that13:23
*** limao has joined #openstack-meeting-413:23
mriedemthis is stored in the request_specs table in a json blob,13:23
sdagueso, I'm still trying to figure out where this is stored. Is this just jammed into user_data?13:23
mriedemin a Text field, so there is a limit in the db, but it's rather large13:24
johnthetubaguyoh right13:24
mriedemsdague: request_specs,13:24
mriedemnova_api db13:24
mriedemhttps://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api_models.py#L17113:24
alex_xuah13:24
sdagueoh, api_models.py13:24
mriedemthe RequestSpec object serializes/deserializes from the json blob13:24
*** psachin has quit IRC13:24
sdaguewhen are request specs deleted?13:24
mriedemi wouldn't be surprised if they aren't, but would need to check13:25
alex_xui guess there will be 500 when over the Text field limit13:25
mriedemalex_xu: yup13:26
mriedembauzas: are request_specs ever deleted?13:26
mriedemthey are in the api db so when we delete an instance we're in the wrong db to clean those up13:26
sdagueI think my biggest concern to exposing this is that it locks us into lifecycle management constraints on that13:27
sdaguebecause it's in a different table13:27
sdaguein the flavor case, it's all super easy, because it's in the same tabl13:27
mriedemwell, not really,13:28
mriedemflavors are in instance_extra13:28
mriedembut same db :)13:28
mriedemfrom what i can tell, we never delete request_specs records13:28
sdaguemriedem: ok, well in a table linked to the instance pretty strongly13:28
mriedemso i can fill up your api db with just bogus server build requests with a million hints13:28
sdaguemriedem: right, I'm sure we're going to have to solve that13:28
mriedemi suppose i should open a bug13:29
johnthetubaguyyeah, bug time for sure13:29
gmannbut if limiting to 50 is not too much ? does anyone use 50 hints all together ?13:29
johnthetubaguymriedem: quota does usually limit these attacks though13:30
johnthetubaguygmann: does it matter? its about the next instance that gets created really13:30
johnthetubaguyif we break that person, its a good fix13:30
sdaguehonestly, I'm less concerned on the limit here13:31
alex_xusdague: what is your main concern?13:31
mriedemjohnthetubaguy: we don't have quotas on hints do we?13:31
sdaguehonestly, I just wonder about exposing this13:32
johnthetubaguymriedem: I mean on build instance13:32
sdagueI do get that "it would be nice"13:32
alex_xusdague: if expose it just for server-group...then we have /server-groups API13:32
sdaguebut, I also think that anyone that's actively using scheduler hints, isn't doing them in an add hoc way13:32
sdaguethey are doing them with a system to coordinate them13:32
mriedemjohnthetubaguy: i'm saying, single server create request, with a scheduler hints dict with a million keys in it13:33
mriedemwe don't have quota limits on hints13:33
johnthetubaguymriedem: I couldn't find where the that DB entry is deleted either13:33
gmannwhy people want that use case implement new sch hint as "same_scheduler_hint" like same_host13:33
mriedemlike we do for metadata or injected files13:33
sdagueand so using nova as redundant key retreival for this seems... odd13:33
johnthetubaguymriedem: sorry, yep +1 that13:33
sdaguegmann: right, but if they launched that server from their program, they know what hints those were13:33
sdaguethe only real case is when Bob manually does an ``openstack server create .... hints``13:34
sdagueoutside of a programatic environment13:34
gmannhumm13:34
sdaguethen Jane wants to duplicate that13:34
sdaguewhich, seems like a nice thing to do, but doesn't seem urgent13:34
mriedemi don't want to make assumptions on the usefulness or use case for this,13:35
sdagueespecially if we want to spend brain power around quotas / policy13:35
gmannif nova implement that sch hint so that Jane can use that sch hint and nova internally does magic at very starting13:35
johnthetubaguysdague: thats basically what I was thinking too, nice to have, acceptable, but not urgent13:35
mriedemif we want to know if this is a silly idea, we should ask the ops list13:35
sdaguemriedem: well, it's a trade off. How many hours are we going to spend on this one.13:35
johnthetubaguywe have that feedback at the PTG already, saying it was useful for the folks in the room13:35
johnthetubaguynot sure it was urgent as such13:36
mriedemit seems relatively straight-forward if we agree on where it lives in the REST API (subresource or not),13:36
mriedemi think the quota limit and deleting request specs are separate issues that need to be dealt with anyway13:36
mriedemas bugs13:36
sdaguejohnthetubaguy: do we have ideas about who those folks were, and vs. policy or  other things13:36
mriedemi think it was a team working with gibi13:36
mriedemso probably related to ericsson and telcos13:37
johnthetubaguysdague: I thought it was chris f as well?13:37
mriedemso do we want to take a couple of actions and move on?13:37
mriedem1. ask the ops list about usefulness of this?13:37
mriedem2. report bugs for the limits/delete issue?13:37
mriedemand make the bugs a prerequisite for the api change?13:38
mriedemif we do the api chngae13:38
mriedem*change13:38
sdagueI want a more comprehensive use case13:38
sdagueI just left -1 feedback for that13:38
johnthetubaguyyup, agreement on 2 seemed important13:38
sdaguethe current use case is just "I want to get this out of nova"13:38
johnthetubaguysdague: better use case makes good sense13:38
sdagueThat's not a use case13:38
alex_xu+1 for #2 should be fixed13:38
johnthetubaguysdague: did you add about the sub resource thing as well?13:39
mriedem#action mriedem to open bugs for lack of limits on scheduler hints and a bug about how we never delete request_specs13:39
gmannyea, it really save to blowup the DB13:39
sdagueI did not, because I think that until there is a more detailed use case I'm -1 regardless13:39
edleafesdague: when migrating an instances, wouldn't the hints be necessary to ensure that it lands on a host that meets the original requirements?13:39
edleafes/instances/instance13:39
sdagueedleafe: I think that's a different issue13:40
johnthetubaguysdague: fair enough13:40
sdaguemigrating an instance should keep the hints, the user shouldn't have to respecify them13:40
mriedemedleafe: we already pull the hints when migrating13:40
gmannand limit on sch hint as version bump right or we can discuss on bug anyways13:40
mriedemfrom the request spec13:40
johnthetubaguyedleafe: that already all fixed I believe, ask bauzas for details13:40
mriedemsdague: that's how it already works i think, yeah13:40
edleafemriedem: ah, ok13:40
alex_xui guess we can move on, as we said, this isn't urgent one, otherwise, we will spend whole hour on that :)13:40
johnthetubaguy++13:40
edleafemriedem: I thought this was tied to that problem13:40
sdagueedleafe: it might be, and the proposers are a couple of releases back13:41
sdaguehence, please provide more detailed use case13:41
edleafesdague: got it13:41
alex_xujohnthetubaguy: anything more for policy? otherwise we done for the priorites13:42
johnthetubaguyother than be smiling at mriedem about the spec?13:42
mriedemi've got it in a tab :)13:42
mriedemhttps://review.openstack.org/#/c/433010 right?13:42
johnthetubaguymriedem: cool, I hope your screen looks better than mine, but I suspect not13:42
alex_xumriedem: it's worth to adverties on the nova weekly meeting for getting more feedback for the policy spec13:42
johnthetubaguymriedem: thats the one13:42
mriedemalex_xu: ok can you update the weekly nova meeting agenda and post highlights for the api subteam?13:43
mriedemwhen we have the weekly meeting, there is usually not many people around that were also at the api meeting, depending on time of day when we have the nova meeting13:43
alex_xumriedem: yea, I will update the agenda, but i can't attend the meeting this week, it is in the super early time for me13:43
mriedemi'm only attending this one because i'm working from home now :)13:43
johnthetubaguyalex_xu: I think the follow on specs need your feedback13:43
alex_xujohnthetubaguy: got it13:44
mriedemalex_xu: right - just need the agenda update with highlights, i'll repeat them13:44
johnthetubaguymriedem: welcome to the club, btw13:44
alex_xumriedem: thanks13:44
mriedemjohnthetubaguy: i can feel my health deteriorating already :)13:44
johnthetubaguymriedem: :)13:44
* cdent expects mriedem's usually stellar hygiene to begin a slow gentle decay13:44
mriedemleg atrophy and whatnot13:44
cdentsigh, yet more crypto-jinxing13:44
alex_xuwe talk about extension removing, so I did some experiment on removing the stevedore https://review.openstack.org/44586413:45
alex_xu#link https://review.openstack.org/44586413:45
alex_xuanother single one13:45
alex_xu#link https://review.openstack.org/44536113:45
johnthetubaguyalex_xu: any way to avoid api-paste.ini changes?13:45
johnthetubaguyalex_xu: I should read your change better!13:46
sdaguejohnthetubaguy: it should be easy to do by just changing the class inline13:46
johnthetubaguyyeah, he fixed it already, I was just being dumb13:46
alex_xujohnthetubaguy: i guess so, i just get circle import problem, but i want to make it works before the meeting, so i just hack the code quickly13:47
johnthetubaguyah, thats no fun13:47
*** cjloader has joined #openstack-meeting-413:47
alex_xuit copies the placement api pattern to list the routes explicitly https://review.openstack.org/#/c/445864/2/nova/api/openstack/compute/router.py@11013:47
sdagueright, the explicit routes is very nice13:48
mriedemwhen i saw that i was thinking router as in neutron router13:48
sdagueit makes it so much easier to understand what is going on13:48
*** kylek3h has quit IRC13:49
gmann+113:49
johnthetubaguyalex_xu: looking good, +1 all what they just said13:49
sdaguethere is still a lot to unwind to really clean this up, but I think this a very good push13:49
alex_xuand before that, we should think about removing the extension point in the server controller https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L15513:50
alex_xuprobably similar way as what i do in the patch13:50
johnthetubaguyyeah, those ones would be good to kill13:50
alex_xuis it something we want to do in Pike?13:51
sdaguealex_xu: ++13:51
gmannalex_xu: that will go away by merging the extension class in server.py's create() right13:51
sdaguealex_xu: I think this would be a great debt reduction13:51
johnthetubaguyas long as policy is still higher in priority, it beats and API features I have seen so far13:51
johnthetubaguyso +1 for pike13:51
johnthetubaguyclosely followed by work on the API concept guide I guess13:52
alex_xugmann: not sure, based on if merge didn't generate too much works13:52
*** FrankZhang has joined #openstack-meeting-413:52
alex_xuok, i can do more futher work, and try to get more detail out, and I need a spec before freeze13:53
johnthetubaguymaybe specless bp is fine for this13:53
gmannspec ?13:53
sdaguealex_xu: one thing to make sure to keep an eye on is that this doesn't break project_id in the url by changing up the router13:53
johnthetubaguybest to evolve the idea in gerrit I guess13:53
*** markvoelker_ has joined #openstack-meeting-413:54
alex_xusdague: yea, i just break the project_id in the afternoon :)13:54
gmann+1 for specless bp13:54
alex_xuok, i will work more poc code, until people feel it is good, then request the bp approve13:54
alex_xu#topic open13:55
*** openstack changes topic to "open (Meeting topic: nova api)"13:55
alex_xuso 5 mins left...13:55
*** markvoelker has quit IRC13:55
alex_xuplease bring up anything for the last 5 mins13:55
johnthetubaguylots of talk about the forum, are there any API things we want to raise at the forum?13:55
johnthetubaguy#link https://etherpad.openstack.org/p/BOS-Nova-brainstorming13:56
sdagueso, fyi, I started writing up the microversion architecture document, which is taking the old blog post and readapting it for more permanent archival https://review.openstack.org/#/c/444892/13:56
johnthetubaguy#link https://wiki.openstack.org/wiki/Forum/Boston201713:56
*** SerenaFeng has quit IRC13:56
sdagueincluding input from things heard at the PTG which are common questions that I think we have answers with13:56
sdagueanswers for13:56
alex_xuare most of developers going to the summit?13:57
johnthetubaguyalex_xu: my gut tells me no13:57
mriedemi doubt it,13:57
*** bobmel has quit IRC13:57
mriedemi actually wanted to start getting a list of who is going, or trying to get approval to go13:57
mriedem#action mriedem to start an etherpad to get an idea of who is going to the summit/forum13:58
johnthetubaguyI am trying to be there, but not yet confirmed13:58
alex_xuok, i also didn't hear anything about summit travel strategy from my manager also13:58
johnthetubaguyI was thinking what do we want feedback on from operators and users13:58
mriedemjohnthetubaguy: there is a thread about something like that in the ops ML,13:58
johnthetubaguythe ironic raise min version discussion is the only thing that came to mind really13:58
mriedemand basically there wasn't a lot of feedback, or requests for sessions,13:58
mriedemso the forum organizers are a bit surprised and nervous from what i gather,13:59
johnthetubaguyyeah, there is a dev thread on that too, I think13:59
mriedemand a lot of operators won't be there because the summit is so close after the ops meetup13:59
mriedemso i suspect a fair amount of thumb twiddling13:59
alex_xu...13:59
alex_xuit is the time close the meeting13:59
mriedemone last thing,14:00
alex_xu#endmeeting14:00
*** openstack changes topic to " (Meeting topic: ironic_neutron)"14:00
openstackMeeting ended Wed Mar 15 14:00:05 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:00
alex_xuthanks all14:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/nova_api/2017/nova_api.2017-03-15-13.00.html14:00
mriedemhttps://review.openstack.org/#/c/391060/ is for deleting the request spec14:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/nova_api/2017/nova_api.2017-03-15-13.00.txt14:00
openstackLog:            http://eavesdrop.openstack.org/meetings/nova_api/2017/nova_api.2017-03-15-13.00.log.html14:00
gmannthanks14:00
alex_xumriedem: let us back to nova channel :)14:00
*** cdent has left #openstack-meeting-414:00
johnthetubaguymriedem: I forgot about that bit too14:00
*** SerenaFeng has joined #openstack-meeting-414:01
alex_xui remember there is another meeting after us before14:01
*** zhurong_ has joined #openstack-meeting-414:03
*** mriedem has left #openstack-meeting-414:03
*** alexchadin has quit IRC14:05
*** cathrichardson has joined #openstack-meeting-414:05
*** links has joined #openstack-meeting-414:05
*** zhurong_ has quit IRC14:06
*** baoli has quit IRC14:07
*** reedip has quit IRC14:09
*** baoli has joined #openstack-meeting-414:10
*** cjloader has quit IRC14:12
*** chigang has joined #openstack-meeting-414:13
*** irenab_ has joined #openstack-meeting-414:15
*** erikmwilson has quit IRC14:15
*** erikmwilson has joined #openstack-meeting-414:15
*** kylek3h has joined #openstack-meeting-414:17
*** reedip has joined #openstack-meeting-414:18
*** hrw has joined #openstack-meeting-414:24
*** reedip has quit IRC14:24
*** reedip has joined #openstack-meeting-414:26
*** woodard has quit IRC14:29
*** amotoki has joined #openstack-meeting-414:29
*** woodard has joined #openstack-meeting-414:31
*** Julien-zte has quit IRC14:35
*** efoley__ has joined #openstack-meeting-414:35
*** marst has quit IRC14:36
*** karthiks is now known as karthiks_afk14:36
*** galstrom_zzz is now known as galstrom14:36
*** mnasiadka has joined #openstack-meeting-414:37
*** Julien-zte has joined #openstack-meeting-414:37
*** Julien-zte has quit IRC14:38
*** iyamahat has joined #openstack-meeting-414:38
*** dave-mccowan has joined #openstack-meeting-414:38
*** efoley_ has quit IRC14:39
*** dasanind has quit IRC14:40
*** dasanind has joined #openstack-meeting-414:41
*** d0ugal has quit IRC14:42
*** links has quit IRC14:42
*** erikmwilson has quit IRC14:42
*** marst has joined #openstack-meeting-414:42
*** d0ugal has joined #openstack-meeting-414:43
*** hongbin has joined #openstack-meeting-414:43
*** erikmwilson has joined #openstack-meeting-414:44
*** irenab_ has quit IRC14:50
*** skraynev has joined #openstack-meeting-414:50
*** Sukhdev has joined #openstack-meeting-414:51
*** gongysh has quit IRC14:51
*** cjloader has joined #openstack-meeting-414:52
*** cjloader has quit IRC14:52
*** cjloader has joined #openstack-meeting-414:53
*** bobmel has joined #openstack-meeting-414:54
*** cathrichardson has quit IRC14:54
*** Sukhdev_ has joined #openstack-meeting-414:55
*** tonytan4ever has joined #openstack-meeting-414:55
*** yamahata has joined #openstack-meeting-414:55
*** sayantan_ has joined #openstack-meeting-414:56
*** premsankar has joined #openstack-meeting-414:58
*** cathrichardson has joined #openstack-meeting-414:59
*** bobmel has quit IRC14:59
*** bobmel has joined #openstack-meeting-415:00
*** jascott1 has joined #openstack-meeting-415:01
*** caboucha has joined #openstack-meeting-415:04
*** mbruzek has joined #openstack-meeting-415:04
*** janki has quit IRC15:05
*** kjackal has joined #openstack-meeting-415:05
*** bobh has joined #openstack-meeting-415:06
*** marcoceppi has joined #openstack-meeting-415:06
*** Syed__ has joined #openstack-meeting-415:08
*** zhubingbing has joined #openstack-meeting-415:09
*** limao has quit IRC15:10
*** Sukhdev_ has quit IRC15:10
*** limao has joined #openstack-meeting-415:11
*** Sukhdev_ has joined #openstack-meeting-415:11
*** erikmwilson has quit IRC15:12
*** zhubingbing has quit IRC15:14
*** erikmwilson has joined #openstack-meeting-415:14
*** zhubingbing has joined #openstack-meeting-415:14
*** Sukhdev_ has quit IRC15:15
*** vks1 has quit IRC15:29
*** sayantan_ has quit IRC15:32
*** amotoki has quit IRC15:33
*** armax has joined #openstack-meeting-415:37
*** unicell has joined #openstack-meeting-415:37
*** Jeffrey4l has quit IRC15:38
*** berendt has joined #openstack-meeting-415:38
*** SerenaFeng has quit IRC15:39
*** Jeffrey4l has joined #openstack-meeting-415:39
*** limao has quit IRC15:42
*** persia has quit IRC15:42
*** limao has joined #openstack-meeting-415:42
*** persia has joined #openstack-meeting-415:45
*** irenab has quit IRC15:48
*** zhubingbing has quit IRC15:49
*** mnaser has joined #openstack-meeting-415:50
*** reedip has quit IRC15:50
*** wxy| has joined #openstack-meeting-415:50
*** nkrinner is now known as nkrinner_afk15:53
*** duonghq has joined #openstack-meeting-415:54
*** limao has quit IRC15:56
*** david-lyle has joined #openstack-meeting-415:56
*** irenab has joined #openstack-meeting-415:57
*** mnasiadka has quit IRC15:57
*** Sukhdev_ has joined #openstack-meeting-415:58
inc0#startmeeting kolla15:59
openstackMeeting started Wed Mar 15 15:59:23 2017 UTC and is due to finish in 60 minutes.  The chair is inc0. Information about MeetBot at http://wiki.debian.org/MeetBot.15:59
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:59
*** openstack changes topic to " (Meeting topic: kolla)"15:59
openstackThe meeting name has been set to 'kolla'15:59
*** egonzalez has joined #openstack-meeting-415:59
inc0#topic rollcall, w00t15:59
duonghqo/15:59
inc0you know what to do15:59
*** openstack changes topic to "rollcall, w00t (Meeting topic: kolla)"15:59
mnasero/ bonjour15:59
hrwo/15:59
pbourkeWOOT15:59
duonghqoops15:59
akwasnieo/16:00
berendto/16:00
Jeffrey4lwoot16:00
egonzalezwoot o/16:00
spsurya_o/16:00
*** zhubingbing_ has joined #openstack-meeting-416:00
*** sayantan_ has joined #openstack-meeting-416:01
jascott1o/16:01
sayantan_woot16:01
*** vhosakot has joined #openstack-meeting-416:01
zhubingbing_woot16:01
spsurya_woot16:01
zhubingbing_o/16:01
vhosakoto/ w00t w00t16:01
qwangO/16:02
*** vsaienk0 has quit IRC16:02
inc0#topic announcements16:02
*** openstack changes topic to "announcements (Meeting topic: kolla)"16:02
inc01. we releaed ocata!16:02
Jeffrey4lso many people today ;)16:02
inc0congrats everyone16:02
spsurya_gratz16:03
qwangJeffrey4l: for DST16:03
hrwyay! more reviewers!16:03
*** doude has quit IRC16:03
Jeffrey4laha16:03
inc02. One more week for voting for duonghq to become core, if anyone from core team missed it, please vote16:03
vhosakotyep, will vote16:04
duonghqthank inc016:04
spsurya_duonghq: congrats16:04
inc0so last week we canibalized regular agenda for release discussion, so now let's get back to it16:04
*** hongbin has quit IRC16:05
inc0#topic Need to formalize policy around pushing to dockerhub16:05
*** openstack changes topic to "Need to formalize policy around pushing to dockerhub (Meeting topic: kolla)"16:05
inc0agree ^16:05
inc0formalize and automate16:05
*** mandre has joined #openstack-meeting-416:05
inc0#link https://bugs.launchpad.net/kolla-ansible/+bug/1669075/comments/416:05
openstackLaunchpad bug 1669075 in kolla-ansible "kolla-ansible pull with kolla_ansible-4.0.0.0rc1 fails, because of missing tag in docker registry" [Low,Invalid]16:05
berendtregarding automate: i can add this to our jenkins instance16:05
pbourke#linkhttps://wiki.openstack.org/wiki/Meetings/Kolla#Agenda_for_next_meeting_.28Mar_8th_2017.2916:05
pbourke#link https://wiki.openstack.org/wiki/Meetings/Kolla#Agenda_for_next_meeting_.28Mar_8th_2017.2916:05
*** l4yerffeJ has joined #openstack-meeting-416:06
Jeffrey4lrc is unstable, push them will cause lots of issue, imo.16:06
mnaserbut wont they technically never be pulled16:06
Jeffrey4lespecially for hub.docker.com.16:06
mnaserunless you're running an rc release of kolla-ansible/kubernetes?16:06
Jeffrey4lbut push them into tarballs.openstack.org is OK, i think.16:06
berendtJeffrey4l: when you visit our docs the master documents including the tag 4.0.0 was published16:07
inc0alternatively, instead of rc16:07
*** doude has joined #openstack-meeting-416:07
berendtbecause of this david opened this bug16:07
inc0keep pushing stable/ocata16:07
pbourkeis there a reason we can't push to dockerhub along side tarballs.oo16:07
inc0with some meaninful thag16:07
inc0tag16:07
inc0like 4.0.0-latest16:07
berendtthe master branch is only usable when building own images16:07
mnaseri think what inc0 makes a lot of sense, that means backports can make their way much faster16:08
Jeffrey4lpbourke, i want to know how to keep hub.docker.com credential in ci.16:08
inc0yeah and also fixes what egonzalez mentioned on main channel - some other project deploys critical fix16:08
Jeffrey4linc0, 4.0.0-latest is a good idea.16:08
inc0we have it upstream immediatly16:08
*** Serlex has joined #openstack-meeting-416:08
inc0and :latest for master16:08
inc0berendt: my question is...what jenkins instance?:)16:09
mnaserinc0: well technically, you wouldnt, unless you manually trigger stable/<branch> (i could be wrong)?16:09
berendtinc0:  company one16:09
berendtnot sure if we have to add it to the openstack jenkins16:09
inc0right16:09
Jeffrey4lberendt, re docs, sorry, i do not get your point ;(16:09
berendtJeffrey4l: david opened the bug because the kolla-ansible repository on the master branch is not usable without building own images16:10
inc0so how about we will create crontab entries and keep them in our repo16:10
Jeffrey4lmnaser, we can , there is a period pipeline in zuul.16:10
mnaseroh cool116:10
inc0Jeffrey4l: really? so we can run a gate daily?16:10
Jeffrey4linc0, yep.16:10
inc0or rather, job to build+push?16:11
Jeffrey4lpretty sure.16:11
inc0cool16:11
mnaseryes i recall now the periodic pipeline16:11
mnaserhttps://docs.openstack.org/infra/system-config/zuul.html > periodic16:11
inc0do we agree that we create branch :4.0.0-latest for daily stable ocata and :latest for daily master?16:11
Jeffrey4l#link https://docs.openstack.org/infra/system-config/zuul.html16:11
inc0or maybe not latest16:11
inc0let's call it master or trunk16:12
inc0as latest is default tag16:12
mnaserwould it be a lot more work to add newton? :X16:12
inc0no it wouldnt16:12
inc0we can do neutron too16:12
Jeffrey4lneutron?16:12
mnaserit would be quite beneficial (as ocata is still "fresh")16:12
inc0newton16:12
mnaseri think he means newton :-P16:12
inc0sorry16:12
inc0I'm still waking up;)16:12
Jeffrey4lso i guess push branch is acceptable by all guys, right?16:13
inc0#action inc0: write bp for daily gerrit jobs16:13
Jeffrey4ltag name is not a big deal.16:13
inc0yeah16:13
inc0we can continue discussion in bp and as usual16:13
pbourkeinc0: how are we going to get credentials into these jobs16:14
Jeffrey4lanother thing related to this is: auto bump the service tag in source.16:14
Jeffrey4lpbourke, good point.16:14
inc0pbourke: that's a good question, I'll check with infra for secret storage16:14
pbourkeinc0: cool16:14
inc0I think they have hiera (they need to;))16:14
inc0maybe we can somehow tap into it16:14
mnaserthey do have hiera16:15
mnaserpypi credentials are stored in there for example16:15
Jeffrey4lcool.16:15
Jeffrey4lmnaser, you know lots of think about ci?16:15
Jeffrey4lthing*16:15
* mnaser has been in openstack since 201116:16
Jeffrey4lwow16:16
mnaserour cloud is running newton (but it started its life off as bexar actually) -- looking to get more involved but we can get into that later :)16:16
hrwmnaser: perfect person for '10y of openstack experience' offers16:16
Jeffrey4llol16:16
inc0mnaser: so from Bexar?:016:16
berendtlol16:17
egonzalezlol16:17
mnaserhttp://jeffrose.wpengine.netdna-cdn.com/wp-content/uploads/2011/12/dr.-evil-million-dollar-term-policy-300x241.jpg16:17
inc0ok let's move on16:17
berendtwe started first environment with bexar, too, funny times16:17
inc0#topic drop root16:17
*** openstack changes topic to "drop root (Meeting topic: kolla)"16:17
inc0duonghq: you're u16:17
inc0up16:17
duonghqthank inc016:17
duonghqI see we have 2 bugs relate to drop root topic:16:18
duonghq#info keystone https://bugs.launchpad.net/kolla/+bug/157679416:18
openstackLaunchpad bug 1576794 in kolla "drop root for keystone" [Critical,In progress] - Assigned to Surya Prakash Singh (confisurya)16:18
duonghq#info crontab https://bugs.launchpad.net/kolla/+bug/156074416:18
openstackLaunchpad bug 1560744 in kolla "drop root for crontab" [Critical,Confirmed]16:18
*** rbak_ has quit IRC16:18
duonghqfor crontab, I see that sdake commented it cannot be dropped in centos, for keystone, I'm not sure16:19
spsurya_inc0:  first to check is this valid bug , need to b fix ?16:19
duonghqso if we can confirm for crontab one, I think we can close the bug16:19
*** cathrichardson has quit IRC16:19
spsurya_we pbourke comment too for keystone one16:19
spsurya_that root can't be dropped16:19
*** cathrichardson has joined #openstack-meeting-416:20
*** bobmel has quit IRC16:20
*** vsaienk0 has joined #openstack-meeting-416:20
inc0well for keystone, and other apache based apis, it can't be dropped16:20
*** rbak has joined #openstack-meeting-416:20
inc0afair16:20
duonghqpbourke, how do you think?16:20
pbourkewould be interested in what the keystone guys have to say on this16:20
pbourkesuddenly forcing root on operators is a strange decision16:21
pbourkeregardless of the benefits brought by running behind apache16:21
hrwif it can run on >1024 port then should be doable without root16:21
Jeffrey4lcopy from net: Apache has to run as root initially in order to bind to port 80. If you don't run it as root initially then you cannot bind to port 80. If you want to bind to some port above 1024 then yes, you can.16:21
spsurya_pbourke: +116:21
Jeffrey4lhttps://superuser.com/questions/316705/running-apache-as-a-different-user16:21
Jeffrey4lall the port we are using now > 102416:21
inc0Jeffrey4l: horizon is still 80/44316:22
inc0well 8016:22
Jeffrey4loh, right. horizon is.16:22
duonghqso, we can move it to higher port, and drop root?16:22
mnaserhaproxy as well?16:22
mnaserfor the horizon backends16:22
inc0but technically we could run horizon on 1024< and bind 80 on haproxy16:22
inc0just not backwards compatible change so let's not do it16:23
spsurya_seems like >1024 would be ok for dropping16:23
Jeffrey4linc0, haproxy is optional.16:23
mnaseraio deployments might become a bit weird though ^16:23
inc0everything is optional;)16:23
inc0but yeah, can break stuff16:23
Jeffrey4lkolla support run without haproxy.16:23
duonghqmnaser, in default setting, AIO still use haproxy16:23
*** lei-zh has joined #openstack-meeting-416:23
mnaserit seems like the root requirement is there, regardless16:23
inc0yeah, and keepalived;)16:23
mnaserthere's quite a few components which will need root at the end of the day16:24
inc0well, either way16:24
duonghqwe still can bind port from docker side16:24
inc0keystone shouldn't need it because of apache16:24
Jeffrey4lso we can drop root for apache with port > 1024 , right?16:24
mnaseryes Jeffrey4l16:24
*** cathrichardson has quit IRC16:24
inc0duonghq: that's good alternative, but we would need to drop net=host for apis16:24
inc0which I wouldn't be opposed to16:24
hrwat linaro we only deploy nova/neutron/cinder/glance/horizon/keystone + openvswitch + ceph iirc16:25
*** julim_ has quit IRC16:25
*** rbak has quit IRC16:25
Jeffrey4lhrw, so?16:25
*** l4yerffeJ has quit IRC16:25
duonghqinc0, hmm, forgot that, one of our goals16:25
*** rbak has joined #openstack-meeting-416:25
mnaseri like net=host being there.  it makes life simple.  once you get out of it, you have to start playing around overlay networsk and you start adding a lot of the complexities (imho)16:25
Jeffrey4lthere is another parameter may be helpful to drop root: docker run --cap-add16:25
Jeffrey4lbut i am not sure.16:26
mnaseractually thats a really good suggestion16:26
*** julim has joined #openstack-meeting-416:26
inc0yeah, and also there were performance issues16:26
pbourkehow many people see this as high priority?16:26
*** l4yerffeJ has joined #openstack-meeting-416:26
Jeffrey4lpbourke, drop root, or?16:26
mnaseras a deployer, i dont really care about the keystone container running as root (honestly)16:26
pbourkebreaking out of a container is a theoretical exploit... meanwhile we have world readable passwords on all target nodes16:26
Jeffrey4lbtw, even though keystone container running as root, but keystone wsgi run as keystone user.16:26
mnaserhttpd is going to be running as root in most other deployments methods in the first place and the keystone processes fork under keystone16:27
inc0and getting into container is arguably harder than root host16:27
*** unicell has quit IRC16:27
inc0as we don't run any services there besides one we need16:27
*** sshnaidm is now known as sshnaidm|nnl16:27
*** sshnaidm|nnl is now known as sshnaidm|bbl16:27
Jeffrey4lcan i say: drop root is not critical issue, but nice to have ?16:27
mnaseri would agree with that ^16:28
pbourkeI think so16:28
inc0but regardless, can we examine drop root for ks as there doesn't seem to be compelling reason why not?16:28
*** robputt_ has quit IRC16:28
*** clayton has quit IRC16:28
inc0it's still better to remove it16:28
Jeffrey4lso if drop-root for any container is possible, and anyone who interested in this? please implement it :)16:28
inc0just not critical16:28
spsurya_Jeffrey4l:  we can its type to medium ?16:28
duonghqsure16:28
pbourkesomeone should investigate and update the docs if its not currently feasable16:28
inc0yeah let's make all drop root medium bugs16:28
*** cathrichardson has joined #openstack-meeting-416:29
Jeffrey4lmedium, agree.16:29
duonghqso we drop its "importance"?16:29
duonghqlol16:29
inc0lol16:29
spsurya_duonghq: lol16:29
duonghqI'll ask sdake later when I see him16:29
duonghqabout crontab16:29
inc0(and I bet *nobody* actually laughted out loud)16:29
spsurya_although we need to fix it anyway16:29
spsurya_inc0: +116:30
duonghqya, alright16:30
inc0right, let's move on16:30
*** robputt has joined #openstack-meeting-416:30
spsurya_yes no body16:30
inc0#topic canonical k8s deployment16:30
*** openstack changes topic to "canonical k8s deployment (Meeting topic: kolla)"16:30
*** reedip has joined #openstack-meeting-416:30
inc0so I think we don't have our canonical guys around16:31
inc0(do we have kolla-k8s people?)16:31
Jeffrey4lCanonical company? interesting16:31
inc0kfox1111 around?16:31
inc0ok it seems we don't have quorum for that, pushing to next meeting16:32
zhubingbing_;)16:32
*** kbyrne has quit IRC16:32
inc0#topic open discussion16:32
*** openstack changes topic to "open discussion (Meeting topic: kolla)"16:32
inc0since we ran out of agenda items, anything needing our immediate attention?16:32
vhosakotI'm still deploying kolla-k8s and will update docs as needed.16:32
duonghqcan I?16:32
inc0duonghq: go ahead16:32
duonghqforgot add this to agenda, I drafted on bp from last week16:33
duonghq#link https://blueprints.launchpad.net/kolla/+spec/unix-signals-handling16:33
*** clayton has joined #openstack-meeting-416:33
duonghqcan you give me some comment?16:33
duonghqhmm, where is the bot, I think bot'll put the title16:33
duonghq Unix singals handling in Kolla image16:33
inc0duonghq: first, we need to figure out which services allows sighup16:33
inc0second, that won't work with CONFIG_ONCE16:34
berendtduonghq: i think he doesn't because of the leading #link16:34
*** david-lyle_ has joined #openstack-meeting-416:34
duonghqberendt, roger16:34
*** david-lyle has quit IRC16:34
duonghqinc0, ya, but in COPY_ALWAYS, it'll be nice feature to reload setting w/o downtime16:34
Jeffrey4lduonghq, have u tried sighup. it should work with dumb-init.16:34
mnaseralso, i think this is a big of a weird situation because not all config values are reloaded16:34
duonghqw/o restart container16:34
mnaserso for example oslo_log might notice the change but some other part of another component will16:35
duonghqJeffrey4l, I'm not sure w/ dumb-init, just plain service, it's ok16:35
mnaserso i think its important to keep in mind of the possible complexity that might introduce knowing which config values will reload and which ones wont16:35
duonghqmnaser, ya, and we also have some service support graceful shutdown by signal16:35
mnaseri think graceful shutdown is miles more important especially for cases like nova-compute for example16:36
Jeffrey4lsighup should be handle properly, as long as the real service could handle it.16:36
*** kbyrne has joined #openstack-meeting-416:36
Jeffrey4lcurrently, we use sighup for haproxy configure reload.16:36
Jeffrey4lso i think this pb is already done ;)16:37
inc0yeah, sigkill is more importnat16:37
mnaserbut i think on reconfigure's sending signal instead of just killing the container (unless docker already does that?)16:37
duonghqmnaser, it's depend on argument we pass to docker16:38
inc0docker does sigkill and then timeout (30s I believe) before force termination16:38
duonghqthe signal indeed16:38
Jeffrey4linc0, 10s16:38
mnasergotcha inc0 that's good for nova-compute16:38
*** zhubingbing_ has quit IRC16:38
mnaserbut 10 seconds might be a bit too short but i think that's anothre discussion16:38
Jeffrey4lit is configurable.16:38
Jeffrey4lfor each container.16:39
mnaserthats good to know, thanks Jeffrey4l16:39
Jeffrey4ldocker stop -t <num>16:39
inc0but I don't believe we use this config16:39
inc0maybe that's good bug to kolla_docker?16:39
duonghqJeffrey4l, should we figure what service support SIGHUP to reload whole service config, then passthrough the signal to that service?16:39
portdirectsorry to burst in late - we can also controll the signals in k8s - so would be great to get kfox and sbezverk to have some input on that16:39
Jeffrey4lkolla-ansible do not support this parameter so far.16:39
inc0portdirect: yeah k8s is better in this spae16:40
Jeffrey4lduonghq, not all parameter support SIGHUP, jut part of them, iirc.16:40
duonghqJeffrey4l, it's docker-py, docker issue or our issue?16:40
inc0our issue16:41
*** zhubingbing_ has joined #openstack-meeting-416:41
Jeffrey4lwait 1 min. which issue are u talking?16:41
inc0well, we don't allow to override 10s16:41
inc0that's it16:41
mnaseri think a summary of what inc0 is saying is overriding the docker kill timeout for containers16:41
mnaser(aka the time period from when it sends a signal to stop and then forcingly terminates the container)16:42
Jeffrey4l1. kolla container support sighub, it pass to the real process    2. container is killed after 10s without stopped.16:42
inc0and for 2 - let's add this config so we can extend period for services like n-cpu or heat16:42
Jeffrey4linc0, ++16:43
duonghqJeffrey4l, just for sure, we already support passing SIGHUP to container?16:43
mnaseras you're using dumb-init i believe you it should happen automagically16:43
duonghqinc0, +116:43
Jeffrey4lduonghq, yep. with dumb-init, SIGHUP is handle properly.16:43
duonghqmnaser, Jeffrey4l roger16:43
mnaseri have a few things to bring up if we're done with this16:43
Jeffrey4lyou can try it simplely.16:43
duonghqiirc, we're planing to move to another init16:43
inc0yeah, but correct me if I'm wrong but we don't *really* use sighup during reconfigure16:44
duonghqtini?16:44
Jeffrey4lbut another thing is: not all parameter in nova.conf support SIGHUP.16:44
duonghqinc0,  yup16:44
duonghqJeffrey4l, of course16:44
Jeffrey4linc0, for haproxy, yes. others no.16:44
duonghqit's mnaser said: it's make things go wired16:44
inc0question is, is it a big deal really16:44
duonghqi.e. all oslo log support it,16:44
Jeffrey4lit is impossible, imo.16:44
inc0at least very hard16:45
Jeffrey4lwe do not know which parameter is change, so we can not know whether we should restart or sighup.16:45
Jeffrey4lso it is impossible.16:45
*** yamahata has quit IRC16:45
inc0right16:45
mnaseri think if you want to revise the bp duonghq you would maybe look into merge_configs to notice what changed16:45
duonghqbut for glance, it's support SIGHUP for all config16:45
inc0safer to do full restart16:45
duonghqI mean, by the time, maybe more service support this kind of reconfiguration16:46
mnaserand then maybe if SIGHUP becomes "the way to go" long term, you'd easily be able to do that16:46
*** iyamahat has quit IRC16:46
Jeffrey4lif one service announce he support SIGHUP for all config, i think we can implement this.16:46
duonghqso, for services have not supported yet, we can ignore that,16:46
duonghqwe can have some kind of fully supported list16:46
mnaserjust on a deployer perspective16:47
inc0duonghq: but if we introduce 2 different modes of reload16:47
inc0that's complexity16:47
mnaseri would much rather have a full restart16:47
mnaseri doubt SIGHUP reloads have undergone heavy testing16:47
Jeffrey4lCOPY_ONCE is another big concern when using SIGHUP.16:47
Jeffrey4lmnaser, ++16:47
duonghqinc0, sure,16:47
mnaserdeploy X change, send SIGHUP, makes sure everthing is working is probably not something that's tested16:47
Jeffrey4lin most of case, restart is not a big deal.16:47
duonghqok16:48
inc0another question16:48
mnaserif it is a big deal then you have mutliple controllers and serial will do controlled restarts so you should be okay16:48
inc0different topic16:48
inc0draining of connections on haproxy16:48
inc0during upgrade16:48
Jeffrey4lrestart means: kill the process and start it again,   reload/sighup means recreate the inner class/object again.16:48
*** Sukhdev_ has quit IRC16:48
Jeffrey4linc0, at that point, we should support rolling upgrade first.16:49
inc0right...16:49
mnaserinstead of draining connections, i think shutting all services down and letting haproxy return 502 is an acceptable thing16:49
inc0any ideas about that btw16:49
inc0?16:49
Jeffrey4lotherwise the remaining connection won't work.16:49
duonghqabout draining connection on haproxy, iirc, egonzalez have a solution16:49
Jeffrey4lmnaser, i like you.16:50
Jeffrey4llolo16:50
egonzalezinc0, yep, ansible support setting a haproxy backend as maintenance mode16:50
inc0yay..but it doesn't support serial way we need it;)16:50
duonghqwe can drain connection than upgrade the node, so it appear no downtime at that point16:50
Jeffrey4lserial is not rolling upgrade. we talked about this16:50
inc0ok, anyway, rolling upgrade16:50
inc0that's what I meant16:51
mnaseri would: pull all new images, shutdown all $service containers, run db syncs, start all $service containers.  naturally, during the time of this happening, haproxy will be giving back 502s16:51
duonghqabout rolling upgrade, graceful shutdown is important for achieve that16:51
mnaserfor rolling upgrades, here's what i'd throw in the table, add multiple steps to it (or maybe even multiple kolla-ansible steps)16:51
mnaserstep #1, upgrade control plane (this happens with no serial)16:51
Jeffrey4lmnaser, shutdown all service means shutdown haproxy.16:52
mnasernope, shut down a specific service, ex: glance16:52
Jeffrey4lgot.16:52
mnaserstep #2, upgrade data plan (this happens with say, 20% serial or whatever)16:52
Jeffrey4lduonghq, graceful shutdown mean?16:52
mnaseras part of step #1, you'd set upgrade_levels on the controllers too16:52
inc0yeah, we thought of 2 different plays16:52
mnaserand then the final step would be, remove all upgrade_levels and restart $service16:52
duonghqglance (for example) has glance-control to coordinate its microservice, we have not supported that16:53
inc0hmm, upgrade playbook can call 3 plays with serial16:53
duonghqJeffrey4l, we send some signal to container, it'll drain connection by itself16:53
inc01 - upgrade control, no serial, set upgrade_lebels16:53
inc02- upgrade compute, with serial16:53
inc03 - remove controller upgrade_levels16:53
mnaserideally id like to see those split (and one that is combined).  we usually prefer to upgrade control plane and make sure everything is a-ok16:54
*** zhubingbing_ has quit IRC16:54
Jeffrey4ldo all services support upgrade_levels?16:54
mnaserthe large scale ones do (aka neutron+nova)16:54
mnaserthe rest i dont really know but they're so lightweight that it's not as big of a deal16:54
mnasermost people dont have 300 heat-engine instances for example16:55
Jeffrey4lyep.16:55
inc0separating upgrade to multiple plays - I really like that16:56
Jeffrey4ldraining connection is trying to reduce the downtime in #116:56
*** baoli has quit IRC16:56
mnaseri have few things16:56
mnaserbefore the end if people dont mind16:56
inc0I'd do it after we make upgrade gats really16:56
Jeffrey4ltwo topics we are haveing.16:56
duonghqJeffrey4l, minute, does dumb-init support passsing SIGKILL to the process? in general, every signal?16:56
Jeffrey4lmnaser, please.16:56
mnaserhttps://review.openstack.org/#/c/445690/ keystone-ssh is broken16:56
duonghqinc0, +1 for your 3 plays16:56
Jeffrey4lduonghq, yep.16:56
*** baoli has joined #openstack-meeting-416:56
mnasermultinode rotation of fernet tokens doesnt work16:56
duonghqJeffrey4l, cool16:56
mnaserif people can give some love to that review, it would be wonderful16:56
mnaserill backport afterwards16:57
Jeffrey4lduonghq, dumb-init works like systemd.16:57
mnaserand as a closer for next time maybe, i want to float the idea of using bindep when installing from source to avoid problems like this - https://review.openstack.org/#/c/446032/16:57
Jeffrey4l+2ed16:58
duonghqJeffrey4l, ok, I'll experiment that, thanks16:58
*** baoli has quit IRC16:58
*** cathrichardson has left #openstack-meeting-416:58
inc0ok, we're running out of time16:58
inc0thank you all for coming16:58
duonghqthanks16:58
inc0#endmeeting kolla16:58
*** openstack changes topic to " (Meeting topic: ironic_neutron)"16:58
openstackMeeting ended Wed Mar 15 16:58:41 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:58
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2017/kolla.2017-03-15-15.59.html16:58
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2017/kolla.2017-03-15-15.59.txt16:58
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2017/kolla.2017-03-15-15.59.log.html16:58
*** lei-zh has quit IRC16:58
*** lazyPwr has joined #openstack-meeting-416:59
*** hrw has left #openstack-meeting-417:01
*** duonghq has quit IRC17:02
*** egonzalez has quit IRC17:02
*** britthouser7 has joined #openstack-meeting-417:03
*** vhosakot has left #openstack-meeting-417:04
*** salmankhan has joined #openstack-meeting-417:05
*** britthouser has quit IRC17:05
*** unicell has joined #openstack-meeting-417:05
*** iyamahat has joined #openstack-meeting-417:05
*** unicell has quit IRC17:05
*** baoli has joined #openstack-meeting-417:06
*** anilvenkata has quit IRC17:07
*** chigang has quit IRC17:09
*** wxy| has quit IRC17:11
*** erikmwilson has quit IRC17:12
*** erikmwilson has joined #openstack-meeting-417:13
*** rtheis has joined #openstack-meeting-417:13
*** rtheis has quit IRC17:16
*** Swami has joined #openstack-meeting-417:20
*** yamahata has joined #openstack-meeting-417:24
*** matrohon has quit IRC17:28
*** pcaruana has quit IRC17:28
*** unicell has joined #openstack-meeting-417:28
*** unicell has quit IRC17:29
*** ltomasbo is now known as ltomasbo|away17:32
*** unicell has joined #openstack-meeting-417:33
*** Sukhdev_ has joined #openstack-meeting-417:34
*** Sukhdev has quit IRC17:36
*** reedip has quit IRC17:38
*** jed56 has quit IRC17:40
*** jamespage has joined #openstack-meeting-417:44
*** pmesserl_ has joined #openstack-meeting-417:46
*** pmesserli has quit IRC17:46
*** unicell has quit IRC17:53
*** armax has quit IRC17:55
*** s3wong has joined #openstack-meeting-417:57
*** arosales has joined #openstack-meeting-418:00
*** liangy has quit IRC18:03
*** efoley_ has joined #openstack-meeting-418:04
*** marst has quit IRC18:05
*** marst has joined #openstack-meeting-418:05
*** Sukhdev_ has quit IRC18:07
*** efoley__ has quit IRC18:08
*** baoli has quit IRC18:09
*** efoley_ has quit IRC18:09
*** baoli has joined #openstack-meeting-418:10
*** baoli has quit IRC18:14
*** jascott1 has left #openstack-meeting-418:15
*** bogdando has quit IRC18:16
*** joedborg has quit IRC18:18
*** baoli has joined #openstack-meeting-418:22
*** krtaylor has quit IRC18:26
*** unicell has joined #openstack-meeting-418:27
*** marst has quit IRC18:28
*** armax has joined #openstack-meeting-418:30
*** marst has joined #openstack-meeting-418:33
*** sshnaidm|bbl is now known as sshnaidm18:36
*** unicell has quit IRC18:37
*** unicell has joined #openstack-meeting-418:41
*** bnemec has quit IRC18:41
*** cathrichardson has joined #openstack-meeting-418:44
*** unicell1 has joined #openstack-meeting-418:44
*** unicell has quit IRC18:44
*** bnemec has joined #openstack-meeting-418:44
*** liangy has joined #openstack-meeting-418:45
*** unicell1 has quit IRC18:47
*** skraynev has quit IRC18:48
*** cathrichardson has quit IRC18:49
*** unicell has joined #openstack-meeting-418:50
*** unicell has quit IRC18:53
*** marst has quit IRC18:54
*** marst has joined #openstack-meeting-418:55
*** Serlex has quit IRC18:56
*** unicell has joined #openstack-meeting-418:56
*** erikmwilson has quit IRC19:12
*** erikmwilson has joined #openstack-meeting-419:13
*** krtaylor has joined #openstack-meeting-419:16
*** marst has quit IRC19:22
*** vishnoianil has quit IRC19:22
*** Sukhdev has joined #openstack-meeting-419:23
*** pmesserl_ has quit IRC19:24
*** cathrichardson has joined #openstack-meeting-419:24
*** pmesserli has joined #openstack-meeting-419:24
*** kylek3h has quit IRC19:42
*** aunnam has quit IRC19:45
*** dharinic has quit IRC19:45
*** pshedimb has quit IRC19:45
*** shasha_t- has quit IRC19:45
*** raj_singh has quit IRC19:45
*** sneti has quit IRC19:45
*** iurygregory has quit IRC19:47
*** iurygregory has joined #openstack-meeting-419:50
*** bobmel has joined #openstack-meeting-419:53
*** iurygregory has quit IRC19:56
*** bobmel has quit IRC19:57
*** david-lyle_ is now known as david-lyle19:57
*** iurygregory has joined #openstack-meeting-420:00
*** MeganR has joined #openstack-meeting-420:00
*** matrohon has joined #openstack-meeting-420:00
*** uck has joined #openstack-meeting-420:01
*** sayantan_ has quit IRC20:02
*** Sukhdev has quit IRC20:02
*** salmankhan has quit IRC20:08
*** hongbin has joined #openstack-meeting-420:13
*** vishnoianil has joined #openstack-meeting-420:13
*** rwallner has quit IRC20:14
*** rwallner has joined #openstack-meeting-420:17
*** marst has joined #openstack-meeting-420:19
*** rwallner_ has joined #openstack-meeting-420:19
*** rwallner_ has quit IRC20:19
*** rwallner_ has joined #openstack-meeting-420:19
*** rwallner has quit IRC20:21
*** marst_ has joined #openstack-meeting-420:25
*** marst has quit IRC20:28
*** dave-mccowan has quit IRC20:29
*** matrohon has quit IRC20:31
*** sneti has joined #openstack-meeting-420:34
*** salmankhan has joined #openstack-meeting-420:35
*** marst_ has quit IRC20:36
*** cathrichardson has left #openstack-meeting-420:37
*** stream10 has joined #openstack-meeting-420:40
*** dtardivel has quit IRC20:40
*** uck has quit IRC20:51
*** MeganR has quit IRC20:59
*** yfauser_ has quit IRC21:04
*** yfauser has joined #openstack-meeting-421:05
*** sneti has quit IRC21:05
*** hongbin has quit IRC21:06
*** stream10 has quit IRC21:06
*** cjloader_ has joined #openstack-meeting-421:07
*** sdague has quit IRC21:09
*** yfauser has quit IRC21:09
*** cjloader has quit IRC21:11
*** cjloader_ has quit IRC21:12
*** dave-mccowan has joined #openstack-meeting-421:13
*** dave-mcc_ has joined #openstack-meeting-421:17
*** dave-mccowan has quit IRC21:19
*** FrankZhang has quit IRC21:19
*** revon has joined #openstack-meeting-421:22
*** salmankhan has quit IRC21:25
*** krtaylor has quit IRC21:27
*** sneti has joined #openstack-meeting-421:30
*** salmankhan has joined #openstack-meeting-421:30
*** sneti has quit IRC21:30
*** yfauser has joined #openstack-meeting-421:34
*** l4yerffeJ_ has joined #openstack-meeting-421:34
*** tonytan4ever has quit IRC21:34
*** l4yerffeJ has quit IRC21:35
*** Jeffrey4l_ has joined #openstack-meeting-421:35
*** Jeffrey4l has quit IRC21:35
*** Sukhdev has joined #openstack-meeting-421:36
*** yfauser has quit IRC21:38
*** Sukhdev has quit IRC21:41
*** caboucha has quit IRC21:41
*** FrankZhang has joined #openstack-meeting-421:46
*** cjloader has joined #openstack-meeting-421:47
*** rwallner_ has quit IRC21:49
*** FrankZhang has quit IRC21:51
*** baoli has quit IRC21:54
*** galstrom is now known as galstrom_zzz21:54
*** Sukhdev has joined #openstack-meeting-421:57
*** Julien-zte has joined #openstack-meeting-421:59
*** cjloader has quit IRC22:05
*** uck has joined #openstack-meeting-422:05
*** Julien-zte has quit IRC22:13
*** krtaylor has joined #openstack-meeting-422:17
*** armax has quit IRC22:19
*** rfolco has quit IRC22:23
*** baoli has joined #openstack-meeting-422:34
*** yfauser has joined #openstack-meeting-422:35
*** gongysh has joined #openstack-meeting-422:37
*** mbruzek has quit IRC22:38
*** baoli has quit IRC22:38
*** vishnoianil has quit IRC22:40
*** yfauser has quit IRC22:40
*** vishnoianil has joined #openstack-meeting-422:41
*** hongbin has joined #openstack-meeting-422:43
*** bobh has quit IRC22:45
*** klamath has quit IRC22:59
*** rfolco has joined #openstack-meeting-423:04
*** haleyb has joined #openstack-meeting-423:10
*** pmesserli has quit IRC23:11
*** rfolco has quit IRC23:14
*** haleyb has quit IRC23:21
*** salmankhan has quit IRC23:23
*** salmankhan has joined #openstack-meeting-423:24
*** bobmel has joined #openstack-meeting-423:38
*** bobmel has quit IRC23:43
*** yfauser has joined #openstack-meeting-423:53
*** yfauser has quit IRC23:57
*** joanna has joined #openstack-meeting-423:58
*** adisky_ has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!