| *** TxGirlGeek has joined #openstack-nova | 00:08 | |
| *** TxGirlGeek has quit IRC | 00:08 | |
| *** pvradu has joined #openstack-nova | 00:12 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Handle websockify v0.9.0 in console proxy https://review.opendev.org/677856 | 00:12 |
|---|---|---|
| *** panda has quit IRC | 00:17 | |
| *** takamatsu has quit IRC | 00:17 | |
| *** panda has joined #openstack-nova | 00:19 | |
| *** markvoelker has joined #openstack-nova | 00:25 | |
| *** markvoelker has quit IRC | 00:30 | |
| *** gyee has quit IRC | 00:32 | |
| *** takashin has quit IRC | 00:55 | |
| *** bbobrov has quit IRC | 00:55 | |
| *** lbragstad has quit IRC | 00:55 | |
| *** tbachman has quit IRC | 00:55 | |
| *** edleafe has quit IRC | 00:55 | |
| *** dtantsur|afk has quit IRC | 00:55 | |
| *** ChanServ has quit IRC | 00:55 | |
| *** tkajinam has quit IRC | 00:55 | |
| *** threestrands has quit IRC | 00:55 | |
| *** factor has quit IRC | 00:55 | |
| *** owalsh|away has quit IRC | 00:55 | |
| *** cfriesen has quit IRC | 00:55 | |
| *** jhesketh has quit IRC | 00:55 | |
| *** prometheanfire has quit IRC | 00:55 | |
| *** frickler has quit IRC | 00:55 | |
| *** aarents__ has quit IRC | 00:55 | |
| *** NostawRm has quit IRC | 00:55 | |
| *** mtreinish has quit IRC | 00:55 | |
| *** tobias-urdin has quit IRC | 00:55 | |
| *** rcernin has quit IRC | 00:55 | |
| *** ebbex has quit IRC | 00:55 | |
| *** Conqueror has quit IRC | 00:55 | |
| *** dpawlik has quit IRC | 00:55 | |
| *** hamzy_ has quit IRC | 00:56 | |
| *** mrjk has quit IRC | 00:56 | |
| *** alex_xu has quit IRC | 00:56 | |
| *** mandre has quit IRC | 00:56 | |
| *** eandersson has quit IRC | 00:56 | |
| *** evrardjp has quit IRC | 00:56 | |
| *** amorin has quit IRC | 00:56 | |
| *** lifeless has quit IRC | 00:56 | |
| *** sorrison has quit IRC | 00:56 | |
| *** weshay has quit IRC | 00:56 | |
| *** igordc has quit IRC | 00:56 | |
| *** aojea has quit IRC | 00:56 | |
| *** ircuser-1 has quit IRC | 00:56 | |
| *** yaawang has quit IRC | 00:56 | |
| *** smcginnis has quit IRC | 00:56 | |
| *** stephenfin has quit IRC | 00:56 | |
| *** knikolla has quit IRC | 00:56 | |
| *** kukacz has quit IRC | 00:56 | |
| *** sean-k-mooney has quit IRC | 00:56 | |
| *** sapd1 has quit IRC | 00:56 | |
| *** dansmith has quit IRC | 00:56 | |
| *** dulek has quit IRC | 00:56 | |
| *** rnoriega- has quit IRC | 00:56 | |
| *** tbarron has quit IRC | 00:56 | |
| *** Vek has quit IRC | 00:56 | |
| *** antonym has quit IRC | 00:56 | |
| *** jlvillal has quit IRC | 00:56 | |
| *** panda has quit IRC | 00:56 | |
| *** klindgren has quit IRC | 00:56 | |
| *** artom has quit IRC | 00:56 | |
| *** licanwei has quit IRC | 00:56 | |
| *** Alon_KS has quit IRC | 00:56 | |
| *** hoonetorg has quit IRC | 00:56 | |
| *** lyarwood has quit IRC | 00:56 | |
| *** openstackgerrit has quit IRC | 00:56 | |
| *** lennyb has quit IRC | 00:56 | |
| *** cgoncalves has quit IRC | 00:56 | |
| *** dasp has quit IRC | 00:56 | |
| *** jenglisch has quit IRC | 00:56 | |
| *** Li_Liu has quit IRC | 00:56 | |
| *** johnthetubaguy has quit IRC | 00:56 | |
| *** tonyb has quit IRC | 00:56 | |
| *** pots has quit IRC | 00:56 | |
| *** johanssone has quit IRC | 00:56 | |
| *** jamiec has quit IRC | 00:56 | |
| *** mchlumsky has quit IRC | 00:56 | |
| *** irclogbot_2 has quit IRC | 00:56 | |
| *** brinzhang_ has quit IRC | 00:56 | |
| *** dosaboy has quit IRC | 00:56 | |
| *** cervigni has quit IRC | 00:56 | |
| *** jangutter has quit IRC | 00:56 | |
| *** gibi has quit IRC | 00:56 | |
| *** mgariepy has quit IRC | 00:56 | |
| *** gryf has quit IRC | 00:56 | |
| *** johnsom has quit IRC | 00:56 | |
| *** tjgresha has quit IRC | 00:56 | |
| *** purplerbot has quit IRC | 00:56 | |
| *** ianw has quit IRC | 00:56 | |
| *** gary_perkins has quit IRC | 00:56 | |
| *** Anticimex has quit IRC | 00:56 | |
| *** redkrieg has quit IRC | 00:56 | |
| *** tobberydberg has quit IRC | 00:56 | |
| *** jbryce has quit IRC | 00:56 | |
| *** kmalloc has quit IRC | 00:56 | |
| *** jmlowe has quit IRC | 00:56 | |
| *** logan- has quit IRC | 00:56 | |
| *** mrhillsman has quit IRC | 00:56 | |
| *** yikun has quit IRC | 00:56 | |
| *** bbowen__ has quit IRC | 00:56 | |
| *** tinwood has quit IRC | 00:56 | |
| *** cz2 has quit IRC | 00:56 | |
| *** fungi has quit IRC | 00:56 | |
| *** whoami-rajat has quit IRC | 00:56 | |
| *** yonglihe has quit IRC | 00:56 | |
| *** rouk has quit IRC | 00:56 | |
| *** jroll has quit IRC | 00:56 | |
| *** pas-ha has quit IRC | 00:56 | |
| *** lchabert has quit IRC | 00:56 | |
| *** ildikov has quit IRC | 00:56 | |
| *** tonyb[m] has quit IRC | 00:56 | |
| *** seyeongkim has quit IRC | 00:56 | |
| *** ashish2307 has quit IRC | 00:56 | |
| *** rajinir has quit IRC | 00:56 | |
| *** dustinc has quit IRC | 00:56 | |
| *** jrosser has quit IRC | 00:56 | |
| *** fyx has quit IRC | 00:56 | |
| *** jbernard has quit IRC | 00:56 | |
| *** lxkong has quit IRC | 00:56 | |
| *** mugsie has quit IRC | 00:56 | |
| *** dannins has quit IRC | 00:56 | |
| *** andreaf has quit IRC | 00:56 | |
| *** masayukig has quit IRC | 00:56 | |
| *** gmann has quit IRC | 00:56 | |
| *** donnyd has quit IRC | 00:56 | |
| *** jungleboyj has quit IRC | 00:56 | |
| *** pvradu has quit IRC | 00:56 | |
| *** KeithMnemonic1 has quit IRC | 00:56 | |
| *** DinaBelova has quit IRC | 00:56 | |
| *** kaisers has quit IRC | 00:56 | |
| *** efried has quit IRC | 00:56 | |
| *** Nick_A has quit IRC | 00:56 | |
| *** jistr has quit IRC | 00:56 | |
| *** zzzeek has quit IRC | 00:56 | |
| *** umbSublime has quit IRC | 00:56 | |
| *** ttx has quit IRC | 00:56 | |
| *** hemna_ has quit IRC | 00:56 | |
| *** amotoki has quit IRC | 00:56 | |
| *** mordred has quit IRC | 00:56 | |
| *** arne_wiebalck has quit IRC | 00:56 | |
| *** csatari has quit IRC | 00:56 | |
| *** gregwork has quit IRC | 00:56 | |
| *** coreycb has quit IRC | 00:56 | |
| *** portdirect has quit IRC | 00:56 | |
| *** zbr has quit IRC | 00:56 | |
| *** d34dh0r53 has quit IRC | 00:56 | |
| *** luyao has quit IRC | 00:56 | |
| *** vdrok has quit IRC | 00:56 | |
| *** rpittau|afk has quit IRC | 00:56 | |
| *** samc-bbc has quit IRC | 00:56 | |
| *** mnaser has quit IRC | 00:56 | |
| *** NobodyCam has quit IRC | 00:56 | |
| *** TheJulia has quit IRC | 00:56 | |
| *** PrinzElvis has quit IRC | 00:56 | |
| *** guilhermesp has quit IRC | 00:56 | |
| *** rm_work has quit IRC | 00:56 | |
| *** fnordahl has quit IRC | 00:56 | |
| *** _erlon_ has quit IRC | 00:56 | |
| *** mnasiadka has quit IRC | 00:56 | |
| *** melwitt has quit IRC | 00:56 | |
| *** Hazelesque has quit IRC | 00:56 | |
| *** BlackDex has quit IRC | 00:56 | |
| *** rabel has quit IRC | 00:56 | |
| *** icey has quit IRC | 00:56 | |
| *** StevenK has quit IRC | 00:56 | |
| *** aspiers has quit IRC | 00:56 | |
| *** awestin1 has quit IRC | 00:56 | |
| *** mgagne has quit IRC | 00:56 | |
| *** bauzas has quit IRC | 00:56 | |
| *** ab-a has quit IRC | 00:56 | |
| *** Jeffrey4l has quit IRC | 00:56 | |
| *** dtruong has quit IRC | 00:56 | |
| *** jdillaman has quit IRC | 00:56 | |
| *** dklyle has quit IRC | 00:56 | |
| *** adriant has quit IRC | 00:56 | |
| *** redrobot has quit IRC | 00:56 | |
| *** elod has quit IRC | 00:56 | |
| *** mgoddard has quit IRC | 00:56 | |
| *** adrianc has quit IRC | 00:56 | |
| *** toabctl has quit IRC | 00:56 | |
| *** obre has quit IRC | 00:56 | |
| *** gouthamr has quit IRC | 00:56 | |
| *** spotz has quit IRC | 00:56 | |
| *** szaher has quit IRC | 00:56 | |
| *** kevinbenton has quit IRC | 00:56 | |
| *** larsks has quit IRC | 00:56 | |
| *** arxcruz has quit IRC | 00:56 | |
| *** mmedvede has quit IRC | 00:56 | |
| *** mmedvede has joined #openstack-nova | 01:14 | |
| *** larsks has joined #openstack-nova | 01:14 | |
| *** kevinbenton has joined #openstack-nova | 01:14 | |
| *** arxcruz has joined #openstack-nova | 01:14 | |
| *** szaher has joined #openstack-nova | 01:14 | |
| *** spotz has joined #openstack-nova | 01:14 | |
| *** gouthamr has joined #openstack-nova | 01:14 | |
| *** obre has joined #openstack-nova | 01:14 | |
| *** toabctl has joined #openstack-nova | 01:14 | |
| *** adrianc has joined #openstack-nova | 01:14 | |
| *** mgoddard has joined #openstack-nova | 01:14 | |
| *** elod has joined #openstack-nova | 01:14 | |
| *** redrobot has joined #openstack-nova | 01:14 | |
| *** adriant has joined #openstack-nova | 01:14 | |
| *** dklyle has joined #openstack-nova | 01:14 | |
| *** jdillaman has joined #openstack-nova | 01:14 | |
| *** dtruong has joined #openstack-nova | 01:14 | |
| *** Jeffrey4l has joined #openstack-nova | 01:14 | |
| *** weshay has joined #openstack-nova | 01:14 | |
| *** sorrison has joined #openstack-nova | 01:14 | |
| *** lifeless has joined #openstack-nova | 01:14 | |
| *** amorin has joined #openstack-nova | 01:14 | |
| *** evrardjp has joined #openstack-nova | 01:14 | |
| *** eandersson has joined #openstack-nova | 01:14 | |
| *** mandre has joined #openstack-nova | 01:14 | |
| *** alex_xu has joined #openstack-nova | 01:14 | |
| *** mrjk has joined #openstack-nova | 01:14 | |
| *** hamzy_ has joined #openstack-nova | 01:14 | |
| *** dpawlik has joined #openstack-nova | 01:14 | |
| *** Conqueror has joined #openstack-nova | 01:14 | |
| *** ebbex has joined #openstack-nova | 01:14 | |
| *** rcernin has joined #openstack-nova | 01:14 | |
| *** jamiec has joined #openstack-nova | 01:14 | |
| *** johanssone has joined #openstack-nova | 01:14 | |
| *** tonyb has joined #openstack-nova | 01:14 | |
| *** pots has joined #openstack-nova | 01:14 | |
| *** johnthetubaguy has joined #openstack-nova | 01:14 | |
| *** Li_Liu has joined #openstack-nova | 01:14 | |
| *** jenglisch has joined #openstack-nova | 01:14 | |
| *** dasp has joined #openstack-nova | 01:14 | |
| *** cgoncalves has joined #openstack-nova | 01:14 | |
| *** lennyb has joined #openstack-nova | 01:14 | |
| *** openstackgerrit has joined #openstack-nova | 01:14 | |
| *** lyarwood has joined #openstack-nova | 01:14 | |
| *** hoonetorg has joined #openstack-nova | 01:14 | |
| *** licanwei has joined #openstack-nova | 01:14 | |
| *** artom has joined #openstack-nova | 01:14 | |
| *** Alon_KS has joined #openstack-nova | 01:14 | |
| *** klindgren has joined #openstack-nova | 01:14 | |
| *** panda has joined #openstack-nova | 01:14 | |
| *** edleafe has joined #openstack-nova | 01:14 | |
| *** tbachman has joined #openstack-nova | 01:14 | |
| *** lbragstad has joined #openstack-nova | 01:14 | |
| *** bbobrov has joined #openstack-nova | 01:14 | |
| *** takashin has joined #openstack-nova | 01:14 | |
| *** ab-a has joined #openstack-nova | 01:14 | |
| *** bauzas has joined #openstack-nova | 01:14 | |
| *** mgagne has joined #openstack-nova | 01:14 | |
| *** jlvillal has joined #openstack-nova | 01:14 | |
| *** antonym has joined #openstack-nova | 01:14 | |
| *** Vek has joined #openstack-nova | 01:14 | |
| *** rnoriega- has joined #openstack-nova | 01:14 | |
| *** dansmith has joined #openstack-nova | 01:14 | |
| *** sapd1 has joined #openstack-nova | 01:14 | |
| *** sean-k-mooney has joined #openstack-nova | 01:14 | |
| *** kukacz has joined #openstack-nova | 01:14 | |
| *** knikolla has joined #openstack-nova | 01:14 | |
| *** stephenfin has joined #openstack-nova | 01:14 | |
| *** tbarron has joined #openstack-nova | 01:14 | |
| *** yaawang has joined #openstack-nova | 01:14 | |
| *** smcginnis has joined #openstack-nova | 01:14 | |
| *** ircuser-1 has joined #openstack-nova | 01:14 | |
| *** aojea has joined #openstack-nova | 01:14 | |
| *** dulek has joined #openstack-nova | 01:14 | |
| *** igordc has joined #openstack-nova | 01:14 | |
| *** dtantsur|afk has joined #openstack-nova | 01:14 | |
| *** tobias-urdin has joined #openstack-nova | 01:14 | |
| *** NostawRm has joined #openstack-nova | 01:14 | |
| *** aarents__ has joined #openstack-nova | 01:14 | |
| *** frickler has joined #openstack-nova | 01:14 | |
| *** prometheanfire has joined #openstack-nova | 01:14 | |
| *** jhesketh has joined #openstack-nova | 01:14 | |
| *** cfriesen has joined #openstack-nova | 01:14 | |
| *** mtreinish has joined #openstack-nova | 01:14 | |
| *** owalsh|away has joined #openstack-nova | 01:14 | |
| *** factor has joined #openstack-nova | 01:14 | |
| *** threestrands has joined #openstack-nova | 01:14 | |
| *** tkajinam has joined #openstack-nova | 01:14 | |
| *** awestin1 has joined #openstack-nova | 01:14 | |
| *** aspiers has joined #openstack-nova | 01:14 | |
| *** StevenK has joined #openstack-nova | 01:14 | |
| *** icey has joined #openstack-nova | 01:14 | |
| *** rabel has joined #openstack-nova | 01:14 | |
| *** BlackDex has joined #openstack-nova | 01:14 | |
| *** Hazelesque has joined #openstack-nova | 01:14 | |
| *** melwitt has joined #openstack-nova | 01:14 | |
| *** mnasiadka has joined #openstack-nova | 01:14 | |
| *** _erlon_ has joined #openstack-nova | 01:14 | |
| *** fnordahl has joined #openstack-nova | 01:14 | |
| *** rm_work has joined #openstack-nova | 01:14 | |
| *** guilhermesp has joined #openstack-nova | 01:14 | |
| *** PrinzElvis has joined #openstack-nova | 01:14 | |
| *** TheJulia has joined #openstack-nova | 01:14 | |
| *** mnaser has joined #openstack-nova | 01:14 | |
| *** NobodyCam has joined #openstack-nova | 01:14 | |
| *** samc-bbc has joined #openstack-nova | 01:14 | |
| *** rpittau|afk has joined #openstack-nova | 01:14 | |
| *** vdrok has joined #openstack-nova | 01:14 | |
| *** luyao has joined #openstack-nova | 01:14 | |
| *** d34dh0r53 has joined #openstack-nova | 01:14 | |
| *** zbr has joined #openstack-nova | 01:14 | |
| *** portdirect has joined #openstack-nova | 01:14 | |
| *** coreycb has joined #openstack-nova | 01:14 | |
| *** gregwork has joined #openstack-nova | 01:14 | |
| *** csatari has joined #openstack-nova | 01:14 | |
| *** arne_wiebalck has joined #openstack-nova | 01:14 | |
| *** mordred has joined #openstack-nova | 01:14 | |
| *** ChanServ has joined #openstack-nova | 01:14 | |
| *** card.freenode.net sets mode: +o ChanServ | 01:14 | |
| *** cervigni has joined #openstack-nova | 01:14 | |
| *** jangutter has joined #openstack-nova | 01:14 | |
| *** mgariepy has joined #openstack-nova | 01:14 | |
| *** gryf has joined #openstack-nova | 01:14 | |
| *** johnsom has joined #openstack-nova | 01:14 | |
| *** purplerbot has joined #openstack-nova | 01:14 | |
| *** ianw has joined #openstack-nova | 01:14 | |
| *** gary_perkins has joined #openstack-nova | 01:14 | |
| *** tobberydberg has joined #openstack-nova | 01:14 | |
| *** KeithMnemonic1 has joined #openstack-nova | 01:15 | |
| *** DinaBelova has joined #openstack-nova | 01:15 | |
| *** kaisers has joined #openstack-nova | 01:15 | |
| *** efried has joined #openstack-nova | 01:15 | |
| *** Nick_A has joined #openstack-nova | 01:15 | |
| *** jistr has joined #openstack-nova | 01:15 | |
| *** zzzeek has joined #openstack-nova | 01:15 | |
| *** umbSublime has joined #openstack-nova | 01:15 | |
| *** ttx has joined #openstack-nova | 01:15 | |
| *** hemna_ has joined #openstack-nova | 01:15 | |
| *** amotoki has joined #openstack-nova | 01:15 | |
| *** mandre has quit IRC | 01:17 | |
| *** sorrison has quit IRC | 01:17 | |
| *** roukoswarf has joined #openstack-nova | 01:21 | |
| *** mugsie has joined #openstack-nova | 01:21 | |
| *** bbowen has joined #openstack-nova | 01:21 | |
| *** brinzhang has joined #openstack-nova | 01:21 | |
| *** mandre has joined #openstack-nova | 01:21 | |
| *** Anticimex has joined #openstack-nova | 01:21 | |
| *** lchabert has joined #openstack-nova | 01:22 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add docstring to check_availability_zone function https://review.opendev.org/677858 | 01:22 |
| *** tinwood has joined #openstack-nova | 01:22 | |
| *** gmann has joined #openstack-nova | 01:23 | |
| *** jmlowe has joined #openstack-nova | 01:23 | |
| *** irclogbot_1 has joined #openstack-nova | 01:24 | |
| *** hongbin has joined #openstack-nova | 01:26 | |
| *** swamireddy has joined #openstack-nova | 01:27 | |
| *** gmann has quit IRC | 01:27 | |
| *** gmann has joined #openstack-nova | 01:28 | |
| *** igordc has quit IRC | 01:32 | |
| *** fungi has joined #openstack-nova | 01:36 | |
| *** aojea has quit IRC | 01:39 | |
| *** aojea has joined #openstack-nova | 01:39 | |
| *** larainema has joined #openstack-nova | 01:53 | |
| *** jbernard has joined #openstack-nova | 01:54 | |
| *** morgan has joined #openstack-nova | 02:02 | |
| *** jroll has joined #openstack-nova | 02:03 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Handle websockify v0.9.0 in console proxy https://review.opendev.org/677856 | 02:06 |
| *** ricolin has joined #openstack-nova | 02:21 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies https://review.opendev.org/648480 | 02:21 |
| *** igordc has joined #openstack-nova | 02:26 | |
| *** markvoelker has joined #openstack-nova | 02:32 | |
| *** hamzy has joined #openstack-nova | 02:36 | |
| *** hamzy_ has quit IRC | 02:36 | |
| *** licanwei has quit IRC | 02:36 | |
| *** BjoernT has joined #openstack-nova | 02:55 | |
| *** markvoelker has quit IRC | 03:20 | |
| *** markvoelker has joined #openstack-nova | 03:21 | |
| *** markvoelker has quit IRC | 03:25 | |
| *** janki has joined #openstack-nova | 03:45 | |
| *** markvoelker has joined #openstack-nova | 03:46 | |
| *** artom has quit IRC | 03:53 | |
| *** markvoelker has quit IRC | 03:56 | |
| *** markvoelker has joined #openstack-nova | 03:57 | |
| *** markvoelker has quit IRC | 03:57 | |
| *** markvoelker has joined #openstack-nova | 03:58 | |
| *** markvoelker has quit IRC | 04:08 | |
| *** markvoelker has joined #openstack-nova | 04:09 | |
| *** hongbin has quit IRC | 04:13 | |
| *** markvoelker has quit IRC | 04:14 | |
| *** udesale has joined #openstack-nova | 04:16 | |
| *** pvradu has joined #openstack-nova | 04:22 | |
| *** mkrai has joined #openstack-nova | 04:25 | |
| *** pvradu has quit IRC | 04:27 | |
| *** mkrai has quit IRC | 04:34 | |
| *** mkrai has joined #openstack-nova | 04:36 | |
| *** BjoernT_ has joined #openstack-nova | 04:48 | |
| *** mkrai has quit IRC | 04:49 | |
| *** BjoernT has quit IRC | 04:50 | |
| *** mkrai has joined #openstack-nova | 04:51 | |
| *** bhagyashris has joined #openstack-nova | 05:00 | |
| *** mkrai has quit IRC | 05:04 | |
| *** mkrai has joined #openstack-nova | 05:06 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove zVM requirement from the top level requirements. https://review.opendev.org/677870 | 05:11 |
| *** BjoernT_ has quit IRC | 05:15 | |
| *** ratailor has joined #openstack-nova | 05:18 | |
| *** igordc has quit IRC | 05:20 | |
| *** janki has quit IRC | 05:26 | |
| openstackgerrit | Merged openstack/nova master: Fix missing rule description in HACKING.rst https://review.opendev.org/677589 | 05:28 |
| *** jaosorior has joined #openstack-nova | 05:29 | |
| *** janki has joined #openstack-nova | 05:43 | |
| *** udesale has quit IRC | 05:44 | |
| *** udesale has joined #openstack-nova | 05:45 | |
| *** takamatsu has joined #openstack-nova | 05:47 | |
| *** aarents__ has quit IRC | 06:09 | |
| *** jawad_axd has joined #openstack-nova | 06:20 | |
| *** pvradu has joined #openstack-nova | 06:24 | |
| *** tetsuro has joined #openstack-nova | 06:38 | |
| *** yonglihe has joined #openstack-nova | 06:47 | |
| *** rpittau|afk is now known as rpittau | 06:51 | |
| *** damien_r has joined #openstack-nova | 06:56 | |
| *** takamatsu has quit IRC | 06:57 | |
| *** pvradu has quit IRC | 06:57 | |
| *** maciejjozefczyk has joined #openstack-nova | 07:01 | |
| *** udesale has quit IRC | 07:02 | |
| *** udesale has joined #openstack-nova | 07:02 | |
| *** udesale has quit IRC | 07:02 | |
| *** udesale has joined #openstack-nova | 07:03 | |
| openstackgerrit | Merged openstack/nova master: Add a hacking rule for non-existent assertions https://review.opendev.org/677596 | 07:05 |
| *** trident has quit IRC | 07:06 | |
| alex_xu | efried: sean-k-mooney this doesn't sounds right https://review.opendev.org/#/c/664420/42/nova/scheduler/request_filter.py@205, looks like we can't do the translate in request filter | 07:09 |
| *** udesale has quit IRC | 07:11 | |
| *** udesale has joined #openstack-nova | 07:11 | |
| *** trident has joined #openstack-nova | 07:14 | |
| *** takashin has quit IRC | 07:17 | |
| *** ivve has joined #openstack-nova | 07:20 | |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: Ignore root_gb for BFV in simple tenant usage API https://review.opendev.org/612626 | 07:29 |
| *** xek has joined #openstack-nova | 07:36 | |
| *** takashin has joined #openstack-nova | 07:44 | |
| *** gibi has joined #openstack-nova | 07:56 | |
| *** threestrands has quit IRC | 08:01 | |
| *** priteau has joined #openstack-nova | 08:06 | |
| *** jangutter_ has joined #openstack-nova | 08:11 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Specify availability_zone to unshelve https://review.opendev.org/663851 | 08:11 |
| openstackgerrit | Merged openstack/nova master: Move final bridge commands to privsep. https://review.opendev.org/639580 | 08:12 |
| openstackgerrit | Merged openstack/nova master: Cleanup the _execute shim in nova/network. https://review.opendev.org/639581 | 08:13 |
| openstackgerrit | Merged openstack/nova master: We no longer need rootwrap. https://review.opendev.org/554438 | 08:13 |
| openstackgerrit | Merged openstack/nova master: Cleanup no longer required filters and add a release note. https://review.opendev.org/639826 | 08:13 |
| openstackgerrit | Merged openstack/nova master: Make a failure to purge_db fail in post_test_hook.sh https://review.opendev.org/677806 | 08:13 |
| openstackgerrit | Merged openstack/nova master: Split fake host capabilities into reusable variables https://review.opendev.org/677710 | 08:14 |
| *** jangutter has quit IRC | 08:15 | |
| *** mdbooth has joined #openstack-nova | 08:20 | |
| *** shilpasd has joined #openstack-nova | 08:21 | |
| *** sorrison has joined #openstack-nova | 08:21 | |
| *** takamatsu has joined #openstack-nova | 08:21 | |
| *** tkajinam has quit IRC | 08:23 | |
| *** lpetrut has joined #openstack-nova | 08:24 | |
| *** dtantsur|afk is now known as dtantsur | 08:28 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add delete_on_termination to volume-attach API https://review.opendev.org/673133 | 08:31 |
| *** gibi has quit IRC | 08:33 | |
| *** gibi has joined #openstack-nova | 08:33 | |
| *** markvoelker has joined #openstack-nova | 08:37 | |
| *** ralonsoh has joined #openstack-nova | 08:39 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Specify availability_zone to unshelve https://review.opendev.org/663851 | 08:40 |
| *** pvradu has joined #openstack-nova | 08:41 | |
| *** markvoelker has quit IRC | 08:45 | |
| shilpasd | gibi: thanks for reviewing patches for 'isolate aggregates', will fix small nits | 08:49 |
| gibi | shilpasd: I'm moving forward on that series right now, so you can expect more votes from me | 08:50 |
| shilpasd | gibit: thanks | 08:51 |
| *** tetsuro has quit IRC | 08:53 | |
| *** tetsuro has joined #openstack-nova | 08:53 | |
| *** rcernin has quit IRC | 08:54 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add user_id and project_id colume to Migration https://review.opendev.org/673990 | 08:58 |
| *** takamatsu has quit IRC | 09:08 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | 09:26 |
| *** tetsuro has quit IRC | 09:27 | |
| *** takashin has left #openstack-nova | 09:30 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add user_id and project_id colume to Migration https://review.opendev.org/673990 | 09:31 |
| *** mdbooth has quit IRC | 09:32 | |
| *** mdbooth has joined #openstack-nova | 09:37 | |
| *** tetsuro has joined #openstack-nova | 09:37 | |
| shilpasd | gibi: https://review.opendev.org/#/c/671074/8/nova/objects/aggregate.py@472, we are accepting ignored_keys as [], to make function generalized, So based on 'value' one can get list of aggregates by using this function. | 09:43 |
| gibi | shilpasd: do we call the function with such generalized parameters? or do you have a plan short term to add such a call? | 09:44 |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add delete_on_termination to volume-attach API https://review.opendev.org/673133 | 09:45 |
| shilpasd | gibi: no any plan as such, ok, will address this comment, tnx | 09:47 |
| gibi | shilpasd: I suggest not to add complexity that will not be used right now. If we figure out that we need a more generic call then we can make the necessary changes in the function any time | 09:47 |
| shilpasd | gibi: sure Gibi, will work on review comments | 09:49 |
| gibi | shilpasd: thanks | 09:49 |
| aspiers | alex_xu: I think we need to talk to efried about https://review.opendev.org/#/c/664420/42/nova/scheduler/request_filter.py@206 and https://review.opendev.org/#/c/664420/42/nova/virt/hardware.py@1225 | 09:50 |
| aspiers | alex_xu: oh, you already said that | 09:50 |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption https://review.opendev.org/664420 | 09:51 |
| *** mdbooth has quit IRC | 10:04 | |
| *** mdbooth has joined #openstack-nova | 10:04 | |
| *** bhagyashris has quit IRC | 10:12 | |
| *** ociuhandu has joined #openstack-nova | 10:13 | |
| *** tetsuro has quit IRC | 10:14 | |
| stephenfin | dansmith: Could I get your thoughts on https://review.opendev.org/#/c/537414/ today? I think it's sane, but maybe there's something I've missed or should be doing in addition | 10:28 |
| stephenfin | alex_xu: Fancy hitting these trivial changes? https://review.opendev.org/#/c/671791/ https://review.opendev.org/#/c/675570/ | 10:28 |
| stephenfin | #success nova no longer needs rootwrap (well, except for starting privsep daemons and os-brick, for some strange reason) | 10:33 |
| openstackstatus | stephenfin: Added success to Success page (https://wiki.openstack.org/wiki/Successes) | 10:33 |
| *** shilpasd has quit IRC | 10:35 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Address nits from privsep series https://review.opendev.org/677210 | 10:37 |
| *** bbowen has quit IRC | 10:39 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Add delete_on_termination to volume-attach API https://review.opendev.org/673133 | 10:40 |
| *** markvoelker has joined #openstack-nova | 10:40 | |
| *** mdbooth has quit IRC | 10:45 | |
| *** markvoelker has quit IRC | 10:45 | |
| *** mkrai has quit IRC | 10:47 | |
| *** mkrai_ has joined #openstack-nova | 10:47 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Recalculate 'RequestSpec.numa_topology' on resize https://review.opendev.org/662522 | 10:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Update docstring of 'revert_resize' function https://review.opendev.org/665976 | 10:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Cleanup of '_test_resize' helper test https://review.opendev.org/664245 | 10:50 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Add '_setup_compute_services' helper https://review.opendev.org/663102 | 10:50 |
| *** takamatsu has joined #openstack-nova | 10:55 | |
| sean-k-mooney | efried: o/ i have a process question for you. when can we submit blueprints/specs for approval for Ussuri. i think its normally after m3 but you mentions posible targeting stuff to U early a week or two back | 10:58 |
| *** mkrai_ has quit IRC | 10:59 | |
| sean-k-mooney | from a downstream persective we will normally only consider a feature bacport if said feature is merged on master, and we will only commit to trying to backport it if the feature is approved and the design allows it to be | 11:00 |
| sean-k-mooney | the context is i have a customer asking when we will know if we can backport https://review.opendev.org/#/c/674072/ and currenly we have said october/november but just trying to figure out if we can let them know before then. | 11:01 |
| openstackgerrit | sahid proposed openstack/nova master: cellv2: fix update_cell to support cell0 https://review.opendev.org/672045 | 11:01 |
| alex_xu | aspiers: yea, that is really strange | 11:03 |
| alex_xu | stephenfin: yea, checking | 11:03 |
| *** tesseract has joined #openstack-nova | 11:07 | |
| *** ash2307 has joined #openstack-nova | 11:09 | |
| *** markvoelker has joined #openstack-nova | 11:10 | |
| alex_xu | stephenfin: done | 11:11 |
| stephenfin | alex_xu: Thanks :) | 11:12 |
| alex_xu | np | 11:12 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Move DB dependencies to 'extras' https://review.opendev.org/677475 | 11:13 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: setup.cfg: Cleanup https://review.opendev.org/677969 | 11:13 |
| *** jamesdenton has joined #openstack-nova | 11:14 | |
| *** udesale has quit IRC | 11:14 | |
| *** markvoelker has quit IRC | 11:15 | |
| aspiers | alex_xu: sorry, what's strange? | 11:17 |
| stephenfin | alex_xu: There's one more non-functional change here actually, if you have time https://review.opendev.org/#/c/672336/ :) | 11:18 |
| *** tbachman has quit IRC | 11:20 | |
| *** takamatsu has quit IRC | 11:25 | |
| *** shilpasd has joined #openstack-nova | 11:35 | |
| *** aojea has quit IRC | 11:36 | |
| *** ash2307 has quit IRC | 11:37 | |
| *** ash2307 has joined #openstack-nova | 11:38 | |
| *** bbowen has joined #openstack-nova | 11:38 | |
| *** markvoelker has joined #openstack-nova | 11:40 | |
| *** tbachman has joined #openstack-nova | 11:41 | |
| *** markvoelker has quit IRC | 11:45 | |
| *** takamatsu has joined #openstack-nova | 11:45 | |
| *** ociuhandu has quit IRC | 11:53 | |
| *** markvoelker has joined #openstack-nova | 11:54 | |
| *** jangutter_ is now known as jangutter | 12:02 | |
| *** larainema has quit IRC | 12:07 | |
| shilpasd | gibi: hi | 12:12 |
| gibi | shilpasd: hi | 12:12 |
| shilpasd | gibi: if we don't have traits sets either on flavor or image, then we should skip this filter, since https://review.opendev.org/#/c/667952/18/nova/tests/functional/test_aggregates.py@516 is failing if raise ValueError if ignored_keys is empty | 12:13 |
| shilpasd | IMO, we should return false at https://review.opendev.org/#/c/671075/9/nova/scheduler/request_filter.py@79, if keys is empty | 12:15 |
| openstackgerrit | Merged openstack/nova master: FUP for I5576fa2a67d2771614266022428b4a95487ab6d5 https://review.opendev.org/677769 | 12:15 |
| shilpasd | gibi: please confirm | 12:15 |
| shilpasd | IMO we should skip filter if keys are empty | 12:17 |
| gibi | shilpasd: if there is no traits in image or in flavor we still want to prevent the instance to land in an aggregate that needs to be isolated. isn't it? | 12:17 |
| *** belmoreira has joined #openstack-nova | 12:18 | |
| gibi | shilpasd: it is how I understand the spec https://review.opendev.org/#/c/609960/8/specs/train/approved/placement-req-filter-forbidden-aggregates.rst@20 | 12:19 |
| shilpasd | gibi: yes | 12:19 |
| gibi | so if the keys are empty then we have to forbid every aggregates that has some kind of metadata set | 12:19 |
| shilpasd | so we shouldn't raise ValueError in DB for ignored_keys empty | 12:20 |
| shilpasd | https://review.opendev.org/#/c/671074/8/nova/objects/aggregate.py@472 | 12:21 |
| *** ratailor has quit IRC | 12:21 | |
| gibi | shilpasd: you are correct. so if there is no ignored_keys then we have to return every aggregate that has metadata.value set to "required" | 12:22 |
| gibi | shilpasd: so my comment is wrong in https://review.opendev.org/#/c/671074/8/nova/objects/aggregate.py@472 | 12:23 |
| shilpasd | gibi: ok, will skip this | 12:23 |
| *** ociuhandu has joined #openstack-nova | 12:24 | |
| *** takashin has joined #openstack-nova | 12:24 | |
| gibi | shilpasd: I guess i mixed up ignored_keys and key_prefix. See https://review.opendev.org/#/c/671074/8/nova/objects/aggregate.py@473 | 12:25 |
| shilpasd | gibi: no prob, tnx for discussion | 12:26 |
| gibi | shilpasd: thanks for double checking my comment | 12:26 |
| *** adriant has quit IRC | 12:26 | |
| shilpasd | will have ValueError at beginning only for key_prefix | 12:26 |
| *** adriant has joined #openstack-nova | 12:27 | |
| gibi | shilpasd: ack | 12:27 |
| shilpasd | thank you | 12:27 |
| *** nweinber has joined #openstack-nova | 12:29 | |
| *** mdbooth has joined #openstack-nova | 12:29 | |
| *** mmethot has quit IRC | 12:31 | |
| *** donnyd has joined #openstack-nova | 12:32 | |
| *** ociuhandu has quit IRC | 12:33 | |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported https://review.opendev.org/638680 | 12:54 |
| *** nweinber_ has joined #openstack-nova | 12:56 | |
| aspiers | stephenfin: thanks for your recheck on https://review.opendev.org/#/c/673151/16 - but any idea why it's rerunning the check jobs not the gate jobs? | 12:58 |
| *** nweinber has quit IRC | 12:58 | |
| stephenfin | aspiers: no idea. That's just the way it's always done it. It's a zuul thing, I imagine | 12:59 |
| aspiers | Oh, I thought that once it hit the gate, recheck would only redo the gate jobs | 12:59 |
| aspiers | Thought I'd seen that behaviour before | 12:59 |
| *** jmlowe has quit IRC | 12:59 | |
| aspiers | Seems kinda pointless to rerun the check jobs when nothing has changed there | 12:59 |
| aspiers | Oh well, check is almost finished, gate soon | 13:00 |
| openstackgerrit | Merged openstack/nova master: Make memtune parameters consistent with libvirt docs and code https://review.opendev.org/636301 | 13:10 |
| openstackgerrit | Merged openstack/nova master: fakelibvirt: Stop distinguishing between NUMA, non-NUMA https://review.opendev.org/675570 | 13:10 |
| belmoreira | melwitt I'm upgrading nova to stein and i'm having issues with novnc | 13:11 |
| belmoreira | as part of the consoleauth deprecation where are the tokens stored? | 13:13 |
| openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Nova object changes for forbidden aggregates request filter https://review.opendev.org/671072 | 13:13 |
| *** tbachman has quit IRC | 13:16 | |
| *** gbarros has joined #openstack-nova | 13:16 | |
| *** ociuhandu has joined #openstack-nova | 13:17 | |
| *** tbachman has joined #openstack-nova | 13:18 | |
| *** ociuhandu has quit IRC | 13:19 | |
| *** BjoernT has joined #openstack-nova | 13:19 | |
| *** ociuhandu has joined #openstack-nova | 13:20 | |
| *** mriedem has joined #openstack-nova | 13:21 | |
| *** ociuhandu has quit IRC | 13:21 | |
| *** ociuhandu has joined #openstack-nova | 13:22 | |
| openstackgerrit | Shilpa Devharakar proposed openstack/nova master: DB API changes to get non-matching aggregates from metadata https://review.opendev.org/671074 | 13:22 |
| *** ash2307 has quit IRC | 13:22 | |
| openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Add a new request filter to isolate aggregates https://review.opendev.org/671075 | 13:24 |
| *** ash2307 has joined #openstack-nova | 13:26 | |
| *** jmlowe has joined #openstack-nova | 13:26 | |
| *** ociuhandu has quit IRC | 13:27 | |
| openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Enable request filter isolate_aggregates https://review.opendev.org/667952 | 13:27 |
| *** ociuhandu has joined #openstack-nova | 13:27 | |
| *** belmoreira has quit IRC | 13:28 | |
| *** bnemec has joined #openstack-nova | 13:29 | |
| *** belmoreira has joined #openstack-nova | 13:30 | |
| belmoreira | I would really appreciate some help with vnc | 13:32 |
| belmoreira | when using workarounds/enable_consoleauth=true we don't keep the previous behaviour? | 13:32 |
| belmoreira | tokens are now stored in the cell db. | 13:33 |
| *** BjoernT_ has joined #openstack-nova | 13:33 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Update docstring of 'revert_resize' function https://review.opendev.org/665976 | 13:33 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Recalculate 'RequestSpec.numa_topology' on resize https://review.opendev.org/662522 | 13:33 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Cleanup of '_test_resize' helper test https://review.opendev.org/664245 | 13:33 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Add '_setup_compute_services' helper https://review.opendev.org/663102 | 13:33 |
| belmoreira | the was I'm running novnc is global, so is not connecting to the db to check the token | 13:33 |
| belmoreira | s/was/way | 13:34 |
| adrianc | stephenfin, sean-k-mooney : do we have a verdict on: https://review.opendev.org/#/c/675776/ ? | 13:34 |
| *** BjoernT has quit IRC | 13:34 | |
| sean-k-mooney | we could revert it and not that this is need due to a bug in the sriov nic agent | 13:35 |
| stephenfin | belmoreira: melwitt will hopefully correct me if I say anything wrong, but '[workarounds] enable_consoleauth' enables a fallback path to help with migration to the new DB-based system | 13:36 |
| *** ociuhandu has quit IRC | 13:36 | |
| sean-k-mooney | there is nolonger a need to set the mac for libvirt but it valid to still set it untill the sriov nic agent is updated. it is a bug that the agent depens on the mack however | 13:36 |
| stephenfin | Emphasis on fallback. We'll use the DB tokens first and foremost and only fallback if no tokens are found | 13:37 |
| *** ociuhandu has joined #openstack-nova | 13:37 | |
| adrianc | "a historic design decision" :) | 13:37 |
| belmoreira | stephenfin I'm trying to use that without success. | 13:37 |
| sean-k-mooney | adrianc: the historic design descis being the only thing that was allowed to be depeded on is the pci address :) | 13:38 |
| sean-k-mooney | at somepoint i guess neutron forgot that | 13:38 |
| *** ociuhandu has quit IRC | 13:39 | |
| sean-k-mooney | the sriov nic agent is in principal ment to be able to work with non libvirt virt drivers too | 13:39 |
| belmoreira | stephenfin token validation fails | 13:39 |
| *** lbragstad has left #openstack-nova | 13:39 | |
| *** ociuhandu has joined #openstack-nova | 13:40 | |
| sean-k-mooney | like xen or powervm although i dont know if it is used with either | 13:40 |
| yonglihe | sean-k-mooney: thanks given your valuable +1 for https://review.opendev.org/#/c/621476/ | 13:40 |
| stephenfin | belmoreira: Odd. I'm looking at commit 969239029d4a13956747e6e0b850d6c6ab4035f0 rn to see what could possibly be going wrong | 13:40 |
| stephenfin | belmoreira: Dumb question, but you have this option set on the conf files used by the 'nova-novncproxy' service, right? | 13:41 |
| belmoreira | stephenfin yes | 13:41 |
| stephenfin | Cool. Just checking :) | 13:41 |
| sean-k-mooney | stephenfin: feel like sending https://review.opendev.org/#/c/621476/ on its way and closing out that blueprint | 13:42 |
| stephenfin | I'd been holding off on that because I still wasn't sure how I feel about that whole thing, heh | 13:42 |
| stephenfin | But yeah. Let me finish looking into this consoleauth thing first though | 13:43 |
| *** tbachman has quit IRC | 13:43 | |
| sean-k-mooney | ok if you have time to add it to your review queue then its an easy win assumeing you decide how you feel about it | 13:43 |
| adrianc | sean-k-mooney: ill open a bug in neutron, once the revert is in ill abandon https://review.opendev.org/#/c/676713 | 13:43 |
| sean-k-mooney | adrianc: why abandon that? it would be good to open the bug first and update the comment to reference the new bug | 13:44 |
| sean-k-mooney | oh because it still depens on the mac | 13:44 |
| sean-k-mooney | jsut looks at a different source | 13:44 |
| adrianc | yah, we talked that changes will be required from server side | 13:45 |
| adrianc | i.e the mechanism driver | 13:45 |
| *** priteau has quit IRC | 13:45 | |
| *** mmethot has joined #openstack-nova | 13:46 | |
| *** ociuhandu has quit IRC | 13:46 | |
| stephenfin | belmoreira: Have you tracebook to look at? There are a couple of InvalidToken exceptions that could be raised in that code | 13:46 |
| stephenfin | *trackback | 13:46 |
| stephenfin | *traceback | 13:46 |
| stephenfin | third time lucky | 13:46 |
| *** tbachman has joined #openstack-nova | 13:46 | |
| *** altlogbot_1 has joined #openstack-nova | 13:47 | |
| openstackgerrit | Alexandre arents proposed openstack/nova master: Abort live-migration during instance_init https://review.opendev.org/678016 | 13:48 |
| *** altlogbot_1 has quit IRC | 13:48 | |
| stephenfin | I can't see anything obvious there, though I was wrong with my statement about it being a fallback. If that's toggled, we check the consoleauth service first, not after | 13:48 |
| belmoreira | stephenfin: from consoleauth: Checking Token: ***, False | 13:51 |
| shilpasd | gibi: Hi, i have pushed revised patches (waiting for zuul) but i have lost your +2s, requesting you to review/vote further, thanks | 13:52 |
| *** altlogbot_2 has joined #openstack-nova | 13:52 | |
| shilpasd | Addressed your review comments and uploaded patches for isolated aggregates patches. | 13:53 |
| belmoreira | stephenfin: from nova-novncproxy: https://www.codepile.net/pile/O1P8ee1q | 13:54 |
| stephenfin | belmoreira: Should I see something there? | 13:54 |
| *** igordc has joined #openstack-nova | 13:55 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Update docstring of 'revert_resize' function https://review.opendev.org/665976 | 13:55 |
| belmoreira | stephenfin: the way that is deployed is global. nova-novncproxy and consoleauth are not deployed per cell | 13:56 |
| *** Sundar has joined #openstack-nova | 13:57 | |
| stephenfin | Oh, that could be problematic | 13:57 |
| belmoreira | stephenfin: that is the trace that I get. the "code 404, message File not found" is new to me | 13:58 |
| *** davee_ has joined #openstack-nova | 13:59 | |
| efried | nova meeting now | 14:00 |
| Sundar | dansmith, sean-k-mooney, mriedem, gibi: Can you please review https://review.opendev.org/#/q/status:open+project:openstack/nova+bp/nova-cyborg-interaction ? I have added the notification and addressed the main comments. Will add more UT, tempest CI framework is making progress. | 14:00 |
| Sundar | Well, all are welcome to review. | 14:00 |
| stephenfin | belmoreira: I think you're going to need to open a bug for this. I don't know if this has been discussed as an issue before (I don't recall it having been so) | 14:00 |
| efried | sean-k-mooney: We were going to wait until the name was official to start creating the artifacts in lp and nova-specs. If you have a spec you want to open right now, you can write it against backlog/ and then move it. | 14:01 |
| sean-k-mooney | Sundar what os are you deveoping on? i can try and deploy the series in a vm | 14:01 |
| efried | alex_xu, sean-k-mooney, aspiers: request filter stuff after the meeting? | 14:01 |
| *** davee_ has quit IRC | 14:01 | |
| alex_xu | efried: yea | 14:01 |
| sean-k-mooney | it will be next week before i can spend a lot of time on ith however | 14:02 |
| belmoreira | stephenfin ok thanks | 14:02 |
| sean-k-mooney | efried: ya i can do that. its going to be really short anyway | 14:02 |
| *** hemna has joined #openstack-nova | 14:02 | |
| *** davee_ has joined #openstack-nova | 14:02 | |
| sean-k-mooney | efried: stephenfin and i have an internal team meeting after the nova meeting but we will be still on irc | 14:03 |
| Sundar | sean-k-mooney: It is Centos 7.6, kernel 3.10.0-957 | 14:03 |
| Sundar | Thanks | 14:03 |
| sean-k-mooney | Sundar: im assuming you testing with python 2 still? or python 3 | 14:03 |
| Sundar | Yes, python 2 | 14:04 |
| sean-k-mooney | ok i have been having issue with centos and python2 lately but ill spin up a vm and try and deploy it | 14:04 |
| belmoreira | stephenfin is there any recommendation how to setup nonvc with multiple cells? | 14:04 |
| aspiers | efried: sure | 14:04 |
| dansmith | belmoreira: I think you really want to talk to melwitt | 14:05 |
| sean-k-mooney | the fake driver merged in cyborg right so i should be able to test with that | 14:05 |
| belmoreira | stephenfin I'm thinking how this should work now. We will need to have nova-novncproxy available per cell. This means that the vnc url that I will get will include the cell controller. Is this correct? | 14:05 |
| *** jawad_axd has quit IRC | 14:05 | |
| *** jawad_axd has joined #openstack-nova | 14:06 | |
| Sundar | sean-k-mooney: Yes, the fake driver has merged. Please deploy https://review.opendev.org/#/q/project:openstack/cyborg+branch:master+topic:nova-integ+status:open . The part where Cyborg reports to Placement, https://review.opendev.org/#/c/659233/, is also WIP. But the combination works today with some massaging. We will sort out the wrinkles before | 14:08 |
| Sundar | merging these patches. | 14:08 |
| stephenfin | belmoreira: I really don't know, I'm afraid :( melwitt is your person | 14:08 |
| belmoreira | dansmith stephenfin thanks, will try to talk with melwitt | 14:09 |
| stephenfin | I know you'll need a service per cell, yes, but how that will look I'm not sure | 14:09 |
| stephenfin | https://github.com/openstack/devstack/blob/master/lib/nova#L947-L973 | 14:09 |
| *** jawad_axd has quit IRC | 14:10 | |
| *** spsurya has joined #openstack-nova | 14:10 | |
| *** janki has quit IRC | 14:11 | |
| *** hemna has quit IRC | 14:12 | |
| *** nweinber_ has quit IRC | 14:13 | |
| *** Sundar has quit IRC | 14:15 | |
| *** ociuhandu has joined #openstack-nova | 14:16 | |
| openstackgerrit | Adrian Chiris proposed openstack/nova master: Revert "vif: Resolve a TODO and update another" https://review.opendev.org/675776 | 14:17 |
| *** nweinber_ has joined #openstack-nova | 14:17 | |
| *** ociuhandu has quit IRC | 14:19 | |
| *** ociuhandu has joined #openstack-nova | 14:19 | |
| *** eharney has joined #openstack-nova | 14:20 | |
| *** tbachman has quit IRC | 14:22 | |
| *** tbachman has joined #openstack-nova | 14:23 | |
| *** ash2307 has quit IRC | 14:27 | |
| *** Sundar has joined #openstack-nova | 14:27 | |
| *** Sundar has quit IRC | 14:28 | |
| *** ash2307 has joined #openstack-nova | 14:28 | |
| mriedem | dtantsur: TheJulia: did you find out if https://review.opendev.org/#/q/topic:bug/1839560+branch:stable/stein fixed your grenade issue with rebalancing? | 14:30 |
| TheJulia | mriedem: upon issuing a change on master branch, zuul immediately comes back and says there is a branch merge failure with dependencies of a dependent patch on stable/stein | 14:32 |
| TheJulia | It used to work, but... I guess not anymore. | 14:32 |
| aspiers | sean-k-mooney: recheck is apparently not working for https://review.opendev.org/#/c/666915/ | 14:33 |
| stephenfin | yonglihe, sean-k-mooney: Think there's a bug with that NUMA API change | 14:34 |
| stephenfin | comments left | 14:34 |
| sean-k-mooney | it hit a post failure again or there was a zuul restart and it got droped im guess | 14:35 |
| stephenfin | tl;dr: I'd kill the summary view entirely. I don't think it's possible for it to be reliable | 14:35 |
| sean-k-mooney | stephenfin: ya just read good cache on the mutable data in kwargs | 14:35 |
| sean-k-mooney | stephenfin: i though we had a hacking check for that | 14:35 |
| yonglihe | stephenfin: post me a comment, i gonna fix it soon. and you got new update next day. thanks. | 14:35 |
| stephenfin | yonglihe: Cool. Thanks :) | 14:35 |
| *** gbarros has quit IRC | 14:38 | |
| yonglihe | stephenfin: for most important of -1, it's we should drop instance.vcpu_model, right? | 14:39 |
| stephenfin | yonglihe: In a meeting. Give me 10 | 14:39 |
| yonglihe | sure. | 14:39 |
| *** hemna has joined #openstack-nova | 14:43 | |
| *** jhesketh has quit IRC | 14:44 | |
| *** cfriesen has quit IRC | 14:44 | |
| *** jaosorior has quit IRC | 14:44 | |
| *** nweinber__ has joined #openstack-nova | 14:45 | |
| *** jhesketh has joined #openstack-nova | 14:45 | |
| stephenfin | yonglihe: to be honest, I'd personally like to drop the 'cpu_topology' element [1] from the response [1] https://review.opendev.org/#/c/621476/57/doc/api_samples/os-server-topology/v2.77/servers-topology-resp-user.json@2 | 14:46 |
| stephenfin | so we'd just include the 'nodes' element | 14:46 |
| stephenfin | yonglihe: The reason being asymmetric topologies, which we support | 14:47 |
| stephenfin | I can do this: | 14:47 |
| yonglihe | Ok, got your concern. That's seems very right thing to do. | 14:48 |
| stephenfin | openstack flavor create --vcpus 3 --ram 768 --disk 20 test.asymmetric | 14:48 |
| *** nweinber_ has quit IRC | 14:48 | |
| *** ash2307 has left #openstack-nova | 14:48 | |
| yonglihe | I know that stuff, but it slipped away while wrote spec -:). | 14:49 |
| stephenfin | openstack flavor set test.asymmetric --property 'hw:numa_nodes=2' --property 'hw:numa_cpus.0=0' --property 'hw:numa_cpus.0=1,2' --property 'hw:numa_mem.0=256' --property 'hw:numa_mem.1=512' | 14:49 |
| stephenfin | Okay, sweet :) | 14:49 |
| *** mdbooth has quit IRC | 14:50 | |
| stephenfin | Also, I wonder if we should rename 'vcpu_set' to 'cpus' ? | 14:50 |
| yonglihe | I bet alex_xu also buy in this solution. | 14:50 |
| stephenfin | The reason being that we're overloading the term vcpu now with the cpu-resources work | 14:50 |
| stephenfin | and it's also not a set | 14:50 |
| yonglihe | cpus seems enough, | 14:50 |
| stephenfin | Cool cool | 14:50 |
| yonglihe | it's list? | 14:51 |
| stephenfin | In your response, yeah | 14:51 |
| yonglihe | i wonder the does json had a set? | 14:51 |
| stephenfin | I don't know if JSON supports sets or similar | 14:51 |
| stephenfin | jinx | 14:51 |
| stephenfin | I don't think we need it | 14:51 |
| stephenfin | Even if it did | 14:51 |
| stephenfin | Since this is read-only | 14:51 |
| stephenfin | sean-k-mooney: You happy with all that ^ RE: https://review.opendev.org/#/c/621476/ | 14:52 |
| yonglihe | jinx? what's that, i'm lost here. | 14:52 |
| *** mdbooth has joined #openstack-nova | 14:52 | |
| stephenfin | yonglihe: people say "jinx" when two people say the same thing at the same time | 14:52 |
| sean-k-mooney | reading back | 14:53 |
| yonglihe | -:0) new to me . thanks. | 14:53 |
| sean-k-mooney | you have a typo | 14:53 |
| stephenfin | Urban Dictionary is a rarely a good resource but here you go, heh https://www.urbandictionary.com/define.php?term=Jinx | 14:53 |
| sean-k-mooney | openstack flavor set test.asymmetric --property 'hw:numa_nodes=2' --property 'hw:numa_cpus.0=0' --property 'hw:numa_cpus.1=1,2' --property 'hw:numa_mem.0=256' --property 'hw:numa_mem.1=512' | 14:53 |
| *** tbachman has quit IRC | 14:53 | |
| mdbooth | stephenfin: I'd assumed that was a British thing? | 14:54 |
| *** ash2307 has joined #openstack-nova | 14:54 | |
| mdbooth | stephenfin: Although you are part Essex boy, of course | 14:54 |
| *** artom has joined #openstack-nova | 14:54 | |
| stephenfin | sean-k-mooney: Oops, yeah. Generally though, do those comments make sense | 14:55 |
| sean-k-mooney | mdbooth: jinx is a thing in ireland too | 14:55 |
| mdbooth | mriedem dansmith: https://review.opendev.org/#/c/677736/ Do those unit tests look better? Dropped the libvirt dep. | 14:55 |
| stephenfin | mdbooth: Definitely an Irish thing too, I assure you | 14:55 |
| sean-k-mooney | stephenfin: i have not read all the comments in the review but i will | 14:55 |
| *** takamatsu has quit IRC | 14:55 | |
| mdbooth | stephenfin: Perhaps it's a general anglophone thing, too | 14:55 |
| stephenfin | though the variant I knew growing up involved not speaking 'til you were freed from the jinx :-\ | 14:56 |
| mdbooth | stephenfin: Yep, that's the one I remember | 14:56 |
| sean-k-mooney | stephenfin: and being punched in the sholder if you did | 14:56 |
| stephenfin | yuuuup | 14:56 |
| *** ash2307 has left #openstack-nova | 14:56 | |
| mdbooth | yonglihe: It's a cultural rabbit hole :) | 14:56 |
| dansmith | mdbooth: just using fakelibvirt but otherwise the same? yes :) | 14:56 |
| mdbooth | dansmith: Yarp. I had to add some additional fakeness to fakelibvirt | 14:57 |
| mdbooth | But not a lot | 14:57 |
| dansmith | aye | 14:57 |
| mdbooth | dansmith: I've given the customer a test build, so hopefully we'll get some feedback on whether it addresses the real issue. | 14:58 |
| alex_xu | stephenfin: yonglihe still checking that whether we will have empty sockets https://github.com/openstack/nova/blob/f9ba1192c4/nova/virt/libvirt/driver.py#L5219 | 14:58 |
| dansmith | mdbooth: cool | 14:58 |
| stephenfin | alex_xu: Yeah, that branch could be invalid (it wouldn't be the first time). Just as importantly though, what does that do for the asymmetric topology case? | 14:59 |
| *** mlavalle has joined #openstack-nova | 15:00 | |
| alex_xu | stephenfin: whether drop the cpu_topology field probably a decision for yonglihe, I remember lasttime talk with sean-k-mooney, we said if he want the cpu_topology, then it must be a field out of nova cell | 15:00 |
| yonglihe | alex_xu, stephenfin, sean-k-mooney: drop it seems safe enough. | 15:01 |
| alex_xu | stephenfin: I think instance.vcpu_model is for the whole machine, doesn't related to numa | 15:01 |
| alex_xu | okay | 15:01 |
| sean-k-mooney | yes it is for the whole vm | 15:01 |
| sean-k-mooney | it not related to numa | 15:02 |
| sean-k-mooney | you can have cpu_sockets=1 and numa_nodes=2 or cpu_sockets=2 and numa_nodes=1 | 15:02 |
| *** munimeha1 has joined #openstack-nova | 15:02 | |
| *** gbarros has joined #openstack-nova | 15:03 | |
| sean-k-mooney | if you use the numa_cpu.X=y syntax you can even make it more disjoint | 15:03 |
| yonglihe | if it for whole VM , does it related to asyc cpu number? how it going to behavior under such configurations? | 15:03 |
| yonglihe | openstack flavor set test.asymmetric --property 'hw:numa_nodes=2' --property 'hw:numa_cpus.0=0' --property 'hw:numa_cpus.1=1,2' --property 'hw:numa_mem.0=256' --property 'hw:numa_mem.1=512' | 15:03 |
| sean-k-mooney | none of those option affect eh cpu toployg at all | 15:04 |
| sean-k-mooney | it change what memory contolr the cpu is mapped too | 15:04 |
| alex_xu | sean-k-mooney: and the numa can across a socket, right? | 15:04 |
| sean-k-mooney | the coup toplogy is contoled by hw:cpu_sockets, hw:cpu_threads and hw:cpu_cores | 15:04 |
| sean-k-mooney | yep | 15:04 |
| sean-k-mooney | or you can have multple numa node ins the same socket | 15:05 |
| sean-k-mooney | they are treated entirely seperatly | 15:05 |
| alex_xu | yea, so numa is totally a logic partition for the cpu | 15:05 |
| alex_xu | and memory | 15:05 |
| *** jmlowe has quit IRC | 15:05 | |
| sean-k-mooney | you can technical configure a 2 core vm where differente hyperthreas are in different numa nodes if you want too | 15:05 |
| *** takashin has left #openstack-nova | 15:07 | |
| alex_xu | nice | 15:07 |
| yonglihe | sure, so expose cpu_topology is not related to asyc cpu. | 15:07 |
| *** jmlowe has joined #openstack-nova | 15:07 | |
| alex_xu | sean-k-mooney: but stephenfin point out https://github.com/openstack/nova/blob/f9ba1192c4/nova/virt/libvirt/driver.py#L5219, the vcpu_topology may empty | 15:08 |
| alex_xu | I just doesn't figure out what case we will have yet | 15:08 |
| sean-k-mooney | sure it will be empty unless you use teh hw:cpu_* extrapecs | 15:08 |
| sean-k-mooney | so we need to not just check the vcpu_model but allso all of the sub fields to see if they are set | 15:09 |
| alex_xu | oh, I thought we will have a default one | 15:09 |
| sean-k-mooney | the default is virt driver speficic | 15:09 |
| sean-k-mooney | so unless the virt driver populated it in the instance no | 15:10 |
| sean-k-mooney | if it does we might | 15:10 |
| melwitt | belmoreira: hi, as of rocky, console proxies need to be deployed per cell https://docs.openstack.org/nova/stein/user/cellsv2-layout.html#consoleauth-service-and-console-proxies and then if you need to keep consoles working during a live upgrade, set [workarounds]enable_consoleauth = True to enable nova-consoleauth to be a fall back https://docs.openstack.org/releasenotes/nova/stein.html | 15:12 |
| efried | alex_xu, sean-k-mooney, aspiers: so what's up with this request_filters thing? | 15:12 |
| alex_xu | efried: I thought we always getting the info from extra spec, not put something back to extra spec https://review.opendev.org/#/c/664420/42/nova/scheduler/request_filter.py@206 | 15:13 |
| alex_xu | that feel strange | 15:13 |
| aspiers | alex_xu: did you see the eavesdrop discussions I linked to? | 15:14 |
| sean-k-mooney | alex_xu the reques filter do modify the tempory flavor | 15:14 |
| efried | yeah, it's an unfortunate temporary measure | 15:14 |
| alex_xu | aspiers: sorry, I didn't get a chance yet | 15:14 |
| efried | aspiers and I discussed at the PTG the longer road to restructuring the code so we wouldn't have to do that, we could just update the request spec (I think) | 15:15 |
| efried | but afaik aspiers hasn't rewritten all of that for us yet :P | 15:15 |
| aspiers | alex_xu: hw:mem_encryption=True is the extra spec visible to users/operators, but it needs to be translated into resources:MEM_ENCRYPTION_CONTEXT=1 behind the scenes just within the RequestSpec | 15:15 |
| aspiers | users/ops shouldn't have to know about the resource class | 15:16 |
| efried | ++ ^ this | 15:16 |
| alex_xu | yea, I see | 15:16 |
| efried | alex_xu: There's precedent in the other request filters, which I think aspiers pointed to. | 15:16 |
| sean-k-mooney | we do the same thing with request filters that add required/forbiding tratis | 15:16 |
| alex_xu | probably we can have request group obj in request spec, then it will be more beatiful | 15:16 |
| belmoreira | melwitt thanks. I'm reading more about this change | 15:16 |
| efried | yes alex_xu, that's the idea, but it's not simple to do. | 15:16 |
| efried | aspiers and I talked about it for like 2h on Saturday at the PTG. | 15:17 |
| alex_xu | ok, got it, seem that is already thing we agree on can do now | 15:17 |
| sean-k-mooney | yep we were not planning to use the request spec in train right | 15:17 |
| aspiers | I'd love the chance to improve things in the future, but it would be great if we don't have to block SEV for this | 15:17 |
| sean-k-mooney | that was for U | 15:17 |
| melwitt | belmoreira: k. let me know if you have questions. also, mnaser went through this same novnc "challenge" when he upgraded, so maybe he can help answer questions too | 15:17 |
| efried | sean-k-mooney: we were tentatively thinking it could happen in T, but at this point, yeah, we should probably punt. | 15:18 |
| *** ash2307 has joined #openstack-nova | 15:18 | |
| alex_xu | I won't block on that | 15:18 |
| mnaser | o/ | 15:18 |
| melwitt | belmoreira: from an operator perspective, I mean | 15:18 |
| aspiers | efried: having said all that, alex_xu's suggestion to put the translation into scheduler/utils.py sounded interesting | 15:18 |
| aspiers | but I don't know enough to understand how that relates to this discussion right now | 15:19 |
| sean-k-mooney | efried: we have a few new request filters this cycle. i think it makes sense to prot them all in U | 15:19 |
| efried | melwitt: Thank you for the fix around websockify. And stephenfin thanks for digging into the symbol alias business. I guess we're stuck supporting the dual-location business :( | 15:19 |
| efried | aspiers: where was that part? | 15:19 |
| sean-k-mooney | aspiers: we were moving away form that intentionally | 15:19 |
| aspiers | efried: let me find it | 15:19 |
| belmoreira | melwitt: workarounds/enable_consoleauth = True is only for the leftovers, right? becasue in stein the DB will be always used to store the token | 15:19 |
| *** macz has joined #openstack-nova | 15:20 | |
| sean-k-mooney | e.g. we do some traslation in utils but we disucess not doing that and using request filster intead | 15:20 |
| melwitt | mnaser: belmoreira just upgraded to stein and novnc started failing to work, console proxies are not yet deployed per cell. I'm thinking he needs to set [workarounds]enable_consoleauth = True during the live upgrade and then deploy proxies per cell and then after upgrade be able to turn [workarounds]enable_consoleauth = False | 15:20 |
| sean-k-mooney | aspiers: efried that said we do translate vcpu/ram/disk in the scheulder/utils | 15:20 |
| alex_xu | vpmem also need that, and stephenfin's standard cpu tracking need that also | 15:20 |
| aspiers | efried: https://review.opendev.org/#/c/664420/42/nova/scheduler/request_filter.py@206 | 15:20 |
| sean-k-mooney | alex_xu ya so stephenfin's change will do it in the sculder utils replace this https://github.com/openstack/nova/blob/master/nova/scheduler/utils.py#L432 | 15:22 |
| efried | aspiers: So is the suggestion to put the translation from hw_mem_enc extra spec to MEM_ENC_CTX resource class into the sched/utils from_request_spec (or from_extra_specs) method instead of the request filter? | 15:22 |
| belmoreira | melwitt, the main issue is because I'm running the novnc/console_auth globally (not per cell). And after the rocky->stein upgrade it can check tokens anymore (even when using [workarounds]enable_consoleauth=true) | 15:22 |
| sean-k-mooney | but in general im not sure we shoudl keep doing that | 15:22 |
| melwitt | belmoreira: right, for leftovers and also needed during the live upgrade to handle consoles while you're changing the deployment to deploy proxies per cell. once you have proxies per cell and upgrade complete, you can turn workarounds/enable_consoleauth = False and stop the nova-consoleauth service and stop having to deploy it | 15:22 |
| stephenfin | melwitt: I think belmoreira is saying that it's still not working with 'workarounds/enable_consoleauth = True' though | 15:23 |
| aspiers | efried: yes I think that's what alex_xu is suggesting | 15:23 |
| melwitt | belmoreira, stephenfin: hm, ok. thinking... | 15:24 |
| sean-k-mooney | aspiers: efried we could but i though we talked about this at the ptg and decied not to do that | 15:24 |
| alex_xu | I'm ok with both, just want to figure out what is the plan for T release since we have serveal patch will do the same thing | 15:24 |
| sean-k-mooney | i could be miss rememebring that | 15:24 |
| belmoreira | stephenfin, melwitt it doesn't work with workarounds/enable_consoleauth = True (with everything running stein) | 15:24 |
| aspiers | sean-k-mooney, alex_xu: what are the pros / cons? | 15:25 |
| melwitt | belmoreira: I guess... that does make sense after the TTL has expired for already existing tokens, if you have not deployed proxies per cell yet | 15:25 |
| melwitt | because new tokens are *not* stored in nova-consoleauth | 15:25 |
| melwitt | *new token auths | 15:26 |
| aspiers | both code paths run in the scheduler, right? | 15:26 |
| efried | aspiers, alex_xu: Perhaps after we've merged stephenfin's patch to consolidate all that request spec mess, we could refactor the various request filters to do that. (I would still want it modular so it's not a monolithic mass of conversions.) But for now, that from_request_spec/from_extra_specs code is a bloody mess and it would be pretty hard to work the logic into the right places. So for now I say leave it in the request filte | 15:26 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Get instances outside of update_available_resource lock https://review.opendev.org/677790 | 15:26 |
| alex_xu | efried: ok, got it | 15:26 |
| stephenfin | efried: Are you referring to https://review.opendev.org/#/c/674894/ ? | 15:26 |
| aspiers | efried: OK thanks | 15:26 |
| *** ivve has quit IRC | 15:27 | |
| aspiers | alex_xu: so that means https://review.opendev.org/#/c/664420/42 is ready for re-review | 15:27 |
| *** ash2307 has quit IRC | 15:27 | |
| efried | stephenfin: yes, that's the one. | 15:27 |
| belmoreira | melwitt right... is there any easy way to enable tokens in nova-consoleauth again? (I'm in the middle of a crisis here) | 15:27 |
| alex_xu | aspiers: yea | 15:27 |
| aspiers | alex_xu: oops sorry I mean https://review.opendev.org/#/c/664420/ previous link was an old PS | 15:28 |
| stephenfin | I think I could move that to the top of the list of approved patches if you want it now? I don't think it has a dependency on any of my other functional changes | 15:28 |
| efried | stephenfin: I wonder, is there a way it could be moved out/earlier?... jinx | 15:28 |
| stephenfin | coke! | 15:28 |
| aspiers | alex_xu, stephenfin: also I fixed the tiny bug in https://review.opendev.org/#/c/638680 | 15:28 |
| efried | stephenfin: as discussed above, we're not blocking on it, we're going to continue to do the logic in the request filter for now. So don't worry about it unless it's easy. | 15:28 |
| stephenfin | Sure. Let me try | 15:29 |
| *** ash2307 has joined #openstack-nova | 15:29 | |
| *** macz has quit IRC | 15:30 | |
| *** ash2307 has left #openstack-nova | 15:30 | |
| *** macz has joined #openstack-nova | 15:31 | |
| melwitt | belmoreira: hm, looking at the code, it should still work if you have workarounds/enable_consoleauth = True in stein. I see in nova/compute/api.py it still stores the token console auth in nova-consoleauth in addition to in the cell database. so I can't see why it wouldn't work yet | 15:32 |
| belmoreira | melwitt from the consoleauth I only get: Checking Token: ***, False | 15:33 |
| belmoreira | melwitt from nova-novncproxy: https://www.codepile.net/pile/O1P8ee1q | 15:34 |
| melwitt | belmoreira: did you set workarounds/enable_consoleauth = True on hosts where nova-api and nova-novncproxy runs? | 15:34 |
| stephenfin | belmoreira: Maybe it's just me, but I don't see anything in that codepile link | 15:35 |
| *** tbachman has joined #openstack-nova | 15:38 | |
| belmoreira | melwitt workarounds/enable_consoleauth it's also for the nova-api? I'm only running it in the vnc nodes | 15:38 |
| melwitt | belmoreira: you need it for nova-api to tell it to store token auth in nova-consoleauth service | 15:38 |
| melwitt | and you need it for nonvcproxy to tell it to look in nova-consoleauth to find token auths when validating | 15:39 |
| melwitt | so you need both | 15:39 |
| belmoreira | that will be easy to change. Let me do it | 15:39 |
| openstackgerrit | Merged openstack/nova master: Track libvirt host/domain capabilities for multiple machine types https://review.opendev.org/673151 | 15:41 |
| openstackgerrit | Merged openstack/nova master: Extract new base class for provider usage functional tests https://review.opendev.org/676964 | 15:41 |
| *** macz has quit IRC | 15:43 | |
| *** tbachman has quit IRC | 15:47 | |
| *** lpetrut has quit IRC | 15:48 | |
| *** tbachman has joined #openstack-nova | 15:49 | |
| *** dave-mccowan has joined #openstack-nova | 15:49 | |
| *** gyee has joined #openstack-nova | 15:50 | |
| efried | mriedem: clarkb suggested trying to repro the innodb thing with a post that copies database logs. | 15:53 |
| efried | I'm trying to hack up a patch to do that, but there's at least three things about it that I don't understand. | 15:53 |
| *** pvradu has quit IRC | 15:53 | |
| *** dave-mccowan has quit IRC | 15:55 | |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported https://review.opendev.org/638680 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: claims: Remove useless caching https://review.opendev.org/671791 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Rename exception argument https://review.opendev.org/671795 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'hardware.get_host_numa_usage_from_instance' https://review.opendev.org/671797 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'hardware.host_topology_and_format_from_host' https://review.opendev.org/671798 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'hardware.instance_topology_from_instance' https://review.opendev.org/671799 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Rework 'hardware.numa_usage_from_instances' https://review.opendev.org/672565 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Split NUMA object tests https://review.opendev.org/672336 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: scheduler: Flatten 'ResourceRequest.from_extra_specs', 'from_image_props' https://review.opendev.org/674894 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions https://review.opendev.org/537414 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option https://review.opendev.org/671792 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement https://review.opendev.org/671793 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available' https://review.opendev.org/672693 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell' https://review.opendev.org/674395 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs https://review.opendev.org/671800 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields' https://review.opendev.org/674103 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait https://review.opendev.org/675571 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'hw:cpu_policy', 'hw:mem_page_size' extra specs from API samples https://review.opendev.org/675338 | 15:56 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta https://review.opendev.org/671801 | 15:56 |
| stephenfin | efried: Yeah, trivial to rebase | 15:57 |
| efried | nice, thanks stephenfin | 15:57 |
| * stephenfin goes to re-learn how to do online migrations | 15:57 | |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection https://review.opendev.org/636334 | 15:57 |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py https://review.opendev.org/636318 | 15:57 |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Apply SEV-specific guest config when SEV is required https://review.opendev.org/644565 | 15:58 |
| openstackgerrit | Adam Spiers proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption https://review.opendev.org/666616 | 15:58 |
| *** jmlowe has quit IRC | 15:59 | |
| efried | mriedem: Any idea what this [1] would look like if I wanted to copy "the database logs" ? | 16:00 |
| efried | [1] https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/playbooks/infra-puppet-apply/post.yaml | 16:00 |
| *** ociuhandu has quit IRC | 16:00 | |
| *** ricolin_ has joined #openstack-nova | 16:01 | |
| *** shilpasd has quit IRC | 16:02 | |
| *** tbachman has quit IRC | 16:04 | |
| *** ricolin has quit IRC | 16:04 | |
| *** tbachman has joined #openstack-nova | 16:04 | |
| *** ricolin_ is now known as ricolin | 16:05 | |
| *** ociuhandu has joined #openstack-nova | 16:05 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Handle websockify v0.9.0 in console proxy https://review.opendev.org/677856 | 16:06 |
| mriedem | efried: i know devstack based jobs copy the mysqldb logs | 16:06 |
| mriedem | well they used to anyway | 16:06 |
| openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Try to repro bug 1823251 with mysql logs https://review.opendev.org/678051 | 16:08 |
| openstack | bug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone" [High,Confirmed] https://launchpad.net/bugs/1823251 | 16:08 |
| mriedem | efried: i'd guess it's a matter of adding a post-run play to collect the db logs https://github.com/openstack/nova/blob/master/playbooks/legacy/nova-lvm/post.yaml | 16:08 |
| mriedem | like ^ | 16:08 |
| mriedem | which i think runs after some other tempest/devstack post task copies things to /logs | 16:08 |
| mriedem | where the sqlite lots are stored, idk - or does this only fail in mysql? | 16:09 |
| mriedem | devstack-gate for legacy jobs would save off the mysql logs here https://github.com/openstack/devstack-gate/blob/9459f44cb5f604b84ca6b5642b89d7aeceae9f35/functions.sh#L667 | 16:09 |
| *** ociuhandu has quit IRC | 16:11 | |
| mriedem | so we need a play that copies those to devstack_log_dir | 16:11 |
| mriedem | $devstack_log_dir | 16:11 |
| *** ricolin has quit IRC | 16:11 | |
| *** ricolin has joined #openstack-nova | 16:11 | |
| mriedem | ok i see something in devstack-base | 16:12 |
| mriedem | https://github.com/openstack/devstack/blob/master/.zuul.yaml#L243 | 16:12 |
| mriedem | though that must not be working b/c i'm not seeing mysql logs in tempest job output | 16:12 |
| openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Try to repro bug 1823251 with mysql logs https://review.opendev.org/678051 | 16:12 |
| openstack | bug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone" [High,Confirmed] https://launchpad.net/bugs/1823251 | 16:12 |
| *** altlogbot_2 has quit IRC | 16:14 | |
| efried | mriedem: trying there --^ | 16:14 |
| efried | if you can see immediate problems, please lmk. | 16:14 |
| belmoreira | melwitt I get the same result. Doesn't work | 16:14 |
| *** mdbooth has quit IRC | 16:15 | |
| melwitt | belmoreira: and you tried a fresh vnc console for an instance? it won't work for the already existing ones | 16:15 |
| *** altlogbot_3 has joined #openstack-nova | 16:15 | |
| belmoreira | melwitt fresh | 16:15 |
| sean-k-mooney | stephenfin: before i forget yes the comment you left in the toplogy api patch make sense to me | 16:16 |
| stephenfin | (y) | 16:16 |
| *** xek has quit IRC | 16:17 | |
| belmoreira | melwitt can you see the trace? https://www.codepile.net/pile/pVkj75Ll | 16:18 |
| *** morgan is now known as kmalloc | 16:19 | |
| mriedem | efried: looks like by default mysql doesn't enable logging | 16:19 |
| mriedem | https://dev.mysql.com/doc/refman/5.7/en/server-logs.html | 16:19 |
| mriedem | so that's probably why we don't get them in the devstack job | 16:19 |
| belmoreira | melwitt but is going to the nova-consoleauth because nova-consoleauth also fails to verify the token | 16:20 |
| melwitt | belmoreira: yeah. actually, that's showing it not falling back to nova-consoleauth. it's failing the database-based validation (expected). but with CONF.workarounds.enable_consoleauth = True it should fall back. checking the code again... | 16:20 |
| efried | mriedem: iiuc this bug happens on unit tests, not devstacks; is there something we need to do to enable logging there? | 16:20 |
| mriedem | efried: it's not devstack, but the unit test jobs setup mysql and postgresql for opportunistic db testing for the schema migrations | 16:20 |
| melwitt | belmoreira: you see it going to nova-consoleauth too? I'm missing it in the trace | 16:21 |
| mriedem | that's what nova/tools/test-setup.sh is for | 16:21 |
| mriedem | efried: so likely just means we need to configure mysql for logging in that script | 16:21 |
| belmoreira | melwitt I see the consoleauth log: Checking Token: a86d2dcb-a8e3-4fa6-b707-92ae1243c96f, False | 16:22 |
| melwitt | oh, I see yeah. sorry. I got it backward, with enable_consoleauth = True it will try nova-consoleauth first and then fall back to the database | 16:23 |
| belmoreira | and actually I see the token being sent to the nova-consoleauth: Received Token: *** | 16:24 |
| efried | mriedem: sorry if I'm getting lost here; are you telling me my patch right now won't actually have anything to copy unless we do something to that test-setup.sh? | 16:24 |
| mriedem | efried: we can see, but i think so | 16:24 |
| mriedem | from what i've been reading | 16:24 |
| mriedem | and seeing in the devstack jobs | 16:24 |
| mriedem | or not seeing really | 16:24 |
| mriedem | devstack jobs will attempt to copy /var/log/mysql.log/.err but i don't see those in devstack job logs that get published, | 16:25 |
| mriedem | and the mysql docs say logging is not enabled by deafult | 16:25 |
| mriedem | *default | 16:25 |
| mriedem | so that's probably why i'm not seeing anything published | 16:25 |
| belmoreira | melwitt can you point me to this code? | 16:25 |
| melwitt | belmoreira: yeah... so this implies the original get_vnc_console call isn't storing the auth in nova-consoleauth. but it should be as long as you've set enable_consoleauth = True on the nova-api configs... | 16:25 |
| melwitt | yes. one sec | 16:25 |
| melwitt | belmoreira: https://github.com/openstack/nova/blob/stable/stein/nova/compute/api.py#L3948-L3964 | 16:26 |
| melwitt | that's what stores the token auth in nova-consoleauth when enabled | 16:26 |
| melwitt | and you already the other side working, the console proxy is looking there | 16:27 |
| melwitt | so something is missing about the nova-api side | 16:27 |
| *** rpittau is now known as rpittau|afk | 16:28 | |
| efried | stephenfin: Would you please hit https://review.opendev.org/#/c/677856/ again before you leave? | 16:29 |
| belmoreira | melwitt thanks a lot for your help | 16:29 |
| * stephenfin clicks | 16:29 | |
| belmoreira | melwitt what was really missing in my side was enable_consoleauth = True in the nova-api | 16:29 |
| stephenfin | Yup, done | 16:30 |
| efried | mriedem: would you mind making that edit, since you seem to have at least some idea how that would be done? I'm flying blind here. | 16:30 |
| efried | Or did you want to wait until this one finishes and verify that the logs are absent? | 16:30 |
| belmoreira | after that I see nova-consoleauth getting the token | 16:30 |
| efried | thanks stephenfin | 16:30 |
| melwitt | belmoreira: yeah, but you said you added that and restarted the nova-api's right? and it's still not working? | 16:30 |
| belmoreira | melwiit but it was falling... and the log in the nonvc was confusing | 16:30 |
| belmoreira | melwitt the issue was memcache for some reason needed a restart | 16:31 |
| belmoreira | melwitt it's working \o/ Thanks a lot again | 16:31 |
| *** panda is now known as panda|out | 16:31 | |
| melwitt | belmoreira: oh, weird. I don't understand why that would be needed but relieved it's working now | 16:32 |
| belmoreira | I will add "enable_consoleauth = True" into my prod apis. This will give more time to better decide how to setup this per cell | 16:33 |
| belmoreira | melwitt the main issue that I see for this new setup is because I have a lot of cells and we allow vnc console access from outside world. With this means that I will need to have an "ingress" to match the vnc url to the correct server. | 16:35 |
| melwitt | belmoreira: good call. just please be sure to get the per cell setup worked out before Train because all of the workaround stuff gets removed at that time. so you will want the per cell setup working in Stein *before* you upgrade to Train | 16:36 |
| belmoreira | melwitt that's why I'm using vnc as a central service | 16:36 |
| belmoreira | melwitt thanks a lotn again. This gives me some time to properly plan. I didn't follow all this refactor done in the vnc | 16:37 |
| melwitt | belmoreira: yeah... well, the key thing is the proxies need access to the cell databases. so if you can set that up in a way without having to give ingress to your cell controllers (if you made them separate maybe?) then there are some options. maybe talk to mnaser to see how he does it | 16:39 |
| *** ivve has joined #openstack-nova | 16:39 | |
| *** dtantsur is now known as dtantsur|afk | 16:39 | |
| melwitt | belmoreira: you're not alone. this has been a troublesome one :( maybe there is yet more I need to add to the documentation | 16:40 |
| *** ociuhandu has joined #openstack-nova | 16:41 | |
| mriedem | efried: "Or did you want to wait until this one finishes and verify that the logs are absent?" let's go with that | 16:42 |
| efried | ack, thx | 16:43 |
| mriedem | it's 11:43 and i feel like i haven't really settled into being productive today | 16:43 |
| *** N3l1x has joined #openstack-nova | 16:43 | |
| efried | it's like being PTL all over again, eh? | 16:44 |
| efried | Maybe doing PTL stuff felt productive to you | 16:44 |
| mriedem | i wasn't doing "ptl stuff" most days | 16:44 |
| sean-k-mooney | do we still need n-cauth? just noticed its enabled in some of the tempest jobs | 16:45 |
| mriedem | sean-k-mooney: we should'nt no | 16:45 |
| mriedem | hell i thought stephenfin had patches to remove it in train | 16:45 |
| sean-k-mooney | ok ya he did | 16:45 |
| mnaser | im pretty sure i saw it removed | 16:46 |
| sean-k-mooney | oh never mind i was looking at a stable run | 16:46 |
| mriedem | zoinks | 16:46 |
| *** ociuhandu has quit IRC | 16:46 | |
| sean-k-mooney | i was looking at a stable/rocky log master is correct | 16:48 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: docs: pretty up return code table or heal_allocations https://review.opendev.org/678063 | 16:53 |
| *** belmoreira has quit IRC | 16:54 | |
| *** psachin has joined #openstack-nova | 16:55 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get https://review.opendev.org/642899 | 16:55 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for node.list https://review.opendev.org/656027 | 16:55 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for validating instance and node https://review.opendev.org/656028 | 16:55 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for setting instance id https://review.opendev.org/659690 | 16:55 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for add/remove instance info from node https://review.opendev.org/659691 | 16:55 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for getting network metadata from node https://review.opendev.org/670213 | 16:55 |
| *** markvoelker has quit IRC | 16:57 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: doc: pretty up return code table for sync_aggregates https://review.opendev.org/678064 | 16:57 |
| *** markvoelker has joined #openstack-nova | 17:00 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support migrating SRIOV port with bandwidth https://review.opendev.org/676980 | 17:00 |
| *** bnemec has quit IRC | 17:00 | |
| mriedem | lyarwood: if you're back, can you hit these stein backports when you get a chance? https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:stable/stein+topic:bug/1839560 - regressoin since rocky for baremetal nodes so would be good to get those in | 17:01 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Allow migrating server with port resource request https://review.opendev.org/671497 | 17:02 |
| *** jmlowe has joined #openstack-nova | 17:05 | |
| *** hemna has quit IRC | 17:07 | |
| stephenfin | dansmith, mriedem: When a compute node record is deleted, can it ever come back? | 17:09 |
| dansmith | wellllll | 17:09 |
| dansmith | about that... | 17:09 |
| dansmith | stephenfin: last week? no.. this week? yes | 17:10 |
| dansmith | https://review.opendev.org/#/c/675496/ | 17:10 |
| stephenfin | dansmith: We should probably remove the deleted check from this online migration, in that case? https://github.com/openstack/nova/blob/master/nova/objects/compute_node.py#L504 | 17:11 |
| melwitt | does anyone know how/where notifications are logged? | 17:11 |
| dansmith | stephenfin: no | 17:11 |
| *** psachin is now known as psachin|away | 17:12 | |
| dansmith | stephenfin: you don't want to count deleted nodes for anything until/unless they're undeleted | 17:12 |
| dansmith | and we'll do all the migratory behavior when we resurrect and then subsequently save it | 17:12 |
| sean-k-mooney | melwitt: i guess its proably depned on what is sending them. i would expect to see some notifiaciotn logs in n-cpu | 17:12 |
| stephenfin | doesn't that mean we need to keep that online migration around forever then? | 17:12 |
| sean-k-mooney | e.g. if the compute service is emmiting vm lifecycle notifications | 17:13 |
| dansmith | stephenfin: no, because we do the migration activity upon resurrection | 17:13 |
| melwitt | sean-k-mooney: yeah, I don't know where or how they are logged. there's a CONF.notifications.default_level for the log level but I don't see it used anywhere in nova code | 17:13 |
| melwitt | and I can't find what logs the notifications or what format they're in | 17:13 |
| *** tesseract has quit IRC | 17:13 | |
| dansmith | stephenfin: if we ever want to remove *that* behavior we'll need a blocker type migration | 17:14 |
| stephenfin | gotcha | 17:14 |
| * stephenfin duplicates check for the numa_topology migration | 17:14 | |
| *** ash2307 has joined #openstack-nova | 17:14 | |
| sean-k-mooney | melwitt: its unlikely but the only other place that would make sense would be the conductor | 17:14 |
| *** igordc has quit IRC | 17:15 | |
| sean-k-mooney | but it feel inefficnet to need to send them form the conductor so i doubt we would do that | 17:15 |
| sean-k-mooney | melwitt: are you trying to find the ones used by nova join | 17:16 |
| melwitt | I'm trying to find the ones anywhere in nova | 17:16 |
| *** panda|out has quit IRC | 17:16 | |
| melwitt | I don't see how or where they are logged | 17:16 |
| melwitt | looks like the only use of CONF.notifications.default_level was removed here https://github.com/openstack/nova/commit/9f48aee9b0ea68f7c8eba6a1f3d076e4194d804d#diff-2f33aae68e09a2fe816870ac389cfe95 | 17:20 |
| melwitt | I'm guessing that decorator somehow logged things? | 17:20 |
| *** panda has joined #openstack-nova | 17:20 | |
| melwitt | I dunno | 17:20 |
| sean-k-mooney | melwitt: maybe this https://github.com/openstack/nova/blob/master/nova/rpc.py#L420 | 17:21 |
| melwitt | mriedem: do you know if we intentionally stopped logging notifications in rocky? commit linked above ^ | 17:23 |
| melwitt | sean-k-mooney: that looks like some kind of error condition. not general log of any notification | 17:23 |
| dansmith | did we ever log them? | 17:23 |
| dansmith | they'd be spread all over the place if we did | 17:23 |
| melwitt | based on the existence of the CONF.notifications.default_level option we did | 17:24 |
| melwitt | yeah | 17:24 |
| melwitt | but the option is no longer used anywhere after that commit | 17:24 |
| melwitt | so I wonder if that decorator used to result in logging somehow. I don't know how it worked | 17:24 |
| dansmith | isn't that level something about which notifcations we emit, not the log level? | 17:25 |
| dansmith | "Default notification level for outgoing notifications." | 17:26 |
| melwitt | I dunno, sounds like a log level https://github.com/openstack/nova/blob/master/nova/conf/notifications.py#L51-L57 | 17:26 |
| melwitt | but yeah, I guess it could have meant that notifications used to be categorized and you could prune down which to emit? | 17:27 |
| dansmith | right, like only emit started/stopped type things and not progress-related ones | 17:27 |
| dansmith | or "I checked on a thing" ones | 17:27 |
| dansmith | I could definitely be wrong | 17:27 |
| sean-k-mooney | melwitt: we have some failutre logs here https://github.com/openstack/nova/blob/master/nova/notifications/base.py#L134-L139 | 17:27 |
| melwitt | maybe we never logged notifications. guh, I don't know | 17:27 |
| dansmith | I didn't really think we did, tbh | 17:27 |
| melwitt | sean-k-mooney: yeah, I know we have failure logs | 17:28 |
| *** psachin|away has quit IRC | 17:32 | |
| *** psachin has joined #openstack-nova | 17:33 | |
| *** igordc has joined #openstack-nova | 17:34 | |
| mriedem | melwitt: we do'nt log notificatoins | 17:40 |
| mriedem | like dan said, that's not a log level | 17:41 |
| mriedem | each event has a level associated with it | 17:41 |
| mriedem | why? what customer is saying they had notifications logged? | 17:42 |
| mriedem | note - you can configure oslo.messaging to just log notifications | 17:42 |
| mriedem | that's not a nova thing, that's an oslo thing | 17:42 |
| melwitt | thanks. fyi, the default_level option is no longer used anywhere so that might be a bug? but unrelated to what I was looking for | 17:42 |
| *** ociuhandu has joined #openstack-nova | 17:42 | |
| mriedem | https://docs.openstack.org/oslo.messaging/latest/configuration/opts.html#oslo_messaging_notifications.driver | 17:43 |
| mriedem | [oslo_messaging_notifications]/driver=log | 17:43 |
| melwitt | mriedem: no, we're trying to debug something and trying to verify that nova is sending notifications. and were looking for a clue about how to tell if it is | 17:43 |
| melwitt | thanks | 17:43 |
| mriedem | btw, gibi's last summit talk about versioned notifications (which i think you're in the video) has some nice stuff about configuring and testing notificaoins out to see them | 17:44 |
| mriedem | https://www.openstack.org/videos/summits/denver-2019/nova-versioned-notifications-the-result-of-a-3-year-journey | 17:44 |
| mriedem | oh let me guess - something something heat isn't getting notifications | 17:45 |
| mriedem | maybe the customer flipped on versioned notifications only and heat only listens for unversioned | 17:45 |
| melwitt | novajoin, the vendordata service | 17:45 |
| melwitt | so yeah, pretty much | 17:45 |
| melwitt | yeah, we checked and both are set to use unversioned so it's not something obvious | 17:46 |
| *** ociuhandu has quit IRC | 17:47 | |
| melwitt | haha, indeed I attended that talk. I'll look at that again | 17:47 |
| *** psachin has quit IRC | 17:50 | |
| melwitt | looks like something is afoot with the driver setting, it's set to 'noop' which seems bad :( | 17:51 |
| melwitt | good thing you pointed that out, I had forgotten about it | 17:52 |
| melwitt | [oslo_messaging_notifications]/driver | 17:52 |
| *** ralonsoh has quit IRC | 17:54 | |
| *** macz has joined #openstack-nova | 17:54 | |
| *** tbachman has quit IRC | 17:55 | |
| efried | sean-k-mooney: were you one who was vocal about what "privsep stage 3" should look like? | 17:59 |
| efried | nm, I see you're already on the cyborg privsep review, which is where this was going. | 18:03 |
| *** tbachman has joined #openstack-nova | 18:08 | |
| *** tbachman has quit IRC | 18:11 | |
| *** irclogbot_1 has quit IRC | 18:14 | |
| *** irclogbot_0 has joined #openstack-nova | 18:15 | |
| melwitt | looks like there was a recent change to tripleo to disable notification drivers when telemetry is disabled, so this deploy got caught up in that | 18:16 |
| melwitt | thanks again for the hint about the [oslo_messaging_notifications]/driver setting. mriedem++ | 18:17 |
| *** maciejjozefczyk has quit IRC | 18:17 | |
| mriedem | worked? | 18:23 |
| melwitt | they haven't tried yet with driver=messagingv2 but I'm sure this is the issue | 18:24 |
| mriedem | ah yeah | 18:24 |
| melwitt | there was an assumption that only telemetry needed the notifications and since it's disabled, it set driver=noop to avoid needless notification traffic, | 18:25 |
| melwitt | but novajoin is in the mix here too and needs the notifications to work | 18:25 |
| mriedem | silly tripleo | 18:28 |
| mriedem | i thought heat also consumed nova notifications, or maybe that's indirectly via ceilometer? | 18:28 |
| mriedem | but yeah lots of projects listen to nova notifications besides those, you've also got designate, watcher, blazar, etc - though maybe tripleo doesn't support those | 18:28 |
| *** altlogbot_3 has quit IRC | 18:29 | |
| *** edleafe has quit IRC | 18:29 | |
| melwitt | yeah, this is the undercloud and that confuses me, but maybe that's why | 18:29 |
| melwitt | I think notifications are always on in the overcloud | 18:29 |
| melwitt | in order for other things to work, I assume we have some other service that needs them | 18:29 |
| mriedem | oh yeah, forgot about the cloud turducken | 18:30 |
| melwitt | yeah | 18:30 |
| mriedem | well i suppose it always feels good to come back and say, "this isn't a nova problem, it's a tripleo problem" | 18:30 |
| melwitt | heh, indeed | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions https://review.opendev.org/537414 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option https://review.opendev.org/671792 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement https://review.opendev.org/671793 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available' https://review.opendev.org/672693 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell' https://review.opendev.org/674395 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs https://review.opendev.org/671800 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields' https://review.opendev.org/674103 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait https://review.opendev.org/675571 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'hw:cpu_policy', 'hw:mem_page_size' extra specs from API samples https://review.opendev.org/675338 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta https://review.opendev.org/671801 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Fold in argument to '_update_provider_tree_for_vgpu' https://review.opendev.org/676729 | 18:31 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add reshaper for PCPU https://review.opendev.org/674895 | 18:31 |
| *** bnemec has joined #openstack-nova | 18:34 | |
| *** edleafe has joined #openstack-nova | 18:35 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Add docstring to check_availability_zone function https://review.opendev.org/677858 | 18:38 |
| mriedem | anyone else have an opinion about nova migration-list with --migration-type or just --type in https://review.opendev.org/#/c/675117/ ? | 18:40 |
| *** jbernard has quit IRC | 18:43 | |
| *** jbernard has joined #openstack-nova | 18:43 | |
| *** factor has quit IRC | 18:51 | |
| *** factor has joined #openstack-nova | 18:52 | |
| *** spsurya has quit IRC | 18:52 | |
| *** factor has quit IRC | 18:54 | |
| *** factor has joined #openstack-nova | 18:54 | |
| efried | mriedem: sans click, I would say --migration-type just because --type is so generic. | 18:59 |
| *** ricolin has quit IRC | 18:59 | |
| *** factor has quit IRC | 19:01 | |
| artom | mriedem, make it --kind-of-migration and watch the comments pour in | 19:02 |
| *** tbachman has joined #openstack-nova | 19:03 | |
| mriedem | --migration-flavour? | 19:04 |
| artom | Points for the UK spelling :D | 19:05 |
| artom | (aka the *correct* spelling. Yours truly, a Canadian) | 19:06 |
| *** bbowen_ has joined #openstack-nova | 19:06 | |
| artom | (except when I feel like being Quebecois or Russian - yay absence of national identity!) | 19:06 |
| *** bbowen has quit IRC | 19:08 | |
| efried | mriedem: I left helpful comments on https://review.opendev.org/#/c/678051/ | 19:14 |
| mriedem | artom: how would you do it in old russ? | 19:20 |
| *** boxiang has quit IRC | 19:20 | |
| artom | Gather 'round a bottle of vodka (or two) and let the solution emerge by itself | 19:20 |
| mriedem | efried: you might need: | 19:22 |
| mriedem | become: yes | 19:22 |
| *** boxiang has joined #openstack-nova | 19:23 | |
| *** panda has quit IRC | 19:23 | |
| artom | mriedem, FWIW, I'd say just --type, because 'migration' is already explicitly implied (ha!) in the command | 19:24 |
| mriedem | the devstack tasks that use synchronize all have some form of "become: true" for sudo | 19:24 |
| artom | In (server-)list and flavor-list, we don't repeat the thing we're list in the args | 19:24 |
| artom | So it's just flavor-list --extra-specs, not flavor-list --flavor-extra-specs | 19:25 |
| melwitt | I don't know if it's just me but I didn't understand which option dtroyer was for in his comment | 19:25 |
| artom | But I agree that --type is trickier, because it's more vague on its own than something like --extra-specs | 19:25 |
| *** jrosser has joined #openstack-nova | 19:29 | |
| mriedem | melwitt: dean was saying since nova uses --*-type as a convention be consistent in nova cli | 19:29 |
| *** panda has joined #openstack-nova | 19:29 | |
| mriedem | osc uses --type for the most part | 19:29 |
| mriedem | since context is derived from the command you're using | 19:30 |
| melwitt | does a nova osc command count as 'nova cli'? | 19:30 |
| mriedem | so since nova cli uses --key-type, --console-type and --backup-type, use --migration-type | 19:30 |
| mriedem | no | 19:30 |
| mriedem | osc is osc | 19:30 |
| melwitt | haha ok, that's what I was thinking | 19:30 |
| *** ozzzo has joined #openstack-nova | 19:35 | |
| *** gbarros has quit IRC | 19:36 | |
| melwitt | oh, geez, I didn't realize that change was for python-novaclient. ugh | 19:37 |
| melwitt | I thought it was for osc 'openstack server' command | 19:37 |
| melwitt | yeah I agree stay consistent with other python-novaclient things | 19:38 |
| efried | mriedem: it looks like logging is enabled by default? | 19:39 |
| openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Try to repro bug 1823251 with mysql logs https://review.opendev.org/678051 | 19:41 |
| openstack | bug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone" [High,Confirmed] https://launchpad.net/bugs/1823251 | 19:41 |
| mnaser | sean-k-mooney: do you happen to know if you're able to backport the os-vif bug to stable/stein ? | 19:41 |
| efried | mriedem: if it's writing to "the console"... is that the same console that tests are being run in? | 19:42 |
| mriedem | efried: no, | 19:44 |
| mriedem | likely the journal? | 19:44 |
| mriedem | i.e. mysql systemd journal log | 19:44 |
| mriedem | if i had a devstack handy i'd poke at this but i don't | 19:44 |
| mriedem | efried: if this were an IMM or VIOS, wwyd?! | 19:45 |
| efried | mriedem: How destructive is the poking? I have one you can jump on | 19:45 |
| openstackgerrit | Jonathan Rosser proposed openstack/os-vif stable/stein: only disable mac ageing for ovs hybrid plug https://review.opendev.org/678098 | 19:46 |
| efried | I don't know what IMM is. If it were VIOS I would phone a friend. | 19:47 |
| efried | The problem is that I have basically no understanding of the chain of events that's leading to mysqld running and/or being used in this environment. | 19:47 |
| mnaser | sean-k-mooney: jrosser has backported the os-vif issue which fixes deployments letting vms see other vms traffic :) | 19:48 |
| mriedem | integrated management module | 19:49 |
| mriedem | like the CMM in a bladecenter | 19:49 |
| mriedem | DOY | 19:50 |
| mriedem | where is dansmith when i need him for ibm jokes | 19:50 |
| mriedem | efried: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/test-setup is the role for hitting the test-setup script in the unit test jobs | 19:51 |
| efried | by the time we run tools/test-setup.sh, mysqld is already running, right? | 19:51 |
| *** tbachman has quit IRC | 19:51 | |
| mriedem | has to be | 19:51 |
| mriedem | since we're issuing commands against it | 19:51 |
| efried | so whatever we're doing we need to do well before that | 19:52 |
| efried | unless it's possible to restart mysqld from that script, is that what you were suggesting above? | 19:52 |
| *** bbowen_ has quit IRC | 19:52 | |
| *** tbachman has joined #openstack-nova | 19:53 | |
| melwitt | mnaser: isn't that a pretty serious security issue? looked in the bug and it didn't look treated as such | 19:56 |
| openstackgerrit | Merged openstack/nova master: Remove deprecated [neutron]/url option https://review.opendev.org/677755 | 19:57 |
| *** adriant has quit IRC | 19:57 | |
| mriedem | efried: the mysql docs seem to suggest you can change logging config at runtime and flush the settings | 20:01 |
| mriedem | but w/o an env to play with idk | 20:01 |
| mriedem | efried: otherwise yeah i'd think you could restart from within the script just by doing: sudo systemctl restart mysqld | 20:01 |
| efried | I'm looking at a default-y devstack and /var/log/mysql has files in it | 20:05 |
| *** tbachman_ has joined #openstack-nova | 20:05 | |
| *** nweinber__ has quit IRC | 20:05 | |
| *** davee_ has quit IRC | 20:07 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Fail compute service delete if resource provider delete fails https://review.opendev.org/678100 | 20:07 |
| *** tbachman has quit IRC | 20:07 | |
| *** tbachman_ is now known as tbachman | 20:07 | |
| mriedem | efried: huh yeah i guess my devstack patch works | 20:08 |
| mriedem | https://ccb62560c9b6fbee62ac-3bdb45e74ea7431452edb68e5fcaf6be.ssl.cf5.rackcdn.com/678053/1/check/neutron-tempest-linuxbridge/d0d8b63/controller/logs/mysql/ | 20:08 |
| mriedem | https://review.opendev.org/#/c/678053/ | 20:09 |
| mriedem | maybe the ubuntu packages changed where the log files go? | 20:09 |
| mriedem | since...trusty? | 20:09 |
| efried | mriedem: Presumably that ^ will just work for dsvm jobs anyway since by default tox jobs don't copy *any* logs? | 20:11 |
| openstackgerrit | Merged openstack/nova master: Limit get_sdk_adapter to requested service type https://review.opendev.org/674678 | 20:13 |
| openstackgerrit | Merged openstack/nova master: Add a hacking rule for useless assertions https://review.opendev.org/677610 | 20:13 |
| openstackgerrit | Merged openstack/nova master: doc: remove confusing docs about aggregate allocation ratios https://review.opendev.org/677472 | 20:13 |
| *** tbachman has quit IRC | 20:14 | |
| *** markvoelker has quit IRC | 20:16 | |
| mnaser | melwitt: it is a very serious secuity issue | 20:28 |
| mnaser | with linuxbridge, a vm can see traffic to other vms | 20:28 |
| melwitt | ok. argh, so by default we get no OSSA handling with it because of the way os-vif project is tagged? feels like we need to fix that (I don't know how) | 20:29 |
| melwitt | I commented on the lp bug | 20:29 |
| *** markvoelker has joined #openstack-nova | 20:30 | |
| *** tbachman has joined #openstack-nova | 20:34 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Find instance in another cell during floating IP re-association https://review.opendev.org/656594 | 20:36 |
| mriedem | efried: tox jobs copy logs, like the tox logs and testr results | 20:36 |
| *** boxiang has quit IRC | 20:37 | |
| *** boxiang has joined #openstack-nova | 20:38 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove zVM requirement from the top level requirements. https://review.opendev.org/677870 | 20:42 |
| *** ociuhandu has joined #openstack-nova | 21:03 | |
| *** nweinber__ has joined #openstack-nova | 21:05 | |
| *** tbachman has quit IRC | 21:06 | |
| mriedem | dansmith: i looked at mdbooths thing here https://review.opendev.org/#/c/677736/ and it seems sane, just some nits and such, and maybe some unnecessary test code | 21:06 |
| mriedem | guess we're just waiting on a customer feedback | 21:06 |
| openstackgerrit | Merged openstack/nova master: Update docstring of 'revert_resize' function https://review.opendev.org/665976 | 21:07 |
| *** ociuhandu has quit IRC | 21:08 | |
| jrosser | mnaser: melwitt i can already see that this is failing https://review.opendev.org/#/c/678098/ | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: Introduce live_migration_claim() https://review.opendev.org/635669 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: New objects for NUMA live migration https://review.opendev.org/634827 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: LM: add support for augmenting migrate_data with info from claims https://review.opendev.org/634828 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: LM: add support for updating NUMA-related XML on the source https://review.opendev.org/635229 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: RPC changes to prepare for NUMA live migration https://review.opendev.org/634605 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: NUMA live migration support https://review.opendev.org/634606 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: Deprecate CONF.workarounds.enable_numa_live_migration https://review.opendev.org/640021 | 21:21 |
| openstackgerrit | Artom Lifshitz proposed openstack/nova master: [WIP] Functional test for NUMA live migration https://review.opendev.org/672595 | 21:21 |
| melwitt | jrosser: hm, yeah I see it too. will probably need sean-k-mooney help to fix | 21:23 |
| jrosser | whilst the cherry-pick was trivial, i'm not really familiar with the code and imminent PTO means someone else really needs to take a look | 21:23 |
| artom | dansmith, ^^ finally have something | 21:23 |
| melwitt | jrosser: ack. sean-k-mooney or I or someone can get it into shape while you're away | 21:23 |
| artom | I posted a note in the middle that only the patches below it have had feedback addressed | 21:24 |
| *** tbachman has joined #openstack-nova | 21:24 | |
| artom | But I wanted to let CI do its thing | 21:24 |
| jrosser | melwitt: excellent thankyou - we have some anxious folk on the OSA side with stein deploys affected by this | 21:24 |
| * artom -> home | 21:25 | |
| melwitt | jrosser: understood. this is bad for everyone, will want to fix asap | 21:25 |
| openstackgerrit | Merged openstack/nova master: Address nits from privsep series https://review.opendev.org/677210 | 21:27 |
| *** artom has quit IRC | 21:29 | |
| *** tbachman has quit IRC | 21:31 | |
| *** markvoelker has quit IRC | 21:35 | |
| *** mmethot has quit IRC | 21:37 | |
| *** BjoernT_ has quit IRC | 21:40 | |
| melwitt | fun, I just learned that the reverts_task_state decorator tries to update the resource tracker and if that fails (e.g. libvirtd stopped), it blows up and prevents further decorators from running, namely wrap_instance_fault | 21:41 |
| melwitt | so then we get no server fault in the instance | 21:41 |
| *** nweinber__ has quit IRC | 21:48 | |
| mriedem | efried: sean-k-mooney: alex_xu: dansmith (in absentia): i've replied on the vpmem persistence ML thread, enjoy | 21:52 |
| mriedem | i can't say i read all of sean-k-mooney's legalize reply | 21:52 |
| mriedem | i got to like bullet 4-a-ii and my head exploded | 21:52 |
| efried | agreed | 21:53 |
| mriedem | with that i need to get the hell outside for awhile | 21:53 |
| *** mriedem is now known as mriedem_away | 21:54 | |
| sean-k-mooney | thanks and ya sorry my reply were a bit dense on info | 21:58 |
| *** munimeha1 has quit IRC | 21:59 | |
| sean-k-mooney | melwitt: i can take a look and fix up the backport | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get https://review.opendev.org/642899 | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for node.list https://review.opendev.org/656027 | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for validating instance and node https://review.opendev.org/656028 | 22:01 |
| melwitt | sean-k-mooney: thanks! | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for setting instance id https://review.opendev.org/659690 | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for add/remove instance info from node https://review.opendev.org/659691 | 22:01 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use SDK for getting network metadata from node https://review.opendev.org/670213 | 22:01 |
| *** bnemec has quit IRC | 22:03 | |
| sean-k-mooney | melwitt: im pretty sure that add is missing here https://github.com/openstack/os-vif/blob/stable/stein/os_vif/internal/command/ip/__init__.py | 22:03 |
| sean-k-mooney | we remove a layer of indirection in train | 22:04 |
| sean-k-mooney | so ther is 1 addtion plays we need to add the parmater in stien | 22:04 |
| melwitt | you mean it does not accept a ageing kwarg? | 22:04 |
| melwitt | oh | 22:04 |
| sean-k-mooney | correct it does not currently the patch that was backported did not have to update that file because we removed it in master | 22:05 |
| sean-k-mooney | melwitt: mnaser in attion to adding the aging parmater to 1 more location i will need to update the functional test or backport a second patch | 22:19 |
| sean-k-mooney | but yes we shoudl be able to make this work | 22:19 |
| dansmith | mriedem_away: I assume by "outside" you mean either (a) out in super mario world or (b) three feet from your door to plant something | 22:20 |
| *** markvoelker has joined #openstack-nova | 22:21 | |
| melwitt | super mario world? | 22:21 |
| dansmith | melwitt: i.e. some video game as opposed to actually going outside | 22:23 |
| melwitt | haha, ok. that's an old super nintendo game | 22:24 |
| sean-k-mooney | it is a good game. unfortunetly i dont have my snes anymore. i do have a saga meadrive with sonic plug into by tv | 22:24 |
| melwitt | I didn't know mriedem_away is a SNES person | 22:25 |
| *** markvoelker has quit IRC | 22:25 | |
| melwitt | I liked it ok but not a huge fan of super mario. I prefer rpgs | 22:25 |
| sean-k-mooney | ... tries not to feel old for having fond memories of snes and sage games | 22:25 |
| *** ivve has quit IRC | 22:26 | |
| melwitt | I <3 snes | 22:27 |
| openstackgerrit | sean mooney proposed openstack/os-vif stable/stein: only disable mac ageing for ovs hybrid plug https://review.opendev.org/678098 | 22:28 |
| sean-k-mooney | the againg parmater was jsut missing in that one spot after all | 22:28 |
| sean-k-mooney | but now i need to fiture out why i was getting test failures on rhel8 | 22:29 |
| *** mmethot has joined #openstack-nova | 22:29 | |
| dansmith | melwitt: yeah, I know.. mriedem_away likes snes, which is why I chose it | 22:29 |
| *** mmethot has quit IRC | 22:34 | |
| *** tbachman has joined #openstack-nova | 22:35 | |
| *** TxGirlGeek has joined #openstack-nova | 22:35 | |
| *** markvoelker has joined #openstack-nova | 22:41 | |
| sean-k-mooney | efried: if you have the link to the cyborg privsep patch that would be useful i have several cyborg patches added to my review queue and i did comment on there use of privsep i think in the past bug i cant recall which one it was | 22:45 |
| sean-k-mooney | efried: ah its https://review.opendev.org/#/c/673957/ | 22:47 |
| sean-k-mooney | i was added to it but i have not reviewd it yet ill take a look tomorow. | 22:48 |
| sean-k-mooney | "This code is modelled strongly on how nova and cinder[0] has chosen | 22:48 |
| sean-k-mooney | to use privsep. | 22:48 |
| sean-k-mooney | " | 22:48 |
| sean-k-mooney | ^ that is not a good start. | 22:49 |
| *** markvoelker has quit IRC | 22:51 | |
| *** rcernin has joined #openstack-nova | 22:55 | |
| *** nweinber__ has joined #openstack-nova | 22:57 | |
| *** rcernin is now known as rcernin|brb | 23:00 | |
| *** igordc has quit IRC | 23:02 | |
| *** igordc has joined #openstack-nova | 23:02 | |
| *** tkajinam has joined #openstack-nova | 23:03 | |
| *** macz has quit IRC | 23:07 | |
| *** rcernin|brb has quit IRC | 23:09 | |
| *** rcernin has joined #openstack-nova | 23:10 | |
| *** nweinber__ has quit IRC | 23:11 | |
| *** takashin has joined #openstack-nova | 23:33 | |
| *** eharney has quit IRC | 23:36 | |
| openstackgerrit | Merged openstack/nova master: Handle websockify v0.9.0 in console proxy https://review.opendev.org/677856 | 23:49 |
| *** igordc has quit IRC | 23:57 | |
| *** owalsh|away has quit IRC | 23:57 | |
| *** ricolin has joined #openstack-nova | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!