Tuesday, 2018-03-13

*** liusheng has joined #openstack-meeting00:00
*** rbudden has quit IRC00:01
*** awaugama has quit IRC00:04
*** Sukhdev has joined #openstack-meeting00:04
*** fnaval has quit IRC00:13
*** wanghao_ has quit IRC00:21
*** yangyapeng has joined #openstack-meeting00:21
*** wanghao has joined #openstack-meeting00:22
*** yangyapeng has quit IRC00:26
*** salv-orlando has joined #openstack-meeting00:29
*** HeOS has quit IRC00:31
*** cloudrancher has quit IRC00:32
*** liyi has joined #openstack-meeting00:32
*** chyka has joined #openstack-meeting00:34
*** cloudrancher has joined #openstack-meeting00:34
*** salv-orlando has quit IRC00:34
*** wanghao has quit IRC00:34
*** wanghao has joined #openstack-meeting00:35
*** mriedem has quit IRC00:36
*** yamahata_ has quit IRC00:37
*** chyka has quit IRC00:38
*** Swami has quit IRC00:45
*** zhurong has joined #openstack-meeting00:48
*** claudiub|2 has quit IRC00:58
*** kaisers1 has joined #openstack-meeting01:06
*** kaisers has quit IRC01:07
*** harlowja has quit IRC01:10
*** yangyapeng has joined #openstack-meeting01:19
*** imcsk8 has joined #openstack-meeting01:19
*** pzchen has joined #openstack-meeting01:22
*** hongbin has joined #openstack-meeting01:24
*** ykatabam1 has quit IRC01:28
*** ykatabam has joined #openstack-meeting01:28
*** ZacharyMa has joined #openstack-meeting01:30
*** salv-orlando has joined #openstack-meeting01:31
*** Sukhdev_ has joined #openstack-meeting01:33
*** amodi has joined #openstack-meeting01:35
*** salv-orlando has quit IRC01:35
*** Sukhdev has quit IRC01:36
*** Sukhdev_ has quit IRC01:38
*** zhurong has quit IRC01:45
*** gongysh has joined #openstack-meeting01:45
*** epico has joined #openstack-meeting01:49
*** julim has joined #openstack-meeting01:51
*** yamahata_ has joined #openstack-meeting01:51
*** zaneb has quit IRC01:54
*** zhongjun has joined #openstack-meeting01:54
*** zaneb has joined #openstack-meeting01:57
*** rcernin has quit IRC02:04
*** kaisers_ has quit IRC02:09
*** amodi has quit IRC02:09
*** markstur_ has quit IRC02:15
*** lhx_ has joined #openstack-meeting02:23
*** zhurong has joined #openstack-meeting02:26
*** salv-orlando has joined #openstack-meeting02:31
*** salv-orlando has quit IRC02:36
*** fzdarsky__ has joined #openstack-meeting02:43
*** fzdarsky_ has quit IRC02:46
*** psachin has joined #openstack-meeting02:47
*** rosmaita has quit IRC02:49
*** chohoor has joined #openstack-meeting02:53
*** kevzha01 has joined #openstack-meeting02:53
*** amodi has joined #openstack-meeting02:57
*** gouthamr has quit IRC03:00
*** kevzha01 is now known as kevinz03:00
*** bkopilov has quit IRC03:05
*** rcernin has joined #openstack-meeting03:07
*** epico has quit IRC03:09
*** ricolin has joined #openstack-meeting03:15
*** edmondsw has joined #openstack-meeting03:18
*** epico has joined #openstack-meeting03:19
*** chohoor has left #openstack-meeting03:21
*** edmondsw has quit IRC03:22
*** Zames has joined #openstack-meeting03:22
*** Zames has quit IRC03:26
*** Zames has joined #openstack-meeting03:28
*** salv-orlando has joined #openstack-meeting03:32
*** Dinesh_Bhor has joined #openstack-meeting03:36
*** salv-orlando has quit IRC03:36
*** amodi has quit IRC03:37
*** VW has joined #openstack-meeting03:37
*** Tom-Tom has joined #openstack-meeting03:39
*** tpatil has joined #openstack-meeting03:40
*** rbudden has joined #openstack-meeting03:41
*** Zames has quit IRC03:44
*** ekcs has quit IRC03:46
*** gongysh has quit IRC03:47
*** harlowja has joined #openstack-meeting03:48
*** Tom-Tom has quit IRC03:48
*** Tom-Tom has joined #openstack-meeting03:48
*** links has joined #openstack-meeting03:50
*** hongbin has quit IRC03:51
*** VW has quit IRC03:52
*** VW has joined #openstack-meeting03:53
*** Spaz-Home has joined #openstack-meeting03:53
*** Tom-Tom has quit IRC03:53
*** chyka has joined #openstack-meeting03:53
*** amodi has joined #openstack-meeting03:54
*** Tom-Tom has joined #openstack-meeting03:55
*** Spazmotic has quit IRC03:57
*** VW has quit IRC03:57
*** chyka has quit IRC03:58
*** liyi has quit IRC03:58
*** niraj_singh has joined #openstack-meeting03:58
*** gyee has quit IRC03:59
tpatilHi04:00
tpatilToday Sampath is unavailable so I will chair today's Masakari meeting04:00
*** rkmrHonjo has joined #openstack-meeting04:00
niraj_singhtpatil: hi04:00
tpatilHi04:01
*** rbudden has quit IRC04:01
rkmrHonjohi04:01
Dinesh_BhorHi all04:01
*** daidv has joined #openstack-meeting04:01
tpatil#startmeeting masakari04:01
openstackMeeting started Tue Mar 13 04:01:53 2018 UTC and is due to finish in 60 minutes.  The chair is tpatil. Information about MeetBot at http://wiki.debian.org/MeetBot.04:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.04:01
*** openstack changes topic to " (Meeting topic: masakari)"04:01
openstackThe meeting name has been set to 'masakari'04:01
tpatil#topic High Priority Items04:02
*** openstack changes topic to "High Priority Items (Meeting topic: masakari)"04:02
*** ykatabam has quit IRC04:03
*** ykatabam has joined #openstack-meeting04:03
tpatilWe should merge this patch soon04:03
tpatil#link : https://review.openstack.org/#/c/549705/04:03
tpatilI will approve this patch after this meeting04:04
rkmrHonjoThanks.04:04
tpatilAny other patches that needs attention?04:04
tpatilwhat about this patch https://review.openstack.org/#/c/547879/?04:05
tpatilIs it a blocker for queens release?04:06
*** shaohe_feng has quit IRC04:06
tpatilrkmrHonjo: Do you have any update?04:06
rkmrHonjoAh, no. In my understanding, we'll backport it after releasing.04:06
rkmrHonjoPy35 UT error is addressed by this patch: https://review.openstack.org/#/c/551195/04:07
rkmrHonjoPlease review it.04:07
*** gongysh has joined #openstack-meeting04:07
*** gongysh has quit IRC04:08
tpatilrkmrHonjo: Will review it today04:08
*** Tom-Tom has quit IRC04:08
rkmrHonjotpatil: thank you.04:08
tpatil#topic : Masakari Project Mascot04:09
*** openstack changes topic to ": Masakari Project Mascot (Meeting topic: masakari)"04:09
tpatilAny recommendations or preference what should be the Masakari mascot?04:09
rkmrHonjoI have two ideas.04:09
rkmrHonjo1. St. Bernard(Dog): St. Bernard is famous as rescue dog. And, masakari rescues VM instances.04:09
tpatilrkmrHonjo: Good suggestion04:10
rkmrHonjo2. Asian Black Bear: In Japan, Masakari(one of the ax) is closely related to "Kintaro". He is a folk hero. And, Kintaro is also related to bear. Asian Black Bear is typical bear in Japan.04:10
tpatilIn the last meeting, Gekko was also proposed04:11
tpatillet's do a voting here04:11
tpatil#startvote Masakari Mascot? St. Bernard(Dog), Asian Black Bear, Gekko04:12
openstackBegin voting on: Masakari Mascot? Valid vote options are St, Bernard, Dog, Asian, Black, Bear, Gekko.04:12
openstackVote using '#vote OPTION'. Only your last vote counts.04:12
tpatil#vote St. Bernard(Dog)04:12
*** caowei has quit IRC04:12
openstacktpatil: St. Bernard(Dog) is not a valid option. Valid options are St, Bernard, Dog, Asian, Black, Bear, Gekko.04:12
rkmrHonjo#vote St. Bernard(Dog)04:13
openstackrkmrHonjo: St. Bernard(Dog) is not a valid option. Valid options are St, Bernard, Dog, Asian, Black, Bear, Gekko.04:13
tpatilSorry I made a mistake in adding vote options04:13
tpatillet me end this vote here and start it one more time with correct voting options04:13
tpatil#endvote04:13
openstackVoted on "Masakari Mascot?" Results are04:13
*** caowei has joined #openstack-meeting04:14
tpatil#startvote what should be the Masakari Project Mascot? Bernard_Dog, Asian_black_bear, Gekko04:14
openstackBegin voting on: what should be the Masakari Project Mascot? Valid vote options are Bernard_Dog, Asian_black_bear, Gekko.04:14
openstackVote using '#vote OPTION'. Only your last vote counts.04:14
tpatil#vote Bernard_Dog04:15
rkmrHonjo#vote Bernard_Dog04:15
Dinesh_Bhor#vote Bernard_Dog04:15
niraj_singh#vote Bernard_Dog04:15
*** dtruong2 has joined #openstack-meeting04:16
tpatilOk let's see the result04:16
tpatil#endvote04:16
openstackVoted on "what should be the Masakari Project Mascot?" Results are04:16
openstackBernard_Dog (4): tpatil, rkmrHonjo, Dinesh_Bhor, niraj_singh04:16
*** dtruong2 has quit IRC04:17
*** jamesmcarthur has joined #openstack-meeting04:17
tpatilSampath will propose this mascot name to the concerned team04:17
tpatilthank you all for voting04:17
tpatil#topic Rocky Release Items04:18
*** openstack changes topic to "Rocky Release Items (Meeting topic: masakari)"04:18
tpatil#link : https://etherpad.openstack.org/p/masakari-rocky-work-items04:18
tpatilI have added few items in the etherpad which we couldn't finish in Queens04:18
tpatilPlease add items that you want to see in Rocky release04:19
*** VW has joined #openstack-meeting04:19
tpatilSampath would like to discuss about the rocky items in the next IRC meeting04:20
rkmrHonjoOk. I added two items to "New items".04:20
tpatilrkmrHonjo: Thank you04:20
*** gongysh has joined #openstack-meeting04:20
*** gongysh has quit IRC04:21
tpatilDo we want to move the sdk code from masakariclient to openstacksdk?04:21
*** gongysh has joined #openstack-meeting04:21
tpatilI will add this item in the etherpad, let's discuss about it in the next meeting04:21
rkmrHonjoOk.04:22
*** gongysh has quit IRC04:22
*** daidv has quit IRC04:22
*** jamesmcarthur has quit IRC04:22
*** gongysh has joined #openstack-meeting04:22
*** daidv has joined #openstack-meeting04:22
tpatil#topic Bugs04:23
*** openstack changes topic to "Bugs (Meeting topic: masakari)"04:23
Dinesh_BhorThis was the ML discussion about moving code to openstacksdk: http://lists.openstack.org/pipermail/openstack-dev/2018-January/126421.html04:23
*** VW has quit IRC04:24
tpatilDinesh_Bhor: Thank for you sharing this ML thread. I will add this link in etherpad for discussion04:24
tpatilNo new bugs are reported04:24
tpatil#topic Discussion points04:25
*** openstack changes topic to "Discussion points (Meeting topic: masakari)"04:25
*** gongysh has quit IRC04:25
*** kevzha01_ has joined #openstack-meeting04:25
tpatilniraj_singh: Do you want to give any update about the progress of masakari-dashboard?04:26
niraj_singhi am still facing the same issue while runnig tox.04:26
*** VW has joined #openstack-meeting04:26
niraj_singhraise ReadError("not a gzip file")04:27
niraj_singhReadError: not a gzip file04:27
tpatilWhich gzip file is giving this error?04:28
*** kevinz has quit IRC04:28
niraj_singhhttp://tarballs.openstack.org/horizon/horizon-master.tar.gz04:28
niraj_singhI downloaded it and tried to unpack but it was giving the same error04:29
niraj_singhAlso check the file type: horizon-master.tar.gz: HTML document, ASCII text, with CRLF line terminators04:30
tpatilHave you checked whether other horizon plugins also refers to the same file?04:30
niraj_singhyes they refer the same file.04:30
niraj_singhi am configuring mistral to verify whether it is working in mistral or not04:31
*** VW has quit IRC04:31
tpatilAre you able to run tox successfully in case of mistral horizon plugin?04:31
*** sridharg has joined #openstack-meeting04:32
niraj_singhI did not verify that till now working on it.04:32
tpatilok04:32
*** salv-orlando has joined #openstack-meeting04:33
*** ekcs has joined #openstack-meeting04:33
niraj_singhNow i am able to install masakari-api service in openstack-ansible.04:34
tpatilniraj_singh: Great!!!04:34
niraj_singhthanks04:35
tpatilniraj_singh: Let's add a blueprint to install masakari service  in Openstack_ansible project04:35
niraj_singhok04:35
tpatilYou can add this item in the rocky etherpad04:35
niraj_singhok04:36
*** bkopilov has joined #openstack-meeting04:36
niraj_singhThat's it from my side.04:37
tpatilniraj_singh: thank you04:37
*** salv-orlando has quit IRC04:38
*** lpetrut has joined #openstack-meeting04:38
tpatilLet's wrap this meeting early if there are no topics left for discussion04:38
tpatilThank you all04:39
tpatil#endmeeting04:39
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"04:39
openstackMeeting ended Tue Mar 13 04:39:36 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)04:39
openstackMinutes:        http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-03-13-04.01.html04:39
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-03-13-04.01.txt04:39
openstackLog:            http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-03-13-04.01.log.html04:39
rkmrHonjobye04:39
*** rkmrHonjo has quit IRC04:40
*** Dinesh_Bhor has left #openstack-meeting04:41
*** ekcs has quit IRC04:43
*** anilvenkata has joined #openstack-meeting04:45
*** zhurong has quit IRC04:53
*** VW has joined #openstack-meeting04:55
*** kaisers has joined #openstack-meeting04:59
*** tpatil has quit IRC04:59
*** liyi has joined #openstack-meeting04:59
*** VW has quit IRC04:59
*** lpetrut has quit IRC05:05
*** edmondsw has joined #openstack-meeting05:06
*** liyi has quit IRC05:09
*** edmondsw has quit IRC05:10
*** VW has joined #openstack-meeting05:11
*** lpetrut has joined #openstack-meeting05:11
*** salv-orlando has joined #openstack-meeting05:14
*** VW has quit IRC05:16
*** longkb has quit IRC05:16
*** imcsk8 has quit IRC05:19
*** imcsk8 has joined #openstack-meeting05:19
*** VW has joined #openstack-meeting05:22
*** lpetrut has quit IRC05:23
*** sidx64 has joined #openstack-meeting05:26
*** yangyapeng has quit IRC05:30
*** VW has quit IRC05:30
*** janki has joined #openstack-meeting05:30
*** yangyapeng has joined #openstack-meeting05:30
*** VW has joined #openstack-meeting05:35
*** oanson has quit IRC05:37
*** rossella_s has quit IRC05:40
*** zhurong has joined #openstack-meeting05:41
*** rossella_s has joined #openstack-meeting05:44
*** claudiub|2 has joined #openstack-meeting05:44
*** VW has quit IRC05:48
*** VW has joined #openstack-meeting05:48
*** VW has quit IRC05:53
*** VW has joined #openstack-meeting05:55
*** rossella_s has quit IRC05:58
*** rossella_s has joined #openstack-meeting05:58
*** armax has quit IRC05:59
*** harlowja has quit IRC05:59
*** amodi has quit IRC05:59
*** gongysh has joined #openstack-meeting06:02
*** daidv has quit IRC06:04
*** liyi has joined #openstack-meeting06:07
*** david-lyle has quit IRC06:08
*** VW has quit IRC06:12
*** liyi has quit IRC06:13
*** ykatabam has quit IRC06:17
*** apetrich has joined #openstack-meeting06:19
*** marios has joined #openstack-meeting06:23
*** jamemcc has joined #openstack-meeting06:23
*** VW has joined #openstack-meeting06:26
*** masber has quit IRC06:29
*** VW has quit IRC06:31
*** sridharg has quit IRC06:32
*** anilvenkata has quit IRC06:32
*** ykatabam has joined #openstack-meeting06:32
*** oanson has joined #openstack-meeting06:38
*** oanson has quit IRC06:38
*** VW has joined #openstack-meeting06:39
*** oanson has joined #openstack-meeting06:39
*** masber has joined #openstack-meeting06:41
*** claudiub|2 has quit IRC06:44
*** anilvenkata has joined #openstack-meeting06:45
*** liusheng has quit IRC06:45
*** VW has quit IRC06:48
*** d0ugal has joined #openstack-meeting06:48
*** tovin07_ has joined #openstack-meeting06:48
*** liusheng has joined #openstack-meeting06:48
*** longkb has joined #openstack-meeting06:49
*** longkb1 has quit IRC06:51
*** edmondsw has joined #openstack-meeting06:54
*** zhurong has quit IRC06:55
*** ykatabam has quit IRC06:57
*** edmondsw has quit IRC06:59
*** armax has joined #openstack-meeting06:59
*** VW has joined #openstack-meeting07:01
*** sridharg has joined #openstack-meeting07:06
*** VW has quit IRC07:06
*** liuyulong has joined #openstack-meeting07:07
*** liyi has joined #openstack-meeting07:10
*** VW has joined #openstack-meeting07:12
*** sidx64 has quit IRC07:14
*** liyi has quit IRC07:17
*** VW has quit IRC07:17
*** Li_Jiale has joined #openstack-meeting07:19
*** ykatabam has joined #openstack-meeting07:19
*** lpetrut has joined #openstack-meeting07:20
*** VW has joined #openstack-meeting07:21
*** ttsiouts has quit IRC07:22
*** ttsiouts has joined #openstack-meeting07:22
*** sidx64 has joined #openstack-meeting07:23
*** rcernin has quit IRC07:24
*** VW has quit IRC07:26
*** VW has joined #openstack-meeting07:27
*** imcsk8 has quit IRC07:28
*** browny_ has quit IRC07:29
*** salv-orlando has quit IRC07:29
*** chyka has joined #openstack-meeting07:29
*** VW has quit IRC07:32
*** browny_ has joined #openstack-meeting07:33
*** epico has quit IRC07:34
*** salv-orlando has joined #openstack-meeting07:34
*** chyka has quit IRC07:34
*** imcsk8 has joined #openstack-meeting07:38
*** VW has joined #openstack-meeting07:40
*** epico has joined #openstack-meeting07:41
*** radeks has joined #openstack-meeting07:42
*** pcaruana has joined #openstack-meeting07:42
*** andreas_s has joined #openstack-meeting07:44
*** VW has quit IRC07:45
*** sidx64 has quit IRC07:47
*** VW has joined #openstack-meeting07:48
*** HeOS has joined #openstack-meeting07:49
*** e0ne has joined #openstack-meeting07:50
*** links has quit IRC07:52
*** VW has quit IRC07:53
*** epico has quit IRC07:53
*** sidx64 has joined #openstack-meeting07:54
*** VW has joined #openstack-meeting07:58
*** links has joined #openstack-meeting07:59
*** epico has joined #openstack-meeting08:00
*** YanXing_an has joined #openstack-meeting08:01
*** browny_ has quit IRC08:01
*** VW has quit IRC08:02
*** longkb1 has joined #openstack-meeting08:06
*** longkb has quit IRC08:08
*** longkb2 has joined #openstack-meeting08:08
*** longkb1 has quit IRC08:11
*** VW has joined #openstack-meeting08:13
*** VW has quit IRC08:18
*** browny_ has joined #openstack-meeting08:19
*** tesseract has joined #openstack-meeting08:19
*** tesseract-RH has joined #openstack-meeting08:20
*** tesseract-RH has quit IRC08:20
*** egallen has joined #openstack-meeting08:21
*** salv-orlando has quit IRC08:23
*** tssurya has joined #openstack-meeting08:23
*** phil has joined #openstack-meeting08:33
*** phil is now known as Guest1508608:34
*** sidx64 has quit IRC08:39
*** VW has joined #openstack-meeting08:39
*** shaohe_feng has joined #openstack-meeting08:40
*** liyi has joined #openstack-meeting08:41
*** edmondsw has joined #openstack-meeting08:42
*** VW has quit IRC08:44
*** liyi has quit IRC08:45
*** liyi_ has joined #openstack-meeting08:45
*** edmondsw has quit IRC08:46
*** alexchadin has joined #openstack-meeting08:46
*** YanXing_an has quit IRC08:51
*** trinaths has joined #openstack-meeting08:52
*** salv-orlando has joined #openstack-meeting08:57
*** priteau has joined #openstack-meeting08:59
*** alexchadin has quit IRC08:59
*** YanXing_an has joined #openstack-meeting09:02
*** VW has joined #openstack-meeting09:04
*** VW has quit IRC09:09
*** VW has joined #openstack-meeting09:09
*** VW has quit IRC09:14
*** apetrich has quit IRC09:18
*** VW has joined #openstack-meeting09:21
*** sridharg has quit IRC09:24
*** rubasov has joined #openstack-meeting09:24
*** sridharg has joined #openstack-meeting09:24
*** sidx64 has joined #openstack-meeting09:26
*** liyi_ has quit IRC09:26
*** VW has quit IRC09:26
*** sidx64 has quit IRC09:26
*** Li_Jiale has quit IRC09:28
*** VW has joined #openstack-meeting09:31
*** dbecker has joined #openstack-meeting09:31
*** YanXing_an has quit IRC09:32
*** YanXing_an has joined #openstack-meeting09:33
*** yangyapeng has quit IRC09:35
*** VW has quit IRC09:36
*** alexchadin has joined #openstack-meeting09:36
*** yangyapeng has joined #openstack-meeting09:37
*** browny_ has quit IRC09:38
*** wanghao_ has joined #openstack-meeting09:43
*** rossella_s has quit IRC09:44
*** dmellado has joined #openstack-meeting09:47
*** rossella_s has joined #openstack-meeting09:47
*** wanghao has quit IRC09:47
*** claudiub|2 has joined #openstack-meeting09:52
*** sidx64 has joined #openstack-meeting09:54
*** yamahata_ has quit IRC09:56
*** VW has joined #openstack-meeting09:56
*** tovin07_ has quit IRC09:59
*** anilvenkata has quit IRC09:59
*** anilvenkata has joined #openstack-meeting10:00
*** VW has quit IRC10:01
ZacharyMa1110:07
*** sidx64 has quit IRC10:08
*** sidx64 has joined #openstack-meeting10:11
*** YanXing_an has quit IRC10:12
*** sidx64 has quit IRC10:13
*** browny_ has joined #openstack-meeting10:15
*** sidx64 has joined #openstack-meeting10:18
*** browny_ has quit IRC10:19
*** sidx64 has quit IRC10:19
*** rossella_s has quit IRC10:19
*** rossella_s has joined #openstack-meeting10:20
*** browny_ has joined #openstack-meeting10:22
*** browny_ has quit IRC10:22
*** brault_ has quit IRC10:23
*** sidx64 has joined #openstack-meeting10:24
*** rossella_s has quit IRC10:26
*** liyi has joined #openstack-meeting10:27
*** rossella_s has joined #openstack-meeting10:29
*** edmondsw has joined #openstack-meeting10:30
*** VW has joined #openstack-meeting10:31
*** liyi has quit IRC10:31
*** edmondsw has quit IRC10:35
*** VW has quit IRC10:36
*** sidx64 has quit IRC10:38
*** sidx64 has joined #openstack-meeting10:45
*** pcaruana has quit IRC10:45
*** VW has joined #openstack-meeting10:46
*** brault has joined #openstack-meeting10:47
*** wanghao has joined #openstack-meeting10:50
*** VW has quit IRC10:51
*** brault has quit IRC10:52
*** wanghao_ has quit IRC10:52
*** alexchadin has quit IRC10:56
*** rbudden has joined #openstack-meeting10:59
*** browny_ has joined #openstack-meeting11:01
*** rcernin has joined #openstack-meeting11:02
*** brault has joined #openstack-meeting11:03
*** VW has joined #openstack-meeting11:03
*** browny_ has quit IRC11:04
*** chyka has joined #openstack-meeting11:06
*** alexchadin has joined #openstack-meeting11:07
*** sidx64 has quit IRC11:07
*** anilvenkata has quit IRC11:07
*** sidx64 has joined #openstack-meeting11:08
*** VW has quit IRC11:08
*** anilvenkata has joined #openstack-meeting11:09
*** brault has quit IRC11:10
*** chyka has quit IRC11:10
*** rbudden has quit IRC11:18
*** browny_ has joined #openstack-meeting11:21
*** browny_ has quit IRC11:23
*** bkopilov has quit IRC11:30
*** VW has joined #openstack-meeting11:36
*** browny_ has joined #openstack-meeting11:37
*** VW has quit IRC11:40
*** fzdarsky__ has quit IRC11:42
*** gongysh has quit IRC11:43
*** VW has joined #openstack-meeting11:44
*** sidx64 has quit IRC11:45
*** edmondsw has joined #openstack-meeting11:45
*** browny_ has quit IRC11:45
*** yamamoto has quit IRC11:46
*** brault has joined #openstack-meeting11:48
*** browny_ has joined #openstack-meeting11:48
*** VW has quit IRC11:48
*** sidx64 has joined #openstack-meeting11:49
*** sidx64 has quit IRC11:49
*** yamamoto has joined #openstack-meeting11:50
*** epico has quit IRC11:51
*** kopecmartin has joined #openstack-meeting11:51
*** trinaths has quit IRC11:52
*** egallen has quit IRC11:53
*** sidx64 has joined #openstack-meeting11:53
*** sidx64 has quit IRC11:54
*** sidx64 has joined #openstack-meeting11:55
*** salv-orlando has quit IRC11:58
*** rcernin has quit IRC12:00
*** noslzzp has joined #openstack-meeting12:00
*** yamamoto has quit IRC12:01
*** yamamoto has joined #openstack-meeting12:01
*** mikal_ has joined #openstack-meeting12:02
*** sambetts|afk is now known as sambetts12:02
*** raildo has joined #openstack-meeting12:04
*** mikal has quit IRC12:04
*** yamamoto has quit IRC12:06
*** VW has joined #openstack-meeting12:08
*** rossella_s has quit IRC12:12
*** rossella_s has joined #openstack-meeting12:12
*** VW has quit IRC12:12
*** browny_ has quit IRC12:19
*** browny_ has joined #openstack-meeting12:20
*** ZacharyMa has quit IRC12:20
*** janki has quit IRC12:25
*** browny_ has quit IRC12:25
*** liyi has joined #openstack-meeting12:29
*** fabian has joined #openstack-meeting12:29
*** yangyapeng has quit IRC12:30
*** fabian is now known as chenyb4_12:30
*** browny_ has joined #openstack-meeting12:30
*** yangyapeng has joined #openstack-meeting12:30
*** liyi has quit IRC12:35
*** zhurong has joined #openstack-meeting12:35
*** pchavva has joined #openstack-meeting12:38
*** VW has joined #openstack-meeting12:39
*** Zames has joined #openstack-meeting12:39
*** rbudden has joined #openstack-meeting12:41
*** _pewp_ has quit IRC12:41
*** wanghao has quit IRC12:42
*** zhurong has quit IRC12:42
*** egallen has joined #openstack-meeting12:43
*** _pewp_ has joined #openstack-meeting12:43
*** Zames has quit IRC12:43
*** VW has quit IRC12:43
*** chenyb4_ is now known as chenyb412:44
*** zhurong has joined #openstack-meeting12:45
*** zhiyuan has quit IRC12:45
*** zhiyuan has joined #openstack-meeting12:45
*** eharney has quit IRC12:45
*** dprince has joined #openstack-meeting12:49
*** Zames has joined #openstack-meeting12:49
*** mriedem has joined #openstack-meeting12:51
*** VW has joined #openstack-meeting12:52
*** hoangcx_ has joined #openstack-meeting12:53
*** fnaval has joined #openstack-meeting12:54
*** rosmaita has joined #openstack-meeting12:57
*** VW has quit IRC12:57
*** dtruong2 has joined #openstack-meeting12:58
*** rbowen has left #openstack-meeting12:58
*** chohoor has joined #openstack-meeting12:58
*** salv-orlando has joined #openstack-meeting12:59
*** Zames has quit IRC12:59
*** XueFeng has joined #openstack-meeting13:00
XueFeng#startmeeting senlin13:00
openstackMeeting started Tue Mar 13 13:00:28 2018 UTC and is due to finish in 60 minutes.  The chair is XueFeng. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
*** openstack changes topic to " (Meeting topic: senlin)"13:00
openstackThe meeting name has been set to 'senlin'13:00
XueFenghello everyone13:01
dtruong2hello13:01
chohoor:)13:02
chenyb4hello13:02
XueFengLet's wait a moment13:03
*** mmethot has joined #openstack-meeting13:03
XueFengHere is the agenda :https://wiki.openstack.org/wiki/Meetings/SenlinAgenda13:03
*** wanghao has joined #openstack-meeting13:04
XueFengHere is rocky cycle work items:https://etherpad.openstack.org/p/senlin-rocky-workitems13:04
*** salv-orlando has quit IRC13:04
XueFenghi dtruong2, chohoor, chenyb413:05
XueFenglet's get started13:05
*** lhx_ has quit IRC13:06
*** psachin has quit IRC13:07
XueFeng#topic fast scaling spec13:08
*** openstack changes topic to "fast scaling spec (Meeting topic: senlin)"13:08
XueFenghi chohoor13:08
XueFenghttps://github.com/openstack/senlin/blob/master/doc/specs/cluster-fast-scaling.rst13:08
XueFengWhich status about the spec13:08
*** julim has quit IRC13:08
chohooryes, this is a old spec in last year, I'll do it next week.13:09
XueFengOk13:09
*** cloudrancher has quit IRC13:10
*** julim has joined #openstack-meeting13:10
XueFengAny new process, call us13:10
*** cloudrancher has joined #openstack-meeting13:11
XueFenglet's move13:11
XueFeng#topic K8s on Senlin13:11
*** openstack changes topic to "K8s on Senlin (Meeting topic: senlin)"13:11
XueFengdtruong2, "Drain node before deleting worker node" can be implemented using lifecycle hooks." is add by you ?13:13
dtruong2Yes, I added that line13:13
dtruong2If I understand correctly, I think this can be done using the lifecycle hooks in the deletion policy.13:14
XueFengYes, I think so13:14
XueFengThis can be related with you last patch?13:14
XueFengs/patch/spec13:14
dtruong2I finished the implementation of the lifecycle hook spec.13:15
*** zhurong has quit IRC13:15
XueFengGreat13:15
dtruong2It was already merged in Queens13:15
XueFengyes13:15
dtruong2So K8s on senlin can use it to drain the node13:16
XueFengOK, this can be verified when ks8 on senlin developing13:17
XueFengAnd also we have some todo about "k8s on senlin":https://review.openstack.org/#/c/515321/5/contrib/kubernetes/TODO.rst13:17
XueFengAny body feels free to pick it and implement them13:18
*** dustins has joined #openstack-meeting13:18
dtruong2i can help with the drain node integration with lifecycle hook13:19
XueFengOK, thanks dtruong213:19
*** VW has joined #openstack-meeting13:19
*** dustins has quit IRC13:19
XueFengchenyb413:19
chenyb4yes13:19
*** jamesmcarthur has joined #openstack-meeting13:20
*** dustins has joined #openstack-meeting13:20
XueFengThe work about senlinclient has finished13:21
chenyb4With k8s todo, it's not clear how to start13:21
chenyb4yes, senlinclient function test has finished13:21
chenyb4But the openstack- SDK gives us some difficulties with the version.13:22
XueFengFirst, you can study from the videos:you guys can study this 4]https://v.qq.com/x/page/i05125sfonh.html13:23
XueFeng[5]https://v.qq.com/x/page/t0512vo6tw1.html13:23
XueFeng[6]https://v.qq.com/x/page/y0512ehqiiq.html13:23
*** mjturek has joined #openstack-meeting13:23
chenyb4ok, i will study13:24
XueFengok13:26
XueFengThen can do this first: Add more network interfaces in drivers.13:27
*** VW has quit IRC13:28
*** wanghao has quit IRC13:28
chenyb4What interface? About k8s network?13:28
*** gongysh has joined #openstack-meeting13:28
*** wanghao has joined #openstack-meeting13:28
*** yangyapeng has quit IRC13:29
*** wanghao has quit IRC13:29
XueFengin senlin side13:29
*** wanghao has joined #openstack-meeting13:29
*** wanghao has quit IRC13:29
*** yangyapeng has joined #openstack-meeting13:29
*** wanghao has joined #openstack-meeting13:30
*** yangyapeng has quit IRC13:30
*** wanghao has quit IRC13:30
*** wanghao has joined #openstack-meeting13:31
*** wanghao has quit IRC13:31
chenyb4What scenario is used?13:31
XueFenghttps://github.com/openstack/senlin/blob/master/contrib/kubernetes/kube/base.py#L7513:31
*** wanghao has joined #openstack-meeting13:32
chenyb4Ok, I known.13:32
*** wanghao has quit IRC13:32
*** wanghao has joined #openstack-meeting13:33
*** wanghao has quit IRC13:33
XueFengOk, let's move13:33
*** singlethink has joined #openstack-meeting13:34
*** yamamoto has joined #openstack-meeting13:34
*** jinli has joined #openstack-meeting13:34
XueFeng#topic important Bugs:13:35
*** openstack changes topic to "important Bugs: (Meeting topic: senlin)"13:35
XueFenghttps://bugs.launchpad.net/senlin/+bug/175201413:36
openstackLaunchpad bug 1752014 in senlin "cluster list --limit return error" [Undecided,New]13:36
*** julim has quit IRC13:36
*** eharney has joined #openstack-meeting13:37
*** VW has joined #openstack-meeting13:37
XueFengchenyb413:37
*** julim has joined #openstack-meeting13:38
*** VW has quit IRC13:38
chenyb4This bug has little to do with senlin and is supported by the python-openstacksdk.13:38
*** VW has joined #openstack-meeting13:39
*** _pewp_ has quit IRC13:39
*** yamamoto has quit IRC13:39
chenyb4I will submit a bug in the python-openstacksdk about limit.13:39
XueFengSo we should fixes python-openstacksdk ?13:39
XueFengOK13:39
*** _pewp_ has joined #openstack-meeting13:40
chenyb4Need SDK support.13:40
XueFengYep13:41
XueFenghttps://bugs.launchpad.net/senlin/+bug/173235513:41
openstackLaunchpad bug 1732355 in senlin "Cannot stop messaging listener after health policy detached" [Undecided,In progress] - Assigned to chenyb4 (chenyb4)13:41
*** SerenaFeng has joined #openstack-meeting13:41
*** watanabe_isao has joined #openstack-meeting13:41
*** jroll has quit IRC13:41
*** jroll has joined #openstack-meeting13:42
*** bkopilov has joined #openstack-meeting13:42
XueFengThis one, you in process?chenyb4?13:43
chenyb4https://review.openstack.org/#/c/521892/13:44
XueFengok, we can close this bug13:45
XueFenghttps://bugs.launchpad.net/senlin/+bug/175454713:45
openstackLaunchpad bug 1754547 in senlin "aodh alarm create: error: argument -t/--type" [Undecided,New]13:45
*** lpetrut has quit IRC13:45
XueFengAnd this one, is  not ab bug for senlin13:45
chenyb4The bug code has been committed, but is paused.13:45
*** janzian has joined #openstack-meeting13:45
chenyb4yes, only doc error13:45
chenyb4aodh alarm create parameter has change13:46
XueFengYes, we can fix the doc error13:46
dtruong2i have to leave the meeting.  if you need anything from me, please contact me on senlin channel.13:47
XueFengOk, dtruong213:47
XueFengthanks13:48
XueFenghttps://bugs.launchpad.net/python-senlinclient/+bug/175398813:48
openstackLaunchpad bug 1753988 in python-senlinclient "'cluster profile list' is not an openstack command" [Undecided,New]13:48
*** pasuder has joined #openstack-meeting13:49
XueFengThis also can be closed13:49
chenyb4yes13:49
*** watanabe_isao has quit IRC13:49
*** jlibosva has joined #openstack-meeting13:50
XueFengOK, the last bug:https://bugs.launchpad.net/senlin/+bug/175214313:51
openstackLaunchpad bug 1752143 in senlin "Senlin rally job is broken" [Undecided,Confirmed]13:51
XueFengI will fix it13:51
*** hichihara has joined #openstack-meeting13:52
*** caowei has quit IRC13:52
chenyb4ok13:52
*** dtruong2 has quit IRC13:52
XueFengOK, that's all about the work items13:52
*** yamamoto has joined #openstack-meeting13:53
*** mlavalle has joined #openstack-meeting13:53
*** caowei has joined #openstack-meeting13:53
*** esberglu has joined #openstack-meeting13:53
chenyb4I have two questions.13:54
XueFengthanks13:54
*** awaugama has joined #openstack-meeting13:54
XueFengyes13:54
chenyb4ok, let's move to senlin channel13:54
XueFengok13:54
XueFengthanks again13:54
XueFengLet's end meeting13:55
*** yamamoto has quit IRC13:55
XueFeng#endmeeting13:55
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"13:55
openstackMeeting ended Tue Mar 13 13:55:14 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:55
openstackMinutes:        http://eavesdrop.openstack.org/meetings/senlin/2018/senlin.2018-03-13-13.00.html13:55
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/senlin/2018/senlin.2018-03-13-13.00.txt13:55
openstackLog:            http://eavesdrop.openstack.org/meetings/senlin/2018/senlin.2018-03-13-13.00.log.html13:55
*** chohoor has left #openstack-meeting13:55
*** mjturek has quit IRC13:59
*** salv-orlando has joined #openstack-meeting14:00
*** VW_ has joined #openstack-meeting14:00
*** VW has quit IRC14:00
*** gouthamr has joined #openstack-meeting14:00
jlibosva#startmeeting networking14:01
openstackMeeting started Tue Mar 13 14:01:03 2018 UTC and is due to finish in 60 minutes.  The chair is jlibosva. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
*** openstack changes topic to " (Meeting topic: networking)"14:01
jlibosvahi all14:01
openstackThe meeting name has been set to 'networking'14:01
mlavalleo/14:01
jlibosva#topic Announcements14:01
*** YanXing_an has joined #openstack-meeting14:01
*** openstack changes topic to "Announcements (Meeting topic: networking)"14:01
aspierso/14:01
*** ndefigueiredo has joined #openstack-meeting14:01
jlibosvaThis is the first Tuesday meeting after the PTG14:01
pasuderhello!14:01
slaweqhello14:01
jlibosvamlavalle sent out a nice summary here14:01
jlibosva#link http://lists.openstack.org/pipermail/openstack-dev/2018-March/128183.html14:01
pasudertrue +114:01
haleybhi14:02
ndefigueiredoHi guys14:02
jlibosvain development cycle, we're currently at Rocky-1 which is due at the week of 16 Apr14:02
* mlavalle wonders how haleyb is doing wit the latest storm14:02
*** kiennt26 has joined #openstack-meeting14:02
hichiharahi14:02
haleybno trees fell down yet, cross fingers14:02
*** VW_ has quit IRC14:03
mlavallegood luck!14:03
jlibosvafingers crossed haleyb :)14:03
amotokihi14:03
*** VW has joined #openstack-meeting14:03
jlibosvathat's all from me, any other announcements from anybody?14:03
rubasovhi14:03
mlavalleNot from me14:04
ndefigueiredojust a question about the meeting structure14:04
ndefigueiredois there an agenda?14:04
*** salv-orlando has quit IRC14:04
jlibosvandefigueiredo: we have a wiki page: https://wiki.openstack.org/wiki/Network/Meetings14:04
*** lajoskatona_ has joined #openstack-meeting14:04
ndefigueiredothanks14:05
*** yanxingan has joined #openstack-meeting14:05
*** YanXing_an has quit IRC14:05
mlavallendefigueiredo: good question :-)14:05
mlavallendefigueiredo: and you can add a topic at the end, in the open agenda section14:05
mlavalleif you need to14:06
jlibosvaand I need to remove the one that I added :)14:06
*** bobh has joined #openstack-meeting14:06
jlibosvaas it was discussed already14:06
jlibosvaanyway, moving on14:06
jlibosva#topic Blueprints14:06
mlavalleyou are always welcome to add topics14:06
*** openstack changes topic to "Blueprints (Meeting topic: networking)"14:06
jlibosva#link https://launchpad.net/neutron/+milestone/rocky-114:06
mlavalleRegarding the Rocky-1 milestone, I want to point out that it is not complete yet14:07
ndefigueiredomlavalle: will do.14:07
mlavallein the dashboard14:07
jlibosvaack14:07
*** amodi has joined #openstack-meeting14:08
mlavalleI have to go thorugh the PTG summary14:08
*** VW has quit IRC14:08
mlavalleand add blueprints from there that don't exist in Launchpad yet14:08
pasudermlavalle: I noticed in the morning that I am assigned person to subnetpool blueprint. Shall I do something more or just continue with working on implementation?14:08
mlavallepasuder: just continue working on implementation14:09
pasudermlavalle: thx14:09
mlavalleI am trying to do the "paperwork" for you all14:09
amotokipasuder: which one?14:09
mlavalleso you can focus on the development side14:09
pasuderthx!14:09
pasuderamotoki: https://blueprints.launchpad.net/neutron/+spec/subnet-onboard14:09
mlavallethe Launchpad "paperwork"14:09
pasudermlavalle: understand, thank you14:09
amotokipasuder: thanks14:10
mlavalleas I go through the PTG summary, I might contact some of you when creating the blueprints in Launchpad14:10
mlavallepasuder: the idea of this ection of the meeting is that you can report status of your assigned blueprint14:11
mlavalleor ask for hel (reviews for example) in case you are stuck14:11
mlavallehelp^^^14:11
pasudermlavalle: at this moment I do not have anything to report14:12
mlavallendefigueiredo: please look at the PTG summary. there is one or two places where your name pops up14:12
mlavalleso you and I will have to create one or two blueprints14:12
mlavalleabd ad it to the dashboard14:13
ndefigueiredomlavalle: just having some trouble finding things as I learn.14:13
mlavalleno problem, we are here to help14:13
jlibosvandefigueiredo: in any case you have troubles, feel free to ping us on #openstack-neutron channel :)14:13
mlavalledon't by shy about asking questions, please14:13
jlibosva++14:14
slaweq++14:14
amotoki++14:14
mlavallendefigueiredo: yeah, jlibosva is in Prague, very close to your time zone14:14
*** alexchadin has quit IRC14:14
*** sidx64 has quit IRC14:14
ndefigueiredook, thank you. If I can ask now: 1) is there a place for adding the agenda items? 2) where can I see the PTG summary?14:14
mlavallethe same as slaweq14:14
mlavallehe is in Poland14:14
jlibosvandefigueiredo: sure, at this wiki, once you're logged in, you can click Edit button: https://wiki.openstack.org/wiki/Network/Meetings14:15
jlibosvandefigueiredo: and at the very bottom, there is On Demand Agenda where you can put your topic14:15
ndefigueiredojlibosva: cool, thanks :)14:15
jlibosvawe usually have 5-15 minutes at the end of each meeting dedicated for such topics14:15
ndefigueiredofwiw I am in South Africa (+2 timezone) currently.14:16
pasuderndefigueiredo: same in PL and CZ :)14:16
mlavalleand there are no stupid questions.... well, ocasionally that PTG guys comes up with a few14:16
mlavalle;-)14:16
*** sidx64 has joined #openstack-meeting14:16
pasuder:D14:17
amotokiyou are in a same time zone even though you are in different seasons :)14:17
pasuderamotoki: true :) same but different14:17
jlibosvaso unless there is anything else to be added to blueprints, I suggest to move on :)14:18
ndefigueiredoamotoki: Yes! It is hot here (end of summer)!14:18
jlibosvandefigueiredo: oh, one more thing :)14:18
jlibosvandefigueiredo: even if at the end at the open agenda topic there is nothing in the wiki, feel free to bring any topic even without writing it to the wiki page14:19
jlibosvaok, now moving on :)14:19
jlibosva#topic Community Goals14:19
*** openstack changes topic to "Community Goals (Meeting topic: networking)"14:19
jlibosva#link https://governance.openstack.org/tc/goals/index.html#release-cycles14:19
*** alexchadin has joined #openstack-meeting14:20
*** alexchadin has quit IRC14:20
jlibosvaso seems like we have some debts from previous cycles14:20
amotokiwe newly added this section in Rocky so that we can sync more with community goals.14:20
mlavallehere, I want to say that annp sent me an email asking if he can work on https://governance.openstack.org/tc/goals/pike/deploy-api-in-wsgi.html.14:20
amotoki:)14:21
jlibosvaright and I saw at the BP dashboard we already track some of the missing goals14:21
ndefigueiredojlibosva: Cool, got it14:21
jlibosvaannp++ great :)14:21
mlavalleamotoki: you ok with it?14:21
amotokimlavalle: yes14:21
mlavalleI'll respond to his email copying you14:22
amotoki IIRC we already have a WIP devstack patch. we can resume the work based on it14:22
mlavalleyes, please respond to the email with a pointer to it14:22
*** lhx_ has joined #openstack-meeting14:22
amotokisure14:22
*** annp has joined #openstack-meeting14:23
*** boden has joined #openstack-meeting14:23
jlibosvaI'm looking that the python3.5 support is not written at the wiki page but I don't think we're done with it14:23
mlavalleoh really?14:23
jlibosvawe did some work to make functional tests working with python3 and I think it hasn't been finished14:23
slaweqI only know we had some experimental jobs for py3514:24
jlibosvahttps://etherpad.openstack.org/p/py3-neutron-pike14:24
mlavalleok, let's add it to the wiki14:24
amotokiso, do we need to enable python3 in more gate jobs?14:24
mlavalleand I will hunt down the blueprint if one ever existed and add it to the dasjboard14:24
jlibosvaI think it would be nice to get at least functional python3 job running and passing14:25
*** ykatabam has quit IRC14:25
jlibosvaI'll search for the eventlet bug to see how it stands, I remember vstinner working on it14:25
mlavallejlibosva: was there ever a launchpad blueprint for it? do you know?14:26
jlibosvamlavalle: I think there was an Issue on eventlet github IIRc14:26
mlavalleok, I'll also try to find it14:26
jlibosvamlavalle: oh, there was: https://bugs.launchpad.net/oslo.service/+bug/170504714:27
openstackLaunchpad bug 1705047 in oslo.service "Race condition in signal handling on Python 3" [High,In progress] - Assigned to Victor Stinner (victor-stinner)14:27
mlavallethanks!14:27
mlavallejlibosva: good catch about us missing that community goal as well14:28
jlibosvaright, I think we're not able to gracefully shutdown multiprocessed processes, like neutron-server14:28
jlibosvamlavalle: thanks :)14:28
*** eharney has quit IRC14:28
amotokisome updates on the other community goals14:29
*** annp has quit IRC14:29
amotokire: policy-in-code, there is no explicit progress this week but I had time to look into more. i will update it later this week14:29
*** felipemonteiro has joined #openstack-meeting14:29
amotokire: mox removal, we successfully got assignees :)14:29
mlavalleyaay!14:29
mlavallewho are they?14:30
haleybthis bug is tracking the work, https://bugs.launchpad.net/bugs/175350414:30
openstackLaunchpad bug 1753504 in python-neutronclient "Remove mox/mox3 usage from testing" [High,In progress] - Assigned to Hongbin Lu (hongbin.lu)14:30
amotokihongbin works on neutronclient14:30
amotokihaleyb: yes14:30
mlavalleah great!14:30
*** eharney has joined #openstack-meeting14:30
*** annp has joined #openstack-meeting14:30
amotokiI covered dashboard stuffs too14:30
amotokimidonet stuff depends on neutronclient and yamamoto is aware of it too14:31
*** SerenaFeng has quit IRC14:31
*** hongbin has joined #openstack-meeting14:31
slaweqI can take a look at https://governance.openstack.org/tc/goals/rocky/enable-mutable-configuration.html if there is no other volunteer14:32
amotokithat's all from me14:32
*** liyi has joined #openstack-meeting14:32
mlavalleslaweq: thanks. yes, please go ahead14:32
amotokislaweq: thanks.14:33
jlibosvathanks for updates14:33
jlibosvaanything else to community goals?14:33
mlavalleso at this point we have asignees for all of them, right amotoki ?14:33
amotokiso, we seems to have assignees for all goals14:33
slaweqok, so I will take care, thx14:33
*** janki has joined #openstack-meeting14:33
pasuder:D14:33
mlavalleGreat!14:33
amotokilet's update the wiki page :)14:33
jlibosvagood :)14:34
jlibosvamoving on14:34
jlibosva#topic Bugs14:34
*** openstack changes topic to "Bugs (Meeting topic: networking)"14:34
jlibosvahaleyb sent an email about last week14:34
haleybhttp://lists.openstack.org/pipermail/openstack-dev/2018-March/128182.html14:34
jlibosva#link http://lists.openstack.org/pipermail/openstack-dev/2018-March/128182.html14:34
jlibosvaah14:35
mlavalleyou were preparing for the storm, right?14:35
jlibosvathanks haleyb :)14:35
* haleyb had that paste waiting :)14:35
haleybi'll go through high and those that need attention14:35
haleybhttps://bugs.launchpad.net/bugs/175406214:35
openstackLaunchpad bug 1754062 in OpenStack SDK "openstack client does not pass prefixlen when creating subnet" [Undecided,New]14:35
haleybtwo fixes proposed for that, one has merged for the api-ref, openstacksdk change yet to merge14:36
haleybhttps://bugs.launchpad.net/bugs/175432714:36
openstackLaunchpad bug 1754327 in neutron "Tempest scenario jobs failing due to no FIP connectivity" [High,Fix released] - Assigned to Slawek Kaplonski (slaweq)14:36
amotokido we need OSC fix in addition to SDK?14:36
amotokii haven't checked it yet.14:37
haleybamotoki: no, just the sdk it seems, it was filtering the argument from what i remember14:37
amotokihaleyb: ah, it is possible. i will check it later.14:38
haleybamotoki: thanks, i knew you had reviewed that change too14:38
haleybmoving on the tempest bug, slawek's change has mergeed to increase ssh timeout value, so it is fixed14:39
haleybhttps://bugs.launchpad.net/bugs/175524314:39
openstackLaunchpad bug 1755243 in neutron "AttributeError when updating DvrEdgeRouter objects running on network nodes" [High,In progress] - Assigned to Daniel Gonzalez Nothnagel (dgonzalez)14:39
slaweqyes, and I think that lb scenario job is much better now :)14:39
*** liyi has quit IRC14:39
*** sidx64 has quit IRC14:39
haleybslaweq: yes, thanks!14:40
* jlibosva refreshes grafana14:40
* mlavalle suspected jlibosva was going to do that14:40
slaweqLOL14:40
mlavalle:-)14:40
jlibosva:)14:40
amotokisomeone seems to have disabled auto refresh :p14:41
haleybregarding the DVR bug ^^^, there was a scenario where the agent could try and read an invalid attribute, fix proposed yesterday, just needs updates based on comments14:41
haleybhttps://review.openstack.org/#/c/552097/14:42
jlibosvawow! 4% at LB job, *clap clap* slaweq14:42
slaweqthx14:42
mlavalleNice!14:42
* haleyb waits for applause to lessen before moving on :)14:42
*** chyka has joined #openstack-meeting14:42
amotoki#thanks slaweq succeeds to improve linuxbridge failure rate much :)14:43
amotokino thanks bot?14:43
haleybok, last high priority from last week is https://bugs.launchpad.net/bugs/175456314:44
openstackLaunchpad bug 1754563 in neutron "Arp_responder function has failed since Ocata" [High,Confirmed]14:44
*** rossella_s has quit IRC14:44
*** sidx64 has joined #openstack-meeting14:44
haleybthere is a missing setup_privsep() call in the linuxbridge agent, which slaweq had actually just fixed in another change, i cherry-picked the relevant file to queens and will propose to pike as well14:45
slaweqhaleyb: I think it is also needed for ocata14:45
slaweqas there are privileged.add_neigh_entry() used there also14:45
slaweqhttps://github.com/openstack/neutron/blob/stable/ocata/neutron/agent/linux/ip_lib.py#L98214:46
haleybslaweq: yes, i just know stable policy might mean security critical only14:46
*** rossella_s has joined #openstack-meeting14:46
slaweqah, ok14:46
haleybhttps://docs.openstack.org/project-team-guide/stable-branches.html14:46
amotokifrom several discussions, "critical fixes" depends on context14:47
slaweqisn't this issue critical for LB agent?14:47
jlibosvaI would say yes if arp responder doesn't work without it14:47
haleybyes, and it is up to us being the maintainers, so we can override security only14:48
jlibosvaalso given the complexity of the patch ...14:48
haleybjlibosva: whoa, those two lines are crazy!14:48
mlavalleLOL14:48
jlibosvatwo? I thought it's a oneliner14:49
haleybi will push the two additional changes14:49
jlibosvaoh, right, import :)14:49
haleybone import, one line of running code14:49
amotoki-1/+1 means 2 lines?14:49
slaweqamotoki: it's +2 only14:49
amotokianother simple case :)14:49
mlavallelet's move on... I would like to hvae 5 min at the end for aspiers14:49
haleyblet's move on since we have :11 left14:49
jlibosvaok, we have 10 minutes left and still some agenda :)14:50
haleybhttps://bugs.launchpad.net/bugs/175343414:50
openstackLaunchpad bug 1753434 in neutron "Unbound ports floating ip not working with address scopes in DVR HA " [Undecided,Confirmed]14:50
aspiers:)14:50
haleybi need to triage that further to see if it's still broken in master14:50
haleybnext one14:50
haleybhttps://bugs.launchpad.net/bugs/175469514:50
openstackLaunchpad bug 1754695 in neutron "Incorrect state of the Openflow table" [Undecided,New]14:50
*** alexchadin has joined #openstack-meeting14:51
haleyblatest comment on that was that restarting neutron_openvswitch_agent container fixed issue14:51
*** SerenaFeng has joined #openstack-meeting14:51
haleybanyone willing to take a closer look?14:51
mlavalleI will14:51
haleybsold!14:51
haleyblast untriaged is https://bugs.launchpad.net/bugs/175460014:52
openstackLaunchpad bug 1716043 in neutron "duplicate for #1754600 no CLI for quota details" [Low,In progress] - Assigned to Slawek Kaplonski (slaweq)14:52
haleybbut actually see that was just marked a duplicate14:52
jlibosvacool :)14:52
jlibosvathanks haleyb for updates14:52
jlibosvajust a reminder that bzhao is a bug deputy for this week14:53
*** browny_ has quit IRC14:53
haleybmlavalle: there were two new rfes as well for drivers team14:53
* mlavalle will talk to him tonight14:53
jlibosvaamotoki: boden do you have any updates to docs, cli or lib or can we skip the topic?14:53
mlavallehaleyb: yeap, I saw them14:53
bodenjlibosva: well considering time I guess we can skip.. I can follow-up offline as needed14:53
jlibosvaboden: thanks :)14:53
*** alexchadin has quit IRC14:53
jlibosvasorry about my bad timing14:53
jlibosva#topic On demand agenda14:54
amotokion SDK, i am preparing an etherpad page on gap between neutronclient and openstacksdk https://etherpad.openstack.org/p/neutron-openstacksdk-migration14:54
*** openstack changes topic to "On demand agenda (Meeting topic: networking)"14:54
jlibosvaoh, sorry amotoki for changing topic already14:54
amotokiit is WIP. I would like to double check with slaweq after i check it.14:54
mlavalleamotoki: thanks. good initaitive :-)14:54
amotokijlibosva: no problem14:54
jlibosvathanks amotoki14:54
*** wxy| has joined #openstack-meeting14:54
jlibosvaaspiers put an agenda item here https://wiki.openstack.org/wiki/Network/Meetings#On_Demand_Agenda14:54
jlibosvaaspiers: stage is yours :)14:54
aspiersthanks14:54
aspiershi all14:54
slaweqamotoki: sure14:55
aspiersdetails are in the link above really, but this idea came out of discussions at the PTG14:55
aspiersI have written a Python module git-deps which can predict the complexity of porting tasks14:55
rubasovhi14:55
*** wxy| has quit IRC14:55
aspiers#link https://github.com/aspiers/git-deps#use-case-1-porting-between-branches14:55
*** ykatabam has joined #openstack-meeting14:55
*** ykatabam has quit IRC14:55
aspiersso question is, would it be useful to include this in neutron's stable branch checks pipeline14:55
aspierssorry, I mean in master14:56
*** wxy| has joined #openstack-meeting14:56
aspiersto get a heads up on the impact of a change in master on potential backporting work14:56
amotokiwhat complexity does it check?14:56
rubasovI'm here (together with my colleague lajoskatona) to help with the minimum bandwidth stuff this cycle14:56
aspiersI talked to Tony Breeds about it and he suggested neutron might be a good place to try it first, since you are apparently very proactive with backporting :)14:56
*** yanxingan has quit IRC14:56
aspiersamotoki: it checks how many dependent commits are required in order for a patch to apply14:57
rubasovwe couldn't be there on the ptg unfortunately14:57
jlibosvait would be good to hook it with launchpad tags like "queens-backport-potential"14:57
*** gongysh has quit IRC14:57
rubasovbut from other colleagues (working with nova) I know the overall plan has changed a lot14:57
amotokiaspiers: interesting initiative14:58
aspiersif people are interested in trying it, I'd be very happy to help14:58
rubasovdoes anybody plan to re-spin the neutron-side spec for minimum bandwidth based on the current thinking?14:58
mlavallerubasov: let's you an I talk in the neutron channel14:58
aspiersit's more or less ready for use right now, would just need wrapping in a zuul job I guess14:58
amotokiit seems two topics are discussed in paralell :(14:58
mlavalleaspiers: would it be a job in the check queue?14:59
rubasovwill take this topic offline with mlavalle, thanks14:59
aspiersmlavalle: yes14:59
aspiersmlavalle: well, it could be run manually too14:59
aspierseven during development14:59
jlibosvawe can discuss details in the channel or perhaps summarizing the idea to ML about what aspiers talks about would be good?14:59
jlibosvaas we're running out of time ..14:59
aspiersjlibosva: fine by me14:59
jlibosvaaspiers: thanks a lot!14:59
jlibosvait sounds interesting initiative :)15:00
mlavalleyeah, let's start a ML thread15:00
aspiersI can hop over to neutron channel now15:00
jlibosvarubasov: thanks for raising that topic too :)15:00
jlibosvaand thanks everybody for showing up15:00
mlavalleyes, I founf it interesting in the PTG and asked aspiers to share with the team15:00
*** rosmaita has left #openstack-meeting15:00
jlibosva#endmeeting15:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:00
openstackMeeting ended Tue Mar 13 15:00:26 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:00
slaweqthx15:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-03-13-14.01.html15:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-03-13-14.01.txt15:00
openstackLog:            http://eavesdrop.openstack.org/meetings/networking/2018/networking.2018-03-13-14.01.log.html15:00
mlavallendefigueiredo: delighted to have you on-board15:00
*** lajoskatona_ has quit IRC15:00
amotokithanks15:00
*** salv-orlando has joined #openstack-meeting15:00
pasuderbye! thx!15:00
*** SerenaFeng has quit IRC15:01
*** pasuder has left #openstack-meeting15:01
slaweq#startmeeting neutron_qos15:01
openstackMeeting started Tue Mar 13 15:01:06 2018 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: neutron_qos)"15:01
openstackThe meeting name has been set to 'neutron_qos'15:01
*** gongysh has joined #openstack-meeting15:01
ndefigueiredomlavalle: Very glad to be a part of the team!15:01
slaweqhi on another meeting for those who are interested in neutron-qos :)15:01
mlavalleo/15:01
*** annp has quit IRC15:01
*** markstur has joined #openstack-meeting15:01
slaweqcan we have 2 minutes before we will start really?15:02
*** gongysh has quit IRC15:02
*** hichihara has quit IRC15:02
mlavalleure15:02
*** hoangcx_ has quit IRC15:03
*** alexchadin has joined #openstack-meeting15:04
*** munimeha1 has joined #openstack-meeting15:04
slaweqok, I'm back now15:04
slaweqso can we start?15:05
slaweq#topic RFEs15:05
*** openstack changes topic to "RFEs (Meeting topic: neutron_qos)"15:05
*** salv-orlando has quit IRC15:05
*** boden has left #openstack-meeting15:05
slaweqmlavalle: are You here?15:06
mlavalleyes I am15:06
njohnstono/15:06
slaweqhi njohnston :)15:06
njohnstonHello slaweq!15:07
slaweqfirst rfe for today15:07
slaweq#link https://bugs.launchpad.net/neutron/+bug/156096315:07
openstackLaunchpad bug 1560963 in neutron "[RFE] Minimum bandwidth support (egress)" [Wishlist,In progress]15:07
mlavalleI can update here15:07
*** jlibosva has left #openstack-meeting15:07
slaweqgo on mlavalle15:08
mlavalleThis work is being tackled on the NOva side by gibi. he is one of the Nova cores15:08
slaweqmlavalle: I think You are talking about #link https://bugs.launchpad.net/neutron/+bug/157898915:09
openstackLaunchpad bug 1578989 in neutron "[RFE] Strict minimum bandwidth support (egress)" [Wishlist,In progress] - Assigned to Slawek Kaplonski (slaweq)15:09
mlavallewe had a session on it in Dublin15:09
slaweqam I right?15:09
mlavalleyes15:09
slaweqok, so let's go with this one15:09
slaweqplease continue15:09
*** chenyb4 has quit IRC15:09
mlavalleand rubasov is going to help on the Neutron side15:10
mlavallehe is going to re-spin https://review.openstack.org/#/c/508149/15:10
mlavallebased on what was discussed in Dublin15:11
slaweqgreat15:11
mlavalleand the progress made on the NOva side spec:15:11
mlavallehttps://review.openstack.org/#/c/502306/15:11
slaweqon Nova side it's almost ready I think15:12
mlavalleI will personally work implementing the Neutron side15:12
mlavallebut now we will have help from rubasov and lajoskatona15:13
slaweqthx mlavalle and rubasov :)15:13
*** browny_ has joined #openstack-meeting15:13
slaweqso getting back to https://bugs.launchpad.net/neutron/+bug/156096315:14
openstackLaunchpad bug 1560963 in neutron "[RFE] Minimum bandwidth support (egress)" [Wishlist,In progress]15:14
slaweqthis is somehow related to what mlavalle said15:14
mlavalleslaweq: sorry for the mix up15:14
slaweqit is matter of backend implementation of such minimum bandwidth rule15:15
*** lajoskatona_ has joined #openstack-meeting15:15
slaweqmlavalle: no, it was even better to start from what You said :)15:15
*** kiennt26 has quit IRC15:15
slaweqfor https://bugs.launchpad.net/neutron/+bug/1560963 there was patch for LB agent made by ralonsoh some time ago15:15
openstackLaunchpad bug 1560963 in neutron "[RFE] Minimum bandwidth support (egress)" [Wishlist,In progress]15:15
mlavalle:-)15:15
slaweqbut it wasn't working well and was reverted15:16
*** artom has joined #openstack-meeting15:16
*** kiennt26 has joined #openstack-meeting15:16
slaweqand to be honest it will be quite tricky to provide such traffic shaping with minimum bandwidth for port15:16
rubasovhi all15:16
lajoskatona_Hi15:17
slaweqproblem is that tc allows to shape egress traffic and we need to shape traffic which is ingress from bridge POV15:17
slaweqI want to check how we can use IFB devices for that as I think it is only possible solution15:17
slaweqhi lajoskatona_ and rubasov15:17
mlavallerubasov: we are discussing the fact that minimum bandwidth rules are only implemented for egress15:17
slaweqmaybe someone have some other ideas or want to work on it?15:18
mlavallewe need to keep this in mind15:18
mlavallefor the scheduling work we will be doing15:18
*** browny_ has quit IRC15:18
rubasovmlavalle: thanks for bringing me up to speed15:18
mlavalleso I propose to start working on the Nova scheduling stuff15:19
rubasovpreviously I was thinking the scheduling (both ingress/egress) and the ingress enforcement work can be kept orthogonal15:19
mlavalleyeah15:20
*** Leo_m has quit IRC15:20
mlavallelet's do a first pass on the spec15:21
slaweqyes, sure15:21
mlavalleand see what the effect is15:21
slaweqbut we need to remember that backend implementation will be not trivial also :)15:21
rubasovokay, agree to start working with the scheduling15:21
mlavalleabsolutely, but I am counting on slaweq to provide guidance15:22
mlavalleby the way, rubasov and lajoskatona_ are in Hungary15:22
mlavalleright?15:22
slaweqnice, more and more people from my TZ :)15:22
rubasovyes, time zone UTC+1 or +2 soon in daylight saving15:22
lajoskatona_mlavalle/slaweq: yeah, same TZ15:22
mlavalleslaweq is in Poland15:22
*** mjturek has joined #openstack-meeting15:23
mlavallewe already transitioned to day light saving this past weekend in the USA15:24
slaweqok, so we can agree that You will now focus on specs for scheduling part and I will try to find some solutions for backend, right?15:24
mlavallethat sounds good to me15:24
rubasovslaweq: sounds great15:24
mlavalle++15:24
slaweqgreat15:24
slaweqso going to next rfe15:24
mlavalleslaweq: please also provide feedback in the specs15:24
slaweqmlavalle: sure15:24
slaweqI will15:25
mlavalle:-)15:25
slaweqnext is #link https://bugs.launchpad.net/neutron/+bug/159661115:25
openstackLaunchpad bug 1596611 in neutron "[RFE] Create L3 IPs with qos (rate limit)" [Wishlist,In progress] - Assigned to LIU Yulong (dragon889)15:25
slaweqthis one is almost done, only patch not merged yet is scenario tests15:25
slaweq #link https://review.openstack.org/#/c/529784/15:25
rubasovslaweq, mlavalle: thanks in advance for the reviews15:25
slaweqplease review it :)15:25
mlavalleyeah, that was my impession15:25
*** david-lyle has joined #openstack-meeting15:25
mlavallewill do15:25
slaweqthx15:25
slaweqI think there is nothing more to add with this one15:26
slaweqso we can go to next15:26
slaweq#link https://bugs.launchpad.net/neutron/+bug/172757815:26
openstackLaunchpad bug 1727578 in neutron "[RFE]Support apply qos policy in VPN service" [Wishlist,Triaged]15:26
mlavalleyeap15:26
slaweqthere is specs proposed for that but there wasn't any update for some time15:26
slaweqI commented some nits there only but maybe mlavalle and others can also review it15:27
mlavalleI will talk to zhaobo this week about it15:27
slaweqmlavalle: thx15:27
mlavalleI'll ask him to follow up15:27
slaweqI'm not a vpn expert so I will definitely need someone else to look into it :)15:27
mlavalleyeap15:28
slaweqmoving on to next topic15:28
slaweq#topic Bugs15:28
*** openstack changes topic to "Bugs (Meeting topic: neutron_qos)"15:28
slaweqit was very quite time recently15:28
*** yamamoto has joined #openstack-meeting15:28
slaweqthere are no new bugs which are still open15:28
*** salv-orlando has joined #openstack-meeting15:29
slaweqfrom bugs which are still there for some time we have:15:29
slaweq#link https://bugs.launchpad.net/neutron/+bug/163918615:29
openstackLaunchpad bug 1639186 in neutron "qos max bandwidth rules not working for neutron trunk ports" [Low,Confirmed]15:29
slaweqthere is no volunteer to work on it still15:29
mlavallemhhhh15:30
slaweqI will probably don't have time for it neither15:30
mlavalleI will try to take a look15:31
slaweqthx mlavalle15:31
slaweqnext is #link https://bugs.launchpad.net/neutron/+bug/173285215:31
openstackLaunchpad bug 1732852 in neutron "neutron don't support Router gateway rate limit " [Low,In progress] - Assigned to Slawek Kaplonski (slaweq)15:31
slaweqwhich is similar case15:31
*** ndefigueiredo has quit IRC15:31
slaweqI am assigned to it becasue I did some update on docs related to it15:31
slaweqbut I don't have time for check how/if we can solve it15:32
slaweqI will remove myself from it - maybe there will be someone who will want to work on it15:32
mlavallewhen I'm done with the other one, I'll get back to this one15:33
slaweqmlavalle: thx again :)15:33
slaweqand the last one is15:33
slaweq#link https://bugs.launchpad.net/neutron/+bug/173941115:33
openstackLaunchpad bug 1739411 in neutron "QoS DSCP mark disappear stable/ocata" [Low,Confirmed] - Assigned to Pavlukhin Max (mpavlukhin)15:33
*** kiennt26 has quit IRC15:33
slaweqbut this one is only related to Ocata branch15:33
*** salv-orlando has quit IRC15:33
slaweqauthor proposed some patch but looks that he don't continue work on it15:34
slaweqhttps://review.openstack.org/#/c/536095/15:34
slaweqquestion is: should we continue work on such patch for ocata?15:34
slaweqI don't think it is really critical bug15:34
mlavalleagree15:35
slaweqmlavalle: what do You think?15:35
mlavalleagree15:35
slaweqshould we close it as "Won't fix" then?15:35
mlavalleyes, please15:36
slaweqok, thx15:36
slaweqso, that's all from me for today15:36
slaweq#topic Open Discussion15:36
*** openstack changes topic to "Open Discussion (Meeting topic: neutron_qos)"15:36
slaweqanyone wants to talk about something else?15:36
mlavallejust to welcome rubasov and lajoskatona_ to the team15:37
mlavallewe are delighted to have you!15:37
slaweq++15:37
rubasovmlavalle: thank you15:37
rubasovrubasov: we hope to get up to speed quickly so we can really help out15:37
slaweqif You will need anything I am on neutron channel available almost everyday :)15:38
*** yamamoto has quit IRC15:38
slaweqso just ping me15:38
lajoskatona_mlavalle: thanks15:38
rubasovslaweq: thanks, we'll linger in the chat too15:39
mlavalleme too. just in a different time zone15:39
mlavalleI am in UTC - 515:39
mlavalleduring day light saving time15:39
mlavallesunny Austin Texas15:39
slaweqnow we are in two weeks when we are closer to each other :)15:39
mlavallethat's true15:40
slaweqas You already changed time and we not yet15:40
slaweqok, if there is nothing else, I think we can finish earlier today15:41
mlavalleThanks!15:41
mlavalleo/15:41
rubasovthank you15:41
slaweqthx15:41
slaweq#endmeeting15:41
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:41
openstackMeeting ended Tue Mar 13 15:41:47 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:41
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_qos/2018/neutron_qos.2018-03-13-15.01.html15:41
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_qos/2018/neutron_qos.2018-03-13-15.01.txt15:41
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_qos/2018/neutron_qos.2018-03-13-15.01.log.html15:41
mlavallerubasov: this is the meeting we just ended: http://eavesdrop.openstack.org/#Neutron_QoS_Meeting15:42
*** lajoskatona_ has quit IRC15:42
rubasovmlavalle: yep, thanks15:42
*** browny_ has joined #openstack-meeting15:45
*** masuberu has joined #openstack-meeting15:46
*** harlowja has joined #openstack-meeting15:46
*** alexchadin has quit IRC15:47
*** yamahata_ has joined #openstack-meeting15:47
*** masber has quit IRC15:50
*** Patifa has joined #openstack-meeting15:50
*** gyee has joined #openstack-meeting15:51
*** Leo_m has joined #openstack-meeting15:53
*** yangyapeng has joined #openstack-meeting15:53
*** links has quit IRC15:55
*** masuberu has quit IRC15:57
*** david-lyle has quit IRC15:57
*** dklyle has joined #openstack-meeting15:57
*** jlibosva has joined #openstack-meeting15:58
*** yangyapeng has quit IRC15:59
*** chenying has quit IRC16:01
*** ihrachys has joined #openstack-meeting16:01
*** chenying has joined #openstack-meeting16:01
ihrachys#startmeeting neutron_ci16:01
openstackMeeting started Tue Mar 13 16:01:47 2018 UTC and is due to finish in 60 minutes.  The chair is ihrachys. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: neutron_ci)"16:01
openstackThe meeting name has been set to 'neutron_ci'16:01
mlavalleo/16:01
jlibosvao/16:02
ihrachysI will need to drop off today in the middle of the meeting so I would like someone to take over the chair from there16:02
ihrachysvolunteers welcome16:02
ihrachys#topic Actions from prev meeting16:02
*** openstack changes topic to "Actions from prev meeting (Meeting topic: neutron_ci)"16:02
ihrachys"slaweq to check why it takes too long to raise interfaces in linuxbirdge scenarios job, and to compare with dvr"16:02
ihrachysslaweq, around?16:03
mlavallehe was here 10 minutes ago16:03
mlavallewe finished the QoS meeting16:04
jlibosvaI think we agreed last time it was because of multinode?16:04
jlibosvathat dvr is multinode while linuxbridge is allinone16:04
*** brault has quit IRC16:04
*** brault has joined #openstack-meeting16:04
ihrachysyeah though I am not sure if we made any progress in terms of patches to bump timeout16:05
slaweqhi16:05
jlibosvaiirc it was merged16:05
slaweqsorry for late16:05
ihrachyshttps://review.openstack.org/550832 ?16:05
jlibosvayep16:05
slaweqihrachys: only thing I could do was increase ssh timeout16:06
*** cloudrancher has quit IRC16:06
ihrachysok great. I also noticed on grafana that the linuxbridge job is very stable now16:06
ihrachysso that probably actually helped16:06
slaweqfrom logs which I checked it wasn't looking that there is any issue with neutron agent's or something like that16:06
*** harlowja has quit IRC16:06
ihrachysgreat work slaweq16:06
slaweqthx16:06
*** cloudrancher has joined #openstack-meeting16:06
mlavallehe got an ovation for this in the Neutron meeting16:06
slaweqLOL16:07
mlavallestanding ovation16:07
ihrachysnext was "ihrachys to check grafana stats several days later when dust settles"16:07
jlibosvaindeed :)16:07
ihrachysthat's about fullstack / dvr instability16:07
ihrachysdvr scenarios are still problematic, but fullstack seems to be more stable than functional now for a week or so16:07
slaweq\o/16:07
ihrachyslooks like if we keep functional voting we should definitely have fullstack too16:08
ihrachyswe can check charts later16:08
ihrachys"jlibosva to look into agent startup failure and missing logs in: http://logs.openstack.org/83/549283/1/check/neutron-fullstack/cbad08a/logs/"16:08
*** links has joined #openstack-meeting16:08
jlibosvaI tried to reproduce the l3 agent failing to start locally but no success16:08
jlibosvaI posted a patch to log failed processes though, I think it merged16:08
jlibosvahttps://review.openstack.org/#/c/550566/16:09
slaweqmaybe it was some issue in some other package and was fixed in meantime16:09
ihrachysnice, we will revisit it the next time it hits16:10
*** rbudden has quit IRC16:10
ihrachysthese are all AIs we had16:10
ihrachys#topic Grafana16:10
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"16:10
ihrachyshttp://grafana.openstack.org/dashboard/db/neutron-failure-rate16:10
ihrachysas I said before, fullstack looks very nice. there were some failure bumps during the week but they match with other bumps for other jobs16:11
ihrachysnow fullstack at 6% or smth like that16:11
ihrachysin contrast functional is almost 20%16:11
*** lhx__ has joined #openstack-meeting16:12
ihrachysand as for tempest, linuxbridge scenarios are looking very good16:12
ihrachyslike 2-3% now16:12
ihrachysin contrast to dvr scenarios that are still 35%16:12
slaweqI hope it will be like that now16:13
slaweqas I was checking during weekend with this longer ssh timeout it was passing every time16:13
ihrachysand dvr-ha job is also at the same high failure rate16:13
slaweqI think that I saw some trunk related test in dvr failing often16:13
ihrachysanother candidate with reasonable behavior is -ovsfw- though it will need more monitoring I believe16:14
ihrachyswe can dive in each type16:14
ihrachys#topic Fullstack16:14
*** openstack changes topic to "Fullstack (Meeting topic: neutron_ci)"16:14
ihrachysconsidering that the job is quite stable for a while, should we make it vote now?16:14
ihrachyswe are at the start of cycle so that's good16:14
slaweqsounds good for me16:15
slaweqwe can try16:15
*** lhx_ has quit IRC16:15
jlibosvawould that require to also include fullstack in gate queue?16:15
ihrachyswell we can experiment with partial enablement like we did with functional of course16:16
ihrachysnot that I am saying I would suggest doing it16:16
ihrachysmlavalle, thoughts16:17
mlavalleI'd say go for it16:17
ihrachysslaweq, do you want the honor of posting the patch?16:17
slaweqihrachys: I would love to :)16:18
slaweqthx16:18
ihrachys#action slaweq to enable voting for fullstack16:18
ihrachysmlavalle, jlibosva so do we go with both queues or check only?16:18
mlavallelet's start with check16:19
slaweq++16:19
ihrachysok16:19
slaweqlet's do it with small steps16:19
ihrachyswe will revisit gate in like 2 weeks then16:19
*** sidx64 has quit IRC16:19
jlibosvathat's what my question was above, I think there is a "rule" that voting jobs should be in gate queue too, isn't there?16:19
ihrachysjlibosva, there is tradition for sure16:19
ihrachysbut we had functional not in gate but in check for some time16:19
*** browny_ has quit IRC16:20
ihrachyswe can post and see if infra objects16:20
ihrachysI don't mind enabling in both queues16:20
slaweqthere is also neutron-rally-neutron which is not in gate currently16:20
slaweqand is voting in check queue16:21
*** browny_ has joined #openstack-meeting16:21
*** yangyapeng has joined #openstack-meeting16:21
ihrachysI will skip discussion of fullstack failures for today16:21
ihrachys#topic Rally16:21
*** openstack changes topic to "Rally (Meeting topic: neutron_ci)"16:21
ihrachysdo we know what's the background behind rally not gating?16:22
ihrachysis it because it breaks from time to time due to instabilities in rally itself?16:22
ihrachysI remember there were multiple cases when a patch in rally broke our gates16:22
ihrachysso maybe that16:22
ihrachysI am not too excited to enable gating for it16:23
ihrachysI mean, gate queue16:23
mlavalleI don't know the details, but it must be that16:23
ihrachysok. I would focus on other jobs for now where we have better understanding and control.16:23
ihrachys#topic Scenarios16:24
*** openstack changes topic to "Scenarios (Meeting topic: neutron_ci)"16:24
clarkbglance recently removed rally beacuse it wasn't working at all for them16:24
clarkb(just a datapoint)16:24
*** rossella_s has quit IRC16:24
mlavallegood to know, clarkb16:24
ihrachyshttp://grafana.openstack.org/dashboard/db/neutron-failure-rate?panelId=8&fullscreen16:24
ihrachysconsidering linuxbridge scenarios job is in good shape (failure spikes are reflected in other jobs, it's at 5% right now), do we want to consider it for voting too?16:25
mlavalleyes16:25
*** yangyapeng has quit IRC16:25
mlavallelet's go for it16:26
mlavalleearly in the cycle16:26
ihrachysobjections?16:26
slaweqalso only for check queue for now?16:26
*** rossella_s has joined #openstack-meeting16:26
* ihrachys waves at rossella_s 16:26
*** browny_ has quit IRC16:26
*** Guest15086 has quit IRC16:27
ihrachysI would imagine yes, check queue for now16:27
rossella_sihrachys, hi!16:27
*** jamesmcarthur has quit IRC16:27
ihrachysok seems like no objections16:27
*** radeks has quit IRC16:27
mlavallehola rossella_s16:27
ihrachys#action slaweq to enable voting for linuxbridge scenarios16:27
*** jamesmcarthur has joined #openstack-meeting16:27
slaweqok, sure16:27
rossella_smlavalle, hola :)16:28
*** salv-orlando has joined #openstack-meeting16:28
slaweqhi rossella_s16:28
ihrachysslaweq, can you take over the meeting from here? I gotta bail out.16:28
slaweqsure16:28
ihrachys#chair slaweq16:28
openstackCurrent chairs: ihrachys slaweq16:28
slaweqdo You have link to agenda somewhere?16:28
ihrachysthere is no agenda :)16:29
mlavallewe can follow previous meetings16:29
ihrachysbut basically look at dvr scenarios that would be the main thing :)16:29
slaweqok, sure16:29
ihrachysok bye folks!16:29
slaweqI will take care16:29
*** ihrachys has quit IRC16:29
slaweqbye ihrachys16:29
jlibosvao/16:29
slaweqso moving on with scenario jobs16:30
slaweqdvr and dvr-ha are still on high failure ratio16:30
*** links has quit IRC16:30
*** marios has quit IRC16:31
slaweqabout dvr when I was testing ssh timeout patch I had few times same errors like on http://logs.openstack.org/32/550832/2/check/neutron-tempest-plugin-dvr-multinode-scenario/6186573/logs/testr_results.html.gz16:31
slaweqor http://logs.openstack.org/32/550832/2/check/neutron-tempest-plugin-dvr-multinode-scenario/136c7ef/logs/testr_results.html.gz16:32
slaweqbut every time it was failure with trunk port16:32
jlibosvais it just test_subport_connectivity or also lifecycle?16:32
jlibosvaah, second link answers my question :) sorry16:32
mlavalleyeah, it's trunk ports16:32
slaweqjlibosva: in second link it was lifecycle16:32
slaweqany ideas about that?16:32
slaweqon third one there was both of them even: http://logs.openstack.org/32/550832/2/check/neutron-tempest-plugin-dvr-multinode-scenario/6d09fd8/logs/testr_results.html.gz16:33
*** noslzzp has quit IRC16:33
*** wxy|_ has joined #openstack-meeting16:33
slaweqI just found another example of same tests failed16:33
slaweqdo You have time/resources to check that this week?16:34
*** wxy| has quit IRC16:34
slaweqI don't have any dvr environment and don't have experience with both dvr and trunk so it might be hard for me16:34
*** SerenaFeng has joined #openstack-meeting16:36
*** liyi has joined #openstack-meeting16:36
*** andreas_s_ has joined #openstack-meeting16:36
haleybI know dvr but not trunk, do you just need a multi-node environment?16:36
jlibosvaI know trunk and a bit of dvr :)16:36
slaweqso we have a winner :)16:37
*** lhx__ has quit IRC16:37
*** rbudden has joined #openstack-meeting16:37
jlibosvaI can have a look and if I have issues with dvr, I'll poke haleyb16:37
slaweqthx jlibosva16:37
slaweq#action jlibosva to take a look on dvr trunk tests issue16:38
*** andreas_s has quit IRC16:38
slaweqI'm trying to find some failed neutron-tempest-dvr-ha-multinode-full test now as this one is also around 50% fails16:39
*** yangyapeng has joined #openstack-meeting16:39
slaweqI found one http://logs.openstack.org/14/529814/5/check/neutron-tempest-dvr-ha-multinode-full/d8cfbdf/logs/testr_results.html.gz16:40
slaweqbut this doesn't look like related to neutron16:40
slaweqdo You have maybe any other example?16:40
haleybthat might be an old bug?  https://bugs.launchpad.net/neutron/+bug/171730216:41
openstackLaunchpad bug 1717302 in neutron "Tempest floatingip scenario tests failing on DVR Multinode setup with HA" [High,Confirmed] - Assigned to Brian Haley (brian-haley)16:41
*** rossella_s has quit IRC16:41
*** e0ne has quit IRC16:42
*** browny_ has joined #openstack-meeting16:43
*** rossella_s has joined #openstack-meeting16:44
slaweqhaleyb: will You continue work on it?16:44
*** liyi has quit IRC16:44
*** yangyapeng has quit IRC16:44
jlibosvado we have a logstash query for the above?16:44
slaweqI don't know16:44
mlavalleNo we don't have one16:45
*** andreas_s_ has quit IRC16:45
haleybslaweq: i have not reproduced it locally yet16:45
jlibosvamaybe this could be used? http://bit.ly/2Fz6FPs16:46
*** gouthamr has quit IRC16:47
jlibosvait looks to me that the issue is gone16:47
*** eharney_ has joined #openstack-meeting16:47
slaweqjlibosva: are You sure that logs from this job are properly indexed in logstash?16:48
mlavalleno hist over the past 7 days16:48
slaweqAFAIR there was some issue with fullstack for example16:48
jlibosvait's a normal tempest job and afaik all service logs are indexed16:48
slaweqok, it should be16:48
jlibosvaor is the error coming from neutron-keepalived-state-change ?16:49
slaweqok, I will try to find more example of failures for this job16:49
jlibosvamaybe that one is not indexed, I don't know :)16:49
*** browny_ has quit IRC16:49
slaweqand if I will find something what is happen often I will just report as bugs16:49
slaweqwhat You think?16:49
*** andreas_s has joined #openstack-meeting16:49
mlavallesounds good16:49
slaweq#action slaweq check reasons of failures of neutron-tempest-dvr-ha-multinode-full16:50
slaweqso, other tempest jobs are below 10% of failure so it's fine IMO16:51
*** eharney has quit IRC16:51
slaweqperiodic jobs looks that are fine also16:52
slaweqdo You have anything to add?16:52
mlavalleI don't16:53
slaweq#topic Open discussion16:53
*** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)"16:53
slaweqI just want to say that I found today that our scenario jobs are using neutron-legacy lib still16:53
slaweqso I want to switch it to lib/neutron16:54
slaweqare You fine with that? or there is any reason why it's like that and I shouldn't change it16:54
*** karimull has quit IRC16:55
*** pchavva has quit IRC16:55
mlavallenot that I'm aware of16:55
slaweqok, so I will send a patch and check how it works then16:56
slaweq#action slaweq switch scenario jobs to lib/neutron16:56
*** browny_ has joined #openstack-meeting16:56
slaweqok, so if You don't have anything I think we are done for today16:57
*** karimull has joined #openstack-meeting16:58
*** eharney_ has quit IRC16:58
* jlibosva nods16:58
slaweqI wasn't for sure as good as ihrachys as a chair but I hope it was somehow :)16:58
jlibosvayou did really great :)16:58
slaweqthank You16:58
slaweqbye16:58
slaweq#endmeeting16:58
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:58
mlavalle==16:58
openstackMeeting ended Tue Mar 13 16:58:57 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:58
jlibosvathanks, bye16:58
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-03-13-16.01.html16:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-03-13-16.01.txt16:59
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-03-13-16.01.log.html16:59
mlavalleslaweq: you diid great16:59
mlavalleo/16:59
slaweqthx mlavalle and jlibosva :)16:59
*** andreas_s has quit IRC16:59
slaweqand haleyb of course :)16:59
slaweqhave a nice day16:59
*** mlavalle has left #openstack-meeting17:01
*** browny_ has quit IRC17:02
*** eharney_ has joined #openstack-meeting17:03
*** eharney_ is now known as eharney17:03
*** ekcs has joined #openstack-meeting17:04
*** ekcs has quit IRC17:05
*** yangyapeng has joined #openstack-meeting17:05
*** Swami has joined #openstack-meeting17:06
*** rossella_s has quit IRC17:06
*** jlibosva has quit IRC17:06
*** gouthamr has joined #openstack-meeting17:07
*** pchavva has joined #openstack-meeting17:07
*** pchavva has quit IRC17:07
*** rossella_s has joined #openstack-meeting17:08
*** SerenaFeng has quit IRC17:08
*** andreas_s has joined #openstack-meeting17:08
*** d0ugal has quit IRC17:09
*** yangyapeng has quit IRC17:10
*** pchavva has joined #openstack-meeting17:11
*** ricolin has quit IRC17:11
*** rpioso|afk is now known as rpioso17:14
*** egallen has quit IRC17:14
*** cloudrancher has quit IRC17:15
*** cloudrancher has joined #openstack-meeting17:15
*** rossella_s has quit IRC17:15
*** neiljerram has joined #openstack-meeting17:17
*** kopecmartin has quit IRC17:17
*** browny_ has joined #openstack-meeting17:19
*** wxy|_ has quit IRC17:19
*** rossella_s has joined #openstack-meeting17:20
*** ekcs has joined #openstack-meeting17:24
*** yangyapeng has joined #openstack-meeting17:24
*** andreas_s has quit IRC17:27
*** yangyapeng has quit IRC17:28
*** felipemonteiro_ has joined #openstack-meeting17:29
*** felipemonteiro has quit IRC17:31
*** andreas_s has joined #openstack-meeting17:32
*** yangyapeng has joined #openstack-meeting17:33
*** yangyapeng has quit IRC17:37
*** jessegler has joined #openstack-meeting17:38
*** noslzzp has joined #openstack-meeting17:39
*** liyi has joined #openstack-meeting17:39
*** apetrich has joined #openstack-meeting17:40
*** _pewp_ has quit IRC17:45
*** liyi has quit IRC17:46
*** andreas_s has quit IRC17:46
*** yangyapeng has joined #openstack-meeting17:46
*** yangyapeng has quit IRC17:51
*** browny_ has quit IRC17:52
*** jbadiapa_ has joined #openstack-meeting17:55
*** jbadiapa has quit IRC17:58
*** _pewp_ has joined #openstack-meeting17:58
*** larainema has quit IRC17:58
*** tobiash has joined #openstack-meeting18:02
*** sambetts is now known as sambetts|afk18:02
*** browny_ has joined #openstack-meeting18:02
*** felipemonteiro_ has quit IRC18:05
*** yangyapeng has joined #openstack-meeting18:06
*** armstrong has joined #openstack-meeting18:07
*** amodi has quit IRC18:08
*** rbudden has quit IRC18:09
*** yangyapeng has quit IRC18:10
*** _pewp_ has quit IRC18:12
*** _pewp_ has joined #openstack-meeting18:12
*** rossella_s has quit IRC18:13
*** andreas_s has joined #openstack-meeting18:14
*** rossella_s has joined #openstack-meeting18:15
*** yamahata_ has quit IRC18:19
*** pchavva has quit IRC18:19
*** rossella_s has quit IRC18:20
*** rossella_s has joined #openstack-meeting18:20
*** jessegler has quit IRC18:20
*** egallen has joined #openstack-meeting18:25
*** yangyapeng has joined #openstack-meeting18:27
*** amodi has joined #openstack-meeting18:27
*** andreas_s has quit IRC18:28
*** egallen has quit IRC18:30
*** harlowja has joined #openstack-meeting18:30
*** harlowja has quit IRC18:30
*** egallen has joined #openstack-meeting18:30
*** yangyapeng has quit IRC18:31
*** rossella_s has quit IRC18:32
*** andreas_s has joined #openstack-meeting18:33
*** gouthamr has quit IRC18:33
*** rossella_s has joined #openstack-meeting18:34
*** browny_ has quit IRC18:36
*** d0ugal has joined #openstack-meeting18:38
*** rossella_s has quit IRC18:39
*** andreas_s has quit IRC18:42
*** tssurya has quit IRC18:42
*** liyi has joined #openstack-meeting18:43
*** rossella_s has joined #openstack-meeting18:44
*** liyi has quit IRC18:48
*** diablo_rojo has joined #openstack-meeting18:49
*** felipemonteiro has joined #openstack-meeting18:51
*** andreas_s has joined #openstack-meeting18:52
*** yamahata_ has joined #openstack-meeting18:54
*** Shrews has joined #openstack-meeting18:54
*** bobh has quit IRC18:54
*** felipemonteiro_ has joined #openstack-meeting18:55
*** felipemonteiro has quit IRC18:59
*** egallen has quit IRC18:59
corvuso/19:00
clarkbhello19:00
clarkbanyone else here for the infra meeting?19:00
*** eharney has quit IRC19:00
clarkbwe no longer have the keystone meeting ending to remind us it is our turn :)19:00
ianwo/19:00
dmsimard\o19:00
tobiasho/19:00
clarkb#startmeeting infra19:01
openstackMeeting started Tue Mar 13 19:01:22 2018 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
*** openstack changes topic to " (Meeting topic: infra)"19:01
openstackThe meeting name has been set to 'infra'19:01
clarkb#link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting19:01
clarkb#topic Announcements19:01
*** openstack changes topic to "Announcements (Meeting topic: infra)"19:01
pabelangero/19:01
clarkbfungi has created a rocky release gpg key that needs signing19:01
clarkbinfra-rooters should sign that key as they are able19:02
fungioh, right19:02
fungilemmet link19:02
*** browny_ has joined #openstack-meeting19:02
diablo_rojoo/19:02
fungi#link https://sks-keyservers.net/pks/lookup?op=vindex&search=0xc31292066be772022438222c184fd3e1edf21a78&fingerprint=on Rocky Cycle signing key19:02
fungii also have a related documentation update19:03
dmsimardI signed that but I had never uploaded my own personal key before, I still need to do that,19:03
fungi#link https://review.openstack.org/551376 Update signing docs for Zuul v319:03
clarkblooks like I need to rereview it19:04
*** d0ugal has quit IRC19:04
fungithere are a couple of minor tweaks to the process which also impact attestation (specifically the location of the per-cycle revocation certificates it asks that you download a copy of)19:04
fungiwhich is why i mention it19:04
*** armstrong has quit IRC19:04
fungiin another weekish i'll un-wip the corresponding release change and move forward with the remaining steps to replace the key in zuul configuration19:05
clarkbcool. That was the only announcement I had19:05
*** armstrong has joined #openstack-meeting19:05
*** eharney has joined #openstack-meeting19:05
*** armstrong has quit IRC19:05
clarkb#topic Actions from last meeting19:05
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)"19:05
*** armstrong has joined #openstack-meeting19:05
clarkb#link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-03-06-19.01.txt minutes from last meeting19:05
*** gema has joined #openstack-meeting19:06
clarkbfungi had an action to generate the rocky key. That is done. I also got around to going over the three specs I had called out for cleanup. Two were abandoned and one was rebased with some minor edits19:06
*** andreas_s has quit IRC19:06
*** browny_ has quit IRC19:06
*** neiljerram has quit IRC19:06
clarkbI still have it as a low priority todo item to continue to go through specs and clean up/rebase as necessary but not sure that it needs to be an action item until there is something actionable19:07
clarkb#topic Specs approval19:07
*** openstack changes topic to "Specs approval (Meeting topic: infra)"19:07
clarkb#link https://review.openstack.org/#/c/550550/ Improve IRC discoverability19:07
dmsimardIt's not so much up for approval rather than just pointing out that I wrote that thing so looking for reviews19:08
clarkbthis spec is dmsimard's. Looks like it has gotten some reviews. Do you (dmsimard) and its reviewers think it is ready to go up for a vote?19:08
clarkbah ok19:08
*** browny_ has joined #openstack-meeting19:08
dmsimardSorry I didn't realize "for approval"19:08
clarkbdmsimard its not the only thing we use this section for so it is fine.19:08
clarkbI guess this gets it in front of people who will hopefully review it now :) and thank you to those of you who have already reviewed it19:09
clarkbplease do review that if you ahve time. But I'm going to keep moving as there is quite a bit left on the agenda and important things too19:09
clarkb#topic Priority Efforts19:09
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)"19:09
clarkb#topic Zuul v319:10
*** openstack changes topic to "Zuul v3 (Meeting topic: infra)"19:10
clarkb#link https://review.openstack.org/552637 Proposal to make Zuul a top level project19:10
fungiyay!19:10
clarkbcorvus has proposed a change to openstack governance to remove Zuul from openstack in order to make it its own top level project19:10
clarkbIf you have any questions or concerns I'm happy to field them here and I think the TC and corvus are also more than willing to discuss what this means19:10
corvusthese are true statements19:11
*** andreas_s has joined #openstack-meeting19:11
*** tesseract has quit IRC19:11
clarkbThe other zuul item worth mentioning was a security related bug in zuul's executors that bwrap isolated us against19:12
fungi#link http://lists.zuul-ci.org/pipermail/zuul-announce/2018-March/000001.html Zuul untrusted information disclosure19:12
corvuswe're running with the fix for that now19:12
corvuswe're expecting a couple more like that19:12
fungithere's also a discussion underway about rescheduling the zuul weekly meeting19:13
fungi#link http://lists.zuul-ci.org/pipermail/zuul-discuss/2018-March/000064.html Zuul meeting time19:13
*** browny_ has quit IRC19:13
pabelanger++19:14
clarkbwere there any other zuul items to bring up here? I'll also give us a few minutes here before continuing on if anyone wants to talk about the zuul governance change or security19:15
*** sridharg has quit IRC19:15
*** larainema has joined #openstack-meeting19:16
corvusi think that's about it19:16
tobiashMaybe to note that we're trying out a storyboard based approach for dealing with security issues19:16
corvusoh yes!19:17
clarkboh ya and you'll find direction on how to submit such things in the zuul docs soon (if that isn't already merged)19:17
corvushopefully we'll have some documentation for that soon19:17
*** rossella_s has quit IRC19:18
tobiashSo I consider me as a beta user of this new process :)19:18
fungiright, i've got a to do this week to draft some vulnerability management process and user-facing documentation on reporting suspected vulnerabilities19:18
*** browny_ has joined #openstack-meeting19:19
fungiso far, at least, storyboard hasn't seemed to entirely fight our needs with having a private vulnerability report and discussing proposed patches19:19
fungiwe'll see how it goes19:19
clarkbalright, if anyone has questions or concerns you can find us in #openstack-infra and in #zuul and the TC over in #openstack-tc. There is also the infra and zuul and openstack dev mailing lists. Definitely reach out if you want to.19:20
*** rossella_s has joined #openstack-meeting19:20
clarkb#topic Project Renames19:20
*** openstack changes topic to "Project Renames (Meeting topic: infra)"19:20
clarkbbefore the PTG we pencilled in this friday as a project rename day. Since then I think we've lost monty who was involved with one of the projects wanting a rename19:21
clarkbI expect that the release team will be ok with renames on Friday if we want to move forward since they've loosened the requirements on trailing project releases19:21
clarkbfungi: corvus: do we think we can realistically rename project for mordred without mordred being around?19:21
corvusi think monty is expecting to be back by friday, but i can't guarantee that :)19:22
*** rbudden has joined #openstack-meeting19:22
fungimmm19:22
clarkbthere was one other project as well. I do think it would be good to have at least one rename behind us with zuulv319:22
clarkbjust so that we can sort out a working process19:22
corvusi can help out, but i don't have time to prepare/drive it this week19:23
clarkbthe other item that made this somewhat urgent (fixing nova-specs repo replication) has been addressed already so I think we don't have to commit to it this week if impractical without monty19:23
fungiyeah, i'm a smidge lost on what the order of operations will be with code changes to perform the rename (which in theory is the only real change to the process?)19:23
clarkbfungi: ya I think its all on the zuul side that changes19:23
clarkbto make sure we don't wedge zuul19:23
fungidid we say we'll need to force in follow-up changes to repos with broken zuul configuration prior to restarting zuul?19:24
clarkbthere was talk of making zuul ignore broken configs on start up. corvus did that happen? if so I don't think we need to force things in, instead the project would just have to get updates in before they would function again19:24
*** bobh has joined #openstack-meeting19:25
tobiashNot yet19:25
corvuswe shouldn't need changes to the repos themselves at this point, as long as they don't have project names in their config19:25
corvusthat was the biggest concern19:25
*** andreas_s has quit IRC19:25
*** d0ugal has joined #openstack-meeting19:26
*** d0ugal has quit IRC19:26
*** d0ugal has joined #openstack-meeting19:26
corvusso it may just be a matter of landing a main.yaml change after gerrit is back up.19:26
corvusoh... there's probably something in project-config too... hrm19:26
corvusso if there's an entry in project-config for it, we'll need 3 changes.  remove from the live config, rename in the tenant config, add back to live config with new name19:27
*** esberglu has quit IRC19:27
clarkbcorvus: the last two have to be force merges currently once gerrit is back?19:27
*** armstrong has quit IRC19:28
corvusclarkb: no, should just be regular project-config merges19:28
clarkbso zuul will start back up again even in that state?19:28
*** Patifa has quit IRC19:28
fungiokay, but basically we can't rename in one project-config change (even if the repo-specific config doesn't require its own editing)? we need to remove with a change and then add with another change?19:28
clarkboh right its the removal that allows it to start up cleanly19:29
corvusclarkb: oh, if we're stopping zuul (i guess we are because gerrit is going down) we want 4 changes.  remove from live config, remove from tenant.  [rename].  add to tenant, add to live config.19:29
*** bobh has quit IRC19:29
corvusall of those can be regular changes though.19:29
corvusno force-merges19:30
dmsimardI had topics for the meeting but with the DST changes, the middle of the meeting conflicts with kids ending school so I'll have to drop. Just looking for reviews and a general question I'm not required to be here for. Be back in a while o/19:30
clarkbright its the removal that allows it to be regular changes19:30
*** andreas_s has joined #openstack-meeting19:30
corvusya19:30
fungiso changes 1 and 2 merge, then we stop zuul, do the offline manual rename bits, start zuul, merge the 3rd and 4th changes?19:30
corvusyep19:30
clarkbfungi: ya19:30
fungiat what point do we merge in-repo config changes, if required?19:31
clarkbfungi: I think that would be step 519:31
corvusthere shouldn't be any... but if there are, we need to think about a custom plan19:31
fungithere'll be at least one for .gitreview anyway, so presumably zuul config tweaks can go in the same change19:31
corvusfor example, if the repo has jobs used by other repos, that's a problem19:31
fungioh, right19:31
clarkbhrm19:32
corvusthat's the sort of thing where we either need 'load with broken config' or we just need to force-merge all the changes with zuul off19:32
clarkbso maybe in this case we are best off actually writing down the steps above in our normal renaming documentation with the concerns until zuul can gracefully fall back19:32
corvus(or, if it's just one job on one other repo, maybe we temporarily remove it then add it back)19:32
clarkbthen check each of the repos to be renamed against thost concerns then do it19:32
fungithis is where the tc resolution we've been talking about comes in, to permit us to bypass code review for changes to various projects when required for expedient modification to ci/automation configuration19:32
*** gouthamr has joined #openstack-meeting19:32
corvusi have that half-written.  but i don't think we have to block in this case, i'm sure we can get permission from the involved projects.19:33
fungitotally agree19:33
corvus(i hit writers block on that resolution, sorry)19:33
clarkbya I don't think the tc resolution would block us19:33
clarkbmore I don't want us to discover on friday after noon we all of a sudden have to merge a bunch of stuff to get zuul started again19:34
*** egallen has joined #openstack-meeting19:34
*** andreas_s has quit IRC19:34
clarkbalso I'm not entirely sure I know exactly what mordred wants to rename19:34
clarkbso it might be difficult to evaluate this particular case with regards to his project(s)19:35
corvus"Something related to sdks/shade (via mordred)"19:35
corvusi agree that's not much to go on19:35
corvusi mean, we could just take a guess and see if he likes what we came up with19:35
clarkbya I wrote that down based on a random irc message from modred at some point19:35
clarkbcorvus: ha19:36
corvuswe renamed it "shadybee".  we thought you'd like that.19:36
clarkbI'm inclined to say lets focus on getting the docs updated with concrete steps to do the rename and gotchas to watch out for like jobs in project being used by another project19:36
*** esberglu has joined #openstack-meeting19:37
clarkbthen resync with monty, get concrete todo (probably in the form of a gerrit change with the new project name and all the details), then do rename based on the docs update19:37
corvusyah.  after this, i'm leaning toward saying maybe we should just say the plan is to force-merge the project-config changes, until we support loading broken configs.19:37
clarkbfungi: is the process documentation still somethign you were interested in doing?19:37
corvusthat's probably the simplest, and (bizarrly) least risky.  main thing is if we typo something in project-config, we might need to force-merge a followup fix.19:37
clarkbI'm inclined to volunteer for making zuul handle broken configs but I've read the config loader code and wouldn't want to promise anything :)19:38
fungiclarkb: it is, but i feel like it'll be an untested shell until we actually try to do it at least once (and probably not fully fleshed-out until we've done it a few times and hit various corner cases)19:38
clarkbfungi: ya but at least we'll have something to start with and then iterate on19:39
corvusclarkb: i'd recommend at least waiting until i finish making it "better" :)19:39
fungisure, i'm up for writing that and having something in gerrit circa thursday-ish19:39
clarkbok lets start there then and resync on tuesday hopefully with a mordred around19:39
clarkbI'll update the release team19:39
clarkb(and now moving on beacuse running out of time)19:39
clarkb#topic General Topics19:39
*** openstack changes topic to "General Topics (Meeting topic: infra)"19:39
clarkbianw: would like to talk about AFS, reprepro and reliability19:40
*** bobh has joined #openstack-meeting19:40
ianwyes19:41
clarkbmy understanding is that having reprepro write out new repo mirrors is not working so well19:41
ianwno -- http://paste.openstack.org/show/700292/19:41
ianwit is not very fault tolerant at all19:41
ianwcompared to, say, an rsync.  so there was some chatter with auristor in openstack-infra ... we debugged some of the client issues19:42
ianw*some* of it might be fixed in later versions; particularly stuff and interrupted syscalls19:42
clarkbianw: do we think the fileservers or the clients or both need to be updated?19:42
ianwso, my proposal is to custom build some later version client debs and manually install on mirror-update, and see how we go for a while19:43
fungisomething to the effect that the version of openafs shipped in ubuntu is incompatible with the kernel shipped in the same ubuntu version19:43
clarkbianw: can you reuse the debs that were built for the zuul executors? that would make this simpler probably?19:43
corvuswhat do the initial errors look like?19:44
corvus(the pasted errors seem to generally be follow-up errors about a lockfile sticking around)19:44
ianwpossibly, i was also thinking a more radical jump to the 1.8 branch ... if nothing else at least we can provide feedback19:44
ianwcorvus: it varies a lot, but the underlying issue is usually that afs issues cause broken writes19:44
pabelangerwhen I've looked at reprepro / afs failures, it was because we lost access to AFS and reprepro dies, and leaves a lockfile.19:45
ianwthen once the reprepro fails, or the db gets corrupt, we have to intervene19:45
fungiif 1.8.0 works out, we can presumably upgrade to ubuntu bionic and get the same version19:45
ianwyep, what pabelanger said :)19:45
*** egallen has quit IRC19:45
ianwfungi: yes, that was my thinking, to pre-stage that essentially19:46
*** bobh has quit IRC19:46
pabelangerbut, it does seem to happening more. I wonder if it is because our reprepro database is starting to get larger, now with 3 distros (trusty, xenial, bionic)19:46
fungithey're on 1.8.0~pre5-1 at the moment19:46
ianwif it explodes worse, then we can go back.19:46
corvusat best, that would *reduce* the rate of failure.  but any network filesystem is going to hit an issue at some point.  are we sure we can't just delete the lockfile and retry?19:46
ianwcorvus: in some cases, yes.  but likely as not some of the .db files are corrupt and you know how that goes :)19:47
corvuspabelanger: surely they each have their own databases?19:47
ianwtoday i will go through that paste list and try to get them all restarted19:47
corvusmaybe we could automatically recover by rsyncing the read-only volume contents back to the read-write volume and restarting?19:48
clarkbI think auristor also mentioned that some behavior change in the linux kernel means that clients writes will be flakier19:48
clarkb(something to do with interrupts)19:48
fungiyeah, this is why he was suggesting newer openafsclient19:48
pabelangercorvus: I don't think so, we clump them into a single reprepro update run. We could split that out into per distro updates I think19:48
corvus[to be clear, upgrading to be less flaky sounds great, i'm just wondering if we can do that and make it more robust at the same time]19:48
clarkbcorvus: ++19:48
ianwmy thought is that it's unlikely to be worse than the current status quo, and possibly likely to be better19:49
clarkbI'm willing to try updated afs client on mirror-update and continue to try and make it more reliable from there with smarter fault recovery19:49
clarkbresyncing from the ro volume seems like a good place to start for that19:49
pabelangerYah, I've tested using replacing read/write database (corrupt) with read-only database, re-run reprepro and it does recover. Just takes some time to index everything again19:50
ianwgood idea, i could definitely add a roll-back step to the script19:50
clarkbianw: anything else to add before we talk arm64?19:51
corvusi wish there were an afs command to do that instantly (since i know under the hood it's cow), but i don't think there is; i think rsync is the best option.19:51
ianwso we want to try the updated client?19:51
*** bobh has joined #openstack-meeting19:52
corvuswfm19:52
clarkbianw: sounds reasonable to me especially given what auristor has said19:52
fungiwe also know we want tnewer openafs anyway for various security reasons, so i'm all for whatever gets us a sane story there (whether that's upgrading servers sooner, or coming up with a convenient means of maintaining more recent openafs on existing distro versions)19:52
ianwok, i'll work on that19:52
ianwif we have issues with the server side, there might be options too19:53
ianwbut let's discuss that another time19:53
clarkbre arm64 we ran a job successfully19:53
*** browny_ has quit IRC19:53
clarkbdoes that mean the infra pieces are largely in place?19:53
ianwyep, i think so (modulo the now broken ubuntu-ports mirroring re above :)19:53
clarkbthere was also mailing list thread about getting a kolla job running on arm6419:54
ianwi dropped some comments in https://review.openstack.org/549319 after looking at the run; it's not super fast19:54
clarkbwhich should do a decent job of exercising it a bit more than pep819:54
ianwso we'll have to take that into account19:54
gemaok, I have asked xinliang in my team to add a kolla build (he is working with jeffrey4l on that)19:54
ianwyep, i didn't respond to the email yet but of course ping me if there's issues :)19:55
gemaianw: will do, thanks a lot19:55
ianwi will merge the dib bits now, i think they're sufficiently tested19:55
gema+119:55
ianwi think that's it for now19:55
clarkbyay progress19:55
clarkbthank you everyone that has worked to move that stuff along19:56
clarkb#link https://review.openstack.org/#/q/topic:ara-sqlite-middleware Ara sqlite middleware will allow us to go back to having ara results on all jobs19:56
*** bobh has quit IRC19:56
*** browny_ has joined #openstack-meeting19:56
clarkbdmsimard: ^ would like reviews on this topic. One of the things it will do is cut the number of files copied per job a lot which should speed up job runtimes and allow us to have ara results on all jobs again19:56
clarkbIn addition to that dmsimard was thinking it would be a good idea to have the infra meeting time and location in our irc channel topic. I think this is ar easonable thing to do though our topic is already so long19:57
dmsimardAlso, FWIW 1.0 work has resumed and it's very interesting. Can't wait to share more about it.19:57
* dmsimard is back from school19:57
pabelangerhttps://review.openstack.org/549644/ also gets us started on arm64 wheels, which I've +3'd too for testing19:57
clarkbI can't see the whole infra topic in my irc client so I'm probably a bad one to ask if that would be useful19:57
clarkbdmsimard: I think if no one opposes it we can go ahead and make that change19:58
corvuspeople see it on joining19:58
corvuswell, they "see" it19:58
fungimy client shows this much of the docs url... "http://d"19:58
*** raildo has quit IRC19:58
clarkbcorvus: thats a good point, it does message it to you on join19:58
dmsimardyeah what corvus said, it's the first thing that's printed when joining a channel19:58
corvusperhaps "they are shown it" is the right phrasing :)19:58
fungiwfm19:59
clarkbwe are basically at time now. So rather than official open discussion time feel free to join us in #openstack-infra for any remaining items/topics19:59
clarkbthank you everyone19:59
clarkb#endmeeting19:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"19:59
openstackMeeting ended Tue Mar 13 19:59:49 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-03-13-19.01.html19:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-03-13-19.01.txt19:59
openstackLog:            http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-03-13-19.01.log.html19:59
*** Shrews has left #openstack-meeting19:59
*** tobiash has left #openstack-meeting20:01
*** browny_ has quit IRC20:01
*** mikal_ is now known as mikal20:02
*** bobh has joined #openstack-meeting20:02
*** Patifa has joined #openstack-meeting20:04
*** radeks has joined #openstack-meeting20:06
*** bobh has quit IRC20:08
*** tssurya has joined #openstack-meeting20:09
*** browny_ has joined #openstack-meeting20:12
*** tssurya has quit IRC20:15
*** tssurya has joined #openstack-meeting20:15
*** bobh has joined #openstack-meeting20:16
*** browny_ has quit IRC20:17
*** bobh has quit IRC20:22
*** artom has quit IRC20:24
*** browny_ has joined #openstack-meeting20:24
*** rossella_s has quit IRC20:25
*** browny_ has quit IRC20:27
*** browny_ has joined #openstack-meeting20:27
*** rossella_s has joined #openstack-meeting20:28
*** yangyapeng has joined #openstack-meeting20:30
*** bobh has joined #openstack-meeting20:32
*** rossella_s has quit IRC20:33
*** yangyapeng has quit IRC20:35
*** bobh has quit IRC20:37
*** harlowja has joined #openstack-meeting20:37
*** rossella_s has joined #openstack-meeting20:37
*** watanabe_isao has joined #openstack-meeting20:40
*** e0ne has joined #openstack-meeting20:45
*** d0ugal has quit IRC20:45
*** watanabe_isao has quit IRC20:45
*** watanabe_isao has joined #openstack-meeting20:46
*** cloudrancher has quit IRC20:48
*** cloudrancher has joined #openstack-meeting20:50
*** dprince has quit IRC20:51
*** sidx64 has joined #openstack-meeting20:52
*** pchavva has joined #openstack-meeting20:54
*** brault has quit IRC20:56
*** bobh has joined #openstack-meeting20:56
*** bobh has quit IRC21:01
*** egallen has joined #openstack-meeting21:01
*** rossella_s has quit IRC21:04
*** bobh has joined #openstack-meeting21:04
*** rossella_s has joined #openstack-meeting21:04
*** singlethink has quit IRC21:08
*** cloudrancher has quit IRC21:09
*** rossella_s has quit IRC21:09
*** bobh has quit IRC21:09
*** rossella_s has joined #openstack-meeting21:10
*** cloudrancher has joined #openstack-meeting21:10
*** bobh has joined #openstack-meeting21:11
*** bobh has quit IRC21:16
*** pchavva has quit IRC21:16
*** browny_ has quit IRC21:17
*** d0ugal has joined #openstack-meeting21:18
*** d0ugal has quit IRC21:18
*** d0ugal has joined #openstack-meeting21:18
*** radeks has quit IRC21:19
*** rossella_s has quit IRC21:20
*** gouthamr has quit IRC21:22
*** rossella_s has joined #openstack-meeting21:23
*** gouthamr has joined #openstack-meeting21:23
*** claudiub has joined #openstack-meeting21:27
*** imcsk8_ has joined #openstack-meeting21:28
*** gouthamr has quit IRC21:29
*** janki has quit IRC21:30
*** claudiub|2 has quit IRC21:30
*** imcsk8 has quit IRC21:30
*** esberglu has quit IRC21:30
*** andreas_s has joined #openstack-meeting21:30
*** rossella_s has quit IRC21:31
*** browny_ has joined #openstack-meeting21:32
*** esberglu has joined #openstack-meeting21:33
*** eharney has quit IRC21:33
*** ykatabam has joined #openstack-meeting21:33
*** sidx64 has quit IRC21:33
*** bobh has joined #openstack-meeting21:33
*** rossella_s has joined #openstack-meeting21:34
*** dustins has quit IRC21:34
*** pchavva has joined #openstack-meeting21:34
*** pchavva has quit IRC21:34
*** andreas_s has quit IRC21:35
*** browny_ has quit IRC21:37
*** tssurya has quit IRC21:37
*** esberglu has quit IRC21:37
*** d0ugal has quit IRC21:37
*** pchavva has joined #openstack-meeting21:38
*** pchavva has quit IRC21:38
*** rossella_s has quit IRC21:39
*** awaugama has quit IRC21:41
*** watanabe_isao has quit IRC21:41
*** browny_ has joined #openstack-meeting21:41
*** rossella_s has joined #openstack-meeting21:42
*** salv-orlando has quit IRC21:44
*** e0ne has quit IRC21:45
*** liyi has joined #openstack-meeting21:45
*** browny_ has quit IRC21:51
*** liyi has quit IRC21:51
*** salv-orlando has joined #openstack-meeting21:53
*** mriedem has quit IRC21:55
*** cloudrancher has quit IRC21:55
*** cloudrancher has joined #openstack-meeting21:56
*** jamesmcarthur has quit IRC21:58
*** rcernin has joined #openstack-meeting21:59
*** e0ne has joined #openstack-meeting22:00
*** esberglu has joined #openstack-meeting22:02
*** noslzzp has quit IRC22:02
*** jamesmcarthur has joined #openstack-meeting22:04
*** amodi has quit IRC22:04
*** bobh has quit IRC22:06
*** browny_ has joined #openstack-meeting22:07
*** rossella_s has quit IRC22:10
*** rossella_s has joined #openstack-meeting22:13
*** markstur has quit IRC22:19
*** yangyapeng has joined #openstack-meeting22:20
*** edmondsw has quit IRC22:21
*** yangyapeng has quit IRC22:24
*** fnaval has quit IRC22:27
*** browny_ has quit IRC22:31
*** browny_ has joined #openstack-meeting22:31
*** yangyapeng has joined #openstack-meeting22:40
*** priteau has quit IRC22:40
*** chyka has quit IRC22:43
*** e0ne has quit IRC22:43
*** chyka has joined #openstack-meeting22:43
*** rossella_s has quit IRC22:43
*** yangyapeng has quit IRC22:44
*** rossella_s has joined #openstack-meeting22:45
*** browny_ has quit IRC22:47
*** munimeha1 has quit IRC22:51
*** browny_ has joined #openstack-meeting22:54
*** masber has joined #openstack-meeting22:54
*** hongbin has quit IRC22:59
*** rossella_s has quit IRC22:59
*** rossella_s has joined #openstack-meeting23:02
*** d0ugal has joined #openstack-meeting23:03
*** yangyapeng has joined #openstack-meeting23:04
*** yamamoto has joined #openstack-meeting23:08
*** yangyapeng has quit IRC23:08
*** salv-orlando has quit IRC23:15
*** dmacpher has quit IRC23:15
*** felipemonteiro_ has quit IRC23:16
*** browny_ has quit IRC23:18
*** artom has joined #openstack-meeting23:20
*** jamesmcarthur has quit IRC23:22
*** yangyapeng has joined #openstack-meeting23:23
*** rossella_s has quit IRC23:24
*** gongysh has joined #openstack-meeting23:25
*** gongysh has quit IRC23:26
*** gongysh has joined #openstack-meeting23:27
*** rossella_s has joined #openstack-meeting23:27
*** yangyapeng has quit IRC23:28
*** browny_ has joined #openstack-meeting23:28
*** rbudden has quit IRC23:34
*** edmondsw has joined #openstack-meeting23:36
*** yangyapeng has joined #openstack-meeting23:38
*** bobh has joined #openstack-meeting23:40
*** edmondsw has quit IRC23:41
*** cloudrancher has quit IRC23:41
*** aeng has joined #openstack-meeting23:42
*** yangyapeng has quit IRC23:42
*** bobh has quit IRC23:43
*** cloudrancher has joined #openstack-meeting23:43
*** singlethink has joined #openstack-meeting23:45
*** janzian has quit IRC23:47
*** liyi has joined #openstack-meeting23:49
*** singlethink has quit IRC23:49
*** jamesmcarthur has joined #openstack-meeting23:50
*** singlethink has joined #openstack-meeting23:50
*** liyi has quit IRC23:56
*** mriedem has joined #openstack-meeting23:56
*** Swami has quit IRC23:56
*** dklyle has quit IRC23:57
*** mjturek has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!