Thursday, 2018-06-28

*** heyongli has quit IRC00:02
*** heyongli has joined #openstack-infra00:02
*** alex_xu has joined #openstack-infra00:04
*** Nil_ has quit IRC00:07
*** rpioso is now known as rpioso|afk00:08
openstackgerritMerged openstack-infra/zuul master: gerrit: cast change and patchset numbers to str  https://review.openstack.org/57715400:09
*** Nil_ has joined #openstack-infra00:10
*** heyongli has quit IRC00:12
*** heyongli has joined #openstack-infra00:12
*** felipemonteiro_ has joined #openstack-infra00:12
*** jamesmcarthur has joined #openstack-infra00:22
*** dingyichen has joined #openstack-infra00:22
*** heyongli has quit IRC00:22
*** heyongli has joined #openstack-infra00:23
*** felipemonteiro_ has quit IRC00:26
*** jamesmcarthur has quit IRC00:27
*** eharney has joined #openstack-infra00:29
*** heyongli has quit IRC00:32
*** heyongli has joined #openstack-infra00:33
*** austinsun[m] has joined #openstack-infra00:33
*** hemna_ has quit IRC00:36
*** gyee has quit IRC00:39
*** kzaitsev_pi has joined #openstack-infra00:42
*** heyongli has quit IRC00:43
*** heyongli has joined #openstack-infra00:43
*** kzaitsev1pi has quit IRC00:45
*** heyongli has quit IRC00:53
*** heyongli has joined #openstack-infra00:53
*** kzaitsev1pi has joined #openstack-infra00:54
*** rh-jelabarre has joined #openstack-infra00:55
*** kzaitsev_pi has quit IRC00:55
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move localloop to exec_sudo  https://review.openstack.org/57861600:58
*** Dinesh_Bhor has joined #openstack-infra01:01
*** heyongli has quit IRC01:03
*** heyongli has joined #openstack-infra01:04
*** spotz has quit IRC01:04
ianwgema: re my previous msg, linaro keystone seems back now, so glitch in the matrix i guess01:04
ianwi don't know what's happened to nb03.o.o however, non-responsive.  i'm trying a reboot01:04
*** yolanda_ has joined #openstack-infra01:05
*** yamahata has quit IRC01:07
openstackgerritMerged openstack-infra/zuul-jobs master: ara-report: use a different fact name for ara_report_path  https://review.openstack.org/57767601:08
*** yolanda has quit IRC01:08
*** yolanda has joined #openstack-infra01:09
ianwhard reboot has it up again01:10
*** yolanda_ has quit IRC01:11
*** jesslampe has joined #openstack-infra01:11
*** yolanda_ has joined #openstack-infra01:13
*** heyongli has quit IRC01:13
*** heyongli has joined #openstack-infra01:14
*** edmondsw has joined #openstack-infra01:16
*** yolanda has quit IRC01:16
*** yolanda__ has joined #openstack-infra01:19
*** edmondsw has quit IRC01:20
*** spotz has joined #openstack-infra01:20
*** jesslampe has quit IRC01:22
*** yolanda_ has quit IRC01:22
*** heyongli has quit IRC01:24
*** heyongli has joined #openstack-infra01:24
*** jesslampe has joined #openstack-infra01:25
*** jesslampe has quit IRC01:26
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move localloop to exec_sudo  https://review.openstack.org/57861601:26
*** linshuicheng[m] has joined #openstack-infra01:31
*** rlandy has quit IRC01:33
*** heyongli has quit IRC01:34
*** heyongli has joined #openstack-infra01:34
*** gongysh has joined #openstack-infra01:35
*** heyongli has quit IRC01:44
*** heyongli has joined #openstack-infra01:45
*** heyongli has quit IRC01:54
*** heyongli has joined #openstack-infra01:55
*** Shrews has quit IRC02:00
*** gfidente has joined #openstack-infra02:05
*** heyongli has quit IRC02:05
*** heyongli has joined #openstack-infra02:05
*** hongbin has joined #openstack-infra02:06
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move localloop to exec_sudo  https://review.openstack.org/57861602:09
ianwhttps://bootstrap.pypa.io/get-pip.py appears unreachable from nb0302:15
*** heyongli has quit IRC02:15
*** heyongli has joined #openstack-infra02:15
*** heyongli has quit IRC02:25
*** heyongli has joined #openstack-infra02:26
*** links has joined #openstack-infra02:30
*** links has quit IRC02:30
*** kzaitsev1pi has quit IRC02:32
*** sthussey has quit IRC02:32
*** kzaitsev_pi has joined #openstack-infra02:32
*** dpawlik has joined #openstack-infra02:34
*** heyongli has quit IRC02:35
*** heyongli has joined #openstack-infra02:36
*** dpawlik has quit IRC02:38
*** heyongli has quit IRC02:46
*** heyongli has joined #openstack-infra02:46
*** vivsoni has quit IRC02:49
*** heyongli has quit IRC02:56
*** heyongli has joined #openstack-infra02:56
*** edmondsw has joined #openstack-infra03:03
*** roman_g has quit IRC03:06
*** heyongli has quit IRC03:06
*** heyongli has joined #openstack-infra03:07
*** tonytan4ever has quit IRC03:07
*** edmondsw has quit IRC03:08
*** zhangfei has joined #openstack-infra03:10
*** heyongli has quit IRC03:16
*** heyongli has joined #openstack-infra03:17
*** zhangfei has quit IRC03:26
*** zhangfei has joined #openstack-infra03:27
*** heyongli has quit IRC03:27
*** heyongli has joined #openstack-infra03:27
openstackgerritTristan Cacqueray proposed openstack-infra/nodepool master: builder: do not configure provider that doesn't manage images  https://review.openstack.org/57864203:35
*** heyongli has quit IRC03:37
*** heyongli has joined #openstack-infra03:37
*** tonytan4ever has joined #openstack-infra03:46
*** heyongli has quit IRC03:47
*** heyongli has joined #openstack-infra03:48
*** lpetrut has joined #openstack-infra03:49
*** tonytan4ever has quit IRC03:50
*** vivsoni has joined #openstack-infra03:51
*** rh-jelabarre has quit IRC03:52
*** udesale has joined #openstack-infra03:53
*** slaweq has quit IRC03:53
*** heyongli has quit IRC03:57
*** heyongli has joined #openstack-infra03:58
*** heyongli has quit IRC04:08
*** heyongli has joined #openstack-infra04:08
*** yamahata has joined #openstack-infra04:08
*** slaweq has joined #openstack-infra04:11
*** slaweq has quit IRC04:16
*** heyongli has quit IRC04:18
*** heyongli has joined #openstack-infra04:18
*** boden has joined #openstack-infra04:22
*** tonytan4ever has joined #openstack-infra04:24
*** boden has quit IRC04:26
*** sree_ has joined #openstack-infra04:27
*** sree_ has quit IRC04:27
*** hongbin has quit IRC04:27
*** heyongli has quit IRC04:28
*** heyongli has joined #openstack-infra04:29
*** lpetrut has quit IRC04:32
*** ramishra has joined #openstack-infra04:34
*** heyongli has quit IRC04:38
*** heyongli has joined #openstack-infra04:39
AJaegerianw, frickler, jhesketh with https://review.openstack.org/#/c/577307/ merged, can we merge the docs update as well, please? That's https://review.openstack.org/#/c/57731004:48
jheskethAJaeger: looking04:49
*** heyongli has quit IRC04:49
*** heyongli has joined #openstack-infra04:49
jhesketh+W04:51
AJaegerthanks!04:51
*** edmondsw has joined #openstack-infra04:52
AJaegersmcginnis: https://review.openstack.org/#/c/578574/ should be fine, if you don't define jobs, no need t olist the repo in projects.yaml04:57
*** edmondsw has quit IRC04:57
openstackgerritMerged openstack-infra/system-config master: Update to openstackdocstheme  https://review.openstack.org/57767804:58
*** heyongli has quit IRC04:59
*** heyongli has joined #openstack-infra04:59
*** ykarel has joined #openstack-infra05:00
*** janki has joined #openstack-infra05:00
openstackgerritMerged openstack-infra/infra-manual master: Remove system-required instructions for creators  https://review.openstack.org/57731005:05
openstackgerritMerged openstack-infra/project-config master: Readd openstack/operations-guide repo  https://review.openstack.org/57844105:05
*** gongysh has quit IRC05:06
*** heyongli has quit IRC05:09
*** heyongli has joined #openstack-infra05:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Call kpartx remove in umount, not cleanup  https://review.openstack.org/57865705:10
*** slaweq has joined #openstack-infra05:11
openstackgerritMerged openstack-infra/system-config master: Add statusbot to #openstack-helm  https://review.openstack.org/56588705:13
openstackgerritMerged openstack-infra/system-config master: Add statusbot to #openstack-security  https://review.openstack.org/56588805:14
*** slaweq has quit IRC05:15
openstackgerritMerged openstack-infra/system-config master: Blackhole messages to ambassadors-owner on lists  https://review.openstack.org/57653905:16
*** jbadiapa has quit IRC05:17
*** dhajare has joined #openstack-infra05:19
*** heyongli has quit IRC05:19
*** heyongli has joined #openstack-infra05:20
*** heyongli has quit IRC05:30
*** heyongli has joined #openstack-infra05:30
*** gongysh has joined #openstack-infra05:31
*** openstackgerrit has quit IRC05:34
*** jesslampe has joined #openstack-infra05:35
*** pgadiya has joined #openstack-infra05:36
*** pgadiya has quit IRC05:36
*** quiquell|off is now known as quiquell|rover05:37
*** cshastri has joined #openstack-infra05:38
*** heyongli has quit IRC05:40
*** heyongli has joined #openstack-infra05:40
*** jogo has quit IRC05:42
*** iranzo has joined #openstack-infra05:44
*** quiquell|rover is now known as quique|rover|bbl05:45
*** bdodd has quit IRC05:46
*** heyongli has quit IRC05:50
*** heyongli has joined #openstack-infra05:51
*** openstackstatus has quit IRC05:51
*** pahuang has quit IRC05:51
*** openstackstatus has joined #openstack-infra05:52
*** ChanServ sets mode: +v openstackstatus05:52
*** Bhujay has joined #openstack-infra05:54
*** yolanda__ is now known as yolanda05:59
*** heyongli has quit IRC06:00
*** heyongli has joined #openstack-infra06:01
*** zhangfei has quit IRC06:01
*** andreas_s has joined #openstack-infra06:08
*** quique|rover|bbl is now known as quiquell|rover06:10
*** ramishra has quit IRC06:10
*** heyongli has quit IRC06:11
*** slaweq has joined #openstack-infra06:11
*** heyongli has joined #openstack-infra06:11
*** ramishra has joined #openstack-infra06:12
*** zhangfei has joined #openstack-infra06:13
*** slaweq has quit IRC06:15
*** jogo has joined #openstack-infra06:17
*** quiquell|rover is now known as quique|rover|afk06:17
*** heyongli has quit IRC06:21
*** heyongli has joined #openstack-infra06:21
*** jamesmcarthur has joined #openstack-infra06:23
*** jamesmcarthur has quit IRC06:27
*** lpetrut has joined #openstack-infra06:28
*** ccamacho has quit IRC06:29
*** bdodd has joined #openstack-infra06:30
*** heyongli has quit IRC06:31
*** heyongli has joined #openstack-infra06:32
*** ramishra has quit IRC06:35
*** openstackgerrit has joined #openstack-infra06:35
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Test for system-required  https://review.openstack.org/57870106:35
AJaegerclarkb: added a test so that nobody readds system-required ^06:36
*** ramishra has joined #openstack-infra06:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Test for system-required  https://review.openstack.org/57870106:39
*** aspiers[m] has quit IRC06:40
*** dpawlik has joined #openstack-infra06:40
*** edmondsw has joined #openstack-infra06:40
*** aspiers[m] has joined #openstack-infra06:41
*** smcginnis[m] has quit IRC06:41
*** heyongli has quit IRC06:41
*** heyongli has joined #openstack-infra06:42
*** smcginnis[m] has joined #openstack-infra06:43
*** nicolasbock has joined #openstack-infra06:43
*** slaweq has joined #openstack-infra06:44
*** edmondsw has quit IRC06:46
*** slaweq has quit IRC06:48
*** heyongli has quit IRC06:52
*** heyongli has joined #openstack-infra06:52
*** caphrim007_ has quit IRC06:52
*** caphrim007 has joined #openstack-infra06:53
*** quique|rover|afk is now known as quiquell|rover06:53
*** slaweq has joined #openstack-infra06:54
*** ramishra has quit IRC06:55
*** agopi has quit IRC06:56
*** ramishra has joined #openstack-infra07:00
*** jcoufal has joined #openstack-infra07:01
*** heyongli has quit IRC07:02
*** cfriesen has quit IRC07:02
*** heyongli has joined #openstack-infra07:02
*** shardy has joined #openstack-infra07:05
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: add executing job INFO log  https://review.openstack.org/57870407:08
*** peereb has joined #openstack-infra07:09
*** stakeda has quit IRC07:10
*** pcaruana has joined #openstack-infra07:10
*** Adri2000 has quit IRC07:11
*** tesseract has joined #openstack-infra07:11
*** heyongli has quit IRC07:12
*** heyongli has joined #openstack-infra07:13
*** Adri2000 has joined #openstack-infra07:15
openstackgerritIan Wienand proposed openstack/diskimage-builder master: block-device lvm: fix umount phase  https://review.openstack.org/50395807:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move localloop to exec_sudo  https://review.openstack.org/57861607:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Call kpartx remove in umount, not cleanup  https://review.openstack.org/57865707:17
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [WIP] LVM testing for xenial-build-succeeds  https://review.openstack.org/57870807:17
*** jbadiapa has joined #openstack-infra07:17
*** heyongli has quit IRC07:22
*** heyongli has joined #openstack-infra07:23
*** ramishra has quit IRC07:23
*** ramishra has joined #openstack-infra07:24
*** amoralej|off is now known as amoralej07:26
*** ramishra has quit IRC07:29
*** ramishra has joined #openstack-infra07:30
*** andreas_s has quit IRC07:31
*** sungn has joined #openstack-infra07:31
*** andreas_s has joined #openstack-infra07:32
*** heyongli has quit IRC07:33
*** heyongli has joined #openstack-infra07:33
*** jiapei has joined #openstack-infra07:34
openstackgerritColleen Murphy proposed openstack-infra/puppet-nodepool master: Fix name of libxslt dev package  https://review.openstack.org/57751907:34
gemaianw: yeah, we had a 10 min down time yesterday, whilst rebooting a switch to get the jumbo frames configured07:34
gemaianw: sorry about that, didn't expect it to take so long to reboot :S07:34
ianwgema: ok ... you can see from the builds it is trying to do @ https://nb03.openstack.org/ that it's not going well07:35
*** yolanda_ has joined #openstack-infra07:35
gemaianw: ok, we'll pick that up today07:35
gemaianw: we were trying to get the cloud to have sane MTUs for VMs/containers07:36
*** agopi has joined #openstack-infra07:36
gemaianw: what is the time of those logs? UTC?07:37
*** yolanda is now known as Guest6344807:37
*** yolanda_ is now known as yolanda07:37
sungnHello, everyone. I'm now building a third party CI environment. Should I use zuul and molteniron to build it? If so should I also use jenkins? Can anybody here have experience help me please? Thank you!07:38
*** Guest63448 has quit IRC07:38
ianwgema: yes, utc07:39
*** ramishra has quit IRC07:39
gemaack, so things are not going great yet, anyway, keep an eye on that ticket we have open07:40
gemawe'll get there07:40
gemaianw: feel free to add any concerns to it also07:40
ianwgema: ok, yeah you can mostly see that it's just random network failures trying to grab things during the build07:40
gemayup07:40
gemawill add that07:40
ianwhttps://bootstrap.pypa.io/get-pip.py was a good one to test, sometimes it would be ok, other times not07:41
ianwthat is behind some sort of cdn, but best i could tell it was always to same ip07:41
ianw151.101.76.17507:41
*** ccamacho has joined #openstack-infra07:41
ianwhttp://paste.openstack.org/show/724499/ -- two runs from just a second ago.  first one was fine, second one didn't work07:42
*** heyongli has quit IRC07:43
*** heyongli has joined #openstack-infra07:43
*** jpena|off is now known as jpena07:44
*** hashar has joined #openstack-infra07:44
gemaianw: cool, thanks for the info, we'll look into that07:45
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned  https://review.openstack.org/57687607:52
*** heyongli has quit IRC07:53
*** heyongli has joined #openstack-infra07:54
*** numans has joined #openstack-infra07:55
*** numans_ has quit IRC07:56
*** tosky has joined #openstack-infra07:58
*** jesslampe has quit IRC07:59
*** jesslampe has joined #openstack-infra07:59
*** andreas_s has quit IRC07:59
*** andreas_s_ has joined #openstack-infra08:03
*** rpittau has quit IRC08:03
*** rpittau has joined #openstack-infra08:03
*** andreas_s_ has quit IRC08:03
*** ykarel is now known as ykarel|lunch08:03
*** heyongli has quit IRC08:03
*** heyongli has joined #openstack-infra08:04
*** jesslampe has quit IRC08:04
*** threestrands has joined #openstack-infra08:06
*** threestrands has quit IRC08:06
*** threestrands has joined #openstack-infra08:06
*** jpich has joined #openstack-infra08:07
*** d0ugal has joined #openstack-infra08:08
*** sshnaidm is now known as sshnaidm|afk08:09
*** threestrands has quit IRC08:13
openstackgerritColleen Murphy proposed openstack-infra/puppet-nodepool master: Fix name of libxslt dev package  https://review.openstack.org/57751908:13
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci master: Add beaker-rspec bindep dependencies  https://review.openstack.org/57855908:13
*** heyongli has quit IRC08:14
*** heyongli has joined #openstack-infra08:14
*** electrofelix has joined #openstack-infra08:15
*** tonytan4ever_brb has joined #openstack-infra08:15
*** tonytan4ever has quit IRC08:19
*** tonytan4ever_brb has quit IRC08:20
*** tonytan4ever has joined #openstack-infra08:20
*** dansmith has quit IRC08:20
*** florianf|afk is now known as florianf08:21
*** dansmith has joined #openstack-infra08:21
*** dansmith is now known as Guest8882308:21
*** roman_g has joined #openstack-infra08:22
*** heyongli has quit IRC08:24
*** heyongli has joined #openstack-infra08:24
*** ramishra has joined #openstack-infra08:25
*** edmondsw has joined #openstack-infra08:29
*** numans has quit IRC08:30
*** jcoufal has quit IRC08:31
*** ethfci has joined #openstack-infra08:32
*** edmondsw has quit IRC08:34
*** heyongli has quit IRC08:34
*** heyongli has joined #openstack-infra08:35
*** derekh has joined #openstack-infra08:40
*** heyongli has quit IRC08:44
*** heyongli has joined #openstack-infra08:45
*** dingyichen has quit IRC08:47
*** andreas_s has joined #openstack-infra08:54
*** andreas_s has quit IRC08:54
*** andreas_s has joined #openstack-infra08:54
*** heyongli has quit IRC08:55
*** andreas_s has quit IRC08:55
*** heyongli has joined #openstack-infra08:55
*** andreas_s has joined #openstack-infra08:59
*** andreas_s has quit IRC09:01
*** andreas_s has joined #openstack-infra09:01
*** andreas_s has quit IRC09:02
*** heyongli has quit IRC09:05
*** heyongli has joined #openstack-infra09:05
*** andreas__ has joined #openstack-infra09:06
*** andreas__ has quit IRC09:06
*** andreas_s_ has joined #openstack-infra09:07
*** heyongli has quit IRC09:15
*** d0ugal has quit IRC09:16
*** heyongli has joined #openstack-infra09:16
*** d0ugal has joined #openstack-infra09:16
*** armaan has joined #openstack-infra09:17
*** andreas_s_ has quit IRC09:22
*** ykarel|lunch is now known as ykarel09:23
*** heyongli has quit IRC09:25
*** heyongli has joined #openstack-infra09:26
*** andreas_s has joined #openstack-infra09:27
*** andreas_s has quit IRC09:29
*** andreas_s has joined #openstack-infra09:29
*** pcichy has joined #openstack-infra09:30
*** zoli is now known as zoli|lunch09:34
*** Dinesh_Bhor has quit IRC09:34
*** evrardjp has quit IRC09:35
*** pcichy has quit IRC09:35
*** pcichy has joined #openstack-infra09:35
*** heyongli has quit IRC09:36
*** heyongli has joined #openstack-infra09:36
*** gfidente has quit IRC09:37
*** evrardjp has joined #openstack-infra09:41
*** heyongli has quit IRC09:46
*** heyongli has joined #openstack-infra09:46
*** dtantsur|afk is now known as dtantsur09:49
openstackgerritChason Chan proposed openstack-infra/project-config master: Add api-ref-jobs to Watcher templates list  https://review.openstack.org/57875009:51
*** rcernin has quit IRC09:56
*** heyongli has quit IRC09:56
*** heyongli has joined #openstack-infra09:57
*** armaan has quit IRC10:02
*** armaan has joined #openstack-infra10:02
*** armaan has quit IRC10:03
*** armaan has joined #openstack-infra10:04
*** heyongli has quit IRC10:06
*** heyongli has joined #openstack-infra10:07
*** jcoufal has joined #openstack-infra10:11
*** andreas_s has quit IRC10:12
*** jcoufal has quit IRC10:14
*** jcoufal has joined #openstack-infra10:15
*** andreas_s has joined #openstack-infra10:16
*** heyongli has quit IRC10:17
*** heyongli has joined #openstack-infra10:17
*** edmondsw has joined #openstack-infra10:17
*** edmondsw has quit IRC10:22
*** boden has joined #openstack-infra10:24
*** armaan has quit IRC10:26
*** armaan has joined #openstack-infra10:27
*** heyongli has quit IRC10:27
*** heyongli has joined #openstack-infra10:28
*** boden has quit IRC10:29
*** apetrich has quit IRC10:30
*** armaan has quit IRC10:31
*** udesale has quit IRC10:32
*** boden has joined #openstack-infra10:33
*** heyongli has quit IRC10:37
*** heyongli has joined #openstack-infra10:38
*** peereb has quit IRC10:43
*** ramishra has quit IRC10:44
*** salv-orlando has joined #openstack-infra10:44
*** salv-orlando has quit IRC10:45
*** heyongli has quit IRC10:47
*** heyongli has joined #openstack-infra10:48
*** gongysh has quit IRC10:52
*** zoli|lunch is now known as zoli10:55
*** heyongli has quit IRC10:58
*** heyongli has joined #openstack-infra10:58
*** sshnaidm|afk is now known as sshnaidm10:58
*** jpena is now known as jpena|lunch10:59
*** andreas_s has quit IRC11:04
*** andreas_s has joined #openstack-infra11:05
*** heyongli has quit IRC11:08
*** heyongli has joined #openstack-infra11:08
*** andreas_s has quit IRC11:10
*** zhangfei has quit IRC11:10
*** andreas_s has joined #openstack-infra11:11
*** apetrich has joined #openstack-infra11:11
*** dpawlik has quit IRC11:17
*** heyongli has quit IRC11:18
*** heyongli has joined #openstack-infra11:19
*** andreas_s has quit IRC11:19
*** dpawlik has joined #openstack-infra11:20
*** andreas_s has joined #openstack-infra11:20
*** numans_ has joined #openstack-infra11:27
*** heyongli has quit IRC11:28
*** heyongli has joined #openstack-infra11:29
*** gfidente has joined #openstack-infra11:29
*** gfidente has quit IRC11:29
*** gfidente has joined #openstack-infra11:29
*** ldnunes has joined #openstack-infra11:29
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned  https://review.openstack.org/57687611:29
*** dtantsur is now known as dtantsur|brb11:32
*** camunoz has joined #openstack-infra11:34
*** agopi has quit IRC11:34
*** gongysh has joined #openstack-infra11:36
*** numans_ has quit IRC11:36
*** zul has joined #openstack-infra11:39
openstackgerritFabien Boucher proposed openstack-infra/zuul master: Add tenant yaml validation option to scheduler  https://review.openstack.org/57426511:39
*** heyongli has quit IRC11:39
*** heyongli has joined #openstack-infra11:39
*** pcichy has quit IRC11:43
*** salv-orlando has joined #openstack-infra11:45
*** jcoufal has quit IRC11:48
*** zul has quit IRC11:49
*** heyongli has quit IRC11:49
*** heyongli has joined #openstack-infra11:49
*** ramishra has joined #openstack-infra11:50
openstackgerritAnkit Kumar proposed openstack/diskimage-builder master: Adding new dib element  https://review.openstack.org/57877311:50
*** jiapei has quit IRC11:50
*** ramishra has quit IRC11:51
*** salv-orlando has quit IRC11:51
*** ramishra has joined #openstack-infra11:51
*** amoralej is now known as amoralej|lunch11:54
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add new modprobe element  https://review.openstack.org/57717011:56
*** pcaruana has quit IRC11:56
*** jpena|lunch is now known as jpena11:56
*** heyongli has quit IRC11:59
*** heyongli has joined #openstack-infra12:00
*** andreas_s has quit IRC12:03
*** andreas_s has joined #openstack-infra12:04
*** edmondsw has joined #openstack-infra12:06
*** andreas_s has quit IRC12:08
*** andreas_s has joined #openstack-infra12:08
fungi#status log lists.openstack.org has been removed from the emergency disable list now that https://review.openstack.org/576539 has merged12:09
openstackstatusfungi: finished logging12:09
*** heyongli has quit IRC12:09
*** heyongli has joined #openstack-infra12:10
*** edmondsw has quit IRC12:11
*** zhangfei has joined #openstack-infra12:11
*** Bhujay has quit IRC12:12
*** rosmaita has joined #openstack-infra12:13
*** rlandy has joined #openstack-infra12:13
*** sthussey has joined #openstack-infra12:19
*** heyongli has quit IRC12:20
*** heyongli has joined #openstack-infra12:20
*** rosmaita has quit IRC12:21
*** trown|outtypewww is now known as trown12:28
*** rosmaita has joined #openstack-infra12:29
*** panda|bike is now known as panda12:30
*** heyongli has quit IRC12:30
*** heyongli has joined #openstack-infra12:30
*** zhangfei has quit IRC12:30
*** eharney has quit IRC12:35
*** zul has joined #openstack-infra12:37
*** agopi has joined #openstack-infra12:37
*** tpsilva has joined #openstack-infra12:37
*** apetrich has quit IRC12:38
*** heyongli has quit IRC12:40
*** rlandy is now known as rlandy|afk12:40
*** heyongli has joined #openstack-infra12:41
mordredsungn: I don't know about molteniron, but yes, you should use zuul. if you use zuul, you do not need jenkins12:41
cmurphyis there a standard workaround for this pip 10 weirdness? http://logs.openstack.org/22/577522/2/check/openstackci-beaker-ubuntu-trusty/de1a314/job-output.txt.gz#_2018-06-28_08_45_58_485083 i'm only seeing it on trusty12:42
odyssey4meis it possible for projects to use status bot (or another bot) similarly to the way infra uses it to record 'log' events? We'd like to have it as a nice way of recording noted events for project members which can then easily be shared/reviewed/discussed at meetings.12:43
*** pcaruana has joined #openstack-infra12:44
fungicmurphy: the pip 10 maintainers don't consider it weirdness. some potential workarounds are enumerated in https://github.com/pypa/pip/issues/480512:50
*** heyongli has quit IRC12:50
*** heyongli has joined #openstack-infra12:51
*** alexchadin has joined #openstack-infra12:51
fungiodyssey4me: you could run one yourself, the source code is available: https://git.openstack.org/cgit/openstack-infra/statusbot12:51
fungiodyssey4me: though working with us to design something could be cool too12:52
*** rcernin has joined #openstack-infra12:52
*** dtantsur|brb is now known as dtantsur12:55
fungicmurphy: if we can't uninstall the six package from the distro, the next easiest thing is to delete its dist-info file from the filesystem so pip doesn't see it12:57
cmurphyfungi: thanks, I was wondering if infra had settled on a particular workaround since I'm sure it's caused problems13:00
cmurphyI sort of assume python-six can't just be uninstalled but i'll make sure before I get more heavy handed13:00
*** heyongli has quit IRC13:01
openstackgerritJens Harbott (frickler) proposed openstack-infra/project-config master: Add devstack-plugin-ceph to #openstack-qa channel  https://review.openstack.org/57879013:01
*** heyongli has joined #openstack-infra13:01
fricklergmann: andreaf: ^^13:01
fungicmurphy: where it came up in devstack, i think we ended up removing the dist-info files for affected distro packages13:01
*** edmondsw has joined #openstack-infra13:01
cmurphyfungi: ah okay13:02
AJaegerconfig-core, could you review https://review.openstack.org/#/c/578574/ and https://review.openstack.org/#/c/578701 to finalize removing of system-required template from project-config, please?13:02
andreaffrickler +113:02
fricklercmurphy: fungi: current solution in devstack is still to pin pip<10, workarounds for pip>=10 are still in progress13:02
*** myoung|pto has quit IRC13:03
cmurphyoh13:03
cmurphylovely13:03
fungifrickler: interesting. maybe i'm thinking of cases where it came up in diskimage-builder in that case13:03
fricklersee the stack below https://review.openstack.org/#/c/561597/13:03
*** _ari_ has quit IRC13:03
*** otherwiseguy has quit IRC13:03
*** ihar has joined #openstack-infra13:03
*** _ari_ has joined #openstack-infra13:04
*** myoung has joined #openstack-infra13:04
*** otherwiseguy has joined #openstack-infra13:05
fungiaha, it was the egg-info files and i was thinking of https://review.openstack.org/562884 it seems13:05
ssbarnea[m]how can I disable use of upper_constraints use on build-openstack-sphinx-docs?13:05
*** andreas_s has quit IRC13:06
*** andreas_s has joined #openstack-infra13:07
*** andreas_s has quit IRC13:07
ssbarnea[m]i found one case where this fails because package has "pyyaml>4" and the constraints are lower, instead of failing pip respects the constraints and installed a version that is not compatible.13:07
*** andreas_s has joined #openstack-infra13:07
smcginnisssbarnea[m]: Hmm, that shouldn't happen that way. Do you have a link to the job?13:08
*** rcernin has quit IRC13:08
ssbarnea[m]smcginnis: check https://review.openstack.org/#/c/578754/ -- look at differences13:08
*** andreas_s has quit IRC13:08
*** rh-jelabarre has joined #openstack-infra13:09
ssbarnea[m]building docs in classic way works, as it does not use any constraints. but on this template it fails.13:09
*** heyongli has quit IRC13:11
*** heyongli has joined #openstack-infra13:11
gmannfrickler: thanks. Lgtm13:12
*** andreas_s_ has joined #openstack-infra13:13
*** amoralej|lunch is now known as amoralej13:14
smcginnisssbarnea[m]: Oh, I read what you said better now. So you are trying to raise the pyyaml version in requirements.txt to be higher than what is in upper-constraints.13:15
smcginnisssbarnea[m]: That's not possible, at least as far as I'm aware of.13:15
smcginnisssbarnea[m]: The upper-constraint for pyyaml would need to be raised first to allow for that.13:16
odyssey4mefungi: it seems that with the right extensions, mediawiki could do something like a datatables view - so all data of each different type could be in a single page, then there can be sub-pages which have a subset of that data13:17
*** andreas_s_ has quit IRC13:17
odyssey4mefungi: so effectively it could be a pretty straightforward implementation - put all 'log' items in a single page, then have filtered views per channel13:17
*** quiquell|rover is now known as quique|rover|lch13:18
odyssey4meit's probably terribly inefficient, but no worse than it is today I guess13:18
*** agopi has quit IRC13:19
ssbarnea[m]jjb is not really openstack anymore, and raising pyyaml version on constraints would be very hard. pyyaml broke the API in 4.1. I am inclined to remove the openstack-docs job and rely on one. As long the publish to readthedocs will work we should be fine.13:19
ssbarnea[m]anyway , nobody needs two flavours of "docs" building :)13:19
*** eharney has joined #openstack-infra13:19
smcginnisssbarnea[m]: That makes sense. If it doesn't need to go to docs.openstack.org then you don't necessarily need that job.13:19
AJaegerssbarnea[m]: jjb is still listed in governance as infra project13:20
*** udesale has joined #openstack-infra13:20
smcginnisssbarnea[m]: Another non-openstack centric docs job could probably be added.13:20
ssbarnea[m]... or I could spend 2h and make it work with both versions of pyyaml.13:21
*** heyongli has quit IRC13:21
AJaegerssbarnea[m]: do you need pyyaml for docs building at all?13:21
smcginnisIt doesn't look like many projects use pyyaml from my quick search. Probably good just to propose raising it above 4.1 and see what the repercussions would be.13:22
AJaegerssbarnea[m]: alternative: Create doc/requirements.txt and use that one...13:22
fungiyou could probably use a job variant which passes in an alternative (empty) constraints file13:22
*** heyongli has joined #openstack-infra13:22
fungibut yeah, if you don't need pyyaml installed for docs builds, what AJaeger suggests is easiest13:22
smcginnisAJaeger: Wouldn't doc/requirements.txt still be subject to constraints checks?13:22
AJaegersmcginnis: it would be - but it would not include pyyaml ;)13:22
smcginnisAJaeger: Ah, so if it's not really needed just for docs, use that different file to get by. Gotcha.13:23
AJaegersmcginnis: exactly13:23
fungiright, the recommendation is to use a doc/requirements.txt which omits pyyaml and anything else not needed for sphinx-build to run successfully13:23
AJaegerssbarnea[m]: that should be the quickest way ^13:23
ssbarnea[m]i am afraid that the failure is caused by an inline code example in the docs.13:23
AJaeger;(13:24
ssbarnea[m]but I am considering removing  or updating it as I do not find it useful at all.13:24
fungiis there some sphinx extension which is importing pyyaml?13:24
ssbarnea[m]to me it looks more like documenting the code not the usage, so it should not be in the docs. let me try few approaches.13:25
ssbarnea[m]and guys, thanks for the help here, i clearly have few paths that I  can take.13:25
*** andreas_s has joined #openstack-infra13:27
*** numans_ has joined #openstack-infra13:27
*** caphrim007 has quit IRC13:28
AJaegerssbarnea[m]: tested locally and worked directly - feel free to take over (change   https://review.openstack.org/578798  )13:28
*** caphrim007 has joined #openstack-infra13:29
AJaegerssbarnea[m]: Oh, that one installed "PyYAML==4.1", so might break with constraints in the gate - let's see13:29
*** heyongli has quit IRC13:31
*** heyongli has joined #openstack-infra13:32
*** numans_ has quit IRC13:32
mordredssbarnea[m], fungi: it's jjb - even as an infra project it doesn' tneed build-openstack-sphinx-docs - just use build-sphinx-docs13:33
*** caphrim007 has quit IRC13:33
fungiagreed. i see no particular reason to force jjb to use the constranits-based jobs13:34
ssbarnea[m]i will fix it13:34
mordredbuild-openstack-sphinx-docs is just a wrapper around build-sphinx-docs which adds openstack constraints enforcement13:34
*** Shrews has joined #openstack-infra13:34
*** mriedem has joined #openstack-infra13:37
*** apetrich has joined #openstack-infra13:39
*** andreas_s has quit IRC13:40
*** heyongli has quit IRC13:42
*** heyongli has joined #openstack-infra13:42
ssbarnea[m]mordred: i see that jjb docs are published on  docs.openstack.org too, so the use of "publish-openstack-sphinx-docs-infra" template sounds correct. and I suspect that this one is also introducing the constrains.13:43
*** quique|rover|lch is now known as quiquell|rover13:43
*** alexchadin has quit IRC13:44
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: jenkins-job-builder change docs job  https://review.openstack.org/57880213:45
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Remove credentials from urls in merger log  https://review.openstack.org/57880313:45
mordredssbarnea[m]: I believe you're right - and I think that's a bug in publish-openstack-sphinx-docs-infra13:47
*** andreas_s has joined #openstack-infra13:49
*** hongbin has joined #openstack-infra13:50
*** rlandy|afk is now known as rlandy13:50
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Don't use requirements/constraints for infra docs  https://review.openstack.org/57880713:52
mordredfungi, AJaeger, ssbarnea[m]: ^^ something like that13:52
*** heyongli has quit IRC13:52
*** heyongli has joined #openstack-infra13:52
*** alexchadin has joined #openstack-infra13:54
openstackgerritSorin Sbarnea proposed openstack-infra/project-config master: Don't use requirements/constraints for infra docs  https://review.openstack.org/57880713:57
*** andreas_s has quit IRC13:58
*** kgiusti has joined #openstack-infra13:58
*** andreas_s has joined #openstack-infra13:59
*** ykarel is now known as ykarel|afk13:59
*** bobh has joined #openstack-infra13:59
*** agopi has joined #openstack-infra14:00
*** cshastri has quit IRC14:00
*** Guest88823 is now known as dansmith14:01
*** e0ne has joined #openstack-infra14:02
*** annp_ has joined #openstack-infra14:02
*** heyongli has quit IRC14:02
*** lpetrut has quit IRC14:03
*** heyongli has joined #openstack-infra14:03
*** ykarel|afk has quit IRC14:04
*** esarault has joined #openstack-infra14:05
*** esarault_ has joined #openstack-infra14:06
*** andreas_s has quit IRC14:08
*** esarault has quit IRC14:09
*** andreas_s has joined #openstack-infra14:10
*** andreas_s has quit IRC14:10
*** lbragstad has quit IRC14:10
*** andreas_s has joined #openstack-infra14:11
fungianybody happen to know why we use the term "core developer" instead of "core reviewer" in our zuul pipeline descriptions?14:12
ssbarnea[m]mordred: see https://review.openstack.org/#/c/578807/2/zuul.d/jobs.yaml@25314:12
*** heyongli has quit IRC14:12
*** heyongli has joined #openstack-infra14:13
*** apetrich has quit IRC14:16
*** andreas_s has quit IRC14:17
*** dhajare has quit IRC14:17
*** zhangfei has joined #openstack-infra14:17
mordredfungi: historical accidents?14:18
*** esarault has joined #openstack-infra14:19
*** andreas_s has joined #openstack-infra14:20
*** esarault_ has quit IRC14:21
*** quiquell|rover is now known as quiquell|off14:21
fungimordred: i'm tempted to clean up those mentions but they've propagated from project-config to system-config and zuul so i couldn't tell if it was just reuse of some original prose or something more intentional14:22
*** andreas_s has quit IRC14:22
*** andreas_s has joined #openstack-infra14:23
*** heyongli has quit IRC14:23
*** heyongli has joined #openstack-infra14:23
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Don't use requirements/constraints for infra docs  https://review.openstack.org/57880714:25
mordredssbarnea[m]: good catch - thanks!14:25
*** hemna_ has joined #openstack-infra14:25
*** jamesmcarthur has joined #openstack-infra14:25
mordredfungi: I think it's just propagation14:25
*** hemna_ has quit IRC14:25
mordredfungi: I happen to have an old copy of the old layout file with this:14:26
mordred"description: Changes that have been approved by core developers are enqueued in order in this pipeline, and if they pass tests in Jenkins, will be merged."14:26
*** haleyb has quit IRC14:27
*** rnoriega has quit IRC14:27
*** weshay|ruck has quit IRC14:27
*** _ari_ has quit IRC14:27
*** dpawlik has quit IRC14:27
*** _ari_ has joined #openstack-infra14:28
fungiyeah, i'll push some changes to clean it up in that case. just did a similar one for the project-team-guide14:28
*** haleyb has joined #openstack-infra14:28
*** rnoriega has joined #openstack-infra14:28
*** weshay has joined #openstack-infra14:28
Diabelkohello again14:30
Diabelkomight be a little bit weird question, but bear with me14:30
Diabelkohow many physical nodes does OpenStack's CI have?14:30
DiabelkoI mean, how big are the clusters that you spawn slaves on14:30
fungiwe have no idea14:30
fungiwe don't operate them14:30
fungiservice providers donate accounts to us14:31
fungiall we know is the quotas they've set for us14:31
Diabelkomhm14:31
fungiin most cases they're just accounts in public "clouds"14:31
*** e0ne has quit IRC14:31
Diabelkosure, thanks14:32
fungiand so the hardware is shared across all their customers14:32
Diabelkoand the reason I asked it's because someone was interested in having an openstack cluster with 2k nodes14:32
Diabelkoand supposedly all of that for the CI14:32
*** CrayZee has joined #openstack-infra14:33
Diabelkoand I'm trying to check if Zuul and Nodepool can handle that ;)14:33
fungisounds pretty massive14:33
mordredyes14:33
mordredzuul and nodepool can definitely handle it :)14:33
*** heyongli has quit IRC14:33
Diabelkoawesome14:33
DiabelkoI'll print out that quote and hang at the wall :P14:34
*** heyongli has joined #openstack-infra14:34
mordredbut it's a *lot* of capacity - for comparison, 2k concurrent vms is about our high-water mark currently - and those are 8G vms typically with about 4vcpus14:34
fungiyeah, the zuul/nodepool control plane are designed to be scaled out horizontally as needed (zuul executors and mergers, nodepool launchers and builders)14:34
*** annp_ has quit IRC14:35
*** Swami has joined #openstack-infra14:35
DiabelkoTungsten Fabric's (OpenContrail's) CI right now has limits for 70 VMs14:35
Diabelkoand we rarely hit that14:35
Diabelkoso there was no need to actually increase the limits for now14:35
Diabelkototally different scale :)14:36
Diabelkoagain, thank you guys ;)14:36
*** Swami_ has joined #openstack-infra14:37
*** weshay has quit IRC14:37
*** myoung has quit IRC14:37
*** _ari_ has quit IRC14:37
*** pabelanger has quit IRC14:37
*** rasca has quit IRC14:37
*** weshay has joined #openstack-infra14:38
*** pabelanger has joined #openstack-infra14:38
*** lbragstad has joined #openstack-infra14:38
*** lpetrut has joined #openstack-infra14:38
*** _ari_ has joined #openstack-infra14:38
*** rasca has joined #openstack-infra14:39
*** Swami has quit IRC14:39
*** e0ne has joined #openstack-infra14:40
*** shardy has quit IRC14:42
*** heyongli has quit IRC14:43
*** heyongli has joined #openstack-infra14:44
*** myoung has joined #openstack-infra14:44
openstackgerritMerged openstack-infra/zuul master: Remove credentials from urls in merger log  https://review.openstack.org/57880314:44
*** shardy has joined #openstack-infra14:45
*** numans_ has joined #openstack-infra14:45
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838514:46
*** kiennt26 has joined #openstack-infra14:47
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: WIP: Fix for pools with diff labels  https://review.openstack.org/57883114:49
aspiersanyone know what's up with bugs.launchpad.net? I get a timeout when I try to file a bug14:51
frickleraspiers: most of the time that disappears if you retry after a few minutes14:51
*** Swami_ has quit IRC14:51
aspiersI did retry after a few mins :-/14:52
frickleraspiers: if it persists, try opening the bug with a short subject and edit it later14:52
frickleraspiers: if that also doesn't help, take the error-code you get in the timeout and ask on #launchpad14:52
aspiersI'm not sure how a short subject would help? I literally can't file a bug at all14:53
aspiersI'll try #launchpad, thanks14:53
frickleraspiers: launchpad searches for existing bugs that match your subject initially. it may timeout if that search gets too complex14:53
*** heyongli has quit IRC14:53
*** heyongli has joined #openstack-infra14:54
*** cfriesen has joined #openstack-infra14:54
aspiersno, that search succeeded14:54
fungiaspiers: sometimes it has to do with which project you're trying to create a bugtask against too. sometimes it throws its hands up in disgust at write operations involving projects with a large number of subscribers14:54
aspiersit was the submission which failed14:54
aspiersfungi: I was submitting to masakari, so ... :-)14:54
fungiahh, yeah masakari is probably not one of those14:55
aspiersI've reported in #launchpad14:55
fungii've seen it with neutron and nova bugs14:55
fungiprojects with somewhere around a thousand subscribers14:55
*** alex_xu has quit IRC14:58
aspiersgot a reply on #launchpad: wait even longer (e.g. 10 mins)14:58
*** CrayZee is now known as snapiri-15:00
*** gongysh has quit IRC15:00
*** alex_xu has joined #openstack-infra15:00
openstackgerritMerged openstack/diskimage-builder master: Fix bootloader for efi on rhel systems  https://review.openstack.org/57604115:02
*** duke has joined #openstack-infra15:02
*** duke has left #openstack-infra15:02
*** Swami has joined #openstack-infra15:03
*** heyongli has quit IRC15:04
*** heyongli has joined #openstack-infra15:04
*** alexchadin has quit IRC15:06
openstackgerritMerged openstack-infra/project-config master: jenkins-job-builder change docs job  https://review.openstack.org/57880215:07
*** bobh has quit IRC15:07
*** rpioso|afk is now known as rpioso15:08
*** kiennt26 has quit IRC15:10
*** hamzy has quit IRC15:11
*** yamamoto has quit IRC15:12
*** yamamoto has joined #openstack-infra15:12
*** heyongli has quit IRC15:14
*** heyongli has joined #openstack-infra15:14
AJaegermordred: I don't think 578807 will work - if the constraints file is missing, the roles break. Don't they?15:15
mordredAJaeger: they shouldn't - build-sphinx-docs does not require a constraints file, since that is an openstack-specific thing15:15
*** e0ne has quit IRC15:15
mriedemhmm, new pbr release? http://logs.openstack.org/32/560832/11/check/tempest-full-py3/79f5de2/job-output.txt.gz#_2018-06-28_13_29_30_78422515:15
mriedemnope15:16
mordredAJaeger: http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/install-if-python/tasks/main.yaml#n3315:16
AJaegermordred: indeed, let's try...15:19
AJaegermordred: I overlooked one bit in my first investigation...15:19
*** Shrews has quit IRC15:20
*** kiennt26 has joined #openstack-infra15:23
*** caphrim007 has joined #openstack-infra15:23
*** gyee has joined #openstack-infra15:24
*** heyongli has quit IRC15:24
*** heyongli has joined #openstack-infra15:25
*** esarault_ has joined #openstack-infra15:25
*** Shrews has joined #openstack-infra15:26
*** caphrim007 has quit IRC15:26
*** caphrim007 has joined #openstack-infra15:26
*** caphrim007 has quit IRC15:27
*** caphrim007 has joined #openstack-infra15:27
*** esarault has quit IRC15:29
*** jamesmcarthur has quit IRC15:31
*** heyongli has quit IRC15:34
*** heyongli has joined #openstack-infra15:35
*** zhangfei has quit IRC15:35
*** lpetrut has quit IRC15:36
*** lpetrut has joined #openstack-infra15:37
*** jamesmcarthur has joined #openstack-infra15:38
openstackgerritMerged openstack-infra/zuul master: Don't add implied branch matchers to project-pipeline variants  https://review.openstack.org/57788115:39
*** lxkong has quit IRC15:39
*** hamzy has joined #openstack-infra15:40
*** andreas_s has quit IRC15:42
*** zoli is now known as zoli|gone15:43
*** zoli|gone is now known as zoli15:44
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Fix typos in docs  https://review.openstack.org/57885415:44
*** heyongli has quit IRC15:45
*** ykarel has joined #openstack-infra15:45
*** heyongli has joined #openstack-infra15:45
*** Shrews has quit IRC15:45
*** iranzo has quit IRC15:46
*** Shrews has joined #openstack-infra15:47
*** pbourke has quit IRC15:50
*** dpawlik has joined #openstack-infra15:51
*** hashar is now known as hasharAway15:52
*** pbourke has joined #openstack-infra15:52
smcginnisI've added ACLs and other things for the operations-guide repo, but when I try to submit a patch I get an error that it is read-only.15:53
smcginnisIs there somewhere else I need to make a change?15:53
fungismcginnis: i wonder if the new acl doesn't actually turn off the read-only flag and leaves it in whatever state it found it15:54
fungiwe don't often un-retire repos so this may be slightly uncharted territory15:55
*** heyongli has quit IRC15:55
smcginnisfungi: Any idea what I can check or where to go from here?15:55
*** heyongli has joined #openstack-infra15:55
fungii can manually alter the read-only state of the project in gerrit, but it would be good to figure out how to make the manage-projects script do that on its own15:55
*** udesale has quit IRC15:56
*** dpawlik has quit IRC15:56
*** udesale has joined #openstack-infra15:56
ssbarnea[m]can we inject some life in gerritlib? I have one review that is >1 year old, https://review.openstack.org/#/c/451992/15:57
openstackgerritJeremy Stanley proposed openstack-infra/project-config master: Remove obsolete zuul and jenkins dev configs  https://review.openstack.org/57886515:58
openstackgerritJeremy Stanley proposed openstack-infra/project-config master: There are no core developers, only core reviewers  https://review.openstack.org/57886615:58
corvusfungi, smcginnis: i'm guessing it's a matter of explicitly setting the state attribute rather than just removing it from the acl file.15:58
fungicorvus: yeah, that's my assumption as well, i just need to free up a minute to look16:00
*** esarault has joined #openstack-infra16:00
smcginnisIt can definitely wait until after TC office hours.16:00
fungioh look, they just ended ;)16:00
TheJuliaSo, how do we go about changing the irc channel topics?16:01
TheJuliaAt least for ones owned by openstackinfra and the openstack bot16:02
*** amoralej is now known as amoralej|off16:02
*** esarault_ has quit IRC16:02
fungiTheJulia: you do it through chanserv16:03
fungiTheJulia: if you're on the chanserv access list for the channel and have the +t permission granted, you can /msg chanserv topic #mychannel This is our channel topic16:03
TheJuliafungi: looks like I'm not16:04
TheJulia:\16:04
fungiTheJulia: which channel?16:04
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Don't use requirements/constraints for infra docs  https://review.openstack.org/57880716:04
TheJulia#openstack-ironic16:04
*** lpetrut has quit IRC16:05
*** heyongli has quit IRC16:05
fungiTheJulia: seeing as you're the ironic ptl, i'm just going to add you16:05
TheJuliafungi: thanks!16:05
*** heyongli has joined #openstack-infra16:06
*** slaweq has quit IRC16:06
fungiTheJulia: done, you now have the same access as your predecessors16:06
TheJulia\o/16:06
fungiwe can also add anyone else you want to be a channel operator16:07
fungijust let us know16:07
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838516:07
fungismcginnis: i need to go run some errands, but can look at the repo state as soon as i get back. should be less than an hour16:07
*** bobh has joined #openstack-infra16:08
*** shardy has quit IRC16:08
smcginnisfungi: Thanks, take your time.16:08
*** ccamacho has quit IRC16:09
dtantsurfungi: oh, fun, I did not know that when I was the PTL :)16:09
smcginnisI thought channel topics were periodically reset from something listed in a yaml file somewhere.16:10
*** florianf has quit IRC16:10
TheJuliasmcginnis: I was thinking the same, but at the same time I was also wondering "Wait, I would have likely had seen this changed at some point...." if it was16:11
openstackgerritMonty Taylor proposed openstack-infra/zuul master: web: fix status page flickering  https://review.openstack.org/57822616:11
mgagnewhat's the best way to change my main email address in LP and not break Gerrit and friends?16:12
*** panda is now known as panda|off16:12
AJaegerconfig-core, could you review https://review.openstack.org/#/c/578574/ and https://review.openstack.org/#/c/578701 to finalize removing of system-required template from project-config, please?16:12
*** ccamacho has joined #openstack-infra16:14
*** heyongli has quit IRC16:15
*** heyongli has joined #openstack-infra16:16
*** d0ugal has quit IRC16:17
*** kiennt26 has quit IRC16:18
clarkbTheJulia: smcginnis our bot resets topics during outages if we ask it too you then sets them back to what they were on the all clear16:19
openstackgerritMatt Riedemann proposed openstack-infra/project-config master: Remove ironic-tempest-dsvm-ipa-wholedisk-bios-agent_ipmitool-tinyipa for nova  https://review.openstack.org/57887916:19
clarkbmgagne: I am not sure there is a way? I want to say changing the primary email address on an lp account results in a new openid which will confuse gerrit. fungi probably remembers best having debugging and understood that all at the time it was causing us much trouble16:20
mgagneyes, my concern is the change with openid16:21
mriedemmgagne: when i left ibm i had to change launchpad from mriedem@us.ibm.com to mriedem.os@gmail.com16:21
*** jpich has quit IRC16:21
mriedemi have an email from fungi if i can find it16:21
*** Shrews has quit IRC16:21
mgagnemriedem: I can't change mine to mriedem.os@gmail.com too :D16:22
stephenfinQuestion: do zuul jobs support nodes and anchors? https://anil.io/blog/symfony/yaml/using-variables-in-yaml-files/16:22
smcginnisYeah, I think you just need to add the new email address to your LP settings.16:22
stephenfinTo avoid needing to duplicate stuff16:22
smcginnisstephenfin: I played around with that awhile back. I believe so.16:22
clarkbstephenfin: they should, both zuul and ansible use pyyaml which supports them16:22
stephenfinExcellent. Thanks smcginnis, clarkb :)16:22
* stephenfin goes to experiment16:23
mgagneI got the new email as an alternative email too. I want to change my main to be more neutral. So I guess if mriedem can find that email, that would be great. :P16:23
corvusstephenfin: for zuul.yaml files, note that the scope is only within a single file (you can't reference one defined in another file)16:23
corvusbut otherwise yes16:23
*** Shrews has joined #openstack-infra16:23
mriedemstephenfin: i'll make that update16:24
stephenfinmriedem: I was just about to ask. Go for it16:24
mriedemmgagne: unfortunately i'm not seeing it, probably deleted it and thunderbird only keeps it around for a year i think (and this was over a year ago)16:24
mriedemmgagne: but yeah you can add your new email here https://launchpad.net/~mriedem and sign in with it as your primary16:25
*** slaweq has joined #openstack-infra16:25
*** janki has quit IRC16:25
mriedemwell, for your profile of course :)16:25
pabelangerdo we happen to gather the complete output of syslog (on node) from a job? Trying to compare something we are seeing in rdo about multiple connections to a job from zuul-executor16:25
mgagnemight be the same procedure? https://docs.openstack.org/infra/system-config/gerrit.html#duplicate-accounts-in-gerrit or https://docs.openstack.org/infra/system-config/gerrit.html#combining-gerrit-accounts ?16:25
pabelangerif not, I should be able to quickly write something16:25
mriedeminterestingly, openid loging for launchpad still shows my us.ibm.com email16:25
mgagnewhich will require help from infra team16:26
*** heyongli has quit IRC16:26
*** heyongli has joined #openstack-infra16:26
mriedemhttps://review.openstack.org/#/settings/web-identities to change emails in gerrit16:26
mriedemhttps://review.openstack.org/#/settings/contact16:26
*** raopajay has quit IRC16:26
mgagneyep, got that one sorted out. I guess what's left is changing my openid email16:28
corvuspabelanger: devstack does, regular jobs don't16:28
*** Shrews has quit IRC16:29
mgagneI guess I'm just gonna update it and see how bad it breaks16:29
clarkbmgagne: let us know either way (as it would be helpful to know fr the future)16:29
pabelangercorvus: thanks16:30
clarkbpabelanger: corvus: devstack grabs the entire journal too16:30
*** udesale has quit IRC16:31
pabelangeryup, I found one thanks16:33
*** auristor has quit IRC16:34
*** ramishra has quit IRC16:34
stephenfinAnother question for the audience: is there a local linter/client we can use to validate our zuul job definitions locally?16:36
*** heyongli has quit IRC16:36
*** heyongli has joined #openstack-infra16:36
*** eharney has quit IRC16:37
*** tesseract has quit IRC16:38
mgagneso it appears that you can change your main email address without infra involvement if you do it in the right order16:38
mgagneI think that previous users changed it in Ubuntu One/LP and wondered why Gerrit didn't detect it when in fact, they didn't add the new email to Gerrit first.16:40
clarkbstephenfin: not currently, proper checking requires loading the entire global state and the zuul service is what has that and we've not sorted out an api to query it for linting locally (or some other method)16:40
clarkbmgagne: ah16:40
stephenfinclarkb: Makes sense. Thanks for the info16:41
*** apetrich has joined #openstack-infra16:42
*** Shrews has joined #openstack-infra16:44
*** jbadiapa has quit IRC16:44
*** auristor has joined #openstack-infra16:45
*** heyongli has quit IRC16:46
*** heyongli has joined #openstack-infra16:47
*** jamesmcarthur has quit IRC16:48
*** trown is now known as trown|lunch16:49
*** eharney has joined #openstack-infra16:50
*** salv-orlando has joined #openstack-infra16:51
notmynamewhere's the right place to ask questions or generally talk about dev work in bindep?16:52
*** jamesmcarthur has joined #openstack-infra16:53
*** Swami has quit IRC16:53
*** rh-jelabarre has quit IRC16:53
clarkbnotmyname: probably here or on the infra mailing list16:54
notmynameclarkb: ok, thanks16:54
*** yamahata has quit IRC16:54
*** salv-orlando has quit IRC16:56
*** heyongli has quit IRC16:56
*** heyongli has joined #openstack-infra16:57
*** baoli has joined #openstack-infra16:58
*** ramishra has joined #openstack-infra16:59
*** derekh has quit IRC17:00
*** eernst has joined #openstack-infra17:00
*** Shrews has quit IRC17:00
openstackgerritMerged openstack-infra/gerritlib master: Updated list of Python versions in tox  https://review.openstack.org/45199217:01
*** jpena is now known as jpena|off17:01
*** baoli has quit IRC17:02
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Translate zuulStartStream into typescript  https://review.openstack.org/55861817:02
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Shift log streaming code into StreamComponent  https://review.openstack.org/55861917:02
*** Shrews has joined #openstack-infra17:03
*** dpawlik has joined #openstack-infra17:04
*** gfidente is now known as gfidente|afk17:06
*** heyongli has quit IRC17:07
*** heyongli has joined #openstack-infra17:07
*** dpawlik has quit IRC17:09
*** Shrews has quit IRC17:09
*** jaosorior has quit IRC17:10
dhellmanncorvus : do you think you'll have some time to talk about https://etherpad.openstack.org/p/goal-python3-first tomorrow?17:10
*** electrofelix has quit IRC17:10
*** eernst has quit IRC17:11
*** Shrews has joined #openstack-infra17:11
*** alexchadin has joined #openstack-infra17:12
*** yamahata has joined #openstack-infra17:13
*** Shrews has quit IRC17:16
*** Shrews has joined #openstack-infra17:17
*** heyongli has quit IRC17:17
*** heyongli has joined #openstack-infra17:17
*** ccamacho has quit IRC17:18
*** alexchadin has quit IRC17:19
*** lpetrut has joined #openstack-infra17:20
mgagneclarkb: the best I could do for documentation: https://gist.github.com/mgagne/f8c42692f83995c9f4b413e8dd4e176717:20
mgagneI had already done some steps in the past so I'm not sure if ALL are required but it worked for me17:20
fungiclarkb: mgagne: changing which e-mail address you use to authenticate to login.ubuntu.com is what i think ends up causing you to get a different openid. updating which address is primary in lp should _probably_ have no impact, as long as that's a separate configuration?17:22
*** dtantsur is now known as dtantsur|afk17:22
mgagneI think you should add it to Gerrit too so it can found your current account?17:22
*** bobh_ has joined #openstack-infra17:23
*** bobh has quit IRC17:23
mgagneotherwise you just end up with the same old problem where one has a new account in Gerrit and can't find its old changes and you need to merge both accounts.17:24
*** SumitNaiksatam has joined #openstack-infra17:24
fungimgagne: _if_ you wind up with a new openid, then yes we have to manually alter the db to associate that with your old account and mark the newly autocreated account inactive so you don't end up with query conflicts in odd places17:25
mgagnefungi: you DO end up with a new openid17:26
*** ramishra has quit IRC17:26
mgagneor not?17:26
openstackgerritBrian Haley proposed openstack-infra/devstack-gate master: Support an IPv6 underlay network  https://review.openstack.org/34304117:27
fungimgagne: if you change the address you use with login.ubuntu.com then i _think_ you end up with a new openid17:27
mgagnewut... same openid but different domain: login.ubuntu.com vs login.launchpad.net17:27
*** heyongli has quit IRC17:27
fungilogin.launchpad.net is also login.ubuntu.com, just the former name is deprecated17:27
clarkbmgagne: login.ubuntu.com is the canonical (no pun intended) location now aiui17:27
mgagneso it's all fine, same openid. just need to make sure Gerrit has your new email prior to change.17:27
*** alexchadin has joined #openstack-infra17:28
fungiubuntu sso isn't technically part of launchpad, just used to share a domain name with it17:28
*** heyongli has joined #openstack-infra17:28
*** e0ne has joined #openstack-infra17:28
*** e0ne has quit IRC17:28
fungii've been instructed that they're entirely separate software/services, launchpad just happens to _use_ the sso17:29
mgagnebecause I don't think LP/Ubuntu One shares your alternative emails during the login process.17:29
mgagnewhich could confuse Gerrit otherwise17:29
mgagneright17:29
mgagneso add new email to openid consumer sites first and then update ubuntu one.17:30
*** esarault_ has joined #openstack-infra17:31
openstackgerritBrian Haley proposed openstack-infra/devstack-gate master: Support an IPv6 underlay network  https://review.openstack.org/34304117:31
*** eharney_ has joined #openstack-infra17:32
*** ykarel has quit IRC17:32
*** bobh_ has quit IRC17:33
*** alexchadin has quit IRC17:33
*** bobh has joined #openstack-infra17:33
*** esarault has quit IRC17:33
openstackgerritMerged openstack-infra/zuul master: Revert "Revert "Upgrade from angularjs (v1) to angular (v6)""  https://review.openstack.org/57838417:33
openstackgerritMerged openstack-infra/zuul master: Use window.location.href for the href not pathname  https://review.openstack.org/57824317:33
*** bobh_ has joined #openstack-infra17:33
*** tonytan4ever_brb has joined #openstack-infra17:34
*** eharney has quit IRC17:35
*** eharney_ is now known as eharney17:35
*** tonytan4ever has quit IRC17:37
fungimgagne: good to know that works--thanks for testing!17:37
*** heyongli has quit IRC17:37
*** bobh has quit IRC17:38
*** heyongli has joined #openstack-infra17:38
*** jesslampe has joined #openstack-infra17:39
*** jamesmcarthur has quit IRC17:40
fungismcginnis: so, for starters, i've confirmed that https://review.openstack.org/#/admin/projects/openstack/operations-guide is read-only17:43
fungismcginnis: _however_ i think the fact that https://review.openstack.org/#/admin/projects/openstack/operations-guide,access is empty points to the problem17:44
smcginnisfungi: Any automation that flips that switched?17:44
fungispecifically, the way manage-projects updates configuration for a project is to push the updated configuration into it17:44
fungiand if a project is read-only, it can't do that17:44
fungii'm starting to remember this catch-22 came up at least once in the past17:44
*** Shrews has quit IRC17:45
smcginnisfungi: Ah, so my ACL changes couldn't actually be applied in gerrit because of that?17:45
fungiand i think we decided at the time that it was too complex an issue to work around given the infrequency with which we encounter it17:45
fungiso, yes, i think if i manually flip the switch then manage-projects will be able to push a working acl into it17:46
fungibut yeah, basically it can make a project read-only by pushing a configuration update into it, but then once it's read-only it can't undo it the same way17:46
smcginnisThat's too bad it can't just be automated, but at least it does seem to be a simple and infrequent thing.17:46
fungiwe could automate this, if we wanted, by making calls to the api instead17:46
smcginnisProbably more effort than it's worth.17:47
fungiyeah, as i said, i think that's the conclusion we came to last time17:47
smcginnisUnless that would make it better by not needing to remember these caveats on the rare occasions it happens.17:47
fungiright ;)17:47
*** snapiri- has quit IRC17:47
*** jesslampe has quit IRC17:47
smcginnisfungi: Is there anywhere that would make sense for me to push a documentation patch noting this?17:47
fungianyway, i've switched it back from read-only to active state17:47
fungismcginnis: that might be a sufficient compromise17:48
*** heyongli has quit IRC17:48
fungimaybe at/near the end of the retirement instructions we can have a notebox about it or something17:48
clarkbsmcginnis: fungi possibly a footnote on retiring a project for unretiring a project17:48
fungiyeah17:48
*** heyongli has joined #openstack-infra17:48
*** jamesmcarthur has joined #openstack-infra17:49
smcginnisOK, I'll see if I can draft some kind of breadcrumb at least to leave there to trigger everyone's memory next time it happens.17:49
smcginnisfungi: Any next step actions needed from me to move ahead, or is this something you can take care of?17:49
fungiso when manage-projects runs again this would correct itself, but seeing as how we haven't merged anything recently to trigger that i'll run it manually instead17:49
*** trown|lunch has quit IRC17:50
smcginnisOh good, that was going to be my next question.17:50
smcginnisI see state says active now.17:50
fungiour mp caching is fighting me on this17:51
fungiapparently because nothing with the acl has changed since the last time it ran, it doesn't want to do anything17:51
fungineed to figure out a workaround with the cache, just a sec17:52
*** salv-orlando has joined #openstack-infra17:52
fungii mangled the sha for it in the cache17:53
fungithat seems to have worked17:53
fungihttps://review.openstack.org/#/admin/projects/openstack/operations-guide,access is now an acl17:53
openstackgerritMerged openstack-infra/project-config master: Don't use requirements/constraints for infra docs  https://review.openstack.org/57880717:53
fungismcginnis: lmk if you need anything else on this, but i think you should be all set now17:53
smcginnisfungi: Thanks, it looks correct to me.17:54
smcginnisI will try pushing up a patch for review. If you don't hear anything more from me you can assume all is good.17:54
*** lpetrut has quit IRC17:54
*** salv-orlando has quit IRC17:56
*** trown has joined #openstack-infra17:57
*** Shrews has joined #openstack-infra17:58
*** heyongli has quit IRC17:58
*** heyongli has joined #openstack-infra17:58
*** jamesmcarthur has quit IRC18:07
*** alexchadin has joined #openstack-infra18:08
*** jamesmcarthur has joined #openstack-infra18:08
*** heyongli has quit IRC18:08
openstackgerritSean McGinnis proposed openstack-infra/infra-manual master: Add note about project read-only step for unretirement  https://review.openstack.org/57895418:08
*** heyongli has joined #openstack-infra18:09
smcginnisfungi, clarkb: We'll see if that helps. ^18:09
fungithanks!18:10
*** jamesmcarthur has quit IRC18:10
*** jamesmcarthur has joined #openstack-infra18:11
*** SumitNaiksatam_ has joined #openstack-infra18:12
*** alexchadin has quit IRC18:13
*** SumitNaiksatam has quit IRC18:13
*** SumitNaiksatam_ is now known as SumitNaiksatam18:13
*** pcaruana has quit IRC18:14
*** jamesmcarthur has quit IRC18:15
*** heyongli has quit IRC18:18
*** esarault has joined #openstack-infra18:19
*** heyongli has joined #openstack-infra18:19
*** SumitNaiksatam has quit IRC18:20
*** huzefa has joined #openstack-infra18:21
huzefaIs this the right place to ask about DevStack? I'm trying to use osprofiler and having some problems18:22
clarkbhuzefa: #openstack-qa is probably more appropriate for devstack and osprofiler18:22
huzefathanks18:22
*** esarault_ has quit IRC18:22
*** Shrews has quit IRC18:23
*** yolanda_ has joined #openstack-infra18:25
corvusdhellmann: yes; my afternoon would probably be best18:26
*** jamesmcarthur has joined #openstack-infra18:27
*** yolanda has quit IRC18:27
openstackgerritMerged openstack-infra/zuul master: Consolidate navigation functions  https://review.openstack.org/57838518:29
*** heyongli has quit IRC18:29
*** Shrews has joined #openstack-infra18:29
*** jamesmcarthur has quit IRC18:29
*** heyongli has joined #openstack-infra18:29
dhellmanncorvus : you're west cost of US still, right?18:29
corvusya18:29
dhellmanncorvus : how about 13:00 your time, then?18:30
corvusdhellmann: wfm18:30
*** Shrews_ has joined #openstack-infra18:32
dhellmanncorvus : invitation incoming18:32
*** esarault has quit IRC18:34
fungi"west cost" is certainly an apt description of the bay area18:34
*** Shrews_ has quit IRC18:34
*** Shrews has quit IRC18:35
*** gfidente|afk has quit IRC18:37
corvusdhellmann: i feel like i'm involved in this because i can answer questions about how zuul will run jobs, but it's looking like the proposal may involve changing some of the job content, so it'd be great if we can also get some input from someone with more of a stake in them such as mordred, fungi, or clarkb.18:38
*** heyongli has quit IRC18:39
*** heyongli has joined #openstack-infra18:39
*** armaan has joined #openstack-infra18:40
corvus(a bunch of unrelated 20:00 utc meetings just got scheduled, didn't they? :)18:40
clarkbcorvus: dhellmann what day are we talking about for 2000UTC?18:41
corvustomorrow18:41
dhellmannthe latest draft of the plan is in https://etherpad.openstack.org/p/goal-python3-first for your review between now and then18:41
dhellmannI can just drop by here if that's the easiest place to "meet"18:42
corvusyeah.  we can move to another channel if it's busy, but we might want to do some voice chatting too.18:42
dhellmannoh, good point, I forgot you mentioned that18:43
dhellmannare folks ok with a google hangout for that?18:43
corvusnot really.  we do have a pbx server though.18:43
dhellmannok, that works then18:43
dhellmannI don't know how to get to that, but I'm sure one of you can tell me :-)18:43
corvushttps://wiki.openstack.org/wiki/Infrastructure/Conferencing18:43
*** vivsoni_ has joined #openstack-infra18:44
dhellmannok18:44
*** vivsoni has quit IRC18:44
mordreddhellmann: if I wanted to make comments on that plan - should I do them inline? or collect them somewhere else like the end?18:44
* mordred wants to do the thing that's the least disruptive to folks18:44
dhellmannmordred : inline is OK, that's part of why I moved it to an etherpad for now18:45
*** huzefa has left #openstack-infra18:45
dhellmannand I wiped the original color from the import so we could tell what mods are being made18:45
*** armaan has quit IRC18:45
mordredcool18:45
dhellmannI tried to bold the actions I still need to take, fwiw18:45
*** Shrews has joined #openstack-infra18:45
*** armaan has joined #openstack-infra18:45
*** rfolco is now known as rfolco_afk18:46
*** e0ne has joined #openstack-infra18:47
*** heyongli has quit IRC18:49
*** heyongli has joined #openstack-infra18:50
*** e0ne has quit IRC18:50
*** armaan has quit IRC18:50
*** salv-orlando has joined #openstack-infra18:53
mtreinishcorvus, clarkb, pabelanger, mordred: If you get a sec can you take a look at: https://review.openstack.org/#/q/status:open+topic:firehose-cyrus18:55
mtreinishI'm keen to get lpmqtt fixed since it hasn't been emitting messges since dec.18:56
*** tonytan4ever_brb has quit IRC18:56
*** tonytan4ever has joined #openstack-infra18:56
*** jamesmcarthur has joined #openstack-infra18:56
*** salv-orlando has quit IRC18:57
*** heyongli has quit IRC18:59
*** heyongli has joined #openstack-infra19:00
clarkbcorvus: do you want to review mtreinish's ^ exim change?19:00
clarkber I guess fungi wrote it19:01
mtreinishclarkb: heh, yeah they're fungi's patches :)19:02
*** jamesmcarthur has quit IRC19:03
corvus+519:03
clarkbI got the second +w19:04
openstackgerritMerged openstack-infra/project-config master: Add kata runtime and tests repos to zuul  https://review.openstack.org/57856219:05
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Fix for pools with different labels  https://review.openstack.org/57883119:05
openstackgerritMerged openstack-infra/zuul master: Fix typos in docs  https://review.openstack.org/57885419:09
*** heyongli has quit IRC19:10
*** heyongli has joined #openstack-infra19:10
*** heyongli has quit IRC19:20
*** heyongli has joined #openstack-infra19:20
*** rfolco_afk is now known as rfolco19:20
*** rh-jelabarre has joined #openstack-infra19:23
*** jesslampe has joined #openstack-infra19:27
*** dpawlik has joined #openstack-infra19:28
*** heyongli has quit IRC19:30
*** heyongli has joined #openstack-infra19:31
*** jcoufal has joined #openstack-infra19:31
*** jcoufal has quit IRC19:31
*** dpawlik has quit IRC19:33
openstackgerritMerged openstack-infra/puppet-exim master: Make localuser router optional  https://review.openstack.org/57789319:33
*** Shrews has quit IRC19:33
*** Shrews has joined #openstack-infra19:34
*** Shrews has quit IRC19:35
*** Shrews has joined #openstack-infra19:35
*** jesslampe has quit IRC19:35
openstackgerritMerged openstack-infra/system-config master: Check "cyrus" Exim router before "localuser"  https://review.openstack.org/57789519:36
*** bobh_ has quit IRC19:37
*** eharney has quit IRC19:39
*** heyongli has quit IRC19:40
*** heyongli has joined #openstack-infra19:41
weshayanyone know why I would hit http://logs.openstack.org/13/528213/42/gate/tripleo-ci-centos-7-containerized-undercloud-upgrades/58315c1/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-06-28_18_27_5219:41
weshay2018-06-28 18:27:52 | time="2018-06-28T18:27:51Z" level=fatal msg="pinging docker registry returned: Get https://registry-1.docker.io/v2/: dial tcp: lookup registry-1.docker.io on 127.0.0.1:53: no such host"19:41
weshayhttp://logs.openstack.org/13/528213/42/gate/tripleo-ci-centos-7-containerized-undercloud-upgrades/58315c1/logs/undercloud/etc/resolv.conf.txt.gz19:41
weshayusing unbound19:42
fungidoes it happen regularly or only occasionally?19:42
weshayoccasionally.. but I fear infra's wrath re: gate failures19:42
weshay:)19:42
fungiyeah, one common explanation is that one of the authoritative nameservers for the domain was briefly returning a no-such-domain response for that record and so it got cached by one of the recursive resolvers being used as a forwarder19:43
pabelangerdoes docker have a crazy low TTL on dns?19:44
*** Shrews has quit IRC19:44
weshaydoes it make sense to cache no-such-domain responses?19:44
pabelangerI want to say 60 seconds19:45
clarkbdocker doesn't use unbound19:45
clarkbiirc it will use google dns19:45
clarkbbecause you can't talk to localhost port 53 on the host from a container19:45
fungipabelanger: it has a 60-second ttl on those records but a 1-day negative cache ttl19:45
fungiweshay: the ietf thinks so, yes19:45
fungiwhich is why there's a negative cache ttl field in every soa19:45
weshayheh fair.. seems odd to me though19:45
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstackci master: Add beaker tests for nodepool  https://review.openstack.org/57752219:46
pabelangerclarkb: fungi: I thought the last time we discussed this, there was a setting in unbound we could override the 60sec TTL on the domain?19:46
fungiit's so that authoritative nameservers don't get overrun with lookups for the same nonexistent record getting accidentally pounded over and over because of a typo somewhere19:46
pabelangerto avoid the lookup on forwarders19:47
weshayfungi, that makes sense19:47
fungipabelanger: probably, but as clarkb suggested docker ignores your actual nameserver configuration19:47
clarkbianw: good point on https://review.openstack.org/#/c/578153/4 I left some concerns with that approach, curious to know what you think of the laternatives I left19:47
clarkbfungi: pabelanger yes docker ebhavior aiui is to use the host /etc/resolv.conf unless it has localhost listed then they just use google19:48
fungiaha, and since we run unbound on localhost/loopback...19:48
pabelangermaybe we need some firewall rule to rewrite 8.8.8.8 lookup in that case?19:48
pabelangeror use public interface for nameserver in those cases19:49
weshaycode in question is.. http://git.openstack.org/cgit/openstack/tripleo-common/tree/tripleo_common/image/image_uploader.py#n32419:49
clarkbpabelanger: I don't think we should do that, we aren't the police, we provide resources software doesn't have to use them19:49
fungior bind a linklocal address to a virtual interface and have unbound listen on that in jobs which use docker19:49
clarkbinfra-root https://review.openstack.org/#/c/578556/ is an easy one that will help finish up my ssl work of the last week or so19:49
fungipabelanger: relying on the public interface for doing such things is problematic for a couple reasons19:49
weshayso I don't think it's docker cli19:50
weshayat least19:50
pabelangerclarkb: right, but if jobs are failing because docker is ignoring our configuration, we likely need to workaround it19:50
pabelangerfungi: yah, new virtual loopback might work too19:50
clarkbpabelanger: I think the jobs need to workaround them if using broken software yes19:51
fungipabelanger: foremost because using the actual vm interface would make it too easy to accidentally start running an open recursive resolver on test nodes19:51
*** heyongli has quit IRC19:51
clarkbI don't think we can accomodate all broken software19:51
*** heyongli has joined #openstack-infra19:51
pabelangerfungi: +119:51
pabelangerclarkb: ack19:51
clarkbthis is a long standing issue in docker, they added an opt in work around to docker itself you can use19:52
clarkbyou basically have to set up your networking the way lxc does it aiui19:52
clarkband docker runs a dns proxy effectively between the namespaces for you19:52
clarkbbut you have to configure docker to do that, I don't think infra can do that for every job that wants to use docker19:52
pabelangerclarkb: do you remember where that code is for the rewrite to 8.8.8.8?19:53
*** ssbarnea[m] is now known as ssbarnea19:53
clarkbpabelanger: https://docs.docker.com/config/containers/container-networking/#ip-address-and-hostname look for "DNS services"19:53
clarkb"If the container cannot reach any of the IP addresses you specify, Google’s public DNS server 8.8.8.8 is added, so that your container can resolve internet domains."19:54
pabelangerthanks19:54
mwhahahabut those types of requests aren't from within docker containers, it's docker itself19:55
mwhahahait's when we go to pull an image19:55
mwhahahaso not sure if it's the same setting19:56
pabelangerthat was why I was thinking it had to do with low TTL on docker.com (60 seconds) unbound is only caching that for a short time, before hitting forwarding.conf servers again19:56
pabelangerI thought dmsimard found a setting in unbound to override it19:57
pabelangerbut unsure if we actually landed any change for that19:57
dmsimardwe did19:57
clarkblooks like it is using tcp for dns lookup I don't expect htat is a problem but is odd19:58
mwhahahahttp://logs.openstack.org/13/528213/42/gate/tripleo-ci-centos-7-containerized-undercloud-upgrades/58315c1/logs/undercloud/etc/unbound/conf.d/ttl.conf.txt.gz19:58
dmsimardpabelanger: http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/commit/?id=f795128f21ba943a58ed7f257952c90b38a05f2119:59
mwhahahaof course the unbound logs are blank again19:59
dmsimardpabelanger: http://codesearch.openstack.org/?q=unbound_cache&i=nope&files=&repos=19:59
fungiclarkb: since that record is a largeish rr set, it may be in excess of the 512b limit for datagram responses19:59
fungii get 8 records back20:00
clarkbah20:00
clarkbdouble check unbound is listening on tcp:53 maybe? pretty sure it is based on memory20:01
*** heyongli has quit IRC20:01
*** heyongli has joined #openstack-infra20:01
clarkbtcp        0      0 127.0.0.1:53            0.0.0.0:*               LISTEN      696/unbound20:02
clarkblooks like it is20:02
*** vivsoni_ has quit IRC20:03
*** vivsoni has joined #openstack-infra20:03
clarkbif that rr is dynamically populated using a healthcheck is it possible that none of the servers wree up for a short period an dthe record was empty?20:06
clarkbwe just happened to catch the upstream outage?20:06
fungialso they're using amazon's dns farm. in my experience this sort of thing is almost always a glitch with one of the master nameservers briefly returning no-such-domain responses which end up getting cached for the duration of the negative cache ttl by a random set of intermediary recursive resolvers, resulting in inconsistent resolution for a while after the original event is resolved20:09
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Add zuul.child_jobs in ansible inventory file  https://review.openstack.org/57818120:09
*** zul has quit IRC20:10
*** heyongli has quit IRC20:11
*** heyongli has joined #openstack-infra20:12
fungiif that's the case expect some percentage of lookup failures roughly proportional with the inverse of the number of authoritative servers (or some multiple of it) for anywhere from the negative cache ttl duration minus the record ttl, to the full negative cache ttl duration (in this case the two are basically the same given the disparity between the two values)20:14
fungiwhen the record and negative cache ttls are closer, you tend to get a half-life sort of envelope20:15
weshayk.. checking what we can do on our end.. if we think that's just a blip on the radar we'll hit from time to time20:21
weshaythank you20:21
*** heyongli has quit IRC20:21
*** heyongli has joined #openstack-infra20:22
*** kgiusti has left #openstack-infra20:24
clarkbfungi: I'm still trying to sort out dynamic mtu value setting and ianw makes agreat point that my current setup isn't idempotent and subsequent overlays will have a lower mtu because the previous overlay had a lower mtu and we find the lowest mtu and subtract from that again...20:25
clarkbfungi: I'm trying to determine if there is a good way to filter the interfaces on the host to only get the "real" ones20:25
clarkbbasically anything that models physical hardware, any idea if there is a good way to do that?20:26
clarkb(I'm poking around in sysfs now and now finding a good answer to that)20:26
clarkbglean checks the mac addr type (if it is permament or not)20:26
clarkbmaybe I will just do like glean to start20:28
*** kjackal has quit IRC20:31
*** kjackal has joined #openstack-infra20:31
*** heyongli has quit IRC20:32
*** heyongli has joined #openstack-infra20:32
*** tonytan4ever_brb has joined #openstack-infra20:37
*** d0ugal has joined #openstack-infra20:38
*** tonytan4ever has quit IRC20:39
fungimmm20:39
fungiwell, the configdrive or metadata server will only list real interfaces, right?20:39
fungithough that's not very friendly to people running not in a cloud20:39
fungi*thinking cap on*20:40
fungido we care about interfaces besides those with a default route, in this scenario?20:40
fungijust wondering whether the routing tables can be used as a clue20:40
clarkbyes, rax is an example of where we do care about tha as we use the private network interface which isn't the default route interface20:41
clarkbianw suggested default route as a hint too but I don't think we can rely on that20:41
clarkbhowever the glean test will work for the rax caes20:41
clarkbI've got the glean test coded up now in zuul-jobs if we think that is a reasonable approximation20:41
fungii still wonder why we use the other interface in rax20:41
clarkbfungi: it is to avoid NAT in clouds with floating IPs20:42
*** heyongli has quit IRC20:42
clarkbthe private IP in rax is a separate interface (but typically the same interface on clouds with floating IPs)20:42
*** heyongli has joined #openstack-infra20:42
corvusto be clear, nothing about floating ips requires nat.  we're avoiding nat in clouds with nat, right?  :)20:43
clarkbcorvus: floating Ips are implemented using NAT in neutron. floating ips imply nat always aiui20:43
stevebakerweshay: hey. yeah if skopeo inspects are failing lets add a retry decorator. I think its the only thing in the uploader code which doesn't have it now20:43
weshaystevebaker, rock on20:44
corvusclarkb: :(20:45
*** camunoz has quit IRC20:45
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Dynamically determine overlay network mtu  https://review.openstack.org/57815320:48
clarkbthat is what the glean filter looks like20:48
*** heyongli has quit IRC20:52
corvusclarkb: that almost looks like it wants to be a module :)20:52
*** heyongli has joined #openstack-infra20:53
clarkbcorvus: possibly, I tend to find those harder to debug personally (I have tested this ssh script just by running it locally)20:53
corvusclarkb: oh, you should take a look at what i did in devstack -- i made a unit test framework for the localrc module20:53
corvusclarkb: to be clear, i'm not suggesting you should do that right now.  this one seems solidly right on the border of complexity.20:54
corvusclarkb: http://git.openstack.org/cgit/openstack-dev/devstack/tree/roles/write-devstack-local-conf/library/test.py  for reference20:54
corvusclarkb: change lgtm and works on my ubuntu machine... i assume you have some depends-on pointed at that?20:55
clarkbya, its a balance between data structures too complex for bash and ease of executing the code.20:56
clarkbcorvus: yes I have a devstack change I need to recheck also our ozj tests for multinode test changes to zuul-jobs20:56
clarkbhttps://review.openstack.org/#/c/578157/1 is the change I have depends on for extra testing20:57
*** d0ugal has quit IRC20:57
clarkbif we like this approach I will update my devstack-gate change too20:57
clarkbone thing that might make this more robust is take min(real interface mtus - 50 # the number we calculate here, other interface mtus)20:59
clarkbI don't know that that is necessary though21:00
*** ihar has quit IRC21:01
*** heyongli has quit IRC21:02
*** heyongli has joined #openstack-infra21:03
*** trown is now known as trown|outtypewww21:03
clarkbcorvus: it has been ~2 hours since the zuul main.yaml projects list was updated but https://review.openstack.org/#/c/578563/ continues to fail. We do a sighup or similar to have zuul pick these changes up right? (its not part of dynamically reconfigured configs)21:05
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Match tag items against containing branches  https://review.openstack.org/57855721:07
corvusclarkb: yes i'll look21:07
clarkbcorvus: looks like puppet may have only just run21:07
clarkbthere was a ~2.5 hour gap in runs21:07
clarkbI'm going to try rechecking now to see if that was the only issue21:07
corvusthis reminds me i should review the spec :)21:07
clarkbbah bad timezone math but yes hasn't run recently21:09
clarkb2018-06-28 19:22:25,497 p=8359 u=root |  skipping: [mirror01.cn1.linaro.openstack.org]21:09
clarkbis the last thing from ansible running puppet21:09
corvusthere are no "Full reconfiguration" events in zuul's log, consistent with puppet not triggering it21:10
clarkbansible is not running, it must've just timed out21:10
clarkblets see if it starts again in 5 minutes (it should)21:11
*** heyongli has quit IRC21:13
*** heyongli has joined #openstack-infra21:13
fungii wonder what's caused that delay21:16
*** ldnunes has quit IRC21:16
clarkbit has started running again21:17
*** rosmaita has quit IRC21:17
mordredcorvus: reading specs is lame - just blindly +2 to indicate you just agree with whatever I said21:17
clarkbfungi: I'm guessing it is netowrk connectivity issues to some node(s)21:18
clarkbfungi: we will probably have to catch it in the act21:18
fungilooks like there was a similar gap from 17:06:38 to 19:00:0621:20
clarkbfungi: and same last line logged21:20
*** rwsu has joined #openstack-infra21:20
corvusmordred: oy.  you used your outside voice to say what you really think again.21:20
mordredcorvus: BLAST21:20
fungi14:52:40 to 16:45:04 also21:21
*** heyongli has quit IRC21:23
*** heyongli has joined #openstack-infra21:23
clarkbfungi: in about 20 minutes we should get to where the logging stops and we can look at what the leftover ansible processes are doing21:23
clarkbunrelated (I thinK) zuul is really busy today. Just did 1373 jobs in the last hour as reported by graphite21:24
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Report to gerrit over HTTP  https://review.openstack.org/57702721:25
corvusthat's down from our record of 2kph :(21:26
corvus2kjph21:26
* mordred misses the 2kjph days21:26
clarkbI think easy mode multinode jobs and spectre/meltdown have affected that throughput21:27
*** edmondsw has quit IRC21:31
*** hasharAway has quit IRC21:32
*** heyongli has quit IRC21:33
*** heyongli has joined #openstack-infra21:34
*** numans_ has quit IRC21:35
*** numans has joined #openstack-infra21:36
clarkbfungi: ianw it looks like nb03 may be what we are hanging the puppet runs on21:40
fungiinteresting. did it die?21:41
fungii can ssh to it from the puppetmaster at least21:41
fungiit last rebooted ~19.5 hours ago21:42
*** rcernin has joined #openstack-infra21:42
clarkband root has an ssh connection from puppetmaster21:42
ianwclarkb / fungi : i'm not suprised, the network is unfortunately very flaky and weird21:42
clarkbI don't see any puppet-user logs in syslog though21:43
clarkbJun 28 21:23:41 nb03 ansible-setup: Invoked with filter=* gather_subset=['all'] fact_path=/etc/ansible/facts.d gather_timeout=10 is lastansible related thing in syslog21:43
*** heyongli has quit IRC21:43
*** heyongli has joined #openstack-infra21:44
fungipmtud blackhole?21:44
*** boden has quit IRC21:44
ianwit usually pings, isn't that icmp-ish based?21:45
clarkbfungi: looks like they may have increased the mtu there21:45
clarkboh but its 8950 now :/21:45
clarkbso we'll have the ooposite problem21:45
fungiyup21:45
clarkbthey need to set that neutron setting that logan- mentioned that makes it 1500 even if the host interfaces are 900021:46
fungi`sudo scp nb03.openstack.org:/var/log/syslog.1 ./` hangs a quarter of the way through21:46
ianwclarkb: yep, there is a ticket open for that21:46
fungiso unsurprising that fact collection is similarly hanging21:46
clarkbany objection to me manually updating that mtu on nb03 for now?21:46
fungiwfm21:46
fungithough that won't persist on reboot unless you also add it to the interfaces file, presumably21:46
ianwhttps://servicedesk.linaro.org/servicedesk/customer/portal/11/DC-369 for reference21:47
clarkbfungi: ya lets hope they fix ^ before next reboot. But at least this way we can confirm it is the issue21:47
fungiagreed21:47
clarkbI ran `sudo ip link set eth0 mtu 1500`21:48
fungisurprised we don't experience log collection issues from job nodes there21:48
fungior maybe we do?21:48
clarkbfungi: considering puppet was running yesterday iirc I'm guessing this is all very new change and we may not have noticed jobs being sad there21:48
fungisure, since it's only arm64 jobs presumably21:49
ianwi'm not sure it's helped that much21:49
ianwmy test to pypi from yesterday http://paste.openstack.org/show/724499/ still works and fails about equally21:50
clarkbianw: it being mtu 1500?21:50
ianwyes sorry21:50
clarkbI only did nb03 not the mirror21:50
fungimy syslog.1 scp now hangs at ~3/4 done21:50
ianwclarkb: that's on nb03 ... you can see dib has just been trying over and over but can never get everything it needs for a build21:51
fungitried again and it hung around 1/4 done21:51
clarkboh I read pypi as testing our mirror, got it21:51
clarkbI wonder if one of the links is in that cloud is not jumbo frame capable21:52
clarkband so even 1500 would fail21:52
ianwfungi: yeah, and from a command line, basic interaction worked, but i noticed that "top" (which i guess sends pages of output) was a pretty good way to get it to stop21:52
clarkb(because 1500 + overlay overhead needs jumbo frames)21:52
fungiyup21:52
ianwwe should be able to test by increasing size of ping packets?21:53
clarkbianw: or I can reduce the MTU to say 145021:53
clarkb(iirc that is what it was set to before)21:53
ianwyeah, start there, can't make it worse :)21:54
clarkbdone21:54
fungiFrom 103.20.251.147 icmp_seq=1 Frag needed and DF set (mtu = 1450)21:54
*** heyongli has quit IRC21:54
*** heyongli has joined #openstack-infra21:54
fungithat was when trying to ping it with large packets21:55
clarkbfungi: is your scp happier now?21:55
*** salv-orlando has joined #openstack-infra21:55
clarkbit should fragement properly if jumbo frames not working is the issue21:55
clarkb*it should fragement properly now if jumbo frames not working is the issue21:56
fungiyep, reran the same scp 5 times and worked every time21:56
ianwok, my "wget get-pip.py" is running reliably now i think21:56
clarkbya so at 1500 with overlay overhead we were still in jumbo frame territory and those must not be owrking on all links21:56
clarkbbut at 1450, we fit in at 1500 total and it fragments and is happy21:56
ianwclarkb: do you have access to that linaro tracker?  i can update their bug with this info21:57
clarkbianw: I don't know that I do, is it in the shared passwords file?21:57
clarkbor do we just make our own accounts?21:57
clarkblooks like I hvae to already hav an account, if you want to update it that would be great21:58
ianwit's just been own accounts but not sure if you have to be added to the issue.  will do, anyway gema will see this at some point i'm sure :)21:58
ianwgreat find, i'm going to hope your mind just jumped to mtu because of all our recent stuff :)  should of thought of that last night21:59
*** salv-orlando has quit IRC22:00
clarkbya not sure how fungi immediately jumped to that22:01
clarkbour existing ssh connection for ansible is unhappy22:02
clarkbany reason I shouldn't just kill that process?22:02
clarkbnext pass through should be fine with the temporary 1450 value22:02
fungii spent years staring at various sorts of mtu-related problems22:03
fungii see them in my sleep22:03
ianwso it started at 8950, 1500 didn't work and now we're at 1450 is the short story right?22:04
clarkbianw: yes22:04
*** heyongli has quit IRC22:04
clarkbI am going to kill 7039 on puppetmaster, this is the ansible process for nb03 that is out to lunch22:04
clarkbactually before I do that I will update mtu on the mirror too as I expect it too will be unhappy22:04
*** heyongli has joined #openstack-infra22:04
*** lxkong has joined #openstack-infra22:04
smcginnisSimple tagging ACL removal that has +1 from the project's PTL - https://review.openstack.org/#/c/578381/22:04
fungiwhen you give customers the ability to plug their network gear into yours, you get every crazy misconfiguration you can imagine plus a bunch more you can't22:05
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823022:05
clarkbmirror node is already set to 145022:06
clarkbkilling that process allowed ansible to finish22:07
ianwclarkb: ahhh, because that hasn't been rebooted.22:08
ianwhttps://nb03.openstack.org/ubuntu-xenial-arm64-0000007617.log  is running now, and will be a good test22:08
*** rlandy has quit IRC22:12
*** aeng has joined #openstack-infra22:12
ianwfungi: my network would be fine if it wasn't for all you damn clients! :)22:14
*** heyongli has quit IRC22:14
*** nicolasbock has quit IRC22:14
clarkbianw: that is what I tell my wife when her phone isn't able to upload to nextcloud22:15
*** heyongli has joined #openstack-infra22:15
clarkband 9 times out of 10 it is being on the wrong wifi network22:15
*** hongbin has quit IRC22:16
*** mpjetta has quit IRC22:19
*** bnemec has quit IRC22:19
*** heyongli has quit IRC22:24
*** heyongli has joined #openstack-infra22:25
*** kjackal has quit IRC22:27
*** hamzy has quit IRC22:30
clarkbnodepool has almost caught up on the noderequest backlog22:30
*** hamzy has joined #openstack-infra22:30
clarkbhopefully that means zuul dashboard will update soon22:34
*** heyongli has quit IRC22:35
*** hamzy has quit IRC22:35
*** heyongli has joined #openstack-infra22:35
*** jamesmcarthur has joined #openstack-infra22:35
notmynameis infra still using launchpad for bugs. ie if someone files a bug in LP for openstack-infra, does it get looked at? or is LP ignored and everything is storyboard now?22:36
*** hamzy has joined #openstack-infra22:37
clarkbnotmyname: should all be storyboard now22:38
notmynameah22:38
*** linkmark has quit IRC22:38
clarkbthe one exception is we hav ea launchpad bug tracker for the "gate" so that elastic-recheck can track against those bugs22:38
notmynamehttps://bugs.launchpad.net/openstack-infra/+bug/177920322:38
openstackLaunchpad bug 1779203 in openstack-infra/networking-spp-ci "bindep does not work on Alpine linux" [Undecided,New]22:38
*** jamesmcarthur has quit IRC22:40
fungiyeah, infra was the first team to migrate from lp to sb, several years ago now22:40
notmynamewhere should bugs be filed now?22:40
clarkbnotmyname: for bindep against the bindep project in storyboard22:40
notmynameI mean, I could google for "openstack infra bug" but a link would be more helpful ;-)22:41
fungithe bindep readme or contributing doc should hopefully say22:41
notmynamefungi: unfortunately, no22:42
fungibut basically yes, log in at storyboard.o.o, create a new story and put in openstack-infra/bindep as the project for the initial task22:42
notmynameah! in the contributing doc. not readme22:42
notmynameproject 811, naturally ;-)22:42
clarkbnotmyname: I'm not sure that is a bug as much as a feature request, bindep doesn't have support for alpines package manager22:43
fungihttps://git.openstack.org/cgit/openstack-infra/bindep/tree/CONTRIBUTING.rst#n1822:43
fungiyup22:43
clarkbthe changes I made made it possible to add that support, but you still need to teach bindep how to tlak to alpines package manager22:43
notmynameclarkb: good news! storyboard doesn't have bugs anyway ;-)22:44
funginotmyname: the project names in project urls feature has actually merged, but i'm still struggling with a bug causing the webclient to do url escaping on the slashes in project names which the api doesn't know to unescape yet22:44
fungiso close!22:44
notmynameok, I'll pass this on to ehud (who filed the bug in LP)22:44
clarkbwe could probably clean up the error message though (that is not really firendly way to say that the platform package manager isn't known22:45
*** heyongli has quit IRC22:45
*** heyongli has joined #openstack-infra22:45
fungithanks for bringing it to our attention, notmyname!22:47
notmynamenew to storyboard here... if I am viewing a project's stories and click the "dashboard" button on the left, then the browser back button no longer works. is this a known issue, or maybe I'm doing it wrong?22:52
*** tosky has quit IRC22:53
*** rwsu has quit IRC22:54
*** rwsu has joined #openstack-infra22:55
*** heyongli has quit IRC22:55
fungiit's likely somewhere between a bug and a bad implementation of the dashboard link22:55
*** heyongli has joined #openstack-infra22:56
*** salv-orlando has joined #openstack-infra22:56
notmynameis the "jump to..." box shortcuts for commands or a search box for projects?22:57
*** agopi has quit IRC22:58
notmyname(answer: search, mostly)23:00
*** salv-orlando has quit IRC23:01
*** tonytan4ever_brb has quit IRC23:03
*** tonytan4ever has joined #openstack-infra23:03
*** caphrim007_ has joined #openstack-infra23:04
*** caphrim007_ has quit IRC23:05
*** threestrands has joined #openstack-infra23:05
*** threestrands has quit IRC23:05
*** threestrands has joined #openstack-infra23:05
*** caphrim007_ has joined #openstack-infra23:05
*** heyongli has quit IRC23:05
*** heyongli has joined #openstack-infra23:06
*** yolanda__ has joined #openstack-infra23:07
*** caphrim007 has quit IRC23:07
*** caphrim007_ has quit IRC23:09
openstackgerritClark Boylan proposed openstack-infra/bindep master: Clearer unsupported platform error message  https://review.openstack.org/57902923:09
clarkbnotmyname: fungi ^ that should make these errors more clear23:10
notmynamecool23:10
*** yolanda_ has quit IRC23:11
clarkboh forgot to git add the os-release file23:11
*** caphrim007 has joined #openstack-infra23:11
openstackgerritClark Boylan proposed openstack-infra/bindep master: Clearer unsupported platform error message  https://review.openstack.org/57902923:11
*** heyongli has quit IRC23:16
*** caphrim007 has quit IRC23:16
*** heyongli has joined #openstack-infra23:16
*** caphrim007 has joined #openstack-infra23:17
*** yolanda__ has quit IRC23:18
*** caphrim007 has quit IRC23:21
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Support skip_child_jobs via zuul_return  https://review.openstack.org/57823023:26
*** heyongli has quit IRC23:26
*** heyongli has joined #openstack-infra23:26
*** dhill_ has quit IRC23:27
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: WIP: Add a role to return file comments  https://review.openstack.org/57903323:28
*** dpawlik has joined #openstack-infra23:29
clarkbcorvus: as a heads up the zuul post job ran which may have incomplete dashboard23:29
clarkbthe followup is queued23:30
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: Support line comments in Gerrit  https://review.openstack.org/57703523:31
ianwcan i stop nodepool-builder picking up a new build, but let it finish the current one?23:33
*** dpawlik has quit IRC23:33
corvusclarkb: post job have dashboard?  i'm confused23:34
ianwi want to attach a new volume to nb03.o.o as space is getting tight now we build bionic too23:34
corvusclarkb: our post jobs don't deploy the dashboard23:34
clarkbcorvus: they create the tarball that puppet deploys23:34
corvusooh23:34
pabelangerianw: no, i believe DIB will stop or try too23:35
corvusi should resume work on the promote pipeline23:36
*** heyongli has quit IRC23:36
*** heyongli has joined #openstack-infra23:37
clarkbcorvus: that would help here ++23:37
clarkblooks like part of our backlog is the integrated gate has been flapping, nova just had a lower constraints failure23:37
*** threestrands has quit IRC23:38
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: WIP: Add a role to return file comments  https://review.openstack.org/57903323:38
*** tpsilva has quit IRC23:40
*** agopi has joined #openstack-infra23:46
*** heyongli has quit IRC23:46
*** heyongli has joined #openstack-infra23:47
*** masber has quit IRC23:48
*** sthussey has quit IRC23:48
*** stakeda has joined #openstack-infra23:54
*** mpjetta has joined #openstack-infra23:55
*** gagehugo has quit IRC23:56
*** heyongli has quit IRC23:57
*** heyongli has joined #openstack-infra23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!