Monday, 2018-07-02

*** heyongli has quit IRC00:02
*** heyongli has joined #openstack-infra00:03
*** dingyichen has joined #openstack-infra00:05
*** jamesmcarthur has joined #openstack-infra00:08
*** heyongli has quit IRC00:13
*** heyongli has joined #openstack-infra00:13
*** jamesmcarthur has quit IRC00:20
*** heyongli has quit IRC00:23
*** heyongli has joined #openstack-infra00:23
*** heyongli has quit IRC00:33
*** heyongli has joined #openstack-infra00:33
*** heyongli has quit IRC00:43
*** heyongli has joined #openstack-infra00:44
*** heyongli has quit IRC00:54
*** heyongli has joined #openstack-infra00:54
*** graphene has quit IRC01:01
*** bobh has quit IRC01:02
*** graphene has joined #openstack-infra01:03
*** heyongli has quit IRC01:04
*** heyongli has joined #openstack-infra01:04
*** hongbin has joined #openstack-infra01:04
*** bobh has joined #openstack-infra01:09
openstackgerritMerged openstack-infra/system-config master: Irc: Add openstackstatus to openstack-helm channel  https://review.openstack.org/57592001:12
*** heyongli has quit IRC01:14
*** heyongli has joined #openstack-infra01:14
*** kiennt26 has joined #openstack-infra01:15
*** zhangfei has joined #openstack-infra01:15
openstackgerritMerged openstack-infra/project-config master: Remove obsolete zuul and jenkins dev configs  https://review.openstack.org/57886501:16
openstackgerritMerged openstack-infra/project-config master: There are no core developers, only core reviewers  https://review.openstack.org/57886601:16
*** jiapei has joined #openstack-infra01:18
*** bobh has quit IRC01:19
*** bobh has joined #openstack-infra01:22
*** heyongli has quit IRC01:24
openstackgerritMerged openstack-infra/project-config master: increase timeout on neutron-lib periodic for vmware-nsx  https://review.openstack.org/57853901:25
*** heyongli has joined #openstack-infra01:25
*** bobh has quit IRC01:27
*** kiennt26 has quit IRC01:28
*** edmondsw has joined #openstack-infra01:29
openstackgerritMerged openstack-infra/project-config master: Add py35 jobs to python-tempestconf  https://review.openstack.org/57929301:29
openstackgerritMerged openstack-infra/project-config master: drop pypy jobs from cliff  https://review.openstack.org/57923901:33
*** edmondsw has quit IRC01:34
*** heyongli has quit IRC01:35
*** bobh has joined #openstack-infra01:35
*** heyongli has joined #openstack-infra01:35
openstackgerritMerged openstack-infra/project-config master: Stop running jobs for the release-tools repo  https://review.openstack.org/57918501:37
openstackgerritMerged openstack-infra/project-config master: remove lower constraints to vmware-nsx gate pipeline  https://review.openstack.org/57539901:37
openstackgerritMerged openstack-infra/project-config master: Remove ironic-tempest-dsvm-ipa-wholedisk-bios-agent_ipmitool-tinyipa for nova  https://review.openstack.org/57887901:37
*** bobh has quit IRC01:39
openstackgerritMerged openstack-infra/project-config master: Add gerritbot to #openstack-service-broker IRC channel  https://review.openstack.org/57923501:40
*** zul has joined #openstack-infra01:41
*** heyongli has quit IRC01:45
*** heyongli has joined #openstack-infra01:45
*** openstackgerrit has quit IRC01:49
*** heyongli has quit IRC01:55
*** heyongli has joined #openstack-infra01:55
*** bobh has joined #openstack-infra01:58
*** kiennt26 has joined #openstack-infra02:01
*** bobh has quit IRC02:02
*** graphene has quit IRC02:02
*** graphene has joined #openstack-infra02:03
*** heyongli has quit IRC02:05
*** heyongli has joined #openstack-infra02:06
*** graphene has quit IRC02:08
*** graphene has joined #openstack-infra02:10
*** lathiat has quit IRC02:15
*** bobh has joined #openstack-infra02:15
*** lathiat has joined #openstack-infra02:15
*** heyongli has quit IRC02:16
*** heyongli has joined #openstack-infra02:16
*** Diabelko has quit IRC02:16
*** Diabelko has joined #openstack-infra02:16
*** bobh has quit IRC02:20
*** jamesmcarthur has joined #openstack-infra02:21
*** bobh has joined #openstack-infra02:25
*** jamesmcarthur has quit IRC02:25
*** heyongli has quit IRC02:26
*** heyongli has joined #openstack-infra02:26
*** graphene has quit IRC02:27
*** graphene has joined #openstack-infra02:29
*** bobh has quit IRC02:30
*** heyongli has quit IRC02:36
*** heyongli has joined #openstack-infra02:36
*** graphene has quit IRC02:38
*** graphene has joined #openstack-infra02:39
*** psachin has joined #openstack-infra02:40
*** heyongli has quit IRC02:46
*** heyongli has joined #openstack-infra02:47
*** openstackgerrit has joined #openstack-infra02:49
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: dashboard: fix multi-tenant navigation bar  https://review.openstack.org/57941802:50
*** bobh has joined #openstack-infra02:51
*** ykarel has joined #openstack-infra02:52
*** heyongli has quit IRC02:57
*** heyongli has joined #openstack-infra02:57
*** ykarel has quit IRC03:01
*** hongbin has quit IRC03:03
*** heyongli has quit IRC03:07
*** heyongli has joined #openstack-infra03:07
*** heyongli has quit IRC03:17
*** edmondsw has joined #openstack-infra03:17
*** heyongli has joined #openstack-infra03:17
*** edmondsw has quit IRC03:22
*** ramishra has joined #openstack-infra03:26
*** sungn has quit IRC03:26
*** heyongli has quit IRC03:27
*** heyongli has joined #openstack-infra03:28
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: angular: call enableProdMode  https://review.openstack.org/57349403:30
*** heyongli has quit IRC03:38
*** heyongli has joined #openstack-infra03:38
*** bobh has quit IRC03:39
*** lpetrut has joined #openstack-infra03:40
*** jiapei has quit IRC03:48
*** heyongli has quit IRC03:48
*** heyongli has joined #openstack-infra03:48
*** zhangfei has quit IRC03:56
*** udesale has joined #openstack-infra03:57
*** heyongli has quit IRC03:58
*** heyongli has joined #openstack-infra03:58
*** Bhujay has joined #openstack-infra04:00
*** jiapei has joined #openstack-infra04:00
*** zhangfei has joined #openstack-infra04:00
*** fresta_ has joined #openstack-infra04:03
*** ykarel has joined #openstack-infra04:03
*** fresta has quit IRC04:07
*** heyongli has quit IRC04:08
*** heyongli has joined #openstack-infra04:09
*** vivsoni has joined #openstack-infra04:12
*** Bhujay has quit IRC04:13
*** heyongli has quit IRC04:19
*** heyongli has joined #openstack-infra04:19
*** yamamoto has joined #openstack-infra04:21
openstackgerritOlivier Bourdon proposed openstack/diskimage-builder master: Fix for proper LVM support  https://review.openstack.org/57616804:22
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: model: fix AttributeError exception in freezeJobGraph  https://review.openstack.org/57942804:23
*** sree has joined #openstack-infra04:23
*** ethfci has quit IRC04:26
*** lpetrut has quit IRC04:27
*** sree has quit IRC04:27
*** heyongli has quit IRC04:29
*** heyongli has joined #openstack-infra04:29
*** jamesmcarthur has joined #openstack-infra04:36
*** stakeda has joined #openstack-infra04:37
*** heyongli has quit IRC04:39
*** heyongli has joined #openstack-infra04:40
*** jamesmcarthur has quit IRC04:40
*** jamesmcarthur has joined #openstack-infra04:42
*** jamesmcarthur has quit IRC04:48
*** heyongli has quit IRC04:49
*** heyongli has joined #openstack-infra04:50
*** rcernin has quit IRC04:55
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: executor: change execution log to INFO  https://review.openstack.org/57870404:56
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: Use readthedocs webhook to trigger build  https://review.openstack.org/57943404:56
*** dklyle has quit IRC04:58
*** heyongli has quit IRC05:00
*** heyongli has joined #openstack-infra05:00
*** cshastri has joined #openstack-infra05:01
*** edmondsw has joined #openstack-infra05:06
*** sree has joined #openstack-infra05:08
*** links has joined #openstack-infra05:09
*** links has quit IRC05:09
*** heyongli has quit IRC05:10
*** heyongli has joined #openstack-infra05:10
*** andreas_s has joined #openstack-infra05:10
*** edmondsw has quit IRC05:11
*** andreas_s has quit IRC05:13
*** vivsoni has quit IRC05:13
*** andreas_s has joined #openstack-infra05:14
*** andreas_s has quit IRC05:18
jiapeihello guys, I'm now trying to configure Zuul v3, but it fails when git clone Ironic projects, http://paste.openstack.org/show/724713/, anyone knows the reason?05:19
*** heyongli has quit IRC05:20
*** heyongli has joined #openstack-infra05:20
*** apetrich has joined #openstack-infra05:23
*** vivsoni has joined #openstack-infra05:23
*** pgadiya has joined #openstack-infra05:23
*** pgadiya has quit IRC05:24
*** e0ne has joined #openstack-infra05:25
ianwjiapei: nothing logged above that?  13 suggests perhaps permission denied, so i might start looking at permissions?05:26
jiapeiSure, Iwill paste it05:26
*** tojuvone_ is now known as tojuvone05:29
jiapei@ianw I copy the pemisssions here http://paste.openstack.org/show/724714/05:29
*** heyongli has quit IRC05:30
ianwi feel like there's maybe some git output before the exception in the logs?05:30
*** heyongli has joined #openstack-infra05:31
jiapeithe git output just says when it clones, there is exception http://paste.openstack.org/show/724715/05:33
jiapeiand then this log block repeats again and again05:34
ianw  stdout: 'Cloning into '/var/lib/zuul/executor-git/review.openstack.org/openstack/ironic'...' ... there's no stderr output ?05:36
*** e0ne has quit IRC05:38
jiapeioh, it says 'unable to initialize repo'05:38
jiapeibut I tried use 'git clone' command line, it successfully clone the project05:39
*** heyongli has quit IRC05:41
*** rcernin has joined #openstack-infra05:41
*** heyongli has joined #openstack-infra05:41
*** rcernin has quit IRC05:41
*** rcernin has joined #openstack-infra05:41
*** rcernin has quit IRC05:41
*** quiquell|off is now known as quiquell|rover05:41
*** rcernin has joined #openstack-infra05:42
ianwjiapei: hmm, i'd really be looking at permissions of /var/lib/zuul , that's my first suspicion05:42
jiapeiianw: http://paste.openstack.org/show/724716/ it's here05:46
*** dhajare has joined #openstack-infra05:47
*** psachin has quit IRC05:48
jiapeiwell, it seems that permissions is ok...05:50
*** heyongli has quit IRC05:51
*** heyongli has joined #openstack-infra05:51
*** slaweq has joined #openstack-infra05:54
*** e0ne has joined #openstack-infra05:54
*** slaweq has quit IRC05:58
*** armaan has joined #openstack-infra05:59
jiapeiianw: I just restarted the service, with log http://paste.openstack.org/show/724717/, could you have a look of it again?05:59
*** iranzo has joined #openstack-infra05:59
ianwgit clone ssh://lenovo_lxca_ci@review.openstack.org:29418/openstack/ironic /var/lib/zuul/executor-git/review.openstack.org/openstack/ironic06:00
ianwdoes that work as the zuul user?06:00
*** peereb has joined #openstack-infra06:00
*** heyongli has quit IRC06:01
*** heyongli has joined #openstack-infra06:01
*** iranzo has quit IRC06:02
jiapeiYes, that works as zuul user06:02
*** kjackal has joined #openstack-infra06:03
*** iranzo has joined #openstack-infra06:06
*** iranzo has quit IRC06:06
*** iranzo has joined #openstack-infra06:06
*** AJaeger has quit IRC06:08
*** heyongli has quit IRC06:11
*** heyongli has joined #openstack-infra06:12
*** udesale_ has joined #openstack-infra06:16
*** iranzo has quit IRC06:18
*** iranzo has joined #openstack-infra06:18
*** iranzo has quit IRC06:18
*** iranzo has joined #openstack-infra06:18
*** AJaeger has joined #openstack-infra06:19
*** udesale has quit IRC06:19
*** janki has joined #openstack-infra06:20
*** lpetrut has joined #openstack-infra06:22
*** heyongli has quit IRC06:22
*** heyongli has joined #openstack-infra06:22
*** dmellado has joined #openstack-infra06:23
*** andreas_s has joined #openstack-infra06:25
*** quiquell|rover is now known as quique|rover|bbl06:25
*** iranzo has quit IRC06:27
*** iranzo has joined #openstack-infra06:27
*** iranzo has quit IRC06:27
*** iranzo has joined #openstack-infra06:27
*** heyongli has quit IRC06:32
*** heyongli has joined #openstack-infra06:32
*** ccamacho has joined #openstack-infra06:32
*** pguimaraes has joined #openstack-infra06:33
*** threestrands has joined #openstack-infra06:33
*** threestrands has quit IRC06:33
*** threestrands has joined #openstack-infra06:33
*** ccamacho has quit IRC06:33
*** dpawlik has joined #openstack-infra06:37
*** threestrands has quit IRC06:37
*** nicolasbock has joined #openstack-infra06:39
*** ccamacho has joined #openstack-infra06:40
*** udesale__ has joined #openstack-infra06:42
*** heyongli has quit IRC06:42
*** heyongli has joined #openstack-infra06:42
*** e0ne has quit IRC06:43
*** udesale_ has quit IRC06:45
*** kjackal has quit IRC06:45
*** vivsoni has quit IRC06:48
*** roman_g has joined #openstack-infra06:52
*** heyongli has quit IRC06:52
*** heyongli has joined #openstack-infra06:53
*** edmondsw has joined #openstack-infra06:55
*** vivsoni has joined #openstack-infra06:55
*** jamesmcarthur has joined #openstack-infra06:56
*** vivsoni_ has joined #openstack-infra06:58
*** vivsoni has quit IRC06:58
*** udesale_ has joined #openstack-infra06:58
*** edmondsw has quit IRC07:00
*** vivsoni has joined #openstack-infra07:00
*** quique|rover|bbl is now known as quiquell|rover07:00
*** vivsoni_ has quit IRC07:01
*** zhangfei has quit IRC07:01
*** jamesmcarthur has quit IRC07:01
*** udesale__ has quit IRC07:01
*** heyongli has quit IRC07:03
*** heyongli has joined #openstack-infra07:03
*** armaan has quit IRC07:07
*** armaan has joined #openstack-infra07:08
*** rcernin has quit IRC07:09
*** kjackal has joined #openstack-infra07:11
*** heyongli has quit IRC07:13
*** heyongli has joined #openstack-infra07:13
*** zhangfei has joined #openstack-infra07:14
*** heyongli has quit IRC07:23
*** heyongli has joined #openstack-infra07:23
*** armaan has quit IRC07:26
*** armaan has joined #openstack-infra07:27
*** tesseract has joined #openstack-infra07:27
openstackgerritIan Wienand proposed openstack-infra/zuul-sphinx master: Open role readme files in utf-8 mode  https://review.openstack.org/57947407:30
*** florianf has joined #openstack-infra07:32
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: Use readthedocs webhook to trigger build  https://review.openstack.org/57943407:32
*** psachin has joined #openstack-infra07:32
*** heyongli has quit IRC07:33
*** heyongli has joined #openstack-infra07:34
*** zoli is now known as zoli|wfh07:34
*** rpittau has joined #openstack-infra07:35
*** graphene has quit IRC07:36
*** alexchadin has joined #openstack-infra07:37
*** graphene has joined #openstack-infra07:38
*** tosky has joined #openstack-infra07:38
*** hashar has joined #openstack-infra07:38
*** jpich has joined #openstack-infra07:39
*** heyongli has quit IRC07:44
*** jpena|off is now known as jpena07:44
*** heyongli has joined #openstack-infra07:44
*** pguimaraes has quit IRC07:44
*** pguimaraes has joined #openstack-infra07:45
*** yamamoto_ has joined #openstack-infra07:53
*** heyongli has quit IRC07:54
*** heyongli has joined #openstack-infra07:54
*** ralonsoh has joined #openstack-infra07:56
*** yamamoto has quit IRC07:57
*** Goneri has joined #openstack-infra08:00
*** d0ugal has joined #openstack-infra08:01
*** d0ugal has quit IRC08:01
*** d0ugal has joined #openstack-infra08:01
*** e0ne has joined #openstack-infra08:02
*** heyongli has quit IRC08:04
*** heyongli has joined #openstack-infra08:04
*** shardy has joined #openstack-infra08:05
*** armaan has quit IRC08:06
*** armaan has joined #openstack-infra08:07
*** dbecker has joined #openstack-infra08:07
*** armaan has quit IRC08:12
*** armaan has joined #openstack-infra08:13
*** ykarel is now known as ykarel|lunch08:13
*** heyongli has quit IRC08:14
*** heyongli has joined #openstack-infra08:15
*** seongsoocho has joined #openstack-infra08:22
*** vivsoni_ has joined #openstack-infra08:23
*** vivsoni has quit IRC08:23
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: Use readthedocs webhook to trigger build  https://review.openstack.org/57943408:23
*** heyongli has quit IRC08:25
*** heyongli has joined #openstack-infra08:25
*** jpich has quit IRC08:26
*** jpich has joined #openstack-infra08:27
*** heyongli has quit IRC08:35
*** heyongli has joined #openstack-infra08:35
*** slaweq has joined #openstack-infra08:36
*** derekh has joined #openstack-infra08:38
*** sambetts|afk has quit IRC08:40
*** slaweq has quit IRC08:43
*** edmondsw has joined #openstack-infra08:43
*** heyongli has quit IRC08:45
*** heyongli has joined #openstack-infra08:45
*** sambetts_ has joined #openstack-infra08:47
*** edmondsw has quit IRC08:47
*** armaan has quit IRC08:50
*** armaan has joined #openstack-infra08:50
*** heyongli has quit IRC08:55
*** heyongli has joined #openstack-infra08:56
*** electrofelix has joined #openstack-infra08:57
*** e0ne has quit IRC08:58
*** dingyichen has quit IRC08:59
*** armaan has quit IRC08:59
*** armaan has joined #openstack-infra08:59
*** r-mibu has joined #openstack-infra09:02
*** e0ne has joined #openstack-infra09:04
*** graphene has quit IRC09:04
*** graphene has joined #openstack-infra09:06
*** heyongli has quit IRC09:06
*** heyongli has joined #openstack-infra09:06
*** heyongli has quit IRC09:16
*** heyongli has joined #openstack-infra09:16
*** lifeless has quit IRC09:17
*** lifeless has joined #openstack-infra09:18
*** flaper87 has quit IRC09:24
*** flaper87 has joined #openstack-infra09:24
*** heyongli has quit IRC09:26
*** heyongli has joined #openstack-infra09:26
*** panda|ko is now known as panda09:33
*** finucannot is now known as stephenfin09:34
*** andreas_s has quit IRC09:34
*** andreas_s has joined #openstack-infra09:36
*** heyongli has quit IRC09:36
*** heyongli has joined #openstack-infra09:37
*** andreas_s has quit IRC09:38
*** andreas_s has joined #openstack-infra09:38
*** spsurya_ has joined #openstack-infra09:40
*** sshnaidm|off is now known as sshnaidm09:40
*** sambetts_ is now known as sambetts09:45
*** heyongli has quit IRC09:47
*** armaan has quit IRC09:47
*** armaan has joined #openstack-infra09:47
*** heyongli has joined #openstack-infra09:47
*** sree_ has joined #openstack-infra09:49
*** sree_ is now known as Guest6826509:49
*** sree has quit IRC09:51
*** andreas_s has quit IRC09:54
*** d0ugal has quit IRC09:55
*** d0ugal has joined #openstack-infra09:55
*** d0ugal has quit IRC09:55
*** d0ugal has joined #openstack-infra09:55
*** andreas_s has joined #openstack-infra09:55
*** ykarel|lunch is now known as ykarel09:56
*** heyongli has quit IRC09:57
*** heyongli has joined #openstack-infra09:57
*** kjackal has quit IRC10:01
*** kjackal has joined #openstack-infra10:02
*** Guest68265 has quit IRC10:02
*** andreas_s has quit IRC10:05
*** heyongli has quit IRC10:07
*** heyongli has joined #openstack-infra10:07
*** jchhatbar has joined #openstack-infra10:08
*** janki has quit IRC10:09
*** jchhatba_ has joined #openstack-infra10:09
*** andreas_s has joined #openstack-infra10:10
*** jchhatbar has quit IRC10:13
*** jokke_ has joined #openstack-infra10:15
*** kiennt26 has quit IRC10:15
*** heyongli has quit IRC10:17
*** heyongli has joined #openstack-infra10:18
quiquell|roverHello10:26
quiquell|roverWe are starting to see problems accessing mirror.centos.org10:26
quiquell|roverhttp://mirror.centos.org/centos/7/virt/x86_64/kvm-common/repodata/b58d947530c09c958e0d78c2c9029ef1fbb4d341c68ce99e3b0133561ca70421-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found10:26
quiquell|roverhttp://logs.openstack.org/45/560445/77/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/02d4f13/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz10:27
quiquell|roverIs there any issue  ?10:27
*** heyongli has quit IRC10:28
*** heyongli has joined #openstack-infra10:28
openstackgerritMerged openstack-infra/zuul-jobs master: Dynamically determine overlay network mtu  https://review.openstack.org/57815310:28
*** ralonsoh_ has joined #openstack-infra10:30
*** ralonsoh has quit IRC10:33
*** andreas_s has quit IRC10:34
*** andreas_s has joined #openstack-infra10:35
*** kjackal has quit IRC10:35
*** heyongli has quit IRC10:38
*** heyongli has joined #openstack-infra10:38
*** stakeda has quit IRC10:40
*** andreas_s has quit IRC10:44
*** andreas_s has joined #openstack-infra10:45
*** heyongli has quit IRC10:48
*** heyongli has joined #openstack-infra10:49
*** graphene has quit IRC10:53
*** dbecker has quit IRC10:53
*** dbecker has joined #openstack-infra10:54
*** graphene has joined #openstack-infra10:56
*** andreas_s has quit IRC10:57
*** andreas_s has joined #openstack-infra10:57
*** heyongli has quit IRC10:58
*** heyongli has joined #openstack-infra10:59
*** graphene has quit IRC11:00
*** graphene has joined #openstack-infra11:01
*** heyongli has quit IRC11:09
*** heyongli has joined #openstack-infra11:09
*** seongsoocho has quit IRC11:11
*** rh-jelabarre has joined #openstack-infra11:13
*** edmondsw has joined #openstack-infra11:14
*** quiquell|rover is now known as quique|rover|lch11:19
*** heyongli has quit IRC11:19
*** heyongli has joined #openstack-infra11:19
*** zoli|wfh is now known as zoli|lunch11:22
*** udesale_ has quit IRC11:25
*** heyongli has quit IRC11:29
*** heyongli has joined #openstack-infra11:29
*** ralonsoh_ has quit IRC11:29
*** jchhatba_ has quit IRC11:30
*** ramishra has quit IRC11:30
*** vivsoni has joined #openstack-infra11:30
*** jpena is now known as jpena|lunch11:30
*** ramishra has joined #openstack-infra11:32
*** vivsoni_ has quit IRC11:32
*** vivsoni_ has joined #openstack-infra11:33
*** zhangfei has quit IRC11:35
*** vivsoni has quit IRC11:36
*** ldnunes has joined #openstack-infra11:36
*** jroll has quit IRC11:36
*** heyongli has quit IRC11:39
*** heyongli has joined #openstack-infra11:40
*** jroll has joined #openstack-infra11:40
*** kjackal has joined #openstack-infra11:41
*** panda is now known as panda|lunch11:43
*** vivsoni_ has quit IRC11:43
*** quique|rover|lch is now known as quiquell|rover11:44
*** vivsoni has joined #openstack-infra11:45
*** kaiokmo has joined #openstack-infra11:46
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Add coverage job for Ceilometer  https://review.openstack.org/57952511:47
*** heyongli has quit IRC11:50
*** heyongli has joined #openstack-infra11:50
*** peereb has quit IRC11:54
*** florianf_ has joined #openstack-infra11:59
*** heyongli has quit IRC12:00
*** heyongli has joined #openstack-infra12:00
*** sree has joined #openstack-infra12:02
*** florianf has quit IRC12:03
*** alexchadin has quit IRC12:04
*** cjloader has joined #openstack-infra12:05
*** sree has quit IRC12:06
*** derekh has quit IRC12:08
*** heyongli has quit IRC12:10
*** heyongli has joined #openstack-infra12:10
*** derekh has joined #openstack-infra12:11
*** derekh has quit IRC12:11
*** neiloy has joined #openstack-infra12:13
*** vivsoni has quit IRC12:14
*** vivsoni has joined #openstack-infra12:15
*** janki has joined #openstack-infra12:16
*** Goneri has quit IRC12:18
*** pguimaraes has quit IRC12:19
*** florianf_ has quit IRC12:20
*** heyongli has quit IRC12:20
*** florianf has joined #openstack-infra12:20
*** heyongli has joined #openstack-infra12:21
*** vivsoni has quit IRC12:21
*** panda|lunch is now known as panda12:25
*** rlandy has joined #openstack-infra12:25
*** cjloader has quit IRC12:26
*** jpena|lunch is now known as jpena12:28
*** vivsoni has joined #openstack-infra12:29
*** heyongli has quit IRC12:31
*** heyongli has joined #openstack-infra12:31
*** psachin has quit IRC12:33
*** jrist has joined #openstack-infra12:34
*** agopi|off has quit IRC12:39
*** heyongli has quit IRC12:41
*** heyongli has joined #openstack-infra12:41
*** pguimaraes has joined #openstack-infra12:42
*** trown|outtypewww is now known as trown12:46
*** heyongli has quit IRC12:51
*** heyongli has joined #openstack-infra12:51
*** jpena is now known as jpena|off12:52
*** kgiusti has joined #openstack-infra12:53
*** Tengu has left #openstack-infra12:54
*** jbadiapa_ has quit IRC12:55
*** Goneri has joined #openstack-infra12:56
*** jamesmcarthur has joined #openstack-infra12:57
*** heyongli has quit IRC13:01
*** heyongli has joined #openstack-infra13:02
*** jamesmcarthur has quit IRC13:02
*** florianf has quit IRC13:03
*** florianf has joined #openstack-infra13:03
*** rh-jelabarre has quit IRC13:03
*** tesseract has quit IRC13:04
*** janki has quit IRC13:04
*** janki has joined #openstack-infra13:05
*** trown has quit IRC13:05
*** jlibosva has joined #openstack-infra13:08
*** Goneri has quit IRC13:08
*** rfolco has quit IRC13:08
*** agopi|off has joined #openstack-infra13:09
*** rfolco has joined #openstack-infra13:09
*** tesseract has joined #openstack-infra13:10
*** tesseract has quit IRC13:10
*** trown|brb has joined #openstack-infra13:12
*** heyongli has quit IRC13:12
*** heyongli has joined #openstack-infra13:12
*** trown|brb is now known as trown13:12
*** d0ugal has quit IRC13:13
*** agopi|off is now known as agopi13:14
*** dalvarez has quit IRC13:17
*** dalvarez has joined #openstack-infra13:17
*** jbadiapa has joined #openstack-infra13:18
openstackgerritMerged openstack-infra/devstack-gate master: Dynamically determine overlay MTU  https://review.openstack.org/57814613:18
pandaif I specify a Depends-On: on a change in another gerrit instance, is that reflected at all in ZULL_CHANGES variable ?13:21
*** bobh has joined #openstack-infra13:21
*** heyongli has quit IRC13:22
*** heyongli has joined #openstack-infra13:22
openstackgerritSaverio Proto proposed openstack/diskimage-builder master: Add support for Fedora 28  https://review.openstack.org/57913113:23
*** fultonj has quit IRC13:26
tobascohello, we recently got a new branch on puppet-ceph and the release bot gave us these two commits unfourtunately we dont have any jobs for the gitreview and tox files13:26
tobascohttps://review.openstack.org/#/c/578999/13:26
tobascohttps://review.openstack.org/#/c/579000/13:26
tobascocan they be forced merged? otherwise we need some help on what job we should add, is noop-jobs a thing?13:27
*** heyongli has quit IRC13:32
*** heyongli has joined #openstack-infra13:32
*** d0ugal has joined #openstack-infra13:35
*** mriedem has joined #openstack-infra13:35
*** rh-jelabarre has joined #openstack-infra13:36
pabelangerquiquell|rover: you shouldn't be  using mirror.centos.org, we have regional mirror that contain that information13:38
*** tesseract has joined #openstack-infra13:38
pabelangereg: http://mirror.dfw.rax.openstack.org/centos/7/virt/x86_64/13:39
*** r-mibu has quit IRC13:39
*** heyongli has quit IRC13:42
*** heyongli has joined #openstack-infra13:43
pandapabelanger: if I make a change depend on something on another gerrit instance, is there anywhere I can see the pair (HOST, CHANGE) ?13:45
fungiquiquell|rover: i'm not aware of any issues reaching mirror.centos.org and i can retrieve that url just fine from a server in inap mtl01 (where that build occurred). could it have been a temporary issue?13:46
*** ihar has joined #openstack-infra13:46
*** sthussey has joined #openstack-infra13:48
*** dalvarez has quit IRC13:48
*** florianf has quit IRC13:48
*** dalvarez has joined #openstack-infra13:49
*** sree has joined #openstack-infra13:49
*** florianf has joined #openstack-infra13:49
fungipanda: tobasco: i recommend having at least one job defined which doesn't have any file exclusions (or just stop using file exclusions except where you know for sure you need them, in many cases they're a premature optimization)13:52
fungier, sorry panda that was for tobasco13:52
*** heyongli has quit IRC13:53
fungipanda: i'm trying to find the answer regarding the ZUUL_CHANGES variable you're asking about, i guess that's an environment variable set in legacy jobs or something?13:53
pandayeah tobasco is usually too spicy for me.13:53
*** heyongli has joined #openstack-infra13:53
pandafungi: yes, but I'm ok with any other variable that makes me understand how to match the change with the proper directory in /src13:53
*** sree has quit IRC13:53
tobascopanda: it's too spicy for me as well ;)13:53
tobascofungi: ok, i'll figure something out with adding making sure a job runs13:54
pandafungi: ZUUL_CHANGES already contained the repo and the refspec, but the gerrit host is missing13:54
pandafungi: as far as I can see13:54
fungipanda: yeah, looks like ZUUL_CHANGES is populated by the code here: https://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/ansible/filter/zuul_filters.py#n5213:55
fungiso it's coming from the zuul changes dict in the ansible vars13:55
pandafungi: ah, so the "new" zuul dict contains also the host as a key I imagine ?13:56
*** bnemec has joined #openstack-infra13:56
fungipanda: if you're looking for the change url, the zuul items dict seems to include a change_url key13:57
*** eharney has joined #openstack-infra13:57
pandaI'll need a test job that dumps  the non-legacy vars.13:58
*** quiquell|rover is now known as quiquell|off13:58
fungipanda: see in http://logs.openstack.org/45/560445/77/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/02d4f13/zuul-info/inventory.yaml for an example (though that only has one entry in items, changes with dependencies should have multiple)13:58
fungithe zuul vars from every build are always provided in zuul-info/inventory.yaml13:59
*** PapaOurs is now known as bauzas13:59
pabelangerpanda: it will show up in inventory file under zuul.items13:59
*** apetrich has quit IRC13:59
pandafungi: AAAAHH, zrc_dir is what I was looking for13:59
pandafungi: pabelanger it's already all there, thanks!13:59
*** apetrich has joined #openstack-infra14:00
*** jamesmcarthur has joined #openstack-infra14:00
*** zoli|lunch is now known as zli14:00
*** zli is now known as zoli14:01
*** heyongli has quit IRC14:03
*** heyongli has joined #openstack-infra14:03
*** jamesmcarthur has quit IRC14:06
*** lpetrut has quit IRC14:08
*** jamesmcarthur has joined #openstack-infra14:09
*** jamesmcarthur has quit IRC14:11
*** jamesmcarthur has joined #openstack-infra14:12
*** jamesmcarthur_ has joined #openstack-infra14:12
*** heyongli has quit IRC14:13
*** heyongli has joined #openstack-infra14:13
*** jamesmcarthur has quit IRC14:16
*** jamesmcarthur_ is now known as jamesmcarthur14:16
openstackgerritMerged openstack-infra/nodepool master: Publish docs on release  https://review.openstack.org/57930014:19
openstackgerritMerged openstack-infra/nodepool master: Handle node no longer in pool error  https://review.openstack.org/57930914:19
*** armaan has quit IRC14:21
*** armaan has joined #openstack-infra14:22
*** cshastri has quit IRC14:23
*** heyongli has quit IRC14:23
*** heyongli has joined #openstack-infra14:24
*** jamesmca_ has joined #openstack-infra14:28
*** jpena|off is now known as jpena14:31
*** rpioso|afk is now known as rpioso14:32
*** dhajare has quit IRC14:33
*** dpawlik has quit IRC14:33
*** heyongli has quit IRC14:34
*** heyongli has joined #openstack-infra14:34
openstackgerritSaverio Proto proposed openstack/diskimage-builder master: Add support for Fedora 28  https://review.openstack.org/57913114:40
*** elbragstad is now known as lbragstad14:43
*** heyongli has quit IRC14:44
*** heyongli has joined #openstack-infra14:44
sshnaidmpabelanger, hi, can we move tripleo-ci to openstack instead of "openstack-infra"?14:46
*** armaan has quit IRC14:47
pabelangersshnaidm: you'll need to discuss with openstack-infra PTL, I believe that is under governance of openstack-infra14:48
pabelangerclarkb: ^14:48
fungii thought we already moved it in governance, checking14:51
*** ykarel has quit IRC14:51
mnaserdoes anyone know which ipv6 addresses were not working in the traceroutes14:51
*** lpetrut has joined #openstack-infra14:52
mnaserirccloud logs are being weird :(14:52
fungiyeah, it14:52
mnaserat the time i think the nodepool launcher assosicated to our cloud had issues14:52
fungipabelanger: sshnaidm: yeah tripleo-ci is already a tripleo deliverable, just needs to be added to the repo renames list if there's interested in renaming it into a different namespace14:52
sshnaidmfungi, pabelanger I think we are. What is renames list?14:53
*** zzzeek has quit IRC14:53
fungisshnaidm: add it to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames14:54
fungiso we can schedule the necessary maintenance window14:54
*** heyongli has quit IRC14:54
*** heyongli has joined #openstack-infra14:54
*** zzzeek has joined #openstack-infra14:55
clarkbmnaser: It was nl03 and a server I have in ovh both unable to route to the test VMs in vexxgost14:58
*** agopi_ has joined #openstack-infra15:00
*** agopi has quit IRC15:02
*** heyongli has quit IRC15:04
*** heyongli has joined #openstack-infra15:05
clarkbinfra-root (and anyone else interested) not sure if you saw the openci meeting scheduling results but it appears to be today in ~53 minutes15:07
clarkbmnaser: http://paste.openstack.org/show/724609/ and http://paste.openstack.org/show/724610/ are the traceroute pastes15:08
*** graphene has quit IRC15:08
mnaserthanks for that info clarkb15:09
*** andreas_s has quit IRC15:12
*** andreas_s has joined #openstack-infra15:13
*** andreas_s has quit IRC15:14
*** andreas_s has joined #openstack-infra15:14
*** heyongli has quit IRC15:15
*** heyongli has joined #openstack-infra15:15
*** agopi_ is now known as agopi15:17
*** lpetrut has quit IRC15:18
*** njohnston_ has joined #openstack-infra15:24
*** heyongli has quit IRC15:25
*** heyongli has joined #openstack-infra15:25
*** sungn has joined #openstack-infra15:26
mnaserclarkb: still having the issues?  i can traceroute from the gateway so im trying to think why this is happening15:31
clarkbmnaser: we were as of yesterday when we turned it off15:31
clarkblet me check from the mirror node15:31
*** njohnston_ has quit IRC15:32
*** njohnston_ has joined #openstack-infra15:32
*** heyongli has quit IRC15:35
clarkbmnaser: ping6 isn't working to ping mirror.ca-ymq-1.vexxhost.openstack.org from nl03.openstack.org15:35
*** heyongli has joined #openstack-infra15:35
mnaserthis is so strange hmm15:36
fungiclarkb: yeah, i had the call info on my calendar but have an appointment which is going to conflict, i think. hopefully we have enough others calling in to represent, my presence would likely have been redundant15:37
dhellmanncorvus , fungi, clarkb, mordred: I have a question about the python3 discussion from Friday. Do we still want/need to separate jobs by branch specifier as we move them, so that branch-aware jobs that run only on master are left in project-config, for example?15:38
*** sungn has quit IRC15:38
clarkbmnaser: I can ping between ovh and rackspace but not from those to vexxhost15:38
*** ccamacho has quit IRC15:38
*** sungn has joined #openstack-infra15:38
jiapeiHello guys, I just setup Zuul v3, but it fails to connect to Gerrit with error log http://paste.openstack.org/show/724714/, anyone have any idea on it?15:39
clarkbdhellmann: my hunch is yes particularly for only master since you'd get new job configs everytime you branched then having them all apply to master would result in unexpected behavior for users15:39
dhellmannclarkb : ok, good point15:41
logan-mnaser: fwiw I don't see the v6 prefix your mirror is on announced from any of my transits.15:41
mnaserlogan-: it looks like that is the case15:41
mnaserso im debugging15:41
mnaserrather, sending emails.15:41
clarkbjiapei: have you tried manually doing a git clone against the gerrit server from your zuul host as the zuul user? I'd work backwards from that15:41
dhellmannclarkb : could I get you to take  a look at http://git.openstack.org/cgit/openstack/goal-tools/tree/goal_tools/python3_first/jobs.py and http://git.openstack.org/cgit/openstack/goal-tools/tree/goal_tools/tests/python3_first/test_jobs.py and see if those look like they're doing what you would expect? if you want to try them out, there are some basic instructions in the readme file15:42
jiapeiYes, I tried manually, and it successfully git clone the Ironic code15:42
jiapeiclarkb:15:42
dhellmann clarkb : https://review.openstack.org/#/c/578194/ was the patch that added them if that's easier15:43
jiapeiBut I don't know why zuul executor reports "git" failed with exit code -1315:43
corvusjiapei: was there any more log info after "git.exc.GitCommandError: Cmd('git') failed due to: exit code(-13)" ?15:44
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for nova json compare unit test bug 1779711  https://review.openstack.org/57960815:45
openstackbug 1779711 in OpenStack Compute (nova) "test_pre_live_migration_volume_backed* intermittently fails serialized json compare" [Critical,Confirmed] https://launchpad.net/bugs/177971115:45
jiapeicorvus: http://paste.openstack.org/show/724715/, only 2 more lines, and then the log repeat saying same thing15:45
clarkbdhellmann: ya I'll run that against a project or two and make sure the results look good15:45
*** heyongli has quit IRC15:45
dhellmannclarkb : thank you!15:45
*** heyongli has joined #openstack-infra15:46
*** tosky has quit IRC15:48
*** njohnston_ has quit IRC15:50
*** njohnston_ has joined #openstack-infra15:51
clarkbdhellmann: against neutron it finds some periodic jobs that are master specific against stable/queens15:51
dhellmannclarkb : ok, thanks, I'll take a look15:52
dhellmannI tested against devstack15:52
clarkbperiodic-jobs-with-oslo-master maybe we actually do want those though?15:52
dhellmannI wonder if that means "with-oslo-source"15:52
corvusjiapei: do you have an 'sshkey' configured for that connection?15:53
*** e0ne has quit IRC15:54
dhellmannclarkb : those periodic jobs do run only on master15:55
dhellmannI wonder why we both with those15:55
*** heyongli has quit IRC15:56
*** weshay is now known as weshay|ruck15:56
*** heyongli has joined #openstack-infra15:56
clarkbdhellmann: possibly buggy config?15:56
dhellmannmaybe?15:56
dhellmannI wonder why we have periodic jobs doing this at all15:57
*** pbourke has quit IRC15:57
clarkbnova has periodic-jobs-with-oslo-master too fwiw. But far less of the master specific stuff than neutron had overall15:57
clarkbanother set of jobs we probably don't need on stable are the release note jobs because we only generate those relative to master right? or do we run them against all merges but only generate them from the viewpoint of master?15:58
*** gyee has joined #openstack-infra15:58
*** pbourke has joined #openstack-infra15:58
fungithey're triggered by events on all branches, just always checkout master i think?15:59
*** njohnston_ has quit IRC15:59
fungiwe want to update published release notes even for activity on a stable branch, since stable branch changes can come with their own release notes relative to their point releases16:00
*** cjloader has joined #openstack-infra16:00
*** njohnston has joined #openstack-infra16:01
*** ramishra has quit IRC16:03
*** vabada has quit IRC16:04
corvusjiapei: if you do have an sshkey setting, then the command would be: GIT_SSH_COMMAND="ssh -i /path/to/key" git clone ssh://lenovo_lxca_ci@review.openstack.org:29418/openstack/ironic /var/lib/zuul/executor-git/review.openstack.org/openstack/ironic16:05
*** heyongli has quit IRC16:06
*** heyongli has joined #openstack-infra16:06
fungimordred: are you on the openci call?16:07
dhellmannclarkb, fungi : yes, we need to trigger the release notes jobs on all branches but the job needs to check out master to run properly16:07
dhellmannI know that one is a weird case16:07
dhellmannI'm not sure I see the value of the periodic library jobs. We gate changes in the libraries against the services already.16:08
dhellmannand we gate the upper-constraints change when we release a library16:08
dhellmannI'll start a mailing list thread about these jobs to see if someone can remember what they are for16:09
fungimordred: they were asking about the ci vocabulary/glossary work you had talked about previously but will take it to the openci ml instead. i have to drop off to get to an appointment at this point16:09
*** dklyle has joined #openstack-infra16:10
* fungi will be back soon, hopefully by 17:30z16:10
*** trown is now known as trown|lunch16:10
*** armaan has joined #openstack-infra16:12
*** heyongli has quit IRC16:16
*** ykarel has joined #openstack-infra16:16
*** anteaya has joined #openstack-infra16:16
*** heyongli has joined #openstack-infra16:16
*** bhavik1 has joined #openstack-infra16:22
*** sambetts is now known as sambetts|afk16:24
*** heyongli has quit IRC16:26
*** heyongli has joined #openstack-infra16:27
*** andreas_s has quit IRC16:31
*** andreas_s has joined #openstack-infra16:32
*** armaan has quit IRC16:36
*** armaan has joined #openstack-infra16:36
*** heyongli has quit IRC16:37
*** andreas_s has quit IRC16:37
*** heyongli has joined #openstack-infra16:37
*** andreas_s has joined #openstack-infra16:39
*** dpawlik has joined #openstack-infra16:40
*** mihalis68 has joined #openstack-infra16:43
*** jpich has quit IRC16:43
*** andreas_s has quit IRC16:44
*** dpawlik has quit IRC16:45
*** bhavik1 has quit IRC16:46
*** heyongli has quit IRC16:47
*** heyongli has joined #openstack-infra16:47
*** camunoz has joined #openstack-infra16:48
*** mriedem has quit IRC16:49
*** alex_xu has quit IRC16:50
*** jamesmcarthur has quit IRC16:52
*** iranzo has quit IRC16:52
*** alex_xu has joined #openstack-infra16:54
*** dpawlik has joined #openstack-infra16:56
clarkbas an update on packethost, I created and instance there and it doens't appear to have working networking yet. So I think we are still waiting for the cabling and mtu changes to happen?16:57
*** heyongli has quit IRC16:57
*** heyongli has joined #openstack-infra16:57
clarkbdhellmann: that seems like a good place to start with those jobs in particular. I don't really see anything else weird in the output of that script.16:58
*** jpena is now known as jpena|off16:58
dhellmannclarkb : bnemec thinks they were being used to test oslo libs at one point but we're not using them any more16:58
dhellmannit raises the point that my script isn't looking deeply enough at the settings. I'm working on making it look at project template definitions for jobs like this, so I don't need to do it myself16:59
clarkbI want to say at one time we wanted oslo to work agianst all stable branches16:59
clarkbbut then we got constraints and didn't need that anymore because we could reliably pin to specific versions on different stable brnaches17:00
*** jrist has quit IRC17:00
dhellmannhmm, maybe? I think I would have spoken up against any plan like that.17:00
dhellmannwe had stable branches for oslo pretty early17:00
*** dpawlik has quit IRC17:01
*** tesseract has quit IRC17:02
*** dtantsur is now known as dtantsur|afk17:03
*** jrist has joined #openstack-infra17:06
*** heyongli has quit IRC17:07
*** electrofelix has quit IRC17:08
*** heyongli has joined #openstack-infra17:08
*** ykarel has quit IRC17:09
openstackgerritSagi Shnaidman proposed openstack-infra/project-config master: Rename openstack-infra/tripleo-ci to openstack/tripleo-ci  https://review.openstack.org/57964417:10
*** armaan has quit IRC17:12
*** armaan has joined #openstack-infra17:12
*** peereb has joined #openstack-infra17:14
*** trown|lunch is now known as trown17:17
*** heyongli has quit IRC17:18
*** heyongli has joined #openstack-infra17:18
*** owalsh is now known as owalsh_pto17:18
*** diablo_rojo has joined #openstack-infra17:24
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for nova json compare unit test bug 1779711  https://review.openstack.org/57960817:24
openstackbug 1779711 in OpenStack Compute (nova) "test_pre_live_migration_volume_backed* intermittently fails serialized json compare" [Critical,In progress] https://launchpad.net/bugs/1779711 - Assigned to Matt Riedemann (mriedem)17:24
corvusi have to run to an appointment; will be back in a few hours17:25
*** jlibosva has quit IRC17:25
*** heyongli has quit IRC17:28
*** heyongli has joined #openstack-infra17:28
*** jamesmca_ has quit IRC17:30
*** felipemonteiro has joined #openstack-infra17:34
*** felipemonteiro has quit IRC17:38
*** heyongli has quit IRC17:38
*** heyongli has joined #openstack-infra17:38
*** felipemonteiro has joined #openstack-infra17:39
clarkbLooks like the mtu changes got in, thank you reviewers for that17:39
clarkbcorvus: when you return did you want to follow up on ianw's zuul-discuss thread about log-inventory changes and get my change sto shuffle that around merged?17:40
*** e0ne has joined #openstack-infra17:44
*** felipemonteiro has quit IRC17:45
*** sungn has quit IRC17:45
*** felipemonteiro has joined #openstack-infra17:47
*** heyongli has quit IRC17:48
*** heyongli has joined #openstack-infra17:49
*** pguimaraes has quit IRC17:50
*** janki has quit IRC17:52
*** panda is now known as panda|off17:52
*** jamesmcarthur has joined #openstack-infra17:57
*** heyongli has quit IRC17:59
*** heyongli has joined #openstack-infra17:59
*** graphene has joined #openstack-infra18:01
*** iranzo has joined #openstack-infra18:05
*** peereb has quit IRC18:07
*** heyongli has quit IRC18:09
*** heyongli has joined #openstack-infra18:09
*** e0ne has quit IRC18:09
openstackgerritSam Yaple proposed openstack/diskimage-builder master: Add keyring if supplied  https://review.openstack.org/57965818:10
*** florianf has quit IRC18:10
*** iranzo has quit IRC18:15
*** jamesmcarthur has quit IRC18:16
*** hongbin has joined #openstack-infra18:19
*** heyongli has quit IRC18:19
*** heyongli has joined #openstack-infra18:19
*** e0ne has joined #openstack-infra18:20
*** jamesmcarthur has joined #openstack-infra18:29
*** heyongli has quit IRC18:29
*** heyongli has joined #openstack-infra18:30
openstackgerritSam Yaple proposed openstack/diskimage-builder master: Add keyring if supplied  https://review.openstack.org/57965818:34
*** graphene has quit IRC18:34
*** graphene has joined #openstack-infra18:36
*** e0ne has quit IRC18:36
*** pcichy has quit IRC18:38
*** pfallenop has quit IRC18:39
*** heyongli has quit IRC18:40
*** heyongli has joined #openstack-infra18:40
*** pfallenop has joined #openstack-infra18:40
*** pfallenop has joined #openstack-infra18:40
*** pfallenop has quit IRC18:40
Shrewswhat was the commit msg syntax to reference a sb item/18:42
Shrews?18:42
cjloaderhow would I go about changing my gerrit username?18:44
*** pfallenop has joined #openstack-infra18:45
*** pfallenop has joined #openstack-infra18:45
Shrewsnm, found it (again)18:45
*** pfallenop has quit IRC18:45
clarkbcjloader: the short answer is you don't, Gerrit expects that value to not chnage18:47
clarkbcjloader: is there a specific issue or concern you are looking to address?18:47
cjloaderI wanted to have my username match my irc name18:48
cjloaderall of the other accounts related are this username18:48
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Fix for referencing cloud image by ID  https://review.openstack.org/57966418:48
clarkbcjloader: the username is really only exposed to you as part of pushing/pulling code. The bits of data that are exposed to humans like Full Name and email addresses can be updated in the gerrit settings page for your user18:49
cjloaderokay, I understand, ty18:49
*** heyongli has quit IRC18:50
*** heyongli has joined #openstack-infra18:50
clarkbdtroyer: do you want to address ianw's comment in https://review.openstack.org/#/c/578532/ (basically a way to reduce config overhead going forward)18:54
clarkbdtroyer: it may not be appropriate depending on how the various components all go together18:54
*** pfallenop has joined #openstack-infra18:57
*** pfallenop has quit IRC18:59
*** heyongli has quit IRC19:00
*** heyongli has joined #openstack-infra19:00
*** diablo_rojo has quit IRC19:03
*** amotoki has quit IRC19:04
openstackgerritMerged openstack-infra/project-config master: Add api-ref-jobs to Watcher templates list  https://review.openstack.org/57875019:06
mnaserclarkb: want to recheck ipv6 now?19:07
*** e0ne has joined #openstack-infra19:07
clarkbmnaser: yup, looking19:07
dtroyerclarkb: that seems like the right thing, I'm about to head out for a bit, will do it later this afternoon19:07
dtroyerthanks19:07
clarkbdtroyer: cool, noticed there is a new docs repo too so figured it may be worthwhile to get that all set up right the first time19:08
clarkbmnaser: things ping19:08
mnaseryay.19:08
clarkbmnaser: let me get a revert up19:09
openstackgerritClark Boylan proposed openstack-infra/project-config master: Revert "Temporarily stop booting nodes in vexxhost"  https://review.openstack.org/57967119:10
*** heyongli has quit IRC19:10
mordredinfra-root: I'm 6-months behind on expense reports - so I'm basically not doing anything else until I'm caught up19:10
clarkbmordred: good luck with that19:11
*** heyongli has joined #openstack-infra19:11
*** pcichy has joined #openstack-infra19:11
clarkbif config-core want to review 579671 I can watch it19:12
*** e0ne has quit IRC19:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Fix for referencing cloud image by ID  https://review.openstack.org/57966419:13
Shrewsmordred: umm... wow19:14
mordredShrews: yeah19:15
openstackgerritMerged openstack-infra/zuul master: model: fix AttributeError exception in freezeJobGraph  https://review.openstack.org/57942819:16
*** heyongli has quit IRC19:21
*** heyongli has joined #openstack-infra19:21
*** cjloader has quit IRC19:24
clarkbmnaser: http://logs.openstack.org/74/74/c3a54a71613ec4736adcdb363be6c17b01ccd9f1/third-party-check/kata-runsh/2a7dbfb/ ran on vexxhost so we are booting nodes successfully now19:25
clarkbmnaser: but failed doing dns lookup for the mirror19:25
*** felipemonteiro has quit IRC19:26
clarkbgoing to look into that, wonder if it is fallout from the ipv6 stuff19:26
*** rh-jelabarre has quit IRC19:29
*** jamesmcarthur has quit IRC19:30
clarkbI can resolve it from a node in vexxhost19:31
*** felipemonteiro has joined #openstack-infra19:31
*** heyongli has quit IRC19:31
*** jamesmcarthur has joined #openstack-infra19:31
*** heyongli has joined #openstack-infra19:31
*** shardy has quit IRC19:32
*** d0ugal has quit IRC19:34
dhellmannclarkb : I've updated my job extraction script to look at the jobs within templates: https://review.openstack.org/57967219:35
dhellmannif a job is only added to a project on a single branch using config in-repo but without a branch specifier, does the job only apply to *that* branch?19:35
dhellmannI think so, but I want to make sure that stripping the branch specifiers out of the data is the right thing to do19:35
fungidhellmann: it applies to all branches of that project if that project has no zuul configuration in those other branches19:36
dhellmannok, so we have to ensure that all projects get *some* configuration in each branch, and then whatever is in the branch is what applies to that branch?19:36
clarkbdhellmann: yup19:36
*** rh-jelabarre has joined #openstack-infra19:36
dhellmannok19:36
fungibasically, yes19:36
dhellmannthat's a little surprising, but I don't think it will be a problem19:36
dhellmannI guess I keep getting surprised by spooky-action-at-a-distance configuration behavior :-)19:37
fungiif a branch has no zuul configuration then that project's master branch configuration is applied for events on that branch19:37
clarkbmnaser: I jumped on a vexxhost node and manually updated sources.list and did an apt-get update and it worked so unsure of why it is unhappy19:37
dhellmannI think when we're done here we will have at least some settings on every branch and the settings won't be identical, so I want to make sure that the branch settings won't be mixed together in some surprising way19:38
clarkbmaybe upstream dns resolvers had cached bad records?19:38
fungidhellmann: yeah, if a project wants differing behavior on non-master branches then zuul configuration needs to be added to those branches, which is mostly a one-time bootstrapping problem as far as v3 migration fallout goes. after that new branches cut from master get zuul configuration as a side effect of branching anyway19:39
dhellmannfungi : ok, good, so it sounds like we'll be in good shape after this transition19:40
dhellmannthanks for confirming that -- I had been assuming it would work that way, but I've been bitten by assumptions a few times now so I'm glad to have the confirmation19:41
*** heyongli has quit IRC19:41
*** heyongli has joined #openstack-infra19:41
*** jamesmcarthur has quit IRC19:42
fungito be fair, that isn't entirely how it worked to start out and we changed some of the implicit vs explicit branch matcher behaviors in an attempt to be more intuitive19:43
fungii continue to double-check myself on branch matching as a result19:43
clarkbmnaser: the issue seems to be ipv6  connectivity to google dns19:44
clarkbmnaser: dig google.com @2001:4860:4860::8888 is unhappy19:45
clarkbmnaser: I'm guessin that ipv6 is only half fixed?19:45
clarkbmnaser: ya traceroute to that has a single hop then dies19:45
clarkbmnaser: 1  2604:e100:1:0:ce2d:e0ff:fe5a:d84e (2604:e100:1:0:ce2d:e0ff:fe5a:d84e)  0.824 ms !N  0.467 ms !N  0.319 ms !N19:46
*** jamesmcarthur has joined #openstack-infra19:48
*** eharney has quit IRC19:50
*** heyongli has quit IRC19:51
*** heyongli has joined #openstack-infra19:52
*** jamesmcarthur has quit IRC19:56
*** heyongli has quit IRC20:02
*** heyongli has joined #openstack-infra20:02
*** cjloader has joined #openstack-infra20:03
*** cjloader has quit IRC20:07
*** heyongli has quit IRC20:12
*** sanfern has joined #openstack-infra20:12
*** heyongli has joined #openstack-infra20:12
clarkbcorvus: cmurphy can we safely run a new afs fileserver against openstack.org's cell in https://review.openstack.org/#/c/579394/1/spec/acceptance/fixtures/default.pp (it is a global filesystem so wondering if that has an impact on our systems)20:13
clarkbI'm guessing it will just fail to authenticate and join the cell?20:13
*** graphene has quit IRC20:15
cmurphyclarkb: I'm not really sure...the service seems to start but I'm guessing it's not functional, would be great to have input on how to set up a proper simulation20:16
*** graphene has joined #openstack-infra20:16
clarkbcmurphy: my hunch is that the service just doesn't serve data to thatcell because it has to authenticate via kerberos to do so (and rspec tests don't have those credentials)20:17
cmurphyI was trying to have it set up its own kerberos realm as well but it didn't really want to work, I'll have to actually read some docs and learn how it works20:18
clarkbI wonder if there is a test cell we can join20:18
*** jamesmcarthur has joined #openstack-infra20:19
*** jamesmcarthur has quit IRC20:19
*** jamesmcarthur has joined #openstack-infra20:20
*** kgiusti has left #openstack-infra20:20
corvusclarkb, cmurphy: there's a bunch of bootstrapping stuff that's not automated (like creating the cell keys, etc), so it'd be considerable work to actually do a complete test.  you could use 'openstack.org' or something else as the cell and realm names -- either way you'd write local config files (like CellServDB and krb5.conf) that specified the servers for that cell/realm (since we won't update20:22
corvusDNS)20:22
*** heyongli has quit IRC20:22
*** heyongli has joined #openstack-infra20:23
corvusclarkb, cmurphy: if we're at "the service starts but would fail if you tried to use it" i think that's a fine place for acceptance tests.  :)20:23
clarkbcorvus: and it shouldn't affect production in that state right?20:23
corvusgoing further is likely a rabbit hole.  a fun one.  like, the sort of rabbit with a waistcoat and pocket watch.  but still a rabbit hole.20:23
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Promote puppet-4 beaker jobs to nonvoting check  https://review.openstack.org/57934320:23
corvusclarkb: right, as long as it doesn't have any keys (and nothing in dns points to it) should be fine20:24
fungibeware the edible fungi20:24
clarkbcool +2 then20:24
*** graphene has quit IRC20:24
fungialso watch out for poorly-labeled beverages20:24
*** graphene has joined #openstack-infra20:26
*** bobh has quit IRC20:28
corvusfungi: er, you said a thing earlier i'm not quite sure is right.  you said "if a branch has no zuul configuration then that project's master branch configuration is applied for events on that branch".  but nova's master branch config won't affect stable branches, even if there is no stable branch config.  only the non-branch-aware config in project-config would affect the stable branches.20:28
clarkbI just approved a couple of the puppet-4 topic changes, if they turn out ok I think I may disable git01-07 in puppet, and approve https://review.openstack.org/#/c/570825/520:29
clarkbthen if 08 looks good reenable puppet on 01-0720:29
clarkbthat gives us an easy rollback via haproxy if necessary20:29
*** eharney has joined #openstack-infra20:29
*** jamesmcarthur has quit IRC20:30
*** sanfern has quit IRC20:31
*** sanfern has joined #openstack-infra20:32
cmurphyclarkb: that one is blocked by https://review.openstack.org/57099120:32
*** sanfern has quit IRC20:32
clarkboh nevermind then20:32
*** sanfern has joined #openstack-infra20:32
*** heyongli has quit IRC20:32
*** jamesmcarthur has joined #openstack-infra20:32
*** heyongli has joined #openstack-infra20:33
*** sanfern has quit IRC20:33
fungicorvus: oh, wait was that one of the things which changed with implicit matchers after we put v3 into production?20:33
*** sanfern has joined #openstack-infra20:33
*** sanfern has quit IRC20:34
*** sanfern has joined #openstack-infra20:34
fungidhellmann: ^ misinformation from me, i'm afraid. sorry!20:34
fungithough the end result is likely the same in your case20:34
*** sanfern has quit IRC20:34
clarkbok I think I'm mostly on top of topic:puppet-4 if someone else is willing to review too I am happy to babysit stuff like described above20:35
*** sanfern has joined #openstack-infra20:35
clarkbmore than happy to pick off a change at a time if they affect production (the changes to testing should be straightforward and mergeable though)20:35
*** sanfern has quit IRC20:35
*** sanfern has joined #openstack-infra20:36
*** sanfern has quit IRC20:36
*** cjloader has joined #openstack-infra20:36
*** sanfern has joined #openstack-infra20:36
*** sanfern has quit IRC20:37
cmurphyfyi sometime soon I am planning to patchbomb this change to all the modules assuming people are happy with it https://review.openstack.org/57752120:37
*** sanfern has joined #openstack-infra20:37
clarkbcmurphy: I left a note on it, I think it is a good improvement but also not strictly necessary?20:37
*** sanfern has quit IRC20:37
clarkbcmurphy: ZUUL_UUID is available via the zuulv2 env compat layer, but relying less on that is a good thing20:38
*** sanfern has joined #openstack-infra20:38
cmurphyclarkb: not sure if it was ZUUL_UUID or WORKSPACE but something about it wasn't working20:38
*** sanfern has quit IRC20:38
clarkbhrm maybe it was the workspace thing then20:38
clarkbit was checking for ZUUL_REF before which definiteld did not work20:39
cmurphyis WORKSPACE only available in legacy mode maybe?20:39
*** sanfern has joined #openstack-infra20:39
*** sanfern has quit IRC20:39
*** sanfern has joined #openstack-infra20:39
*** sanfern has quit IRC20:40
corvusfungi: i kind of lost track of the changes.  i do think there was something really early about master being more special that way, but then it ran into the branching problem (once you branch master, that stuff is on stable now).  so now the only way master is special is if the repo has no other branches.  i can't remember when we made that change.20:40
*** sanfern has joined #openstack-infra20:40
*** sanfern has quit IRC20:41
*** cjloader has quit IRC20:41
fungicorvus: thanks for clarifying! reeducation in progress20:41
corvusfungi, dhellmann: anyway, putting tags aside (so just considering changes), it should be intuitive at this point: absent any explicit branch specification, in-repo config applies only to the current branch.  project-config applies to all branches.20:42
*** heyongli has quit IRC20:43
fungiahh, right, and then at one point we were going to try to have in-repo configs use explicit branch matchers to define stable branch jobs, but realized that becomes a right mess once they get forked so reversed the recommendation?20:43
*** heyongli has joined #openstack-infra20:43
corvusayup20:43
corvusthe list of rules for implicit branch matchers for jobs is down to two: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.branches20:43
corvus(the bullet list at the bottom)20:44
fungimore straightforward than i remembered. awesome20:50
*** heyongli has quit IRC20:53
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr tag command  https://review.openstack.org/56173120:53
*** heyongli has joined #openstack-infra20:53
*** bobh has joined #openstack-infra20:55
openstackgerritMerged openstack-infra/system-config master: Simplify group_names variable  https://review.openstack.org/57699520:57
openstackgerritMerged openstack-infra/puppet-meetbot master: Fix template variables  https://review.openstack.org/56711120:57
openstackgerritMerged openstack-infra/puppet-meetbot master: Add beaker tests  https://review.openstack.org/56504620:58
*** bobh has quit IRC20:59
*** felipemonteiro has quit IRC21:01
*** bobh has joined #openstack-infra21:03
*** heyongli has quit IRC21:03
*** heyongli has joined #openstack-infra21:03
*** trown is now known as trown|outtypewww21:05
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr tag command  https://review.openstack.org/56173121:07
*** bobh has quit IRC21:07
openstackgerritLance Bragstad proposed openstack-infra/project-config master: Update oslo.limit testing jobs  https://review.openstack.org/57969021:10
*** bobh has joined #openstack-infra21:13
*** heyongli has quit IRC21:13
*** heyongli has joined #openstack-infra21:14
*** ldnunes has quit IRC21:15
*** bobh has quit IRC21:17
openstackgerritEhud Kaldor proposed openstack-infra/bindep master: Task: 22622 Task: 22623 Story: 2002765  https://review.openstack.org/57905621:18
*** felipemonteiro has joined #openstack-infra21:18
*** nicolasbock has quit IRC21:24
*** heyongli has quit IRC21:24
*** heyongli has joined #openstack-infra21:24
*** dklyle has quit IRC21:24
*** dklyle has joined #openstack-infra21:25
*** SamYaple has joined #openstack-infra21:31
*** heyongli has quit IRC21:34
*** tonytan4ever has joined #openstack-infra21:34
*** heyongli has joined #openstack-infra21:34
dhellmanncorvus , fungi : ok, so it sounds like a script that drops the branch modifiers as part of building the settings stanza to move out of project-config and into the source repo would be doing the correct and desirable thing21:35
fungidhellmann: yes, that's my takeaway21:36
corvus++21:38
*** bobh has joined #openstack-infra21:40
clarkbit bugs me that unbound doesn't treat a failed dns resolver as a reason to fallback to the next in the list21:44
*** agopi has quit IRC21:44
*** heyongli has quit IRC21:44
*** bobh has quit IRC21:44
*** heyongli has joined #openstack-infra21:44
*** bobh has joined #openstack-infra21:45
fungicorvus: i haven't set up the associated apache vhosts nor the mail routing in exim yet, but this is a great first indicator that we don't need special multi-domain hacks: http://lists-dev.openstack.org/mailman3/21:46
*** hongbin has quit IRC21:46
clarkbanyone know if it is possible to configure that with unbound? I'm wading through the manpage and not finding anything obvious21:46
fungicorvus: or at least that we may not need special multi-domain hacks depending on what else we find out ends up being globally configurable only vs list-specific or domain-specific i guess21:47
*** bobh has quit IRC21:49
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Fix race condition with executor hdd sensor  https://review.openstack.org/57970021:52
corvusfungi: neato!21:54
*** heyongli has quit IRC21:54
fungicorvus: in particular, the mailman cli now expects listnames to be complete e-mail addresses including their domains21:55
*** heyongli has joined #openstack-infra21:55
fungiso i had to say `mailman create foo@mm3test0.openstack.org1 et cetera21:55
fungier, i mean `mailman create foo@mm3test0.openstack.org`21:55
corvusfungi: lemme know if you see a per-domain list index21:56
*** bobh has joined #openstack-infra21:56
openstackgerritEhud Kaldor proposed openstack-infra/bindep master: Task: 22622 Task: 22623 Story: 2002765  https://review.openstack.org/57905621:56
fungicorvus: it's a setting: FILTER_VHOST21:56
corvusfungi: cool, so maybe can do that once you have the vhosts setup21:56
fungiyou set that on a domain and it will only show lists associated with the domain of the vhost21:56
fungiat least, according to documentation21:57
fungibut yeah, this poc is all still very raw... notes in progress at https://etherpad.openstack.org/p/mm3poc21:57
*** bobh has quit IRC22:00
*** hashar has quit IRC22:01
*** kjackal has quit IRC22:02
*** felipemonteiro has quit IRC22:03
*** tonytan4ever has quit IRC22:03
*** tonytan4ever_brb has joined #openstack-infra22:03
*** heyongli has quit IRC22:05
*** heyongli has joined #openstack-infra22:05
*** AJaeger has quit IRC22:05
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Fix race condition with executor hdd sensor  https://review.openstack.org/57970022:05
openstackgerritJames E. Blair proposed openstack-infra/nodepool master: Add test for referencing cloud image by ID  https://review.openstack.org/57970222:09
*** jamesmcarthur has quit IRC22:13
*** cjloader has joined #openstack-infra22:14
*** heyongli has quit IRC22:15
*** heyongli has joined #openstack-infra22:15
*** rcernin has joined #openstack-infra22:18
*** AJaeger has joined #openstack-infra22:19
*** felipemonteiro has joined #openstack-infra22:20
*** felipemonteiro has quit IRC22:23
*** amotoki has joined #openstack-infra22:23
*** heyongli has quit IRC22:25
*** heyongli has joined #openstack-infra22:25
corvusclarkb: https://review.openstack.org/563789  base-test is happy?22:26
clarkbcorvus: that was my understanding, tristanC and ianw had to work through an issue with it on newer ansible22:27
*** dtruong_ has quit IRC22:27
*** dtruong has joined #openstack-infra22:28
clarkbcorvus: 'Note that testing uncovered an issue with the original role -- the "inventory_file" variable is not set by Ansible for localhost only jobs.  Thus "log-inventory" will not break any jobs where "validate-host" was working, but you should be careful not to additionally introduce it into localhost (that is to say, executor-only) jobs without considering this.'22:28
corvusit'd be cool if someone could drop a base-test link into a review comment22:28
fungicorvus: actually even without setting up special apache vhosts, FILTER_VHOST=True in /etc/mailman3/mailman-web.py seems to work for the hyperkitty interface at, e.g., http://mm3test0.openstack.org/mailman3/hyperkitty/ (the web archiver) so now i need to figure out whether postorious (the administrative interface which seems to be the default redirect target) has a similar option and whether it22:29
fungiactually matters22:29
fungier, postorius22:31
fungii always want to add an extra "o"22:31
fungibut apparently 2 was plenty for them22:31
corvusclarkb: i've looked, but i can't find a DNM change that exercises log-inventory in base-test.  do you have one handy, or should i make one?22:32
clarkbcorvus: I don't have one handy22:33
clarkbit was ianw and tristanc testing it aiui22:34
corvusclarkb: it looks like you wrote the changes :)22:34
clarkbI did, but I neglected them when it got like 8 changes deep and needed deprecation notices and so on22:34
*** bobh has joined #openstack-infra22:35
clarkbmy interest in fixing fedora is only slightly greater than nil22:35
*** heyongli has quit IRC22:35
*** heyongli has joined #openstack-infra22:36
corvusthat's fine.  i won't push you to do this work or finish it.  but i'm just surprised i'm being asked to review it before all the documented steps have been done.  i could have easily assumed that you performed the procedure and were just asking for the final ok.22:36
clarkbmy understanding is the documented steps have been done, just not by me22:37
clarkbbased on the email ianw sent in which testing discovered the problem with localhost only jobs22:37
clarkb(but I could be misreading that)22:38
corvusi opened all the links in that message, and none of them exercise base-test22:39
*** bobh has quit IRC22:39
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: DNM: Exercise log-inventory in base-test  https://review.openstack.org/57970822:40
clarkbthat caught an interesting problem with the third party ci ("problem")22:41
corvusthat's expected22:41
corvusit's a true positive.  :)  we'll never merge that change.22:42
*** heyongli has quit IRC22:46
*** heyongli has joined #openstack-infra22:46
*** rh-jelabarre has quit IRC22:50
*** heyongli has quit IRC22:56
*** heyongli has joined #openstack-infra22:56
*** bobh has joined #openstack-infra22:57
*** bobh has quit IRC23:01
*** aeng has quit IRC23:02
*** edmondsw has quit IRC23:05
clarkbI'm impressed the post queue is as long as it is after the update to supercedent pipeline manager23:05
*** edmondsw has joined #openstack-infra23:06
*** heyongli has quit IRC23:06
*** heyongli has joined #openstack-infra23:06
*** bobh has joined #openstack-infra23:07
fungithe lack of redundancy there has been really effective for getting post jobs run sooner23:08
*** bobh_ has joined #openstack-infra23:10
*** bobh_ has quit IRC23:11
*** edmondsw has quit IRC23:11
*** bobh_ has joined #openstack-infra23:11
*** graphene has quit IRC23:13
*** graphene has joined #openstack-infra23:14
*** neiloy has quit IRC23:14
*** bobh has quit IRC23:14
*** bobh_ has quit IRC23:15
*** heyongli has quit IRC23:16
*** heyongli has joined #openstack-infra23:17
*** pahuang has joined #openstack-infra23:19
*** aeng has joined #openstack-infra23:20
*** jamesmcarthur has joined #openstack-infra23:21
*** jamesmcarthur has quit IRC23:26
*** heyongli has quit IRC23:27
*** heyongli has joined #openstack-infra23:27
*** agopi has joined #openstack-infra23:29
*** dpawlik has joined #openstack-infra23:35
ianwi think i have a fedora host held now that exhibited the problem23:35
*** rlandy has quit IRC23:35
mnaserhi23:36
ianwhrm no, i guess my autohold just got lost23:36
mnaseri have a few free cycles23:37
*** heyongli has quit IRC23:37
mnaserare we still seeing dns resolution issues hitting google?23:37
clarkbmnaser: yes23:37
mnasergrrr23:37
mnaseripv6: it'll solve all problems they said23:37
*** heyongli has joined #openstack-infra23:37
clarkb2001:4860:4860::8888 and 2001:4860:4860::8844 unping23:37
clarkband they die at the first hop in vexxhost23:37
*** agopi has quit IRC23:37
*** rh-jelabarre has joined #openstack-infra23:38
ianwmnaser: apropos me looking at hold lists, do you still need "mnaser debug packethost job timeouts" 198.72.124.162 ?23:39
*** dpawlik has quit IRC23:39
mnaserianw: no i think we are good on that. we've found the source of the issue, sorry for not updating23:39
clarkbmnaser: oh, have details on that? would be crious23:40
mnaseri guess this was the whole checksum stuff23:40
mnaserfungi: mentioned checksum + bridge + offloading in nic = weird things23:40
mnasernow for the ipv6 google issue... i literally see no routes, i wonder if they are not installed or $peering_arugment23:40
*** eharney has quit IRC23:41
fungimnaser: not necessarily weird. hardware offload just means you no longer see those values when they get to the kernel network stack so validating them is pointless and doomed to fail23:43
*** threestrands has joined #openstack-infra23:43
fungiperhaps surprising if it's not your server and so you don't know to expect it (yay clouds)23:44
*** gyee has quit IRC23:45
clarkbmnaser: pings now so whatever you changed must be working?23:47
*** heyongli has quit IRC23:47
mnaserclarkb: flapped a bgp session and i guess routes were not properly installed23:47
* mnaser shrugs23:47
*** heyongli has joined #openstack-infra23:48
clarkbI'm going to recheck kata tests and if they work I'll reapprove the revert for vexxhost max servers23:48
mnasercool, thanks and sorry for the disturbance23:48
ianwcorvus: looking it over, i think it's a case of "i thought they did it" <-> "i thought they did it" .  thanks for looking23:49
clarkbcorvus: ianw http://logs.openstack.org/08/579708/1/check/tox-py35-on-zuul/ce13e64/ara-report/result/2ffd0b13-ef8b-4632-8369-cd65d3c78b39/ it seems to have worked23:50
clarkband the validate-host inventory copy was a noop after (marked OK not Changed)23:50
*** diablo_rojo has joined #openstack-infra23:51
*** mylu has joined #openstack-infra23:51
*** dingyichen has joined #openstack-infra23:53
*** heyongli has quit IRC23:57
*** heyongli has joined #openstack-infra23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!