Wednesday, 2018-03-28

pabelangerprometheanfire: ianw: we should see about adding a non-voting jobs to both glean and diskimage-builder too, and depends-on the nodepool change00:00
pabelangermordred: wfm00:01
mordredcorvus: that's kinda my feeling ... I could switch it - but I think I mostly just don't care :)00:02
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Support updated REST and HTML layout  https://review.openstack.org/55697300:02
mordredbtw - the last 2 puppet spec test failures on puppet-zuul were actual real bugs00:03
mordredso - yay for testing00:03
*** germs has quit IRC00:04
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Split v2 and v3 web config  https://review.openstack.org/55686900:04
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Support updated REST and HTML layout  https://review.openstack.org/55697300:04
*** s-shiono has joined #openstack-infra00:04
*** salv-orlando has joined #openstack-infra00:05
corvusokay, the cgit update is in place on all backends00:05
mordredcorvus: \o/00:06
*** Swami has quit IRC00:06
*** felipemonteiro has joined #openstack-infra00:07
corvuspabelanger, mordred, fungi: i haven't gotton a misfire yet, and my reload finger is getting sore00:08
*** salv-orlando has quit IRC00:10
*** rlandy is now known as rlandy|bbl00:11
*** rkukura_ has joined #openstack-infra00:11
*** mrhillsman is now known as mrhillsman_in_mm00:11
*** mythicalphoenix has quit IRC00:12
*** yamamoto has joined #openstack-infra00:12
*** technotony has joined #openstack-infra00:12
*** mrhillsman_in_mm is now known as mrhillsman00:13
*** openstack has joined #openstack-infra00:15
*** ChanServ sets mode: +o openstack00:15
prometheanfirepabelanger: :D thanks00:15
corvusi'll mark that spec complete after https://review.openstack.org/555104 lands -- there's a merge conflict and i don't want to rebase it00:15
* prometheanfire sees if clarkb is around (and doubts it)00:15
*** technotony has joined #openstack-infra00:17
*** yamamoto has quit IRC00:17
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Update links to git.zuul-ci.org  https://review.openstack.org/55709900:18
openstackgerritMerged openstack-infra/puppet-zuul master: Add new parameters to zuul::web  https://review.openstack.org/55708400:20
openstackgerritMerged openstack-infra/system-config master: Pass web settings to zuul::web  https://review.openstack.org/55708500:20
*** stakeda has joined #openstack-infra00:20
*** aeng has joined #openstack-infra00:20
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710000:21
*** dave-mccowan has joined #openstack-infra00:21
ianwpabelanger: ok ... did we verify things on limestone first?00:27
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: Do not merge: Test limestone nodes  https://review.openstack.org/55684900:27
ianwpabelanger / dmsimard: ^ running things on limestone to see what happens00:28
mordredcorvus, pabelanger, ianw: zomg. https://review.openstack.org/#/c/556869/ is actually green00:28
pabelangerianw: ah, yah. I knew there was a test00:28
pabelangermordred: woot00:29
*** VW has joined #openstack-infra00:30
*** VW_ has quit IRC00:30
mordredso - it should be safe to land00:31
ianwmordred: did you change the zuul dots?  they're a little flat? https://imgur.com/a/LuGE800:31
mordredianw: I did not - that bug has actually been around for a bit -Ive got a fix for it in the javascript stack though00:31
corvusoh, is it the *dots* that are wrong, i assumed it was the lines00:32
ianwok, cool, yeah i thought i'd seen something about it00:32
mordredinfra-root: I procedural -2'd the main zuul api change patch https://review.openstack.org/#/c/556967 - tomorrow we can get it landed and rolled out when I'm around to watch/fix00:32
corvusmordred: 869 has 2x+2.  i'm about to afk so don't want to +W00:32
mordredcorvus: ++ - same here00:33
mordredI think we're set to go for tomorrow00:33
pabelangersounds like a plan00:33
ianwpabelanger: openstack-infra-base-integration-opensuse423 -- node_failure ... that's a bummer00:33
*** gyee has quit IRC00:33
pabelangerianw: we can only launch 10 nodes, wonder if that is the issue00:34
pabelangerwe are also hold 2 nodes00:34
pabelangerlet me see if we can delete them00:34
pabelangeryah00:34
pabelangerthey are from me00:34
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: DNM: debug some ipv6 variables  https://review.openstack.org/55702200:34
corvuspabelanger: being at quota should not produce a node_failure00:35
pabelangercorvus: good point, I'll check logs00:35
clarkbya I fixedthat bug00:35
clarkbits tested now too00:35
corvusclarkb: oh there was a bug?  were launchers restarted with it?00:35
pabelangerFeb13 is when it was last started00:36
pabelangeron nl02 at least00:36
clarkbcorvus: ya this was forever ago00:36
clarkblike december or january00:36
*** yamahata has joined #openstack-infra00:38
*** yamamoto has joined #openstack-infra00:38
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(1/2)  https://review.openstack.org/55669600:39
*** felipemonteiro has quit IRC00:42
pabelangerclarkb: corvus: ianw: the nodeset in https://review.openstack.org/556849 for opensuse has a typo00:43
pabelangerso the nodes aren't valid00:43
Jeffrey4lifra-root, since kolla create a new group "kolla-core-cli" https://review.openstack.org/#/admin/groups/1889,members , could you add me as the initial core member? thanks.00:43
Jeffrey4linfra-root ^^00:43
ianwJefrey4l: done00:44
ianwpabelanger: heh, ok that would do it00:45
Jeffrey4lthanks00:45
*** yamamoto has quit IRC00:45
pabelangerianw: given that multinodes jobs passed, I'm good assuming single node does too00:46
*** efoley has quit IRC00:47
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(1/2)  https://review.openstack.org/55669600:47
ianwpabelanger: it's so *weird* ... i've reverted back to "bare" ansible_default_ipv6 is defined in https://review.openstack.org/#/c/557022 and not seeing any failures to pick up ipv600:48
*** yamahata has quit IRC00:49
pabelangerianw: have no thoughts00:50
ianwheisenbug00:50
ianwonce it finishes, i'll try a run without the debug statements, if that passes ... ¯\_(ツ)_/¯00:52
*** odyssey4me has quit IRC00:53
*** odyssey4me has joined #openstack-infra00:53
ianwpabelanger: i also remember why we left the glean nodepool-src tests in project-config now too, because they were in queue: glean00:53
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(2/2)  https://review.openstack.org/55678900:54
*** yamamoto has joined #openstack-infra00:56
*** rkukura has quit IRC00:58
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: Do not merge: Test limestone nodes  https://review.openstack.org/55684901:04
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: DNM: debug some ipv6 variables  https://review.openstack.org/55702201:05
*** bobh has joined #openstack-infra01:05
*** pahuang_ has quit IRC01:07
Jeffrey4linfra-root, recently, i tried to add a serial jobs in release pipeline in openstack/kolla project. yesterday, a new release 5.0.2 is release, but the jobs i added seems not loaded. is anyone could check this why?01:12
Jeffrey4lhere is the related patch https://review.openstack.org/55670101:12
Jeffrey4lhere is the related release piple result http://logs.openstack.org/92/921bb0dc8b559e9cf3f6b5c17d0c6597c4debc44/release/01:12
*** gyankum has joined #openstack-infra01:12
*** yamamoto has quit IRC01:14
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: autohold: prevent using ',' in change argument  https://review.openstack.org/55632901:15
*** prometheanfire has quit IRC01:15
*** gongysh has joined #openstack-infra01:16
clarkbJeffrey4l: do those jobs exist on pike?01:16
Jeffrey4lclarkb, yes. it is backported by https://review.openstack.org/#/c/556701/01:17
*** bobh has quit IRC01:17
Jeffrey4land 5.0.2 tag includes that patch.01:17
clarkblooks like its in the same file ya01:17
*** notmyname has quit IRC01:17
clarkbI'm wondering if it is because tags are not directly associated to branches if this is why its unhappy01:18
Jeffrey4lclarkb, maybe. is there any way i can add jobs in release pipeline?01:18
clarkbyou can add them in project config but I think we need to understand this better01:19
Jeffrey4li cloud. But i think this should be fixed in zuul, too. it is a noraml feature.01:20
clarkbhttp://logs.openstack.org/92/921bb0dc8b559e9cf3f6b5c17d0c6597c4debc44/release/ is what it did run01:21
clarkbcan you find where those are defined for kolla? maybe in project config (hoping it gives us more info and I'm on a phone)01:21
*** cshastri has joined #openstack-infra01:22
Jeffrey4lthese are not configure in kolla project. them should be configure in project-config and inherit from a jobs template.01:22
*** hongbin has joined #openstack-infra01:22
clarkbya thats my guess01:22
*** prometheanfire has joined #openstack-infra01:22
*** notmyname has joined #openstack-infra01:22
clarkbya its project config01:23
clarkbI think this may be one for corvus to understamd how tags map to bramches01:23
Jeffrey4lyeah, i found it too.01:23
Jeffrey4lcool, hope this featur could land :D01:24
*** pahuang_ has joined #openstack-infra01:25
*** technotony has quit IRC01:25
*** prometheanfire has quit IRC01:29
*** armaan has quit IRC01:30
*** armaan has joined #openstack-infra01:31
dmsimardianw: re: logstash and ansible01:33
dmsimardI want to wave my hands in several directions and mention ara01:33
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(1/2)  https://review.openstack.org/55669601:34
dmsimardBut I'm going to bed early, but I wanted you to know that I have an opinion on the thing, especially with the eventual new version of ARA01:34
dmsimardSo I'll try to remember to tell you about my opinion :D01:35
dmsimardAlso, for those interested, my OpenStack meetup talk and openstack-infra went well and I'll share a YouTube link when it's up :D01:35
*** sree has quit IRC01:36
*** sree has joined #openstack-infra01:37
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(2/2)  https://review.openstack.org/55678901:38
*** gongysh has quit IRC01:38
*** vivsoni has quit IRC01:39
*** gouthamr has joined #openstack-infra01:40
*** vivsoni has joined #openstack-infra01:41
*** sree has quit IRC01:41
*** bobh has joined #openstack-infra01:45
*** rosmaita has quit IRC01:50
*** liusheng has quit IRC01:51
*** liusheng has joined #openstack-infra01:52
*** bobh has quit IRC01:53
*** prometheanfire has joined #openstack-infra01:55
*** germs has joined #openstack-infra02:00
*** germs has quit IRC02:00
*** germs has joined #openstack-infra02:00
*** ykarel|away has joined #openstack-infra02:02
*** germs has quit IRC02:04
*** liusheng has quit IRC02:06
*** salv-orlando has joined #openstack-infra02:07
*** liusheng has joined #openstack-infra02:07
*** cshastri has quit IRC02:08
*** psachin has joined #openstack-infra02:11
*** ramishra has joined #openstack-infra02:11
*** salv-orlando has quit IRC02:12
*** ykarel|away has quit IRC02:14
*** jamesmcarthur has joined #openstack-infra02:15
*** yamamoto has joined #openstack-infra02:15
*** ykarel|away has joined #openstack-infra02:16
*** cshastri has joined #openstack-infra02:18
*** yamamoto has quit IRC02:21
*** pahuang_ has quit IRC02:21
*** VW has quit IRC02:25
*** VW has joined #openstack-infra02:26
*** zhurong has joined #openstack-infra02:33
*** pahuang_ has joined #openstack-infra02:34
*** ykarel|away has quit IRC02:34
*** gongysh has joined #openstack-infra02:35
*** zhangfei has joined #openstack-infra02:35
*** yamamoto has joined #openstack-infra02:37
*** sree has joined #openstack-infra02:39
*** sree has quit IRC02:39
*** sree has joined #openstack-infra02:39
*** zhangfei has quit IRC02:40
*** zhangfei has joined #openstack-infra02:41
corvusdmsimard: well, there's a mailing list thread, so don't fret, it'll still be there tomorrow.  but i think the thing to keep in mind here that this is searching across all builds.02:41
corvusJeffrey4l, clarkb: when the jobs are added to kolla on a branch, they get an implied branch specifier, so https://review.openstack.org/556701 really means "run these jobs on changes to the stable/pike branch" because that's the branch it modified.  we might be able to make this work the way you expect in the future, however, at the moment, i think the best thing to do is to remove those job02:46
corvusinvocations from the project definition in the kolla repo, and instead add them in project-config.02:46
*** armaan has quit IRC02:59
*** yamamoto has quit IRC03:18
*** jamesmcarthur has quit IRC03:21
*** dhajare_ has joined #openstack-infra03:29
*** janki has joined #openstack-infra03:32
openstackgerritTony Breeds proposed openstack-infra/irc-meetings master: Make Lujin Luo the main chair for Neutron upgrades meeting  https://review.openstack.org/55699003:39
*** anticw has quit IRC03:42
*** anticw has joined #openstack-infra03:43
*** hongbin has quit IRC03:43
*** cshastri has quit IRC03:45
*** cshastri has joined #openstack-infra03:45
*** andreas_s has joined #openstack-infra03:46
openstackgerritMerged openstack-infra/irc-meetings master: Make Lujin Luo the main chair for Neutron upgrades meeting  https://review.openstack.org/55699003:48
*** andreas_s has quit IRC03:51
*** jamesmcarthur has joined #openstack-infra03:54
*** dave-mccowan has quit IRC03:55
*** VW has quit IRC03:55
*** VW has joined #openstack-infra03:55
*** jaosorior has joined #openstack-infra03:56
*** udesale has joined #openstack-infra03:57
*** VW_ has joined #openstack-infra04:00
*** VW has quit IRC04:00
*** germs has joined #openstack-infra04:01
*** germs has quit IRC04:01
*** germs has joined #openstack-infra04:01
*** germs has quit IRC04:06
*** stakeda has quit IRC04:07
*** sshnaidm_ has joined #openstack-infra04:08
*** sshnaidm has quit IRC04:08
*** salv-orlando has joined #openstack-infra04:08
*** salv-orlando has quit IRC04:13
*** ykarel|away has joined #openstack-infra04:15
*** yamamoto has joined #openstack-infra04:19
*** gongysh has quit IRC04:19
*** gouthamr has quit IRC04:22
*** VW_ has quit IRC04:23
*** VW has joined #openstack-infra04:24
*** yamamoto has quit IRC04:25
*** psachin has quit IRC04:25
*** namnh has joined #openstack-infra04:27
*** VW has quit IRC04:29
*** sshnaidm_ has quit IRC04:32
*** cshastri has quit IRC04:39
*** psachin has joined #openstack-infra04:43
*** links has joined #openstack-infra04:46
*** sshnaidm_ has joined #openstack-infra04:48
*** cshastri has joined #openstack-infra04:54
*** cshastri has quit IRC04:54
*** cshastri has joined #openstack-infra04:55
*** lpetrut has joined #openstack-infra04:55
*** udesale has quit IRC04:58
*** udesale has joined #openstack-infra04:59
*** armaan has joined #openstack-infra05:04
*** sshnaidm_ has quit IRC05:09
*** salv-orlando has joined #openstack-infra05:09
*** salv-orlando has quit IRC05:09
*** salv-orlando has joined #openstack-infra05:09
AJaegerdhellmann, prometheanfire, I commented on https://review.openstack.org/#/c/555426/ - if prometheanfire gives a +1, I'm fine to proceed.05:14
*** pgadiya has joined #openstack-infra05:19
*** yamamoto has joined #openstack-infra05:21
*** dhajare_ is now known as dhajare05:23
*** sshnaidm has joined #openstack-infra05:24
*** lpetrut has quit IRC05:26
*** e0ne has joined #openstack-infra05:26
*** lpetrut has joined #openstack-infra05:27
*** yamamoto has quit IRC05:27
openstackgerritzhongshengping proposed openstack-infra/project-config master: Retire puppet-ganesha(2/2)  https://review.openstack.org/55678905:27
*** e0ne has quit IRC05:33
*** aeng has quit IRC05:34
*** liusheng has quit IRC05:35
*** liusheng has joined #openstack-infra05:36
*** lpetrut has quit IRC05:39
*** jtomasek has joined #openstack-infra05:43
*** rlandy|bbl has quit IRC05:43
*** armaan has quit IRC05:49
*** e0ne has joined #openstack-infra05:50
*** aeng has joined #openstack-infra05:51
*** lpetrut has joined #openstack-infra05:52
*** gfidente has joined #openstack-infra05:54
*** gfidente has joined #openstack-infra05:54
*** cshastri has quit IRC05:57
*** claudiub|2 has joined #openstack-infra05:59
*** greghaynes has quit IRC06:01
*** aeng has quit IRC06:02
*** germs has joined #openstack-infra06:02
*** germs has quit IRC06:02
*** germs has joined #openstack-infra06:02
*** gongysh has joined #openstack-infra06:02
*** germs has quit IRC06:06
*** cshastri has joined #openstack-infra06:10
*** e0ne has quit IRC06:10
*** greghaynes has joined #openstack-infra06:10
*** garyk has quit IRC06:11
*** dhajare has quit IRC06:11
*** vaidy has quit IRC06:13
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/55715706:14
*** Gorian has quit IRC06:14
*** garyk has joined #openstack-infra06:14
*** garyk has quit IRC06:15
*** armaan has joined #openstack-infra06:15
Jeffrey4linfra-root it is possible that re-use a playbooks from kolla project in openstack-zuul-jobs' job definition?06:18
*** isviridov_away has quit IRC06:18
*** Gorian has joined #openstack-infra06:21
Jeffrey4lnow i have migrate some jobs from kolla to openstack-zuul-jobs(another story), is there any eailer way rather than copy all playbooks to openstack-zuul-jobs?06:23
*** yamamoto has joined #openstack-infra06:23
*** gfidente has quit IRC06:24
*** florianf has joined #openstack-infra06:24
*** claudiub has joined #openstack-infra06:26
*** garyk has joined #openstack-infra06:26
*** chenying_ has joined #openstack-infra06:27
*** chenying has quit IRC06:27
*** udesale_ has joined #openstack-infra06:28
*** auristor has joined #openstack-infra06:28
*** garyk has quit IRC06:28
*** yamamoto has quit IRC06:28
*** auristor1 has quit IRC06:28
*** claudiub|2 has quit IRC06:29
*** Hal has quit IRC06:29
*** jaosorior has quit IRC06:29
*** ykarel_ has joined #openstack-infra06:30
*** udesale has quit IRC06:30
*** udesale__ has joined #openstack-infra06:30
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Retire puppet-ganesha(2/2)  https://review.openstack.org/55678906:31
*** dbecker has quit IRC06:32
*** jtomasek has quit IRC06:32
*** ykarel|away has quit IRC06:32
*** udesale_ has quit IRC06:33
AJaegerJeffrey4l: you cannot reuse playbooks, only roles. What are you trying to achieve?06:33
*** kiennt26 has joined #openstack-infra06:34
AJaegerJeffrey4l: migration of jobs from kolla to openstack-zuul-jobs looks strange06:34
Jeffrey4lAJaeger, i added some release jobs in kolla project. but it won't work as expected. corvus told me better migrate the jobs to infra project.06:34
Jeffrey4lcheck http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-03-28.log.html#t2018-03-28T01:12:0406:35
Jeffrey4land http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-03-28.log.html#t2018-03-28T02:41:5806:35
AJaegerJeffrey4l: he said "invocations of the jobs", so just move the job invocation to zuul.d/projects.yaml in project-config.06:37
*** garyk has joined #openstack-infra06:38
AJaegerJeffrey4l: leave the job definition where it is for now - but please double check with corvus06:38
*** pcaruana has joined #openstack-infra06:38
Jeffrey4lok. i will check with corvus, thanks.06:39
*** alexchadin has joined #openstack-infra06:39
prometheanfireAJaeger: we are going to try and get the pbr bump in first, (want emonty/nemec's ack), then we move ahead with the per-project reqs06:39
*** garyk has quit IRC06:40
AJaegerprometheanfire: no pressure from my side ;)06:40
prometheanfireabout to go to bed, but I'll ask this anyway, just ping me with an answer if you have it.  Can storyboard do cross project bugs (one bug, many projects) like launchpad can?06:40
AJaegerprometheanfire: no idea ;(06:41
AJaegerprometheanfire: good night!06:41
prometheanfirenn06:41
AJaegerinfra-root, http://git.openstack.org/cgit/openstack/kolla-cli/tree/ was created and imported - but https://github.com/openstack/kolla-cli is not setup. Hope that heals magically...06:42
*** ihrachys has quit IRC06:43
*** dbecker has joined #openstack-infra06:45
*** dhajare has joined #openstack-infra06:47
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/55715706:51
*** xinliang has quit IRC06:52
*** andreas_s has joined #openstack-infra06:55
*** lpetrut has quit IRC06:58
*** ykarel__ has joined #openstack-infra07:03
*** gongysh has quit IRC07:04
*** xinliang has joined #openstack-infra07:05
*** zhipeng has joined #openstack-infra07:06
*** ykarel_ has quit IRC07:06
*** zhurong has quit IRC07:08
*** jaosorior has joined #openstack-infra07:10
*** gongysh has joined #openstack-infra07:10
*** ianychoi has quit IRC07:10
openstackgerritzhongshengping proposed openstack-infra/project-config master: Prefix the project description with RETIRED for retired projects  https://review.openstack.org/55716607:11
*** ykarel__ is now known as ykarel07:13
*** HeOS has joined #openstack-infra07:14
*** hashar has joined #openstack-infra07:14
*** rcernin has quit IRC07:15
*** aviau has quit IRC07:19
*** aviau has joined #openstack-infra07:19
*** salv-orlando has quit IRC07:22
*** salv-orlando has joined #openstack-infra07:22
*** tosky has joined #openstack-infra07:23
*** yamamoto has joined #openstack-infra07:25
*** caphrim007_ has quit IRC07:25
*** tesseract has joined #openstack-infra07:25
*** caphrim007 has joined #openstack-infra07:26
*** alexchadin has quit IRC07:26
*** salv-orlando has quit IRC07:27
*** electrofelix has joined #openstack-infra07:27
*** garyk has joined #openstack-infra07:27
*** garyk has quit IRC07:28
*** yamamoto has quit IRC07:30
*** pcichy has joined #openstack-infra07:30
*** kiennt26 has quit IRC07:30
*** alexchadin has joined #openstack-infra07:31
fricklerprometheanfire: iiuc the idea is that you can have multiple tasks assigned to a story, those tasks may be attached to different projects, then07:33
*** gfidente has joined #openstack-infra07:36
*** gfidente has joined #openstack-infra07:36
fricklerprometheanfire: stories (the generic term for what lp calls bugs) aren't directly associated to projects at all, only via their tasks07:37
*** shardy has joined #openstack-infra07:38
*** udesale__ is now known as udesale07:43
*** salv-orlando has joined #openstack-infra07:45
*** HeOS has quit IRC07:46
openstackgerritMarkos Chandras (hwoarang) proposed openstack-infra/project-config master: proposal: OSA: Add support for removing files  https://review.openstack.org/55717607:49
*** zhangfei has quit IRC07:51
*** bmace has quit IRC07:51
*** bmace has joined #openstack-infra07:52
*** salv-orlando has quit IRC07:54
*** ralonsoh has joined #openstack-infra07:54
openstackgerritMarkos Chandras (hwoarang) proposed openstack-infra/project-config master: proposal: OSA: Do not sync tests/tests-repo-clone.sh anymore  https://review.openstack.org/55717607:54
*** salv-orlando has joined #openstack-infra07:54
*** lucas-afk is now known as lucasagomes07:56
*** salv-orlando has quit IRC07:59
*** germs has joined #openstack-infra08:03
*** germs has quit IRC08:03
*** germs has joined #openstack-infra08:03
*** arxcruz|rover is now known as arxcruz|off08:03
*** jpich has joined #openstack-infra08:04
*** zhangfei has joined #openstack-infra08:07
*** germs has quit IRC08:08
*** derekh has joined #openstack-infra08:08
*** Hal has joined #openstack-infra08:11
kashyapfungi: Excellent (on the wiki expiration).  Thanks!08:11
*** zhipeng has quit IRC08:16
*** zhipeng has joined #openstack-infra08:16
*** Hal1 has joined #openstack-infra08:17
*** Hal has quit IRC08:19
*** priteau has joined #openstack-infra08:20
*** pcichy has quit IRC08:22
*** gongysh has quit IRC08:23
*** rcernin has joined #openstack-infra08:24
*** iranzo has joined #openstack-infra08:24
*** s-shiono has quit IRC08:26
*** yamamoto has joined #openstack-infra08:26
*** e0ne has joined #openstack-infra08:27
*** yamamoto has quit IRC08:30
*** lihi has quit IRC08:32
*** oanson has quit IRC08:34
*** oanson has joined #openstack-infra08:36
*** lihi has joined #openstack-infra08:39
*** lpetrut has joined #openstack-infra08:40
*** rcernin has quit IRC08:42
*** lpetrut has quit IRC08:47
*** lpetrut has joined #openstack-infra08:47
*** HeOS has joined #openstack-infra08:52
*** alexchadin has quit IRC08:57
*** udesale has quit IRC08:58
*** alexchadin has joined #openstack-infra08:58
*** chenying_ has quit IRC08:59
*** udesale has joined #openstack-infra09:05
*** bhujay has joined #openstack-infra09:10
*** shardy has quit IRC09:10
*** shardy has joined #openstack-infra09:12
*** zhipeng has quit IRC09:22
openstackgerritSlawek Kaplonski proposed openstack-infra/project-config master: Add Fullstack gate failure rate to neutron dashboard  https://review.openstack.org/55726609:23
*** yamamoto has joined #openstack-infra09:27
*** yamamoto has quit IRC09:32
*** alexchadin has quit IRC09:34
*** lpetrut_ has joined #openstack-infra09:41
*** vaidy has joined #openstack-infra09:44
*** dtantsur|afk is now known as dtantsur09:46
*** ykarel is now known as ykarel|afk09:53
*** sree has quit IRC09:56
*** sree has joined #openstack-infra09:57
*** salv-orlando has joined #openstack-infra09:58
*** verdurin has joined #openstack-infra10:01
*** sree has quit IRC10:02
*** adarazs_lunch is now known as adarazs10:03
*** germs has joined #openstack-infra10:03
*** namnh has quit IRC10:03
*** panda|off is now known as panda10:04
*** germs has quit IRC10:08
*** ykarel|afk is now known as ykarel10:09
*** ianychoi has joined #openstack-infra10:15
*** sambetts|afk is now known as sambetts10:18
*** nhandler has quit IRC10:21
*** nhandler has joined #openstack-infra10:23
*** armaan has quit IRC10:28
*** cshastri has quit IRC10:28
*** nhandler has quit IRC10:28
*** sshnaidm has quit IRC10:29
*** yamamoto has joined #openstack-infra10:29
*** nhandler has joined #openstack-infra10:30
*** nhandler has quit IRC10:30
*** nhandler has joined #openstack-infra10:32
*** nhandler has quit IRC10:33
*** nhandler has joined #openstack-infra10:33
*** yamamoto has quit IRC10:34
*** alexchadin has joined #openstack-infra10:35
*** zhangfei has quit IRC10:36
*** sshnaidm has joined #openstack-infra10:38
*** pbourke has quit IRC10:44
*** pbourke has joined #openstack-infra10:45
*** udesale_ has joined #openstack-infra10:46
slaweqandreaf: hi, can You once again take a look at https://review.openstack.org/#/c/552846/? I addresses Your comments there and I want to be sure that it's fine now :)10:48
*** Hal1 has quit IRC10:48
*** udesale has quit IRC10:49
*** udesale_ has quit IRC10:52
*** salv-orl_ has joined #openstack-infra10:53
*** zhurong has joined #openstack-infra10:55
*** zhipeng has joined #openstack-infra10:55
*** sshnaidm has quit IRC10:55
*** salv-orlando has quit IRC10:56
*** gyankum has quit IRC10:56
*** vaidy has quit IRC10:57
*** salv-orlando has joined #openstack-infra10:58
*** salv-orl_ has quit IRC10:58
*** nhandler has quit IRC10:58
*** nhandler has joined #openstack-infra10:59
*** isviridov_away has joined #openstack-infra11:02
*** nhandler has joined #openstack-infra11:03
*** nhandler has quit IRC11:03
*** ykarel_ has joined #openstack-infra11:03
*** dhajare_ has joined #openstack-infra11:03
*** chkumar246 has joined #openstack-infra11:03
*** pgadiya_ has joined #openstack-infra11:03
*** ykarel has quit IRC11:04
*** links has quit IRC11:04
*** chandankumar has quit IRC11:04
*** pgadiya has quit IRC11:04
*** salv-orlando has quit IRC11:05
*** links has joined #openstack-infra11:05
*** ykarel__ has joined #openstack-infra11:05
*** armaan has joined #openstack-infra11:06
*** salv-orlando has joined #openstack-infra11:06
*** dhajare has quit IRC11:07
*** sshnaidm has joined #openstack-infra11:07
*** dhajare_ has quit IRC11:08
*** chkumar246 has quit IRC11:08
*** ykarel_ has quit IRC11:08
*** pgadiya_ has quit IRC11:08
*** nhandler has joined #openstack-infra11:09
*** dave-mccowan has joined #openstack-infra11:09
*** nhandler has quit IRC11:09
*** nhandler has joined #openstack-infra11:10
*** nhandler has quit IRC11:10
*** jtomasek has joined #openstack-infra11:10
*** auristor has quit IRC11:13
*** sree has joined #openstack-infra11:14
*** auristor has joined #openstack-infra11:15
*** nhandler has joined #openstack-infra11:17
*** panda is now known as panda|lunch11:18
*** sree has quit IRC11:19
*** nhandler has joined #openstack-infra11:19
*** nhandler has quit IRC11:19
*** chkumar246 has joined #openstack-infra11:20
*** dhajare_ has joined #openstack-infra11:20
*** nhandler has joined #openstack-infra11:22
*** nhandler has quit IRC11:22
*** nhandler has joined #openstack-infra11:24
*** shardy is now known as shardy_lunch11:24
*** nhandler has joined #openstack-infra11:26
*** nhandler has quit IRC11:26
*** jtomasek has quit IRC11:28
*** sree has joined #openstack-infra11:29
*** yamamoto has joined #openstack-infra11:31
*** dtantsur is now known as dtantsur|brb11:31
*** sree_ has joined #openstack-infra11:32
*** sree_ is now known as Guest4082211:33
*** nhandler has joined #openstack-infra11:33
*** rfolco|off is now known as rfolco|ruck11:34
*** nhandler has quit IRC11:34
*** katkapilatova has joined #openstack-infra11:34
*** katkapilatova has left #openstack-infra11:34
*** yamamoto has quit IRC11:35
*** ldnunes has joined #openstack-infra11:35
*** sree has quit IRC11:35
*** nhandler has joined #openstack-infra11:36
*** nhandler has quit IRC11:36
*** salv-orl_ has joined #openstack-infra11:36
*** nhandler has joined #openstack-infra11:37
*** nhandler has joined #openstack-infra11:40
*** aojea has joined #openstack-infra11:40
*** salv-orlando has quit IRC11:41
*** nhandler has joined #openstack-infra11:41
AJaegerinfra-root, https://docs.openstack.org/infra/publications/ is broken - I don't know what broke the publishing job ;( Any help appreciated.11:42
*** nhandler has joined #openstack-infra11:43
*** nhandler has quit IRC11:43
*** dsariel has quit IRC11:43
*** nhandler has joined #openstack-infra11:45
*** nhandler has quit IRC11:45
*** nhandler has joined #openstack-infra11:46
*** nhandler has quit IRC11:46
*** efried has quit IRC11:47
*** efried has joined #openstack-infra11:48
*** ldnunes has quit IRC11:49
*** ykarel__ is now known as ykarel11:49
*** ldnunes has joined #openstack-infra11:50
*** nhandler has joined #openstack-infra11:53
*** nhandler has quit IRC11:53
*** nhandler has joined #openstack-infra11:54
*** nhandler has quit IRC11:55
*** lucasagomes is now known as lucas-hungry11:55
*** jcoufal has joined #openstack-infra11:56
*** jlabarre has joined #openstack-infra11:58
*** nhandler has joined #openstack-infra11:58
*** nhandler has quit IRC11:58
*** nhandler has joined #openstack-infra12:00
fricklerAJaeger: I'm not sure I understand how all this is going to work. is publish-infra-publications missing the publications-index step? seems the main issue is that the root directory there is missing some index.html, right?12:00
*** nhandler has quit IRC12:00
*** andreas_s has quit IRC12:01
*** udesale has joined #openstack-infra12:02
*** andreas_s_ has joined #openstack-infra12:02
AJaegerfrickler: publish-infra-publications-index should publish the index12:03
*** andreas__ has joined #openstack-infra12:03
*** nhandler has joined #openstack-infra12:04
*** germs has joined #openstack-infra12:04
*** germs has quit IRC12:04
*** germs has joined #openstack-infra12:04
*** rosmaita has joined #openstack-infra12:04
fricklerAJaeger: ah, yes, found that now. that job is failing here http://logs.openstack.org/04/0429cea062756448405f89a12a30a672dfc5f36d/post/publish-infra-publications-index/de10a61/job-output.txt.gz#_2018-03-26_17_46_08_16797612:04
*** rosmaita has quit IRC12:04
*** tpsilva has joined #openstack-infra12:05
AJaegerbut apparently did not - or did wrongly, see the published bindep.txt in that directory12:05
AJaegerfrickler: argh ;( I tested that locally when I pushed the last change.12:06
*** bobh has joined #openstack-infra12:06
AJaegerBut won't have time to look into this since I'm out the next days12:06
*** edmondsw has joined #openstack-infra12:06
*** andreas_s_ has quit IRC12:07
fricklerAJaeger: oh, I think the issue is that ./make-index only exists in the master branch, but that job has the branch from the change checked out, in that case "branch: help-wanted-howto"12:07
openstackgerritAndreas Jaeger proposed openstack-dev/hacking master: Import integration test  https://review.openstack.org/54776512:08
fricklerAJaeger: so we might just need a branch override12:08
AJaegerfrickler: ok12:08
*** nhandler has joined #openstack-infra12:08
*** germs has quit IRC12:08
AJaegerfrickler: cool - but do you know where https://docs.openstack.org/infra/publications/tox.ini comes from? Which job is doing that?12:09
*** dprince has joined #openstack-infra12:09
*** armaan has quit IRC12:09
fricklerAJaeger: http://logs.openstack.org/04/0429cea062756448405f89a12a30a672dfc5f36d/post/publish-infra-publications/5c7abca/job-output.txt.gz#_2018-03-26_17_49_07_72790412:09
AJaegerargh ;(12:10
AJaegerso, http://logs.openstack.org/04/0429cea062756448405f89a12a30a672dfc5f36d/post/publish-infra-publications/5c7abca/job-output.txt.gz#_2018-03-26_17_49_03_987369 moves to one place and we publish from another ;(12:11
*** nhandler has joined #openstack-infra12:12
fricklerAJaeger: no, we do publish exactly the files that got moved I'd say12:12
AJaegerfrickler: indeed, that logic above is broken ;(12:12
fricklerAJaeger: so the issue might rather be that we are moving the wrong files12:12
*** rosmaita has joined #openstack-infra12:12
AJaegeryeah ;(12:12
*** nhandler has joined #openstack-infra12:14
AJaegerfrickler: or a wrong branch published - that might have been publish from master which should not publish anything...12:14
* AJaeger is confused - but has no time to look at it12:14
*** lpetrut_ has quit IRC12:15
fricklerAJaeger: seems to be multiple issues all coming together here. I don't have too much time currently, either, maybe someone else can dig into this later. like dmsimard who has another presentation up for publishing maybe ;)12:17
*** nhandler has joined #openstack-infra12:17
*** nhandler has quit IRC12:17
AJaegerLet's hope ;)12:18
AJaegerfrickler: and I think his presentation is exactly the problem, we published those files verbatim which is wrong.12:19
AJaegerdmsimard: ^12:20
*** odyssey4me has quit IRC12:22
*** odyssey4me has joined #openstack-infra12:22
dmsimardHuh ?12:22
*** nhandler has joined #openstack-infra12:22
*** yamamoto has joined #openstack-infra12:22
*** ramishra has quit IRC12:22
*** zhipeng has quit IRC12:23
fricklerAJaeger: put that one isn't merged yet. https://review.openstack.org/515853 does contain tox.ini and similar files, too, though. that's the last one that got published12:23
fricklers/put/but12:23
*** nhandler has joined #openstack-infra12:23
*** nhandler has quit IRC12:23
dmsimardI'll be able to look in ~15 minutes12:23
AJaegerfrickler: ah - yes. Sorry, dmsimard.12:23
fricklerdmsimard: not urgent, I'd say, seems broken for some time already12:24
*** xarses_ has joined #openstack-infra12:24
*** nhandler_ has joined #openstack-infra12:25
*** ramishra has joined #openstack-infra12:25
*** andreww has quit IRC12:28
*** nhandler_ has quit IRC12:29
fricklerdmsimard: AJaeger: so to aggregate what I see, we have two issues: 1. publish-infra-publications-index needs a branch override "master" 2. ZUUL_REFNAME is not set here https://git.openstack.org/cgit/openstack-infra/project-config/tree/playbooks/publications/run.yaml#n12 , leading to the published docs ending one dir level too high12:30
*** zhurong has quit IRC12:34
*** bobh has quit IRC12:34
*** kgiusti has joined #openstack-infra12:34
AJaegerfrickler: Ah, a legacy variable - we need to pass that in as zuul v3 variable12:34
*** andreas__ has quit IRC12:35
*** andreas_s has joined #openstack-infra12:35
openstackgerritMerged openstack-infra/zuul master: Use requests instead of urllib.request in tests  https://review.openstack.org/55405712:36
*** rlandy has joined #openstack-infra12:37
*** andreas_s has quit IRC12:37
*** andreas_s has joined #openstack-infra12:39
*** nhandler has joined #openstack-infra12:40
*** nhandler_ has joined #openstack-infra12:42
*** chkumar246 is now known as chandankumar12:43
*** nhandler_ has quit IRC12:44
*** dsariel has joined #openstack-infra12:44
*** sshnaidm is now known as sshnaidm|afk12:46
*** olaph has joined #openstack-infra12:52
*** jamesmcarthur has quit IRC12:52
*** jamesmcarthur has joined #openstack-infra12:52
dmsimardmaybe it was the first time we merged something since the v3 migration ?12:52
*** lucas-hungry is now known as lucasagomes12:55
*** panda|lunch is now known as panda12:56
*** salv-orlando has joined #openstack-infra12:56
*** salv-or__ has joined #openstack-infra12:57
*** salv-orl_ has quit IRC12:58
*** trown|brb is now known as trown13:00
*** salv-orlando has quit IRC13:02
*** salv-or__ has quit IRC13:02
*** salv-orlando has joined #openstack-infra13:03
*** lbragstad has joined #openstack-infra13:04
*** mriedem has joined #openstack-infra13:06
*** Goneri has joined #openstack-infra13:06
dhellmannAJaeger : I'll split the patch into 2 steps; one to turn off the job and one to clean up the pieces. We can discuss the 2nd piece in more detail.13:06
*** jamesmcarthur has quit IRC13:07
*** jamesmcarthur has joined #openstack-infra13:08
*** salv-orlando has quit IRC13:08
*** armaan has joined #openstack-infra13:11
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Catch errors in release processing script  https://review.openstack.org/55732513:12
*** ykarel_ has joined #openstack-infra13:12
*** jamesmcarthur has quit IRC13:12
*** ykarel has quit IRC13:12
*** ykarel__ has joined #openstack-infra13:14
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove the propose-update-requirements job  https://review.openstack.org/55542613:14
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove "requirements" mode from propose_update.sh  https://review.openstack.org/55732613:14
*** eharney has joined #openstack-infra13:14
dhellmannAJaeger , prometheanfire : ^^13:15
*** dtantsur|brb is now known as dtantsur13:15
*** ykarel_ has quit IRC13:17
*** gouthamr has joined #openstack-infra13:19
yamamotoAJaeger: https://review.openstack.org/#/c/555788/ is only about master? or stable branches as well?13:21
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: check out the series branch when tagging a release  https://review.openstack.org/55733213:26
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: improve error handling of clone_repo  https://review.openstack.org/55733313:26
dhellmannsmcginnis , ttx: ^^13:26
*** Guest40822 has quit IRC13:27
*** sree has joined #openstack-infra13:28
*** jamesmcarthur has joined #openstack-infra13:28
smcginnisTIL git -C13:28
*** electrofelix has quit IRC13:29
*** zhipeng has joined #openstack-infra13:29
dhellmannconceptually I like the subshell approach better, but *shrug*13:30
*** psachin has quit IRC13:30
ttxdhellmann: are you sure that changes anything ?13:31
*** ykarel__ is now known as ykarel13:31
ttxset -e should catch (true && false) alright13:32
dhellmannttx: the first patch is the one we care about. that should cause it to check out the stable branch for the project13:32
dhellmannthe other one was just a bit of cleanup13:32
dhellmannI can abandon that one if you think it doesn't make any difference13:32
*** udesale has quit IRC13:32
ttxWell it's clearer, so I'll take it13:33
*** sree has quit IRC13:33
ttxbut yeah, that was what I thought was misbehaving until I realized it was working as expected and the fail was elsewhere13:33
*** zhipeng has quit IRC13:33
dhellmannyou had a head start on me :-)13:33
*** alexchadin has quit IRC13:37
*** hashar is now known as hasharAway13:39
*** alexchadin has joined #openstack-infra13:39
*** aojea has quit IRC13:40
*** haleyb has quit IRC13:41
*** nhandler has joined #openstack-infra13:42
*** garyk has joined #openstack-infra13:43
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added get summit location banners endpoint  https://review.openstack.org/55733913:44
openstackgerritMerged openstack-infra/openstackid-resources master: Added get summit location banners endpoint  https://review.openstack.org/55733913:45
*** nhandler has quit IRC13:47
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Fix rewrite rule for multi-tenant deploy  https://review.openstack.org/55734213:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696713:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198713:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594813:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198913:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199213:51
*** kiennt26 has joined #openstack-infra13:52
*** salv-orlando has joined #openstack-infra13:53
*** jamesmcarthur has quit IRC13:54
*** jamesmcarthur has joined #openstack-infra13:55
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Create 'Review-Priority' for designate repos  https://review.openstack.org/29525313:55
*** rosmaita has quit IRC13:55
*** efried has quit IRC13:56
*** efried has joined #openstack-infra13:56
*** jamesmcarthur has quit IRC13:59
*** armaan has quit IRC13:59
*** armaan has joined #openstack-infra14:05
*** zhipeng has joined #openstack-infra14:05
*** udesale has joined #openstack-infra14:05
*** germs has joined #openstack-infra14:05
*** germs has quit IRC14:05
*** germs has joined #openstack-infra14:05
*** udesale has quit IRC14:05
*** dklyle has joined #openstack-infra14:05
*** david-lyle has quit IRC14:05
*** udesale has joined #openstack-infra14:05
*** esberglu has joined #openstack-infra14:05
*** hongbin has joined #openstack-infra14:06
*** jrist has quit IRC14:07
corvusAJaeger, Jeffrey4l: AJaeger's interpretation was correct -- only the invocation needs to move, the job definition can stay in kolla14:07
*** dklyle has quit IRC14:07
*** dklyle has joined #openstack-infra14:07
*** dangers_away is now known as dangers14:08
*** hemna_ has joined #openstack-infra14:08
*** dsariel has quit IRC14:09
*** dsariel has joined #openstack-infra14:09
*** germs has quit IRC14:09
*** dangers is now known as dangers_away14:10
*** dangers_away has quit IRC14:11
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Handle ZK session loss during node launch  https://review.openstack.org/55253814:16
*** VW has joined #openstack-infra14:17
*** florianf has quit IRC14:17
*** VW has quit IRC14:17
*** VW has joined #openstack-infra14:18
*** ykarel has quit IRC14:20
*** _alastor_ has quit IRC14:20
*** alexchadin has quit IRC14:24
*** eernst has joined #openstack-infra14:24
*** florianf has joined #openstack-infra14:24
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Remove nullwrap config option  https://review.openstack.org/55735014:25
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Create 'Review-Priority' for designate repos  https://review.openstack.org/29525314:25
*** jogo has quit IRC14:26
*** zhipeng has quit IRC14:27
*** r-daneel has joined #openstack-infra14:28
*** zhipeng has joined #openstack-infra14:28
*** ralonsoh has quit IRC14:29
*** jamesmcarthur has joined #openstack-infra14:31
AJaegerinfra-root, config-core, I'll be on FTO for a long weekend. I'll be back online end of next week.14:31
corvusAJaeger: is that like pto?14:32
*** r-daneel has quit IRC14:32
fricklergoogle finds https://en.wikipedia.org/wiki/Flextime for me14:32
*** r-daneel has joined #openstack-infra14:33
*** felipemonteiro has joined #openstack-infra14:33
*** jogo has joined #openstack-infra14:33
*** jrist has joined #openstack-infra14:33
*** jrist has quit IRC14:33
*** jrist has joined #openstack-infra14:33
*** ianychoi_ has joined #openstack-infra14:33
AJaegercorvus: yes14:34
*** ianychoi has quit IRC14:36
*** ramishra has quit IRC14:38
pabelangermorning14:41
*** caphrim007 has quit IRC14:42
*** pcichy has joined #openstack-infra14:43
pabelangerconfig-core: clarkb: I think we are ready to add limestone back to nodepool: https://review.openstack.org/557092/14:45
AJaegerpabelanger: +2A14:46
dmsimardpabelanger: did we confirm the ipv4 and dns issues are resolved ? (sorry I haven't been able to focus on it as much as I wanted to)14:46
*** ykarel has joined #openstack-infra14:46
pabelangerdmsimard: yah, ianw did that last night14:46
dmsimardawesome14:46
AJaegerpabelanger: please self-approve second change once ready, just gave +214:47
pabelangerAJaeger: wfm14:47
*** udesale has quit IRC14:50
*** efried has quit IRC14:51
*** efried has joined #openstack-infra14:52
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696714:53
*** shardy_lunch is now known as shardy14:53
*** zoli is now known as zoli|gone14:54
*** zoli|gone is now known as zoli14:54
corvusmordred: should we approve the puppet patches now?14:55
*** sshnaidm|afk is now known as sshnaidm14:57
mordredcorvus: yah - although maybe first let's put zuul.o.o in the emergency file so we can control the rollout14:57
openstackgerritMerged openstack-infra/project-config master: Remove limestone specific labels from nl02.o.o  https://review.openstack.org/55709214:57
mordredcorvus: k. I've put zuul01.openstack.org in the emergency file14:58
*** kevinbenton has quit IRC14:58
*** udesale has joined #openstack-infra14:59
*** gfidente has quit IRC14:59
*** r-daneel has quit IRC15:00
*** gfidente has joined #openstack-infra15:01
*** gfidente has joined #openstack-infra15:01
*** links has quit IRC15:03
*** udesale has quit IRC15:03
*** felipemonteiro_ has joined #openstack-infra15:04
*** kevinbenton has joined #openstack-infra15:06
*** r-daneel has joined #openstack-infra15:07
*** felipemonteiro has quit IRC15:07
*** kiennt26 has quit IRC15:08
*** AJaeger has quit IRC15:08
*** pcaruana has quit IRC15:09
*** gyankum has joined #openstack-infra15:11
*** prometheanfire has quit IRC15:14
*** bhujay has quit IRC15:18
*** agopi|out has joined #openstack-infra15:21
*** pcichy has quit IRC15:22
*** _alastor_ has joined #openstack-infra15:23
*** imacdonn has quit IRC15:26
*** imacdonn has joined #openstack-infra15:27
*** prometheanfire has joined #openstack-infra15:28
*** bobh has joined #openstack-infra15:31
*** zhipeng has quit IRC15:32
*** bobh has quit IRC15:36
openstackgerritMonty Taylor proposed openstack-infra/puppet-zuul master: Apply caching to entire REST API  https://review.openstack.org/55698115:41
mordredcorvus: https://review.openstack.org/#/q/topic:javascript+project:openstack-infra/puppet-zuul wanna check the rest of the puppet patches?15:42
*** bobh has joined #openstack-infra15:43
corvusmordred: on it15:43
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to update category group  https://review.openstack.org/55737815:44
openstackgerritMichel Peterson proposed openstack-infra/project-config master: Add lower-constraints job to networking-odl  https://review.openstack.org/55737915:44
*** sree has joined #openstack-infra15:44
openstackgerritMerged openstack-infra/openstackid-resources master: Added endpoint to update category group  https://review.openstack.org/55737815:45
pabelangerokay, just +3 limestone patch to bring it back online15:47
corvusmordred: i'm confused by 557342 -- what's the rule on line 51 for?15:48
*** bobh has quit IRC15:48
*** sree has quit IRC15:49
*** jamesmcarthur has quit IRC15:50
*** jamesmcarthur has joined #openstack-infra15:50
openstackgerritMichel Peterson proposed openstack-infra/project-config master: Add lower-constraints job to networking-odl  https://review.openstack.org/55737915:50
*** andreas_s has quit IRC15:51
*** andreas_s has joined #openstack-infra15:51
*** armaan has quit IRC15:52
*** rosmaita has joined #openstack-infra15:52
*** bobh has joined #openstack-infra15:53
*** caphrim007 has joined #openstack-infra15:54
*** caphrim007 has quit IRC15:54
*** caphrim007 has joined #openstack-infra15:54
openstackgerritMerged openstack-infra/project-config master: Enable limestone-regione for nodepool.o.o  https://review.openstack.org/55709315:54
*** caphrim007 has quit IRC15:54
*** andreas_s_ has joined #openstack-infra15:55
*** caphrim007 has joined #openstack-infra15:55
Jeffrey4lcorvus, could u define what "invocation" is? how could i do this?15:56
corvusJeffrey4l: i just mean when you add it to the project stanza15:56
*** andreas_s has quit IRC15:56
Jeffrey4lcorvus, is there any example for this?15:57
corvusJeffrey4l: actually -- don't do that yet, i'm not sure that will solve the problem.15:58
Jeffrey4lhm. so no solution right now?15:58
corvusJeffrey4l, clarkb: i think the problem might be that the jobs themselves are branched.  let me think about this a bit more.15:58
*** bobh has quit IRC15:58
Jeffrey4lyeah, thanks.15:59
*** rpioso has joined #openstack-infra15:59
rpiosoIs there a way to specify a range of eavesdrop lines so that they are highlighted in the browser?15:59
*** felipemonteiro_ has quit IRC16:00
*** bobh has joined #openstack-infra16:00
*** andreas_s_ has quit IRC16:00
rpiosoI'm thinking of something along the lines of what GitHub offers, e.g., https://github.com/openstack/ironic/blob/f85eb9ab05abdbfda9659a33117ae27546f3f3ce/ironic/drivers/agent.py#L3-L816:00
pabelangerhttp://grafana.openstack.org/dashboard/db/nodepool-limestone16:01
pabelangerback online16:01
mordredcorvus: it's for serving out the static files for each tenant in the multi-tenant static-offload case16:02
fungirpioso: nope, but if someone wanted to put together a spec for an alternative irc log viewer to host on that server i'd certainly give it consideration16:03
mordredcorvus: to make sure that a request for /t/openstack/status.html serves $docroot/status.html ... the previous version of the line was missing the path segment to handle the tenant name :)16:03
corvusmordred: got it!16:03
*** florianf has quit IRC16:03
rpiosofungi: Thank you!16:03
mordredfungi, rpioso: _should_ be fairly easy to update the existing log writing code to add anchors16:04
*** hasharAway is now known as hashar16:04
fungimordred: anchors which hilighted arbitrary ranges of lines though?16:04
mordredoh - actually - the anchors are already there16:04
*** camunoz has joined #openstack-infra16:04
mordredso really one should be able to do the range highlight by adding a bit of javascript - which would be nice, since we could potentially then backport such a feature to the existing logs16:05
*** bobh has quit IRC16:05
corvusJeffrey4l: are the kolla-publish-* jobs the same on all branches of kolla?16:05
*** gyee has joined #openstack-infra16:06
*** andreas_s has joined #openstack-infra16:06
fungiyep, though there may also be client-side log viewers which could operate on the raw logs we publish and do something nicer with them than the html files generated by meetbot16:06
corvusmordred: i'm +2 on all puppet patches16:07
*** bobh has joined #openstack-infra16:08
*** florianf has joined #openstack-infra16:08
pabelangerlogan-: clarkb: dmsimard: limestone-region is back online for nodepool. Keeping an eye on jobs, but think we are in good shape to increase max-servers later today too16:08
logan-awesome, keeping an eye on logstash.. the first job was a success at least :P16:09
clarkbianw corvus just dropping a note here in case I dont have opportunity to write proper email for a bit. But this is maybe an opportunity to leverage structured logging output? we already emit a json file for each job16:09
*** camunoz has quit IRC16:09
clarkbre logstash and ansible16:09
pabelangerlogan-: nice, have log?16:10
corvusclarkb: yeah, could do16:10
logan-http://logs.openstack.org/41/538341/51/check/openstack-helm-linter/c12201a/job-output.txt16:10
logan-just using logstash query: node_provider:limestone-regionone AND message:"LOOP [upload-logs : gzip console log and json output]"16:10
logan-(i just pick a message that every job generally emits)16:10
*** andreas_s has quit IRC16:10
pabelangeryah16:11
mordredcorvus: sweet16:11
pabelangerlooking at http://logs.openstack.org/41/538341/51/check/openstack-helm-linter/c12201a/zuul-info/inventory.yaml16:11
pabelangerI wonder if we should maybe update nodepool.public_ip to be null, over empty string16:11
pabelangererro16:12
pabelangernodepool.public_ipv416:12
corvusaccording to the graph, limestone occasionally goes to 11.  very spinal tap.  http://grafana.openstack.org/dashboard/db/nodepool-limestone16:12
pabelangercorvus: I think there is a bug in statsd reporting, we only have 10 nodes online16:13
*** lucasagomes is now known as lucas-afk16:13
pabelanger0 ready according to CLI16:13
fungicomes with an 18-inch stonehenge replica16:14
corvuspabelanger: yeah, i suspect it's a sequencing issue16:14
dmsimardthanks everyone for helping get limestone online :)16:14
mordredinfra-root: I'm going to land the puppet-zuul changes- zuul01 is in the emergency file, so doing so should not have any impact16:14
pabelangermordred: ack16:14
fungithanks16:15
mordredpabelanger: if you havea sec, https://review.openstack.org/#/c/557342 is not urgent (it's not relevant for us) but might as well go ahead and land it16:15
mordredfungi: you were looking at apache and caching recently, have a sec to check out https://review.openstack.org/#/c/556981 ?16:16
fungisure16:16
dmsimard#thanks logan- and Limestone Networks for donating cloud resources to the OpenStack CI infrastructure!16:16
openstackstatusdmsimard: Added your thanks to Thanks page (https://wiki.openstack.org/wiki/Thanks)16:16
logan-thank you dmsimard :)16:17
rpiosomordred, fungi: It would be cool if that highlighting could be added. The use case I have in mind is a reference to an IRC discussion in a commit message. Highlighting the range would make it easier for folks to find the relevant content.16:18
*** efoley has joined #openstack-infra16:21
*** isviridov_away has quit IRC16:23
mordredrpioso: ++16:24
*** camunoz has joined #openstack-infra16:24
*** ihrachys has joined #openstack-infra16:25
*** florianf has quit IRC16:26
*** haleyb has joined #openstack-infra16:27
*** efoley has quit IRC16:28
*** efoley has joined #openstack-infra16:28
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to get track group by id  https://review.openstack.org/55742716:28
*** jpich has quit IRC16:29
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove double api prefix from tenants call  https://review.openstack.org/55742916:30
openstackgerritMerged openstack-infra/openstackid-resources master: Added endpoint to get track group by id  https://review.openstack.org/55742716:31
*** olaph has quit IRC16:31
*** olaph has joined #openstack-infra16:31
*** VW_ has joined #openstack-infra16:33
openstackgerritMerged openstack-infra/puppet-zuul master: Split v2 and v3 web config  https://review.openstack.org/55686916:34
*** jamesmcarthur has quit IRC16:35
*** rossella_s has joined #openstack-infra16:36
*** VW__ has joined #openstack-infra16:36
*** VW has quit IRC16:36
*** VW_ has quit IRC16:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198716:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594816:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198916:36
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199216:36
*** ihrachys_ has joined #openstack-infra16:38
*** dsariel has quit IRC16:39
*** yamahata has joined #openstack-infra16:40
*** armaan has joined #openstack-infra16:40
*** ihrachys has quit IRC16:41
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710016:41
openstackgerritMerged openstack-infra/zuul master: Remove nullwrap config option  https://review.openstack.org/55735016:42
*** germs has joined #openstack-infra16:43
*** germs has quit IRC16:43
*** germs has joined #openstack-infra16:43
*** germs has quit IRC16:43
*** germs has joined #openstack-infra16:44
*** germs has quit IRC16:44
*** germs has joined #openstack-infra16:44
*** lpetrut has quit IRC16:45
*** trown is now known as trown|lunch16:46
mordredinfra-root: ok. if nobody has any objections, I'm going to land the zuul change to update the rest api - and the correspnding on puppet-zuul change16:48
mordredzuul01 is still in emergency, so we're not quite to rolling it live yet16:48
corvus++16:48
Jeffrey4lre are the kolla-publish-* jobs the same on all branches of kolla? , these exists on all branches except newton branch.16:49
mordredcorvus: got a sec to hit https://review.openstack.org/#/c/557429 ?16:49
corvusJeffrey4l: right, but are they identical on all the branches?16:49
corvusmordred: done16:50
Jeffrey4lcorvus, hrm ocata branch patch is not backported. so master / queens and pike are the same.16:50
*** kgiusti has left #openstack-infra16:50
*** dsariel has joined #openstack-infra16:51
openstackgerritRaoul Scarazzini proposed openstack-infra/project-config master: Create tripleo-ha-utils project (zuul)  https://review.openstack.org/55659816:51
openstackgerritRaoul Scarazzini proposed openstack-infra/project-config master: Create tripleo-ha-utils project (zuul)  https://review.openstack.org/55659816:53
corvusJeffrey4l: should they be the same on all branches?16:54
Jeffrey4lcorvus, no. newton branch is out of maintain. it should be eol in fact. other branches should be the same.16:55
*** gouthamr has quit IRC16:55
*** VW__ has quit IRC16:56
corvusJeffrey4l: so for all branches+tags where these jobs *should* run, they should always do the same thing.  in other words, you don't want to do publish something on the queens branch differently than master.  is that correct?16:56
mgagnemordred: this change could interest you as it suggests changing the network_data.json in a non-compatible way and I see that glance consumes the "latest" version: https://review.openstack.org/#/c/312626/16:57
mordredmgagne: looking - and thank you16:57
mgagnemordred: and if you could provide input to the pending questions in the commit message, that would be appreciated (as a contributor to glean and consumer of network_data.json)16:57
mgagnemordred: thanks16:57
Jeffrey4lcorvus, i think what i want is just like "push master&tag tarball file into tarballs.o.o site", i am trying to implement push docker images built by kolla on branches and tags to hub.docker.com site.16:58
corvusJeffrey4l: the tarball jobs are branchless, so i think that means the answer to my previous question is 'yes'.16:59
*** tosky has quit IRC16:59
*** r-daneel_ has joined #openstack-infra16:59
Jeffrey4lhow the branch tallball is pushed? doesn't it mean branch? like http://tarballs.openstack.org/nova/nova-stable-queens.tar.gz17:00
corvusJeffrey4l: next question:  does kolla have a repo without any branches?  for example, the tripleo project has a tripleo-ci repo which only has a master branch.  they keep ci tooling in there that is used by all the tripleo projects.  does kolla have anything like that?17:01
Jeffrey4lcorvus, no17:01
*** e0ne has quit IRC17:01
corvusJeffrey4l: yes, the tarball jobs push a tarball based on their branch, but they always do the same thing regardless of what branch is involved.17:01
*** r-daneel has quit IRC17:01
*** r-daneel_ is now known as r-daneel17:01
corvusJeffrey4l: what we need to do is to make your publishing jobs branchless.  there are 3  ways to do this:17:02
Jeffrey4lhm, i get you meaning. in kolla, different branch is different.17:02
mordredfrickler, pabelanger, dmsimard: you may also want to look at https://review.openstack.org/#/c/312626 (although I see frickler already has) - from a glean pov perhaps we should update to using 2017-02-22 instead of latest? it probably wouldnt' be TOO hard to add support for both 2017-02-22 and mgagne's new proposed format17:02
*** VW has joined #openstack-infra17:03
dmsimardwow I remember when mgagne submitted that, it's been a long time :)17:03
mgagnedmsimard: ¯\_(ツ)_/¯17:03
corvusJeffrey4l: 1) move the job definitions into openstack-zuul-jobs.  this is probably the easiest thing to do, but it means you won't have approval rights over the jobs, so changes might be slower.17:03
corvusJeffrey4l: 2) create a new repo, maybe call it kolla-ci to hold the jobs.  You would have approval rights for them, but it's extra work to create a new repo.17:04
*** dsariel has quit IRC17:04
Jeffrey4lwhen migrate the job definitions, i have to move the playbooks(run/post/pre) to openstack-zuul-jobs, right?17:04
*** rkukura has joined #openstack-infra17:04
pabelangeryes, playbooks need to live next to zuul.yaml17:05
corvusJeffrey4l: 3) leave the jobs where they are, but remove them from all branches of kolla except the master branch.  on the definitions in the master branch, set "branches: .*" so those versions run everywhere.  but each time you branch master (ie, stable/s) you'll need to delete the jobs from the new branch.17:05
corvusJeffrey4l: i think any of those options will work.17:05
*** derekh has quit IRC17:07
Jeffrey4lcool. i am thinking the solution 1), may be i can split current jobs, and add a base job in openstack-zuul-jobs used by kolla, which just push the docker image, then this base job are branchless.17:07
openstackgerritMerged openstack-infra/zuul-website master: Update links to git.zuul-ci.org  https://review.openstack.org/55709917:07
*** hashar is now known as hasharDinner17:07
openstackgerritMerged openstack-infra/zuul master: Reorganize REST API and dashboard urls  https://review.openstack.org/55696717:07
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198917:08
*** Swami has joined #openstack-infra17:08
corvusJeffrey4l: ok.  you won't be able to inherit from that job in the kolla repo though (it would have the same problem you're seeing now).  but you can run any of those jobs in the kolla repo (ie, you can add them to the release pipeline there)17:08
*** janki has quit IRC17:09
Jeffrey4lbut my curiosity is: why peroidic jobs in peroidic-release pipeline works. But tag pipeline doesn't.17:09
prometheanfiremordred: mind taking a look at glean? https://review.openstack.org/54860417:09
Jeffrey4lmaybe i should read the zuul code first :)17:09
prometheanfirefrickler: or you, we do seem to be running into eachother in reviews recently17:10
*** dtantsur is now known as dtantsur|afk17:10
corvusJeffrey4l: periodic jobs run with a branch ref (ie, "refs/stable/queens") so they match the branch restrictions in the job definition.  but the release pipeline runs with a tag reference (ie "refs/tags/1.2.3") which won't match that restriction17:11
openstackgerritTobias Henkel proposed openstack-infra/zuul-website master: Fix doc links in menu  https://review.openstack.org/55744217:11
mordredprometheanfire: sure - also - you may want to look at https://review.openstack.org/#/c/312626 as well17:11
corvusJeffrey4l: jobs defined on a repo with branches have an implied branch restriction; option 3 disables that to make them run everywhere.  options 1 and 2 don't have the restriction because they don't define the jobs in a repo with branches.17:12
corvusJeffrey4l: all the details are here: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.branches17:12
Jeffrey4li see. i will try your solutions. thanks a lot corvus17:12
corvusJeffrey4l: you're welcome.  let me know when they're moved17:13
Jeffrey4lyeah17:13
*** sambetts is now known as sambetts|afk17:13
dmsimardJust finished booking Vancouver travel things \o/17:14
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Add non-voting job nodepool-functional-py35-gentoo-src  https://review.openstack.org/55744317:14
prometheanfiremordred: nova spec?17:14
prometheanfireoh, network info17:14
prometheanfiresure17:15
pabelangerprometheanfire: ianw: ^steps needed for non-voting gentoo jobs for glean / diskimage-builder17:15
prometheanfirepabelanger: <317:15
openstackgerritMerged openstack-infra/zuul master: Use git.zuul-ci.org  https://review.openstack.org/55710017:16
prometheanfirepabelanger: does that need this? https://review.openstack.org/55665217:16
prometheanfiremordred: pabelanger one of you mind workflowing?17:16
*** isviridov_away has joined #openstack-infra17:17
*** efoley has quit IRC17:17
pabelangerprometheanfire: mordred: lets see if clarkb wants to review too17:18
prometheanfirewfm17:18
openstackgerritJames E. Blair proposed openstack-infra/nodepool master: Switch docs to alabaster theme  https://review.openstack.org/55744517:18
pabelangerbut we'd need a glean release to pick it up on nodepool.o.o too17:18
prometheanfirepabelanger: ya, was wondering about that17:19
*** dsariel has joined #openstack-infra17:19
openstackgerritMerged openstack-infra/zuul-website master: Fix doc links in menu  https://review.openstack.org/55744217:19
openstackgerritMatthew Thode proposed openstack-infra/project-config master: make Gentoo use the systemd profile  https://review.openstack.org/55665217:20
*** rkukura has quit IRC17:20
* fungi disappears to run some errands but plans to be back in time for the storyboard meeting at 1900z17:22
*** iyamahat has joined #openstack-infra17:22
logan-pabelanger: so far 1 fail out of 9 finished tests (did not check why), but in the job logs it looks like unbound is still using v4 dns. see http://logs.openstack.org/ea/eab921548303d4ecb4d4508bb572316136b06671/post/publish-openstack-puppet-branch-tarball/5b2ddc0/job-output.txt#_2018-03-28_16_55_50_457355, http://logs.openstack.org/42/554142/5/check/openstack-tox-pep8/997b6e1/job-output.txt#_2018-03-28_17_10_18_908823, etc17:22
*** dhajare_ has quit IRC17:23
*** isviridov_away has quit IRC17:23
pabelangerlooking17:25
*** Goneri has quit IRC17:25
pabelangerOh17:26
pabelangerhaha17:26
pabelangerI think I see the issue17:26
*** bhujay has joined #openstack-infra17:27
pabelangerI'm thinking we might want to move validate-host role before configuure-unbound, since validate-host is where we are actually dumping the facts to disk17:28
pabelangerwe can actually test that with base-test17:28
*** yamamoto has quit IRC17:29
*** gouthamr has joined #openstack-infra17:29
*** lpetrut has joined #openstack-infra17:30
prometheanfiredims_: did you mean to +W the req job removal?17:32
*** gouthamr has quit IRC17:32
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Move validate-host before configure-unbound  https://review.openstack.org/55744917:33
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745017:33
pabelangerinfra-root: I'd like to try the following change to base-test to see if that helps with our ipv6 detection issues on limestone17:34
dims_prometheanfire : did not do any reviews today, which one?17:35
*** shardy has quit IRC17:35
*** bhujay has quit IRC17:35
*** tesseract has quit IRC17:35
*** caphrim007_ has joined #openstack-infra17:36
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Create 'Review-Priority' for designate repos  https://review.openstack.org/29525317:37
openstackgerritMatthew Thode proposed openstack-infra/irc-meetings master: Update requirements meeting time  https://review.openstack.org/55745317:38
*** iyamahat has quit IRC17:38
*** yamahata has quit IRC17:38
openstackgerritMerged openstack-infra/project-config master: check out the series branch when tagging a release  https://review.openstack.org/55733217:39
corvuspabelanger: are you proposing we also do this for the base job, or is this just a temporary change to base-test just to debug this one issue?17:39
*** armaan has quit IRC17:39
openstackgerritMerged openstack-infra/project-config master: improve error handling of clone_repo  https://review.openstack.org/55733317:39
openstackgerritMerged openstack-infra/project-config master: Catch errors in release processing script  https://review.openstack.org/55732517:39
openstackgerritMerged openstack-infra/project-config master: Copy initial jobs for fixtures-git from git-upstream  https://review.openstack.org/55621217:39
prometheanfiredims_: meant for dmsimard17:39
*** jamesmcarthur has joined #openstack-infra17:39
dims_:) prometheanfire17:39
prometheanfiredmsimard: did you mean to +W the req job removal?17:39
prometheanfire:D17:39
pabelangercorvus: yah, a temporary change to aid in debugging first17:39
*** Goneri has joined #openstack-infra17:40
dmsimardprometheanfire: which one ? I've been reviewing a lot of changes17:40
*** caphrim007 has quit IRC17:40
dmsimardcorvus: asked a quick question in https://review.openstack.org/#/c/555053/17:40
corvuspabelanger: first?17:41
corvuspabelanger: i'm asking because i don't think we can do that long-term.  validate-host performs dns lookups, so i think we want to keep it where it is normally.  but i'm fine moving it just to help debug this issue.17:42
*** felipemonteiro has joined #openstack-infra17:43
prometheanfiredmsimard: https://review.openstack.org/55542617:43
openstackgerritMerged openstack-infra/project-config master: proposal: OSA: Do not sync tests/tests-repo-clone.sh anymore  https://review.openstack.org/55717617:43
openstackgerritMerged openstack-infra/project-config master: Retire puppet-ganesha(1/2)  https://review.openstack.org/55669617:43
openstackgerritMerged openstack-infra/project-config master: Add Zuul project for kolla-cli  https://review.openstack.org/55589817:43
*** felipemonteiro_ has joined #openstack-infra17:43
openstackgerritMerged openstack-infra/project-config master: Add ansible-role-k8s-rabbitmq to zuul.d  https://review.openstack.org/55268117:43
prometheanfiredmsimard: it's blocked by the depends-on, so is mostly fine17:43
pabelangercorvus: oh, right. I forgot about that. In that case, if debugging session shows ipv6 works when we swap the roles, maybe we need to split out the dns check / facts to disk logic17:43
dmsimardprometheanfire: yeah I always check depends-on, I saw the +2 but when I looked I don't think the -W was there17:44
corvuspabelanger: wait, you think this is going to *fix* the problem?  i thought you were just trying to record the values.17:45
*** dizquierdo has joined #openstack-infra17:45
dmsimardprometheanfire: Ah, yup. I reviewed at 13:29 and the -W was at 13:3317:45
*** yamamoto has joined #openstack-infra17:46
*** VW has quit IRC17:46
prometheanfiredmsimard: ya, I added it just in case someone else came along17:47
logan-pabelanger: would it maybe make sense to run the setup module in the unbound config role with gather_subset '!all,!min,network' to make sure the network facts are fresh17:47
prometheanfiredmsimard: I thought the project-config review was waiting on my +1 :P17:47
*** felipemonteiro has quit IRC17:47
pabelangercorvus: yah, I think it might fix but wanted to test. Our IPV6 logic is trying to use ansible_default_ipv6 varaible, and thinking it might not be loaded into memory at that point. But does when we write out the host-info file. Perhaps something around the usage of smart facts?17:48
dmsimardprometheanfire: okay np, I removed the +W for the time being to be extra safe :)17:48
openstackgerritMatthew Thode proposed openstack-infra/irc-meetings master: Update requirements meeting time  https://review.openstack.org/55745317:49
corvuspabelanger: fascinating17:49
pabelangerlogan-: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/executor/server.py#n1531 is what we do on all hosts at the start, then we dump the variables into fact cache17:49
pabelangerlogan-: we default to smart facts, so I wonder if it is wonky or something17:49
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-cells job definition  https://review.openstack.org/54978617:50
logan-'!all' implies only 'min' subset is collected, which does not include network facts iirc17:50
pabelangerOh17:50
pabelangerlet me check something17:51
logan-http://paste.openstack.org/raw/716327/ vs http://paste.openstack.org/raw/716328/17:51
*** VW has joined #openstack-infra17:51
*** r-daneel_ has joined #openstack-infra17:51
pabelangerlogan-: Ah, so in that case. it think we need to set gather_facts on our pre-run playbook17:52
*** psachin has joined #openstack-infra17:52
pabelangerwe can also test that17:52
*** r-daneel has quit IRC17:53
*** r-daneel_ is now known as r-daneel17:53
*** VW has quit IRC17:53
*** VW has joined #openstack-infra17:54
*** gfidente has quit IRC17:55
pabelangerlogan-:  http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/validate-host/tasks/main.yaml#n1217:55
pabelangerthat is why the variables show up after we check for ipv617:55
logan-ahh17:55
openstackgerritMerged openstack-infra/puppet-zuul master: Support updated REST and HTML layout  https://review.openstack.org/55697317:55
*** trown|lunch is now known as trown17:56
pabelangercorvus: okay, thanks to logan-, think we have a good theory now.  We need to move http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/validate-host/tasks/main.yaml#n12 before our ipv6 checks17:57
pabelangerwhich means https://review.openstack.org/557449/ should work, but isn't long term17:57
*** rossella_s has quit IRC17:57
pabelangerI think we could set gather_facts: true for pre-run playbook, then when it ran again in validate-host, there should be no impact due to fact cache17:58
*** rkukura has joined #openstack-infra17:58
*** vaidy has joined #openstack-infra17:58
*** jmccrory has quit IRC17:59
*** panda is now known as panda|off17:59
*** isviridov_away has joined #openstack-infra17:59
bmacehey folks.  i'm hoping someone can give me a hand.  we recently got the kolla-cli repository set up, based on an existing repo.  there was an issue where the head of master wasn't pointing to the most recent code.  the most recent code is tagged as o3l_4.0.1.  i would like to get master pointing to that same commit but i can't seem to do it through gerrit and don't have permission to do direct git pushes, for understandable reasons.17:59
corvusbmace: what about merging o3l_4.0.1 into master?18:01
bmacei expect i could make a project-config change that would actually give myself push permission, but my expectation is that would be frowned upon.18:01
*** jamesmcarthur has quit IRC18:01
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather facts for all hosts in pre-run  https://review.openstack.org/55745818:02
bmacecorvus: i tried that first, but i wasn't the only committer, and so when i try to post the review gerrit pukes saying i can't post reviews for other people.. and i would rather not sort of just post the code changes, all as me, and lose all that history.18:02
corvusbmace: you should be able to do it as a merge commit18:02
*** lpetrut has quit IRC18:02
pabelangercorvus: logan-: mordred: dmsimard: thoughts on trying^ first to address ipv6 variable issue18:03
corvusbmace: what happens when you 'git merge o3l_4.0.1'; git commit --amend; git review ?18:03
dmsimardpabelanger: why is the setup task that the Zuul executor run not sufficient ?18:03
logan-dmsimard: gather_subset: '!all' doesnt collect network facts18:04
pabelangerdmsimard: see logan-, it doesn't get network variables18:04
bmacecorvus: it gives me a list about 50 commits that would be posted, complains that i am not the only committer related to those changes, and says it won't post the review.18:04
pabelangerand we only use it to validate SSH is working not for getting all facts18:04
dmsimardlogan-, pabelanger: and is there a reason why we don't want to change that ?18:04
pabelangerdmsimard: I don't think we want to use that code to gather facts18:05
dmsimardAll I'm saying is that fact gathering has a cost so we should probably not do that twice if we can help it18:06
corvusbmace: ah, i understand.  best thing to do might be to send an email to openstack-infra@lists.openstack.org with links to the import history and a request that we force-push the tag as master.18:06
bmacecorvus: https://pastebin.com/BXsRUJdP18:06
*** jmccrory has joined #openstack-infra18:06
pabelangerdmsimard: we have a fact cache setup, so won't be an impact18:06
bmacecorvus: sounds good, thanks much!18:06
*** dsariel has quit IRC18:06
dmsimardpabelanger: I'm not sure the cache expiry is granular to the individual facts18:06
dmsimard(but I'd be happy to be pleasantly surprised)18:07
pabelangerdmsimard: we don't expire facts by default18:07
pabelangerdmsimard: would need to be forced, IIRC18:07
dmsimardpabelanger: would need to test it, I'm not sure what's the behavior... :/18:08
pabelangerdmsimard: right, base-test above should get us some information18:08
dmsimardpabelanger: another thing I wonder is that this is /our/ base job -- if we're assuming facts to be available in zuul-jobs, we should maybe run a setup task with the network subset we're interested in ?18:10
pabelangerdmsimard: https://review.openstack.org/#/c/507933/1/zuul/executor/server.py@1667 is some history on network check for zuul18:10
pabelangerdmsimard: well, we do today, just the order if wrong. https://review.openstack.org/557449/ should fix that, but isn't a long term solution as corvus points out18:11
*** yamamoto has quit IRC18:12
*** pblaho has quit IRC18:12
pabelangerso, either gather_facts: yes in playbook or move http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/validate-host/tasks/main.yaml#n12 into another role18:12
pabelangergive that we have fact cache by default, I think validate-host will just noop18:13
dmsimardpabelanger: gather_facts is just an implicit setup task, these two plays are equivalent: https://gist.github.com/dmsimard/f6e754baee79f537147ed22adb2e221718:13
dmsimardpabelanger: what I'm saying is that we could probably run that setup task explicitely where we expect network facts to be available18:14
dmsimardso that way, we're not relying on zuul operators to have a "gather_facts: yes" in their base job pre playbook.18:15
*** lpetrut has joined #openstack-infra18:16
*** psachin has quit IRC18:16
logan-ya thats something i suggested earlier, maybe consider running setup with gather_subset: '!all,!min,network' in the setup unbound role to assert that the network facts the role depends on are always present. i dont know enough about the whole zuul layout to say whether thats the best fix but its certainly one fix :)18:16
pabelangerdmsimard: right, I understand that, and we do today. We just need to do a refactor and move that setup task before configure-unbound. I'm not sure add it into configure-unbound and validate-host is the best18:16
*** yamahata has joined #openstack-infra18:16
*** caphrim007_ has quit IRC18:18
*** caphrim007 has joined #openstack-infra18:18
dmsimardit turns out that gather_facts and setup might behave differently actually.. (discussing in #ansible-devel)18:18
*** e0ne has joined #openstack-infra18:19
*** yamamoto has joined #openstack-infra18:21
*** caphrim007_ has joined #openstack-infra18:24
*** yamamoto has quit IRC18:26
pabelangerHmm, this more I think about it, gather_facts: yes is the default, so setting that in the playbook might not get us the info, we might also need gather_facts: !all,network18:27
pabelangergather_subset*18:27
pabelangerdmsimard: I think you might be right about setup task18:28
*** caphrim007 has quit IRC18:28
*** iranzo has quit IRC18:29
*** caphrim007_ has quit IRC18:30
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745818:30
pabelangerlogan-: dmsimard: ^18:30
*** caphrim007 has joined #openstack-infra18:30
pabelangermaybe you are right, that it should be just done in configue-unbound18:30
pabelangerI'm just concerned about impact to hosts if we run multiple setup tasks18:31
dmsimardI'm still confused and still asking in #ansible-devel :)18:31
pabelangerk18:32
*** rosmaita has quit IRC18:33
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745818:34
dhellmanndmsimard , AJaeger, mnaser , pabelanger , prometheanfire : please, someone approve https://review.openstack.org/555426 before we end up with a bunch of projects with their lower constraints out of sync18:34
dhellmannwaiting for the patches in the requirements repo to land won't help18:34
dhellmannwe need to turn the job off asap18:34
dmsimarddhellmann: the depended-on patch is still -W by prometheanfire18:35
dhellmanngah18:35
mnaseryeah that won't merge :\18:35
dhellmannok, that depends-on is wrong18:35
dhellmannI'm going to remove it18:36
dhellmannwe need the job turned off18:36
dhellmannotherwise we're going to have a bunch of repos that start failing their checks as soon as we do land the requirements repo changes18:36
*** gyankum has quit IRC18:36
logan-lol pabelanger you beat me to it18:36
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove the propose-update-requirements job  https://review.openstack.org/55542618:36
pabelangerlogan-: yah, I should have just had you propose the patch :)18:36
*** yamamoto has joined #openstack-infra18:36
*** dhajare_ has joined #openstack-infra18:37
dhellmanndmsimard , mnaser : the older version of that change, which removed some code, did make sense to block on the requirements patch. That is now split out and I will put the depends-on back on that  patch18:38
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove "requirements" mode from propose_update.sh  https://review.openstack.org/55732618:39
*** jlk has left #openstack-infra18:39
dhellmanndmsimard, mnaser : does what I'm doing make sense? I'm afraid if we keep dragging this out we're going to end up in a bad state18:39
mnaserdhellmann: it does make sense to me, this thing has to be done quickly or otherwise we'll end up with a mess we don't want to deal with18:40
*** gyankum has joined #openstack-infra18:40
dhellmannyes18:40
jokke_o/18:40
jokke_Anyone here who could help me to get a feature branch for glance repo?18:41
dhellmannjokke_ : you can do that via the releases repo18:41
jokke_oh I can? :o18:41
dhellmannthere should be instructions in the readme there18:41
*** yamamoto has quit IRC18:41
dhellmannall branches can be managed through the deliverable files18:41
jokke_nice, is there documentation for that somewhere I have totally missed?18:41
dhellmannreadme.rst18:41
jokke_uuh, nice18:41
dhellmannin the releases repo18:41
jokke_in that case, sorry and thanks18:42
dhellmannif that's not sufficient, let us know so we can improve it, please18:42
*** corvus is now known as kermitf18:42
*** kermitf is now known as corvus18:42
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198718:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594818:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198918:43
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove need for ZUUL_BASE_HREF build time option  https://review.openstack.org/55747218:43
openstackgerritKendall Nelson proposed openstack-infra/storyboard master: Document some usage instructions for a freshly deployed dev instance  https://review.openstack.org/55601818:45
openstackgerritMerged openstack-infra/project-config master: remove the propose-update-requirements job  https://review.openstack.org/55542618:46
fungidhellmann: ^ it should be gone now18:46
dhellmannfungi : thank you18:46
jokke_dhellmann: looking for example from the old deliverables, the branches location section, can that be HEAD, hash or does it need to be tag?18:47
dhellmannjokke_ : feature branches can be a sha; stable branches must be a version number18:47
dhellmannbut you have to be specific about the sha (you can't use HEAD)18:47
jokke_dhellmann: cheers, that info would be nice addition to the readme18:47
*** gyankum has quit IRC18:48
dhellmannjokke_ : lines 514-52618:48
dmsimardpabelanger, logan-: so even #ansible-devel is confused a little bit but my understanding is that the setup task will *always* run regardless of cache and will *always* update the cache18:49
dmsimardand also the caching is not granular, it's an all or nothing deal18:49
dmsimardand that confuses me a little bit because it seems like they just check if the ansible_facts key exists18:49
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Use github3.py >= 1.0.2  https://review.openstack.org/55747518:49
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745818:50
logan-dmsimard: yes thats my understanding as well. running the setup module will always refresh the cache for any facts in the gather_subset scope18:50
pabelangerlogan-: dmsimard: so followed along in #ansible-devel, ^ shoudl fix our ipv6 issue, however http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/validate-host/tasks/main.yaml#n12 is just going to collect them again, missing the fact cache18:50
pabelangerdmsimard: yes, that is how I followed too18:51
openstackgerritJesse Keating proposed openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747818:51
*** yamamoto has joined #openstack-infra18:52
pabelangerdmsimard: so, we likely want to remove http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/roles/validate-host/tasks/main.yaml#n12 make it top-level and default some sane default, then you can use gather_subset: !all,!min,foo to get what has been missed, updating the fact cache for next plays18:52
openstackgerritJesse Keating proposed openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747818:52
dmsimardpabelanger: but it's the subset thing that confuses me18:53
dmsimardoh actually nevermind, my brain just figured it out18:54
*** lpetrut has quit IRC18:54
jokke_dhellmann: ahh ;)18:56
*** yamamoto has quit IRC18:56
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to delete track group  https://review.openstack.org/55748519:02
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745819:03
openstackgerritMerged openstack-infra/openstackid-resources master: Added endpoint to delete track group  https://review.openstack.org/55748519:03
pabelangerdmsimard: so, are you okay with https://review.openstack.org/55745819:04
pabelangeractually19:05
pabelangerlogan-: min doesn't look to work with ansible 2.319:05
dmsimardpabelanger: if we're going to run a setup task in a pre base playbook, we shouldn't run just a subset19:05
dmsimardbecause like I mentioned earlier, it's a full cache overwrite -- it's not granular19:05
dmsimardso if we run just the network facts, we're "deleting" all the other facts19:06
dmsimardat least from my understanding19:06
logan-dmsimard: it only overwrites vars that are collected, existing vars remain set19:06
pabelangeryes19:06
pabelangerthat is how I understood19:06
logan-pabelanger: ah yeah i dont think you can fence out min on old ansibles19:06
dmsimardalso, it's a nit but I'd put pre_tasks before the roles declaration19:06
dmsimardlogan-: are you positive about that ? It seems like it only checks the ansible_facts key, not what's underneath it19:07
dmsimardat least from what I can parse from #ansible-devel19:07
logan-i'm not sure about ansible_facts, only the effects on hostvars19:08
dmsimarddiscussion here: http://paste.openstack.org/show/716372/19:08
logan-gotcha so you're saying the new cached result will only contain the subset19:08
logan-that makes sense i guess19:08
dmsimardI don't know if it makes sense but that seems to be how it works19:10
logan-++19:10
dmsimardI'll ask another question just to make extra sure19:10
*** yamahata has quit IRC19:11
*** yamahata has joined #openstack-infra19:12
pabelangerdmsimard: logan-: no, I don't think it will just save the new fact, is will merge them with facts in memory and write that into cache.19:14
pabelangeratleast that is what I see locally19:14
logan-cool, i wasnt sure on the caching behavior, thats good to know19:15
dhellmannjokke_ : if you join #openstack-release we can talk about the validation error for your branch patch19:16
*** yamamoto has joined #openstack-infra19:17
*** yamamoto has quit IRC19:17
*** dhajare_ has quit IRC19:17
*** sree has joined #openstack-infra19:19
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745819:21
rm_workanyone know if WSME has a channel?19:21
pabelangerconfig-core: could I get a review on ^ as possible solution to our ipv6 dns issue for limestone. I'd like to test this now if possible, other wise I fear we'll need to diable limestone again until we resolve the ipv4 dns issues19:22
*** olaph1 has joined #openstack-infra19:22
*** sree has quit IRC19:23
*** olaph has quit IRC19:24
*** pblaho has joined #openstack-infra19:25
*** esberglu has quit IRC19:25
*** esberglu has joined #openstack-infra19:26
pabelangerlooking into a possible issue with bandersnatch19:27
*** dprince has quit IRC19:27
pabelangerdon't think we are releasing afs volumes properly19:27
*** yamamoto has joined #openstack-infra19:28
tobiashpabelanger: maybe just the index is not synced yet?19:28
*** mat128 has quit IRC19:29
pabelangerlet me check19:29
*** jlk has joined #openstack-infra19:30
jlkpabelanger: tobiash: I wasn't in here, what was the result of discussion over here about github3.py on the mirrors?19:30
*** esberglu has quit IRC19:31
pabelangerjlk: looking into it now19:31
pabelangergrabbing lock on bandersnatch to see what is happening19:31
jlkokay. The recheck hasn't resulted in jobs attempting yet if I'm reading this right.19:31
fungirm_work: their pypi page says they have a mailing list: http://groups.google.com/group/python-wsme19:31
rm_workyes. I hate mailing lists. >_<19:31
jlkZuul tried things at 12:12, but the recheck hit at 12:1919:32
fungirm_work: if there's a wsme-related irc channel, dhellmann will probably know what/where it is19:32
rm_workthat's why I am always in IRC :P19:32
dhellmannthere used to be #wsme19:32
dhellmannit may be empty due to inactivity19:32
jlkoh but you're saying the package should have been there by 12:1219:32
rm_workseems dead, yeah19:32
*** yamamoto has quit IRC19:32
dhellmannrm_work : why don't we move to #openstack-dev to avoid a long unrelated conversation in this channel. That's at least a "general purpose" channel.19:33
rm_workk19:34
pabelangerjlk: tobiash: oh, it doesn't look like we release pypi packages every 5 mins, there is a matrix to decided when to release the volume19:36
pabelangerI didn't know that19:36
tobiashpabelanger: ah ok, so just recheck in a few hours?19:36
jlkTIL19:37
pabelangertobiash: yah, I'll see if I can find out when it should release19:37
*** bobh has quit IRC19:37
pabelangerhttp://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/bandersnatch-mirror-update.sh19:38
pabelangeris the code19:38
*** esberglu has joined #openstack-infra19:38
pabelangerhttps://review.openstack.org/472842/19:38
pabelangerwas the code clarkb added19:38
pabelangerjlk: tobiash: up to 4 hours19:39
jlk:cool:19:39
*** felipemonteiro_ has quit IRC19:40
*** felipemonteiro_ has joined #openstack-infra19:40
pabelanger2018-03-28T17:36:04,479757010+00:00 was the last time19:40
pabelangerwe did a release of the volume19:40
tobiashso the next will be in about two hours19:41
pabelangeris that the last thing for a release?19:41
tobiashno19:41
tobiashit's not time critical19:41
pabelangerokay, cool19:41
pabelanger++19:41
tobiashjust did the math if I'll watch this change merging or going to bed ;)19:42
*** yamamoto has joined #openstack-infra19:43
jlktobiash: I'll try to remember to recheck in a couple hours.19:45
jlk(dropping the channel again)19:45
*** jlk has left #openstack-infra19:45
*** yamamoto has quit IRC19:47
*** yamahata has quit IRC19:48
*** HeOS has quit IRC19:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742919:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745019:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198719:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594819:51
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198919:51
openstackgerritMerged openstack-infra/project-config master: base-test: Gather network facts for all hosts in pre-run  https://review.openstack.org/55745819:52
*** felipemonteiro__ has joined #openstack-infra19:53
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742919:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add build-time configurable status refresh variable  https://review.openstack.org/55745019:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198719:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594819:54
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198919:54
*** olaph has joined #openstack-infra19:55
*** caphrim007_ has joined #openstack-infra19:56
*** olaph1 has quit IRC19:57
*** yamamoto has joined #openstack-infra19:57
*** yamamoto has quit IRC19:57
*** ykarel is now known as ykarel|away19:57
openstackgerritJeremy Stanley proposed openstack-infra/storyboard master: Use charset=utf8mb4 in pymysql DBURIs  https://review.openstack.org/55749819:58
*** felipemonteiro_ has quit IRC19:58
*** tosky has joined #openstack-infra19:58
*** caphrim007 has quit IRC19:59
*** jamesmcarthur has joined #openstack-infra20:00
*** bobh has joined #openstack-infra20:01
prometheanfiredhellmann: do we have a lower-constraints job defined in project-config?  (asking for new tag)20:01
dhellmannprometheanfire : it's in openstack-zuul-jobs and it's called openstack-tox-lower-constraints20:02
prometheanfireah, k20:02
*** caphrim007_ has quit IRC20:03
*** caphrim007 has joined #openstack-infra20:03
*** dizquierdo has quit IRC20:05
openstackgerritMerged openstack-infra/nodepool master: Switch docs to alabaster theme  https://review.openstack.org/55744520:05
*** tosky has quit IRC20:05
*** ykarel|away has quit IRC20:06
*** tosky has joined #openstack-infra20:09
ianwpabelanger: so ... we weren't crazy and actually weren't getting the net info?20:11
pabelangerianw: ya, our base-minimal job doesn't have same path as base20:12
pabelangerso, our testing would likely always work20:12
pabelangerbecause of validate-host20:12
pabelangerI think I have a fix, just testing locally20:13
*** eharney has quit IRC20:13
openstackgerritDoug Hellmann proposed openstack-infra/infra-manual master: update retirement instructions to keep the .gitreview file  https://review.openstack.org/55750220:17
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742920:18
pabelangerianw: Ha, I just reproduced it20:19
pabelangerand I think our fix, actually breaks it more :)20:19
pabelanger1 min20:19
*** HeOS has joined #openstack-infra20:21
pabelangerokay, fix doesn't break it more20:21
pabelangerlet me test in gate now20:22
openstackgerritMerged openstack-infra/zuul master: Clarify location of depends-on footer  https://review.openstack.org/55518520:23
ianwso it's just that the network isn't up at the time we gather facts?  a priori i wonder how we're getting facts without the network up, but i'm sure there's an explaination :)20:25
*** caphrim007 has quit IRC20:26
pabelangerianw: no, it is this setup command, http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/executor/server.py#n153120:26
*** caphrim007 has joined #openstack-infra20:26
pabelangerby default we don't get the network facts, only after validate-host, will we get them because we do another setup20:26
pabelangerwhich right now, happened after configure-unbound in base / base-test20:27
pabelangerbut base-minimal, validate-host is first, then configure-unbound20:27
corvusdhellmann: are we releasing retired projects?20:30
dhellmanncorvus : we're trying to release a version of django_openstack_auth from a stable branch, yes20:31
dhellmannthere is an ongoing discussion in #openstack-release20:32
*** r-daneel_ has joined #openstack-infra20:32
corvusdhellmann: of all the things that we might have foreseen, i'm not going to fault us for not having foreseen that one.  :)20:32
* corvus catches up20:32
*** r-daneel has quit IRC20:33
*** r-daneel_ is now known as r-daneel20:33
dhellmannprometheanfire : one more fix20:34
dhellmannoops, wrong window20:35
fungicorvus: there's some detailed discussion in #openstack-release about this topic20:36
fungiweighing the pros and cons, it seems like the least icky solution for now. otherwise it involves figuring out a different place to be able to grab sufficient metadata to create a gerrit remote20:37
prometheanfirelol20:39
*** nicolasbock has joined #openstack-infra20:39
pabelangerdmsimard: ianw: logan-: gather_subset: !all,network seems broken in 2.3.3.0. It doesn't work as expected locally20:42
pabelangerbut gather_subnet: network does20:43
pabelangerusing ansible 2.4, it works as expected20:43
pabelangerso, I think we are hitting a bug there20:43
corvuspabelanger: what about min,network?20:43
pabelangercorvus: min isn't in 2.320:44
pabelangergather_subset options allowed: all, hardware, ohai, network, virtual, facter20:45
pabelangeris the error I get20:45
openstackgerritPaul Belanger proposed openstack-infra/project-config master: base-test: use gather_subset: network for ansible 2.3  https://review.openstack.org/55750520:45
pabelanger^ is what works locally20:45
*** andreas_s has joined #openstack-infra20:45
pabelangerwith our configure-mirror role20:45
pabelangerand updates fact-cache properly20:46
corvusneat -- what does !all do in 2.3?20:46
pabelangerthat works by itself, but nothing after it seems to work20:46
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:47
*** e0ne has quit IRC20:48
*** andreas_s has quit IRC20:49
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:50
*** tosky has quit IRC20:50
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use reno for release notes  https://review.openstack.org/26259720:52
*** iyamahat has joined #openstack-infra20:52
*** dsariel has joined #openstack-infra20:52
openstackgerritColleen Murphy proposed openstack-infra/zuul-jobs master: Fix ansible-lint job  https://review.openstack.org/55750720:53
pabelangercorvus: http://paste.openstack.org/show/716518/ is the extra data we get into fact cache when using 557505, the diff is what zuul-executor would do by default with setup playbook it first runs20:53
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Add reno releasenotes support  https://review.openstack.org/53686120:53
*** tosky has joined #openstack-infra20:54
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra-puppet-apply jobs to non-legacy  https://review.openstack.org/55701120:54
cmurphycorvus: I think https://review.openstack.org/557507 fixes my problem20:55
*** yamamoto has joined #openstack-infra20:57
corvuscmurphy: lgtm; pabelanger ^20:58
*** yamahata has joined #openstack-infra20:58
*** beisner is now known as beisner-afk20:59
mordredcorvus, cmurphy: lgtm - but I left it open in case pabelanger wanted to lok20:59
pabelanger+321:00
cmurphythanks guys21:00
*** r-daneel_ has joined #openstack-infra21:01
corvuscmurphy: you should be able to go ahead and depends-on that in your other change; i think.21:02
cmurphycorvus: i did :)21:02
*** r-daneel has quit IRC21:03
*** r-daneel_ is now known as r-daneel21:03
*** yamahata has quit IRC21:03
*** yamamoto has quit IRC21:03
*** jamesmcarthur has quit IRC21:03
cmurphythough the depends-on didn't seem to work21:04
*** trown is now known as trown|outtypewww21:08
*** camunoz has quit IRC21:09
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4  https://review.openstack.org/55198721:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use typescript for webpack config  https://review.openstack.org/55594821:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198921:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199221:10
*** jamesmcarthur has joined #openstack-infra21:10
openstackgerritColleen Murphy proposed openstack-infra/zuul-jobs master: Fix ansible-lint job  https://review.openstack.org/55750721:11
*** jamesmcarthur has quit IRC21:12
*** jamesmcarthur has joined #openstack-infra21:12
cmurphyfixed now ^21:12
*** olaph1 has joined #openstack-infra21:16
*** olaph has quit IRC21:16
openstackgerritMerged openstack-infra/zuul master: Improve root api endpoint finding  https://review.openstack.org/55742921:22
*** rlandy is now known as rlandy|brb21:22
*** iyamahat has quit IRC21:22
*** HeOS has quit IRC21:23
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Fix ansible-lint job  https://review.openstack.org/55751421:24
*** yamahata has joined #openstack-infra21:24
pabelangercorvus: dmsimard: mordred: mind a +3 on https://review.openstack.org/557505/ to continue testing ipv6 dns issues21:25
openstackgerritJeremy Stanley proposed openstack-infra/storyboard master: Use charset=utf8mb4 in pymysql DBURIs  https://review.openstack.org/55749821:25
openstackgerritColleen Murphy proposed openstack-infra/puppet-gerrit master: [DNM] Test unlegacied puppet-apply jobs  https://review.openstack.org/55751521:26
*** rfolco|ruck is now known as rfolco|off21:26
*** e0ne has joined #openstack-infra21:29
*** jamesmcarthur has quit IRC21:30
*** HeOS has joined #openstack-infra21:30
*** Goneri has quit IRC21:32
*** jamesmcarthur has joined #openstack-infra21:33
*** jlabarre has quit IRC21:33
openstackgerritMerged openstack-infra/project-config master: base-test: use gather_subset: network for ansible 2.3  https://review.openstack.org/55750521:35
openstackgerritMerged openstack-infra/zuul master: Use latest release of github3.py  https://review.openstack.org/55747821:38
mordredinfra-root: so - who's ready for me to roll out the dashboard patches?21:41
pabelangermordred: I'm able to suport21:42
pabelangersupport*21:42
mordredI'll take either type :)21:42
*** hasharDinner has quit IRC21:42
*** edmondsw has quit IRC21:43
fungimordred: i'm about to replace my monitors, so my availability may be spotty for a bit but i'll try to check in periodically in case something's gone sideways21:43
corvusfungi: if you have a rotating mount, should be easy to fix if they do go sideways21:44
mordred++21:44
*** sree has joined #openstack-infra21:45
fungihah. in fact, i'm mounting them sideways21:45
pabelangerYAY, finally: http://logs.openstack.org/67/549867/1/check/openstack-zuul-jobs-linters/60cb81c/job-output.txt.gz#_2018-03-28_21_43_26_65199121:46
pabelangeripv6 dns setup21:46
fungisame size and resolution as my current panels, just newer, lighter, less power-hungry, a little crisper and less flaky21:46
mordredhow about: #status notice the zuul web dashboard will experience a short downtime as we roll out some changes - no job execution should be affected21:46
mordredpabelanger: yay!21:46
*** pickle has quit IRC21:48
*** rlandy|brb is now known as rlandy21:48
mordredcorvus, pabelanger, fungi: that notice look ok?21:49
corvusmordred: ++21:49
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Promote base-test to bast for ipv6 DNS fixes  https://review.openstack.org/55752221:49
pabelangermordred: ++21:50
mordred#status notice the zuul web dashboard will experience a short downtime as we roll out some changes - no job execution should be affected21:50
openstackstatusmordred: sending notice21:50
fungimordred: lgtm21:50
*** sree has quit IRC21:51
pabelangercorvus: mordred: dmsimard: ianw: clarkb: ^that is our fix to get dns working on properly for IPV6. Thoughts on making that change to base job?21:51
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra-puppet-apply jobs to non-legacy  https://review.openstack.org/55701121:51
-openstackstatus- NOTICE: the zuul web dashboard will experience a short downtime as we roll out some changes - no job execution should be affected21:52
*** pblaho has quit IRC21:53
*** harlowja has joined #openstack-infra21:53
openstackstatusmordred: finished sending notice21:53
mordredok. here we go21:55
*** e0ne has quit IRC21:55
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra-puppet-apply jobs to non-legacy  https://review.openstack.org/55701121:59
*** yamamoto has joined #openstack-infra21:59
mordredinfra-root: can someone help me figure out what's wrong with the apache rewrite rules?21:59
mordredthe zuul-web service has been restarted, the new api routes show up via curls to localhost:9000 ...22:00
mordredbut apache is 404ing everything22:00
fungilooking22:00
*** VW has quit IRC22:01
pabelangersame22:01
pabelangercurl http://127.0.0.1:9000/openstack/ doesn't work for me22:02
mordredOH22:02
mordredit's totally ...22:02
mordredI'm dumb22:02
fungiout of curiosity, why do we still aliasmatch git patterns to /var/lib/zuul/git? i guess that's something we could wrap in a conditional for v2-only in the puppet module22:02
logan-awesome pabelanger :)22:02
clarkbfungi: likely22:03
mordredfungi: we don't - that's why I'm dumb22:03
fungiohhh22:03
mordredI was doing a local puppet apply - and didn't update the puppet-zuul module22:03
fungimakes sense!22:04
*** yamamoto has quit IRC22:04
pabelangerzuul.o.o seems better now22:04
mordredok. backup and working22:04
*** yamahata has quit IRC22:04
mordredand with the new reorganized api22:04
fungimuch better22:05
openstackgerritMerged openstack-infra/project-config master: Add Fullstack gate failure rate to neutron dashboard  https://review.openstack.org/55726622:06
mordredwoot. I think that looks good and we can take zuul out of the emergency file - any dissent?22:06
pabelangerwfm22:10
corvusme too22:11
*** Goneri has joined #openstack-infra22:12
mordredok. zuul01 has been removed from the emergency file22:14
fungigo for it22:14
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Promote base-test to bast for ipv6 DNS fixes  https://review.openstack.org/55752222:15
pabelangerianw: hows^22:15
fungiso... storyboard is running close to (and frequently over) the 30-minute timeout for tox-py27 and tox-py35... should i set variants on those in project-config or put that in a .zuul.yaml in the sb repo?22:16
ianwpabelanger: thanks, i think it's just non-obvious enough that we collect things twice to put that in :)22:17
pabelangerianw: yah22:17
mordredfungi: I tihnk in the storyboard repo22:17
*** bobh has quit IRC22:17
*** eernst has quit IRC22:17
fungicool, i'll give that a shot22:18
mordredfungi: I mean - honestly, I'd argue that for storyboard we could shift all the jobs form project-config into zuul - it's not a project that follows the PTI or anything22:18
mordredgah22:18
mordreds/zuul/storyboard repo/22:18
fungiyup, that's what i'm gonna try22:18
mordredswet22:18
mordredsweet22:19
*** HeOS has quit IRC22:21
pabelangermordred: got time for a quick review on https://review.openstack.org/557522/ comments in line should hopefully explain the fix22:22
*** eernst has joined #openstack-infra22:24
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra-puppet-apply jobs to non-legacy  https://review.openstack.org/55701122:25
tonybpabelanger, fungi: Can we take care of the OpenStackAnsible newton EOL today?22:28
*** rcernin has joined #openstack-infra22:28
mordredpabelanger: lgtm - I left of +A in case you wanted to manage how it lands22:28
*** eernst has quit IRC22:29
pabelangertonyb: yah, I think so, given that we added you before to project bootstrap. Are you ready now?22:31
pabelangermordred: thanks22:31
tonybpabelanger: gimme 5, so I can do one more review ... I like to stay off review.o.o while I'm in bootstrappers ;P22:31
pabelangerianw: do you want to +A https://review.openstack.org/557522/ now and support? otherwise, we can do tomorrow22:32
pabelangertonyb: yah, seems safe22:32
*** esberglu has quit IRC22:32
pabelangerinfra-root: any objections adding tonyb to gerrit project bootstrappers to eol some neuton branches?22:32
clarkbnope22:32
*** priteau has quit IRC22:33
fungiplease do22:33
ianwpabelanger: yeah, i'm happy to watch it22:33
ianwi only have to disappear for a little in a few hours to watch an easter hat parade22:33
*** ldnunes has quit IRC22:33
tonybpabelanger: okay I've +2+W'd that thing I'm good to go when you are22:33
pabelangertonyb: kk22:34
ianwi'm not sure if that is a thing that translates to USA people :)22:34
pabelangertonyb: okay, added tony@bakeyournoodle.com22:34
*** mriedem has quit IRC22:34
pabelanger#status log added tonyb to Group Project Bootstrappers on review.o.o22:34
openstackstatuspabelanger: finished logging22:34
pabelangerianw: thanks22:34
*** priteau has joined #openstack-infra22:35
pabelangerianw: yah, had to google easter hat parade :)22:35
*** mriedem has joined #openstack-infra22:36
*** iyamahat has joined #openstack-infra22:38
*** HeOS has joined #openstack-infra22:38
openstackgerritMerged openstack-infra/project-config master: Promote base-test to bast for ipv6 DNS fixes  https://review.openstack.org/55752222:39
*** priteau has quit IRC22:40
*** iyamahat has quit IRC22:40
pabelangerlogan-: ^22:41
*** iyamahat has joined #openstack-infra22:41
*** felipemonteiro__ has quit IRC22:43
*** tpsilva has quit IRC22:44
tonybOn a slightly related note .... we should do a keysigning (formal ir otherwise) at some point.  It'd be good if the key I'm sigined these EOL tags with had some sigs from OpenStack folks22:45
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5)  https://review.openstack.org/55198922:45
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls  https://review.openstack.org/55199222:45
*** mriedem has quit IRC22:47
*** ansiwen[q] has joined #openstack-infra22:47
tonybHmm ok I just got:22:48
tonyb+ git push gerrit newton-eol22:48
tonybCounting objects: 1, done.22:48
tonybWriting objects: 100% (1/1), 830 bytes | 830.00 KiB/s, done.22:48
tonybTotal 1 (delta 0), reused 0 (delta 0)22:48
tonybremote: Processing changes: refs: 1, done22:48
tonybTo ssh://review.openstack.org:29418/openstack/openstack-ansible-security.git22:48
tonyb ! [remote rejected] newton-eol -> newton-eol (prohibited by Gerrit)22:48
tonyberror: failed to push some refs to 'ssh://tonyb@review.openstack.org:29418/openstack/openstack-ansible-security.git'22:48
openstackgerritmegan guiney proposed openstack-infra/puppet-refstack master: :Upgrade NPM to latest version  https://review.openstack.org/55753922:48
*** jamesmcarthur has quit IRC22:48
*** pblaho has joined #openstack-infra22:48
tonybI'll check gerrit perms but if there's somethign y'all can check on the backend that'd be cool22:49
pabelangertonyb: did I use the right email?22:49
tonybYeah it seems that repo is read-only22:49
ianwi feel like that's the same email i put in last time we did this, and it worked22:50
*** andreww has joined #openstack-infra22:50
tonybpabelanger: I pushed $lots of tags22:50
tonybI think it's specific to that repo being RO ?22:50
pabelangerdid we retire that repo?22:50
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Convert infra-puppet-apply jobs to non-legacy  https://review.openstack.org/55701122:50
tonybpabelanger: checking22:51
pabelangertonyb: yah, looks retired22:51
tonybpabelanger: Yeah.22:51
tonybI guess I'll just ignore that as it's explained and move on?22:52
pabelangerwfm22:52
tonybit's RO so we can't actuially land anything on stable/newton anyway22:52
pabelangeryah22:53
fungisure, likely wouldn't bother eol'ing branches on retired repos22:53
*** xarses_ has quit IRC22:53
tonybOh and that was the last one in the list anyway ;P22:53
tonybfungi: cool.22:53
fungidoesn't seem like there's a lot of point to trying22:53
*** hongbin has quit IRC22:54
tonybI have removed myself from bootstrappers: https://review.openstack.org/#/admin/groups/26,members22:54
tonybpabelanger: Thanks.22:54
fungithough it came up in the release channel a few hours back that the new em plan may actually make it harder to ever fully retire a project if we continue to follow phased retirement where we only retire the repo once all its branches have reached eol22:54
pabelangertonyb: thanks!22:55
pabelanger#status log removed tonyb to Group Project Bootstrappers on review.o.o22:55
openstackstatuspabelanger: finished logging22:55
fungii suppose if a project is retiring maybe that's an opportunity to selectively declare its stable branches eol after some transitional period22:55
tonybfungi: Yeah I guess we 'retire' master (and perhaps other selected branches) but leave the repo Read-Write until the last branch goe -eol?22:57
tonybfungi: which as you say makes it much harder to fully retire a project22:57
fungithat's what we do for things right now which are dependencies of other things (or maybe test dependencies)22:57
fungifor leaf projects we can still just retire them in one shot22:58
tonybfungi: ok, I guess that thing can be a little hard to track as the openstack-ansible-security thing showed22:59
*** pblaho has quit IRC23:00
*** yamamoto has joined #openstack-infra23:00
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Remove rest_api_url from info payload  https://review.openstack.org/55754423:02
*** yamamoto has quit IRC23:06
openstackgerritIan Wienand proposed openstack-infra/system-config master: Fix mariadb sync  https://review.openstack.org/55308523:07
ianwpabelanger: i found fqdn_rand() which i think does what we want for ^23:08
ianwi could also use that to offset all the jobs i guess, rather than https://review.openstack.org/#/c/553894/23:08
*** rlandy has quit IRC23:10
*** beisner-afk is now known as beisner23:14
*** bobh has joined #openstack-infra23:16
*** tosky has quit IRC23:16
*** jamesmcarthur has joined #openstack-infra23:18
ianwclarkb: pre comment many hours ago ... yeah after looking I feel like the deprecation of the multiline filter is probably telling us that we want to consider ingestion of logs longer term, probably to collate things more before it's fed to logstash23:18
clarkbianw: ya and thinking even more about it maybe we ingest all the service logs via systemd files23:19
clarkbsince those are structured23:19
*** iyamahat has quit IRC23:20
*** salv-orlando has quit IRC23:21
ianwclarkb: so basically just run the devstack.journal.xz file in at the end of the test run?23:22
*** Goneri has quit IRC23:22
*** salv-orlando has joined #openstack-infra23:22
*** jamesmcarthur has quit IRC23:22
clarkbya. Woukd need to be tested for feasability but then that should map reasonably well to how people injest logs if using systemd23:23
clarkbat least format wise23:23
clarkbmaybe not line protocol because of our weird back and forth23:23
ianwif you had that, and the job-output.json for each test ... that would cover almost anything?23:23
*** olaph has joined #openstack-infra23:23
clarkbya I think so23:23
ianwit might be possible to have an input on a different port, and feed that the job-output.json?23:25
*** olaph1 has quit IRC23:25
clarkbor just select on some metadata like we already do23:25
clarkbbut ya23:25
ianwyeah, the thing is you can't really select things in an input {} ... afaict23:25
*** caphrim007_ has joined #openstack-infra23:26
*** salv-orlando has quit IRC23:27
*** caphrim007_ has quit IRC23:28
*** caphrim007 has quit IRC23:30
*** gyee has quit IRC23:32
openstackgerritMerged openstack-infra/zuul master: Remove rest_api_url from info payload  https://review.openstack.org/55754423:35
corvusi'm going to kick puppet on zuul01 and restart the scheduler with the tip of master.23:36
corvusi'm also going to restart all the executors and zuul-web23:36
corvusand mergers23:36
corvusthis is a final sanity check before tagging zuul 3.0.023:36
corvusshould we also restart nodepool, or is it up to date?23:36
*** HeOS has quit IRC23:37
clarkbNodepool likely needs a restart too. Did the statsd thing get sorted there?23:39
corvusclarkb: what's the statsd thing?23:39
clarkbcorvus: the same thing we talked about for zuul. Iirc pabelanger got the change in to set the statsd ipv6 config option we were going to revert?23:39
corvusclarkb: that change was reverted23:40
clarkbya asking if we need restart ti check that23:40
corvusah.  looks like the last nl restarts were feb1323:41
corvusso there have been changes since then, but that post-dates those23:41
mordredcorvus: I have to afk - the dinner is ready ... but feel free to go ahead from my end23:44
corvusi will stop nodepool-builders, stop nodepool-launchers, stop zuul-executors, stop zuul-mergers, save queues, stop zuul-scheduler, stop zuul-web.  then start zuul-scheduler, start zuul-mergers, start zuul-executors, start nodepool-launchers, start nodepool-builders, start zuul-web, re-enqueue23:44
*** claudiub has quit IRC23:52
*** rkukura has quit IRC23:53
pabelangeryah, we also need to restart nodepool23:53
pabelanger++23:53
corvuseverything is restarted now; zuul is loading config23:54
*** iyamahat has joined #openstack-infra23:55
corvus#status notice Zuul has been restarted to update to the latest code; existing changes have been re-enqueued, you may need to recheck changes uploaded in the past 10 minutes23:57
openstackstatuscorvus: sending notice23:57
*** rpioso is now known as rpioso|afk23:57
-openstackstatus- NOTICE: Zuul has been restarted to update to the latest code; existing changes have been re-enqueued, you may need to recheck changes uploaded in the past 10 minutes23:58
*** rossella_s has joined #openstack-infra23:58
corvusjobs seem to be running23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!