Thursday, 2017-10-26

openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135200:01
SpamapSodd quirk of Github Depends-On's..00:02
SpamapSthey're based not on the commit message, but the description of the PR00:03
SpamapSso I can land things that have no Depends-On, but have Depends-On in the PR.00:03
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Make the git web url a template  https://review.openstack.org/51516800:08
clarkbjeblair: ^ tehre is an attempt and I just realized I ran tox on it but not pep800:08
jeblairi just wrote the words "secret inheritance"00:11
clarkbis that like a secret garden?00:11
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Make the git web url a template  https://review.openstack.org/51516800:11
clarkbsure enough I missed something pep8 didn't like00:11
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135201:03
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524901:03
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: experiment with late-binding inheritance  https://review.openstack.org/51135201:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524901:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Switch to late-binding inheritance  https://review.openstack.org/51135201:48
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524901:48
dmsimardSo ansible 2.4.1 is finally out01:49
dmsimardI've tagged ara 0.14.5rc1, will sanity check it tomorrow and release it -- 2.4.0 is blacklisted01:49
dmsimardmordred, Shrews ^01:50
SpamapSdmsimard: neat03:17
SpamapSjeblair: I trust my name appears in the document in which you wrote "secret inheritance" followed by a large dollar amount or percentage.03:18
*** smyers has quit IRC04:23
*** smyers has joined #zuul04:38
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Switch to late-binding inheritance  https://review.openstack.org/51135204:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524904:49
SpamapSYou know, there's this weird effect having a nice set of nodepool and zuul to iterate patches on...05:05
SpamapSWhen a job takes 10 minutes to run05:05
SpamapSit's long enough to context switch05:05
SpamapSyou git push / git review and then switch tasks for a long time ( longer than 10 minutes )05:06
SpamapSbut when a job is 4 minutes..05:06
SpamapSit's like waiting for the tea kettle.05:06
tobiashyay, configuring branch matching for the noop job in a project pipeline works out of the box :)05:40
*** ruijie has joined #zuul05:51
*** ruijie has left #zuul05:51
openstackgerritMerged openstack-infra/zuul-jobs master: Remove pep8/pyflakes  https://review.openstack.org/51504105:55
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: Test binary data in zuul stream  https://review.openstack.org/51528306:03
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Do late decoding of log stream buffer  https://review.openstack.org/51504306:46
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: Test binary data in zuul stream  https://review.openstack.org/51528306:47
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Do late decoding of log stream buffer  https://review.openstack.org/51504307:00
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: Test binary data in zuul stream  https://review.openstack.org/51528307:23
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic stage-output role  https://review.openstack.org/50923307:25
*** yolanda has joined #zuul07:27
tobiashjamielennox: thanks, I think I found it07:31
tobiashjamielennox: this one rihgt? https://review.openstack.org/#/c/471175/07:31
tobiashwill try that out when I07:32
tobiashwhen I'll dig deeper into github workflows (probably in a few weeks)07:32
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Do late decoding of log stream buffer  https://review.openstack.org/51504307:35
tobiashSpamapS, kklimonda: now with backslashreplace and tests ^07:35
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Default change and patchset to NULL in SQLReporter  https://review.openstack.org/51442307:58
kklimondatobiash: nice - I'll see if I can give it a try today08:01
*** hashar has joined #zuul08:41
*** hashar is now known as hasharAway08:49
*** bhavik1 has joined #zuul09:00
*** smyers has quit IRC09:02
*** electrofelix has joined #zuul09:03
*** bhavik1 has quit IRC09:05
*** smyers has joined #zuul09:14
*** sambetts|afk is now known as sambetts10:09
*** bhavik1 has joined #zuul10:17
*** bhavik1 has quit IRC11:02
*** _ari_ has quit IRC11:38
*** _ari_ has joined #zuul11:43
jkthi there, I'm on Zuul v2, and I'm wondering how can I persuade the zuul merger to also serve git submodules12:32
jktdo I have to somehow include them in Zuul's project dependencies?12:33
*** yolanda has quit IRC13:04
jkthmmmmmm, my submodules are just mirrors of random git repositories from github. I do not have any jobs defined for them; they are really just mirrors13:08
jktreading zuul's source, it seems that it must process some event about a particular project in order to start "merging" it, and that makes sense13:09
jktright, so apparently it's enough to set up a noop job in a pipeline for ref-updated, and ensure that a matching event gets through (such as pushing and removing a throw-away branch)13:42
tobiashjkt: this will only work if you have exactly one merger13:47
tobiashif you have several mergers this will work or not by luck13:47
jkttobiash: because it's random which merger I hit when cloning, right?13:53
tobiashjkt: yes13:53
jktI suppose this is changed in v3, isn't it?13:54
tobiashso they will have different (if any) copies13:54
tobiashsubmodules are currently not really supported13:54
tobiashin v3 you can add the submodule as required project13:54
tobiashthen you can rely on that it's at least there and then you job can put it in the correct place13:55
tobiashs/you job/your job/13:55
jkttobiash: thanks; also, I have just one merger13:56
tobiashjkt: you probably will want to clone it from the merger and update (clone if the merger doesn't have it cached) it from upstream13:58
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Remove unreachable code  https://review.openstack.org/50613714:12
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524914:35
clarkbtobiash: jeblair https://review.openstack.org/#/c/515168/ has been updated and passes tests to use a template string instead of a different config option for all the git hosts15:34
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add implied branch matchers on 'master'  https://review.openstack.org/51445915:53
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Switch to late-binding inheritance  https://review.openstack.org/51135215:54
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524915:54
jeblairclarkb: lgtm +315:57
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Make the git web url a template  https://review.openstack.org/51516816:09
jeblairin my email, i used 'meta' as the config object to use when disabling implicit branch matchers... but i'm thinking 'pragma' might be a better choice?16:19
jeblairit is actually an instruction to the parser on how to treat the content of that file16:20
SpamapSjkt: submodules would be discouraged IMO16:21
SpamapSin all cases16:21
SpamapSjkt: ultimately, submodules are a separate system from git, built in to git.16:22
SpamapSThey're no better than a bash script that checks out a bunch of stuff, IMO.16:23
SpamapSjkt: what I've done with them is just ignore the submodule, and symlink in the zuul managed repo where the submodule would normally be.16:24
SpamapSBut that's just temporary while I get things working.. they'll be factored out eventually16:26
*** bhavik1 has joined #zuul16:33
clarkbjeblair: my only concern with pragma is that they are external to the language in eg C. Implying that different zuul config parsers could implement pragmas differently16:34
clarkbjeblair: but I think something like implicit branch matchers should have consistent behavior (even when overridden?)16:35
clarkbthat may also be overthinking it16:35
jeblairclarkb: in some ways, i feel like this is external to the language a bit.  it instructs the parser to behave differently when it parses the main config16:36
mrhillsmanare public ip addresses for VMs required if I am running Zuul locally16:36
jeblairclarkb: eg https://etherpad.openstack.org/p/pUH31hBvui16:37
jeblairclarkb: it's going to change how those jobs are parsed, because it's in the same file.  but it won't affect how jobs are parsed in other files.  so it doesn't really form a part of the configuration.16:37
jeblairmrhillsman: for the nodepool vms?16:37
mrhillsmanyeah16:38
mrhillsmaninfra page says VMs need public addresses16:38
mrhillsmans/page/peeps16:38
jeblairmrhillsman: the vms need to be accessible from the zuul executor(s) and the nodepool launcher(s)16:38
mrhillsmanok thx16:38
jeblairmrhillsman: aside from that, they don't need to be public, per-se16:38
clarkbsince infra runs on multiple contients in multiple clouds with no relation to each other we need them to be properly public16:39
clarkbwe could work around that but it would require a bit of work16:39
jeblairbut an internal zuul doesn't need that16:39
clarkbright16:39
mrhillsmangot it, figured that was the casr16:39
mrhillsmanthx gentlemen16:41
tobiashSpamapS: I answered on your comment at 51504316:43
tobiashSpamapS: I can move the piggybacked fix to a followup real quick, but testing this could get tricky probably16:44
*** bhavik1 has quit IRC16:49
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: test ansible crash logging  https://review.openstack.org/51547016:56
*** sambetts is now known as sambetts|afk16:58
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: test ansible crash logging  https://review.openstack.org/51547016:59
SpamapStobiash: I think you could leave it as-is17:05
SpamapStobiash: that's why I still +2'd17:05
SpamapStobiash: testing it would likely involve monkeypatching stuff.17:05
tobiashSpamapS: lets see if ^^ can trigger it17:06
tobiashSpamapS: if yes, then that's low hanging fruit and I'll separte this17:06
SpamapSoh yeah fascinating :)17:07
tobiashthe idea is that the shell task kills its python process provoking a not sending of the end tag17:07
tobiashnot sure if this works, but we'll see17:07
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524917:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add pragma directive  https://review.openstack.org/51548317:49
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: test ansible crash logging  https://review.openstack.org/51547017:49
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: remove implied run  https://review.openstack.org/51548717:58
SpamapShrm.. I have 'comment: false' on my success actions and the github driver is still commenting.18:03
tobiashthat sounds like a bug18:05
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Copy Gerrit delay to GitHub driver  https://review.openstack.org/51522418:05
SpamapStobiash: yeah, digging for it now18:06
SpamapSthe code is pretty straight forward, not sure why it is still commenting.18:14
*** electrofelix has quit IRC18:14
*** jkilpatr has joined #zuul18:16
tobiashSpamapS: in the merge path it doesn't consider comment18:17
tobiashah, on merge failure18:17
tobiashthat sounds ok18:18
SpamapSif I'm reading it right, the config for a reporter is passed in when the result happens.18:19
SpamapSeverything else from that config is happening18:19
jlkSpamapS: how do you have it configured in the YAML? Can you post it somewhere?18:28
SpamapSjlk: yeah let me paste18:28
SpamapSjlk: http://paste.openstack.org/show/624742/18:29
jlkinteresting. Yeah, You'll probably have to debug capture it in githubreporter.py18:30
jlkUnless this is a stupid thing where the YAML value of false is not being interpreted as a boolean18:32
jlkit SHOULD, the schema is a bool18:32
jlkSpamapS: does it do it on pending as well?18:38
jlkrather on 'start' ?18:38
SpamapSjlk: no, I only get comments on success and failure18:43
SpamapSand the status URL is correctly set on both18:43
jlkthat's really bizarre. Do you have any other versions of the config in a different branch? When you start up scheduler, it spits out a overall config, what does that show?18:44
SpamapShttp://paste.openstack.org/show/624743/18:45
SpamapSflamel converts yaml to json18:45
SpamapS^^ shows it interprets as false18:45
SpamapSthis is interesting18:46
SpamapS2017-10-26 11:41:54,990 DEBUG zuul.GithubReporter: Reporting change <Change 0x7f64fc007898 144,513e2621a074c805249535430ca816f8d0fab4ab>, params {'status': 'pending', 'comment': False, 'status-url': 'https://zuul.cloud.int.godaddy.com/status/'}, context: GoDaddy/check, state: pending, description: check status: pending, url: https://zuul.cloud.int.godaddy.com/status/18:46
SpamapSpending shows 'comment': False18:46
SpamapS2017-10-26 11:02:58,577 DEBUG zuul.GithubReporter: Reporting change <Change 0x7f64fc0cce80 5,f8a6d40db753e30f0e270ce79dedba17fc906640>, params {'status': 'success', 'status-url': 'https://zuul.cloud.int.godaddy18:47
SpamapS.com:8080/logs/{tenant.name}/{pipeline.name}/{change.project.canonical_name}/{change.number}/{buildset.uuid}/'}, message: Build succeeded.18:47
SpamapSbut 'success' does not show a comment field at all18:47
jlkHUH18:47
SpamapSnor does failure18:47
jlkit's not in self.config18:48
SpamapSit gets defaulted later to True18:49
jlkoh hrm, these loggings are from the individual reporting types18:49
jlkmerge, comment, status, etc.18:49
SpamapSunfortunately, I have to run .. be back in ~9018:49
jlkk18:49
jlkI'm at a loss as to why this would happen, from looking at the code18:52
*** harlowja has quit IRC19:46
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Copy Gerrit delay to GitHub driver  https://review.openstack.org/51522419:56
*** hasharAway has quit IRC19:56
* jlk lunches19:57
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: WIP: Silence ansible-lint  https://review.openstack.org/51552020:28
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: WIP: Silence ansible-lint  https://review.openstack.org/51552020:29
*** jamielennox has quit IRC20:30
*** harlowja has joined #zuul20:33
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: WIP: Silence ansible-lint  https://review.openstack.org/51552020:33
*** jamielennox has joined #zuul20:34
jeblairhi, if folks wanted to start looking at the inheritance changes, i think they're ready for review.  i'm finishing up the implied-run "bonus" change now.  but the others (514459, 511352, 515249, 515483) are ready.20:35
Shrewsjeblair: awesome. plan to dig in on those tomorrow20:37
jeblairShrews: cool.  my hope is to restart with those in place tomorrow, (projects are starting to bump into the issues they fix).  but your tomorrow starts earlier than mine so that should be fine.  :)20:39
*** jamielennox has quit IRC20:54
*** jamielennox has joined #zuul20:55
*** smyers has quit IRC22:04
*** smyers has joined #zuul22:05
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Move test_job_auth_inheritance to test_v3  https://review.openstack.org/51524922:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add pragma directive  https://review.openstack.org/51548322:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove implied run  https://review.openstack.org/51548722:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Support file extension in playbook path  https://review.openstack.org/51553522:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Update test fixtures to use explicit run  https://review.openstack.org/51553622:18
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Validate that a job has a run playbook on freeze  https://review.openstack.org/51553722:31
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Update test fixtures to use explicit run  https://review.openstack.org/51553623:05
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove implied run  https://review.openstack.org/51548723:05
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Validate that a job has a run playbook on freeze  https://review.openstack.org/51553723:05
jeblairthat stack is complete and green23:32
clarkbfriday morning reading?23:32

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!