Wednesday, 2022-03-02

@clarkb:matrix.orgcorvus: question/thought on https://review.opendev.org/c/zuul/zuul/+/830707 too if you have time00:25
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831460: Handle Github branch protection rule webhook events https://review.opendev.org/c/zuul/zuul/+/83146000:37
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: [WIP] Enable mitmproxy between docker/podman to dump test https://review.opendev.org/c/zuul/zuul-registry/+/83113100:45
@jim:acmegating.comClark: thanks, i agree on both points :)00:46
@jim:acmegating.com(but also agree/think that those changes are probably close to their best form for the environment they're in right now)00:47
@clarkb:matrix.orgOk. There were some notes on the parent of 830925 as well. But ya nothing worth a -100:51
@jim:acmegating.comoh missed that!00:58
@jim:acmegating.comClark: ok replied there too, sorry :)01:00
@clarkb:matrix.orgThanks!01:05
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: [WIP] Enable mitmproxy between docker/podman to dump test https://review.opendev.org/c/zuul/zuul-registry/+/83113101:58
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: [WIP] Enable mitmproxy between docker/podman to dump test https://review.opendev.org/c/zuul/zuul-registry/+/83113102:14
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: [WIP] Enable mitmproxy between docker/podman to dump test https://review.opendev.org/c/zuul/zuul-registry/+/83113102:49
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: [WIP] Enable mitmproxy between docker/podman to dump test https://review.opendev.org/c/zuul/zuul-registry/+/83113103:45
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] 831469: ensure-pip: test with install/upgrade of pip https://review.opendev.org/c/zuul/zuul-jobs/+/83146904:08
-@gerrit:opendev.org- Zuul merged on behalf of Dr. Jens Harbott: [zuul/zuul-jobs] 831443: Fix ensure-pip test on Debian Buster https://review.opendev.org/c/zuul/zuul-jobs/+/83144304:17
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-registry] 831131: Enable mitmproxy between docker/podman and tesitng image https://review.opendev.org/c/zuul/zuul-registry/+/83113105:24
-@gerrit:opendev.org- Ian Wienand proposed:05:46
- [zuul/zuul-registry] 831131: Enable mitmproxy between docker/podman and tesitng image https://review.opendev.org/c/zuul/zuul-registry/+/831131
- [zuul/zuul-registry] 831480: tox-py38 : don't run on Fedora https://review.opendev.org/c/zuul/zuul-registry/+/831480
-@gerrit:opendev.org- Zuul merged on behalf of Felix Edel: [zuul/zuul] 830554: Look up worker_zone for log streaming from executor https://review.opendev.org/c/zuul/zuul/+/83055407:14
@iselor:matrix.orgHi All,08:52
I've a question regarding Zuul 5.0.1. Is it possible to have moretha
@iselor:matrix.org * Hi All,08:52
I've a question regarding Zuul 5.0.1. Is it possible to have more than 1 scheduler instance?
@lidaliu:matrix.orgYes it is 09:02
@lidaliu:matrix.orgWe have 4 today09:02
-@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 831495: Update docs to say large installations can need multiple schedulers https://review.opendev.org/c/zuul/zuul/+/83149509:20
-@gerrit:opendev.org- Szymon Datko proposed: [zuul/zuul-jobs] 831423: [ensure-python] Improve check for CentOS/RHEL 9 packages https://review.opendev.org/c/zuul/zuul-jobs/+/83142313:14
-@gerrit:opendev.org- Szymon Datko proposed: [zuul/zuul-jobs] 831423: [ensure-python] Improve check for CentOS/RHEL 9 packages https://review.opendev.org/c/zuul/zuul-jobs/+/83142313:17
-@gerrit:opendev.org- Szymon Datko marked as active: [zuul/zuul-jobs] 831423: [ensure-python] Improve check for CentOS/RHEL 9 packages https://review.opendev.org/c/zuul/zuul-jobs/+/83142313:17
@fungicide:matrix.org> <@iselor:matrix.org> Hi All,13:53
> I've a question regarding Zuul 5.0.1. Is it possible to have more than 1 scheduler instance?
note that 5.0.1 hasn't been released yet, but it's also possible with 5.0.0 (the the recent release). the deployment i help with (zuul.opendev.org) runs two schedulers
@fungicide:matrix.orghttps://zuul.opendev.org/components13:54
@iselor:matrix.orgthanks a lot!14:00
@iselor:matrix.organother question, where should I define admin-rules? 14:01
@iselor:matrix.orgdo I have to specify admin-rule per gerrit repository?14:03
@mhuin:matrix.orgadmin rules apply at tenant level14:03
@fungicide:matrix.orgJakub P.: here's an example: https://opendev.org/openstack/project-config/src/branch/master/zuul/main.yaml#L1-L1914:11
@iselor:matrix.orggreat! thanks a lot!14:11
@fungicide:matrix.orgslightly complicated since it uses yaml anchors in order to avoid us needing to duplicate the same set in each tenant14:11
@fungicide:matrix.orgbut should be enough to give you some idea14:11
@gobi_g:matrix.orgIs there any examples for Prometheus integration? Like what are all the metrics available14:39
@jim:acmegating.comkarthi: the stats are here: https://zuul-ci.org/docs/zuul/latest/monitoring.html#monitoring  you'll need a prometheus statsd exporter14:41
@avass:vassast.orgkarthi: we're using this for example: https://github.com/prometheus/statsd_exporter14:42
@gobi_g:matrix.orgThankyou corvus  Albin Vass 14:44
@gobi_g:matrix.orgDo we need statsd_exporter for https://zuul-ci.org/docs/zuul/latest/monitoring.html#prometheus-monitoring?14:50
@gobi_g:matrix.org* Do we need statsd_exporter for https://zuul-ci.org/docs/zuul/latest/monitoring.html#prometheus-monitoring ?14:51
@jim:acmegating.comkarthi: no that's native prometheus, but only has a few metrics14:51
@jim:acmegating.comyou'll probably want to pull both into your prometheus setup to get a complete picture14:52
@gobi_g:matrix.orgOkay. For native Prometheus port and Prometheus server IP is enough?14:53
@gobi_g:matrix.org* Okay. For native option, Prometheus port and Prometheus server IP is enough?14:54
@gobi_g:matrix.org* Okay. For native option, adding Prometheus port in scheduler section is enough right? We can configure just need to create Prometheus job. Am I right?15:04
@gobi_g:matrix.org* Okay. For native option, adding Prometheus port in scheduler section is enough right? We just need to configure a Prometheus job. Am I right?15:04
@ekapoun1:matrix.orgHello, is there a way to allow cyclic dependencies in Zuul? We realized we can end up in a situation where code in two dependent repos have to depend on each other in order to pass their respective checks/gates in order to merge.15:08
@avass:vassast.orgekapoun1: yep: https://insightevents.se/vehicle-electronics-connected-services/program-detailed/?utm_campaign=unspecified&utm_content=unspecified&utm_medium=email&utm_source=apsis-anp-3&pe_data=D44405D4B71444651407842465A4371%7C3052600015:09
@avass:vassast.org * ekapoun1: yep: https://www.zuul-ci.org/docs/zuul/latest/config/queue.html#attr-queue.allow-circular-dependencies15:09
@ekapoun1:matrix.org> <@avass:vassast.org> ekapoun1: yep: https://www.zuul-ci.org/docs/zuul/latest/config/queue.html#attr-queue.allow-circular-dependencies15:11
Nice, thanks 👍️ I don't remember seeing that attribute on the queue since before :) Is it new?
@avass:vassast.orgekapoun1: Can't remember when it was added tbh but I don't think it's super old. 15:12
@gobi_g:matrix.org> <@gobi_g:matrix.org> Okay. For native option, adding Prometheus port in scheduler section is enough right? We just need to configure a Prometheus job. Am I right?15:13
Albin Vass: any comments on this?
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 830995: Correctly reset failing cycle behind failing item https://review.opendev.org/c/zuul/zuul/+/83099516:43
-@gerrit:opendev.org- Zuul merged on behalf of Dong Zhang: [zuul/zuul] 814437: In github report, using warning emoji for CANCELED job https://review.opendev.org/c/zuul/zuul/+/81443717:31
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831107: Add option to show overall duration in buildset table https://review.opendev.org/c/zuul/zuul/+/83110718:59
@tobias.henkel:matrix.orgtristanC, corvus : I see that there are two ansi related stacks that look similar: 831453 and 775726, should we think about rebasing the logfile size threshold onto the new one?19:07
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831316: Check if job request is still queued before yielding https://review.opendev.org/c/zuul/zuul/+/83131619:08
@jim:acmegating.comtobiash: tristanC sgtm; i +2d the old stack19:12
@jim:acmegating.comi think we could just merge the old stack instead of 831453?19:12
@jim:acmegating.comoh i see it's a little different19:13
@jim:acmegating.comi think all 3 of those changes look good... so... whatever it takes :)19:14
@tobias.henkel:matrix.orgcorvus: there is still a -1 on the start of the old stack though19:18
@tristanc_:matrix.orgok, i'll do the rebase now19:20
@jim:acmegating.comtobiash: thx missed that one.  it's +2 now19:32
@tobias.henkel:matrix.orgcorvus: when looking at the overall duration change result (831107) the first thing that came to my mind was that the table is sorted by duration because the drop down sign looks pretty much the same as in other tables the sign that the table is sorted by that column19:54
@tobias.henkel:matrix.orgI'm not sure if this would confuse some users19:54
@tobias.henkel:matrix.orgbut I also don't have a better idea for that drop down field19:54
@jim:acmegating.comtobiash: thanks, that is a really good point and i didn't see that since i wrote the change.  i think we could change that to a gear... maybe that would help?20:04
@tobias.henkel:matrix.orgI think a gear would work20:05
-@gerrit:opendev.org- Zuul merged on behalf of Tristan Cacqueray: [zuul/zuul] 831450: web: bump re-ansi version https://review.opendev.org/c/zuul/zuul/+/83145020:22
-@gerrit:opendev.org- Zuul merged on behalf of Albin Vass: [zuul/zuul] 831495: Update docs to say large installations can need multiple schedulers https://review.opendev.org/c/zuul/zuul/+/83149520:22
-@gerrit:opendev.org- Tristan Cacqueray proposed:20:25
- [zuul/zuul] 775505: web: render links and ansi escape sequences in console https://review.opendev.org/c/zuul/zuul/+/775505
- [zuul/zuul] 775726: web: disable logfile line rendering when the size exceed a threshold https://review.opendev.org/c/zuul/zuul/+/775726
- [zuul/zuul] 775510: web: add benchmark test for logfile https://review.opendev.org/c/zuul/zuul/+/775510
-@gerrit:opendev.org- Tristan Cacqueray proposed:20:28
- [zuul/zuul] 775505: web: render links and ansi escape sequences in console https://review.opendev.org/c/zuul/zuul/+/775505
- [zuul/zuul] 775726: web: disable logfile line rendering when the size exceed a threshold https://review.opendev.org/c/zuul/zuul/+/775726
- [zuul/zuul] 775510: web: add benchmark test for logfile https://review.opendev.org/c/zuul/zuul/+/775510
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831107: Add option to show overall duration in buildset table https://review.opendev.org/c/zuul/zuul/+/83110720:43
@jim:acmegating.comgear ^20:44
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:20:44
- [zuul/zuul] 831102: Add duration and start time to buildset table https://review.opendev.org/c/zuul/zuul/+/831102
- [zuul/zuul] 831106: Update patternfly-react https://review.opendev.org/c/zuul/zuul/+/831106
- [zuul/zuul] 831107: Add option to show overall duration in buildset table https://review.opendev.org/c/zuul/zuul/+/831107
@jim:acmegating.comrebase ^20:45
@jim:acmegating.comoh hey, if you want to see one of the new features in action, check out the (expected) merge failure message on https://review.opendev.org/83110720:49
@jim:acmegating.comit now says *which* thing failed20:49
@jim:acmegating.comzuul-maint: it would be good if we could get https://review.opendev.org/831240 and https://review.opendev.org/831085 in -- they both fix issues visible in opendev now (neither is critical, but i don't want them to get lost)20:59
@jim:acmegating.comi'd like to upgrade opendev again after those merge20:59
@clarkb:matrix.orgI can review those shortly21:01
@clarkb:matrix.orgcorvus:  for https://review.opendev.org/c/zuul/nodepool/+/831240/1/nodepool/zk.py will nodepool write the requests back out without the created time? Does this value need to go in requestor_data to work around that?21:08
@jim:acmegating.comClark: line 526 in toDict should cause it to be written out21:09
@jim:acmegating.comClark: (that's a change to nodepool to do that, btw, in case you missed that's nodepool and not zuul)21:10
@clarkb:matrix.orgoh yes I did miss that21:10
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 830924: Rename MERGER_FAILURE to MERGE_CONFLICT https://review.opendev.org/c/zuul/zuul/+/83092421:10
@jim:acmegating.comsticking that in requestor data instead would be a fine option; but it felt like something that should be at the top level.  i think the same field does already exist for nodes21:11
@jim:acmegating.com(yes, just double checked that, line 588 for nodes)21:11
@clarkb:matrix.orgya I'm fine with it top level. I just thought it would get eaten bcause I thought I was looking at the zuul side21:12
@jim:acmegating.comyou were right :)21:12
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831609: Add a tenant reconfiguration metric https://review.opendev.org/c/zuul/zuul/+/83160921:49
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 831086: Remove open file limit workaround https://review.opendev.org/c/zuul/zuul/+/83108621:55
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 831240: Retain created_time in node requests https://review.opendev.org/c/zuul/nodepool/+/83124022:08
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 830925: Add MERGE_FAILURE buildset result https://review.opendev.org/c/zuul/zuul/+/83092522:37
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 831609: Add a tenant reconfiguration metric https://review.opendev.org/c/zuul/zuul/+/83160922:38
@iwienand:matrix.orgClark: is it fair to say that the lock/backoff/implementation was basically relying on the parallel uploader not pulling before the upload completed, as so was generically unsafe.  this may have been hidden with a combination of zuul-registry wasn't adding the content-lengths and older clients not verifying lengths either?23:39
@iwienand:matrix.orgthe only other possible thing i can think from reading the api is that you could return a 416 to the other client, with a "last-valid-range" *past* the already uploading chunk, which *might* make it upload the next chunk?  But I don't think that's right, what if the other upload actually fails, and now you don't have that chunk? -- it does seem that all you can do is accept both uploads and then choose one.23:42
@iwienand:matrix.orgthis is wrt to https://review.opendev.org/c/zuul/zuul-registry/+/831235/3/zuul_registry/storage.py for context23:43
@clarkb:matrix.org> <@iwienand:matrix.org> Clark: is it fair to say that the lock/backoff/implementation was basically relying on the parallel uploader not pulling before the upload completed, as so was generically unsafe.  this may have been hidden with a combination of zuul-registry wasn't adding the content-lengths and older clients not verifying lengths either?23:46
Ya I think it's not a pull though it just seems to verify the length immediately after pushing
@clarkb:matrix.org> <@iwienand:matrix.org> the only other possible thing i can think from reading the api is that you could return a 416 to the other client, with a "last-valid-range" *past* the already uploading chunk, which *might* make it upload the next chunk?  But I don't think that's right, what if the other upload actually fails, and now you don't have that chunk? -- it does seem that all you can do is accept both uploads and then choose one.23:47
Ya letting both uploads complete seemed to be safest and that is what I tried to implement

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!