| *** jamesmcarthur has joined #zuul | 00:00 | |
| *** jamesmcarthur has quit IRC | 00:43 | |
| *** jamesmcarthur has joined #zuul | 00:44 | |
| *** jamesmcarthur has quit IRC | 00:49 | |
| *** jamesmcarthur has joined #zuul | 00:53 | |
| *** jamesmcarthur has quit IRC | 01:15 | |
| *** igordc has quit IRC | 01:24 | |
| *** jamesmcarthur has joined #zuul | 01:43 | |
| *** rfolco|rover has joined #zuul | 02:08 | |
| *** bhavikdbavishi has joined #zuul | 02:12 | |
| *** rfolco|rover has quit IRC | 02:16 | |
| *** bhavikdbavishi has quit IRC | 02:21 | |
| *** bhavikdbavishi has joined #zuul | 03:06 | |
| *** jamesmcarthur has quit IRC | 03:21 | |
| *** jamesmcarthur has joined #zuul | 03:22 | |
| *** jamesmcarthur has quit IRC | 03:27 | |
| *** jamesmcarthur has joined #zuul | 03:39 | |
| *** jamesmcarthur has quit IRC | 03:58 | |
| *** jamesmcarthur has joined #zuul | 03:59 | |
| *** jamesmcarthur has quit IRC | 04:04 | |
| *** jamesmcarthur has joined #zuul | 04:07 | |
| *** jamesmcarthur has quit IRC | 04:40 | |
| AJaeger_ | tristanC, mordred , could you review https://review.opendev.org/#/c/672058/ for promstat, please? | 04:44 |
|---|---|---|
| *** jamesmcarthur has joined #zuul | 05:07 | |
| *** jamesmcarthur has quit IRC | 05:14 | |
| *** jamesmcarthur has joined #zuul | 05:40 | |
| *** jamesmcarthur has quit IRC | 05:44 | |
| *** raukadah is now known as chandankumar | 05:46 | |
| *** AJaeger_ has quit IRC | 05:58 | |
| *** AJaeger has joined #zuul | 06:15 | |
| *** jamesmcarthur has joined #zuul | 06:20 | |
| *** jamesmcarthur has quit IRC | 06:25 | |
| *** saneax has joined #zuul | 06:37 | |
| *** tosky has joined #zuul | 07:16 | |
| *** jamesmcarthur has joined #zuul | 07:21 | |
| *** jamesmcarthur has quit IRC | 07:25 | |
| *** jpena|off is now known as jpena | 07:30 | |
| *** pcaruana has joined #zuul | 07:31 | |
| *** jangutter has joined #zuul | 07:38 | |
| *** arxcruz|off is now known as arxcruz | 07:38 | |
| *** jamesmcarthur has joined #zuul | 07:57 | |
| *** jamesmcarthur has quit IRC | 08:02 | |
| *** yolanda has joined #zuul | 08:42 | |
| *** panda has quit IRC | 08:47 | |
| *** panda has joined #zuul | 08:48 | |
| *** jamesmcarthur has joined #zuul | 08:59 | |
| *** jamesmcarthur has quit IRC | 09:03 | |
| *** bhavikdbavishi has quit IRC | 09:23 | |
| *** altlogbot_3 has quit IRC | 09:24 | |
| *** altlogbot_2 has joined #zuul | 09:26 | |
| *** jamesmcarthur has joined #zuul | 09:38 | |
| *** jamesmcarthur has quit IRC | 09:43 | |
| mordred | AJaeger: done | 09:46 |
| AJaeger | thanks, mordred - and good morning ;) | 10:38 |
| *** jamesmcarthur has joined #zuul | 10:39 | |
| mordred | good morning! | 10:44 |
| *** jamesmcarthur has quit IRC | 10:44 | |
| *** saneax has quit IRC | 10:57 | |
| *** jamesmcarthur has joined #zuul | 11:11 | |
| *** jamesmcarthur has quit IRC | 11:16 | |
| *** jamesmcarthur has joined #zuul | 11:27 | |
| *** jamesmcarthur has quit IRC | 11:36 | |
| *** jamesmcarthur has joined #zuul | 11:37 | |
| *** rfolco|rover has joined #zuul | 11:37 | |
| *** rfolco|rover is now known as rfolco|ruck | 11:37 | |
| *** rfolco|ruck is now known as rfolco|rover | 11:39 | |
| *** saneax has joined #zuul | 11:39 | |
| *** jpena is now known as jpena|lunch | 11:46 | |
| *** saneax has quit IRC | 12:03 | |
| *** jamesmcarthur has quit IRC | 12:05 | |
| *** jpena|lunch is now known as jpena | 12:33 | |
| *** rfolco|rover is now known as rfolco|ruck | 12:47 | |
| *** jamesmcarthur has joined #zuul | 12:49 | |
| *** cixx has joined #zuul | 12:52 | |
| cixx | hi. | 12:52 |
| cixx | why zuul instead of jenkins? | 12:53 |
| AJaeger | cixx: did you read https://zuul-ci.org/ and specially https://zuul-ci.org/media/zuul_solution_brief.pdf ? | 12:59 |
| mordred | corvus: when you're up - it is unclear to me why https://review.opendev.org/#/c/673143 "depends on a change that failed to merge" | 13:05 |
| *** AshBullock has joined #zuul | 13:37 | |
| *** AshBullock has quit IRC | 13:48 | |
| *** jeliu_ has joined #zuul | 14:04 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: use opendev image building system for zuul-operator test https://review.opendev.org/673020 | 14:15 |
| *** panda is now known as panda|brb | 14:19 | |
| *** olaph has joined #zuul | 14:20 | |
| *** michael-beaver has joined #zuul | 14:23 | |
| *** panda|brb is now known as panda | 14:25 | |
| tosky | looking at the fact-subunit-output role, it looks like the name of the output html is hardcoded, which may be a problem if I want to collect multiple subunit files | 14:34 |
| tosky | because regardless of the zuul_work_dir, they are collected in testr_repository.html file which ends up into zuul.executor.log_root | 14:34 |
| tosky | do I read it correctly? How can I handle such scenario? Adding a new parameter to fetch-subunit-output? | 14:35 |
| fungi | that's how i'd do it, yeah. something like have the parameter take a list and default to a singleton of the existing value so it retains backward-compatibility with current uses | 14:37 |
| clarkb | you can also combine subunit files | 14:37 |
| fungi | yep, i guess depending on the use case that might be preferable | 14:38 |
| tosky | I see two possible use cases, but that also depends on how subunit2html parses the subunit file | 14:39 |
| clarkb | mordred: for that error you might need to grep the merger logs for why it failed. I had to do similar for smcginnis last week | 14:39 |
| mordred | clarkb: awesome | 14:40 |
| tosky | a) the specific use case I'm working on is about cinder jobs returning both tempest and cinderlib functional tests; they have different prefixes, so their result can be combined, I could combine the streams | 14:40 |
| *** electrofelix has joined #zuul | 14:40 | |
| pabelanger | remote: https://review.opendev.org/673304 Default zuul tenant to use ansible 2.8 for jobs | 14:40 |
| pabelanger | based on my testing on Friday, I think we can consider doing ^ | 14:40 |
| pabelanger | I wasn't able to see any jobs fail under 2.8, but also unsure if I missed any | 14:41 |
| tosky | b) a not-yet-implemented but useful pattern of running multiple times the same tests with slightly different tempest configurations; in that case maybe the different subunit files should be handled differently to make it easier for humans to parse the results | 14:41 |
| tosky | but let me try a parameter :) | 14:41 |
| clarkb | tosky: subunit does timestamp every test run as will as give them a unique identifier iirc. That means it should be safe to combine runs of the same tests | 14:42 |
| clarkb | they will show up as additional runs of the same tests at different times | 14:42 |
| tosky | oh, I see, interesting | 14:42 |
| tosky | so would it make sense to add a general "merge subunit files, if more are specified" role somewhere in the basic jobs? | 14:43 |
| clarkb | I think so. I want to say the regular tempest jobs already do this because they run tox twice on different sets of jobs | 14:44 |
| clarkb | *different sets of tests. There exists some need for this already | 14:44 |
| tosky | I think that's handled at the tox level | 14:45 |
| tosky | https://opendev.org/openstack/tempest/src/branch/master/tox.ini#L109 | 14:45 |
| clarkb | yes it already does it, but we could bubble that up into the log handling I bet | 14:46 |
| *** jank has joined #zuul | 14:48 | |
| tosky | let's see: what do you think about an additional parameter for fetch-subunit-output which contains a list of additional paths where to look for additional subunit files, and a bunch of tasks to combine them with the main one (under zuul_work_dir)? | 14:50 |
| *** jank has quit IRC | 14:53 | |
| clarkb | I think that would work | 14:54 |
| tosky | ok, let me see if I can produce something that makes sense | 14:55 |
| *** bhavikdbavishi has joined #zuul | 15:04 | |
| *** bhavikdbavishi1 has joined #zuul | 15:07 | |
| tosky | (for the record, subunit2html combines different runs of the same tests together, so they are in the same lines) | 15:08 |
| clarkb | tosky: with different timestamps though right? | 15:08 |
| tosky | yep | 15:09 |
| *** bhavikdbavishi has quit IRC | 15:09 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 15:09 | |
| *** jamesmcarthur has quit IRC | 15:16 | |
| *** jamesmcarthur_ has joined #zuul | 15:16 | |
| *** bhavikdbavishi has quit IRC | 15:37 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Don't try to push images when the build failed https://review.opendev.org/673147 | 15:38 |
| *** mattw4 has joined #zuul | 15:50 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: use opendev image building system for zuul-operator test https://review.opendev.org/673020 | 15:51 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Use human-readable names for artifact returns https://review.opendev.org/672382 | 16:06 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Remove download_artifact_name parameter https://review.opendev.org/673327 | 16:06 |
| *** mattw4 has quit IRC | 16:12 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Download-artifact: use the artifact type rather than name https://review.opendev.org/672557 | 16:14 |
| *** AshBullock has joined #zuul | 16:16 | |
| AshBullock | Hey guys, I've seen this change https://review.opendev.org/#/c/578557/ Was wondering what the status of getting merged is, we have a use case where we need to trigger based on a tag to master ref, so this would solve this for us | 16:19 |
| corvus | mhu: sorry, caught one more thing on https://review.opendev.org/636315 | 16:20 |
| mhu | corvus, no worries at all, it's for the greater good! | 16:21 |
| openstackgerrit | James E. Blair proposed zuul/zuul-operator master: DNM: test images https://review.opendev.org/673333 | 16:26 |
| fungi | AshBullock: i think we were mostly looking for more feedback from zuul users on whether or not they considered it a good idea (seeing as how it's basically papering over inconvenient realities of git's data model for the sake of convenience) | 16:29 |
| *** jangutter has quit IRC | 16:31 | |
| *** armstrongs has joined #zuul | 16:38 | |
| *** mattw4 has joined #zuul | 16:40 | |
| armstrongs | yeah at the moment we see that the tag regex works if you have 1 master branch as the tag is always on master. If you have multiple branches then it doesn't work as the git event can be against any branch and it won't match the tag regex specified. So in the current state it looks like zuul has the issue to users as the functionality works with 1 b | 16:41 |
| armstrongs | ranch bt fails with multiple branches. So it appears to work for a period then stop working | 16:42 |
| *** jpena is now known as jpena|off | 16:42 | |
| fungi | the other gotcha is that tags aren't required to reference a commit on any branch at all | 16:43 |
| fungi | the assumption with that change is that corner cases like that can just be documented as undefined behaviors | 16:44 |
| fungi | same with the choice to just pick a branch based on some heuristic if the tag corresponds to a commit present in multiple branch histories | 16:44 |
| armstrongs | yeah so when we match against ref: ^refs/tags/.*$ on push it won't trigger currently unless that event is specifically on master. Could we wildcard in some way the branch so it triggers on any tag the latest master ref? | 16:50 |
| armstrongs | as the issue is we cant invoke an event against master on a new tag. That would be solved by having a branch agnostic trigger mechanism that just watches for tags against * (wildcard) branch and then triggers an action. | 16:54 |
| clarkb | if you dont specify a branch it should run the job against all tags | 16:57 |
| clarkb | then the job can decideif actions need to be taken | 16:57 |
| armstrongs | im not seeing that behaviour | 16:57 |
| *** AshBullock has quit IRC | 16:57 | |
| clarkb | pretty surethat is how all the openstack release jobs work | 16:58 |
| clarkb | maybe the job has to be listedin a branchless repo for that? | 16:58 |
| fungi | it may also be a behavior difference between how tag ref events are emitted by github vs gerrit? | 16:59 |
| fungi | but yeah, we run jobs on tags pushed for commits not present on master branches in opendev all the time | 16:59 |
| armstrongs | http://paste.openstack.org/show/755082/ | 16:59 |
| *** igordc has joined #zuul | 16:59 | |
| fungi | it's a primary workflow for many of our projects (stable point release tags on stable maintenance branches) | 17:00 |
| armstrongs | that at the moment only triggers when you have 1 master branch. But doesnt trigger when you have multiple | 17:00 |
| armstrongs | so my thought was on the push event that defaults somehow to master | 17:01 |
| *** hwangbo has joined #zuul | 17:01 | |
| armstrongs | as it seems it is filtering out other branches and the events look like they are against them | 17:01 |
| fungi | this pipeline triggers builds for us on any tag regardless of the branch for which it was pushed: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/pipelines.yaml#L217-L234 | 17:01 |
| armstrongs | yup you guys sent that example and i used it for reference so it was working great with 1 master branch. When you create feature branches it stops working. | 17:03 |
| fungi | i'm not sure what you mean by "multiple master branches" though (git shouldn't allow more than one branch with the same name on the same remote) | 17:03 |
| armstrongs | i meant multiple branches on the repo | 17:03 |
| fungi | ahh | 17:03 |
| armstrongs | so master and say a new branch called test | 17:03 |
| fungi | yeah, i wonder if this is a problem with the github connection driver | 17:03 |
| armstrongs | so the event looks like the tag event comes through with test in the path and then it looks like it isn't firing. | 17:05 |
| fungi | does the job definition include any sort of explicit branch matcher? | 17:05 |
| armstrongs | nah i tried with and without made no difference | 17:06 |
| clarkb | is the job listed in a branched repo? | 17:07 |
| clarkb | could be the implicit matchers aren't doing what we want | 17:07 |
| armstrongs | so the "test" branch is branched from "master" and they have the same zuul.yaml and same jobs if thats what you mean. However, the branch is just using a PR event with associated jobs. While master is triggering on a push. | 17:09 |
| armstrongs | based on tag regex i pasted above | 17:10 |
| clarkb | ya maybe move the job and its pipeline config into a config repo that doesn't have branches and see if that changes the behavior? | 17:11 |
| clarkb | all of the openstack release jobs are in a config repo with only a master branch | 17:11 |
| clarkb | (maybe for this reason?) | 17:11 |
| *** armstrongs has quit IRC | 17:12 | |
| *** armstrongs has joined #zuul | 17:12 | |
| armstrongs | yeah it works with 1 branch but i need the repo to be able to support a master build based on a tag pushed to repo and also support PR jobs too | 17:13 |
| armstrongs | which is our current issue | 17:14 |
| clarkb | right if the job config lives in a config repo that only has master branch then you can apply that to all the events from whichever branch or tag on the other repo? | 17:14 |
| armstrongs | the config job has only 1 branch. I meant the untrusted project has 2 pipelines 1 for push based on tag regex and another for PR events against a branch. That untrusted project has a number of branches not just 1. The push pipeline with tag regex works when we have 1 branch on the untrusted project. When you go to 2 branches the push event doesnt f | 17:22 |
| armstrongs | ire. | 17:22 |
| fungi | yeah, so this is sounding more and more like it could be a behavior difference between gerrit ref-updated events and github push events | 17:23 |
| armstrongs | indeed | 17:23 |
| fungi | because you've basically described precisely what we're doing in opendev with gerrit and it's been working there | 17:23 |
| *** jamesmcarthur_ has quit IRC | 17:24 | |
| AJaeger | armstrongs: see https://docs.openstack.org/infra/manual/creators.html#central-config-exceptions - we leave the tag job configuration on purpose in a central branchless | 17:26 |
| AJaeger | repository | 17:27 |
| armstrongs | sorry i may be being slow so you are saying my push jobs should be defined in the zuul.d/projects.yaml in the config repository and dont put them on the .zuul.yaml on my untrusted project and that will make the difference? | 17:41 |
| *** armstrongs has quit IRC | 17:47 | |
| fungi | unfortunately https://review.openstack.org/571520 which introduced that guidance didn't come with any accompanying rationale to indicate whether tag jobs should have their pipline additions in a config repo for workflow/policy reasons or because of how zuul interprets them | 17:52 |
| fungi | clarkb: you were the author of that ^ change, perhaps you remember? | 17:52 |
| *** armstrongs has joined #zuul | 17:54 | |
| fungi | i know we have plenty of projects in opendev adding jobs to tag-based pipelines within their own untrusted repos, but i don't know whether any of them tag on more than just a master branch | 17:54 |
| clarkb | fungi: it needs to be a branchless repo iirc | 17:56 |
| clarkb | and our branchless repo happens to be a config repo too | 17:56 |
| *** armstrongs has quit IRC | 17:59 | |
| *** electrofelix has quit IRC | 18:06 | |
| *** jamesmcarthur has joined #zuul | 18:12 | |
| *** jamesmcarthur has quit IRC | 18:52 | |
| *** jamesmcarthur has joined #zuul | 19:04 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-jobs master: Add auth config to kubelet user for buildset registries https://review.opendev.org/673351 | 19:07 |
| *** jamesmcarthur has quit IRC | 19:54 | |
| *** jamesmcarthur has joined #zuul | 19:58 | |
| *** jamesmcarthur has quit IRC | 20:03 | |
| openstackgerrit | Jeff Liu proposed zuul/zuul-jobs master: Add auth config to kubelet user for buildset registries https://review.opendev.org/673351 | 20:06 |
| corvus | mordred: the whole js log series is green if you want to review the last 4 changes (673105 is the tail) | 20:17 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: WIP: Allow ensure-tox to upgrade tox version https://review.opendev.org/672760 | 20:17 |
| openstackgerrit | Jeff Liu proposed zuul/zuul-operator master: use opendev image building system for zuul-operator test https://review.opendev.org/673020 | 20:23 |
| *** jamesmcarthur has joined #zuul | 20:25 | |
| *** jamesmcarthur has quit IRC | 20:31 | |
| *** armstrongs has joined #zuul | 20:37 | |
| mordred | corvus: woot! | 20:41 |
| *** armstrongs has quit IRC | 20:43 | |
| *** jamesmcarthur has joined #zuul | 20:59 | |
| clarkb | corvus: at the base of that js stack you've got some js that returns action types to reducers. That all seems fine except you've also got jsx that seems to do overlapping work for rendering log dir trees. I'm mostly lost in what the tie in between the two sides is (and why they aren't redundant) | 21:01 |
| clarkb | particularly for the manifest stuff | 21:01 |
| clarkb | I think for the logfile stuff that is largely js | 21:01 |
| corvus | they are *slightly* redundant -- | 21:02 |
| corvus | basically the action -> reducer part takes the json data structure from zuul and converts it into 2 data structures -- one is a hash of filename -> node info (so that when we hit a render url, we can look up the mimetype quickly). the other produces a tree that is very similar to what we get from zuul, but it uses 'nodes' instead of 'children', because that's what the TreeView wants. | 21:03 |
| *** jamesmcarthur has quit IRC | 21:03 | |
| corvus | clarkb: on the jsx side, we walk the 'nodes' tree and replace the 'text' attribute with some jsx objects so that it's more than just a string, it's a link (and in a later change, several links and an icon) | 21:04 |
| corvus | the reason i don't just do that in the actions file is that it isn't a jsx file | 21:04 |
| corvus | (and i don't think i should turn it into one) | 21:04 |
| corvus | so basically, i do as much conversion to the forms we're going to use later as early as possible, but then there's that last bit of adding in some html entities at the end. | 21:05 |
| corvus | honestly, if TreeView were a better implementation, i wouldn't be putting the UI elements into that data structure. but it is what it is. so given that, at least that only happens right there with the rest of the ui generation code. | 21:06 |
| clarkb | out of curioustiy why not do the conversions entirely in jsx? | 21:08 |
| fungi | if anybody has time to review 673353 (dns) and 673355 (system-config) changes, i can load data onto the last replacement gitea servers this afternoon | 21:09 |
| corvus | i wanted the index generation done only once, ahead of time, so that lookups of direct file urls are fast. had to walk the tree for that anyway, may as well do any other structural changes there. | 21:09 |
| corvus | (and i think i'm subconciously hoping that we replace treeview with something that doesn't need the weird jsx thing at the end) | 21:10 |
| fungi | d'oh, sorry, wrong channel | 21:11 |
| corvus | however, setting that aside, we could move some of the stuff in actions to the view; but we'd still be walking the tree both places, so it's sort of six-of-one. | 21:11 |
| openstackgerrit | Jeff Liu proposed zuul/zuul-jobs master: Add auth config to kubelet user for buildset registries https://review.opendev.org/673351 | 21:13 |
| clarkb | corvus: couple of notes on https://review.opendev.org/#/c/672839/3 | 21:31 |
| corvus | clarkb: replied | 21:33 |
| corvus | (the lack of named groups made me grumpy, but i got over it. in later versions of JS, that feature is there, but i didn't want to work out whether we could rely on it yet) | 21:34 |
| clarkb | oh ya that is too bad | 21:35 |
| *** jeliu_ has quit IRC | 21:37 | |
| mordred | corvus: yes, I believe we can - it's in es2018 which also is where ... syntax is found, which we are using | 21:38 |
| corvus | oh neat; then next time we're in there, we should see about using that | 21:39 |
| mordred | yeah | 21:39 |
| *** jamesmcarthur has joined #zuul | 21:39 | |
| corvus | (we apparently do not have our linter configured for that, because it barfed at me when i tried to use it) | 21:39 |
| *** jamesmcarthur has quit IRC | 21:40 | |
| *** jamesmcarthur_ has joined #zuul | 21:40 | |
| mordred | corvus: hrm. actually - I might be wrong | 21:41 |
| mordred | looks like react-scripts currently supports object/rest spread syntax (...) from es2018 - and one or two other things, but so far doesn't support named capture groups | 21:42 |
| mordred | corvus: the stack is +A'd except for https://review.opendev.org/#/c/671906 - which clarkb +1'd but said you can treat as a +2 if you want | 21:53 |
| mordred | corvus: I agree - I would be happy for you to +A that | 21:53 |
| clarkb | ya I basically noted that I'm still not super strong on all the stuff changing there | 21:53 |
| clarkb | but what I do understand seems fine | 21:53 |
| *** tosky has quit IRC | 22:32 | |
| *** michael-beaver has quit IRC | 22:32 | |
| *** mattw4 has quit IRC | 22:35 | |
| *** mattw4 has joined #zuul | 22:35 | |
| *** saneax has joined #zuul | 22:57 | |
| *** tjgresha has joined #zuul | 23:08 | |
| corvus | i went ahead and +W'd that. might take a bit to get the whole stack in | 23:23 |
| *** mattw4 has quit IRC | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!