Tuesday, 2018-07-10

logan-one thing I'm noticing on 3.1, with authenticated_only: true, the config check job fails because it cannot download _defconf.tgz (it provides a redirect to the login gateway)00:58
logan-i'm also seeing a traceback/500 error when attempting to login with the local admin user on a new install http://paste.openstack.org/raw/725381/00:58
tristanClogan-: arg, it sounds like this option doesn't work anymore, i don't think we have tested it in a long time...01:12
tristanCi can have a look. was it working in 3.0 ?01:13
logan-yup01:40
gundalowmorning tristanC01:40
tristanCgundalow: o/01:42
gundalowfbo|off:  I corrected the tenant name, thanks for pointing that out https://github.com/ansible/zuul-config/commit/5485ede6e761305e7d781ccf8cbf2d728718cb0201:46
gundalowtristanC: So is the question: Should we have a single tenant called "ansible" which is used for github/ansible-network and github/ansible?01:47
tristanCgundalow: the secret also needs to be re-encrypted, there is one private key per repo (https://github.com/ansible/zuul-config/blob/master/zuul.d/secrets.yaml needs to be changed too)01:48
gundalowtristanC: I think I just copied that from network-engine01:49
tristanCgundalow: i think a single ansible tenant would make sense01:49
gundalowWhat could the potential downsides be?01:50
tristanCgundalow: hum, conflict on the gate requirements pipeline01:50
sfbenderLogan V created software-factory/sf-config master: Allow _defconf.tgz download without authentication  https://softwarefactory-project.io/r/1295401:53
gundalowIf that's an issue in the future could it be worked around by defining the gate requirements in the individual repos (gh/ansible-network/zuul-network-jobs and gh/ansible/ansible)?01:55
tristanCgundalow: well, there can only be one pipeline named "gate", but there could be a "gate-ansible-network" if needed01:56
tristanCgundalow: having a single tenant would make the user interface simpler, there will be only one status page for both organization01:56
gundalowWould having a single tenant mean if we have $vendorA added, then they could run ansible-network & and ansible/ansible Zuul jobs?01:58
gundalowie, only need one time setup and we'd have the ability to run jobs against all repos under the "ansible" tenant?01:58
tristanCgundalow: any tenant could add a zuul-jobs project and be able to re-use the job. so it hink a $vendorA would still needs its own tenant01:59
tristanCgundalow: the tenant scope mostly define 2 things, the base job (which handle logs server fqdn), and the pipelines (which define the github app to use)02:00
tristanCthose things are defined by the config projects of the tenant, e.g. that section: https://softwarefactory-project.io/cgit/config/tree/zuul/ansible_networking.yaml#n602:01
gundalowah, OK02:02
gundalowHow do you think we proceed?02:02
gundalowHow much of an issues is/could conflict on gate be?02:03
tristanCgundalow: so if we want to do this, e.g. https://softwarefactory-project.io/r/1295502:03
tristanCgundalow: then I think we just have to move the pipelines and base jobs to ansible/zuul-config02:04
tristanCand if we are going to do that refactor, then we should take this opportunity to create an ansible-zuul bot (e.g. attached to the ansible org) and configure it in sf-project.io zuul02:05
tristanCe.g. move:02:06
tristanChttps://github.com/ansible-network/zuul-config/blob/master/zuul.d/jobs.yaml#L22-L6102:07
tristanChttps://github.com/ansible-network/zuul-config/blob/master/zuul.d/pipelines.yaml#L1-L11602:07
tristanChttps://github.com/ansible-network/zuul-config/blob/master/zuul.d/projects.yaml#L10-L1302:07
tristanChttps://github.com/ansible-network/zuul-config/blob/master/zuul.d/secrets.yaml#L2-L5102:07
gundalowYup, got most of that in https://github.com/ansible/zuul-config already02:08
tristanCthen the remaining bits can stay in a-n/z-c02:08
gundalowAh, cool, was going to ask if the a-n specific things can stay in that GH Org, ace02:08
tristanCgundalow: yes, those shouldn't conflict as they are specifics to a-n02:09
tristanCgundalow: so do you want to begin with re-using that softwarefactory-project-zuul default bot, or would it be better if the ansible org create its own bot that we configure in sf-project zuul?02:10
tristanC(we'll just need a copy of its private key)02:11
tristanCeither way sound good to me, re-using the bot is easier to begin with, but since we are going to refactor, then it may be a good time to do that change now too02:13
*** corvus_ has joined #softwarefactory02:17
*** corvus has quit IRC02:19
*** rcarrillocruz has quit IRC02:19
gundalowtristanC: I added `softwarefactory-project-zuul` from your link last week and it's got permissions on ansible/{zuul-config,zuul-test-repo}`02:21
gundalowI believe GH bots are linked to GH Orgs, so unsure how it can be shared across a-n and a. Or is that done on the SF side?02:22
tristanCalright, then we should begin with that bot since it's already configured in sf's zuul02:23
tristanCgundalow: iirc, the bot creator define who can install it where02:23
tristanCe.g. the sf-p-zuul bot can be installed by anyone02:24
tristanCit has been created in the softwarefactory-project org02:24
gundalowand under "@ansible Repository access" it lists the two repos I mentioned02:24
tristanCanyway, changing the botname can be done later down the road if needed02:25
gundalowack02:25
*** rcarrillocruz has joined #softwarefactory02:25
tristanCso, would you like to proceed with the ansible-network tenant rename and pipeline migration over to a/z-c today?02:26
gundalowtristanC: I'm here for an hour or so (I'm west coast for the next ~6 weeks)02:26
gundalowrcarrillocruz: Hi, you there?02:27
gundalowhum, actually it's 04:30, so I hope he isn't02:27
tristanCgundalow: what we can do is begin with a new ansible tenant to setup the zuul-config, then we can migrate ansible-network in a second step02:28
gundalowtristanC: I think there will be some releases from network-engine withing the next 24 hours, so phased approach would be good if possible02:28
gundalowcool02:29
gundalowWhat should I do?02:29
tristanCgundalow: i'm going to propose a couple change, one minute02:29
gundalowThanks :)02:29
tristanCgundalow: https://github.com/ansible/zuul-config/pull/402:32
gundalowWhat's `runc-fedora`?02:33
gundalowoh, that's the default, so will be overritten by specific `nodeset` in later definitions.  Merged02:34
tristanCgundalow: i rewrote your config patch to use the new tenant resources definition, here is how it looks like:02:41
tristanCremote:   https://softwarefactory-project.io/r/12896 Add the ansible tenant02:41
tristanCgundalow: the idea is that if we change the ansible tenant resource url to ansible.softwarefactory-project.io/manage02:43
tristanCgundalow: then we'll be able to move that file directly in ansible/zuul-config, so that updating the zuul config can be managed directly from github, without needing to use sf-project gerrit config repo02:44
tristanCgundalow: in the config-check logs, you can see what zuul configuration this generate, see the top of https://softwarefactory-project.io/logs/96/12896/5/check/config-check/5157305/logs/build/main.yaml02:45
tristanCwhich sounds like what we proposed initialy02:45
gundalowShould `projects: Ansible` be `ansible`, not sure if that's just a "friendly name", or it needs to match else where02:46
tristanCgundalow: sure, let me update that02:47
gundalowHow in gerrit can I generate a diff between my last commit and the head of that branch?02:48
tristanCthere is a "Diff against" in the panel-title on top of the file list02:48
tristanCor on the upper-right, you can load previous patchset02:49
gundalowah, got it, thanks02:49
tristanCPS6 adds the missing exclude-unprotected-branch settings, it should be good now02:50
tristanClet's approve this?02:52
gundalow+102:53
tristanCscheduler reconfiguration now begins02:56
tristanCarg, ERROR zuul.Scheduler: Reconfiguration failed: ... github3.exceptions.NotFoundError: 404 Not Found02:58
tristanCfull stacktrace is https://ansible.softwarefactory-project.io/paste/show/14/02:59
tristanCare branch protections set for ansible/zuul-test-repo?03:00
tristanCgundalow: ^03:00
gundalowtristanC: ah, no they were not. You may need to force it to re-read it. I don't think at the moment Zuul get's a reconfiguration event03:01
tristanCok, i removed the setting directly in scheduler configuration, reconfiguration is now resumed03:02
tristanCthough there have been a config error: https://ansible.softwarefactory-project.io/paste/show/15/03:02
gundalowah, so that's my fault03:03
gundalowDo I need to remove `sqlreporter:`?03:03
tristanCit's ok, it just needs s/github/github.com/03:03
tristanCgundalow: now that the the project is registered in zuul, i'll proopose a change to add the logserver secret and fix those issue, one moment03:04
gundalowack03:04
tristanCah success, tenant is created https://softwarefactory-project.io/zuul/t/ansible/status.html03:07
tristanCwith the test-repo https://softwarefactory-project.io/zuul/t/ansible/project.html?project_name=ansible%2Fzuul-test-repo03:07
gundalow\o/03:08
tristanCgundalow: PR in progress03:09
tristanChttps://github.com/ansible/zuul-config/pull/503:13
tristanC(post_failure is normal since it needs the secret for logs upload)03:15
gundalowtristanC: Thanks, merged03:17
tristanCnice, no more config-errors, see https://softwarefactory-project.io/zuul/api/tenant/ansible/config-errors03:18
gundalow\o/03:18
tristanCand the affected pipeline is now loaded, see https://softwarefactory-project.io/zuul/t/ansible/status.html03:18
gundalowcool, got `third-party-check` now03:19
tristanCand ansible/zuul-test-repo is now running jobs through the in-repo zuul.yaml03:19
gundalowYup, so now secrets have been added we should have uploaded logs03:21
tristanCgundalow: so, the next step is to add the ansible-network project to the ansible tenant (excluding pipeline and base job)03:21
tristanCgundalow: then we could drop ansible-network tenant and make the ansible.sf-project.io a white-label deployment for the ansible network03:21
tristanCso that ansible.sf-project.io/zuul/ webui shows the ansible tenant status, jobs and builds03:22
gundalowtristanC: What of "add the ansible-network project to the ansible tenant (excluding pipeline and base job)" can I do without impacting a-n?03:22
tristanCwhite-label deployment for the ansible tenant*03:22
gundalowah, white-label = FOO.sf-project03:22
tristanCgundalow: yes, this can live in parallel of ansible-network tenant configuration03:22
tristanCgundalow: it can actually be any DNS, it's just the "/zuul/" that is scoped to a tenant03:23
gundalowSo I believe I've already got the base parent jobs in that were in a-n also in a, so not sure what's left for me to do there03:23
gundalowsince we said the a-n specific jobs & roles would stay in a-n/ansible-zuul-jobs/03:24
tristanCgundalow: well, we got that ansible tenant up and running, now let's wait for rcarrillocruz and maybe we should draft a story to explain the ins and outs of such merge03:24
gundalowah, as expected linters will fail on `zuul-test-repo/`03:24
tristanCgundalow: you probably want a more custom linters job for the ansible project, that PR is to test zuul03:26
gundalowYup, just raising one03:26
gundalowraised https://github.com/ansible/zuul-test-repo/pull/203:30
gundalowhum, though nothing running, do I need `check` here https://github.com/ansible/zuul-test-repo/pull/2/files#diff-4b5c72a5ee79a9e4660a42ce20d9265fR603:31
tristanCgundalow: the third-party-check should have kicked03:32
tristanCgundalow: i wonder if adding non zuul configuration files to zuul.d cause problems03:32
gundalowoh, the readme?03:33
*** Guest61318 has quit IRC03:34
tristanCand the playbooks, iirc only zuul configuration stanza should be present in the zuul.d folder03:34
tristanCalso iirc roles needs to be at the root of the projects03:35
*** Guest61318 has joined #softwarefactory03:35
*** corvus_ is now known as corvus03:36
gundalowok, I'll move .zuul.d/playbooks to test/utils/zuul/playbooks03:36
*** corvus is now known as Guest7845703:37
*** Guest78457 is now known as jeblair03:38
gundalowtristanC: hum, that's annoying if I have to have `./roles/` in the root of the repo03:38
tristanCgundalow: i think we need a zuul feature to be able to support custom path03:40
tristanCgundalow: perhaps those zuul jobs roles could exists in a ansible/zuul-jobs project?03:40
gundalowMy hope was to keep as much in a/a, so the tests are versioned along side what they are testing03:40
tristanChttps://zuul-ci.org/docs/zuul/user/config.html#attr-job.roles03:41
gundalowI'm happy to have it in the root of `ansible-zuul-jobs/`, though it can't go in the root of ansible/ansible03:41
tristanCgundalow: it's a frequent request, i think we could add a "path" to the job.roles attribute to be able support role not stored at the root of the project03:42
*** jeblair is now known as corvus03:43
gundalowUpdated https://github.com/ansible/zuul-test-repo/pull/203:49
tristanCgundalow: could you try adding the job to "check" instead? i have to go afk now, i'll have a look at that third-party-check pipeline configuration03:52
gundalowSure03:53
gundalowtristanC: Thanks again for all your help!03:55
gundalowtristanC: I need to head off now, I've given you commit powers on the two repos. You should be able to push changes to my PRs.04:41
tristanCgundalow: alright, i'll write a story with a merge plan to make sure it make sense and works for everyone04:45
gundalowtristanC: Sounds like a plan, thanks again :)04:46
tristanCyou're welcome!04:49
tristanCgundalow: rcarrillocruz: here is an initial migration plan draft: https://tree.taiga.io/project/morucci-software-factory/us/148405:06
*** Guest61318 has quit IRC05:44
*** Guest61318 has joined #softwarefactory05:53
*** apevec has joined #softwarefactory06:57
*** apevec has joined #softwarefactory06:57
*** fbo|off is now known as fbo07:28
*** Guest61318 has quit IRC09:10
*** jangutter has quit IRC09:15
rcarrillocruztristanC , gundalow : wfm09:25
*** Guest61318 has joined #softwarefactory09:25
*** jangutter has joined #softwarefactory09:35
*** Guest61318 has quit IRC10:03
sfbenderMerged software-factory/sf-docs master: Add GitHub deployment guide.  https://softwarefactory-project.io/r/1210510:15
*** yassine has joined #softwarefactory11:09
*** yassine is now known as Guest8842511:09
sfbenderMerged software-factory/sf-config master: repos: add patch and review sync strategy  https://softwarefactory-project.io/r/1292913:52
gundalowtristanC: looks good. Is it worth adding a) white-label b) role custom path (need this before it can go into a/a)14:16
*** EmilienM is now known as EvilienM14:42
jruzickaI have a bounty for person who reveals to me why OrderedDict is acting non-deterministically on python3 only here: https://softwarefactory-project.io/r/#/c/12882/14:57
jruzickamhu, heeeey buddy ^^14:57
*** Guest88425 has quit IRC16:00
*** fbo is now known as fbo|off16:44
sfbenderFabien Boucher created software-factory/sf-config master: sf-config depends on PyYAML make sure it is installed  https://softwarefactory-project.io/r/1296516:57
sfbenderMerged software-factory/sf-config master: log-classify: add a dedicated component  https://softwarefactory-project.io/r/1293017:18
sfbenderFabien Boucher created software-factory/sf-docs master: doc: fix remaining references to OCI instead of RunC  https://softwarefactory-project.io/r/1296617:24
*** apevec_ has joined #softwarefactory20:43
*** apevec_ has quit IRC20:43
*** apevec_ has joined #softwarefactory20:43
*** apevec has quit IRC20:45
*** Guest88425 has joined #softwarefactory20:54
*** apevec_ has quit IRC21:08
gundalowtristanC: Any ideas why https://github.com/ansible/zuul-test-repo/pull/2 isn't triggering? It's using `check` (rather than `third-party-check`)23:16
pabelangergundalow: possible you have a syntax error in your job configuration, but zuul isn't reporting it back. You could add https://zuul-ci.org/docs/zuul/user/config.html#attr-project.%3Cpipeline%3E.debug to the pipeline to get extra debug information23:41
pabelangergundalow: basically, if you add a simple job to check pipeline first, then rebase pull/2 once merged, zuul should report back why it is failing23:41
pabelangersomething we need to fix in zuul23:42
gundalowah, I'll change to `noop` with debug, great idea, thanks23:42
pabelangerI'm not sure i have access to zuul logs, otherwise I'd dive into it more23:43
*** Guest88425 has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!