Tuesday, 2018-08-21

rcarrillocruznhicher , mhu : heya, around to +3 https://softwarefactory-project.io/r/#/c/13451/1/resources/tenant-ansible.yaml ?00:27
rcarrillocruzor tristanC , not sure if you are starting now00:27
pabelangerrcarrillocruz: +300:37
rcarrillocruzOH WAIT00:38
rcarrillocruzyou are core00:38
rcarrillocruzi thought you were not00:38
rcarrillocruzthx !00:38
pabelangeryah, think 2 weeks now00:38
tristanCgundalow: pabelanger: i've updated the etherpad about the ansible tenant01:29
tristanC( https://etherpad.openstack.org/p/gundalow )02:20
*** nijaba has quit IRC04:27
*** nijaba has joined #softwarefactory04:30
*** jpena|off is now known as jpena07:40
*** chmouel has joined #softwarefactory07:58
rcarrillocruztristanC: can you please drop my GH keys on 0000110231? it's on hold08:53
rcarrillocruztristanC: as for the ansible tenant, ansible-network is a different team from ansible core. We don't release ansible-network stuff as part of ansible release train. And creating the ansible tenant was not as one of the use cases to CI Galaxy, we simply created a repo called chouse-test to show them how it works08:55
rcarrillocruzdifferent teams08:55
rcarrillocruzdifferent way of doing things08:55
rcarrillocruzdifferent release trains08:55
rcarrillocruznow, if you say the issue is technical or maintenance, as for having two tenants require more resources from SF perpespcetive that's fair08:56
rcarrillocruzbut ideally we would like to manage it with two tenants (at least me)08:56
rcarrillocruzif not possible, then let's discuss to rename the tenant to ansible-network and merge the two project configs into ansible-network/zuul-config, cos right now it's a mess to follow08:57
rcarrillocruzand well... my team is ansible-network, is just we still have modules under ansible/ansible08:59
tristanCrcarrillocruz: you should now have acess to zuul-worker@38.145.32.11009:01
rcarrillocruzsweet thx09:01
rcarrillocruzi don't know why ansible-playbook within dib node freezes09:01
tristanCrcarrillocruz: similarly to the openstack tenant in zuul.openstack.org, multiple core team with differente release train can co-exist in a single tenant09:05
tristanCagreed it's hard to follow, but perhaps readmes and a document to describe how things work would be enough?09:07
rcarrillocruzwell, thing is we don't want to document, we want to have things that below to place FOO to tenant FOO09:08
rcarrillocruzwhat's the pushback?09:08
rcarrillocruzinfra related?09:08
tristanCwe could work around the infra tasks and extra maintainance, my concern is that there was 2 tenants initially09:09
tristanCthen we merged them, and now you want to split them again09:09
tristanCthus i'd like to make sure we won't have to merge them again in the future...09:09
rcarrillocruzyeah, because have seen it's not great to maintain moving forward09:09
rcarrillocruzi see09:09
rcarrillocruzso i ask you something09:10
rcarrillocruzis it possible to have one trusted project to handle two GH orgs09:10
tristanCsure, that is also possible09:10
rcarrillocruzlike, ansible-network/zuul-config managing ansible/ansible and ansible-network/*09:10
rcarrillocruzok, would it be a whole lot of work to rename current tenant to ansible-network and the DNS of the portal we get as ansible-network09:11
rcarrillocruzcos what it bugs me is having two trusted projects really09:11
rcarrillocruzif in the end we have one tenant09:11
rcarrillocruz1-1 is ok, 2 to 1 is confusing09:11
rcarrillocruzand i don'tw ant someone accidentally putting a secret managed by our team on ansible/ansible09:12
rcarrillocruzcos well, we have different secrets/accounts on my team compared to ansible/ansible09:12
tristanCrcarrillocruz: what if we write in bold that a-n/z-c is only to be used for a-n jobs that needs secret, and keep everything else in a/z-c?09:12
rcarrillocruznope09:14
rcarrillocruzi don't want a trusted project in ansible09:14
rcarrillocruzthat's what we have now09:14
rcarrillocruzi'd like ansible/ansible to just have a .zuul.yaml09:14
rcarrillocruzand consume ansible-network/ansible-zuul-jobs09:14
rcarrillocruzwhich may inherit ansible-network/zuul-config09:15
tristanCrcarrillocruz: can you please document what you want in the etherpad09:16
rcarrillocruzsure09:17
rcarrillocruztristanC: i'm seeing issues on our zuul-config jobs09:18
rcarrillocruzhttps://github.com/ansible-network/zuul-config/pull/4209:18
rcarrillocruzhowever09:18
rcarrillocruzhttps://github.com/ansible-network/cloud_vpn_aws_vpn_provider09:18
rcarrillocruzunless letters are dancing on my glasses09:18
rcarrillocruzoh wait09:19
rcarrillocruzmaybe i fat fingered the tenant untrusted projects09:19
* rcarrillocruz goes check09:19
tristanCthen we'll create infra task if needed, but first, please, let's get everyone on-board09:20
rcarrillocruzhmm09:21
rcarrillocruzno...09:21
rcarrillocruzhttps://softwarefactory-project.io/r/#/c/13451/09:21
rcarrillocruzcloud_vpn_aws_vpn_provider was added yesterday09:21
*** sshnaidm|off is now known as sshnaidm09:21
rcarrillocruzany hint ?09:22
tristanCit's not in the list https://ansible.softwarefactory-project.io/zuul/projects.html09:22
rcarrillocruzyeah, but i added them on the tenant, per ^ change09:23
rcarrillocruzseems like it's not been applied?09:23
tristanCthe change got applied, but zuul didn't fully reload the tenant, perhaps because of "errors detected during ansible tenant configuration re-loading"09:30
tristanCi'll issue a manual reload now to check09:31
rcarrillocruzoki, thx09:31
tristanCwell, zuul doesn't tell why it doesn't add the project. could it be because they are missing GH app?09:36
rcarrillocruzmissing app? what you mean09:38
rcarrillocruzthey  are repos hosted under ansible-network09:39
tristanCis the app installed on those new projects?09:39
rcarrillocruzjust like cloud_vpn, which is managed by zuul just fine09:39
rcarrillocruzthe gets attached in an org basis09:40
rcarrillocruzthey get i mean09:48
tristanCin scheduler.log, zuul do the merger:cat job for the new project, but they silently not get added to the project list...09:53
rcarrillocruz:/09:59
rcarrillocruzanything you want me to try on my side10:05
* tristanC reading configloader source to see how this can happens...10:06
gundalowrcarrillocruz: got branch protections enabled?10:13
*** chmouel has quit IRC10:13
gundalowSee the RST in network community10:13
* gundalow finds link10:13
rcarrillocruzi didn't do anything on those repos as for branch protections10:13
gundalowhttps://github.com/ansible/community/blob/master/group-network/roles_development_process.rst#new-role10:14
gundalowrcarrillocruz: above is the process I've been using10:14
rcarrillocruzi don't think they are related tho, zuul is not reloading the tenant10:14
tristanCrcarrillocruz: zuul is reloading the tenant, it's just not registering the new projects10:16
tristanCbranch project shouldn't matter as the projects doesn't use the exclude-unprotected-branches option10:16
rcarrillocruzyeah, i mean, the whole process is not being done10:17
gundalowrcarrillocruz: just reading earlier discussions regarding single/multiple tenants. Once of the requirements from mattclay and myself is as much as possible of the configuration of hat is used to define how we test ansible/ansible needs to be branched (ie product, integration tests and test framework/zuul) must be in the same branch. Think back to before we had branched config for DCI10:19
gundalowSo ansible/ansible MUST Not require anything from out the Ansible repo. And I believe the only thing we need outside of ansible/ansible is a tiny bit of trusted job configuration10:20
gundalowThe GitHub app is installed for ansible-network/*10:21
gundalowJust catching up on discussion, apologies if I'm going through stuff that you've since worked though10:22
rcarrillocruzthe whole one tenant vs two tenants is unrelated to branching , the branching is done in the repos10:24
rcarrillocruzis about having a single place to maintain jobs and look at things10:24
rcarrillocruzsigh, was hoping to release cloud_vpn after i splitted the provisioners/providers repos10:25
*** chmouel has joined #softwarefactory10:48
tristanCrcarrillocruz: ok, found the issue, projects are loaded now10:48
rcarrillocruzweeee10:49
rcarrillocruzthx mate10:49
* rcarrillocruz onto refactor tests, now that cloud_vpn is splitted aprt10:49
gundalowtristanC: ace, what was the issue?10:49
gundalowrcarrillocruz: that doc I linked to has release procedure in for roles. Feedback welcome10:50
tristanCgundalow: the fix is https://softwarefactory-project.io/r/13464 rdo: remove duplicate tripleo-ci definition10:50
rcarrillocruzgundalow: write a release job :P10:50
tristanCthe scheduler reconfiguration was raising an exception later down the reload process, right before making the new configuration effective10:50
rcarrillocruzjokes apart, i'm on making sure the tsts work now that provisioners/providers are outside cloud_vpn, will do then look at it10:51
gundalowRegarding branching & most ansible/* not depending on other things, this was the bit I was discussing10:52
gundalow05:14 <rcarrillocruz> i don't want a trusted project in ansible10:52
gundalow05:14 <rcarrillocruz> i'd like ansible/ansible to just have a .zuul.yaml10:52
gundalow05:14 <rcarrillocruz> and consume ansible-network/ansible-zuul-jobs10:52
*** chmouel has quit IRC10:52
gundalowAnyways, back tomorrow so we can sync up then. Just killing time in airport at the moment10:52
rcarrillocruzgundalow: they will always depend on something, cos jobs depend on base jobs which are in trusted repos10:52
rcarrillocruzand ansible/ansible is not a trusted repo10:53
rcarrillocruzand that is unrelated to branching btw, the branching is put on the jobs repos10:53
rcarrillocruzif you add a .zuul.yaml on ansible/ansible10:53
rcarrillocruzthat has a list of the jobs that are triggered for that repo10:53
rcarrillocruzthose jobs are defined on either a trusted repo10:54
rcarrillocruzor untrusted repo10:54
rcarrillocruzyou could have untrusted jobs defined on ansible/ansible as well, but again, they will depend on base jobs that are on trusted repos10:54
gundalowSounded like you suggested gh/ansible should depend on network-engine10:54
gundalowCurrently have https://github.com/ansible/zuul-config10:55
rcarrillocruznetwork-engine?10:55
gundalow& fork of Ansible https://github.com/ansible/zuul-test-repo/pull/410:55
rcarrillocruznetwork-engine is not a trusted repo, it doesn't contain jobs10:55
gundalowSorry, I meant ansible-network10:56
gundalowAnyways, glad you've got Zuul working so will leave you to do the release10:56
gundalowCan discuss tomorrow10:56
rcarrillocruzyes, that we have base jobs in one location, ansible-network/zuul-config10:56
rcarrillocruzwe have two locations now10:56
rcarrillocruzthat's bad10:56
rcarrillocruzwe had a failure due to disparing base jobs around in jobs10:57
rcarrillocruzwe should have one trusted repo, with one set of base jobs and secrets10:57
rcarrillocruzand since we are ansible-network10:57
rcarrillocruzwe should consolidate on ansible-network/zuul-config10:57
rcarrillocruzand remove ansible/zuul-config10:57
*** jpena is now known as jpena|lunch11:10
*** chmouel has joined #softwarefactory11:49
*** jpena|lunch is now known as jpena12:18
*** ssbarnea is now known as ssbarnea|ruck12:35
mnasersorry to ping about this again.. is there a way to only allow registered users to talk to gerrit (disallow anonymous)?12:41
tristanCmnaser: it should be the "authenticated_only" in the sfconfig.yaml network section13:07
mnasertristanC: i did that, but you can still git clone via http as a registered user13:07
tristanCoh i see, gerrit direct access are still enabled for anon13:09
mnasertristanC: yeah, and i dont see anything in ACLs to disable anonymous users read access13:10
mnaserunless anon users == registered users with cauth13:10
*** chmouel has quit IRC13:11
tristanCthe parent project config is accessible here: /var/lib/software-factory/git/All-projects/project.config13:12
tristanCremoving read access doesn't seems enough though13:12
mnasertristanC: removing "read = group Anonymous Users" from "[access "refs/*"]" wasnt enough?13:14
mnaseri was thinking of adding another group and parenting it to it (dunno if sf resources.yaml allows that)13:15
tristanCmnaser: testing atm, i'm affraid the "authenticated_only" option is under tested and may need more work to be effective13:15
mnasertristanC: yeah no worries, i mean you need to know the exact path in order to be able to clone, but yeah13:15
sfbenderTristan de Cacqueray created software-factory/sf-config master: gateway: authorize cauth to call managesf when authenticated_only is set to True  https://softwarefactory-project.io/r/1346713:20
tristanCmnaser: removing the read access on "refs/*" from the ui worked though, i'm looking for a way to automate that13:21
tristanCmnaser: also, i had the same bug regarding cauth json error, it should be fixed by https://softwarefactory-project.io/r/1346713:22
mnasertristanC: cool, yeah the refs/* is how i fixed it before, i dunno if gerrit acl's allow 'explicit deny'13:22
tristanCmnaser: not sure, but we should be able to force it in this task: https://softwarefactory-project.io/cgit/software-factory/sf-config/tree/ansible/roles/sf-gerrit/tasks/setup_acl.yml13:23
mnaseri think maybe inside my project resources.yaml i can do read = deny group Anonymous User13:24
mnaseri think that might allow me to do per-project denial13:24
mnaseri have to test it13:24
sfbenderTristan de Cacqueray created software-factory/sf-config master: gerrit: disable Anonymous Users when using authenticated_only  https://softwarefactory-project.io/r/1346813:34
tristanCmnaser: ^ should work for all projects13:34
tristanCoh wait no, we currently need anon access to the config for config-update13:35
tristanCthat's another part we need to change to push config repo content to services' instance instead of pulling from gerrit13:36
sfbenderTristan de Cacqueray created logreduce master: Add React web interface  https://softwarefactory-project.io/r/1346913:45
pabelangertristanC: https://softwarefactory-project.io/r/13414/ was a week old, and fixed duplicate tripleo-ci. Just nobody reviewed it :(14:23
tristanCpabelanger: arg, missed that. feel free to self-merge such fix next time.14:36
sfbenderJakub Ružička created rdopkg master: info: fix `rdopkg info -l LOCAL` and add tests  https://softwarefactory-project.io/r/1347214:50
sfbenderMerged graffiti master: Add support for separated_buildreqs releases in list commands  https://softwarefactory-project.io/r/1345014:51
sfbenderMerged rdopkg master: info: fix `rdopkg info -l LOCAL` and add tests  https://softwarefactory-project.io/r/1347215:23
*** jpena is now known as jpena|off16:19
rcarrillocruzgundalow: i just realized with have lots of duplicate jobs in ansible-network-zuul-jobs from sf-jobs16:25
rcarrillocruzwe need to do quite a cleanup16:25
rcarrillocruzcan i please get reviews for https://softwarefactory-project.io/r/#/c/13473/16:28
rcarrillocruzlinters job is failing on a PR i pushed that added an RST, as dib-fedora-27 does not have it16:28
pabelangergundalow: rcarrillocruz: I've proposed https://github.com/ansible-network/ansible-zuul-jobs/pull/32 to remove the duplication16:30
rcarrillocruzyup16:30
pabelangerlets see if zuul is okay with patch16:31
pabelangerI'd also like to make that repo gating once we figure out tenant configuration16:32
nhicherpabelanger: we don't have flavors with disk_size on vexxhost (only cpu, and ram), mnaser proposes to use boot-from-volume for tripleo-ci jobs, do you think it will be an issue ? I don't see boot-from-volume option in upstream project-config17:59
pabelangernhicher: should be fine, vexxhost ceph is pretty good17:59
pabelangernhicher: https://zuul-ci.org/docs/nodepool/configuration.html#pool-labels18:00
pabelangerboot-from-volume is label setting18:00
pabelangeralso likely want volume-size18:00
nhicherpabelanger: yes, mnaser shared https://www.irccloud.com/pastebin/1FSqjT5g18:00
pabelangeryup, looks right18:00
nhicherpabelanger: I will prepare the cloud.yaml file and prepare the review to add the provider18:01
nhicherpabelanger: thanks18:01
pabelangersure18:02
*** mnaser has quit IRC18:42
*** mnaser has joined #softwarefactory19:07
*** chouseknecht has quit IRC19:33
*** trishnag has quit IRC19:48
*** trishnag has joined #softwarefactory20:00
*** sshnaidm is now known as sshnaidm|afk21:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!