Friday, 2018-10-05

openstackgerritJean-Charles Lopez proposed openstack/openstack-helm-infra master: Ceph-client: create pools after mgr up  https://review.openstack.org/60584101:07
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: Gate: Tolerate failures in log collection tasks  https://review.openstack.org/60803401:44
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: Gate: Remove unused helm chart deployment role and playbook  https://review.openstack.org/60803201:44
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: Gate: remove unused pull images role and playbook  https://review.openstack.org/60803301:44
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: WIP: refactor gate runner  https://review.openstack.org/60804501:46
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: [Calico] Update to Calico v3.2  https://review.openstack.org/60706501:50
*** unicell has joined #openstack-helm02:18
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: [DNM] impatient  https://review.openstack.org/60761202:19
*** unicell has quit IRC02:22
*** unicell has joined #openstack-helm02:45
*** unicell has quit IRC02:46
*** unicell has joined #openstack-helm02:46
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm-infra master: Ceph-client: create pools after mgr up  https://review.openstack.org/60584102:55
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: refactor gate runner  https://review.openstack.org/60804502:58
openstackgerritTin Lam proposed openstack/openstack-helm master: Specification: Value File Ordering  https://review.openstack.org/55248502:59
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: refactor gate runner  https://review.openstack.org/60804503:05
openstackgerritMerged openstack/openstack-helm master: Specification: Value File Ordering  https://review.openstack.org/55248503:13
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: refactor gate runner  https://review.openstack.org/60804503:17
openstackgerritTin Lam proposed openstack/openstack-helm master: Add apparmor security annotation  https://review.openstack.org/60236503:26
openstackgerritHari proposed openstack/openstack-helm-addons master: Inclusion annotation for upgrade and install chart changes  https://review.openstack.org/60484903:50
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: refactor gate runner  https://review.openstack.org/60804503:50
*** unicell has joined #openstack-helm04:09
openstackgerritMerged openstack/openstack-helm-infra master: Gate: Tolerate failures in log collection tasks  https://review.openstack.org/60803404:17
openstackgerritChris Wedgwood proposed openstack/openstack-helm master: Libvirt: Remove libvirt dockerfile from repo  https://review.openstack.org/60756704:22
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: refactor gate script running  https://review.openstack.org/60804504:30
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: refactor gate script running  https://review.openstack.org/60804504:32
*** roman_g has quit IRC04:41
*** kukacz has quit IRC04:52
*** openstackgerrit has quit IRC04:52
*** kukacz has joined #openstack-helm04:57
*** openstackgerrit has joined #openstack-helm04:57
*** unicell has quit IRC06:16
openstackgerritMerged openstack/openstack-helm-infra master: Gate: Remove unused helm chart deployment role and playbook  https://review.openstack.org/60803206:43
openstackgerritMerged openstack/openstack-helm-infra master: Gate: remove unused pull images role and playbook  https://review.openstack.org/60803306:57
openstackgerritMerged openstack/openstack-helm-infra master: [Calico] Update to Calico v3.2  https://review.openstack.org/60706506:57
*** roman_g has joined #openstack-helm07:07
*** tmorin has joined #openstack-helm07:10
*** tmorin has left #openstack-helm07:12
*** cfriesen has quit IRC08:21
*** aojeagarcia has joined #openstack-helm08:26
*** lemko has joined #openstack-helm09:01
*** rgogunskiy has joined #openstack-helm09:14
*** gkadam has joined #openstack-helm09:43
openstackgerritAchal proposed openstack/openstack-helm-infra master: Libvirt: Make --listen a configurable paramter for libvirtd  https://review.openstack.org/60797110:57
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup jobs  https://review.openstack.org/60823211:07
evrardjpportdirect: it seems our work will overlap11:17
evrardjpshould we sync?11:17
portdirectYeah11:18
evrardjpso I've cleaned up the jobs in openstack-helm, to see how bad it is. It's quite okay. I see you've worked there :)11:19
evrardjpI'd like to move all the job definitions into openstack-helm-infra11:19
evrardjpso we only keep the project definition in openstack-helm11:20
evrardjpwhat do you think of this?11:20
evrardjpthe idea is to have really lightweight definitions, and standardized across all the repos11:20
evrardjpit reduces the amount of plays too -- your playbook osh-infra-gate-runner can become an osh-gate-runner11:21
evrardjpthen, in said playbooks, we can be smart into what to run, so either gate_scripts is getting passed, or we have a series of defaults11:22
evrardjpalternatively, keeping the job definitions with the project BUT using the playbooks directly from the infra project would do the trick, and be easier to follow for people11:23
portdirectThis sounds good, and where I was wanting to head too :D11:23
portdirectThough I think your skills will get us there more quickly on the zuul/ansible side11:24
portdirectI think the former option you mentioned sounds more manageable over time?11:25
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup jobs  https://review.openstack.org/60823211:25
evrardjpthe former is more manageable over time, but is harder to read for new people: they will not know what the job do, nor how to add more11:27
evrardjpThis can be fixed with proper documentation11:27
evrardjpalso it removes the duplication everywhere -- openstack-helm-infra becomes the place where the gating data happens11:27
evrardjpcould you clarify what is the purpose you wanted to give to openstack-helm-infra ?11:28
evrardjpI mean it's one or the other, it doesn't really matter. But I'd like to make sure I am heading to the right direction: 1) simplify jobs, 2) simplify their playbooks, 3) simplify how they run11:29
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup jobs  https://review.openstack.org/60823211:30
evrardjpwhat I like with the patch I have, is that I already see we have cross definitions, but it was not explicit11:32
evrardjphaha11:32
evrardjpcatching bugs! :)11:32
evrardjpso maybe we should take a decision: keep the jobs definitions separate, or group them11:33
evrardjpmaybe cores have an opinion srwilkers for example was working on gates too IIRC11:33
portdirectYeah, I think this needs a consensus11:34
portdirectI'm drinking coffee and trying to make arbitary judgement - never a good thing ;)11:34
portdirectI think an etherpad may help here11:35
evrardjpok I can draft my plan there maybe11:38
portdirect I think this would be best, it may also provide some opportunity to divide effort11:39
evrardjphttps://etherpad.openstack.org/p/helm-gates-refactor11:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup jobs  https://review.openstack.org/60823212:16
srwilkersMorning12:19
srwilkersreading scrollback12:25
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: refactor gate script running  https://review.openstack.org/60804512:27
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: [WIP] Wire linters to openstack-helm-infra plays  https://review.openstack.org/60825412:32
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: Move to K8s 1.10.8  https://review.openstack.org/60825512:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup project jobs for openstack-helm  https://review.openstack.org/60825612:54
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: Cleanup project jobs for openstack-helm  https://review.openstack.org/60825612:55
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: move default to Ocata  https://review.openstack.org/60825712:57
*** dims_ has quit IRC12:58
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: move default to Ocata  https://review.openstack.org/60825712:58
evrardjpsrwilkers: I asked a question on the etherpad12:59
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: move default to Ocata  https://review.openstack.org/60825713:02
evrardjpportdirect: don't worry about moving the default to O, this is gonna be a one liner in the future :p13:03
evrardjp:D13:04
portdirectif it does not get on your toes right now - I'd like to get that in13:05
srwilkersevrardjp: looking now13:12
evrardjpportdirect: it kinda hits on my toes :p13:17
portdirectok - ignore it for now13:17
portdirectit was 3 sed's :)13:17
portdirectI can run them after your intial ps to bring some sanity to .zuul.yaml is in13:18
evrardjpwell I think those defaults can be overriden -- I will explain :)13:19
evrardjpmy idea is that by default we point to "latest" images so we catch issues in the image building early. Latest should not be latest openstack though, but a "latest stable" image built13:20
evrardjpso the "frozen" images would be newton/ocata/pike/queens for example13:20
evrardjpand these would ALWAYS be given in values overrides13:20
evrardjpit simplifies the gates: We always pass those :p13:20
*** aaronsheffield has joined #openstack-helm13:22
openstackgerritTin Lam proposed openstack/openstack-helm master: Upgrade default from newton to ocata  https://review.openstack.org/60731213:29
openstackgerritTin Lam proposed openstack/openstack-helm master: Add apparmor security annotation  https://review.openstack.org/60236513:29
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm-infra master: [DNM] test lint simplification  https://review.openstack.org/60826713:57
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: [DNM] test lint simplification  https://review.openstack.org/60826913:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm master: [DNM] test lint simplification  https://review.openstack.org/60826913:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm-infra master: [DNM] test lint simplification  https://review.openstack.org/60826714:00
*** munimeha1 has joined #openstack-helm14:05
*** sthussey has joined #openstack-helm14:06
evrardjpsrwilkers: may I borrow you eyes for a second?14:13
srwilkersevrardjp: of course. whats up?14:14
evrardjphttps://review.openstack.org/#/c/608232/4 seems to be failing a lot, and I am wondering if I did something really wrong and that's very hidden, or if that's normal case14:14
evrardjpIt looks like the jobs are getting their variables correctly (see for example kolla)14:15
evrardjp(I do not ask you to review this yet, just have a look at the log and help me figure things out)14:15
evrardjpI have thought further about the jobs -- they should be all in the same repo (-infra). It will allow an easier reuse14:16
srwilkerslooking through now14:18
srwilkerslooks like most of the failures are due to libvirt and nova-compute crashing14:19
srwilkershttp://logs.openstack.org/32/608232/4/check/openstack-helm-latest-dev_deploy_ceph-kolla/3839118/primary/pod-logs/openstack/libvirt-4pqr8/libvirt.txt14:19
*** dansmith is now known as SteelyDan14:20
evrardjpso that's not really a fault of mine then14:20
evrardjpwow then it's real bad14:20
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: [DNM] impatient  https://review.openstack.org/60761214:21
srwilkersportdirect: ^14:21
evrardjpI have seen this "impatient" patch -- I am curious if we could be smarter in the wait : Wait only for DB, then wait for keystone, then all the hell breaks loose?14:21
evrardjp:)14:22
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: [MariaDB] Fix non-default setting for admin user  https://review.openstack.org/60805714:22
srwilkerslooks like libvirt might just be crashing in the kolla gates.  wondering if portdirect's change to the libvirt chart requires us to use the same libvirt image for the kolla gates that we do for the loci gates rather than the kolla image14:27
srwilkersevrardjp: thanks for the heads up14:30
openstackgerritchinasubbareddy mallavarapu proposed openstack/openstack-helm-infra master: Ceph-client: make pool creation depedent on ceph-mgr service  https://review.openstack.org/60584114:41
openstackgerritPete Birley proposed openstack/openstack-helm master: Libvirt: Remove libvirt dockerfile from repo  https://review.openstack.org/60756714:43
evrardjpwhat's the irc nick of Chris Wedgwood?14:57
openstackgerritGage Hugo proposed openstack/openstack-helm master: [DNM/WIP/POC] Add syntribos gate check  https://review.openstack.org/60770215:08
*** rgogunskiy has quit IRC15:12
srwilkersevrardjp: anticw15:21
*** munimeha1 has quit IRC15:22
portdirectevrardjp: I'd certainly like to parallise the deployment of charts a lot more than we do currently - this is what i do locally15:22
portdirectthe trade off here is again io on the nodepool vms15:22
portdirectwe used to cause a lot of lings to fall over on the db-syncs15:23
evrardjpyeah, and helm itself won't give a good orchestration enough15:27
evrardjptoo bad we don't use ansible :p15:27
*** munimeha1 has joined #openstack-helm15:28
evrardjp #troll engaged15:28
jamesgu__portdirect: there are a small number of Docker images in the tools/images directory and they are Ubuntu based only. We want to add suse support, would you recommend to add Suse based Docker file there. I noticed the libvirt has a name convention "Dockerfile.ubuntu.xenial" but wasn't sure that was still the design.15:29
evrardjpjamesgu__: If I understand what portdirect said above, I'd say that OSH wants to get rid of image building as much as possible. Instead I'd pass an override to the values to point to a suse image15:30
evrardjpsaid image can be built on LOCI or anywhere else (for example, for opensuse OBS kiwi)15:30
evrardjpI am thinking it's a very good idea to get away from building images in OSH15:31
jamesgu__I'd agree15:31
evrardjpevery project its scope15:31
evrardjpI am cleaning up the gates, so it will be easy, in the long term, to pass your own values for distro support15:32
jamesgu__I'd agree that we push the tool/images to Loci, some of those may also be available from docker community, I don't know if osh needs specialty images of ovsswtich, libvirt etc. for example15:33
evrardjpI'd expect it would be nice to drop an override file in the current folder for example: https://github.com/openstack/openstack-helm/blob/master/tools/overrides/releases/pike/loci.yaml15:33
evrardjpjamesgu__: have a look at the file I linked15:34
jamesgu__evrardjp: nice. the images I was asking specifically are infra iamges, https://github.com/openstack/openstack-helm/tree/master/tools/images15:37
jamesgu__for example, libvirt, ovsswitch, kube aio etc.15:37
evrardjpIMO we should build all these images15:37
evrardjpI guess portdirect experience might be worth it there. But I believe the work to be done in OSH should be limited to the update of the value files15:39
* portdirect reading15:48
portdirectevrardjp: this is correct - i until recently was running centos for most images in my home lab15:49
portdirectjamesgu__: yeah the intent behind "Dockerfile.ubuntu.xenial" was that we could add a "Dockerfile.opensuse.tumbleweed" or whatever as desired15:50
*** spiette has quit IRC15:58
*** spiette has joined #openstack-helm15:59
evrardjpportdirect: looks like you'll have images to push in the future :)16:17
jamesgu__portdirect: do you want to move those images to loci or stay in osh?16:17
portdirectjamesgu__: i think osh for these16:18
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: Adding Falco  https://review.openstack.org/59829716:18
portdirectas we have to do some pretty weird things with some of them (libvirt)16:19
*** ianychoi_ is now known as ianychoi16:19
evrardjpportdirect: have you thought of using loci_docker_login secret in OSH gates to built images?16:19
portdirectyes! just never got round to it16:19
portdirectbut that would be the target state for these16:19
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: fix tox python3 overrides  https://review.openstack.org/60668816:19
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: Disable Ceph RADOS Gateway dynamic bucket resharding. Problem was discovered regarding issues being caused by RGW dynamic bucket resharding. It is at this time recommended to disable this feature.  https://review.openstack.org/60700116:20
jamesgu__I figured there must be some specialty sauce in those images. we will start to add Dockerfile.opensuse.xxx then.16:20
*** gkadam has quit IRC16:21
*** aojeagarcia has quit IRC16:32
*** spiette has quit IRC16:34
*** spiette has joined #openstack-helm16:35
*** dims has joined #openstack-helm16:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-helm-infra master: [DNM] test lint simplification  https://review.openstack.org/60826716:53
evrardjpok it seems my idea for the gates cleanup work16:54
*** spiette has quit IRC16:59
*** spiette has joined #openstack-helm17:00
*** sawblade6 has joined #openstack-helm17:36
openstackgerritTin Lam proposed openstack/openstack-helm-infra master: Add LDAP support for k8s-keystone-auth in gate  https://review.openstack.org/60141917:39
*** sawblade6 has quit IRC17:41
openstackgerritGage Hugo proposed openstack/openstack-helm master: [DNM/WIP/POC] Add syntribos gate check  https://review.openstack.org/60770217:42
*** lemko has quit IRC19:37
*** sawblade6 has joined #openstack-helm19:37
*** sawblade6 has quit IRC19:46
*** sawblade6 has joined #openstack-helm20:14
*** sawblade6 has quit IRC20:22
openstackgerritMerged openstack/openstack-helm-infra master: Adding Falco  https://review.openstack.org/59829720:24
openstackgerritMerged openstack/openstack-helm-infra master: Disable Ceph RADOS Gateway dynamic bucket resharding. Problem was discovered regarding issues being caused by RGW dynamic bucket resharding. It is at this time recommended to disable this feature.  https://review.openstack.org/60700120:32
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Libvirt: Fix image  https://review.openstack.org/60835520:42
openstackgerritPete Birley proposed openstack/openstack-helm master: Libvirt: Remove libvirt dockerfile from repo  https://review.openstack.org/60756720:52
*** munimeha1 has quit IRC20:52
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Ceph: Remove fluentbit sidecars, mount hostpath for logs  https://review.openstack.org/60835620:53
*** aaronsheffield has quit IRC20:56
openstackgerritChris Wedgwood proposed openstack/openstack-helm-infra master: [DNM] impatient  https://review.openstack.org/60761221:04
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: DNM - Replace docker-py with docker  https://review.openstack.org/60835821:06
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm-infra master: Restrict Gnocchi Ceph access scope to what is needed only  https://review.openstack.org/60836421:28
*** sawblade6 has joined #openstack-helm22:19
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm-infra master: Restrict libvirt Ceph access scope to what is needed only  https://review.openstack.org/60837322:23
*** sawblade6 has quit IRC22:25
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm master: Restrict Cinder, Glance and libvirt Ceph access scope to what is needed only  https://review.openstack.org/60837422:26
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm master: Restrict Cinder, Glance and libvirt Ceph access scope.  https://review.openstack.org/60837422:30
openstackgerritJean-Charles Lopez proposed openstack/openstack-helm-infra master: Restrict libvirt Ceph access scope to what is needed only.  https://review.openstack.org/60837322:31
*** cfriesen has joined #openstack-helm22:44
openstackgerritGage Hugo proposed openstack/openstack-helm-infra master: Replace docker-py with docker  https://review.openstack.org/60835823:01
openstackgerritRenis Makadia proposed openstack/openstack-helm-infra master: [WIP] Ceph-RGW chart cleanup.  https://review.openstack.org/60837923:01
openstackgerritRenis Makadia proposed openstack/openstack-helm-infra master: [WIP] Ceph-RGW chart cleanup.  https://review.openstack.org/60837923:26
*** roman_g has quit IRC23:35
*** sthussey has quit IRC23:36
openstackgerritRenis Makadia proposed openstack/openstack-helm master: [WIP] Ceph-rgw cleanup - update deploy script  https://review.openstack.org/60838523:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!