Friday, 2018-08-10

openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722400:00
*** pmannidi has joined #tripleo00:00
openstackgerritIan Main proposed openstack/python-tripleoclient master: WIP: Speed up plan operations by using a tarball in swift.  https://review.openstack.org/58114100:04
openstackgerritIan Main proposed openstack/tripleo-common master: WIP: Use process-templates.py and cache templates to speed up plan ops.  https://review.openstack.org/58115300:05
*** mschuppert has joined #tripleo00:05
openstackgerritIan Main proposed openstack/tripleo-common master: WIP: Use process-templates.py and cache templates to speed up plan ops.  https://review.openstack.org/58115300:06
*** mrsoul has joined #tripleo00:07
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071900:09
*** gbarros has quit IRC00:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058700:17
*** morazi has quit IRC00:19
*** agopi has joined #tripleo00:26
*** slagle has quit IRC00:36
*** gbarros has joined #tripleo00:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Podman support for docker-puppet  https://review.openstack.org/58865500:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Podman support for docker-puppet  https://review.openstack.org/58865500:44
*** gbarros has quit IRC00:54
*** jtomasek_ has quit IRC00:58
tonybI'm trying to create a custom slimed down contoller role, is there some easy to find minimum set of services?01:04
*** slaweq has joined #tripleo01:11
*** slaweq has quit IRC01:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman  https://review.openstack.org/59058701:16
*** jtcressy has joined #tripleo01:21
openstackgerritJon Schlueter proposed openstack/tripleo-heat-templates stable/queens: Move the shebang to /usr/bin/python  https://review.openstack.org/59059301:29
*** mrsoul has quit IRC01:36
*** mschuppert has quit IRC01:36
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: nova: add parameters to configure nova::cron::archive_deleted_rows  https://review.openstack.org/58744601:36
openstackgerritMerged openstack/tripleo-quickstart master: Enable containerized undercloud in upgrades jobs.  https://review.openstack.org/58351501:41
openstackgerritJon Schlueter proposed openstack/tripleo-common master: Put image name sections in sorted order  https://review.openstack.org/51104101:52
*** jtcressy has quit IRC01:55
*** gbarros has joined #tripleo02:11
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Remove unecessary back-slashes in CephManilaClientKey caps mon  https://review.openstack.org/58918602:12
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: list and show  all the available flavors prior to introspection  https://review.openstack.org/59003602:30
*** dxiri has quit IRC02:30
openstackgerritMerged openstack-infra/tripleo-ci master: Periodic fs050: add promotion hash in "previous" function  https://review.openstack.org/59033902:31
openstackgerritMerged openstack/tripleo-quickstart master: supplemental node: Replace pause with wait_for  https://review.openstack.org/59024802:31
openstackgerritMerged openstack/tripleo-common master: Avoid getting one-empty-element-list in blacklisted_hostnames.  https://review.openstack.org/58915302:31
openstackgerritMerged openstack/tripleo-heat-templates master: DeployedServer support for cidr via get_attr  https://review.openstack.org/58812202:31
openstackgerritMerged openstack/puppet-tripleo master: Fix containerized logrotate configuration  https://review.openstack.org/58921302:31
openstackgerritMerged openstack/tripleo-common master: Action to perform container image prepare  https://review.openstack.org/58591302:31
openstackgerritMerged openstack/tripleo-common master: Add sudoers entry for tripleo-container-image-prepare  https://review.openstack.org/58810102:31
openstackgerritMerged openstack/tripleo-heat-templates master: Break out image prepare into its own "service"  https://review.openstack.org/58191802:31
*** psachin has joined #tripleo02:49
*** gbarros has quit IRC03:05
*** gbarros has joined #tripleo03:07
*** slaweq has joined #tripleo03:11
*** slaweq has quit IRC03:15
*** rh-jelabarre has quit IRC03:28
*** skramaja has joined #tripleo03:29
*** gbarros has quit IRC03:30
*** Petersingh has joined #tripleo03:36
*** Petersingh is now known as Petersingh|brb03:37
openstackgerritMerged openstack/python-tripleoclient master: Insert break lines when showing FFWD upgrade operator warning.  https://review.openstack.org/58779303:45
*** udesale has joined #tripleo03:49
*** itlinux has joined #tripleo03:54
*** skramaja has quit IRC03:59
*** sanjayu_ has joined #tripleo04:01
*** numans has quit IRC04:02
*** ykarel|away has joined #tripleo04:03
*** Petersingh|brb is now known as Petersingh04:18
*** skramaja has joined #tripleo04:20
*** jaganathan has joined #tripleo04:25
*** janki has joined #tripleo04:25
*** sanjayu__ has joined #tripleo04:25
*** sanjayu_ has quit IRC04:28
*** ykarel|away is now known as ykarel04:39
Tenguhello htere :)04:47
jaosoriorgood morning!04:47
Tenguhow are you today jaosorior ?04:47
jaosoriorall good, you?04:47
Tengunot bad at all :).04:47
openstackgerritCédric Jeanneret proposed openstack/instack-undercloud stable/queens: Set Red Hat default SSHD configuration properly  https://review.openstack.org/59064404:48
openstackgerritCédric Jeanneret proposed openstack/instack-undercloud stable/pike: Set Red Hat default SSHD configuration properly  https://review.openstack.org/59064504:48
openstackgerritCédric Jeanneret proposed openstack/instack-undercloud stable/ocata: Set Red Hat default SSHD configuration properly  https://review.openstack.org/59064604:49
Tengubam04:49
Tengujaosorior: lightning speed :)04:49
*** artom has quit IRC04:50
*** itlinux has quit IRC04:51
*** slaweq has joined #tripleo05:11
*** gkadam has joined #tripleo05:12
*** slaweq has quit IRC05:16
*** shyamb has joined #tripleo05:17
*** janki has quit IRC05:19
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix libvirt_type kvm for overcloud deploy  https://review.openstack.org/58757205:20
*** ykarel_ has joined #tripleo05:26
*** ykarel has quit IRC05:28
*** janki has joined #tripleo05:28
*** ykarel__ has joined #tripleo05:28
*** yprokule has joined #tripleo05:30
*** ksambor has joined #tripleo05:30
*** ykarel_ has quit IRC05:31
*** shyamb has quit IRC05:35
*** shyamb has joined #tripleo05:38
openstackgerritHonza Pokorny proposed openstack/puppet-tripleo master: Add apaches expires directive for js and css files  https://review.openstack.org/58957205:40
*** jtcressy has joined #tripleo05:40
*** jfrancoa has joined #tripleo05:41
*** quiquell has joined #tripleo05:42
openstackgerritHonza Pokorny proposed openstack/tripleo-validations master: Add SSL certificate validation  https://review.openstack.org/59021405:42
shyambHi05:43
*** ratailor has joined #tripleo05:43
shyambGood morning05:43
shyambTengu: jaosorior: Hi05:43
shyambMy container is ready05:43
shyambI want to integrate it with director05:44
Tengushyamb: heya! you will need to add it as a new service in tripleo. You might want to see how the docker/services/*.yaml are integrated in the roles.05:45
shyambTengu: jaosorior: Thanks, I have done that in last release05:46
Tenguand I'd say you'll need to learn a bit about kolla, but not 100% sure on that05:46
shyambSo I am familier with some concepts05:46
shyambI have some particular questions05:46
shyamb1. How Can I commit my container to undercloud registry (I am using local registry on undercloud)05:47
shyamb2. How to map service name in roles data to container image name in overcloud image file?05:49
*** shyamb has quit IRC05:54
*** tzumainn has quit IRC05:54
*** ratailor has quit IRC05:58
Tenguhave to go, I'll be back in about 2 hours.06:00
Tengushadower: I can't really help you on that unfortunately.06:00
*** mschuppert has joined #tripleo06:01
openstackgerritMerged openstack/diskimage-builder master: better handle existing keywords files/directories  https://review.openstack.org/57763306:07
*** jtcressy has quit IRC06:10
*** kopecmartin has joined #tripleo06:11
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Force cinder properties to be set on ly on nodes with pcmk on it  https://review.openstack.org/58814806:12
*** florianf has joined #tripleo06:13
*** shyamb has joined #tripleo06:15
shyambTengu: Any thoughts on my doubts?06:15
*** ratailor has joined #tripleo06:16
shyambDoes kolla installs docker container during overcloud deployment?06:18
shyambOr puppet?06:19
*** ratailor has quit IRC06:20
*** ykarel_ has joined #tripleo06:23
*** ratailor has joined #tripleo06:24
*** ykarel__ has quit IRC06:26
*** trozet has quit IRC06:27
*** florianf has quit IRC06:28
*** florianf has joined #tripleo06:29
shyambTengu: I see some datapoints in heat config file06:31
shyambI should be able to figure it out06:31
AeliaIts been a few days I am asking, but still nobody available to help me track my "openstack overlay deploy" issue (for a scale up of an already-existing cluster) which failed at a step OS:Mistal:ExternalResource more info here -> https://gist.github.com/dabelenda/5ab01a1ecab808c0e9734741019443c0#file-heat-stack-state ?06:32
*** jtomasek has joined #tripleo06:32
Aeliaor maybe I should open a bug ?06:32
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Calculate TOCI_JOBTYPE from individual variables  https://review.openstack.org/59020906:38
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Calculate TOCI_JOBTYPE from individual variables  https://review.openstack.org/59020906:39
*** janki has quit IRC06:41
*** pcaruana has joined #tripleo06:43
*** ccamacho has joined #tripleo06:50
shyambHi06:54
*** apetrich has joined #tripleo06:55
jaosoriorshyamb: no, kolla is used to build the containers, not to install them.06:56
*** ykarel__ has joined #tripleo06:56
jaosoriorshyamb: the containers are pulled from the registry during overcloud deployment06:56
shyambjaosorior: For testing purpose I want push my container to undercloud registry06:57
jaosoriorwe have a tool (which is integrated with the openstack CLI) in order to generate the necessary yaml files to point the overcloud deployment to the right url06:57
jaosoriorshyamb: docker push?06:57
shyambjaosorior: yes, maybe I need change the url06:57
jaosoriorit's a matter of pushing the image yourself, you could use docker, skopeo, or whatever tool you like best06:57
shyambby default it will go to docker.io06:58
jaosoriorshyamb: http://tripleo.org/install/containers_deployment/overcloud.html06:58
*** egonzalez has joined #tripleo06:58
jaosoriorshyamb: openstack overcloud container image prepare is what you're looking for06:58
shyambyeah06:59
*** ykarel_ has quit IRC06:59
shyambCan I use it for custom container located on my machine?06:59
jaosorioryeah06:59
shyambGreat06:59
jaosoriorshyamb: so that'll generate a yaml file that you'll pass to the overcloud deployment06:59
shyambLet me try it06:59
jaosoriorand you can add your custom images to that yaml file07:00
*** quiquell has quit IRC07:00
shyambIn docker/services/*.yml we have many steps07:00
*** ykarel__ is now known as ykarel07:01
*** quiquell has joined #tripleo07:01
shyambI understood docker_config step07:01
jaosoriorshyamb: yes, each step is ran in a different part of the deployment.07:01
shyambbut not kolla_config step07:01
shyambAny detailed doc which can explain all these steps?07:01
jaosoriorshyamb: there was... at some point, but I think it's out of date07:02
shyambkolla_config, docker_config, upgrade_tasks etc07:02
*** jpich has joined #tripleo07:02
shyambhmm07:02
jaosorioranyway07:02
jaosoriorkolla_config will generate a file on the host that will be used as the configuration for kolla07:02
*** amoralej|off is now known as amoralej07:02
jaosoriorremember that kolla is the tool that we used to build the images07:02
jaosoriorso, kolla can take extra configurations or commands07:02
shyambOut of these steps, Can I skip If I dont need few of these07:03
jaosorioryou can use that configuration to tell it what binary to run when it starts the container (that's what it's mostly used for)07:03
shyambFor ex, I don't need puppet_config07:03
jaosorioror, you can tell it to copy files, or fix the permission of files07:03
jaosoriorshyamb: yes you can\07:03
jaosorioryou can skip it, no problem.07:03
shyambok07:04
shyambI think I only need kolla config and docker_config07:04
shyambas I just want to run my container07:04
shyambno other changes I need on host07:04
jaosoriorcool07:04
shyambWhat about upgrade tasks?07:04
jaosoriorwell, that's meant to run on an overcloud upgrade07:05
shyambUpgrade_tasks and upgrade_fast_forwad07:05
jaosorioryou know your service better than I do :)07:05
jaosoriorwas it running in a previous OSP release? will you need to upgrade? (stop the previous process and such)07:05
*** slaweq has joined #tripleo07:05
shyambMy service will run in container, so during overcloud upgrade will it replace the container or will it just update rpms?07:05
*** slaweq has quit IRC07:06
jaosorior shyamb well, in an update (different than an upgrade), if your service configuration changes, tripleo itself (using a tool called paunch) will replace the container, and run another one with the new config07:06
*** slaweq has joined #tripleo07:07
shyambok07:07
*** rcernin has quit IRC07:07
shyambIf only rpms getting changed then?07:07
jaosoriorshyamb: however, for ugprades, that means that you had an overcloud (a version or even older) that was running. And now you decide to go to queens or to rocky (depending on when do you plan to introduce the service); are there tasks you need when this upgrade happens?07:07
jaosoriorif you had that service running already in an older overcloud, maybe you need to stop the service, so now it'll be a container07:08
jaosorioror maybe you need to backup the database07:08
jaosoriorit all depends on your service07:08
jaosoriorshyamb: rpms shouldn't affect your container.07:08
shyambohh, I see07:08
jaosoriorshyamb: the container runs on its own user-space, it should have all the rpm dependencies that you need there.07:08
jaosoriorand should not rely on the host.07:08
shyambI think I can ignore that for now07:08
shyambI see these upgrade and upgrade fast are ansible code07:09
jaosorioryeah07:09
shyambDoes it runs on host?07:09
shyambor container?07:09
jaosoriorhost07:09
shyambok07:09
shyambThen I don't need those blocks07:09
shyambfor now07:09
jaosoriorshyamb: ok, so a good example of how the upgrade block is needed is keystone07:09
jaosoriorin osp11, keystone was running on baremetal (on the host)07:10
jaosorioron osp12 it was set as a container07:10
jaosoriorso the upgrade steps take care of stopping the keystone service on the host07:10
jaosoriorand cleaning up the keystone packages on the host07:10
shyambyep07:10
*** holser_ has joined #tripleo07:10
shyambI get it completly07:10
jaosoriorand then the rest would be handled by the regular tripleo steps07:10
jaosoriorshyamb: cool cool07:10
shyambthanks07:10
jaosoriorno problem07:10
jaosoriorhappy to help07:10
shyambWhere can learn about kolla_config block?07:11
shyambthat is must for me07:11
shyambI have created y container using docker only07:11
shyambno kolla concept/tools applied07:11
jaosoriorshyamb: note that kolla is not a must07:11
jaosoriorit's just quite useful for us07:11
shyambAnything I need add here to container07:12
jaosoriorbut you could use just regular docker files07:12
shyambgreat07:12
shyambThat's what I belived07:12
shyamband started :)07:12
shyambjaosorior: Here is my public repo https://github.com/triliodata/triliovault-cfg-scripts/tree/master/redhat-director-scripts/docker/trilio-datamover07:13
shyambin case you want to take a look07:13
jaosoriormandre: do you know if kolla has any available docs related to the actions available? I'm talking about kolla_config; those actions don't seem to be documented... I tend to find them by browsing the kolla code-base.\07:13
jaosoriorshyamb: actually the dockerfile looks quite reasonable.07:14
shyambcool, thanks07:14
jaosoriorbrb07:15
*** jaosorior has quit IRC07:15
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add ability to import plan from Git repository  https://review.openstack.org/58817907:20
*** shyamb has quit IRC07:22
*** numans has joined #tripleo07:22
*** ratailor has quit IRC07:25
*** janki has joined #tripleo07:27
*** shyamb has joined #tripleo07:30
*** Petersingh is now known as Petersingh|lunch07:40
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Force cinder properties to be set on ly on nodes with pcmk on it  https://review.openstack.org/58814807:41
*** pmannidi has quit IRC07:42
*** ykarel is now known as ykarel|lunch07:43
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add tags to OpenShift external tasks to allow upgrading it separately  https://review.openstack.org/59068307:46
*** akrivoka has joined #tripleo07:49
openstackgerrithanish proposed openstack/puppet-tripleo master: Added Containerization support for Liquidio service  https://review.openstack.org/59020207:51
*** udesale has quit IRC07:51
*** udesale has joined #tripleo07:51
*** jpena|off is now known as jpena07:55
Tenguback.07:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044508:00
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Running containerized tempest only in containerized environment  https://review.openstack.org/57778008:09
*** psachin has quit IRC08:13
*** shyamb has quit IRC08:15
*** ratailor has joined #tripleo08:17
*** psachin has joined #tripleo08:28
*** chem has joined #tripleo08:30
*** janki has quit IRC08:32
*** derekh has joined #tripleo08:33
*** aufi has joined #tripleo08:33
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Upgrades: Refactor playbooks to set facts  https://review.openstack.org/57652008:34
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Upgrades: Refactor package removal to step3  https://review.openstack.org/57652108:34
*** lyarwood is now known as lyaaaaaaaaaaaaaa08:34
*** lyaaaaaaaaaaaaaa is now known as lyaaaaaarwood08:34
*** bogdando has joined #tripleo08:36
*** janki has joined #tripleo08:43
*** ykarel|lunch is now known as ykarel08:45
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: WIP Disable management plugin by default  https://review.openstack.org/59070508:50
*** assassin has joined #tripleo08:51
*** ssbarnea has quit IRC08:52
*** shyamb has joined #tripleo08:55
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Use fqdn for live_migration_inbound_addr  https://review.openstack.org/59036208:57
*** rdopiera has joined #tripleo09:01
*** Petersingh|lunch is now known as Petersingh09:02
*** gfidente has joined #tripleo09:04
*** radeks has joined #tripleo09:06
*** salmankhan has joined #tripleo09:09
openstackgerritAna Krivokapic proposed openstack/tripleo-common master: Add support for custom validations  https://review.openstack.org/56951309:23
Tengubandini: heya! would it be possible to get your votes on https://review.openstack.org/#/c/590644/ ? It would be great if this cherry-pick could be merged :)09:25
Tengubandini: thank youuu :)09:28
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Add a script to compare playbook executions  https://review.openstack.org/58847509:28
bandini;)09:29
Tengubandini: there's also the cherry-pick in order versions, but it can wait a bit more :]09:29
Tenguneed the queens for rhos-13.09:29
*** ssbarnea has joined #tripleo09:32
*** shyamb has quit IRC09:37
*** Petersingh is now known as Petersingh|afk09:39
*** aufi has quit IRC09:39
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Make sure that stonith state is enforced before attempting a scaleup  https://review.openstack.org/58252109:46
Tengugfidente: heya! quick question: an "OS::Mistral::ExternalResource" in a deploy usually concerns ceph, right? Care to have a quick look here? https://bugs.launchpad.net/tripleo/+bug/178643409:47
openstackLaunchpad bug 1786434 in tripleo "openstack overlay deploy failed in heat resource_type OS::Mistral::ExternalResource" [Medium,Triaged]09:47
gfidenteTengu looks like the workflow failed09:48
*** jaosorior has joined #tripleo09:48
gfidenteTengu I'd check the mistral logs or ceph-ansible-install log09:48
Tengugfidente: erf... guess logs might be found on the ceph nodes directly?09:48
gfidenteTengu no on the undercloud, /var/log/mistral09:48
gfidentethis is the same workflow which deploys the cluster09:49
gfidenteon the initial deployment attempt09:49
Tenguyes, right. ok. will transmit.09:49
Tenguwill take the issue, but I might need some more help on it.09:50
*** Petersingh|afk is now known as Petersingh09:53
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Add a script to compare playbook executions  https://review.openstack.org/58847509:55
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible  https://review.openstack.org/58944810:01
*** aufi has joined #tripleo10:03
Tengua10:06
Tenguwoops10:06
Tengunom-nom-nom podman has some really interesting things, and its support of varlink might be really, really cool :D. jaosorior you might be interested on a security aspect.10:10
jaosoriorTengu: tell me more10:11
Tengujaosorior: as you probably know, rhel will drop docker in its 8th version. so we're looking for libpod usage and so on.10:12
jaosoriorright10:12
Tengujaosorior: while it's mostly compatible with docker, libpod and podman lacks some features, like auto-restart and so on.10:12
Tenguwe will have a discussion next week about some aspects - I was all "create one systemd service per container" in order to get some nice systemctl restart container-foo for example.10:13
Tengubut, while digging deeper in that new world, I stumbled on varlink and its support in libpod.10:13
Tengumostly: https://www.projectatomic.io/blog/2018/05/podman-varlink/10:13
jaosoriorTengu: right, podman/libpod goes with the assumption that you'll use some orchestration to verify liveliness and do appropriate start/stop/restarts with it. It merely takes care of creating the container.10:14
Tenguthis will create a local socket allowing to make API calls10:14
Tenguand I'm all "woooww that is nice and cool and foo", and it might be interesting to get some security insights about that, especially regarding rights on the socket and the like.10:14
jaosoriorlet me give it a read10:15
Tengubasically, using varlink makes libpod work lik docker :).10:15
jaosoriorTengu: where will you have the discussion about it next week? here in the channel?10:15
Tenguand there is even python bindings.10:15
Tengujaosorior: on BJ - linked to https://etherpad.openstack.org/p/tripleo-podman10:15
jaosoriorTengu: when?10:16
jaosoriorlets see10:16
*** aufi has quit IRC10:16
Tenguhmm. 10pm XD - in order to get sbecker10:16
jaosoriorI don't see the BJ link10:16
Tengunah, he didn't push it - not 100% sure it's an "open" discussion on bj.10:17
Tenguwill check that with Emilien on Monday.10:17
Tenguhe won't be connected today10:17
jaosoriorOk, let me know; I'm interested in this.10:17
Tenguwas pretty sure you would be. Will send an email in fact, he will probably read it anyway.10:18
*** tosky has joined #tripleo10:19
jaosoriorTengu: I agree with your statement, it makes it quite similar to how docker works. And it should be treated similarly: Don't let random things mount that socket, protect the hell out of it10:19
Tengu:)10:20
Tenguas we're at the very beginning, we have to think before doing stuff we will regret later.10:20
jaosoriorindeed10:20
Tengumail sent to EmilienM - you're in Cc, let's see how it goes.10:20
jaosoriorit all depends on the direction we want to go with our containers really10:21
Tenguyup.10:21
Tenguin fact.... I'm still surprised we don't use a real scheduler.10:21
jaosoriorI also wouldn't go for the rkt/nspawn solution either ;)10:21
jaosoriorTengu: that's where I was going :)10:22
Tengulike, I don't know, k8s.10:22
jaosoriorat what point do we try to refactor everything to work with...docker...systemd... or whatever10:22
Tengu^^10:22
jaosoriorand not use an actual orchestrator already10:22
jaosorioreither way, k8s can use CRI-O, which uses libpod10:22
Tenguyup10:22
* jaosorior working on a presentation about these things for my team for next week :)10:23
Tengu\o/10:23
*** Petersingh is now known as Petersingh|afk10:24
Tengujaosorior: I'm happy to see I'm not the only one secretly (or not) whishing for a proper scheduler.10:25
jaosoriorTengu: it would make a lot of things easier10:25
jaosoriorand harder10:25
jaosorior:)10:25
jaosoriorwe just gotta have a proper and honest discussion about this10:25
jaosoriorweight in the pros and cons10:25
jaosoriorand figure out the way we want to move forward10:25
Tenguyup. guess this is the right time to do that, as we have to move away from docker anyway.10:26
jaosoriorbut I'm with you in this, it would be good to give that option a chance for a proper evaluation10:26
jaosoriorbecause yes, we can move to systemd, that wouldn't be thaaat much effort, as our current containers can run easily with podman.... but all the monitoring and metrics tooling, and all the management stuff we gotta do instead... should that effort be put in k8s instead? who knows. LEts talk about it on Tuesday :)10:27
jaosoriormaybe everybody else thinks it's a terrible idea but you and me, who knows10:28
*** ykarel_ has joined #tripleo10:28
*** ykarel__ has joined #tripleo10:30
*** ykarel has quit IRC10:30
*** ykarel_ has quit IRC10:33
*** panda|ruck|off is now known as panda|ruck10:33
*** tosky has quit IRC10:35
*** tosky has joined #tripleo10:36
*** udesale has quit IRC10:36
jaosoriorTengu: how's the SSHd backports going?10:36
Tengujaosorior: will be merged in queens shortly.10:37
Tengujaosorior: once it's done, I'll be able to cherry-pick it downstream :)10:38
jaosoriorTengu: how's the validation work going?10:40
Tengujaosorior: had to re-submit it, it was merged a bit too quickly.10:41
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Migrate tripleo-packages service to ansible package module  https://review.openstack.org/59074210:41
Tenguso waiting for a new validation from florianf after the latest changes (and other ppl). New link: https://review.openstack.org/58916910:41
Tengufeel free to jump in again :)10:42
*** udesale has joined #tripleo10:47
florianfakrivoka: ^ I added a couple of notes re custom validations to Tengu's spec draft yesterday. Would you like to have a look too?10:50
Tenguflorianf: hello! I've updated the content to take your notes in consideration - feel free to validate the new forms :)10:51
akrivokaflorianf: I'll have a look, thanks!10:51
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071910:53
*** shyamb has joined #tripleo10:57
Tenguakrivoka: thank you :)10:58
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/queens: Skip Ceph packages when running tripleo-packages  https://review.openstack.org/59074610:59
*** dtantsur|afk is now known as dtantsur11:01
shyambHi11:02
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: enable ansible colored output on ci  https://review.openstack.org/59074811:03
shyambTengu: which are the mandatory parameters I need to declare in heat service template for my container?11:03
shyambLike ServiceData, ServiceMap?11:04
shyambI don't use them, do I need to declare? In RHOSP10 I heard few of them were mandatory11:04
*** jpena is now known as jpena|lunch11:06
shyambjaosorior: Any thoughts?11:06
Tengushyamb: yep, some are mandatory. wait, I had to do that lately.11:06
Tengushyamb: this one is the minimal: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/xinetd.yaml11:06
Tengushyamb: also take care of the content of the outputs section - in the file I just pointed, it's also just the mandatory parts.11:09
*** Petersingh|afk is now known as Petersingh11:10
*** aufi has joined #tripleo11:10
shyambTengu: Thank you11:11
*** bogdando has quit IRC11:11
*** dsneddon has quit IRC11:12
*** shyamb has quit IRC11:15
*** shyamb has joined #tripleo11:15
*** holser_ has quit IRC11:18
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci master: [WIP] Testing a ansible-ml2 job  https://review.openstack.org/58229411:23
*** odyssey4me has joined #tripleo11:24
*** dsneddon has joined #tripleo11:24
*** rh-jelabarre has joined #tripleo11:26
odyssey4meHi folks - I thought I'd introduce myself here given the discussion on the ML around collaborating on Ansible roles. My name's Jesse Pretorius. I'm a core contributor on the OpenStack-Ansible project, am action orientated and very happy to see these discussions happening and am ready to get stuck in to help make it happen.11:26
odyssey4meI've worked on OSA since its inception in Icehouse and have worked with OpenStack since Essex. I'm very happy to discuss any of our tribal knowledge, our history, why we do things the way we do it, etc in the hopes that we can learn from our mistakes in this new venture. :)11:28
Tenguodyssey4me: hey, welcome :)11:29
*** aufi has quit IRC11:29
Tenguflorianf: thank you for the +2 - if akrivoka is OK with the current state, I suppose I can drop my w-1 and let it merge at will, or shall I keep it like that in order to get some more votes?11:32
*** morazi has joined #tripleo11:33
shyambTengu: How can we populate my config file in container with dynamic values during overcloud deployment?11:35
shyambOld way I followed is like this https://github.com/shyam-biradar/triliovault-cfg-scripts/blob/master/redhat-director-scripts/heat/trilio-datamover.yaml11:36
shyambOn RHOSP1011:36
shyambTengu: Can you take a look and let me know if this is still valid in osp13?11:36
shyambconfig_settings is the section you need verify11:36
Tengushyamb: I think it's still valid, but you might want to ask someone else in order to get a better answer.11:37
shyambhmm11:37
shyambok11:37
Tenguwith the container thingy, there's also kolla in the place, so.... not 100% sure. Still not comfortable with that.11:38
shyambSure11:38
shyambthanks11:38
shyambjaosorior: Are you still there?11:38
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add cleanup service for neutron ovs bridges  https://review.openstack.org/58956911:38
shyambAnybody else have thoughts?11:38
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Fix periodic undercloud install release file  https://review.openstack.org/59075011:40
jaosoriorshyamb: that looks good to me11:40
shyambHow does nova.conf get's populated?11:41
shyambin container?11:41
jaosoriorshyamb: as mentioned before, you gotta bind mount it.11:41
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Fix periodic undercloud install release file  https://review.openstack.org/59075011:41
jaosoriorshyamb: there is a step where puppet gets run on a container, and it'll generate the appropriate files to /var/lib/config-data/puppet-generated/<service>11:41
*** udesale has quit IRC11:41
jaosorioronce you have that, what we do is that we bind-mount the configuration on to the container11:42
shyambYou mean puppet created this directory on host11:42
shyamband we should mount it11:42
shyambSame for my conf files11:42
jaosoriorthat directory exists on the host11:42
jaosoriorso you gotta mount what you need from there11:42
jaosoriorso11:42
jaosoriorfor instance11:42
*** udesale has joined #tripleo11:42
jaosoriorkeystone11:42
shyambI want to create my own service conf file like /etc/tvault-contego/tvault-contego.conf11:43
jaosoriorThis is how we run a container that's needed for keystone, on step_3 https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L14411:43
jaosorioryou can see the volumes there11:43
jaosoriorspecifically https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L15611:43
shyambok11:43
owalshshyamb: hi11:43
jaosoriorshyamb: so it depends on how you want to generate that configuratoin11:43
jaosoriorif you already have puppet integration in place11:43
jaosorioryou can run docker-puppet11:43
jaosoriorwhich is run like this https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L10811:44
shyambhmmm11:44
shyambdocker-puppet?11:44
owalshshyamb: got an example tvalut-contego.conf?11:44
shyambI see bind mount is simple11:44
jaosorioryou tell it what the name of the container is, what tags should it run, and it'll run puppet on a container and generate what you need11:44
jaosoriorthat's what eventually will fill up /var/lib/config-data/puppet-generated11:44
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Add a script to compare playbook executions  https://review.openstack.org/58847511:44
jaosoriorsubsequently, once you have the configuration ready, you can bind-mount it to your container11:45
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable mistral tempest tests in fs027  https://review.openstack.org/56564211:45
shyambowalsh: yes11:45
shyambowalsh: https://github.com/shyam-biradar/triliovault-cfg-scripts/blob/master/redhat-director-scripts/docker/trilio-datamover/tvault-contego.conf11:45
owalshshyamb: I don't see any value there that come from nova.conf11:46
*** Petersingh is now known as Petersingh|afk11:46
shyambjaosorior: So currently rhosp director is using docker-puppet to populate conf files?11:46
jaosoriorcorrect11:46
jaosoriorwe use puppet to generate the configuration files11:47
shyambOr there is any other way like create conf file on host and mount11:47
jaosoriorand puppet gets run on a container.11:47
jaosoriorsure, you could use ansible11:47
jaosorioryou could use an external ansible role like this https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/services/ipsec.yaml#L117 (the role needs to be installed in the undercloud)11:48
shyambowalsh: I don't want nova.conf parameters there11:48
shyambJust given an example11:48
jaosorioror you could just specify the ansible tasks through deploy_steps_tasks11:48
shyambhmm11:48
shyambjaosorior: ok11:48
owalshshyamb: you said that you need to populate it with dynamic values during deployment?11:49
shyambowalsh: yes, I want to populate contego conf with my values like nfs share11:49
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Refactor timeout logic  https://review.openstack.org/58906811:50
*** ykarel_ has joined #tripleo11:50
owalshshyamb: ok... but you need nova.conf for something too?11:51
*** ykarel__ has quit IRC11:53
*** Petersingh|afk is now known as Petersingh11:53
*** shyamb has quit IRC11:54
*** shyamb has joined #tripleo11:54
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Fix periodic undercloud install release file  https://review.openstack.org/59075011:55
shyambowalsh, yes I need nova.conf also11:57
shyambI will mount it in ro mode11:57
shyambno issue of it11:57
owalshshyamb: giving nova full sudo access is a security risk - https://github.com/shyam-biradar/triliovault-cfg-scripts/blob/master/redhat-director-scripts/puppet/trilio/manifests/contego/postinstall.pp#L3212:01
*** jpena|lunch is now known as jpena12:02
shyambyes12:03
*** jaosorior has quit IRC12:03
shyambowalsh: I will think something for it12:03
*** sri_ has quit IRC12:05
*** ratailor has quit IRC12:05
Tengupanda|ruck rfolco|rover heya! is this a transcient issue on gate, or some real issue? http://logs.openstack.org/44/590644/1/gate/tripleo-ci-centos-7-containers-multinode/c12c6d3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-10_11_49_3112:08
*** bogdando has joined #tripleo12:08
owalshshyamb: ok... so picking through the ansible/puppetI can see that the systemd service is passed the nova.conf file. So that's why it's needs to bind mount nova.conf12:09
*** shyamb has quit IRC12:10
*** dprince has joined #tripleo12:12
rfolco|roverTengu, looking12:12
*** dprince has quit IRC12:12
panda|ruckTengu: rfolco|rover I don't thinks it's transient12:13
*** dprince has joined #tripleo12:13
Tengurelated change: https://review.openstack.org/#/c/590644/12:13
Tengubut the issue isn't due to the code I think12:13
florianfTengu: We already had a couple of +2s on the last patch, so I guess once akrivoka is fine with it how about removing the -1 but maybe not push for it to get merged for another couple of days?12:17
Tenguflorianf: fine for me.12:17
rfolco|roverTengu, I am not seeing any errors on the containers multinode job , if not transient, then you are the lucky first one to hit this, will take a closer look at the logs now12:18
Tengurfolco|rover: ok, thanks! I love being lucky ;)12:18
Tengurfolco|rover: I'm waiting for the job to finish and run a recheck12:18
*** quiquell has quit IRC12:20
*** sri_ has joined #tripleo12:20
*** ansmith has joined #tripleo12:26
*** ykarel_ is now known as ykarel12:27
*** amoralej is now known as amoralej|lunch12:28
*** Petersingh has quit IRC12:29
*** udesale has quit IRC12:34
*** skramaja has quit IRC12:34
*** janki has quit IRC12:35
*** abishop has joined #tripleo12:35
*** holser_ has joined #tripleo12:35
*** lblanchard has joined #tripleo12:38
*** raildo has joined #tripleo12:39
*** psachin has quit IRC12:39
*** holser_ has quit IRC12:41
akrivokamandre: thanks for your help with debugging the custom validation CI failure12:41
*** trown|outtypewww is now known as trown12:41
*** holser_ has joined #tripleo12:41
akrivokamandre: running into a different failure now, any idea why /usr/bin/tar might be missing? http://logs.openstack.org/13/569513/9/check/tripleo-ci-centos-7-containers-multinode/f9bc568/logs/undercloud/var/log/containers/mistral/executor.log.txt.gz#_2018-08-10_10_49_45_67112:42
akrivokamandre: is this related to undercloud containerization?12:42
*** waleedm has joined #tripleo12:44
*** shyamb has joined #tripleo12:46
*** tzumainn has joined #tripleo12:54
*** jcoufal has joined #tripleo12:55
trownmandre: good morning... I am trying to rebase https://review.openstack.org/582495 ... is openshift_image_tag used in our current job? ie if I just leave your yaql there... which i think resolves to 3.9... will we still get 3.10 right now?12:55
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: enable ansible colored output on ci  https://review.openstack.org/59074812:56
trownmandre: or do I also need to put up a patch somewhere else to update it so DockerOpenshiftBaseImage defaults to a 3.10 one12:56
trownmandre: which I guess would be: https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml12:59
*** egonzalez has quit IRC13:03
shyambHi13:07
shyambIn kolla_config section of docker heat template, I see command as httpd in for all containers13:08
shyambAny idea on why is it httpd for all containers?13:08
shyambhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/cinder-api.yaml13:09
mwhahahashyamb: because they run behind httpd in the container13:09
shyambok13:09
mwhahahashyamb: we use mod_wsgi to launch the actual apis, so the running process in the container is httpd13:09
mwhahahaexception being neutron13:10
mwhahahawhich does not support httpd13:10
shyambok13:10
shyambI see13:10
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L11713:10
shyambIn old releases only keystone service was running as part httpd13:10
mwhahahacorrect that has changed over the last few releases as the upstream has moved to wsgi as the way to run the services13:11
chandankumarmwhahaha: please have a look at this https://review.openstack.org/58984913:11
mwhahahachandankumar: right the question was do we need to make it configurable for the overcloud13:12
mwhahahachandankumar: it seems weird that it was disabled by mistral by default and i wanted to make sure there wasn't a reason to still allow it13:12
shyambThanks13:12
shyambthat is good to know13:13
Tenguhmm. wondering what zuul is waiting for -.-.13:13
chandankumard0ugal: if the mistral tempest tests were triggered against overcloud, yes we need to make it configurable on overcloud also13:13
chandankumarsorry13:13
chandankumarmwhahaha: ^^13:13
chandankumarmwhahaha: and this one also https://review.openstack.org/58436813:14
shyambAny idea on why we are calling puppet configuration for two times in heat template?13:15
shyambWe are calling puppet code using heat resource first13:16
shyamband then again defining puppet_config in output section13:16
akrivokaTengu: I made some comments on the spec, it looks really good to me, just want to ensure you are aware that once https://review.openstack.org/#/c/569513/ is merged, we are storing validations in swift by default13:16
mwhahahashyamb: depends on the service13:16
shyambmwhahaha: Ok, like?13:17
mwhahahashyamb: the puppet_config section is used to run configuration file related puppet in a docker container to generate the configs13:17
mwhahahashyamb: for some services we then run additional puppet to leverage the existing puppet providers to create keystone users and such later int he deployment13:18
mwhahahashyamb: so puppet_config is just config file, the other part withint he step config can include other execs or api related calls13:18
shyambmwhahaha:ok13:18
mwhahahashyamb: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L108-L117 is just the keystone and keystone domain config file generation13:19
mwhahahashyamb: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L219-L225 is deployment related configuration items but also include the original config bits13:19
mwhahaha(for idempotency)13:19
*** waleedm has quit IRC13:19
shyamblet me take a look13:20
Tenguakrivoka: also for the "default" validations? will the tripleo-validation package disappear?13:21
shyambmwhahaha: That is confusing13:22
shyambIn newton it was straightforward13:22
shyambOne puppet module and it will do all configuration13:22
shyamb:-)13:22
akrivokaTengu: yes for default as well, the validations already get uploaded to swift on undercloud install, the patch I linked changes the behavior of load/find/run actions to look for validations in Swift rather than the disk. the package will not disappear, we still need it as that is the source location we use for uploading validations to swift.13:22
*** amoralej|lunch is now known as amoralej13:23
*** ade_lee has joined #tripleo13:23
Tenguakrivoka: ok, just read your comment out. fact is: ansible run (aka from disk) will be mostly used prior an undercloud deploy, meaning no swift. That's intended, and the swift thing will mostly be supported since we'll be able to run the validation using the same UI "way" (workflow, and so on)13:24
Tenguakrivoka: I can emphasis that in the spec - have to push an update in order to correct the typo/rendering anyway.13:24
akrivokaTengu: ok cool, just wanted to double check you're aware of it13:24
akrivokaTengu: otherwise the spec looks great13:24
shyambmwhahaha: and we are calling again puppet code here also: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L70-L7813:25
*** radeks has quit IRC13:26
Tenguakrivoka: good news :). Thanks for your time and comments :)13:26
shyambFor my container I just want to populate a single config file in /etc/, how can I do it in simple way?13:26
shyambIt should be accessible on my container13:26
Tenguakrivoka: just one thing, regarding "double backticks", you mean ``foo``  right?13:26
akrivokaTengu: yes :)13:27
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10""  https://review.openstack.org/58946913:27
Tengugood :). being lost with all those markdown thingy -.-13:27
Tengugithub wants triple-backticks, another one wants single...13:27
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249513:28
shyambmwhahaha: Any thoughts on my query/13:28
akrivokaI have to look up differences between rst and md every. time.13:28
mwhahahashyamb: gimme a few mins I had to step away13:29
shyambmwhahaha: Sure13:30
shyambthanks13:30
*** dansmith is now known as SteelyDan13:31
openstackgerritCédric Jeanneret proposed openstack/tripleo-specs master: Validation Framework specifications  https://review.openstack.org/58916913:33
Tenguakrivoka: -^^ with some update/precisions/corrections :).13:33
Tenguakrivoka: I've linked your change for the custom validation as well - as it's a reference now.13:34
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: WIP: Attempt to speed up plan template processing  https://review.openstack.org/59077113:34
*** shyamb has quit IRC13:35
*** holser_ has quit IRC13:35
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Make redeploy idempotent  https://review.openstack.org/59000813:36
*** holser_ has joined #tripleo13:36
akrivokaTengu: thanks!13:36
*** gbarros has joined #tripleo13:39
Tenguakrivoka: :)13:40
*** ykarel is now known as ykarel|away13:41
apetrichthrash, toure|gone d0ugal I might have to skip scrum today. I will leave a status13:42
*** ratailor has joined #tripleo13:45
*** jistr is now known as jistr|call13:46
Tenguakrivoka: ah yep, far better with the double-backticks :). thanks for the tip, I'll try to remember that if I'm to push some new content later.13:53
thrashapetrich: ack13:54
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Add previous release entries for stein and rocky  https://review.openstack.org/59077313:55
openstackgerritJiri Stransky proposed openstack-infra/tripleo-ci master: Switch previous release of master from 'queens' to 'rocky'  https://review.openstack.org/59077413:55
*** mjturek has joined #tripleo13:55
*** toure|gone is now known as toure13:58
*** ykarel|away has quit IRC13:58
chemjistr|call: jfrancoa ccamacho panda|ruck: basically we need to have those variable correct https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/container-prep/tasks/main.yml#L15..L2413:59
jistr|callchem: ack yea14:00
*** jistr|call is now known as jistr14:00
*** apetrich has quit IRC14:00
jistrpanda|ruck: we should be able to land this one without affecting anything existing https://review.openstack.org/#/c/59077314:01
panda|ruckjistr: ah I see, yeah perfect, thanks.14:04
Tenguflorianf: dropped my w-1, let's see how it goes in the following days :).14:09
jistrpanda|ruck, chem, jfrancoa: hmm it seems the upgrade job on master is already downloading wrong images. I recall it worked well though, but it must have got broken. Both overcloud_prep_containers.log and upgrade_overcloud_prep_containers.log seem to download tripleomaster images...14:15
chemjistr: yeah, there have been some big refactoring going on ... need to be inverstigated14:16
chemjistr: we create a card for it (don't have time right now) ?14:17
jistrchem: ack will do14:17
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Add rocky featureset010 to the branchful jobs.  https://review.openstack.org/59077914:17
jfrancoajistr: which ones should it download instead?14:17
chemjfrancoa: tripleoqueens ?14:17
jfrancoajistr: or are you referring that during deploy it's downloading tripleomaster?14:18
jistrjfrancoa: when CIing patches to master, it should download tripleoqueens images in overcloud_prep_containers.log and tripleomaster images in upgrade_overcloud_prep_containers.log14:18
chemright14:18
jistrjfrancoa: yes overcloud_prep_containers.log refers to deploy14:18
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: Disable sasl migration user only if the db file exists  https://review.openstack.org/59078014:18
*** ksambor has quit IRC14:19
jfrancoajistr: oh..right, I didn't know if you were referring at the point we set up the containers for deploy or the upgrade. But you are right, overcloud_prep_containers.log is for deploy14:19
panda|ruckjistr: you're talking in general, or in that python script patch ?14:19
jistrpanda|ruck: in general. It's already broken in current state.14:20
panda|ruckjistr: which jobs are affected ? all upgrades job on master ?14:21
chemjistr: can you paste the log, I'll have a look real quick14:21
jistrchem: e.g. this one http://logs.openstack.org/87/589487/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/82b2d19/logs/undercloud/home/zuul/14:22
chemjistr: thanks14:22
panda|ruckweshay: FYI ^14:23
jistrpanda|ruck: yes, i think it probably affects upgrades job on stable branches too though. I bet we simply lost correct handling of overcloud_release and/or overcloud_docker_registry_namespace14:24
jistri'll report a LP bug too14:24
weshaythanks jistr, panda|ruck14:24
*** gbarros has quit IRC14:24
chemjistr: panda|ruck so the issue is there http://logs.openstack.org/87/589487/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/82b2d19/job-output.txt.gz#_2018-08-09_10_50_03_763013 we're skipping it14:26
chemjistr: panda|ruck the task that set the proper variable value14:26
chemjistr: panda|ruck so either container_build_id is defined or  use_overcloud_mixed_upgrade is false14:27
jistrweshay, panda|ruck, chem: https://bugs.launchpad.net/tripleo/+bug/178648814:27
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,Triaged]14:27
jistrhmm i should probably give it alert tag too14:28
panda|ruckjistr: yes, we are having only false positive at this point14:28
chemjistr: commented14:29
*** moguimar has joined #tripleo14:30
chemjistr: panda|ruck I think I got it, proposing a patch14:30
jistrchem: ack cool14:30
chemjistr: sorry got too excited :) the problem is elsewhere14:34
jistrok :)14:35
*** vinaykns has joined #tripleo14:37
*** gbarros has joined #tripleo14:39
*** rpioso|afk is now known as rpioso14:41
*** salmankhan has quit IRC14:43
weshaythat is some eye roll14:44
*** ccamacho has quit IRC14:47
*** salmankhan has joined #tripleo14:49
*** dxiri has joined #tripleo14:53
*** nhicher has joined #tripleo14:57
*** dxiri has quit IRC14:57
*** hamzy_ is now known as hamzy14:57
*** paramite has quit IRC14:58
*** dxiri has joined #tripleo15:01
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable support for running refstack tests in TQE  https://review.openstack.org/57071915:01
*** gbarros has quit IRC15:02
*** tosky has quit IRC15:03
*** ratailor has quit IRC15:07
*** yprokule has quit IRC15:08
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648815:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,Triaged]15:10
*** morazi has quit IRC15:10
chemjistr: panda|ruck oki, got to the bottom of it, see my last comment.15:12
jistrchem: wow that if/else is weird15:15
chemjistr: I can't use the template from another role, right ?15:16
jistrchem: i don't think so15:16
*** gbarros has joined #tripleo15:16
chemjistr: as for the if/else I guess it to be able to re-use the undercloud container configuration, which kind of make sense but completly break us15:16
chemjistr: I'm gonna sed it !15:17
*** kopecmartin has quit IRC15:18
panda|ruck/o\15:19
jistrchem: ok i get reuse of images, but why reuse the files? If the images are the same, the upload operation will take almost no time. We shouldn't try to overoptimize and risk breakage IMO. Run full prepare/upload both on undercloud and overcloud, and if it happens to use the same images (most jobs), then great, but if not (upgrade jobs), let's do the correct upload.15:19
jistrchem: also i must admit i don't fully follow how the reuse happens15:19
jistrah i guess this is only supported in Rocky+, that's why the pre-rocky command is so much more verbose15:20
jistrhttps://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/containers-prepare-parameter.yaml.j2#L415:20
chemjistr: well, this new configuration file is new to me too, so maybe the best way is to make sure that in the script we don't use the if part when mixed upgrade15:21
chemjistr I've been there already ... and it becomes foobar very quickly (overproliferation of variable conditional)15:22
*** morazi has joined #tripleo15:22
*** kopecmartin has joined #tripleo15:24
*** itlinux has joined #tripleo15:24
jistrchem: hm there are more `prepare` calls below in different if/else conditions. 4 in total. And there's just one `upload` call in one of the branches. When release == `master`, the upload never gets called...15:25
openstackgerritBogdan Dobrelya proposed openstack/tripleo-common master: Fail if pushing images into unknown registry  https://review.openstack.org/59079615:26
chemjistr: getting lost ... preparing a patch, and we can continue the discussion there15:26
jistrchem: that script will need some de-spaghettifying, it's quite difficult to follow what happens under what conditions...15:26
jistrchem: yea i'm getting lost too tbh :)15:26
chemjistr: oh boy you're rigth other if release later but with different releases15:26
jistrchem: yea /o15:26
jistranyway i'm OT/EOD/EOW today :)15:28
jistri'll look again on monday15:28
chemjistr: going to be off till wed, good we :)15:29
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates stable/queens: Correct Cinder NetApp backend name parameter mapping  https://review.openstack.org/59079915:29
jistrchem: ack, have a good pto :)15:30
*** paramite has joined #tripleo15:31
chandankumarweshay: https://review.openstack.org/#/c/589849/ needs +2 and +w on this15:38
*** paramite has quit IRC15:39
weshaychandankumar, ok.. let me verify those logs for a sec again15:45
*** rajinir has joined #tripleo15:45
*** sanjayu__ has quit IRC15:45
*** vinaykns has quit IRC15:54
*** gbarros has quit IRC15:59
*** kopecmartin has quit IRC15:59
*** gkadam has quit IRC16:06
*** bogdando has quit IRC16:08
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648816:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,Triaged]16:10
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Move the shebang to /usr/bin/python  https://review.openstack.org/59059316:13
*** jfrancoa has quit IRC16:21
*** jpena is now known as jpena|off16:22
Tengusee you on Monday!16:32
openstackgerritDavid Peacock proposed openstack/python-tripleoclient master: persist temporary installation  working files in archive dir  https://review.openstack.org/58992916:32
*** dprince has quit IRC16:33
dpeacockTengu: later tater16:33
*** jpich has quit IRC16:35
*** holser_ has quit IRC16:43
*** dprince has joined #tripleo16:46
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Don't use the undercloud containers during mixed upgrade.  https://review.openstack.org/59091216:46
*** panda|ruck is now known as panda|ruck|off16:48
sl0wjtomasek: any luck trying those patches?16:53
sl0wjtomasek: just wanted to ask why we're both possibly(?) still around16:54
myoungany idea why LP isn't being updated w/ patches posted with Closes-Bug: in the commit message?16:56
myounge.g. chem's patch just now: https://bugs.launchpad.net/tripleo/+bug/178648816:57
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,Triaged] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)16:57
*** salmankhan has quit IRC16:58
*** moguimar has quit IRC17:00
*** derekh has quit IRC17:01
*** dtantsur is now known as dtantsur|afk17:01
*** chem is now known as chem_gone17:01
*** mjturek has quit IRC17:02
*** chem_gone has quit IRC17:02
*** rdopiera has quit IRC17:02
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add cleanup service for neutron ovs bridges  https://review.openstack.org/58956917:03
*** jcoufal has quit IRC17:06
*** trown is now known as trown|lunch17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648817:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)17:10
*** gfidente has quit IRC17:22
*** jaganathan has quit IRC17:23
*** jcoufal has joined #tripleo17:24
*** amoralej is now known as amoralej|off17:34
*** jcoufal has quit IRC17:39
*** myoung is now known as myoung|lunch18:01
weshaybfournie, this should help in the future https://review.openstack.org/#/c/590036/18:03
bfournieweshay: nice18:03
weshayrfolco|rover, howdy.. do we have a bug on https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master/6142fb5/18:04
rfolco|roverweshay, looking...18:04
rfolco|roverweshay, looks like a new issue, checking how often18:06
weshayrfolco|rover++18:07
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648818:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)18:10
*** ooolpbot has quit IRC18:10
*** raildo_ has joined #tripleo18:10
*** gbarros has joined #tripleo18:12
*** raildo has quit IRC18:14
*** trown|lunch is now known as trown18:15
weshayrfolco|rover, thanks for looking into https://bugs.launchpad.net/tripleo/+bug/168635318:20
openstackLaunchpad bug 1686353 in tripleo "Proxy Options for TripleO QuickStart" [Critical,Incomplete] - Assigned to Rafael Folco (rafaelfolco)18:20
rfolco|roverweshay, please let me know if further actions on that one. I'd be happy to work on it.18:21
rfolco|roverweshay, panda|ruck|off just fyi opened 3node bug: https://bugs.launchpad.net/tripleo/+bug/1786520 <-- 3node jobs failing due to missing file UpgradeInitDeployment18:22
openstackLaunchpad bug 1786520 in tripleo "3node jobs failing due to missing file UpgradeInitDeployment" [Critical,Triaged]18:22
weshayrfolco|rover, did you understand my comments on the libvirt patch?18:22
weshayrfolco|rover, nice18:22
* weshay looks18:22
rfolco|roverweshay, yep, will make it work for manual deployment asap18:23
weshayok.. asap is optional18:23
weshay:)18:23
weshayas I'm sure there will be 10 other things18:23
rfolco|roverweshay, I liked that patch :)18:24
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare  https://review.openstack.org/57347618:24
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: Always enable image prepare service for docker clouds  https://review.openstack.org/58191918:25
openstackgerritwes hayutin proposed openstack/tripleo-common master: Add container_image_prepare_params to deployment workflow  https://review.openstack.org/58641818:25
rfolco|roverweshay, the bug you mentioned fs050 is a mistral failure (workbook could not be deleted somehow)18:25
rfolco|rover"Unable to delete the specified workbook(s).18:25
rfolco|roverfiling a bug...18:26
weshayya..18:26
weshaytoure, may be able to comment on that18:26
weshaytoure, did you get your package build issue resolved?18:26
tourenope18:26
tourestill broken18:26
* toure doesn't like rpms anymore18:27
weshaylolz18:27
tourerfolco|rover you have a mistral failure?18:27
* toure is catching up18:28
rfolco|roverhttp://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset050-upgrades-master/6142fb5/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz18:28
* toure looks18:28
rfolco|rovertoure, looks like our fs050 job is failing to delete workbooks18:28
*** apetrich has joined #tripleo18:29
chandankumarweshay: refstack job passed18:30
chandankumarweshay: https://review.openstack.org/570719 and https://review.openstack.org/58108418:30
chandankumararxcruz: ^^18:30
weshaychandankumar++18:31
openstackgerritMerged openstack/tripleo-upgrade master: HTTP test during update/upgrade/ffwd.  https://review.openstack.org/58707218:31
tourerfolco|rover so it looks like mistral thinks the workbook doesn't exist18:32
toureMistral workbooks.\nWorkbook not found workbook_name=tripleo.scale.v118:32
rfolco|rovertoure, weshay however, thinking better, previous failures are different cause (UNKNOWN_RELEASE)... so this is the first time this happens18:32
* toure looks through mistral logs18:33
openstackgerritMerged openstack-infra/tripleo-ci master: Replace TAGS with ansible var  https://review.openstack.org/58450818:36
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Instance create fails due to wrong default secontext with NFS  https://review.openstack.org/58294918:39
openstackgerritMerged openstack/instack-undercloud stable/queens: Set Red Hat default SSHD configuration properly  https://review.openstack.org/59064418:39
*** zaneb has joined #tripleo18:39
rfolco|roverhttps://bugs.launchpad.net/tripleo/+bug/178653318:40
openstackLaunchpad bug 1786533 in tripleo "periodic fs050 upgrades: Unable to delete the specified workbook(s)" [Critical,Triaged]18:40
rfolco|rovernick rfolco|rover|afk18:40
*** rfolco|rover is now known as rfolco|rover|afk18:40
tourerfolco|rover|afk that is a strange one, I can see where the workbook is create but for some reason when it goes to delete the workflow the api return the error of "unable to find workbook"18:43
tourebut I don't see anything where the job deletes the workbooks before hand18:43
*** paramite has joined #tripleo18:44
*** apetrich has quit IRC18:46
rfolco|rover|afkwill take a closer look and set up a reproducer when I get back18:50
rfolco|rover|afkthanks for looking toure18:50
touresure thing once you have the reproducer let me know I would like to hop on that system18:50
*** assassin has quit IRC18:51
*** gbarros has quit IRC18:52
*** mjturek has joined #tripleo18:55
*** mrunge has quit IRC18:57
*** mrunge has joined #tripleo18:57
*** florianf has quit IRC19:03
*** mjturek has quit IRC19:04
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648819:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)19:10
*** mjturek has joined #tripleo19:15
*** pcaruana has quit IRC19:19
*** dxiri has quit IRC19:22
*** paramite has quit IRC19:23
*** dxiri has joined #tripleo19:31
*** jtcressy has joined #tripleo19:32
*** gkadam has joined #tripleo19:47
*** mjturek has quit IRC19:58
*** itlinux has quit IRC19:59
*** ansmith has quit IRC20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648820:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)20:10
*** mjturek has joined #tripleo20:11
*** mjturek has quit IRC20:21
*** mjturek has joined #tripleo20:23
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: libvirt standalone deployment  https://review.openstack.org/59107620:23
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: libvirt standalone deployment  https://review.openstack.org/59107720:24
*** ade_lee has quit IRC20:25
*** mjturek has quit IRC20:29
*** mjturek has joined #tripleo20:30
*** myoung|lunch is now known as myoung20:32
*** dprince has quit IRC20:38
*** raildo_ has quit IRC20:41
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10  https://review.openstack.org/58249520:41
*** abishop has quit IRC20:47
dpeacockHave a good one everyone; I'll be back in a week.20:48
* dpeacock waves20:48
*** thrash is now known as thrash|g0ne20:52
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: list and show  all the available flavors prior to introspection  https://review.openstack.org/59003620:55
openstackgerritMatt Young proposed openstack-infra/tripleo-ci master: Add browbeat-minimal.yml to ovb playbook list  https://review.openstack.org/59009021:00
*** trown is now known as trown|outtypewww21:01
hamzymy "openstack overcloud deploy ..." now just says 'passwords' and I don21:04
hamzymy "openstack overcloud deploy ..." now just says 'passwords' and I don't know how I caused that21:04
mwhahahahamzy: when you deleted your overcloud last, did you remember to delete the plan?21:04
hamzymwhahaha, I normally delete the overcloud via "openstack stack delete overcloud --yes --wait"21:05
mwhahahahamzy: you also need to delete the plan21:05
mwhahahaif you use openstack overcloud delete overcloud it does both21:05
mwhahahaif you delete the stack, you have to manually do a openstack overcloud plan delete overcloud21:05
hamzythanks!21:06
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add path for a standalone deployment in ci.centos  https://review.openstack.org/59108721:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648821:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)21:10
*** akrivoka has quit IRC21:11
*** lblanchard has quit IRC21:17
*** orange_julius has left #tripleo21:26
openstackgerritMerged openstack/tripleo-quickstart master: Rocky: adding releases files for rocky  https://review.openstack.org/59042821:34
*** morazi has quit IRC21:36
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Upgrades: Refactor playbooks to set facts  https://review.openstack.org/57652021:37
*** colonwq has quit IRC21:41
*** itlinux has joined #tripleo21:46
*** colonwq has joined #tripleo21:54
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use local docker registry host for tempest container  https://review.openstack.org/58436822:04
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648822:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)22:10
*** dhill_ has quit IRC22:13
*** itlinux has quit IRC22:28
openstackgerritMerged openstack/instack master: remove AUTHORS file from git  https://review.openstack.org/57986922:32
*** gkadam has quit IRC22:34
*** rpioso is now known as rpioso|afk22:44
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Document --override-ansible-cfg  https://review.openstack.org/58412522:45
*** myoung is now known as myoung|off23:04
*** jtcressy has quit IRC23:05
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/178648823:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1786488 in tripleo "sc000 upgrade job goes N -> N instead of N-1 -> N" [Critical,In progress] - Assigned to Sofer Athlan-Guyot (sofer-athlan-guyot)23:10
*** mjturek has quit IRC23:12
*** dtrainor has quit IRC23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!