Friday, 2016-03-04

*** ntpttr has quit IRC00:08
*** sdake has quit IRC00:09
*** phiche has quit IRC00:14
*** phiche1 has joined #openstack-ansible00:14
*** sigmavirus24 is now known as sigmavirus24_awa00:15
*** ShannonM has quit IRC00:15
*** jthorne has quit IRC00:23
*** daneyon_ has quit IRC00:31
weezSlogan tks00:35
openstackgerritMerged openstack/openstack-ansible: Add upgrade config playbook and backup configs  https://review.openstack.org/28556400:44
*** ntpttr has joined #openstack-ansible00:56
*** johnmilton has joined #openstack-ansible01:03
*** KT has joined #openstack-ansible01:13
*** ntpttr has quit IRC01:16
*** johnmilton has quit IRC01:23
*** sdake has joined #openstack-ansible01:27
*** phiche has joined #openstack-ansible01:28
*** thorst_ has quit IRC01:28
*** jmckind has joined #openstack-ansible01:28
*** thorst has joined #openstack-ansible01:29
*** KT has quit IRC01:29
*** phiche1 has quit IRC01:29
*** sdake has quit IRC01:35
*** phiche1 has joined #openstack-ansible01:36
*** phiche has quit IRC01:36
*** thorst has quit IRC01:37
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server: Initial commit for bindep requirements  https://review.openstack.org/28789901:48
*** dmsimard has quit IRC01:50
*** dmsimard has joined #openstack-ansible01:51
openstackgerritMerged openstack/openstack-ansible: Add aodh, haproxy, and neutron config upgrades  https://review.openstack.org/28675302:04
*** jthorne has joined #openstack-ansible02:05
openstackgerritMerged openstack/openstack-ansible: Update ceilometer environment configuration  https://review.openstack.org/28682702:06
*** thorst has joined #openstack-ansible02:16
*** fawadkhaliq has quit IRC02:20
*** ntpttr has joined #openstack-ansible02:22
*** thorst has quit IRC02:23
*** jmckind is now known as jmckind_02:24
*** elopez has joined #openstack-ansible02:26
*** elopez has quit IRC02:27
*** weezS has quit IRC02:28
*** ntpttr has quit IRC02:28
*** jguy_ has joined #openstack-ansible02:35
*** sdake has joined #openstack-ansible02:39
*** jthorne has quit IRC02:49
*** sdake has quit IRC02:51
*** sdake has joined #openstack-ansible02:52
*** sdake has quit IRC02:52
*** cemmason has joined #openstack-ansible02:55
*** cemmason has quit IRC03:03
*** cemmason has joined #openstack-ansible03:03
*** cemmason has quit IRC03:03
*** cemmason has joined #openstack-ansible03:04
*** thorst has joined #openstack-ansible03:21
*** lykinsbd has joined #openstack-ansible03:27
*** thorst has quit IRC03:28
*** jguy_ has quit IRC03:36
*** lykinsbd has quit IRC03:36
*** fawadkhaliq has joined #openstack-ansible03:38
*** lykinsbd has joined #openstack-ansible03:41
*** thorst has joined #openstack-ansible04:27
*** agireud has quit IRC04:27
*** aslaen has joined #openstack-ansible04:27
*** openstack has joined #openstack-ansible14:09
odyssey4mepabelanger they're not all passing yet - but we can sort them out as we go, so yes - I think we can go for it14:10
pabelangerodyssey4me: sounds good14:10
pabelangerodyssey4me: we'll only do trusty first14:11
pabelangercentos7 will follow14:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible: Remove dangling Default domain cfg file  https://review.openstack.org/28845814:11
* mhayden tips his hat to odyssey4me14:11
odyssey4meandymccr d34dh0r53 hughsaunders jmccrory cloudnull mattt stevelle automagically I need to provide feedback to the OpenStack product working group about our Mitaka release, Newton and Ocada plans. I've put together https://etherpad.openstack.org/p/openstack-ansible-newton-roadmap-refresh and would like as much feedback as possible please.14:12
odyssey4mepabelanger yeah, centos is NV for all our roles, so that doesn't matter to much at this point14:12
odyssey4mepabelanger do you know if there's a wily image available at all? we have some work in motion that could benefit from a wily image14:13
*** TheIntern has joined #openstack-ansible14:13
pabelangerodyssey4me: no, we currently only roll LTS version of ubuntu. So, we should have xenial work starting soon14:14
odyssey4mepabelanger yeah, that'll do fine - we'd only want the wily image for the purpose of preparing for 16.04 anyway14:14
pabelangerodyssey4me: it is pretty time consuming to bring a new image online.  With fedora-23, we actually skipped fedora-22 because of all changes needed to diskimage-builder and system-config.14:16
pabelangerthat said, if somebody from Canonical came a long and offered to do the work....14:16
odyssey4mehaha, yeah14:16
odyssey4methat would be rather nice14:17
odyssey4mepabelanger do you have a link to the package list installed into these images by default?14:20
pabelangerodyssey4me: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/data/bindep-fallback.txt14:21
pabelangerthat is what is installed if you are missing other-requirements.txt14:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Implement human readable logging for functional tests  https://review.openstack.org/28847614:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Initial commit for bindep requirements  https://review.openstack.org/28787214:26
*** karimb has quit IRC14:27
odyssey4mepabelanger and if there is an empty other-requirements.txt in place?14:27
pabelangerodyssey4me: then you'll get no packages installed.  If we find the file, bindep will use it, and since it is empty it will continue on14:28
pabelangereventually, everybody should have a other-requirements.txt file14:28
pabelangerand we can remove bindep-fallback.txt14:29
pabelangerthat will take a cycle or two14:29
odyssey4mepabelanger but what defines the base image then? where's the d-i-b configuration defined for this image?14:30
pabelangerodyssey4me: that is controlled by nodepool: https://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/nodepool.yaml14:32
pabelangerif you look at the bottom of the file, you'll see the elements we use to create the dibs14:33
pabelangermost come directly from diskimage-builder but we also roll our own14:33
*** kencjohnston has joined #openstack-ansible14:34
bgmccollumodyssey4me should https://review.openstack.org/#/c/279859/ be broken into two reviews? 1: migrate tasks from roles to playbooks. 2: account for rabbitless installs -- or is it ok to combine the two, as long as the commit indicates the two changes...?14:36
*** openstackgerrit_ has quit IRC14:36
*** ShannonM has joined #openstack-ansible14:36
*** openstackgerrit_ has joined #openstack-ansible14:37
*** karimb has joined #openstack-ansible14:42
*** ametts has joined #openstack-ansible14:43
*** asettle has joined #openstack-ansible14:45
*** woodard has quit IRC14:46
openstackgerritByron McCollum proposed openstack/openstack-ansible: Migrate setup of messaging vhost and user from role to playbook  https://review.openstack.org/27985914:47
*** asettle has quit IRC14:50
openstackgerritByron McCollum proposed openstack/openstack-ansible: Do not setup messaging vhost and user when Rabbit is not installed  https://review.openstack.org/28850514:53
*** Mudpuppy has joined #openstack-ansible14:55
*** Mudpuppy has quit IRC14:56
*** Mudpuppy has joined #openstack-ansible14:57
*** neillc has quit IRC14:59
*** phalmos has joined #openstack-ansible14:59
*** mcarden has quit IRC14:59
cloudnullmorning15:00
*** admin0 has quit IRC15:00
*** neillc has joined #openstack-ansible15:00
*** admin0 has joined #openstack-ansible15:00
*** mcarden has joined #openstack-ansible15:00
bgmccollumcloudnull howdy15:02
bgmccollumcloudnull i split off my rabbitless-swift review as a new dependent to the migration of those tasks from the roles to playbooks...15:03
cloudnullah. sounds good15:05
*** markvoelker has quit IRC15:10
*** markvoelker has joined #openstack-ansible15:10
*** spotz_zzz is now known as spotz15:14
*** tiagogomes_ has joined #openstack-ansible15:17
*** tiagogomes has quit IRC15:19
*** tiagogomes_ has quit IRC15:20
*** tiagogomes has joined #openstack-ansible15:20
spotzodyssey4me You looking for an internal or external image?15:24
odyssey4mebgmccollum the patch is fine - it just need to have a commit message describing why it's doing what it's doing15:24
bgmccollumodyssey4me i went ahead and split the two. its clearing what is going on -- thanks15:25
bgmccollumclearer15:25
odyssey4mebgmccollum note that the whole rabbitless-swift thing isn't the only case where that's needed... it's effectively catering for a situation where rabbit is not deployed by OSA, and for other situations where rabbit could be deployed by OSA but isn't needed (eg: keystone deployed with zaqar)15:26
odyssey4mespotz internal or external image of?15:26
bgmccollumodyssey4me i see what you mean about not being swift specific now...15:27
spotzodyssey4me - wily15:27
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Store openstack_host_sysstat_enabled as lower case value for sysstat.default.j2  https://review.openstack.org/28493715:27
odyssey4mespotz ah, don't actually need it myself... I was wondering if it was instrumented into OpenStack-CI15:27
spotzahh15:28
NepocGood morning, was hoping someone was around that understands ceilometer. Right now the only things that show up under "Resource Usage" is Service:Nova (disk.root.size, vcpus, disk.ephemeral.size, memory), Service:Glance (image)15:28
*** kencjohnston has quit IRC15:28
spotzI'm hearing 4/21 though for it being available15:28
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Store openstack_host_systat_enabled as lower case value for sysstat.default.j2  https://review.openstack.org/28493715:29
*** skamithi has joined #openstack-ansible15:30
*** javeriak has joined #openstack-ansible15:32
spotzSo if kilo is stable are we still doing https://review.openstack.org/#/c/284937/?15:32
skamithiodyssey4me: running aio in a vagrant env. it complained that it needs a 100G disk. but aio docs say 50G min.15:33
skamithiwhy is 100G needed to install AIO?15:33
odyssey4meskamithi what size is the disk?15:35
odyssey4meit needs 50G free on the root disk, or a secondary disk (but then you have to feed it some extra vars)15:35
*** javeriak has quit IRC15:35
odyssey4meuh, what the heck? suddenly http://docs.openstack.org/developer/openstack-ansible/ is showing content from the liberty branch15:37
odyssey4me(not master)15:37
matttcloudnull: did you have any issues getting the keystone irr tests going?  i'm trying to do some for glance but can't get keystone deployed for some reason15:38
openstackgerritBjoern Teipel proposed openstack/openstack-ansible: Store openstack_host_systat_enabled as lower case value for sysstat.default.j2  https://review.openstack.org/28493715:40
*** javeriak has joined #openstack-ansible15:41
*** Bjoern has joined #openstack-ansible15:42
odyssey4memattt the keystone role doesn't have a functional deployment test yet :p15:43
odyssey4memattt unless it happened to get fixed under my radar15:43
matttodyssey4me: it does, it's just not activated15:43
matttodyssey4me: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tests/test.yml15:44
odyssey4memattt that's because it wasn't working - so we fell back to resolve it later15:44
*** tiagogomes has quit IRC15:44
*** tiagogomes has joined #openstack-ansible15:44
odyssey4memattt but right now if you commit a patch to make it do the functional test, you'll see that it doesn't work15:44
matttodyssey4me: probably the same issue i'm hitting15:44
*** karimb has quit IRC15:46
bgmccollumodyssey4me better? -- "When RabbitMQ is not installed by OSA (affinity: 0), because a deployer is using an existing RabbitMQ installation, or because it is not needed (eg. Standalone Swift), then do not setup messaging vhost and user for the various services."15:48
pabelangerodyssey4me: okay, bindep changes are live for ansible-functional-ubuntu-trusty.15:50
odyssey4mebgmccollum no need to mention affinity:0 - but the rest is fine15:51
odyssey4mebgmccollum there are other ways, besides changing affinity, to not include rabbitmq ;)15:52
bgmccollumodyssey4me please enlighten15:52
*** ntpttr has joined #openstack-ansible15:52
bgmccollumcause thats how im handling it currently, and i should probably update the docs too15:52
odyssey4mebgmccollum so right now the openstack_user_config / conf.d files we provide as examples use the top level of the nested groups - for example 'shared-infra_hosts' is a group which includes other groups like 'galera_all', 'rabbitmq_all'15:54
odyssey4meif a deployer simply does not use the top level group and implements the lower level groups, then it'll all just work (tm)15:55
bgmccollumah, so just use the explicit child groups that are desired...15:55
odyssey4meyep15:55
bgmccollumok, ill get a review drafted to update the docs too15:55
odyssey4methat is far less complicated than setting affinities15:55
bgmccollumand more clear of the desired environemnt15:56
odyssey4methere may be some bugs there, I suspect we may be missing some of the lower level groups that you may want to use - but it's a behaviour I'd like to encourage15:56
openstackgerritByron McCollum proposed openstack/openstack-ansible: Do not setup messaging vhost and user when Rabbit is not installed  https://review.openstack.org/28850515:56
odyssey4meyes, because it's much clearer about the intent15:56
automagicallyGood day all15:59
odyssey4meo/ automagically16:00
*** thorst has quit IRC16:00
*** thorst has joined #openstack-ansible16:01
*** jthorne has joined #openstack-ansible16:03
spotzo/16:03
automagicallycloudnull: Thx for reviewing a ton of my changes, catching up on Gerrit mail and nice to see a bunch of work merged16:05
odyssey4meautomagically mind giving this a quick look see? https://review.openstack.org/28785516:07
*** daneyon has joined #openstack-ansible16:07
* automagically on it16:07
skamithiodyssey4me: my vagrant aio root disk is only 40G. let me adjust it 51G and see if that works. thx.16:08
automagically+2 +A16:08
odyssey4meskamithi if you want to use two disks, that's fine - you'll just have to see how to enable the bootstrap to prepare it in https://github.com/openstack/openstack-ansible/blob/master/doc/source/developer-docs/quickstart-aio.rst16:09
*** mikelk has quit IRC16:09
odyssey4meskamithi that doc shows everything that the Vagrant implementation needs to do16:10
odyssey4meI'm not sure if it's possible to feed it a parameter, but ideally you'll want to do something like 'vagrant up 12.0.7' and it's checkout the 12.0.7 tag during the build16:11
automagicallyThe Vagrantfile can refer to ENV vars16:11
automagicallySince its just plain ole Ruby16:11
jguy_If I screw up something on multiple containers, and want to regenerate them, it looks like I stop, destroy, and remove the /openstack directory for that container.16:12
odyssey4mejguy_ you can execute the destroy container playbook, and use --limit to limit it to a specific container name if you want to16:13
jguy_Then I assumed I would have to rerun the setup hosts, infra, and openstack16:13
*** daneyon_ has joined #openstack-ansible16:13
*** busterswt has joined #openstack-ansible16:13
jguy_Does it hurt to re-run the whole playbook?16:13
odyssey4mejguy_ setup-hosts will create the containers16:13
odyssey4mesetup-infrastructure actually configures the base infra containers (rabbit, galera, etc)16:14
odyssey4mesetup-openstack does the same for the openstack service containers16:14
jguy_I see an error when I ran setup-hosts for my compute node.16:14
jguy_failed: [lab7] => {"changed": true, "cmd": "find -L '/var/log/lxc' -type f -name '*.log'", "delta": "0:00:00.003027", "end": "2016-03-04 11:12:52.054129", "rc": 1, "start": "2016-03-04 11:12:52.051102", "warnings": []}16:14
odyssey4meif you look inside those, you'll see that they include other playbooks16:14
jguy_stderr: find: `/var/log/lxc': No such file or directory16:14
odyssey4meso you can be quite surgical and run t he specific plays you need16:14
odyssey4mebut it doesn't hurt to run them all16:14
jguy_Yeah, I know that…but the compute node should not have lxc.16:14
jguy_Wonder why this fails.16:15
odyssey4mejguy_ hmm, that's odd - what tag/branch?16:15
*** thorst is now known as thorst_afk16:15
jguy_liberty16:15
skamithiodyssey4me: normally i just edit the vagrant file itself but i see why folk would want that on the actual command line.  don't see any option that vagrant provides to do exactly what you specified. but let's see. if nothing else like automagically says,  you can just refer to ENV vars which are then referenced in the vagrantfile.16:16
jguy_weird LXC is installed there.16:16
*** daneyon has quit IRC16:16
odyssey4meskamithi env vars are fine - I would recommend allowing that, but if possible have it include its own defaults in case someone doesn't specify other options16:17
odyssey4mejguy_ back in juno we used to install lxc on all hosts... but we don't in kilo+, but it's possible that we have a hangover from the past :p16:18
odyssey4mewhat's really weird is that no-one has picked up on it in the last year16:18
jguy_I had an error in my user file initially, and it basically did an AIO… So perhaps I forgot to remove the apt package.16:19
jguy_But I would expect the playbook to look for that log only if it intended to create containers on that host.16:20
skamithiodyssey4me: by default it could install the latest git tag.. found this on web..seems to work " git describe --tags $(git rev-list --tags --max-count=1)"16:20
*** jthorne has quit IRC16:21
jguy_odessey4me it looks like that was it. The playbook saw that LXC was installed, and decided to look for that log file.16:22
odyssey4mejguy_ ah ok, that makes more sense then16:24
odyssey4meskamithi yeah, that seems like a sensible default16:26
*** thorst_afk has quit IRC16:26
odyssey4meskamithi hmm, actually - there's a problem there16:28
*** thorst_afk has joined #openstack-ansible16:29
odyssey4methat shows tags in the order from most recent issued to least recent issued16:29
odyssey4mewe tag multiple branches in parallel, so the order shows like this: 12.0.7, 12.0.6, 11.2.9, 12.0.5, etc16:29
odyssey4meso if we tag a kilo branch tag, then vagrant will end up using that one - which is not what we want16:30
odyssey4meskamithi here's an alternative method: 'git checkout origin/liberty; git describe --abbrev=0 --tags'16:34
ntpttrIf someone were to hypothetically want to deploy nova-network instead of neutron in their OpenStack setup, does openstack-ansible allow for that?16:35
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Enable SSL termination for all services  https://review.openstack.org/28798916:35
odyssey4meskamithi or for kilo 'git checkout origin/kilo; git describe --abbrev=0 --tags'16:35
*** thorst_afk is now known as thorst16:35
openstackgerritMerged openstack/openstack-ansible: Remove dangling Default domain cfg file  https://review.openstack.org/28845816:35
odyssey4meskamithi and I think the default in each branch should be the last stable release16:36
*** weezS has joined #openstack-ansible16:38
mhaydencloudnull: thanks for that lbaasv2 review -- here's the other half of it https://review.openstack.org/#/c/287243/16:38
*** Mudpuppy_ has joined #openstack-ansible16:38
openstackgerritMerged openstack/openstack-ansible-os_cinder: Enable SSL termination for all services  https://review.openstack.org/28798416:39
openstackgerritMerged openstack/openstack-ansible-os_horizon: Enable SSL termination for all services  https://review.openstack.org/28798116:39
*** jthorne has joined #openstack-ansible16:39
*** cemmason has quit IRC16:40
*** Mudpuppy has quit IRC16:41
mhaydencloudnull: and now i will thank you two times16:41
mhayden:)16:41
cloudnulllol16:41
cloudnullty and Bjoern vm for putting all that together.16:41
odyssey4meautomagically cloudnull FYI, if you recheck a patch it will automatically be tested against the head of the branch... rebasing is not actually required16:43
*** karimb has joined #openstack-ansible16:43
odyssey4methis is new info discovered from infra in this week16:43
odyssey4meand I've tested and confirmed it16:43
automagicallyAh okay. Good to know16:43
*** cemmason has joined #openstack-ansible16:43
cloudnullgood to know.16:43
odyssey4meif the patch you depend on has merged, then simply a recheck will do16:44
odyssey4merebases are only needed for patch chains that have not yet merged16:44
automagicallyI did manually rebase a patch earlier but that was for a merge conflict issue, not so much a recheck16:44
odyssey4meautomagically yep, just noting it as it's good info to know16:44
automagically+116:44
odyssey4med34dh0r53 are you around? we need another vote on https://review.openstack.org/28800516:46
automagicallyodyssey4me: Looks like we’ve got an inventory tox env now. Does that need to be added to https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/ansible-role-jobs.yaml in order for us to run the inventory tests during the gate check16:46
odyssey4meautomagically I'd rather we didn't add it as another job16:46
odyssey4melet's add it to the linters job instead to pipeline it after all the other tests in that job16:47
automagicallyK, I remember you had suggested adding it to linters which is pretty clear16:47
automagicallyI’ll do that now16:47
odyssey4methat only requires a change in our repo - check tox.ini's linters job16:47
d34dh0r53odyssey4me: looking at it now16:48
odyssey4meautomagically Liberty 12.0.7 was tagged this morning, so https://review.openstack.org/288391 needs to merge to get the next tag going.16:48
* automagically looking16:49
odyssey4med34dh0r53 thanks - feel free to fire any questions16:49
*** kencjohnston has joined #openstack-ansible16:49
automagically+2 +A on https://review.openstack.org/#/c/28839116:50
*** woodard has joined #openstack-ansible16:51
odyssey4mecloudnull are you working on https://review.openstack.org/288006 or do you mind if I continue working on it?16:51
odyssey4meta automagically16:51
odyssey4meand thanks d34dh0r5316:52
cloudnullodyssey4me:  you can work on it if you'd like .16:52
cloudnulli can seem to figure our where the archive extraction is failing16:52
odyssey4med34dh0r53 FYI, once that merges we'll tag 11.2.10 for Kilo16:52
odyssey4mecloudnull well, just for funsies we've now moved over to using the more sparse image.... so things have changed since last night16:53
*** aslaen has joined #openstack-ansible16:53
d34dh0r53odyssey4me: tys!16:53
odyssey4mesparse is the wrong word... we're now using an ubuntu image that was build by disk-image-builder16:53
*** asettle has joined #openstack-ansible16:53
cloudnull nice16:53
*** asettle has quit IRC16:54
*** jiteka1 has quit IRC16:57
odyssey4mewe can expect to suddenly find builds breaking as a result of us assuming that packages are there, so it'll be some fun :)16:57
*** daneyon_ has quit IRC17:02
*** skamithi has quit IRC17:02
*** admin0 has quit IRC17:02
*** sdake_ has joined #openstack-ansible17:02
*** daneyon has joined #openstack-ansible17:03
*** cfarquhar has quit IRC17:03
*** sdake has quit IRC17:03
*** phiche1 has quit IRC17:05
odyssey4mecloudnull how do we resolve automagically's comment in https://review.openstack.org/#/c/288006/4/templates/lxc-net-bridge.cfg.j2 ?17:06
cloudnullodyssey4me:  we can cast to bool17:07
*** sdake_ is now known as sdake17:07
odyssey4mecloudnull ie 'if lxc_net_gateway | bool' ?17:07
cloudnullI think theres a jinja none type17:08
odyssey4meok, lemme find that17:09
cloudnullhttp://jinja.pocoo.org/docs/dev/templates/#literals17:10
cloudnulltrue, false, and none are available17:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Resolve bad assumptions about the base OS  https://review.openstack.org/28800617:10
odyssey4mecloudnull automagically please review ^17:10
*** Andrew_jedi has joined #openstack-ansible17:10
cloudnulli think it none not None17:11
Andrew_jediHello folks, how are people managing logs with OSA ?17:11
cloudnullah nevermind maybe both work17:11
Andrew_jedisuppose OSA failed to install compute node, where should one look for logs ?17:11
odyssey4meAndrew_jedi we already instrument an rsyslog centralised server, but you can also inform the plays to send the syslog traffic wherever you like17:12
jmccroryAndrew_jedi are you asking about logging of Ansible playbooks?17:13
odyssey4meAndrew_jedi https://github.com/openstack/openstack-ansible/blob/master/doc/source/install-guide/ops-logging.rst17:13
*** daneyon has quit IRC17:13
odyssey4meunfortunately our rendered docs have the liberty content right now thanks to a glitch in the publishing process17:14
odyssey4meAndrew_jedi ah, the content is there: http://docs.openstack.org/developer/openstack-ansible/install-guide/ops-logging.html17:14
Andrew_jediodyssey4me: perfect, let me give that a try :)17:15
jguy_Looks like there is another issue, running the setup-infrastructure playbook, I am getting an error in the play: PLAY [Install galera server]  - TASK: [galera_client | Drop local .my.cnf file] *******************************17:18
jguy_fatal: [os-controller_galera_container-ecc9e60e] => One or more undefined variables: 'galera_root_password' is undefined17:18
jguy_The galera_root_password is defined17:18
cloudnullare you running the play with the "openstack-ansible" command ?17:19
jguy_S#!T17:19
jguy_nope.17:19
cloudnullgive that a go. its just a wrapper around ansible-playbook but it sources all of your user_* var files.17:20
odyssey4mejguy_ :) it's a convenience script to ensure that all the right overrides are implemented17:20
odyssey4meit does take a little getting used to17:21
jguy_Yeah, I know better…feeling a bit sheepish. :)17:22
jguy_Baaaaaaa17:22
*** jguy_ has left #openstack-ansible17:22
odyssey4meMaarp!17:22
*** jguy_ has joined #openstack-ansible17:22
odyssey4mehttps://www.youtube.com/watch?v=Tekhh7Iy-sM :p17:23
*** rgogunskiy has joined #openstack-ansible17:28
*** phalmos has quit IRC17:28
*** phalmos has joined #openstack-ansible17:33
*** lunarlamp has joined #openstack-ansible17:33
*** rgogunskiy has quit IRC17:39
*** weezS has quit IRC17:41
*** rgogunskiy has joined #openstack-ansible17:44
*** karimb has quit IRC17:45
*** tiagogomes_ has joined #openstack-ansible17:49
*** tiagogomes has quit IRC17:49
*** kencjohnston has quit IRC17:52
*** mathlin1 has joined #openstack-ansible17:52
openstackgerritMerged openstack/openstack-ansible-os_swift: Enable SSL termination for all services  https://review.openstack.org/28797517:54
openstackgerritMerged openstack/openstack-ansible-os_keystone: Enable SSL termination for all services  https://review.openstack.org/28798017:54
*** tiagogomes_ has quit IRC17:56
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ server to 3.6.1-1  https://review.openstack.org/28861717:57
*** tiagogomes_ has joined #openstack-ansible17:58
odyssey4mejmccrory that's awesome :)18:01
*** admin0 has joined #openstack-ansible18:02
odyssey4mejmccrory I'm thinking though - perhaps there'd be more value in doing a test from 3.5.x to 3.6.x ?18:02
jmccroryprobably, was that the version in liberty?18:02
odyssey4mejmccrory 3.5.x18:02
*** electrofelix has quit IRC18:03
jmccroryyep, 3.5.7-118:03
spotzDid you guys sign up for the bugbash next week?18:06
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ server to 3.6.1-1  https://review.openstack.org/28861718:07
BjoernDoes anyone the reason why we ripped everything out of openstack-ansible, even the OS roles ? openstack-ansible has become a glorified wrapper and now side loading everything. Now we put os_neutron, for example, in a git project which can not work by itself, there's not even gating on the roles. Back porting into other branches is now a pain18:09
*** tiagogomes_ has quit IRC18:10
*** tiagogomes has joined #openstack-ansible18:10
*** ntpttr has left #openstack-ansible18:10
*** mathlin1 has quit IRC18:10
Andrew_jediodyssey4me: Thanks :), now i can see all the logs at one place.18:11
*** permalac has quit IRC18:12
*** lykinsbd has quit IRC18:13
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-rabbitmq_server: Upgrade RabbitMQ Server to 3.6.1-1  https://review.openstack.org/28861718:13
odyssey4meBjoern yes, this increases the flexibility with the way the project's deliverables can be used18:15
odyssey4mepeople can use the roles without the playbooks, and can also use the roles at whichever tag/sha they want18:16
odyssey4meBjoern by the end of this cycle each independent repo will be functionally tested on its own, and can be deployed for use on its own assuming the pre-requisites are met18:16
Bjoernwhat are the  "project's deliverables " most of the roles can not deployed standalone like neutron needs at least keystone if not others.18:17
odyssey4meBjoern the backport pain is a small price to pay18:17
odyssey4meBjoern the project's deliverables are a set of tools and roles to deploy openstack components... and a set of playbooks to show how to use them18:17
Bjoerndo you have the spec handy ?18:17
stevelleneutron can now be deployed easily to use an existing / external keystone18:17
odyssey4meBjoern http://specs.openstack.org/openstack/openstack-ansible-specs/specs/mitaka/independent-role-repositories.html18:18
odyssey4meit opens up a lot more use-cases and gives deployers a lot more flexibility18:18
Andrew_jediFolks,  suppose there is no br-vlan bridge , will OSA work in that scenario ?18:18
odyssey4meAndrew_jedi possibly - you'd just have to map the alternative bridge18:18
Andrew_jedidocs say br-vlan is mandatory but i removed and osa still installed everything except compute node ?18:19
Andrew_jediodyssey4me: That's what confusing me, osa should have failed at thevery beginning because i have not stated any alternative bridge.18:20
Bjoernstevelle: currently the role requires settings, not set as default like keystone_* and so on, if you don't set them it won't deploy18:20
Bjoernodyssey4me thanks18:20
odyssey4meAndrew_jedi I'm flaky on networking, but the framework we provide is very, very flexible... it's not necesseraily a tested path so you may find bugs.18:20
stevelleBjoern: yes, and the best plan is to document those external expectations clearly18:20
Bjoernyes that has not happend yet18:20
odyssey4meBjoern be careful not to judge it in the current state - it's incomplete and still a WIP18:20
BjoernI wish we would have done that before splitting this up18:20
stevellevery much in progress18:20
odyssey4meBjoern the split per role was causing too much drift, so we decided to take the pain and do it all quickly, then finish it afterwards18:21
stevellethis was very much a "pick your pain" scenario18:21
Andrew_jediodyssey4me: please correct me if i am wrong but br-vlan is supposed to be present only on the machine which is running neutron_agents container ?18:21
odyssey4mestevelle ++18:21
Bjoernoh dear ....18:22
Bjoernbr-vlan needs to be present where neutron runs, also on the compute nodes18:22
*** lykinsbd has joined #openstack-ansible18:22
odyssey4meAndrew_jedi I'm not sure myself. In my experience it does depend on how you're planning your implementation. If you plan to use vlan tagged networks for projects, then I think you'd need it on your compute nodes too.18:23
Andrew_jediodyssey4me: That's what i thought, i don't want to use flat networks or vlan tagged networks for tenants, so i tested this thing where i removed br-vlan, since it's primary role is external connectivity18:24
Andrew_jedii wanted to have only a private network for tenants,18:25
jguy_odessey4me: Question on this concept of adding other openstack packages.  I think I followed the instructions we discussed yesterday.  here’s the addition I made to my user_variables.yml: http://pastebin.com/8UsZXUzF18:26
Andrew_jedibut when i ran osa, everything worked except for compute service18:26
*** dnovosel_1 has joined #openstack-ansible18:26
*** dnovosel_1 has left #openstack-ansible18:26
*** dnovosel_1 has joined #openstack-ansible18:27
*** portante has quit IRC18:29
odyssey4meAndrew_jedi we may be making some bad assumptions in places, so there could be a bug - was there an actual playbook error, or did a service not start?18:30
*** kencjohnston has joined #openstack-ansible18:30
*** portante has joined #openstack-ansible18:31
Andrew_jediodyssey4me: There is no error, os-nova-install.yml shows that compute node has failed, when i checked there was no nova package or nova-compute service for that matter18:32
odyssey4mejguy_ I don't think that the l2gw_* and l2gateway_agent_ini_overrides vars will be picked up at all18:32
odyssey4mejguy_ not unless you've added your own playbooks18:32
jguy_I assumed when the l2gw package was installed, the initial files would be created. Guess not.18:33
jguy_So I will need to make a playbook I suppose to create the files?18:33
odyssey4mejguy_ do you want to deploy from git - because it may deploy from pypi?18:34
jguy_The git repo I specified has them in an etc folder. I was not really sure how that would work.18:34
jguy_I actually don’t see that the plugin was added to the containers.18:35
jguy_there is a pip package…I can try that.18:35
odyssey4mejguy_ yeah, none of that would happen - you'd have to actually add this to the code paths18:35
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_swift: Configure Swift dispersion tools to use Keystone v3  https://review.openstack.org/28783218:36
odyssey4mejguy_ we instrument the ability to add packages in the code, but this is effectively adding a sub-service... it's a little more complex18:37
odyssey4mejguy_ if you like you can put together a patch for it - it looks like a useful thing18:38
jguy_I suppose I could model a task after one of the neutron agents… though the plugin.ini has to go on the neutron server container, and the agent apparently has to run on the neutron server & agent containers, and compute nodes18:38
odyssey4meyep, so that's pretty much why is needs code - not just simply to add packages18:38
automagicallyodyssey4me: So, adding the ip allocation inventory test to linters makes the lint check take 50+ minutes...18:38
odyssey4meautomagically well, that's fun :p18:39
odyssey4meautomagically I expect that the test could be shortened by simply reducing the iterations?18:39
automagicallyYeah, the dominant factor in that time, seems to be the dynamic_inventory.py execution itself18:39
automagicallySure, its at 100 now18:39
automagicallyThe patch I’ll submit that adds it to linters will run it with 25 iterations18:40
automagicallyAnd we’ll see how that goes for awhile18:40
odyssey4me50 mins is not terrible, as our integration test takes longer than that - but I think I'd prefer something around 30 mins perhaps?18:40
jguy_I have not quite figured out how to instruct the deploy server to “install this package”, “create this file here”…etc.  I assume it would be similar to how the neutron agents are installed.18:40
odyssey4mejguy_ ok, can help you there18:40
jguy_is there something in the development guide on the workflow?18:41
*** pcaruana has quit IRC18:41
odyssey4mejguy_ the templates for config files come from https://github.com/openstack/openstack-ansible/tree/liberty/playbooks/roles/os_neutron/templates18:41
odyssey4mejguy_  there are some files that are not templated that are here: https://github.com/openstack/openstack-ansible/tree/liberty/playbooks/roles/os_neutron/files18:41
odyssey4mejguy_ the installation of pip packages happens here: https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/os_neutron/tasks/neutron_install.yml18:42
odyssey4meit may go into a python venv, or not - so there is a bit of logic involved there18:42
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Run inventory test during Jenkins lint check  https://review.openstack.org/28863618:43
odyssey4mejguy_ the list of packages to install into the venv is set with this var: https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/os_neutron/defaults/main.yml#L33318:43
odyssey4meyou are able to set 'neutron_pip_packages' in user_variables with your own list if you want to18:43
odyssey4mejust be sure to include the defaults in your list18:44
odyssey4meyou can see the git sources that are compiled into packages on the repo server here: https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/defaults/repo_packages/openstack_services.yml#L80-L9518:44
odyssey4meotherwise it'll find them from pypi based on the '*_pip_packages' list18:45
*** tiagogomes has quit IRC18:45
jguy_oh cool.18:46
odyssey4meas we're deploying from wheels, we have to configure the deployment of init/upstart files, config files, etc18:46
odyssey4meyou'll find that all in the tasks here: https://github.com/openstack/openstack-ansible/tree/liberty/playbooks/roles/os_neutron/tasks18:46
odyssey4methe config overrides are used in the config_template module, for example: https://github.com/openstack/openstack-ansible/blob/liberty/playbooks/roles/os_neutron/tasks/neutron_post_install.yml#L2818:47
odyssey4mebut setting a config_override var won't work unless there is a task that consumes it18:47
jguy_Ahhhh….Alright. This helps a lot. I am not quite as good as you guys in my ansible coding, but I will do my best. I have learned a lot just from reading the plays.18:49
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_nova: Fix auth_url for nova configuration  https://review.openstack.org/28864218:51
*** weezS has joined #openstack-ansible18:56
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Test basic structure of dynamic inventory output  https://review.openstack.org/28757118:57
*** TheIntern has quit IRC18:59
*** mathlin1 has joined #openstack-ansible19:00
odyssey4meheh, it's not often I get to spot a bug and fix it for -infra :)  https://review.openstack.org/28864419:02
odyssey4methat's what's causing our published docs to be replace by the latest tag's docs19:03
*** kencjohnston has quit IRC19:14
jmccroryodyssey4me read through pabelanger comments earlier, do we need to remove other-requirements.txt to get the default package list? rabbitmq change is failing since curl isn't installed19:15
pabelangerjmccrory: we're going to do new ubuntu-trusty images now, but a workaround is to add curl into other-requirements.txt19:16
*** skamithi13 has quit IRC19:17
*** skamithi13 has joined #openstack-ansible19:17
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_aodh: Fix auth_url for aodh configuration  https://review.openstack.org/28865519:17
jmccrorypabelanger: ah ok, so either wait for the new image or build up other-requirements.txt with minimal package list?19:18
odyssey4mejmccrory I have a patch incoming to fix that :)19:19
odyssey4mejmccrory I'd rather that we define the packages ourselves than get the mass of fallback defaults built for devstack19:20
odyssey4methis is a great way to uncover bugs19:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-apt_package_pinning: Add curl to bindep requirements  https://review.openstack.org/28865719:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client: Add curl to bindep requirements  https://review.openstack.org/28865819:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server: Add curl to bindep requirements  https://review.openstack.org/28865919:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ironic: Add curl to bindep requirements  https://review.openstack.org/28866019:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create: Add curl to bindep requirements  https://review.openstack.org/28866119:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Add curl to bindep requirements  https://review.openstack.org/28866219:21
*** mathlin1 has quit IRC19:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-memcached_server: Add curl to bindep requirements  https://review.openstack.org/28866319:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts: Add curl to bindep requirements  https://review.openstack.org/28866419:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_openrc: Add curl to bindep requirements  https://review.openstack.org/28866519:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh: Add curl to bindep requirements  https://review.openstack.org/28866619:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer: Add curl to bindep requirements  https://review.openstack.org/28866819:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Add curl to bindep requirements  https://review.openstack.org/28867019:22
*** skamithi14 has joined #openstack-ansible19:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance: Add curl to bindep requirements  https://review.openstack.org/28867119:22
*** aslaen has quit IRC19:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat: Add curl to bindep requirements  https://review.openstack.org/28867219:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Add curl to bindep requirements  https://review.openstack.org/28867319:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone: Add curl to bindep requirements  https://review.openstack.org/28867519:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron: Add curl to bindep requirements  https://review.openstack.org/28867719:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Add curl to bindep requirements  https://review.openstack.org/28867819:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift: Add curl to bindep requirements  https://review.openstack.org/28867919:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift_sync: Add curl to bindep requirements  https://review.openstack.org/28868019:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest: Add curl to bindep requirements  https://review.openstack.org/28868119:23
odyssey4mejmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr Can we get these reviewed please? https://review.openstack.org/288348 / https://review.openstack.org/28834119:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install: Add curl to bindep requirements  https://review.openstack.org/28868219:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_lock_down: Add curl to bindep requirements  https://review.openstack.org/28868319:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins: Add curl to bindep requirements  https://review.openstack.org/28868419:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-py_from_git: Add curl to bindep requirements  https://review.openstack.org/28868519:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server: Add curl to bindep requirements  https://review.openstack.org/28868619:24
jmccroryodyssey4me yep, saw that already when testing IRR against centos vms. gcc and python-dev only on my ubuntu images for some reason19:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build: Add curl to bindep requirements  https://review.openstack.org/28868719:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server: Add curl to bindep requirements  https://review.openstack.org/28868819:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_client: Add curl to bindep requirements  https://review.openstack.org/28868919:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rsyslog_server: Add curl to bindep requirements  https://review.openstack.org/28869019:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-security: Add curl to bindep requirements  https://review.openstack.org/28869119:25
*** phiche has joined #openstack-ansible19:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-specs: Add curl to bindep requirements  https://review.openstack.org/28869219:25
*** skamithi13 has quit IRC19:26
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_ceilometer: Fix auth_url for ceilometer configuration  https://review.openstack.org/28869319:27
*** weezS has quit IRC19:28
*** galstrom_zzz is now known as galstrom19:31
*** weezS has joined #openstack-ansible19:32
odyssey4methanks jmccrory19:32
openstackgerritMerged openstack/openstack-ansible-openstack_hosts: Tests: Ensure that the apt cache is always refreshed  https://review.openstack.org/28834119:34
openstackgerritMerged openstack/openstack-ansible-openstack_hosts: Initial commit for bindep requirements  https://review.openstack.org/28787719:34
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Removing openstack_environment.yml. It is no longer useful.  https://review.openstack.org/28869819:35
*** sdake has quit IRC19:36
*** sdake has joined #openstack-ansible19:37
*** mathlin1 has joined #openstack-ansible19:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800619:40
*** mathlin1 has quit IRC19:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800619:49
*** admin0 has quit IRC19:52
*** fawadkhaliq has joined #openstack-ansible19:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800619:57
odyssey4mejmccrory well, that's a fun error: msg: Unexpected error when accessing exploded file: [Errno 2] No such file or directory: '/var/cache/lxc/trusty/rootfs-amd64/etc/ssl/certs/NetLock_Arany_=Class_Gold=_F\\305\\221tan\\303\\272s\\303\\255tv\\303\\241ny.pem'19:57
odyssey4mehttps://jenkins04.openstack.org/job/gate-openstack-ansible-lxc_hosts-ansible-func-ubuntu-trusty/4/console19:57
*** asettle has joined #openstack-ansible19:57
*** weshay has quit IRC19:57
Nepocquick question, which yml file from /etc/openstack_deploy is first to be read?19:58
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Run inventory test during Jenkins lint check  https://review.openstack.org/28863619:58
odyssey4meNepoc the user_*.yml files are read in alphanumerical order19:59
NepocOkay but of all the files not just user_, which is read first?19:59
automagicallyNepoc: For inventory its openstack_user_config.yml19:59
automagicallythen conf.d20:00
NepocI want to replace the controller  or compute ip with a variable20:00
automagicallythen env.d20:00
odyssey4meNepoc the env.d/conf.d / openstack_user_config.yml files are read by inventory before the user_*.yml files20:00
odyssey4mewhat automagically said :)20:00
NepocSo for an all in one I can just make a variable at the top of openstack_user_config.yml then it's used everywhere I would have the IP.20:01
NepocShould work?20:01
*** asettle has quit IRC20:02
mhaydendoes anyone here use gertty?20:02
mhaydenhttps://github.com/openstack/gertty20:02
automagicallyFirst I’ve heard of it20:03
automagicallyI find the keyboard shortcuts in the Gerrit web interface pretty damn effective for keeping both hands on my keyboard20:03
mhaydentrue -- i was mainly curious about gertty but it doesn't respond to any of my keystrokes :/20:03
odyssey4meoh blast - https://github.com/ansible/ansible/issues/1176320:04
mhaydenodyssey4me: that used to throw a bunch of junk to the console... i guess an error is an upgrade? :)20:04
mhaydeni remember putting in some osa patches to get around that20:04
odyssey4memhayden I think dstanek uses it - as I recall he did a plugin for it for a hackathon last year.20:04
palendaeI tried it last year20:05
*** galstrom is now known as galstrom_zzz20:05
palendaeNeeds some work20:05
odyssey4memhayden it's more likely that there's a package missing on the host as that's the only recent change20:05
palendaeAlso had some issues if you had lines starting with -/+, causing line numbers to mismatch20:05
odyssey4meunless cloudnull has changed the image :p20:05
dstanekmhayden: odyssey4me: yes, i use it quite a bit20:05
cloudnullive not changed the image20:06
mhaydendstanek: i keep hitting 'L' but nothing happens20:06
cloudnulli could though :_20:06
cloudnull:)20:06
odyssey4melol20:06
odyssey4mecloudnull perhaps you can help to dig up the root cause - on the new cut down image, the unarchive module is brafing20:06
odyssey4mecloudnull  https://jenkins05.openstack.org/job/gate-openstack-ansible-lxc_hosts-ansible-func-ubuntu-trusty/2/console20:07
odyssey4mesee the '2016-03-04 19:59:22.393' timestamp20:07
dstanekmhayden: are you on the latest? i'm running a pretty old verion20:07
dstanek*version20:07
mhaydendstanek: gertty==1.3.120:07
mhaydendstanek: just installed from git and all is well, it seems :P20:08
cloudnullthats what i was seeing in the experemental image too20:08
dstanekmhayden: one issue i had was terminal colors and having (i think) the lightgray lost until i changes schemes20:08
*** admin0 has joined #openstack-ansible20:09
cloudnullI have not figured out what that is quite yet20:09
cloudnullit seems broken somewhere in the path for /var/cache/lxc/trusty/rootfs-amd64/etc/ssl/certs/NetLock_Arany_=Class_Gold=_F\\305\\221tan\\303\\272s\\303\\255tv\\303\\241ny.pem20:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800620:10
odyssey4mecloudnull I tested the functional test on a public cloud instance and it's fine - so I'm doing some guesses20:10
*** skamithi14 has quit IRC20:12
*** skamithi13 has joined #openstack-ansible20:12
*** weshay has joined #openstack-ansible20:13
odyssey4mepabelanger have you seen this at all? using the unarchive module produces an error: https://jenkins04.openstack.org/job/gate-openstack-ansible-lxc_hosts-ansible-func-ubuntu-trusty/5/console20:14
openstackgerritMerged openstack/openstack-ansible: Use current, but pinned versions of pip, setuptools and wheel  https://review.openstack.org/28800520:16
openstackgerritMerged openstack/openstack-ansible: Information about the keepalived bug when multiple backup nodes have the same priority.  https://review.openstack.org/27966420:17
pabelangerodyssey4me: no, mind you I don't use unarchive much20:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts: Add curl to bindep requirements  https://review.openstack.org/28866420:18
pabelangerodyssey4me: possible missing dependency on sslcerts?20:18
*** ravla has left #openstack-ansible20:19
*** rgogunskiy has quit IRC20:19
odyssey4mepabelanger I'm not quite sure how that would be - all it's doing is unarchiving a tar.gz file (which happens to be an lxc base image)20:19
odyssey4meI'm thinking more along the lines of the host missing locale packages20:19
odyssey4meas it seems to relate to weird characters in the file names of the unarchived archive20:20
pabelangeroh20:20
pabelangerso, you might need to install language-package-en20:21
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Removing openstack_environment.yml. It is no longer useful.  https://review.openstack.org/28869820:21
pabelangerwe don't have locale on our ubuntu-trusty images20:21
*** ErwanJ has joined #openstack-ansible20:21
ErwanJHi all, do the containers on the infra hosts require actual internet access?  The insfra hosts will have internet access, but do I need to attach the LXC containers to a bridge which has internet access or not?  CHeers.20:23
odyssey4mepabelanger lemme fire up a fresh cloud image and pull down a package list20:26
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Enable SSL termination for all services  https://review.openstack.org/27719920:26
automagicallyErwanJ: With default configuration of apt repos and the like in the containers, I believe they will20:27
*** neilus has quit IRC20:27
*** javeriak has quit IRC20:28
automagicallyHowever you can configure the containers to use a proxy server or configure them with alternate/internal APT repos20:28
*** asettle has joined #openstack-ansible20:29
odyssey4meErwanJ the containers go through a NATted interface and access the internet through the hosts20:29
odyssey4melxcbr0 facilitates this20:29
odyssey4meErwanJ you don't have to instrument anything, it's done anutomatically - as long as your hosts have internet access20:30
jguy_odyssey4me after the packages are installed in the venv, are the libs, bins, and etc files copied to the corresponding locations?20:31
odyssey4mecloudnull pabelanger ok, so on a host with these package is just works (tm): http://pastebin.com/kMTDq4bD20:32
odyssey4mejguy_ the required python bits are all in the venvs, with nothing else needed - the venvs are isolated20:32
odyssey4mejguy_ the config files, etc are places in the usual locations, eg: for the keystone service /etc/keystone20:32
odyssey4mejguy_ any c libs are installed via apt packages20:33
ErwanJOk great thanks @odyssey4me,  how does it know which interface on the host it should NAT out of ?  does it use the interface of the default route?20:33
pabelangerodyssey4me: right, so you have 2 ways to solve it.  Add the missing depends into other-requirements.txt and have bindep install them. Or update the ansible role to ensure said dependency is installed.  Personally, I think option 2 might be better.20:34
pabelangerodyssey4me: also note, our images are super minimal20:34
*** asettle has quit IRC20:34
pabelangerless packages then the normal cloud image shipped by ubuntu and fedora20:34
jguy_Oh, ok. I thought the /etc/neutron configs looked like the working copies, but I saw all of the same files in the venv’s etc folder too.20:34
cloudnullpabelanger:  can i download the images ?20:34
odyssey4mepabelanger sure, I realise that - and agree that option 2 is better - right now I'm trying to identify the missing package20:34
cloudnullto test on an openstack cloud I have running ?20:35
odyssey4mepabelanger the point of using the minimal image is to pick up these bad assumptions :)20:35
pabelangercloudnull: you are better manually building it: http://git.openstack.org/cgit/openstack-infra/project-config/tree/tools/build-image.sh20:35
odyssey4meErwanJ I don't know exactly - I think it simply bridges to the host and uses the host's default route20:36
odyssey4meErwanJ or more likely uses the host's routing table...20:36
pabelangerodyssey4me: an easy test would be to add language-pack-en into other-requirements.txt and see if the job passes20:36
pabelangerI suspect that is the issue, if you are depending on locale20:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800620:38
odyssey4mepabelanger good pointer - let's see ^20:38
automagicallyodyssey4me: Care to take a quick look and hopefully a +2 on https://review.openstack.org/#/c/287990/ when you are done battling the minimal image?20:39
pabelangerodyssey4me: Ya, it will take a bit to flash out the move to other-requirements.txt.  Especially ansible jobs, it will likely expose a lot of assumptions of the base OS20:39
*** sdake has quit IRC20:39
odyssey4meautomagically gogogo20:39
*** weshay has quit IRC20:39
automagicallyLikewise here: https://review.openstack.org/#/c/287983/ <— The last two SSL role patchs remaining20:39
odyssey4mepabelanger agreed, which is good :)20:40
*** cfarquhar has joined #openstack-ansible20:40
*** cfarquhar has quit IRC20:40
*** cfarquhar has joined #openstack-ansible20:40
pabelangerodyssey4me: Ya, I think so20:41
*** raddaoui has joined #openstack-ansible20:41
openstackgerritMerged openstack/openstack-ansible-os_aodh: Enable SSL termination for all services  https://review.openstack.org/28799020:41
odyssey4meautomagically done20:41
automagicallythx20:41
odyssey4meautomagically can you implement a WIP patch in the integrated test to verify that all that works?20:42
cloudnullodyssey4me: https://review.openstack.org/#/c/277199/20:42
automagicallyRight20:42
automagicallyThe AIO will build out the HAProxy SSL termination in that patch20:43
openstackgerritMerged openstack/openstack-ansible-os_swift: Add curl to bindep requirements  https://review.openstack.org/28867920:43
automagicallyIncidentally, looks like the gate may be failing until https://review.openstack.org/#/c/277199 merges since the roles are now depending on these vars: https://review.openstack.org/#/c/277199/11/playbooks/inventory/group_vars/hosts.yml20:43
openstackgerritMerged openstack/openstack-ansible-os_heat: Enable SSL termination for all services  https://review.openstack.org/28798320:44
*** ErwanJ has quit IRC20:45
automagicallyAFK for a bit20:45
*** thorst_ has joined #openstack-ansible20:48
odyssey4mecloudnull reviewed20:49
odyssey4meautomagically cloudnull that's a bit silly - we should merge a patch in the integrated repo to disable those defaults until https://review.openstack.org/277199 is ironed out20:51
*** asettle has joined #openstack-ansible20:52
*** thorst has quit IRC20:52
*** weshay has joined #openstack-ansible20:53
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_cinder: Fix auth_url for cinder configuration  https://review.openstack.org/28873020:54
cloudnullodyssey4me: all of the services have the public endpoints are using terminating ssl if we use this patch https://review.openstack.org/#/c/277199/20:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800620:55
odyssey4mecloudnull pabelanger FYI it appears that including 'language-pack-en' did the trick - rejigging the patch properly now.20:56
pabelangerodyssey4me: nice20:56
*** asettle has quit IRC20:56
*** cloudtrainme has joined #openstack-ansible20:56
*** mathlin1 has joined #openstack-ansible20:57
pabelangerodyssey4me: we had the same issue with python-swiftclient and the reason we added it to bindep-fallback.txt20:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: [WIP] Resolve bad assumptions about the base OS  https://review.openstack.org/28800621:03
Andrew_jedikeystone failing, stderr: Could not find a version that satisfies the requirement testtools<2.0.0,>=0.9.2221:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Resolve bad assumptions about the base OS  https://review.openstack.org/28800621:03
Andrew_jediNo matching distribution found for testtools<2.0.0,>=0.9.2221:04
*** sdake has joined #openstack-ansible21:05
Andrew_jediodyssey4me cloudnull : Is this a bug, keystone failing, stderr: Could not find a version that satisfies the requirement testtools<2.0.0,>=0.9.22. No matching distribution found for testtools<2.0.0,>=0.9.2221:06
cloudnullAndrew_jedi: ive not seen that before .21:06
cloudnullis that happening on the repo server?21:07
cloudnullwhile building the venv ?21:07
odyssey4meAndrew_jedi that's resolved by https://review.openstack.org/28800521:07
Andrew_jedicloudnull: nope, during keystone installation21:07
odyssey4menow that it's merged, I need to push a new tag for kilo :)21:07
cloudnulloh. thatll do it21:07
cloudnullAndrew_jedi:  i guess your on a tag. if you change to the branch and pull the latest changes it should be good to go21:08
Andrew_jedicloudnull: yep, i have pulled the recent changes21:09
odyssey4meAndrew_jedi execute: git checkout origin/kilo; git pull21:09
Andrew_jedicloudnull: now building repo server again21:09
cloudnullok21:09
*** johnmilton has quit IRC21:10
*** johnmilton has joined #openstack-ansible21:10
*** johnmilton has quit IRC21:11
*** johnmilton has joined #openstack-ansible21:11
*** johnmilton has quit IRC21:13
*** Mudpuppy has joined #openstack-ansible21:13
*** johnmilton has joined #openstack-ansible21:13
*** Mudpuppy_ has quit IRC21:16
odyssey4me#success OpenStack-Ansible Kilo 11.2.10 released: https://launchpad.net/openstack-ansible/+milestone/11.2.1021:17
openstackstatusodyssey4me: Added success to Success page21:17
*** cemmason has quit IRC21:19
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_glance: Fix auth_url for glance configuration  https://review.openstack.org/28874921:23
*** johnmilton has quit IRC21:23
*** dmsimard has quit IRC21:23
*** mathlin1 has quit IRC21:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Updates all repo SHAs to open up work on 11.2.11  https://review.openstack.org/28875221:28
automagicallyodyssey4me: Re merge a patch to disable termination. So, a patch with just this, but set to false? https://review.openstack.org/#/c/277199/11/playbooks/inventory/group_vars/hosts.yml21:34
automagicallyIf so, I can propose in a minute21:34
automagicallyJust want to make sure I follow you21:34
odyssey4memhayden you spotted the blank console log - that's because the new image has no curl installed... that'll be fixed by monday21:35
odyssey4meor by tuesday more likely actually21:36
odyssey4meautomagically yep, pretty much that with 'openstack_external_ssl: false' should so it21:36
automagicallyRoger21:36
odyssey4methat should at least unblock the gate while the rest gets done21:36
*** phiche1 has joined #openstack-ansible21:37
*** phiche has quit IRC21:38
odyssey4meautomagically the reality is that we should probably default to false in the roles, and use group_vars to set things to true when we're ready21:39
automagicallyAgreed21:39
automagicallyMore patchsets to manage, but the pattern is more appropriate21:39
odyssey4meI didn't think of it before, but it probaby doesn't make sense to default to assuming ssl offloading in the roles themselves21:39
automagicallyThey don’t so much as they assume a few vars exist21:39
automagicallyBut let me take a pass through21:39
odyssey4meyeah, I'd support that pattern better21:40
automagicallyIts the roles coupling tightly to the playbooks problem all over again21:40
automagicallyIts going to keep rearing its ugly head for the next week or two I would guess as IRR fallout21:40
odyssey4meyeah, I think a good pattern is for roles to assume a small amount of requirements in defaults21:41
*** Mudpuppy has quit IRC21:45
*** Mudpuppy has joined #openstack-ansible21:46
*** weezS has quit IRC21:46
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_keystone: Role should default to no external SSL termination  https://review.openstack.org/28875721:48
automagicallyodyssey4me: Ha, so the role attempted to, but the var name was slightly off21:49
odyssey4meautomagically looks like a bug, either in subsequent roles or that role21:50
odyssey4mecloudnull ^21:50
odyssey4meautomagically the funny thing is that I though I saw a mismatch in that var name convention at some point, so in those patches that you asked me to check, I verified them against some other patches21:52
automagicallyAt the rate we’ve been churning patches lately, I’m not surprised we missed a subtle bug21:53
automagicallyThe gate caught it21:53
automagicallyThank you gate21:53
odyssey4me:)21:56
*** woodard has quit IRC21:57
odyssey4meit's time for me to exit for the night21:57
Andrew_jedicloudnull odyssey4me : Thank you :). It worked.21:57
odyssey4mezuul is stuck in its queue processing - infra's busy working on resolving it21:57
*** karimb has joined #openstack-ansible21:58
odyssey4meautomagically if you're interested in learning more about OpenStack's CI/Infra - it's quite interesting to lurk in #openstack-infra21:58
*** pcaruana has joined #openstack-ansible21:58
odyssey4meit's a busy channel, but it keeps you abreast of things going on21:58
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Removing duplicate repo_build role dependency  https://review.openstack.org/28875821:59
automagicallyThx, I may just start21:59
odyssey4meAndrew_jedi good :) Kilo's a stable branch now, and very few other changes will happen in it21:59
*** karimb has quit IRC21:59
Andrew_jediodyssey4me: perfect, thanks for the update :)21:59
odyssey4meAndrew_jedi we're pretty close to having a set of upgrade scripts from kilo to liberty ready, which may be of interest to you... I expect that our next liberty tag will have the base bits done and ready for broad testing and validation22:00
*** aslaen has joined #openstack-ansible22:01
Andrew_jediodyssey4me: I also may have something which will be interesting for you. A heat template to deploy OSA with ceph on any openstack cloud.22:01
odyssey4meAndrew_jedi oh, that sounds good - we have a few similar bits around, and there are some efforts to consolidate some of them22:02
automagicallyThat does sound cool22:02
odyssey4meAndrew_jedi do you have a link?22:02
odyssey4meAndrew_jedi I expect that https://github.com/openstack/openstack-ansible/blob/master/scripts/osa-aio-heat-template.yml could do with a serious amount of updating by anyone keen on doing so22:02
odyssey4meBut I'd definitely be keen to see a fairly flexible multi-node heat template available in-repo.22:03
odyssey4methis is another one, FYI: https://github.com/rcbops/rpc-heat22:04
*** jguy_ has quit IRC22:04
odyssey4meit's been around a long time and needs an overhaul though - there's far too much embedded bash scripting22:04
*** thorst_ has quit IRC22:05
odyssey4meautomagically well spotted in https://review.openstack.org/#/c/288758/ - maybe we should sort the file in alphanumeric order and remove the dup in one go?22:06
Andrew_jediodyssey4me: I will share that soon. :)22:06
odyssey4methat'll make it far easier to prevent similar mistakes in the future22:06
*** KLevenstein has quit IRC22:07
automagicallyAgreed, new patch incoming22:07
*** thorst has joined #openstack-ansible22:07
*** jthorne has quit IRC22:10
*** thorst has quit IRC22:12
*** weshay has quit IRC22:13
odyssey4meautomagically jmccrory cloudnull while gerrit isn't showing the successful build - the CI log is: https://review.openstack.org/28800622:13
*** retreved has quit IRC22:15
cloudnullodyssey4me:  do we need that patch in at this point ?22:15
odyssey4mecloudnull which one? https://review.openstack.org/288006 ?22:15
cloudnullyes22:15
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible: Removing duplicate repo_build role dependency  https://review.openstack.org/28875822:16
odyssey4men orush I suppose - it's blocking successful builds in other roles... but not in the integrated build22:16
cloudnullok22:16
odyssey4meI should perhaps stop being obsessive and stop computering :p22:16
cloudnullIm + on the change however im the original commiter so +1 from me22:17
cloudnullsomeone else must approve22:17
*** aslaen has quit IRC22:17
jmccroryodyssey4me were you able to get depends-on sorted out between roles or still WIP?22:18
*** asettle has joined #openstack-ansible22:18
*** aslaen has joined #openstack-ansible22:20
odyssey4mejmccrory depends-on at this point simply holds back the merge queue, it does not yet test things together22:20
odyssey4mejmccrory I'll work on that in more earnest next week. Without it we're going to have a shoddy time as we'll be forced to merge patches without any certainty that they work together.22:21
*** asettle has quit IRC22:23
*** skamithi14 has joined #openstack-ansible22:23
odyssey4meok, I'm out.22:23
*** thorst has joined #openstack-ansible22:23
odyssey4meladies & gents, it's been a good week - thank you all, have a wonderful weekend!22:23
odyssey4meslainte!22:23
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_heat: Role should default to no external SSL termination  https://review.openstack.org/28876922:26
*** cloudtrainme has quit IRC22:26
*** skamithi13 has quit IRC22:26
*** dnovosel_1 has quit IRC22:26
*** phiche1 has quit IRC22:27
jmccrorythanks, later22:27
*** raddaoui has quit IRC22:27
*** busterswt has quit IRC22:28
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_nova: Role should default to no external SSL termination  https://review.openstack.org/28877322:28
*** asettle has joined #openstack-ansible22:31
openstackgerritMerged openstack/openstack-ansible-os_swift_sync: Add curl to bindep requirements  https://review.openstack.org/28868022:32
*** asettle has quit IRC22:33
*** thorst has quit IRC22:35
Andrew_jedifailed: [compute01] => (item={'path': u'/var/lib/nova/instances'}) => {"failed": true, "gid": 0, "group": "root", "item": {"path": "/var/lib/nova/instances"}, "mode": "0755", "owner": "root", "path": "/var/lib/nova/instances", "size": 16384, "state": "directory", "uid": 0}msg: chown failed22:39
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_heat: Fix auth_url for heat configuration  https://review.openstack.org/28878022:45
openstackgerritBjoern Teipel proposed openstack/openstack-ansible-os_swift: Fix auth_url for swift configuration  https://review.openstack.org/28878122:46
*** aslaen has quit IRC22:46
Andrew_jedigroup should be "nova" and owner should be "nova" ?22:47
*** skamithi14 has quit IRC22:48
*** skamithi13 has joined #openstack-ansible22:48
*** karimb has joined #openstack-ansible22:50
*** woodard has joined #openstack-ansible22:51
*** jguy_ has joined #openstack-ansible22:51
openstackgerritMichael Gugino proposed openstack/openstack-ansible-rsyslog_server: Multi-distro support for rsyslog-server role  https://review.openstack.org/27429022:55
*** aslaen has joined #openstack-ansible22:57
openstackgerritMerged openstack/openstack-ansible-lxc_hosts: Resolve bad assumptions about the base OS  https://review.openstack.org/28800623:01
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_horizon: Role should default to no external SSL termination  https://review.openstack.org/28878623:02
*** galstrom_zzz is now known as galstrom23:04
*** skamithi14 has joined #openstack-ansible23:06
*** karimb has quit IRC23:08
*** skamithi13 has quit IRC23:08
*** karimb has joined #openstack-ansible23:08
*** ametts has quit IRC23:08
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_keystone: Role should default to no external SSL termination  https://review.openstack.org/28875723:08
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_horizon: Role should default to no external SSL termination  https://review.openstack.org/28878623:09
*** admin0 has quit IRC23:21
*** sdake has quit IRC23:25
openstackgerritMerged openstack/openstack-ansible: Updates all repo SHAs to open up work on 12.0.8  https://review.openstack.org/28839123:27
*** Andrew_jedi has quit IRC23:27
*** aslaen has quit IRC23:33
*** Trident has quit IRC23:33
*** karimb has quit IRC23:34
*** thorst has joined #openstack-ansible23:35
*** fawadkhaliq has quit IRC23:38
*** spotz is now known as spotz_zzz23:39
*** fawadkhaliq has joined #openstack-ansible23:39
*** thorst has quit IRC23:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts: Fix apparmor profile load handler  https://review.openstack.org/28785523:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server: Initial commit for bindep requirements  https://review.openstack.org/28787023:48
*** ShannonM has quit IRC23:48
*** daneyon has joined #openstack-ansible23:49
*** daneyon_ has joined #openstack-ansible23:52
*** Bjoern has quit IRC23:53
*** Mudpuppy has joined #openstack-ansible23:54
*** daneyon has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!