| *** yingjun has joined #openstack-kolla | 00:01 | |
| *** salv-orlando has quit IRC | 00:01 | |
| openstackgerrit | Merged openstack/kolla master: Add qdrouterd container https://review.openstack.org/465145 | 00:01 |
|---|---|---|
| kbaegis | Hey, has anyone had the horizon container fail to deploy, incorrect timezone? | 00:02 |
| kbaegis | stable/ocata? | 00:02 |
| kbaegis | "ValueError: Incorrect timezone setting: UTC" | 00:03 |
| *** chas has joined #openstack-kolla | 00:04 | |
| *** huzhengchuan has joined #openstack-kolla | 00:08 | |
| *** huzhengchuan_ has joined #openstack-kolla | 00:08 | |
| *** masber has joined #openstack-kolla | 00:09 | |
| *** chas has quit IRC | 00:09 | |
| *** ducttape_ has joined #openstack-kolla | 00:11 | |
| *** ducttape_ has quit IRC | 00:16 | |
| *** rwellum has quit IRC | 00:21 | |
| *** chas has joined #openstack-kolla | 00:25 | |
| *** ducttape_ has joined #openstack-kolla | 00:26 | |
| *** numans has quit IRC | 00:27 | |
| *** ducttape_ has quit IRC | 00:30 | |
| *** chas has quit IRC | 00:30 | |
| *** numans has joined #openstack-kolla | 00:32 | |
| *** tonanhngo has quit IRC | 00:36 | |
| *** tovin07_ has joined #openstack-kolla | 00:37 | |
| *** itlinux has joined #openstack-kolla | 00:40 | |
| *** itlinux has quit IRC | 00:41 | |
| *** feisky has joined #openstack-kolla | 00:42 | |
| *** itlinux has joined #openstack-kolla | 00:42 | |
| *** tonanhngo has joined #openstack-kolla | 00:43 | |
| *** chas has joined #openstack-kolla | 00:46 | |
| *** tonanhngo_ has joined #openstack-kolla | 00:47 | |
| *** tonanhngo has quit IRC | 00:48 | |
| *** tonanhngo_ has quit IRC | 00:51 | |
| *** chas has quit IRC | 00:51 | |
| *** daidv has joined #openstack-kolla | 00:53 | |
| *** vhosakot_ has quit IRC | 00:55 | |
| daidv | inc0, morning, can you review for my commits related to mixing image type deployment blueprint? | 00:56 |
| daidv | https://review.openstack.org/#/q/mixing-binary-and-source-image | 00:56 |
| *** zhuzeyu has quit IRC | 00:59 | |
| *** zhuzeyu has joined #openstack-kolla | 01:01 | |
| *** bmaltais has quit IRC | 01:04 | |
| *** jtriley has joined #openstack-kolla | 01:05 | |
| *** chas has joined #openstack-kolla | 01:07 | |
| *** chas has quit IRC | 01:12 | |
| *** vhosakot has joined #openstack-kolla | 01:13 | |
| vhosakot | kbaegis: I think the "Incorrect timezone setting" is from django, not from horizon itself. Can you check the horizon logs in the horizon container at /var/log/httpd or /var/log/apache2. | 01:19 |
| *** gfidente has quit IRC | 01:19 | |
| *** ducttape_ has joined #openstack-kolla | 01:27 | |
| *** emccormick has quit IRC | 01:27 | |
| *** itlinux has quit IRC | 01:28 | |
| *** chas has joined #openstack-kolla | 01:28 | |
| *** zhuzeyu has quit IRC | 01:30 | |
| *** zhuzeyu has joined #openstack-kolla | 01:30 | |
| *** hrw has quit IRC | 01:32 | |
| *** chas has quit IRC | 01:33 | |
| *** hrw has joined #openstack-kolla | 01:34 | |
| kbaegis | vhosakot: I just had to rerun deploy | 01:34 |
| kbaegis | Seemed to work | 01:34 |
| vhosakot | cool | 01:34 |
| *** dave-mccowan has quit IRC | 01:36 | |
| *** vhosakot has quit IRC | 01:37 | |
| *** japestinho has joined #openstack-kolla | 01:38 | |
| duonghq | inc0, hello, will we follow openstack release schedule for Pike? | 01:39 |
| *** zhuzeyu has quit IRC | 01:39 | |
| sbezverk | sdake: ping | 01:41 |
| *** caowei has joined #openstack-kolla | 01:42 | |
| *** chas has joined #openstack-kolla | 01:49 | |
| *** chas has quit IRC | 01:53 | |
| *** ducttape_ has quit IRC | 01:55 | |
| *** ducttape_ has joined #openstack-kolla | 01:56 | |
| inc0 | duonghq: we missed P-1, but I'd hope we'll release Pike-2 | 01:57 |
| inc0 | Jeffrey4l is our release liason | 01:57 |
| duonghq | inc0, roger | 01:57 |
| celo_r | Hi, building kolla-ansible 4.0.1 centos from source, kafka fails to build: INFO:kolla.image.build.kafka:source not yet available for centos | 01:58 |
| sbezverk | inc0: https://review.openstack.org/#/c/454841 was addressed, could you please review it? | 01:59 |
| *** unicell has quit IRC | 02:00 | |
| inc0 | we didn't figure out why nova can't use nova rbd user? | 02:01 |
| celo_r | Looks like binary is not available either: INFO:kolla.image.build.kafka:binary not yet available for centos. What is kafka needed for? | 02:06 |
| *** chas has joined #openstack-kolla | 02:10 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Mount cinder volume for cinder-volume and cinder-backup all the time https://review.openstack.org/466683 | 02:13 |
| *** chas has quit IRC | 02:14 | |
| *** kbaegis1 has joined #openstack-kolla | 02:23 | |
| *** kbaegis has quit IRC | 02:26 | |
| sdake | celo_r nothing crucial | 02:28 |
| sdake | celo_r if build binary it wont build - warning may be ignored | 02:28 |
| celo_r | Thank you @sdake, will try to deploy the way it is. | 02:29 |
| sdake | ucs host upgrade utility slower then mud | 02:29 |
| *** chas has joined #openstack-kolla | 02:30 | |
| *** ducttape_ has quit IRC | 02:31 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: v4 gate. https://review.openstack.org/454841 | 02:33 |
| *** tovin07__ has joined #openstack-kolla | 02:34 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements https://review.openstack.org/464393 | 02:35 |
| *** chas has quit IRC | 02:36 | |
| *** eanylin has quit IRC | 02:37 | |
| *** tovin07_ has quit IRC | 02:37 | |
| *** xinliang has quit IRC | 02:40 | |
| *** Pavo has joined #openstack-kolla | 02:40 | |
| *** ArminderSingh- has joined #openstack-kolla | 02:41 | |
| *** Pavo has quit IRC | 02:42 | |
| *** Pavo has joined #openstack-kolla | 02:43 | |
| *** ArminderSingh has quit IRC | 02:44 | |
| *** Pavo has quit IRC | 02:50 | |
| *** ducttape_ has joined #openstack-kolla | 02:51 | |
| *** chas has joined #openstack-kolla | 02:51 | |
| *** xinliang has joined #openstack-kolla | 02:52 | |
| *** xinliang has quit IRC | 02:52 | |
| *** xinliang has joined #openstack-kolla | 02:52 | |
| *** ducttape_ has quit IRC | 02:55 | |
| *** chas has quit IRC | 02:56 | |
| *** eanylin has joined #openstack-kolla | 02:58 | |
| *** huzhengchuan_ has quit IRC | 03:00 | |
| *** huzhengchuan has quit IRC | 03:01 | |
| *** chas has joined #openstack-kolla | 03:12 | |
| *** chas has quit IRC | 03:17 | |
| *** huzhengchuan has joined #openstack-kolla | 03:25 | |
| *** huzhengchuan_ has joined #openstack-kolla | 03:27 | |
| *** itlinux has joined #openstack-kolla | 03:30 | |
| *** chas has joined #openstack-kolla | 03:33 | |
| *** stefan_bo has quit IRC | 03:35 | |
| Jeffrey4l | sdake, around? | 03:37 |
| Jeffrey4l | is helm is competitive with etcd-operator? sdake sbezverk ? | 03:38 |
| *** chas has quit IRC | 03:38 | |
| *** huzhengchuan_ has quit IRC | 03:40 | |
| *** huzhengchuan has quit IRC | 03:41 | |
| *** huzhengchuan_ has joined #openstack-kolla | 03:45 | |
| *** huzhengchuan has joined #openstack-kolla | 03:46 | |
| *** japestinho has quit IRC | 03:48 | |
| *** kbaegis1 has quit IRC | 03:51 | |
| *** chas has joined #openstack-kolla | 03:54 | |
| openstackgerrit | Surya Prakash (spsurya) proposed openstack/kolla-ansible master: [WIP] Add dragonflow ansible role https://review.openstack.org/465862 | 03:56 |
| *** tovin07_ has joined #openstack-kolla | 03:58 | |
| *** chas has quit IRC | 03:59 | |
| duonghq | Jeffrey4l, we have many *-operator thing beside of etcd-operator | 03:59 |
| *** tovin07__ has quit IRC | 04:00 | |
| *** caowei has quit IRC | 04:05 | |
| Jeffrey4l | duonghq, i am talking this project of etcd-op | 04:11 |
| Jeffrey4l | https://github.com/coreos/etcd-operator | 04:11 |
| *** david-lyle has quit IRC | 04:14 | |
| *** chas has joined #openstack-kolla | 04:15 | |
| Jeffrey4l | isn't is a Orchestration tools created by coreos? | 04:15 |
| *** chas has quit IRC | 04:19 | |
| *** itlinux has quit IRC | 04:25 | |
| *** chas has joined #openstack-kolla | 04:36 | |
| *** chas has quit IRC | 04:40 | |
| duonghq | Jeffrey4l, kind of it, but helm is package manager | 04:41 |
| duonghq | I think "operator" is like concept more | 04:41 |
| *** caowei has joined #openstack-kolla | 04:49 | |
| *** chas has joined #openstack-kolla | 04:57 | |
| *** chas has quit IRC | 04:57 | |
| *** chas has joined #openstack-kolla | 04:57 | |
| *** caowei has quit IRC | 05:04 | |
| *** ducttape_ has joined #openstack-kolla | 05:07 | |
| *** chas has quit IRC | 05:08 | |
| Jeffrey4l | is kolla-k8s using helm and etcd-operator? duonghq | 05:10 |
| duonghq | Jeffrey4l, currently, kolla-k8s is using helm | 05:11 |
| *** ducttape_ has quit IRC | 05:11 | |
| Jeffrey4l | is there any future plan? duonghq | 05:12 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/kolla master: Add images for novajoin services https://review.openstack.org/466268 | 05:12 |
| duonghq | Jeffrey4l, I'm not pretty sure | 05:13 |
| Jeffrey4l | aha, thx ;) | 05:13 |
| Jeffrey4l | i am trying to under the kubernetes works ;) | 05:14 |
| Jeffrey4l | world* | 05:14 |
| *** jaosorior_away is now known as jaosorior | 05:24 | |
| *** chas has joined #openstack-kolla | 05:28 | |
| *** chandankumar has joined #openstack-kolla | 05:30 | |
| *** chas has quit IRC | 05:33 | |
| *** caowei has joined #openstack-kolla | 05:34 | |
| openstackgerrit | Zeyu Zhu proposed openstack/kolla-kubernetes master: Remove the invariable value in string.format() https://review.openstack.org/467010 | 05:35 |
| openstackgerrit | Zeyu Zhu proposed openstack/kolla-kubernetes master: Remove the invariable value in string.format() https://review.openstack.org/467010 | 05:38 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multinode gate https://review.openstack.org/466007 | 05:48 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multinode gate https://review.openstack.org/466007 | 05:48 |
| *** chas has joined #openstack-kolla | 05:50 | |
| *** caowei has quit IRC | 05:52 | |
| *** caowei has joined #openstack-kolla | 05:52 | |
| *** chas has quit IRC | 05:54 | |
| *** stefan_bo has joined #openstack-kolla | 06:01 | |
| *** ducttape_ has joined #openstack-kolla | 06:08 | |
| *** chas has joined #openstack-kolla | 06:11 | |
| *** magicboiz has joined #openstack-kolla | 06:12 | |
| *** ducttape_ has quit IRC | 06:13 | |
| sdake | sbezverk for your c220,s od you have "blanks" for storage devices and the n"caddys" for the storage devices that are actually there? | 06:13 |
| *** chas has quit IRC | 06:15 | |
| *** magicboiz has quit IRC | 06:16 | |
| *** tvignaud_afk is now known as tvignaud | 06:16 | |
| *** magicboiz has joined #openstack-kolla | 06:24 | |
| *** huzhengchuan has quit IRC | 06:25 | |
| *** huzhengchuan_ has quit IRC | 06:25 | |
| *** jmccarthy has joined #openstack-kolla | 06:30 | |
| *** chas has joined #openstack-kolla | 06:32 | |
| *** sbezverk has quit IRC | 06:33 | |
| *** sbezverk has joined #openstack-kolla | 06:33 | |
| *** chas has quit IRC | 06:36 | |
| *** huzhengchuan has joined #openstack-kolla | 06:36 | |
| *** huzhengchuan_ has joined #openstack-kolla | 06:36 | |
| *** pcaruana has joined #openstack-kolla | 06:40 | |
| *** skramaja has joined #openstack-kolla | 06:43 | |
| *** chas has joined #openstack-kolla | 06:52 | |
| *** jascott1 has joined #openstack-kolla | 06:55 | |
| *** chas has quit IRC | 06:56 | |
| *** matrohon has joined #openstack-kolla | 06:57 | |
| *** chas has joined #openstack-kolla | 07:03 | |
| *** Serlex has joined #openstack-kolla | 07:05 | |
| *** Serlex has quit IRC | 07:05 | |
| *** Serlex has joined #openstack-kolla | 07:05 | |
| *** korzen has joined #openstack-kolla | 07:05 | |
| *** salv-orlando has joined #openstack-kolla | 07:10 | |
| *** unicell has joined #openstack-kolla | 07:24 | |
| *** salv-orlando has quit IRC | 07:25 | |
| *** manheim_ has joined #openstack-kolla | 07:29 | |
| berendt | kolla-slack: do we have a kolla slack channel? | 07:37 |
| *** huzhengchuan_ has quit IRC | 07:44 | |
| *** huzhengchuan has quit IRC | 07:44 | |
| *** blallau has joined #openstack-kolla | 07:49 | |
| manheim_ | not that i know of | 07:53 |
| *** huzhengchuan_ has joined #openstack-kolla | 07:58 | |
| *** huzhengchuan has joined #openstack-kolla | 07:58 | |
| *** unicell has quit IRC | 07:58 | |
| *** skramaja is now known as skramaja_afk | 07:59 | |
| *** shardy has joined #openstack-kolla | 08:07 | |
| *** ducttape_ has joined #openstack-kolla | 08:10 | |
| *** ducttape_ has quit IRC | 08:15 | |
| *** egonzalez has joined #openstack-kolla | 08:15 | |
| zhubingbing | sup egonzalez | 08:16 |
| zhubingbing | ；） | 08:16 |
| egonzalez | hey zhubingbing , how are you? | 08:16 |
| zhubingbing | i am fine | 08:16 |
| zhubingbing | ;) | 08:17 |
| *** lpetrut has joined #openstack-kolla | 08:17 | |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: Sensu images https://review.openstack.org/463593 | 08:18 |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: WIP - Modified fluentd Image https://review.openstack.org/467075 | 08:18 |
| *** openstackgerrit has quit IRC | 08:18 | |
| manheim_ | egonzalez when i do kolla-ansible pull i can see it goes through ansible/site.yml, right? | 08:20 |
| *** magicboiz has quit IRC | 08:21 | |
| *** magicboiz has joined #openstack-kolla | 08:21 | |
| *** athomas has joined #openstack-kolla | 08:21 | |
| egonzalez | manheim, yep, when you use deploy/pull/upgrade in goes to site.yml, then on each role main.yml have {{ action }}.yml | 08:21 |
| egonzalez | each action is a file called upgrade,pull or deploy | 08:21 |
| manheim_ | ok, so i do the following thing | 08:22 |
| *** jascott1 has quit IRC | 08:22 | |
| manheim_ | 1. put the hyper nodes in the inventory file | 08:22 |
| manheim_ | 2. pull | 08:22 |
| manheim_ | fatal: [192.168.10.15]: FAILED! => {"failed": true, "reason": "the file_name '/usr/local/share/kolla-ansible/ansible/pull.yml' does not exist, or is not readable"} | 08:22 |
| manheim_ | this happens | 08:22 |
| manheim_ | that is the IP of the hyperv node | 08:23 |
| *** jascott1 has joined #openstack-kolla | 08:23 | |
| manheim_ | TASK [nova-hyperv : include] | 08:23 |
| egonzalez | hrm, add an empty pull.yml with --- at the begining | 08:23 |
| *** mandre is now known as mandre|away | 08:23 | |
| jaosorior | egonzalez: hey! could you check this out if you have some time https://review.openstack.org/#/c/466268/ ? | 08:23 |
| manheim_ | at the begining of what | 08:23 |
| egonzalez | of the file, to say is a yaml file but with empty content | 08:24 |
| egonzalez | similar to https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/aodh/tasks/check.yml | 08:25 |
| egonzalez | also add the check.yml file ;) | 08:25 |
| manheim_ | ok, i see now | 08:25 |
| manheim_ | what is the purpose of the file more exactly, when is it used? | 08:25 |
| egonzalez | for sanity checks, example create a volume and remove it | 08:27 |
| *** jascott1 has quit IRC | 08:27 | |
| egonzalez | is wip yep | 08:27 |
| manheim_ | ok, thanks for the help | 08:28 |
| *** pbourke has joined #openstack-kolla | 08:29 | |
| *** ipsecguy_ has joined #openstack-kolla | 08:30 | |
| *** openstackgerrit has joined #openstack-kolla | 08:32 | |
| openstackgerrit | Zeyu Zhu proposed openstack/kolla-kubernetes master: Remove the invariable value in string.format() https://review.openstack.org/467010 | 08:32 |
| *** caowei has quit IRC | 08:32 | |
| *** ipsecguy has quit IRC | 08:33 | |
| *** kbaegis has joined #openstack-kolla | 08:34 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Generalize api_interface_address variable usage https://review.openstack.org/457479 | 08:35 |
| *** skramaja_afk is now known as skramaja | 08:36 | |
| *** kbaegis1 has joined #openstack-kolla | 08:37 | |
| *** caowei has joined #openstack-kolla | 08:38 | |
| openstackgerrit | Merged openstack/kolla-ansible stable/ocata: Mount cinder volume for cinder-volume and cinder-backup all the time https://review.openstack.org/466683 | 08:38 |
| *** kbaegis has quit IRC | 08:40 | |
| *** vcn[m] has quit IRC | 08:46 | |
| *** retr0h has quit IRC | 08:46 | |
| *** bachp has quit IRC | 08:46 | |
| *** nhlfr has quit IRC | 08:46 | |
| *** imcsk8 has quit IRC | 08:46 | |
| *** imcsk8_ has joined #openstack-kolla | 08:46 | |
| jaosorior | egonzalez: thanks for checking it out; got a question about one file though, commented there | 08:47 |
| *** sambetts|afk has quit IRC | 08:48 | |
| *** Kimmo_ has quit IRC | 08:48 | |
| *** vcn[m] has joined #openstack-kolla | 08:49 | |
| egonzalez | jaosorior, replied | 08:49 |
| jaosorior | oooh, right, now I get it | 08:50 |
| jaosorior | thanks | 08:50 |
| egonzalez | basically is that source images are mostly the same for .deb and .rpm distros, unless there is a missing library on one of them | 08:50 |
| matrohon | egonzalez, hi | 08:51 |
| matrohon | egonzalez, I have another question concerning upgrades | 08:52 |
| *** sambetts_ has joined #openstack-kolla | 08:52 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/kolla master: Add images for novajoin services https://review.openstack.org/466268 | 08:52 |
| jaosorior | egonzalez: well, ipa-admintools is missing from debian based distros | 08:52 |
| jaosorior | egonzalez: so novajoin can't be used there. | 08:53 |
| jaosorior | at least it's missing on ubuntu | 08:53 |
| egonzalez | jaosorior, maybe is this package? https://packages.ubuntu.com/search?keywords=freeipa-admintools | 08:53 |
| *** nhlfr has joined #openstack-kolla | 08:53 | |
| *** retr0h has joined #openstack-kolla | 08:53 | |
| *** bachp has joined #openstack-kolla | 08:53 | |
| egonzalez | matrohon, sup | 08:54 |
| *** kbaegis1 has quit IRC | 08:54 | |
| jaosorior | egonzalez: might be. I was told by the team that maintains it that they had missed the deadline for packaging it for ubuntu. | 08:54 |
| matrohon | egonzalez, let's say I want to upgrade only one component that I tag with 4.0.2.0 and push on my local repo, how can I upgrade only this component? | 08:55 |
| *** jistr is now known as jistr|call | 08:56 | |
| jaosorior | egonzalez: I'll give it a try | 08:57 |
| egonzalez | matrohon, example of upgrade senlin-engine only | 08:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/kolla master: Add images for novajoin services https://review.openstack.org/466268 | 08:58 |
| egonzalez | in every defaults of each role, you have a section with tag/name of the images | 08:58 |
| egonzalez | https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/senlin/defaults/main.yml#L36 | 08:58 |
| egonzalez | just override senlin_engine_tag: <your_tag> and deploy/upgrade | 08:58 |
| matrohon | egonzalez, in globals.yml? | 08:59 |
| egonzalez | matrohon, I'd put it there just to remember I changed the value ;) but can be in any place who overrides default variables | 09:00 |
| matrohon | egonzalez, great, I'll give it a try | 09:00 |
| egonzalez | jaosorior, added a few other comments on a previous PS than current | 09:04 |
| jaosorior | egonzalez: thought I had addressed them | 09:04 |
| jaosorior | added the source and pip install packages, handled the debian based distros (hopefully), removed the nova user comment | 09:05 |
| *** shardy has quit IRC | 09:05 | |
| jaosorior | egonzalez: the thing is, we rely on the openstack-nova-common package to create the /etc/ bits | 09:06 |
| jaosorior | since the configuration is in /etc/nova | 09:06 |
| jaosorior | we don't have an /etc/novajoin directory | 09:06 |
| jaosorior | it worked just fine for the binary image... but I guess this is an issue for the source one | 09:06 |
| egonzalez | one if the issues is the cp /novajoin/etc/nova which path not exists in novajoin repo | 09:07 |
| jaosorior | oh, right | 09:08 |
| egonzalez | and the other is nova-common binary into source images that are not allowed to mix | 09:08 |
| jaosorior | crap | 09:08 |
| jaosorior | well, any recommendations? | 09:08 |
| jaosorior | I'm honestly never gonna use the source image :/ | 09:08 |
| egonzalez | nova-common is only needed for the files? or for some dependency? | 09:08 |
| jaosorior | nor will we ever support it in tripleo | 09:08 |
| jaosorior | egonzalez: files, users and permissions. | 09:09 |
| *** huzhengchuan has quit IRC | 09:10 | |
| egonzalez | nova user is being created at base-image, novajoin will need to be in the nova group guess | 09:10 |
| *** huzhengchuan_ has quit IRC | 09:10 | |
| jaosorior | egonzalez: it even uses the same user | 09:10 |
| egonzalez | jaosorior, I'd use plugins for adding nova source code into novajoin, check an example of how to do it https://review.openstack.org/#/c/454743/ | 09:11 |
| egonzalez | then, remove novajoin user creation from config.py, will avoid you a bunch of merge conflicts | 09:12 |
| jaosorior | egonzalez: I'm not sure what the plugins bit would be used for | 09:12 |
| jaosorior | or how | 09:13 |
| jaosorior | egonzalez: or, you mean that novajoin should use the base nova image? | 09:14 |
| *** shardy has joined #openstack-kolla | 09:15 | |
| egonzalez | not sure how close novajoin is to nova, maybe is worth be a child from nova-base and be included into nova/ folder | 09:17 |
| *** jistr|call is now known as jistr | 09:19 | |
| matrohon | egonzalez, you took senlin as an example, but can I do the same with openstack services, I want to do it for nova | 09:21 |
| jaosorior | egonzalez: it's a vendordata plugin. So it's close-ish... but not that much | 09:22 |
| egonzalez | matrohon, nope in a single variable (is WIP atm) but can override each nova variable | 09:22 |
| jaosorior | egonzalez: it can be ran fairly independently and merely requires the /etc/nova folder along with the user and permissions. But that's all. | 09:22 |
| jaosorior | I did think about using the nova base image... but there'a a LOT of stuff we don't really need, and the image would end up quite bloated :/ needlessly | 09:23 |
| *** bjolo has joined #openstack-kolla | 09:24 | |
| *** huzhengchuan has joined #openstack-kolla | 09:24 | |
| *** masber has quit IRC | 09:24 | |
| *** sambetts_ is now known as sambetts | 09:24 | |
| bjolo | Jeffrey4l, sup | 09:25 |
| Jeffrey4l | hey bjolo | 09:25 |
| matrohon | egonzalez, for instance, what is the variable for specifying the tag to use for nova_scheduler? I can't find the code where this can be overridden | 09:25 |
| egonzalez | matrohon, https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/defaults/main.yml#L192 | 09:26 |
| matrohon | egonzalez, great thanks | 09:26 |
| *** gfidente has joined #openstack-kolla | 09:27 | |
| *** gfidente has quit IRC | 09:27 | |
| *** gfidente has joined #openstack-kolla | 09:27 | |
| bjolo | Jeffrey4l, we have rolled back and tried older versions of kernel, docker, etc, but same issue | 09:27 |
| Jeffrey4l | hrm, intresting. | 09:27 |
| bjolo | did you try with newer images? | 09:27 |
| Jeffrey4l | not yet :( . but i have a new deployment multi node now. let me test this now. | 09:28 |
| Jeffrey4l | mom | 09:28 |
| Jeffrey4l | monent. | 09:28 |
| bjolo | tnx | 09:28 |
| *** powerd has joined #openstack-kolla | 09:33 | |
| jaosorior | How are services that use genconfig handled? | 09:36 |
| *** huzhengchuan_ has joined #openstack-kolla | 09:36 | |
| bjolo | Jeffrey4l, https://bugs.launchpad.net/kolla-ansible/+bug/1692852 | 09:39 |
| openstack | Launchpad bug 1692852 in kolla-ansible "nova_libvirt restart fails when there are runing VMs" [Undecided,New] | 09:39 |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a Kolla 'devstack' mode https://review.openstack.org/454690 | 09:43 |
| Jeffrey4l | bjolo, it works. | 09:45 |
| Jeffrey4l | could u try docker-engine from docker official? rather than docker from centos packages. | 09:48 |
| zhubingbing | sup sdake | 09:52 |
| *** tovin07_ has quit IRC | 09:55 | |
| *** ducttape_ has joined #openstack-kolla | 09:57 | |
| *** ducttape_ has quit IRC | 10:02 | |
| bjolo | Jeffrey4l, have tried 17.05 as well | 10:04 |
| openstackgerrit | Merged openstack/kolla-ansible master: Generalize api_interface_address variable usage https://review.openstack.org/457479 | 10:04 |
| bjolo | different error with 17.05 tho | 10:04 |
| bjolo | nova_libvirt restarts but you can not launch any new VMs on that node or attach volumes untill all running vms have been restarted. i.e. moved back to nova_libvirt as parent pid | 10:05 |
| bjolo | Jeffrey4l, in the ticket, can you please write down your setup? os, kernel, docker, storage, etc | 10:06 |
| manheim_ | hmm, i have an interesting error while using 'tunnel_interface' | 10:07 |
| manheim_ | "msg": "{{ hostvars[inventory_hostname]['ansible_' + tunnel_interface]['ipv4']['address'] if orchestration_engine == 'ANSIBLE' else '0.0.0.0' }}: 'dict object' has no attribute 'ipv4'" | 10:07 |
| manheim_ | but I did not set any IP on it | 10:07 |
| manheim_ | i put the interface on manual | 10:07 |
| bjolo | manheim_, how did u do the deploy? with --limit? | 10:08 |
| manheim_ | no | 10:08 |
| manheim_ | simple deploy | 10:08 |
| bjolo | hmm ok | 10:08 |
| *** rmart04 has joined #openstack-kolla | 10:08 | |
| bjolo | ive seen similar errors when using --limit | 10:08 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Fix zun deployment https://review.openstack.org/456256 | 10:10 |
| *** yingjun has quit IRC | 10:11 | |
| egonzalez | manheim, is that failing on control nodes where tunnel_interface is not present? | 10:12 |
| pester | installed kolla 4.0.0 with magnum, trying to run bay, error - "from kubernetes import client as k8s_config" "ImportError: cannot import name client" | 10:12 |
| Jeffrey4l | bjolo, could u show me "rpm -qa | grep docker" | 10:13 |
| pester | and I did "pip install python-kubernetes" in conductor container | 10:13 |
| hrw | morning | 10:13 |
| *** yee379 has quit IRC | 10:13 | |
| *** yee379 has joined #openstack-kolla | 10:14 | |
| manheim_ | i have only one control node, that interface is present | 10:14 |
| egonzalez | pester, magnum code had a requirement bug missing kubernetes library, if using images from docker hub 4.0.0 have that issue, if you build your own should be fixed | 10:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/kolla master: Add images for novajoin services https://review.openstack.org/466268 | 10:14 |
| pester | I got this issue, how to fix it ? I tried "pip install python-kubernetes" it solved first error, but now next... | 10:15 |
| manheim_ | the tunnel interface is set up the same as for br-ex, and br-ex has no issues | 10:21 |
| *** lpetrut has quit IRC | 10:22 | |
| *** lpetrut has joined #openstack-kolla | 10:22 | |
| pester | ok, to fix magnum run `pip install kubernetes && pip install python-kubernetes` | 10:23 |
| pester | in conductor container | 10:23 |
| egonzalez | pester, was fixed upstream early ocata, but not present in published images. btw, ensure kubernetes is kubernetes>=1.0.0b1 # Apache-2.0 | 10:25 |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Specify 'become' for only necessary tasks (default roles) https://review.openstack.org/398684 | 10:25 |
| *** caowei has quit IRC | 10:28 | |
| *** duonghq has quit IRC | 10:29 | |
| *** stefan_bo has quit IRC | 10:33 | |
| *** daidv has quit IRC | 10:42 | |
| *** Kimmo_ has joined #openstack-kolla | 10:48 | |
| *** salv-orlando has joined #openstack-kolla | 10:49 | |
| openstackgerrit | Martin Mágr proposed openstack/kolla master: Sensu images https://review.openstack.org/463593 | 10:51 |
| openstackgerrit | Merged openstack/kolla-ansible master: Updated from global requirements https://review.openstack.org/465258 | 10:52 |
| *** salv-orlando has quit IRC | 10:53 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add VMware DataStore support to glance https://review.openstack.org/452176 | 10:57 |
| bjolo | Jeffrey4l, http://paste.openstack.org/show/610439/ | 10:57 |
| manheim_ | so am I require to have an IP on the tunnel interface? | 11:01 |
| manheim_ | and why | 11:01 |
| *** huzhengchuan has quit IRC | 11:02 | |
| *** huzhengchuan_ has quit IRC | 11:02 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Advertise public heat endpoint for wait conditions https://review.openstack.org/462655 | 11:09 |
| *** Pavo has joined #openstack-kolla | 11:11 | |
| *** Pavo has quit IRC | 11:11 | |
| *** huzhengchuan has joined #openstack-kolla | 11:14 | |
| *** huzhengchuan_ has joined #openstack-kolla | 11:14 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix wrong variable used in trove role https://review.openstack.org/463258 | 11:15 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix secure_proxy_ssl_header option in nova https://review.openstack.org/452062 | 11:16 |
| *** rwellum has joined #openstack-kolla | 11:21 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Add copy ceph keyring files conditions in cinder https://review.openstack.org/458366 | 11:23 |
| openstackgerrit | Merged openstack/kolla-ansible master: Optimize reconfigure action for rabbitmq https://review.openstack.org/422705 | 11:24 |
| openstackgerrit | Merged openstack/kolla master: Replace invalid link for Docker images in README.rst https://review.openstack.org/463479 | 11:24 |
| rwellum | Morning | 11:26 |
| openstackgerrit | Pavel Gluschak (scsnow) proposed openstack/kolla-ansible master: Make cinder-backup service optional https://review.openstack.org/464620 | 11:29 |
| *** bjolo has quit IRC | 11:29 | |
| *** bjolo has joined #openstack-kolla | 11:29 | |
| *** awebber has joined #openstack-kolla | 11:41 | |
| *** salv-orlando has joined #openstack-kolla | 11:42 | |
| awebber | my goal is to launch more instances per host. is this achieved with 'cpu_allocation_ratio' and what is the best way to change it in kolla? | 11:46 |
| *** mnasiadka has joined #openstack-kolla | 11:51 | |
| *** salv-orlando has quit IRC | 11:52 | |
| *** ducttape_ has joined #openstack-kolla | 11:58 | |
| *** srwilkers has joined #openstack-kolla | 12:03 | |
| egonzalez | awebber, create a file at /etc/kolla/config/nova.conf with the section, option, value of the value you want to override and do kolla-ansible reconfigure | 12:04 |
| *** ducttape_ has quit IRC | 12:04 | |
| *** rhallisey has joined #openstack-kolla | 12:04 | |
| awebber | egonzalez: thanks, ill give it a try... | 12:05 |
| awebber | egonzalez: i already have a file called nova-compute.conf. will it get merged if i create a nova.conf in the same directory? | 12:07 |
| egonzalez | awebber, you can override values for each node, per service or global for nova, all depends where you put the values | 12:08 |
| *** bachp has quit IRC | 12:09 | |
| *** vcn[m] has quit IRC | 12:09 | |
| *** nhlfr has quit IRC | 12:09 | |
| *** retr0h has quit IRC | 12:09 | |
| egonzalez | so, you can change schedulers only for nova-scheduler service, virt_type for computes and have a nova.conf to configure something else on both services | 12:09 |
| egonzalez | s/both/all | 12:09 |
| *** mrunge has quit IRC | 12:11 | |
| *** dgonzalez has quit IRC | 12:12 | |
| *** aolwas has quit IRC | 12:12 | |
| *** iniazi_ has joined #openstack-kolla | 12:13 | |
| *** vcn[m] has joined #openstack-kolla | 12:13 | |
| *** mrunge has joined #openstack-kolla | 12:14 | |
| *** dgonzalez has joined #openstack-kolla | 12:14 | |
| *** dave-mccowan has joined #openstack-kolla | 12:14 | |
| sdake | morning | 12:16 |
| *** iniazi has quit IRC | 12:17 | |
| *** bachp has joined #openstack-kolla | 12:17 | |
| *** retr0h has joined #openstack-kolla | 12:17 | |
| *** nhlfr has joined #openstack-kolla | 12:17 | |
| egonzalez | morning sdake | 12:19 |
| rwellum | Morning sdake | 12:21 |
| Jeffrey4l | bjolo, you are using docker from centos. could u have a try official docker? | 12:22 |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible stable/ocata: Fix Telegraf container restarting issue https://review.openstack.org/464039 | 12:25 |
| manheim_ | I have an issue with tempest | 12:27 |
| manheim_ | running minimum basic scenario but erorrs out with IOError: [Errno 2] No such file or directory: '/opt/stack/new/devstack/files/images/cirros-0.3.1-x86_64-uec/cirros-0.3.1-x86_64-vmlinuz' | 12:27 |
| manheim_ | dunno why it looks there as I modified tempest.conf accordingly | 12:27 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Panko.conf cannot be copied in ceilometer role https://review.openstack.org/458534 | 12:28 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Allow serial per service https://review.openstack.org/460090 | 12:30 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Fixing some issues with v4 gates https://review.openstack.org/466536 | 12:32 |
| *** bjolo has quit IRC | 12:32 | |
| *** bmaltais has joined #openstack-kolla | 12:33 | |
| *** bjolo has joined #openstack-kolla | 12:34 | |
| *** tomatopeel has quit IRC | 12:40 | |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: WIP - Modified fluentd Image https://review.openstack.org/467219 | 12:43 |
| *** Pavo has joined #openstack-kolla | 12:48 | |
| *** salv-orlando has joined #openstack-kolla | 12:48 | |
| *** salv-orlando has quit IRC | 12:53 | |
| *** bjolo has quit IRC | 12:53 | |
| *** jtriley has quit IRC | 12:55 | |
| manheim_ | found my tempest issue, scenario was missing | 12:56 |
| *** jaosorior has quit IRC | 12:57 | |
| *** jaosorior has joined #openstack-kolla | 12:57 | |
| *** m1dev has joined #openstack-kolla | 13:06 | |
| *** celo_r has quit IRC | 13:06 | |
| awebber | egonzalez: the values got copied over but it didnt reflect in the horizon dashboard. I am on an 3.0.0 though, could be an older bug... | 13:06 |
| egonzalez | hrm, iirc nova didnt change those values once deployed | 13:07 |
| *** huzhengchuan has quit IRC | 13:09 | |
| *** huzhengchuan_ has quit IRC | 13:10 | |
| bmaltais | Goo morning. I have a strange issue I have not been able to troubleshoot yet. It has to do with memcached | 13:11 |
| bmaltais | For some reason memcached stay in Restarting (71) for ever during and after a successfull deployment with kolla-ansible | 13:11 |
| bmaltais | I tried everything to fix that. Is there a log file I can look into to see whay it keep failing like that? | 13:12 |
| bmaltais | Everything was working yesterday... but I tried to rebuild me environment to confirm my documentation and now the environment won't deploy properly. | 13:13 |
| bmaltais | I have a feeling it has to do with DNS/hosts file | 13:13 |
| bmaltais | The end result is that horizon display "Something went wrong!" upon successful login. | 13:14 |
| *** salv-orlando has joined #openstack-kolla | 13:15 | |
| bmaltais | In the docker log I see "Error setting up exec command in container memcached: " | 13:16 |
| egonzalez | bmaltais, strange, the only thing memcached changed recently is remove verbose from logs | 13:16 |
| *** lucasxu has joined #openstack-kolla | 13:17 | |
| *** lucasxu has quit IRC | 13:17 | |
| *** spsurya has quit IRC | 13:17 | |
| bmaltais | egonzalez: I am using "openstack_release: "4.0.0"" | 13:17 |
| egonzalez | bmaltais, whats the content of /etc/kolla/memcached/config.json | 13:18 |
| egonzalez | hrm, then is not the same | 13:18 |
| egonzalez | memcached is a simple service, just start on its IP address and port, nothing else | 13:19 |
| bmaltais | egonzalez: http://paste.openstack.org/show/610451/ | 13:19 |
| egonzalez | that is good unless the IP is not in the host or the port used by any other service | 13:20 |
| *** salv-orlando has quit IRC | 13:20 | |
| bmaltais | egonzalez: netstat | grep 11211 return nothing | 13:21 |
| bmaltais | egonzalez: Same for 5000 | 13:21 |
| bmaltais | egonzalez: Been pulling my hair since yesterday's afternoon on that | 13:22 |
| *** eanylin has quit IRC | 13:22 | |
| egonzalez | bmaltais, whats the docker info memcahed y docker logs memcached output? | 13:23 |
| *** shardy has quit IRC | 13:25 | |
| bmaltais | egonzalez: http://paste.openstack.org/show/610452/ | 13:25 |
| bmaltais | egonzalez: docker info http://paste.openstack.org/show/610453/ | 13:27 |
| *** shardy has joined #openstack-kolla | 13:29 | |
| *** lucasxu has joined #openstack-kolla | 13:30 | |
| *** chas has quit IRC | 13:30 | |
| egonzalez | bmaltais, may be something related to max open files in ulimit | 13:30 |
| *** chas has joined #openstack-kolla | 13:30 | |
| egonzalez | by default we set 5000 | 13:31 |
| egonzalez | sorry, mean inspect memcached instead of docker info | 13:31 |
| bmaltais | egonzalez: Where can I change this value? Is it in the node or the container? | 13:31 |
| egonzalez | bmaltais, make a test just changing /etc/kolla/memcached/config.json , change 5000 to a higher value and restart the container and check if fixes the issue | 13:32 |
| *** skramaja is now known as skramaja_afk | 13:32 | |
| bmaltais | egonzalez: ok, let see | 13:33 |
| *** fguillot has joined #openstack-kolla | 13:33 | |
| bmaltais | egonzalez: So the new reported command is: "Running command: '/usr/bin/memcached -vv -l 10.10.10.231 -p 11211 -c 8000'" | 13:34 |
| bmaltais | egonzalez: Increased -c to 8000 | 13:34 |
| *** eanylin has joined #openstack-kolla | 13:35 | |
| bmaltais | egonzalez: Same result | 13:35 |
| egonzalez | can you check ulimit -a? | 13:35 |
| *** chas has quit IRC | 13:35 | |
| bmaltais | egonzalez: http://paste.openstack.org/show/610455/ | 13:36 |
| egonzalez | the host have open files (-n) 1024 | 13:36 |
| bmaltais | egonzalez: So this is too low? I never changed this value before... perhaps something new with a recent centos7 update? | 13:37 |
| bmaltais | egonzalez: Changing -c to 1000 allow the container to start | 13:40 |
| bmaltais | egonzalez: Not sure why this is happening out of nowhere | 13:40 |
| egonzalez | well, i would increase host max open files instead of lowering memcached | 13:41 |
| egonzalez | memcached open a lot of files | 13:41 |
| bmaltais | egonzalez: I tried ulimit -n 8000 and with -c 5000 it was still a no go | 13:41 |
| bmaltais | What is your ulimit for files at your end? | 13:42 |
| egonzalez | ulimit -n | 13:42 |
| egonzalez | 1024 | 13:42 |
| egonzalez | let me test memcached container | 13:42 |
| bmaltais | egonzalez: Wow... this is bizare | 13:42 |
| egonzalez | bmaltais, inside memcached container ulimit -n | 13:44 |
| egonzalez | 65536 | 13:44 |
| bmaltais | egonzalez: Changing -c to 4000 also work with ulimit -n 1024 | 13:45 |
| bmaltais | egonzalez: So is it a possible container issue? | 13:45 |
| bmaltais | egonzalez: I tought they were not changing once published | 13:46 |
| egonzalez | bmaltais, not sure, cannot confirm that | 13:46 |
| egonzalez | the container didnt changed, and the config only removed --verbose | 13:46 |
| egonzalez | nothing else afik | 13:46 |
| bmaltais | egonzalez: What is in your config.json for memcached? 5000 or 4000? | 13:46 |
| egonzalez | default 5000 | 13:47 |
| *** dave-mcc_ has joined #openstack-kolla | 13:47 | |
| bmaltais | egonzalez: Wow... this is weird. If I change the value to 4000 all work. Not sure why going to 5000 trip it to fail | 13:47 |
| egonzalez | 5000 goes beyond the limits, where those limits came, no idea :/ | 13:48 |
| bmaltais | egonzalez: I will try to find it as it might be good to add to the guide | 13:48 |
| bmaltais | egonzalez: I am sure others will also run into this. Can't be alone. Maybe a trend caused by a new centos7 update | 13:49 |
| *** dave-mccowan has quit IRC | 13:49 | |
| *** ducttape_ has joined #openstack-kolla | 13:49 | |
| *** tomatopeel has joined #openstack-kolla | 13:49 | |
| *** dave-mccowan has joined #openstack-kolla | 13:50 | |
| *** ducttape_ has quit IRC | 13:51 | |
| *** ducttape_ has joined #openstack-kolla | 13:53 | |
| *** dave-mcc_ has quit IRC | 13:53 | |
| egonzalez | bmaltais, actually -c is for max connections not open files | 13:55 |
| *** jtriley has joined #openstack-kolla | 13:57 | |
| bmaltais | egonzalez: So possibly related to the network connections limit on the node | 13:58 |
| *** rhallisey has quit IRC | 13:59 | |
| *** shardy_ has joined #openstack-kolla | 14:00 | |
| *** rhallisey has joined #openstack-kolla | 14:04 | |
| *** JoseMello has joined #openstack-kolla | 14:05 | |
| pester | fluentd have UI ? how to access it ? | 14:06 |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Support OSprofile usage https://review.openstack.org/455628 | 14:07 |
| *** salv-orlando has joined #openstack-kolla | 14:10 | |
| *** jtriley has quit IRC | 14:10 | |
| *** jtriley has joined #openstack-kolla | 14:11 | |
| *** chas has joined #openstack-kolla | 14:12 | |
| *** salv-orlando has quit IRC | 14:14 | |
| *** eaguilar has joined #openstack-kolla | 14:16 | |
| *** chas has quit IRC | 14:16 | |
| *** emccormick has joined #openstack-kolla | 14:20 | |
| Serlex | @pester, for logs? | 14:20 |
| Serlex | you probably want kibana to view them | 14:21 |
| bmaltais | egonzalez: Changing the value to 4096 also work | 14:21 |
| bmaltais | So possibly some limit imposed by nproc.d | 14:21 |
| egonzalez | bmaltais, dont know where those limits come | 14:22 |
| bmaltais | Are you running centos7? | 14:22 |
| egonzalez | if you found it, let me know so i learn from this too | 14:22 |
| egonzalez | yep | 14:22 |
| bmaltais | egonzalez: Did you try to do yum update on one of your working node to see if it would break after the update? | 14:22 |
| bmaltais | egonzalez: I am really wondering why I am the only one with this issue. I am booting my VM from the same template that always used to work | 14:23 |
| bmaltais | egonzalez: So it must be something external to the state it always was | 14:23 |
| egonzalez | bmaltais, only have docker upgrade, upgraded a few days ago | 14:24 |
| bmaltais | egonzalez: It would have been introduced sometime yesterday... as it was working the day before | 14:24 |
| *** ducttape_ has quit IRC | 14:24 | |
| egonzalez | bmaltais, going to upgrade a node and see if is the only breaking | 14:26 |
| sbezverk | k8s-kolla cores: this one is ready to review and merge https://review.openstack.org/466536 most of experimental jobs are green now.. | 14:28 |
| *** eaguilar has quit IRC | 14:28 | |
| *** klindgren has quit IRC | 14:29 | |
| bmaltais | egonzalez: OK. If it stay fine than the issue is somewhere else. | 14:31 |
| egonzalez | something weird, but had docker-engine 1.12 with docker-selinux 15 and was working :S | 14:32 |
| *** chas has joined #openstack-kolla | 14:33 | |
| egonzalez | bmaltais, still working after upgrade | 14:33 |
| *** klindgren has joined #openstack-kolla | 14:35 | |
| *** mattmceuen has joined #openstack-kolla | 14:35 | |
| bmaltais | egonzalez: OK. If it stay fine than the issue is somewhere else. | 14:36 |
| egonzalez | anyone used bootstrap-servers role to install remote nodes? | 14:37 |
| bmaltais | egonzalez: This is really strange. I guess I will have to manually change -c to 4096 until the source of the issue is found | 14:37 |
| *** chas has quit IRC | 14:37 | |
| egonzalez | can check docker-selinux installed version? | 14:37 |
| bmaltais | egonzalez: Humm... not sure how to do that | 14:38 |
| egonzalez | bmaltais, that was a general question to everybody deploying servers using bootsrap-servers command | 14:38 |
| bmaltais | egonzalez: OK ;-) | 14:39 |
| egonzalez | simply rpm -qa | grep docker or the corresponding on .deb distros | 14:39 |
| bmaltais | egonzalez: docker-engine-selinux-17.05.0.ce-1.el7.centos.noarch | 14:40 |
| egonzalez | not sure if was my mistake while upgrading other things or a bug in baremetal role | 14:40 |
| bmaltais | egonzalez: That got upgraded with yum update | 14:40 |
| bmaltais | egonzalez: But I had the same issue before the update anyway | 14:40 |
| egonzalez | yep, but I had docker-engine 1.12 and selinux in 17.05 | 14:40 |
| bmaltais | egonzalez: I also used the bootsrap-servers command to configure my nodes | 14:41 |
| egonzalez | bootstrap pinpoint to docker-engine 1.12 | 14:42 |
| bmaltais | egonzalez: I did notice some strange things with the result. For example, the hosts file looked wrong | 14:42 |
| *** eaguilar has joined #openstack-kolla | 14:42 | |
| bmaltais | egonzalez: But it gor upgraded when using yum update | 14:42 |
| bmaltais | egonzalez: The host file contained localhost for my node IP instead of the proper node names | 14:43 |
| egonzalez | bmaltais, may have localhost as hostname? | 14:45 |
| egonzalez | opened a bug for etc/hosts with wrong formatting https://bugs.launchpad.net/kolla-ansible/+bug/1692913 | 14:46 |
| openstack | Launchpad bug 1692913 in kolla-ansible "wrong etc/hosts format with baremetal role" [Low,New] | 14:46 |
| egonzalez | quite easy if someone wants to take a bug ;) | 14:46 |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Switch ironic-dnsmasq to Deployment to ensure only one replica https://review.openstack.org/467272 | 14:49 |
| *** shardy has quit IRC | 14:49 | |
| *** shardy_ has quit IRC | 14:50 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla master: Remove all Heka related remaining stuff https://review.openstack.org/446036 | 14:50 |
| *** shardy has joined #openstack-kolla | 14:51 | |
| bmaltais | egonzalez: Correct. I tought the script would take care of setting the hostname to the provided node name | 14:52 |
| *** shardy_ has joined #openstack-kolla | 14:52 | |
| bmaltais | egonzalez: I guess it does not and it need to be set 1st before running the script | 14:52 |
| *** chas has joined #openstack-kolla | 14:54 | |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Make sure pathfinder can find passwords.yml in etc/kolla https://review.openstack.org/467276 | 14:54 |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Switch ironic-dnsmasq to Deployment to ensure only one replica https://review.openstack.org/467272 | 14:55 |
| *** huzhengchuan has joined #openstack-kolla | 14:56 | |
| *** huzhengchuan_ has joined #openstack-kolla | 14:57 | |
| *** lpetrut has quit IRC | 14:57 | |
| *** itlinux has joined #openstack-kolla | 14:57 | |
| *** chas has quit IRC | 14:58 | |
| bmaltais | egonzalez: Looking at the mariadb galera.cfg file something hit me | 14:59 |
| bmaltais | egonzalez: The guide is not clear about using dhcp vs static for nodes interfaces (or I did not saw it). | 15:00 |
| bmaltais | egonzalez: The way the configs are written it use static IP vs fqdn | 15:00 |
| bmaltais | egonzalez: So if the DHCP renew change the IP everything will collapse | 15:00 |
| *** ducttape_ has joined #openstack-kolla | 15:01 | |
| pester | magnum on kolla 4.0.0 - got error "InvalidParameterValue: ERROR: Missing required credential: roles ['heat_stack_owner']" | 15:02 |
| pester | but role is present - openstack role create heat_stack_owner | 15:03 |
| pester | Duplicate entry found with name heat_stack_owner | 15:03 |
| *** ducttape_ has quit IRC | 15:03 | |
| *** ducttape_ has joined #openstack-kolla | 15:04 | |
| egonzalez | pester, need to add your user into heat_stack_owner role | 15:04 |
| egonzalez | bmaltais, yep, that is something we can document on networking guide, ie, rabbit relies on hostname instead of ip | 15:05 |
| pester | now error is "Keystone API connection failed: no password, trust_id or token found" | 15:06 |
| bmaltais | egonzalez: Make sense. I might propose a change to the guide to address this. | 15:06 |
| *** ducttape_ has quit IRC | 15:07 | |
| bmaltais | egonzalez: Changing -c to 4096 fixed my issue with memcached | 15:07 |
| *** ducttape_ has joined #openstack-kolla | 15:07 | |
| egonzalez | probably we assume that users will use static IPs, probably too many assumptions on our side :) | 15:08 |
| bmaltais | Let see if others run into it. A possible fix might be to reduce the ansible config from 5000 to 4096 to prevent it | 15:08 |
| egonzalez | i never had an issue with 5000 :/ | 15:08 |
| bmaltais | egonzalez: Static is probably a best practive for any DC servers ;-) | 15:08 |
| bmaltais | egonzalez: Lab environment... not so much | 15:08 |
| egonzalez | bmaltais, actually I have dhcp for my test vms | 15:09 |
| egonzalez | may be lucky but IPs never changed ;) | 15:09 |
| bmaltais | egonzalez: As long as users know that if DHCP is used it should be "fixed" or else problems will occur. | 15:10 |
| *** blallau has quit IRC | 15:11 | |
| bmaltais | egonzalez: On a different topic, when I try to deploy using the git clone it always fail. I have to use the pip kolla-ansible version for it to complete. | 15:12 |
| bmaltais | egonzalez: Is there a known deployment issue with the git clone project? | 15:12 |
| egonzalez | bmaltais, nope, i always use the git version | 15:13 |
| *** shardy_ has quit IRC | 15:13 | |
| bmaltais | egonzalez: OK. So it might be worth trying again and reporting the issue I am seeing. | 15:13 |
| *** shardy_ has joined #openstack-kolla | 15:13 | |
| egonzalez | bmaltais, just need this commands http://paste.openstack.org/show/610467/ | 15:14 |
| *** chas has joined #openstack-kolla | 15:14 | |
| *** lpetrut has joined #openstack-kolla | 15:14 | |
| bmaltais | egonzalez: Will give it a try | 15:15 |
| *** hieulq_ has joined #openstack-kolla | 15:15 | |
| *** Serlex has quit IRC | 15:16 | |
| bmaltais | egonzalez: I was not installing it like that before... perhaps this was the issue... I was doing python setup.py build ; python setup.py install | 15:18 |
| bmaltais | egonzalez: Was this wrong? | 15:18 |
| egonzalez | yep, local installs only need requirements | 15:19 |
| *** chas has quit IRC | 15:19 | |
| egonzalez | and execute commands locally in the git repo | 15:19 |
| bmaltais | egonzalez: local install... like in AIO? or local install of the git project | 15:20 |
| egonzalez | git repo, sorry | 15:20 |
| pester | hm, it should work ? "/etc/kolla/config/magnum/magnum.conf && kolla-ansible reconfigure --tags magnum" ?? | 15:21 |
| *** eaguilar has quit IRC | 15:21 | |
| bmaltais | egonzalez: I see. OK. Failed again with the same error... | 15:22 |
| bmaltais | egonzalez: http://paste.openstack.org/show/610472/ | 15:23 |
| egonzalez | pester, nope, /etc/kolla/config/magnum.conf should | 15:23 |
| *** tovin07 has joined #openstack-kolla | 15:23 | |
| egonzalez | bmaltais, jinja version? | 15:24 |
| *** tovin07 has left #openstack-kolla | 15:24 | |
| bmaltais | egonzalez: On the deploy node or the controller nodes? | 15:25 |
| egonzalez | deploy | 15:25 |
| bmaltais | egonzalez: Doing rpm -qa | grep jinja return nothing... | 15:26 |
| egonzalez | pip freeze | grep -i jinja | 15:27 |
| bmaltais | Jinja2==2.9.6 | 15:28 |
| openstackgerrit | Juan Badia Payno proposed openstack/kolla master: WIP - Modified fluentd Image https://review.openstack.org/467219 | 15:28 |
| egonzalez | bmaltais, try pip install Jinja2==2.8.2 and deploy again | 15:28 |
| bmaltais | egonzalez: Is 2.8.1 OK? I get an error with 2.8.2: "Could not find a version that satisfies the requirement Jinja2==2.8.2 (from versions: 2.0rc1, 2.0, 2.1, 2.1.1, 2.2, 2.2.1, 2.3, 2.3.1, 2.4, 2.4.1, 2.5, 2.5.1, 2.5.2, 2.5.3, 2.5.4, 2.5.5, 2.6, 2.7, 2.7.1, 2.7.2, 2.7.3, 2.8, 2.8.1, 2.9, 2.9.1, 2.9.2, 2.9.3, 2.9.4, 2.9.5, 2.9.6) No matching distribution found for Jinja2==2.8.2" | 15:29 |
| egonzalez | 2.8.1 | 15:29 |
| bmaltais | egonzalez: Deploying... | 15:30 |
| *** mgoddard has joined #openstack-kolla | 15:30 | |
| *** mnasiadka has quit IRC | 15:33 | |
| hrw | does someone remember price for attending PTG? | 15:33 |
| kfox1111 | morning. | 15:33 |
| egonzalez | hrw, was about 150$ iirc | 15:33 |
| bmaltais | egonzalez: Same crash | 15:33 |
| hrw | trying to gather costs for my 3 weeks US trip | 15:33 |
| sbezverk | kfox1111: good morning, how is your yesterday's fire? extinguished I hope? | 15:34 |
| kfox1111 | heh. ongoing. :/ | 15:34 |
| kfox1111 | narrowing in on it though I think. | 15:34 |
| hrw | egonzalez: that's with contributor discount? | 15:34 |
| kfox1111 | "there are 2 hard things in computer science. naming things, cache invalidation, and off by one errors" | 15:34 |
| kfox1111 | this one's a cache thing I think. :/ | 15:35 |
| *** mgoddard has quit IRC | 15:35 | |
| egonzalez | hrw, full access was 100, there was no contributor discount | 15:35 |
| *** chas has joined #openstack-kolla | 15:35 | |
| hrw | egonzalez: ah right. discount was for summit | 15:36 |
| sbezverk | kfox1111: yeah I watch one api design course, and one famous dude said that nameing is 90% of programming ;) | 15:37 |
| kfox1111 | hehe. yeah, I know right? | 15:37 |
| kfox1111 | takes so long to come up with a good name. | 15:38 |
| bmaltais | egonzalez: Trying to replace globals.yml with the one from new git repo and apply my config on it | 15:38 |
| bmaltais | egonzalez: Let see if this help | 15:38 |
| egonzalez | bmaltais, also check the inventory file | 15:38 |
| sbezverk | kfox1111: :) if you have a couple of minutes, please check https://review.openstack.org/#/c/466536/ | 15:39 |
| bmaltais | egonzalez: The inventory file... where is it located? | 15:39 |
| *** itlinux has quit IRC | 15:39 | |
| bmaltais | You mean the deployment file? | 15:39 |
| bmaltais | Like multinode | 15:39 |
| egonzalez | if using allinone in ansible/inventory but if have custom nodes, need a file with all node and groups on it | 15:40 |
| egonzalez | bmaltais, yep | 15:40 |
| *** chas has quit IRC | 15:40 | |
| bmaltais | egonzalez: OK, will copy the example file from git repo and apply my node names on it and see it that help | 15:41 |
| kfox1111 | sbezverk: looks really good. one question on the review. | 15:44 |
| *** lucasxu has quit IRC | 15:44 | |
| openstackgerrit | sean mooney proposed openstack/kolla master: enable the kolla build system to use out of tree docker files https://review.openstack.org/466132 | 15:44 |
| *** sean-k-mooney has joined #openstack-kolla | 15:45 | |
| sbezverk | kfox1111: nameing nameing ;) yeah I will change it.. | 15:46 |
| sean-k-mooney | Jeffrey4l: https://review.openstack.org/#/c/466132/ should now work the way you suggested | 15:46 |
| kfox1111 | sbezverk: thanks. :) | 15:46 |
| *** pcaruana has quit IRC | 15:47 | |
| Jeffrey4l | sean-k-mooney, nice. LGTM at fist glance. will test it later. thx. ;D | 15:47 |
| *** mnasiadka has joined #openstack-kolla | 15:49 | |
| bmaltais | egonzalez: Yeah... the issue was the inventory file I guess | 15:49 |
| *** lucasxu has joined #openstack-kolla | 15:49 | |
| bmaltais | There must be a significant diff that was causing the crash | 15:49 |
| *** mnasiadka has left #openstack-kolla | 15:49 | |
| bmaltais | egonzalez: Now that this work I will zero everything and re-install everything from scratch to see if the memcached error is gone using the git repo version | 15:50 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Fixing some issues with v4 gates https://review.openstack.org/466536 | 15:52 |
| sbezverk | kfox1111: done | 15:52 |
| *** jrich523 has joined #openstack-kolla | 15:52 | |
| kfox1111 | sbezverk: thanks. looks good to me. :) | 15:53 |
| *** chas has joined #openstack-kolla | 15:56 | |
| *** manheim_ has quit IRC | 15:57 | |
| kfox1111 | sdake: inc0: https://review.openstack.org/#/c/466398/ | 16:00 |
| kfox1111 | plz | 16:00 |
| *** chas has quit IRC | 16:01 | |
| *** scheuk has joined #openstack-kolla | 16:02 | |
| bmaltais | egonzalez: When running kolla-ansible git repo... should I also install the kolla repo to get the gen-password tools? | 16:02 |
| egonzalez | bmaltais, all is in the repo at tools | 16:02 |
| egonzalez | python generate-passwords.py | 16:02 |
| scheuk | I just got into an interesting situation, I performed a kolla-ansible reconfigure with 3.0.3 and now the nova user is missing and I can't docker exec -it into some of the containers | 16:03 |
| bmaltais | I appear to be missing some dependancies then... "ImportError: No module named Crypto.PublicKey" | 16:03 |
| *** rhallisey has quit IRC | 16:03 | |
| sdake | kfox1111 looking | 16:04 |
| *** jamesbenson has joined #openstack-kolla | 16:04 | |
| sdake | kfox1111 looks like it merged | 16:04 |
| *** rhallisey has joined #openstack-kolla | 16:04 | |
| kfox1111 | sdake: thanks. | 16:04 |
| bmaltais | egonzalez: pip install pycrypto | 16:04 |
| kfox1111 | srwilkers: thanks. :) | 16:05 |
| *** cristicalin has joined #openstack-kolla | 16:05 | |
| egonzalez | bmaltais, should be installed with requirements.txt | 16:05 |
| bmaltais | egonzalez: Should I propose a change to requirements.txt file to add it? | 16:05 |
| bmaltais | egonzalez: Was not ;-( | 16:05 |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Remove workaround for broken 1.6.3 https://review.openstack.org/466398 | 16:06 |
| jamesbenson | Good morning everyone! | 16:06 |
| kfox1111 | jamesbenson: good morning. :) | 16:07 |
| jamesbenson | I have a question and I was wondering if someone could help... I've been struggling with it for a few days now and can't seem to get it working (or if it is possible at this version) | 16:07 |
| *** ducttap__ has joined #openstack-kolla | 16:07 | |
| jamesbenson | I'm using MaaS to deploy servers and pre-created the KOLLA_CEPH_DATA_0 and KOLLA_CEPH_DATA_0_J partitions (with the xfs and ceph format)...but ansible doesn't like it.... | 16:08 |
| jamesbenson | I'm familiar with Ansible, but can't seem to get it to jive. | 16:08 |
| *** ducttape_ has quit IRC | 16:09 | |
| egonzalez | bmaltais, found a bug ;), pycrypto is being installed with kolla repo not with kolla-ansible | 16:09 |
| kfox1111 | sdake: see thread "Poroposal for shipping binaries and containers" | 16:10 |
| *** lucasxu has quit IRC | 16:14 | |
| bmaltais | egonzalez: Glad I can help debug this ;-) | 16:15 |
| *** matrohon has quit IRC | 16:15 | |
| bmaltais | egonzalez: One last question Ihope... when I try to run "./kolla-ansible bootstrap-servers -i ~/multinode" | 16:15 |
| egonzalez | jamesbenson, ceph need partitions labelled as KOLLA_CEPH_OSD_BOOTSTRAP_J https://github.com/openstack/kolla-ansible/blob/master/doc/ceph-guide.rst#using-an-external-journal-drive | 16:16 |
| egonzalez | jamesbenson, if not just will ignore those partitions and wont create any osd | 16:16 |
| bmaltais | egonzalez: One last question Ihope... when I try to run "./kolla-ansible bootstrap-servers -i ~/multinode" I get "Command failed ansible-playbook -i /root/multinode -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=bootstrap-servers /root/kolla-ansible/ansible/kolla-host.yml" | 16:16 |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a Kolla 'devstack' mode https://review.openstack.org/454690 | 16:17 |
| *** chas has joined #openstack-kolla | 16:17 | |
| bmaltais | egonzalez: Another missing dependency: pip install -U ansible | 16:18 |
| sean-k-mooney | bmaltais: do you have any more info on how the bootstrap-server command fails? | 16:18 |
| jamesbenson | @egonzalez, I know, but that's assuming you have more than one drive dedicated for ceph. Part of our policy is to run in raid 5/6 so we have one large drive (8 Tb). So I'm separating 7 Tb for ceph | 16:18 |
| *** vhosakot has joined #openstack-kolla | 16:19 | |
| *** jmccarthy has quit IRC | 16:19 | |
| *** shardy has quit IRC | 16:19 | |
| egonzalez | bmaltais, follow quickstart-guide to install deps ;) | 16:19 |
| bmaltais | sean-k-mooney: Because my nodes hostnames were not set to start with | 16:19 |
| bmaltais | sean-k-mooney: The bootstrap script does not set it as part of the boot-strap | 16:19 |
| sean-k-mooney | bmaltais: it will but in the host you run boot strap server you first either need to have them set in /etc/hosts or in the inventory | 16:20 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements https://review.openstack.org/464393 | 16:21 |
| jamesbenson | @bmaltais, be sure to use the internal nic IP's too if you have an option.... | 16:21 |
| bmaltais | egonzalez: Right ;-) I was expecting too much I guess ;-) Now on to the next issue ;-) | 16:21 |
| *** skramaja_afk has quit IRC | 16:21 | |
| sean-k-mooney | bmaltais: it assummes that all host listed in the inventory either have ther ips listed in the inventory or that the hostnames are resolvable on the local system | 16:21 |
| *** lpetrut has quit IRC | 16:22 | |
| bmaltais | sean-k-mooney: I was using the pip kolla-ansible version... and it might have been the cause. | 16:22 |
| *** chas has quit IRC | 16:22 | |
| bmaltais | sean-k-mooney: I am now trying using the latest hit repo version. Perhaps I should unset the hostname to validate that it does set them | 16:22 |
| sdake | kfox1111 have you given any thought to password rotation | 16:23 |
| kfox1111 | sdake: what kind of password rotation? | 16:23 |
| kfox1111 | like fernet rotation or something else? | 16:23 |
| sdake | kfox1111 genpwd -> replace all passwords in the system with the new passwords.yml secret contents | 16:24 |
| sdake | (and associated configmaps) | 16:24 |
| bmaltais | sean-k-mooney: The bootstrap script now fails with: * fatal: [kolla1.ducourrier.com]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'dict object' has no attribute u'ansible_ens160'\n\n | 16:24 |
| kfox1111 | sdake: thats not a use case openstack really supports. :/ | 16:24 |
| sdake | not high priority - just something i'd like to see | 16:24 |
| sdake | kfox1111 it can be done :) | 16:24 |
| kfox1111 | it should be done, but really needs the ability for an account to have 2 passwords. | 16:24 |
| kfox1111 | and old an a new, so it can be rotated properly. | 16:24 |
| kfox1111 | as you can't update all places instantaniously. | 16:25 |
| sdake | i was thinking a really smooth way of doing so would be to have oslo.cfg read kubernetes secretes directly | 16:25 |
| kfox1111 | keystone needs support for that though. | 16:25 |
| sdake | there would obviously be some minimal outage | 16:25 |
| bmaltais | sean-k-mooney: ens160 is my primary NIC name | 16:25 |
| * sdake whines - can someone upgrade my bios for me :) | 16:26 | |
| kfox1111 | +1 to getting oslo.cfg to be able to seperate secrets from the rest of the config. | 16:26 |
| jamesbenson | bmaltais: pull your ansible hosts inventory and see what it is calling your nics... | 16:26 |
| jamesbenson | bmaltais: ansible all -i multinode -m setup --tree /tmp/facts | 16:27 |
| sdake | could you expand on an account having 2 passwords? Is this for a seamless password rotation? a single password should work with a little bit of downtime (under a few seconds) | 16:27 |
| jamesbenson | bmaltais: I had something like that as well...I was trying virtual eths.... | 16:27 |
| sdake | kfox1111 slack when you get a chance | 16:27 |
| kfox1111 | k. | 16:28 |
| sean-k-mooney | bmaltais: do you have ens160 on all servers you are bootstraping? | 16:28 |
| jamesbenson | egonzalez: I definitely understand the importance of it using the one named partition, so it doesn't destroy the rest of your drive unintentially. But no way to recognize partitions that are all ready created and manipulate those if they match? | 16:29 |
| bmaltais | sean-k-mooney: Yes, all nodes have ens160 and ens192 | 16:29 |
| bmaltais | jamesbenson: I see: "ansible_default_ipv4": { "address": "10.10.10.231", "alias": "ens160", | 16:29 |
| sean-k-mooney | is ens160 set as network_interface or neutron_external_interface | 16:31 |
| *** stefan_bo has joined #openstack-kolla | 16:31 | |
| sean-k-mooney | i assume network_interface | 16:31 |
| bmaltais | sean-k-mooney: network_interface | 16:31 |
| *** salv-orlando has joined #openstack-kolla | 16:31 | |
| bmaltais | sean-k-mooney: In globals.yml: network_interface: "ens160" | 16:32 |
| sean-k-mooney | so the error means that on whatever host it failed on it could not find ens160 and there for did not create teh corresponding host_vars | 16:32 |
| sean-k-mooney | can you ssh into the failed host and run ifconfig ens160 to confirm | 16:33 |
| bmaltais | sean-k-mooney: I checked and it exist on both. This is how ansible contact each nodes | 16:34 |
| sean-k-mooney | bmaltais: what is the title of the failing task? | 16:34 |
| *** manheim_ has joined #openstack-kolla | 16:35 | |
| bmaltais | TASK [baremetal : Generate /etc/hosts for all of the nodes] | 16:35 |
| bmaltais | The error appears to have been in '/root/kolla-ansible/ansible/roles/baremetal/tasks/pre-install.yml': line 19 | 16:35 |
| *** stefan_bo has quit IRC | 16:35 | |
| *** Mannheim has joined #openstack-kolla | 16:36 | |
| bmaltais | sean-k-mooney: Full output of error: http://paste.openstack.org/show/610477/ | 16:37 |
| *** ducttap__ has quit IRC | 16:37 | |
| *** awebber has quit IRC | 16:38 | |
| *** chas has joined #openstack-kolla | 16:38 | |
| *** ducttape_ has joined #openstack-kolla | 16:38 | |
| *** manheim_ has quit IRC | 16:39 | |
| bmaltais | sean-k-mooney: Should I have a host entry for each nodes on the deployment hosts? | 16:39 |
| bmaltais | sean-k-mooney: Right now I rely on DNS lookup to resolve | 16:39 |
| bmaltais | sean-k-mooney: Perhaps this is the issue? | 16:39 |
| sean-k-mooney | yes it shoudl be either resolveable via dns or your have to have an entry in /etc/host of the deployment host or you need to define the connection info in the inventory file | 16:40 |
| jamesbenson | the bootstrap will create the hosts on each machine as long as the deploy node can reach them | 16:40 |
| bmaltais | sean-k-mooney: No, same error even with hosts file entries | 16:40 |
| sean-k-mooney | if you ping kolla1 or kolla1.ducourrier.com dose it work from the deployment host? | 16:40 |
| bmaltais | Yes. I can also ssh with no password in each as root | 16:40 |
| egonzalez | bmaltais, your deployer node also have the interface? | 16:41 |
| sean-k-mooney | and "ssh kolla1 ifconfig ens160" show the nic info | 16:41 |
| bmaltais | ens160: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 | 16:42 |
| bmaltais | Yep, plus a bunch of other lines I did not paste | 16:42 |
| *** chas has quit IRC | 16:42 | |
| bmaltais | egonzalez: Yes, same with the exception of ens192 because it does not need it | 16:43 |
| bmaltais | This is the command I run: "./kolla-ansible bootstrap-servers -i ~/multinode" | 16:43 |
| bmaltais | And the multinode top part of the file I modified: http://paste.openstack.org/show/610478/ | 16:44 |
| sean-k-mooney | bmaltais: can you run something like ansible -i ~/multinode kolla1 -m debug -a "var=hostvars[inventory_hostname]" | 16:44 |
| bmaltais | I get: [WARNING]: No hosts matched, nothing to do | 16:45 |
| bmaltais | Running "ansible -i ~/multinode kolla1 -m debug -a "var=hostvars[inventory_hostname]"" | 16:45 |
| openstackgerrit | Sam Betts proposed openstack/kolla-kubernetes master: Make sure pathfinder can find passwords.yml in etc/kolla https://review.openstack.org/467276 | 16:45 |
| bmaltais | But running "ansible -i ~/multinode kolla1.ducourrier.com -m debug -a "var=hostvars[inventory_hostname]"" I get lot's of info | 16:46 |
| bmaltais | Diff is hostname vs FQDN | 16:46 |
| sean-k-mooney | bmaltais: how do you have the host listed in the invenotry file? hostname or fqdn | 16:46 |
| bmaltais | FQDN | 16:46 |
| *** egonzalez has quit IRC | 16:47 | |
| sean-k-mooney | can you try swapping to hostname | 16:47 |
| bmaltais | sean-k-mooney: Sure | 16:47 |
| sean-k-mooney | also if you grep the output for the fqdn did it containte the ansible_ens... var | 16:47 |
| bmaltais | sean-k-mooney: Same error ;-( | 16:49 |
| bmaltais | sean-k-mooney: Grep returned no match for ansible_ens | 16:49 |
| *** lpetrut has joined #openstack-kolla | 16:49 | |
| bmaltais | sean-k-mooney: So it is not part of the returned info | 16:50 |
| bmaltais | sean-k-mooney: It used to bootstrap fine with the old kolla-ansible as server by pip install kolla-ansible | 16:53 |
| sean-k-mooney | just checked on one of my sytems and that info is not included either let me see if i can figure out how to dump all the info | 16:54 |
| sean-k-mooney | oh you would need to also run gather facts before the debug command | 16:56 |
| *** harlowja has joined #openstack-kolla | 16:56 | |
| bmaltais | sean-k-mooney: Sorry for asking... but how do I gather facts? | 16:58 |
| sean-k-mooney | ansible -i ~/multinode kolla1 -m setup | 16:59 |
| bmaltais | ansible all -i ~/multinode -m setup --tree /tmp/facts ? | 16:59 |
| *** chas has joined #openstack-kolla | 16:59 | |
| sean-k-mooney | ansible -i ~/multinode kolla1 -m setup | grep ens160? | 16:59 |
| rwellum | Hey sdake - I've noticed lately when I apply canal.yaml, my master node is 'automatically' untainted. | 16:59 |
| bmaltais | sean-k-mooney: ansible all -i ~/multinode -m setup --tree /tmp/facts | grep ansible_ens return a bunch of ansible_ens160 lines | 17:00 |
| sean-k-mooney | bmaltais: so ansible should be able to discover the values | 17:00 |
| bmaltais | sean-k-mooney: I guess... not sure why it does not | 17:01 |
| bmaltais | I could do a webex if you want to poke around | 17:02 |
| sean-k-mooney | i dont think im going to have time to debug much further if you have all the host in dns you could jsut turn off the hsot file generation | 17:03 |
| sdake | rwellum ok - not sure what to make of that :) | 17:03 |
| *** salv-orlando has quit IRC | 17:03 | |
| sean-k-mooney | it is only need when not use dns | 17:03 |
| *** chas has quit IRC | 17:03 | |
| *** cristicalin has quit IRC | 17:04 | |
| bmaltais | sean-k-mooney: OK, I will try that and see. Should still figure out at some point. | 17:04 |
| bmaltais | sean-k-mooney: So just edit the "/root/kolla-ansible/ansible/roles/baremetal/tasks/pre-install.yml" then? | 17:05 |
| sean-k-mooney | bmaltais: yes when we wrote the bootstrap playbook it was only tested in enviornments wehre dns was not available | 17:05 |
| sean-k-mooney | bmaltais: just add customize_etc_hosts: False in the global.yml | 17:05 |
| bmaltais | OK, Added customize_etc_hosts and now moving along | 17:07 |
| bmaltais | Thank's for the help | 17:07 |
| sean-k-mooney | no worries. sorry its not going more smothly | 17:07 |
| bmaltais | That is part of the fun ;-) | 17:07 |
| vhosakot | bmaltais: I've seen ansible errors with hostname/fqdn inconsistencies too. I just dump all the hostvars and check if ansible_hostname is what the task expects. | 17:09 |
| *** cristicalin has joined #openstack-kolla | 17:10 | |
| sean-k-mooney | vhosakot: yes that might be the issue the task assumes ansible_hostname will match the value of running hostname on the server which will not return the fqdn | 17:11 |
| vhosakot | sean-k-mooney: yes, I have experienced that pain few times :) | 17:11 |
| bmaltais | sean-k-mooney: Let me know if I can provide anything to help with that | 17:11 |
| bmaltais | sean-k-mooney: I noticed another small issue now with kolla-ansible prechecks... | 17:12 |
| sean-k-mooney | bmaltais: well if the node called kolla1 does not output kolla1 when you run ssh kolla1 hostname i think it will fail | 17:12 |
| bmaltais | sean-k-mooney: It checks for a version of docker on the local deployment node (localhost) that does not have it install... resulting in a fail report | 17:13 |
| bmaltais | sean-k-mooney: It returns: kolla1.ducourrier.com | 17:13 |
| sean-k-mooney | ya that technically is not a host name | 17:14 |
| sean-k-mooney | i think ansible will be expecting just kolla1 | 17:14 |
| sean-k-mooney | not sure though | 17:14 |
| *** feisky has quit IRC | 17:14 | |
| sean-k-mooney | when you ran kolla-ansible prechecks did you add -1 ~/multinode e.g. kolla-ansible prechecks -i ~/multinode | 17:15 |
| sean-k-mooney | if not it was running the prechecks on the localhost | 17:15 |
| bmaltais | sean-k-mooney: Yes, -i ~/multinode | 17:15 |
| sean-k-mooney | as an FYI precheck are not expected to pass untill a you manually complete all the steps in the quickstart or you have successfully ran the bootstrap play | 17:16 |
| vhosakot | hi | 17:16 |
| bmaltais | It just happen to contain an entry for [deployment] localhost ansible_connection=local | 17:16 |
| vhosakot | haha, sorry, wrong window :) | 17:16 |
| *** rmart04 has quit IRC | 17:16 | |
| bmaltais | sean-k-mooney: As part of the git repo ansible/inventory example | 17:16 |
| *** cristicalin has quit IRC | 17:17 | |
| *** jaosorior is now known as jaosorior_away | 17:17 | |
| bmaltais | sean-k-mooney: Perhaps it is not required in a multinode setup? | 17:17 |
| *** korzen has quit IRC | 17:17 | |
| bmaltais | sean-k-mooney: Especially when the deployment host does not run any containers | 17:17 |
| sean-k-mooney | bmaltais: ya that is a new bug | 17:18 |
| vhosakot | bmaltais: FYI, I don't see any issue with 1024 ulimit size for open files too. | 17:18 |
| sean-k-mooney | before there was not a group for deployment | 17:18 |
| sean-k-mooney | so when it listed all hosts it did not run on local host | 17:18 |
| *** ducttape_ has quit IRC | 17:18 | |
| sean-k-mooney | many people use the deployment host as one of the controlers | 17:19 |
| *** salv-orlando has joined #openstack-kolla | 17:19 | |
| bmaltais | vhosakot: Look good now when using the latest git repo code | 17:19 |
| sean-k-mooney | the prechecks should probably skipp the deployment group | 17:19 |
| vhosakot | bmaltais: cool, cool :) | 17:19 |
| bmaltais | vhosakot: Might have been all related to using the old version deployed by using pip install kolla-ansible | 17:19 |
| *** chas has joined #openstack-kolla | 17:20 | |
| bmaltais | sean-k-mooney: I agree... unless it verifies dependencies | 17:20 |
| bmaltais | Got to go grab lunch, be back | 17:21 |
| sean-k-mooney | bmaltais: well the only dependecy the deployment host has is that ansible is installed | 17:21 |
| sean-k-mooney | bmaltais: if you can run the precheck you have met that dependecy implicitly | 17:21 |
| sean-k-mooney | bmaltais: enjoy | 17:22 |
| vhosakot | bmaltais: I don't see any issue with "pip install kolla-ansible". I've done many times with no issues. Before re-insalling kolla, just need to do pip uninstall properly so that the next pip installation of kolla does not conflict with few packages like jina/pyctypto/etc.. | 17:23 |
| *** salv-orlando has quit IRC | 17:23 | |
| *** powerd has quit IRC | 17:24 | |
| vhosakot | pycrypto* | 17:24 |
| *** itlinux has joined #openstack-kolla | 17:24 | |
| *** chas has quit IRC | 17:24 | |
| rwellum | sdake: yeah it doesn't hurt because you just get a warning there's no taint to untaint. But it is odd. | 17:33 |
| bmaltais | rwellum: Correct. I was able to deploy successfully. | 17:34 |
| rwellum | Ah did you see the same thing bmaltais ? | 17:34 |
| bmaltais | rwellum: You mean the prechecks fail for the localhost deployment node? | 17:35 |
| rwellum | bmaltais: well this is kolla-kubernetes - sorry if I've cross-threaded here :) | 17:36 |
| bmaltais | rwellum: My bad ;-) I play in both ansible and kubernetes camp ;-) | 17:37 |
| *** tomatopeel has quit IRC | 17:38 | |
| *** tomatopeel has joined #openstack-kolla | 17:40 | |
| *** chas has joined #openstack-kolla | 17:41 | |
| rwellum | np bmaltais | 17:41 |
| rwellum | Well ahead of me there | 17:41 |
| *** shardy_ has quit IRC | 17:42 | |
| *** lucasxu has joined #openstack-kolla | 17:43 | |
| *** chas has quit IRC | 17:45 | |
| *** jrich523 has quit IRC | 17:48 | |
| *** salv-orlando has joined #openstack-kolla | 17:51 | |
| *** manheim_ has joined #openstack-kolla | 17:53 | |
| *** hongbin has joined #openstack-kolla | 17:55 | |
| sean-k-mooney | are there any issues with the gate currently? | 17:58 |
| sean-k-mooney | it looks like several jobs are failing on anything other then ubuntu | 17:59 |
| *** jamesbenson has quit IRC | 17:59 | |
| vhosakot | sean-k-mooney: which gate? we have 3 :) kolla, kolla-ansible, kolla-k8s? | 18:00 |
| sean-k-mooney | good point kolla | 18:00 |
| sean-k-mooney | trying to figure out why https://review.openstack.org/#/c/466132/ failed | 18:00 |
| sean-k-mooney | in the gate config this code should not execute so it should not be able to cause a build failure | 18:01 |
| *** chas has joined #openstack-kolla | 18:01 | |
| sean-k-mooney | vhosakot: well copy_dir will execute but on the first call dest is not a directory so it just calls shutil.copytree(src, dest) which is what the old code did | 18:02 |
| *** itlinux has quit IRC | 18:02 | |
| vhosakot | sean-k-mooney: I see gate is failing here --> http://logs.openstack.org/32/466132/2/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/821cec6/console.html#_2017-05-23_16_31_43_794263. I'd add debugs in tests/test_build.py in runTest before line #71. | 18:04 |
| *** lpetrut has quit IRC | 18:05 | |
| *** chas has quit IRC | 18:06 | |
| *** srwilkers has quit IRC | 18:06 | |
| sean-k-mooney | vhosakot: hum ok | 18:06 |
| sbezverk | srwilkers: https://review.openstack.org/#/c/466536 please check when you have a chance | 18:06 |
| vhosakot | sean-k-mooney: looks like mariadb is not building in gate ? --> http://logs.openstack.org/32/466132/2/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/821cec6/console.html#_2017-05-23_16_31_42_926756 | 18:07 |
| sean-k-mooney | vhosakot: ERROR:kolla.image.build.mariadb:Error'd with the following message | 18:08 |
| sean-k-mooney | ERROR:kolla.image.build.mariadb:The command '/bin/sh -c yum --setopt skip_missing_names_on_install=False -y install expect galera hostname percona-xtrabackup pv rsync socat tar MariaDB-client MariaDB-Galera-server && yum clean all' returned a non-zero code: 1 | 18:08 |
| sean-k-mooney | vhosakot: so ya on centos the yum install is failing | 18:09 |
| vhosakot | sean-k-mooney: where do you see that error? :) | 18:09 |
| sean-k-mooney | vhosakot: No package MariaDB-Galera-server available. | 18:09 |
| sean-k-mooney | vhosakot: http://logs.openstack.org/32/466132/2/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/821cec6/logs/build/mariadb.txt.gz | 18:09 |
| *** eaguilar has joined #openstack-kolla | 18:10 | |
| vhosakot | sean-k-mooney: yes, looks like a mariadb issue in gate, unrelated to your patch. | 18:11 |
| sean-k-mooney | vhosakot: so ya good news i didnt break the gate bad news gate is still broken | 18:11 |
| chandankumar | Hello | 18:12 |
| sean-k-mooney | vhosakot: i wonder if the package name changed or the repo is unavailable | 18:12 |
| chandankumar | Do we run tempest with kolla? | 18:12 |
| vhosakot | sean-k-mooney: yes, gate is busted, I'll see if I can debug more. Jeffrey4l is our gate expert :) | 18:12 |
| *** itlinux has joined #openstack-kolla | 18:12 | |
| *** ducttape_ has joined #openstack-kolla | 18:12 | |
| vhosakot | sean-k-mooney: yes, you are right about the classification of good and bad news ;) | 18:13 |
| vhosakot | inc0: gate is down :) | 18:13 |
| vhosakot | sean-k-mooney: looks like just a matter of using the right (new) package name instead of MariaDB-Galera-server, right? | 18:13 |
| sean-k-mooney | vhosakot: looking at http://yum.mariadb.org/10.0/centos7-amd64/rpms/ i dont see MariaDB-Galera-server | 18:14 |
| sean-k-mooney | vhosakot: i think it just galara now? | 18:14 |
| vhosakot | sean-k-mooney: does gate pull from there? | 18:14 |
| openstackgerrit | Bernard Maltais proposed openstack/kolla-ansible master: Add instruction on shutting down and restarting complete kolla-ansible environment. https://review.openstack.org/466881 | 18:14 |
| sean-k-mooney | that is the default in https://github.com/openstack/kolla/blob/master/docker/base/MariaDB.repo | 18:14 |
| vhosakot | ah right. | 18:14 |
| vhosakot | sean-k-mooney: mind submitting a patch? busy for next few hours, I'll +2 if gate fixes :) | 18:15 |
| sean-k-mooney | ill see if changing the name works but im not 100% shure it correct. i guess the gate will tell us | 18:16 |
| vhosakot | sean-k-mooney: yep | 18:16 |
| *** rmart04 has joined #openstack-kolla | 18:17 | |
| *** hieulq_ has quit IRC | 18:19 | |
| *** powerd has joined #openstack-kolla | 18:20 | |
| *** rmart04 has quit IRC | 18:22 | |
| *** chas has joined #openstack-kolla | 18:23 | |
| *** rmart04 has joined #openstack-kolla | 18:23 | |
| *** powerd has quit IRC | 18:25 | |
| *** chas has quit IRC | 18:28 | |
| *** eaguilar has quit IRC | 18:33 | |
| *** itlinux has quit IRC | 18:34 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multinode gate https://review.openstack.org/466007 | 18:34 |
| *** jrich523 has joined #openstack-kolla | 18:34 | |
| *** krtaylor has quit IRC | 18:35 | |
| *** goni has joined #openstack-kolla | 18:38 | |
| goni | Hi. I am trying to access the openstack dashboard. My deployment was successful using kolla-ansible | 18:40 |
| goni | Is the URL to access dashboard http://<kolla-internal-vip-address>:80? | 18:41 |
| *** tonanhngo has joined #openstack-kolla | 18:42 | |
| *** eaguilar has joined #openstack-kolla | 18:42 | |
| vhosakot | goni: yes, if you want to access from within/inside the cluster. | 18:42 |
| *** itlinux has joined #openstack-kolla | 18:42 | |
| *** chas has joined #openstack-kolla | 18:43 | |
| openstackgerrit | Bertrand Lallau proposed openstack/kolla-ansible master: Grafana post_config checks only need to run locally https://review.openstack.org/463810 | 18:43 |
| *** Pavo has quit IRC | 18:46 | |
| *** salv-orlando has quit IRC | 18:46 | |
| goni | vhosakot: I get this error. http://paste.openstack.org/raw/610483/ | 18:46 |
| *** egonzalez has joined #openstack-kolla | 18:47 | |
| vhosakot | goni: can you curl <kolla-internal-vip-address>:80 on the controller? | 18:47 |
| *** chas has quit IRC | 18:48 | |
| goni | vhosakot I tried doing that but no response :/ | 18:48 |
| *** manheim_ has quit IRC | 18:48 | |
| vhosakot | goni: hmmm :) can you see who owns port 80? lsof -i :80 | 18:49 |
| *** tonanhngo has quit IRC | 18:49 | |
| sean-k-mooney | my guess from that error is that you will find a more detailed error in the apache error log | 18:49 |
| goni | vhosakot apache2 | 18:50 |
| vhosakot | goni: right, I'd dig /var/log/httpd or var/log/apache2 | 18:50 |
| goni | let me check | 18:51 |
| *** JoseMello has quit IRC | 18:55 | |
| openstackgerrit | sean mooney proposed openstack/kolla master: fixed mariadb package name for yum distors https://review.openstack.org/467360 | 18:56 |
| *** salv-orlando has joined #openstack-kolla | 18:56 | |
| sean-k-mooney | vhosakot: https://review.openstack.org/#/c/467360/ allows me to build locally but we should see what the gate says. | 18:57 |
| vhosakot | sean-k-mooney: perfect! | 18:57 |
| sean-k-mooney | running yum install MariaDB-Galera-server in the final container give me the same No package MariaDB-Galera-server available error we are seeing in the gate so it looks like we should just use MariaDB-server now | 18:58 |
| sean-k-mooney | vhosakot: im going to go have dinner but hopefullly that will fix it. chat tommorow | 18:59 |
| vhosakot | sean-k-mooney: o/ night :) | 18:59 |
| *** itlinux has quit IRC | 19:01 | |
| *** zhubingbing has quit IRC | 19:01 | |
| *** zhubingbing has joined #openstack-kolla | 19:02 | |
| *** salv-orlando has quit IRC | 19:02 | |
| *** lucasxu has quit IRC | 19:02 | |
| *** chas has joined #openstack-kolla | 19:04 | |
| goni | vhosakot: var/log/apache2 did not exist. I re-installed apache2 and tried again. I can get to the error log now but doesn't seem to give much information http://paste.openstack.org/show/610484/ | 19:08 |
| *** srwilkers has joined #openstack-kolla | 19:09 | |
| *** chas has quit IRC | 19:09 | |
| *** salv-orlando has joined #openstack-kolla | 19:10 | |
| *** salv-orlando has quit IRC | 19:11 | |
| bmaltais | Hi, I feel bad to ask this... seem like I always ask for help... I am trying to get ceph working following the guide https://github.com/openstack/kolla-ansible/blob/master/doc/ceph-guide.rst | 19:11 |
| bmaltais | Everything looked good with the deploy until: TASK [nova : Pulling cinder cephx keyring for libvirt] ************************************************************************************************************************************************************************ fatal: [kolla1 -> kolla1]: FAILED! => {"changed": false, "cmd": ["docker", "exec", "ceph_mon", "ceph", "auth", "get-key", "client.cinder"], "delta": "0:00:00. | 19:11 |
| bmaltais | ["Error ENOENT: don't have client.cinder"], "stdout": "", "stdout_lines": []} | 19:12 |
| *** rmart04 has quit IRC | 19:12 | |
| bmaltais | Any pointer as to what might be causing this? | 19:12 |
| *** cristicalin has joined #openstack-kolla | 19:15 | |
| *** lucasxu has joined #openstack-kolla | 19:15 | |
| rwellum | sdake: sbezverk: filed a bug with canal: https://github.com/projectcalico/canal/issues/77 | 19:20 |
| *** sgrasley has quit IRC | 19:21 | |
| *** sgrasley has joined #openstack-kolla | 19:22 | |
| *** chas has joined #openstack-kolla | 19:25 | |
| *** scheuk has quit IRC | 19:27 | |
| *** krtaylor has joined #openstack-kolla | 19:28 | |
| *** chas has quit IRC | 19:29 | |
| jemcevoy | I have a couple questions on host specific configs for Newton... | 19:34 |
| jemcevoy | If I have a host that is a little different and has a nvidia K2 Grid card instead of an M60 Grid card like the rest of the systems | 19:34 |
| jemcevoy | What exactly do I name the nova.conf so it gets configures PCI passthrough for 10de:11bf rather then the M60's 10de:13f2 value | 19:34 |
| jemcevoy | And do I need to put all configs that are general with the nova.conf which need to be different? | 19:34 |
| jemcevoy | If the hostname is etbc6-vmhost1 does the config go in /etc/kolla/configs/etbc-vmhost1/nova.conf | 19:35 |
| vhosakot | jemcevoy: here is a blog I wrote about deploying PCI pass-through in OpenStack. I've specified the configs needed under the section "Below are the neutron and nova configurations needed to enable SR-IOV in OpenStack". you might need to add the vendor-scpecific parts in those configs tho. | 19:36 |
| vhosakot | jemcevoy: https://communities.cisco.com/community/developer/openstack/blog/2017/01/13/how-to-deploy-sr-iov-pci-pass-through-in-openstack-using-ciscos-ucsm-ml2-neutron-plugin | 19:36 |
| *** powerd has joined #openstack-kolla | 19:38 | |
| egonzalez | vhosakot good info :) | 19:38 |
| vhosakot | egonzalez: thanks :) | 19:39 |
| egonzalez | jemcevoy the path is /etc/kolla/config/nova/<inventory_hostname>/nova.conf | 19:39 |
| jemcevoy | vhosakot : I have the pci passthrough working well for the new M60 cards My question is on the kolla specifics config directory | 19:39 |
| jemcevoy | Thanks egonzalez | 19:40 |
| vhosakot | jemcevoy: you might need appropriate configs in ml2_conf as well. At least, I needed them in ml2_conf for SR-IOV. | 19:40 |
| vhosakot | jemcevoy: ah, then, add those card-specific/vendor-specific config bits in /etc/kolla/config/nova/<inventory_hostname>/nova.conf, what egonzalez said. | 19:41 |
| bmaltais | Tried a few things but still get an error when seting a basic ceph deployment. | 19:42 |
| bmaltais | When running "docker exec ceph_mon ceph auth get-key client.cinder" I get Error ENOENT: don't have client.cinder | 19:42 |
| jemcevoy | vhosakot: I am passing through an nVidia GPU for high performance VDI used for CADD design of very large models... The VMs are 12 core 128GB big guys | 19:42 |
| bmaltais | The strange thing is that I can get a key for nove... | 19:42 |
| bmaltais | s/nove/nova | 19:42 |
| vhosakot | jemcevoy: cool, high perf is well suited usecase for PCI pass-thru | 19:43 |
| bmaltais | Anyone has seen this before? | 19:43 |
| vhosakot | bmaltais: haven't done much ceph ;) | 19:43 |
| bmaltais | vhosakot: Thanks. This is my 1st attempt. Tought I crossed all T but I must be missing something | 19:45 |
| vhosakot | neutron is what I've done the most as everyone keeps saying "it's the network's fault" ;) | 19:45 |
| *** chas has joined #openstack-kolla | 19:46 | |
| egonzalez | bmaltais is cinder deployed? | 19:48 |
| *** itlinux has joined #openstack-kolla | 19:48 | |
| *** sayantan_ has joined #openstack-kolla | 19:49 | |
| bmaltais | Just saw that globals.yml had cinder set to "no" as the default... | 19:49 |
| bmaltais | I am changing that to yes and will try again ;-) | 19:50 |
| *** chas has quit IRC | 19:50 | |
| vhosakot | cinder is the front-end for ceph, so it will be needed | 19:52 |
| *** bmaltais has quit IRC | 19:54 | |
| *** goni has quit IRC | 19:54 | |
| jemcevoy | vhosakot... Cisco question for you... This cluster has a re-purposed 1Gig switch for the BMCs and admin access. Ports on this switch keep dropping the link for an unknown reason... There are no vlans or anything special on this switch. Is there a command to reset the switch to behave like an unmanaged switch? The 10Gig side is all Cumulus and Cumulus configs makes sense to me. | 19:56 |
| jemcevoy | We just need a dumb switch to connect to a jump host | 19:57 |
| vhosakot | jemcevoy: "unmanaged switch".. does that ever exist? I'd remove all configs, and reboot to go back to day-1 factory-defaults. | 19:58 |
| *** AzazeL_ has quit IRC | 20:00 | |
| *** AzazeL_ has joined #openstack-kolla | 20:00 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Fixing some issues with v4 gates https://review.openstack.org/466536 | 20:02 |
| *** Mannheim has quit IRC | 20:05 | |
| *** chas has joined #openstack-kolla | 20:07 | |
| jemcevoy | vhisakot : where are the configs? Can I just do an rm *.conf or something? I have not touched a Cisco switch since before Y2K... | 20:07 |
| *** sambetts is now known as sambetts|afk | 20:08 | |
| vhosakot | jemcevoy: depends on the OS on the box :) erase configs, clear configs on startup, reboot, go back to day-1. do you know which box? IOS, NXOS, XR, XE, CSR, ISR, virtual appliance? | 20:09 |
| *** numans has quit IRC | 20:10 | |
| *** dave-mccowan has quit IRC | 20:10 | |
| *** chas has quit IRC | 20:11 | |
| *** numans has joined #openstack-kolla | 20:12 | |
| jemcevoy | I do not know which box or NOS.. vhosakot... And the switch is in Sunnyvale and I'm on Portland... I'll have to get their networking team to look into it... But that can take a week or so... | 20:13 |
| *** manheim_ has joined #openstack-kolla | 20:13 | |
| *** sayantan_ has quit IRC | 20:13 | |
| emccormick | jemcevoy: show version will tell you what OS it is | 20:15 |
| emccormick | assuming you have enable access to the switch | 20:15 |
| *** lucasxu has quit IRC | 20:17 | |
| emccormick | and pre y2k commands generally still work. If it's IOS you can probably do "write erase" and then "reload", but it will truly go back to no config and you won't be able to connect to it again until someone sets an IP and password for it. | 20:17 |
| vhosakot | ^^^ | 20:17 |
| emccormick | It could be that the switch hates your NICs and is set to auto detect speed / duplex. You may want to do a show interfaces to see what they are negotiated at | 20:18 |
| emccormick | And now for the reason I woke up. Does anyone know where I should go fish to solve this error during prechecks (kolla 3.0.3)? | 20:19 |
| emccormick | fatal: [compute2.cc.osdev.cirrusseven.net]: FAILED! => {"failed": true, "msg": "The conditional check ''169.254.' not in kolla_internal_vip_address and kolla_internal_vip_address | ipaddr(ip_addr_output.stdout.split()[3]) is none' failed. The error was: error while evaluating conditional ('169.254.' not in kolla_internal_vip_address and kolla_internal_vip_address | ipaddr(ip_addr_output.stdout.split()[3]) is none): | 20:19 |
| emccormick | list object has no element 3"} | 20:19 |
| *** sayantan_ has joined #openstack-kolla | 20:20 | |
| emccormick | I set custom interfaces for compute2 like so: compute2.cc.osdev.cirrusseven.net network_interface=enp3s0f1 api_interface=enp3s0f1 tunnel_interface=enp3s0f0 | 20:20 |
| emccormick | and for everything else it seems to pick things up OK, but that one check fails every time | 20:21 |
| *** lucasxu has joined #openstack-kolla | 20:21 | |
| *** AzazeL_ has quit IRC | 20:23 | |
| *** sayantan_ has quit IRC | 20:24 | |
| *** numans has quit IRC | 20:26 | |
| *** sayantan_ has joined #openstack-kolla | 20:26 | |
| *** chas has joined #openstack-kolla | 20:27 | |
| *** sayantan_ has quit IRC | 20:31 | |
| *** manheim_ has quit IRC | 20:32 | |
| *** numans has joined #openstack-kolla | 20:32 | |
| *** chas has quit IRC | 20:32 | |
| *** harlowja_ has joined #openstack-kolla | 20:32 | |
| *** harlowja has quit IRC | 20:33 | |
| *** mattmceuen has quit IRC | 20:34 | |
| *** manheim_ has joined #openstack-kolla | 20:39 | |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable multinode gate https://review.openstack.org/466007 | 20:41 |
| *** ducttape_ has quit IRC | 20:42 | |
| *** ducttap__ has joined #openstack-kolla | 20:42 | |
| *** manheim_ has quit IRC | 20:47 | |
| *** chas has joined #openstack-kolla | 20:48 | |
| *** ducttape_ has joined #openstack-kolla | 20:49 | |
| *** manheim_ has joined #openstack-kolla | 20:50 | |
| *** ducttap__ has quit IRC | 20:52 | |
| *** chas has quit IRC | 20:53 | |
| *** fguillot has quit IRC | 20:53 | |
| *** david-lyle has joined #openstack-kolla | 20:54 | |
| *** jtriley has quit IRC | 20:57 | |
| *** vhosakot_ has joined #openstack-kolla | 20:59 | |
| *** itlinux has quit IRC | 21:00 | |
| *** vhosakot has quit IRC | 21:00 | |
| *** lucasxu has quit IRC | 21:03 | |
| *** bmace__ has quit IRC | 21:04 | |
| *** harlowja_ has quit IRC | 21:05 | |
| *** bmace__ has joined #openstack-kolla | 21:05 | |
| *** jamesbenson has joined #openstack-kolla | 21:05 | |
| *** rhallisey has quit IRC | 21:06 | |
| *** harlowja has joined #openstack-kolla | 21:08 | |
| *** chas has joined #openstack-kolla | 21:09 | |
| vhosakot_ | sean-k-mooney: I see mariadb built successfully at gate, but failed to deploy at gate during bootstrap --> http://logs.openstack.org/60/467360/1/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/1546f0b/console.html#_2017-05-23_19_29_16_886544 | 21:10 |
| vhosakot_ | I'll dig the logs and see what's going on. | 21:10 |
| *** david-lyle has quit IRC | 21:10 | |
| *** chas has quit IRC | 21:14 | |
| *** eaguilar has quit IRC | 21:16 | |
| -openstackstatus- NOTICE: The logserver has filled up, so jobs are currently aborting with POST_FAILURE results; remediation is underway. | 21:21 | |
| *** ChanServ changes topic to "The logserver has filled up, so jobs are currently aborting with POST_FAILURE results; remediation is underway." | 21:21 | |
| *** david-lyle has joined #openstack-kolla | 21:22 | |
| *** chas has joined #openstack-kolla | 21:30 | |
| *** chas has quit IRC | 21:35 | |
| *** ducttap__ has joined #openstack-kolla | 21:39 | |
| *** krtaylor has quit IRC | 21:41 | |
| *** ducttape_ has quit IRC | 21:43 | |
| *** jroll has quit IRC | 21:47 | |
| *** jroll has joined #openstack-kolla | 21:47 | |
| *** jroll has quit IRC | 21:49 | |
| *** salv-orlando has joined #openstack-kolla | 21:50 | |
| *** chas has joined #openstack-kolla | 21:51 | |
| *** ducttap__ has quit IRC | 21:51 | |
| *** ducttape_ has joined #openstack-kolla | 21:52 | |
| *** jroll has joined #openstack-kolla | 21:53 | |
| *** chas has quit IRC | 21:56 | |
| *** vhosakot_ has quit IRC | 21:58 | |
| *** david-lyle has quit IRC | 22:01 | |
| *** jamesbenson has quit IRC | 22:05 | |
| *** srwilkers has quit IRC | 22:10 | |
| *** chas has joined #openstack-kolla | 22:12 | |
| *** chas has quit IRC | 22:16 | |
| *** jascott1 has joined #openstack-kolla | 22:18 | |
| *** rwellum has quit IRC | 22:19 | |
| *** jascott1 has quit IRC | 22:23 | |
| *** chas has joined #openstack-kolla | 22:33 | |
| *** peterjenkins__ has quit IRC | 22:33 | |
| *** stefan_bo has joined #openstack-kolla | 22:33 | |
| *** peterjenkins__ has joined #openstack-kolla | 22:34 | |
| *** karlamrhein has quit IRC | 22:34 | |
| *** bmaltais has joined #openstack-kolla | 22:34 | |
| *** NobodyCam has quit IRC | 22:35 | |
| *** NobodyCam has joined #openstack-kolla | 22:35 | |
| bmaltais | Hi. I have a question regarding a good minimum ceph enable setup for testing. Well at least a minimum global.yml config for proper ceph support. | 22:36 |
| bmaltais | I have deployed ceph with what I think is required for ceph but when I run init-runonce it is stuck at the glance upload phase | 22:36 |
| bmaltais | And horizon show that the image is being saved... | 22:36 |
| *** karlamrhein has joined #openstack-kolla | 22:36 | |
| bmaltais | What options in global.yml are you enabling for a basic ceph support? | 22:37 |
| *** chas has quit IRC | 22:38 | |
| *** stefan_bo has quit IRC | 22:38 | |
| *** ducttap__ has joined #openstack-kolla | 22:38 | |
| bmaltais | Here is a paste bin of what I changed for my setup: http://paste.openstack.org/show/610497/ | 22:39 |
| bmaltais | Do you see anything missing or that I should add? | 22:39 |
| *** ducttape_ has quit IRC | 22:41 | |
| openstackgerrit | Anthony Lin proposed openstack/kolla-kubernetes master: Script to Deploy Kolla Kubernetes AIO https://review.openstack.org/464312 | 22:42 |
| *** sgrasley1 has joined #openstack-kolla | 22:43 | |
| *** egonzalez has quit IRC | 22:43 | |
| *** iniazi_ has quit IRC | 22:44 | |
| *** dave-mccowan has joined #openstack-kolla | 22:44 | |
| *** sgrasley has quit IRC | 22:44 | |
| *** iniazi_ has joined #openstack-kolla | 22:45 | |
| *** salv-orlando has quit IRC | 22:48 | |
| *** chas has joined #openstack-kolla | 22:54 | |
| *** manheim_ has quit IRC | 22:58 | |
| *** chas has quit IRC | 22:59 | |
| *** cristicalin has quit IRC | 23:02 | |
| *** athomas has quit IRC | 23:04 | |
| *** chas has joined #openstack-kolla | 23:15 | |
| openstackgerrit | Marcus Williams proposed openstack/kolla-ansible master: Add OpenDaylight role https://review.openstack.org/416367 | 23:15 |
| *** powerd has quit IRC | 23:16 | |
| *** chas has quit IRC | 23:20 | |
| *** rkrum has joined #openstack-kolla | 23:23 | |
| *** huzhengchuan has quit IRC | 23:23 | |
| *** huzhengchuan_ has quit IRC | 23:25 | |
| *** rkrum has quit IRC | 23:35 | |
| *** chas has joined #openstack-kolla | 23:36 | |
| *** chas has quit IRC | 23:40 | |
| bmaltais | Anyone on the channel running kolla-ansible with ceph storage? | 23:43 |
| *** hongbin has quit IRC | 23:45 | |
| bmaltais | Looking for some tips on globals.yml to get a basic ceph storage working. | 23:45 |
| bmaltais | Currently I can deploy but loading glance image is stuck at saving... so something is broken with the storage. | 23:46 |
| bmaltais | Looking for info on what you enabled in globals.yml to get going with a sound options selection. | 23:46 |
| *** chas has joined #openstack-kolla | 23:56 | |
| *** salv-orlando has joined #openstack-kolla | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!