Tuesday, 2015-09-15

*** achanda has quit IRC00:01
*** diogogmt has quit IRC00:03
*** gfidente has quit IRC00:05
*** SourabhP has quit IRC00:14
*** dwalsh has joined #kolla00:36
*** slagle has joined #kolla00:47
*** dims_ has joined #kolla00:48
*** weiyu has joined #kolla00:59
*** banix has joined #kolla01:06
*** zhiwei has joined #kolla01:06
*** walters has joined #kolla01:07
*** dwalsh has quit IRC01:15
*** erkules_ has joined #kolla01:21
*** erkules has quit IRC01:24
openstackgerritXiaBing Yao proposed openstack/kolla: Update git clone address in doc/dev-quickstart.rst  https://review.openstack.org/22336601:33
*** vilobhmm_11 has quit IRC01:48
*** dims_ has quit IRC02:11
*** loth has quit IRC02:17
*** banix has quit IRC02:21
*** rhallisey has quit IRC02:22
*** unicell has quit IRC02:26
*** achanda has joined #kolla02:27
*** diogogmt has joined #kolla02:37
*** klint has joined #kolla02:40
*** jasonsb has joined #kolla02:43
*** jasonsb has quit IRC02:46
*** banix has joined #kolla02:47
*** weiyu has quit IRC02:57
*** weiyu has joined #kolla02:59
*** vilobhmm_11 has joined #kolla02:59
*** tfukushima has joined #kolla02:59
SamYaplepbourke: around yea03:05
*** diogogmt has quit IRC03:10
*** diogogmt has joined #kolla03:11
*** dims_ has joined #kolla03:12
*** jasl8r1 has quit IRC03:18
*** dims_ has quit IRC03:19
*** jasl8r has joined #kolla03:22
*** jerryz has quit IRC03:26
*** daneyon_ has joined #kolla03:27
*** apmelton has quit IRC03:28
*** daneyon has quit IRC03:28
*** apmelton has joined #kolla03:31
*** banix has quit IRC03:32
*** weiyu has quit IRC03:42
*** apmelton has quit IRC03:42
*** kjelly has joined #kolla03:44
*** apmelton has joined #kolla03:45
*** weiyu has joined #kolla03:52
*** achanda has quit IRC03:52
*** dayou has joined #kolla03:59
*** jasl8r has quit IRC04:03
*** achanda has joined #kolla04:05
*** achanda has quit IRC04:11
*** dims_ has joined #kolla04:16
*** achanda has joined #kolla04:21
*** dims_ has quit IRC04:22
*** achanda has quit IRC04:27
*** weiyu has quit IRC04:35
*** unicell has joined #kolla04:41
*** SourabhP has joined #kolla04:47
*** SourabhP_ has joined #kolla04:51
*** SourabhP has quit IRC04:54
*** SourabhP_ is now known as SourabhP04:54
*** diga has joined #kolla04:55
*** SourabhP has quit IRC05:03
*** SourabhP_ has joined #kolla05:03
*** coolsvap has joined #kolla05:15
openstackgerritMartin André proposed openstack/kolla: Make kolla-ansible work in pip installed kolla  https://review.openstack.org/22340705:48
*** vilobhmm_11 has quit IRC05:57
openstackgerritMartin André proposed openstack/kolla: Prepare for vagrant-based AIO dev environment  https://review.openstack.org/22341006:02
openstackgerritMartin André proposed openstack/kolla: Allow configuring number of nodes in Vagrantfile  https://review.openstack.org/22341106:02
openstackgerritMartin André proposed openstack/kolla: Libvirt provider for Vagrant  https://review.openstack.org/22341206:02
openstackgerritMartin André proposed openstack/kolla: Use NFS sharing,  it's a lot faster  https://review.openstack.org/22341306:02
openstackgerritMartin André proposed openstack/kolla: Reuse kolla working dir from host in operator  https://review.openstack.org/22341406:02
openstackgerritMartin André proposed openstack/kolla: Increase size of operator to allow building images  https://review.openstack.org/22341506:02
openstackgerritMartin André proposed openstack/kolla: Preconfigure Kolla to work out of the box  https://review.openstack.org/22341606:02
openstackgerritMartin André proposed openstack/kolla: Default vagrant deployment to AIO  https://review.openstack.org/22341706:02
openstackgerritMartin André proposed openstack/kolla: Add vagrant-generated files to gitignore  https://review.openstack.org/22341806:02
openstackgerritMartin André proposed openstack/kolla: Set namespace to point to local registry  https://review.openstack.org/22341906:02
openstackgerritMartin André proposed openstack/kolla: Update documentation for Vagrant environment  https://review.openstack.org/22342006:02
*** weiyu has joined #kolla06:04
*** vilobhmm_11 has joined #kolla06:04
sdakemandre been busy :)06:10
mandreyeah, it was a bit of a pain to setup a dev environment on a new machine, now 2 commands and boom... a working environment06:12
sdakeis that work finished then after it makes it through review?06:12
mandreyup, the final commit implements the blueprint06:13
sdakemandre please set blueprint to in review https://blueprints.launchpad.net/kolla/+spec/vagrant-improvements06:14
sdakeor needs review whichever it is06:14
sdakejust watched taken 306:15
sdakeliam niesen makes a pretty good fighter for an old cat :)06:15
*** zhiwei has quit IRC06:20
mandrethat's what I heard, haven't seen any of the taken movies06:22
*** shardy has joined #kolla06:22
*** coolsvap_ has joined #kolla06:24
sdakemandre forgive me but i have been making a heavy attempt to remove pronouns from our documentation06:27
sdakeyou add a whole slew of them which is going in the wrong direction :)06:27
mandresdake discovered i suck at writing documentation06:28
sdakenah it was good effort ;)06:28
mandreplease add your comments to the code review ;)06:29
sdakewriting docs is ass hard as writing good code06:29
sdakei did06:29
*** vilobhmm_11 has quit IRC06:32
sdakemandre is 40gb really enough (did you test aio on libvirt?)06:32
mandreit's more than enough, my centos-source images take about 1.6GB, and I still have 27GB available on my AIO VM06:35
sdakemandre also i left a note my 3 control node setup takes 8gb per control node on bare metal06:39
sdakei left a comment and approved the patch, but you may want to investigate it at some future point06:39
openstackgerritMerged openstack/kolla: Prepare for vagrant-based AIO dev environment  https://review.openstack.org/22341006:49
openstackgerritMerged openstack/kolla: Allow configuring number of nodes in Vagrantfile  https://review.openstack.org/22341106:49
openstackgerritMerged openstack/kolla: Libvirt provider for Vagrant  https://review.openstack.org/22341206:49
*** coolsvap_ has quit IRC06:49
openstackgerritMerged openstack/kolla: Use NFS sharing,  it's a lot faster  https://review.openstack.org/22341306:49
openstackgerritMerged openstack/kolla: Reuse kolla working dir from host in operator  https://review.openstack.org/22341406:49
*** unicell1 has joined #kolla07:01
*** unicell has quit IRC07:03
*** alisonh has quit IRC07:04
*** achanda has joined #kolla07:06
*** inc0 has joined #kolla07:12
inc0good morning07:14
SamYaplemorning inc007:15
SamYaplecongrats on the married thing07:15
inc0thanks:)07:15
*** weiyu has quit IRC07:16
inc0SamYaple, we need to talk how to do optional bindmounting07:18
inc0after we removed inheritance from start tasks, this will be horrible thing to do...07:18
SamYaplenah its a simple variable change, not a problem07:19
SamYaplewe need to figure out how to log each service to a single file07:19
SamYaplethats the part we have no code for07:19
inc0we do07:19
SamYapleim just waiting for that to do the optional bindmounting everywhere07:19
*** weiyu has joined #kolla07:19
SamYapleoh i didnt see any07:19
SamYapledo yo uhave a link?07:19
inc0https://review.openstack.org/#/c/215062/14/ansible/roles/common/templates/rsyslog.conf.j207:20
inc0we can do all sort of filtering magic based on sender tag07:20
inc0this seems to work07:20
*** alisonh has joined #kolla07:20
SamYapleright but i dont see any service where you have implemented this is my point07:21
SamYaplewe need that code up for review and testing07:21
inc0kolla ansible07:21
inc0is implemented07:21
inc0this has logs and it's there07:21
inc0I can do keystone quickly if you want07:22
SamYaplei mean like nova-api and neutron-server kind of thing07:22
SamYaplekolla_ansible has no logs07:22
*** achanda has quit IRC07:22
inc0actually it does:)07:22
inc0try to run it07:22
inc0it will produce logs to rsyslog07:23
SamYaplewe dont want al lthe system logs though...07:23
SamYaplewe want the services to log to syslog07:24
*** weiyu has quit IRC07:24
SamYaplei mean kolla_ansible just sleeps, it shouldn't be logging anything07:24
inc0when it's creating endpoints and such (and logging is up by then) it logs07:25
*** achanda has joined #kolla07:25
inc0so you get some logs during deployment and that's it07:25
SamYaplewhat does it log when its creating endpoints? my modules do no logging07:25
SamYapleansible modules dont log like that07:25
SamYapleim confused i guess07:26
SamYapledo you have a sample of what its 'logging'?07:26
*** 7JTAAOHLN has joined #kolla07:26
inc0not with me right now, but I can get it later today if you want07:26
inc0or simply try to do quick aio with this one07:26
inc0and look at log07:26
SamYapleyea thats fine. im not worried. we can dig through it later07:27
SamYapleim more concerned about the changes needed to the openstack services and having a sample of those setup07:27
inc0well, it will require a bit of conf change07:28
inc0but I'll play with it later today07:28
SamYapleyep, thats what i want to see so we can test that and make sure that logs the way we want07:29
inc0fair enough07:29
*** 7JTAAOHLN has quit IRC07:30
openstackgerritMerged openstack/kolla: Increase size of operator to allow building images  https://review.openstack.org/22341507:32
*** itsuugo has joined #kolla07:32
*** itsuugo has quit IRC07:33
*** SourabhP has joined #kolla07:33
*** itsuugo has joined #kolla07:34
*** weiyu has joined #kolla07:35
*** SourabhP_ has quit IRC07:36
*** SourabhP has quit IRC07:39
*** achanda has quit IRC07:41
*** inc0 has quit IRC07:43
*** jmccarthy has quit IRC07:43
*** kjelly has quit IRC07:44
*** jmccarthy has joined #kolla07:44
openstackgerritMartin André proposed openstack/kolla: Update documentation for Vagrant environment  https://review.openstack.org/22342007:48
openstackgerritMartin André proposed openstack/kolla: Set namespace to point to local registry  https://review.openstack.org/22341907:48
openstackgerritMartin André proposed openstack/kolla: Add vagrant-generated files to gitignore  https://review.openstack.org/22341807:48
openstackgerritMartin André proposed openstack/kolla: Default vagrant deployment to AIO  https://review.openstack.org/22341707:48
openstackgerritMartin André proposed openstack/kolla: Preconfigure Kolla to work out of the box  https://review.openstack.org/22341607:48
*** Haomeng has joined #kolla07:53
*** Haomeng|2 has quit IRC07:56
*** kjelly has joined #kolla07:57
*** gfidente has joined #kolla08:00
*** sdake has quit IRC08:07
*** itsuugo has quit IRC08:11
pbourkeSamYaple: morning08:13
pbourkeSamYaple: two quick questions... 1) we need ansible 2.0 for some openstack modules right? if I wanted to pin to a tag do you know would v2.0.0-0.2.alpha2 be enough? 2) do you have a link to the bug in docker registry where it pushes all layers (ignores caching so it takes forever)08:15
*** itsuugo has joined #kolla08:19
*** dims_ has joined #kolla08:20
SamYaplepbourke: yea we can pin to that alpha tag. not a big deal. its working now after all and the shade stuff wont be done in time anyway :/08:24
pbourkeSamYaple: yeah we can leave it as is for now, just checking08:27
pbourkethanks08:27
SamYaplei would like to pin it before rc1 to be honest08:27
SamYaplebut we can wait until then08:27
SamYaplepbourke: https://github.com/docker/docker/pull/1549308:28
SamYaplelooks like its fixed in docker 1.8.2 :)08:29
SamYapleoh :(08:29
SamYaplenvm just 1.9.008:29
SamYaplepbourke: either way the issue is fixed in master right now it would seem08:31
*** athomas has joined #kolla08:32
pbourkeSamYaple: awesome thanks again!08:33
*** chandankumar has joined #kolla08:46
*** dims_ has quit IRC08:53
*** itsuugo has quit IRC09:09
*** pbourke has quit IRC09:09
*** pbourke has joined #kolla09:10
*** dayou has quit IRC09:16
*** itsuugo has joined #kolla09:23
*** diga has quit IRC09:26
*** bradjones|away has quit IRC09:47
*** bradjones has joined #kolla09:49
*** bradjones has quit IRC09:49
*** bradjones has joined #kolla09:49
*** dims_ has joined #kolla09:52
*** dims_ has quit IRC09:57
*** diga has joined #kolla10:34
*** diga has quit IRC10:40
*** dims_ has joined #kolla10:44
*** tfukushima has quit IRC10:53
*** dayou has joined #kolla10:56
*** itsuugo has quit IRC10:56
*** itsuugo has joined #kolla11:02
*** weiyu has quit IRC11:03
*** sdake has joined #kolla11:25
mduggan1rhallisey: Sorry if this is going over the same ground as yesterday but I was a little confused by your reply to vbel's question. So I'll try again :-)11:27
mduggan1Are the issues that are blocking LVM, iSCSI & NFS functioning of the dockerised cinder services, at present, issues within the docker containers themselves or are they problems with ansible being able to configure and deploy the cinder containers ?11:27
mduggan1A secondary question is which cinder service are broken ?11:27
*** itsuugo has quit IRC11:27
sdakecinder is busted11:27
*** sdake_ has joined #kolla11:30
pbourke...11:31
*** sdake has quit IRC11:31
*** itsuugo has joined #kolla11:36
*** shardy_ has joined #kolla11:36
SamYaplehas cinder ever worked?11:36
*** rhallisey has joined #kolla11:36
vbelwe have kolla cinder docs in openstack.org11:36
vbelcinder-api works :)11:37
*** shardy has quit IRC11:37
*** athomas_ has joined #kolla11:39
*** shardy_ has quit IRC11:41
*** shardy has joined #kolla11:42
*** athomas has quit IRC11:42
*** itsuugo has quit IRC11:48
*** dayou has quit IRC11:52
*** akwasnie has joined #kolla11:53
*** coolsvap_ has joined #kolla11:56
rhalliseyvbel, I think the issue is doing the volume attach11:57
vbelrhallisey: when using lvm? or in general?11:58
rhalliseyvbel, in general, doing a nova volume attach11:58
vbelrhallisey: I see, thanks11:58
SamYaplevbel: well not in general in general, it works fine for ceph11:59
*** chandankumar has quit IRC11:59
rhalliseyok haven't used ceph yet12:03
*** dwalsh has joined #kolla12:06
*** Haomeng|2 has joined #kolla12:07
rhalliseySamYaple, got a minute?12:08
SamYaplerhallisey: dont worry the code isnt up yet12:08
SamYaplerhallisey: sure12:08
SamYaplewell its mostly up12:09
rhalliseyso there's a problem with putting the json config stuff in /opt/kolla/<service>12:09
SamYapleyea we just need to have a generic moutpoint location12:09
rhalliseyif I go back to that again I need a way to identify where I'm looking for the json config12:09
SamYapleive been pushing that for a while12:09
SamYaplein the container '/opt/kolla/configs/config.json' or something12:09
rhalliseyby that you mean everything, config and json config in one location?12:10
SamYaplewell that, yes but no thats not what i meant12:10
SamYaplemountpoint would lookl ike this:12:10
*** Haomeng has quit IRC12:10
SamYaple/etc/kolla/mariadb/:/opt/kolla/configs/12:10
rhalliseyok that's fine12:10
SamYaple/etc/kolla/rabbitmq/:/opt/kolla/configs/12:10
SamYaplelike that12:10
rhalliseyI just can't have /opt/koll/<service?12:10
rhalliseyok that works12:10
SamYapleyea i totally get that12:10
rhalliseyok I understand the comment12:11
SamYaplethats what i was trying to say back when you were exporting the service name12:11
SamYaplesorry i comment right when i wake up and i am not always coherent12:11
SamYaplethats my fault12:11
rhalliseySamYaple, no worries man12:11
rhalliseyalso with the ubuntu issue for mariadb.. what would that dir be?12:12
SamYaplei dont know, its probably in config-external.sh though12:12
*** athomas_ has quit IRC12:13
openstackgerritMerged openstack/kolla: Make kolla-ansible work in pip installed kolla  https://review.openstack.org/22340712:17
openstackgerritMerged openstack/kolla: Preconfigure Kolla to work out of the box  https://review.openstack.org/22341612:17
openstackgerritMerged openstack/kolla: Default vagrant deployment to AIO  https://review.openstack.org/22341712:17
openstackgerritMerged openstack/kolla: Add vagrant-generated files to gitignore  https://review.openstack.org/22341812:18
*** jasl8r has joined #kolla12:20
*** diogogmt has quit IRC12:21
*** itsuugo has joined #kolla12:22
*** diogogmt has joined #kolla12:22
*** athomas has joined #kolla12:24
*** athomas has quit IRC12:25
*** sdake_ has quit IRC12:30
*** shardy_ has joined #kolla12:38
*** shardy has quit IRC12:39
*** weiyu has joined #kolla12:39
*** itsuugo has quit IRC12:42
vbelnova-novncproxy does not work12:42
vbelADD nova-novncproxy-archive /usr/share/nova-novncproxy-source12:42
vbelRUN cd /usr/share && ln -s nova-novncproxy-source/* novnc12:42
vbelwith the last statement we have link that does not find source12:42
vbelbecause of cd ...12:43
*** shardy_ has quit IRC12:43
*** itsuugo has joined #kolla12:43
*** shardy has joined #kolla12:44
vbel1 sec, why ..12:44
*** banix has joined #kolla12:45
vbelignore me for the moment :) looks like my image is outdated12:51
*** dwalsh has quit IRC12:55
*** klint has quit IRC12:58
*** jruano has joined #kolla12:59
*** chandankumar has joined #kolla13:00
*** chandankumar has quit IRC13:03
*** itsuugo has quit IRC13:13
*** weiyu has quit IRC13:15
*** banix has quit IRC13:16
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file  https://review.openstack.org/21687413:18
*** coolsvap_ has quit IRC13:19
*** dims_ has quit IRC13:21
*** dims_ has joined #kolla13:22
*** itsuugo has joined #kolla13:23
*** chandankumar has joined #kolla13:23
*** walters has quit IRC13:23
*** dwalsh has joined #kolla13:28
*** jruano_ has joined #kolla13:34
*** jruano has quit IRC13:38
*** itsuugo has quit IRC13:47
*** itsuugo has joined #kolla13:49
*** Haomeng has joined #kolla13:54
*** jtriley has joined #kolla13:54
*** Haomeng|2 has quit IRC13:57
*** jasonamyers has joined #kolla13:57
*** jruano_ has quit IRC14:04
*** itsuugo has quit IRC14:09
*** jtriley has quit IRC14:09
*** diogogmt has quit IRC14:17
*** itsuugo has joined #kolla14:21
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file  https://review.openstack.org/21687414:25
*** banix has joined #kolla14:28
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Galera  https://review.openstack.org/21788014:29
rhalliseySamYaple, I'm having trouble testing because of https://bugs.launchpad.net/kolla/+bug/149178214:30
openstackLaunchpad bug 1491782 in kolla "Fail to create haproxy mysql user" [Critical,Triaged]14:30
rhalliseycan't get past keystone14:30
*** achanda has joined #kolla14:30
rhalliseyany idea's to work around this? disabling haproxy is not it14:30
*** achanda has quit IRC14:31
jpeelerrhallisey: i believe i one time added a when: not enabled_haproxy | bool, or something like that in register.yml14:32
jpeelerobviously, that only helps if you disable haproxy14:33
rhalliseyjpeeler, does it get around that bug?14:33
rhalliseyhow are you testing ironic? Are you seeing the same issue?14:33
rhalliseythis occurs 100% of the time in AIO master14:34
jpeelerwell, i'm not using haproxy because i honestly don't know how to configure it14:34
rhalliseyare you able to run AIO?14:35
jpeeleryes, as of last week14:36
jpeelernot looking at it right now though14:36
*** chandankumar has quit IRC14:39
*** itsuugo has quit IRC14:41
*** diogogmt has joined #kolla14:52
*** walters has joined #kolla14:52
*** achanda has joined #kolla14:58
*** itsuugo has joined #kolla14:59
*** vbel has quit IRC15:02
*** vbel has joined #kolla15:03
*** dayou has joined #kolla15:04
*** achanda has quit IRC15:06
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Rabbitmq  https://review.openstack.org/21849615:19
*** dayou has quit IRC15:21
*** itsuugo has quit IRC15:24
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Keystone  https://review.openstack.org/21849715:27
*** akwasnie has quit IRC15:29
*** slagle has quit IRC15:30
*** coolsvap has quit IRC15:31
*** itsuugo has joined #kolla15:38
*** unicell1 has quit IRC15:51
*** jtriley has joined #kolla15:55
*** vilobhmm_11 has joined #kolla15:59
*** juggler has joined #kolla15:59
*** slagle has joined #kolla16:04
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Glance  https://review.openstack.org/21850116:10
*** mduggan1 has quit IRC16:10
*** mduggan has joined #kolla16:11
*** itsuugo has quit IRC16:12
*** chandankumar has joined #kolla16:17
*** juggler has quit IRC16:25
*** itsuugo has joined #kolla16:25
*** SourabhP has joined #kolla16:26
*** sdake has joined #kolla16:28
*** juggler has joined #kolla16:28
*** SourabhP_ has joined #kolla16:28
openstackgerritRyan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Nova  https://review.openstack.org/21850516:30
*** daneyon_ has left #kolla16:31
*** sdake_ has joined #kolla16:31
*** SourabhP has quit IRC16:32
*** SourabhP_ is now known as SourabhP16:32
*** juggler_ has joined #kolla16:32
sdake_samyaple around?16:33
*** juggler has quit IRC16:34
*** sdake has quit IRC16:35
*** juggler_ has quit IRC16:39
sdake_morning folks16:40
*** unicell has joined #kolla16:40
rhalliseyhye16:41
rhalliseyhey16:41
rhalliseysdake_, I think config stuff is going well16:43
*** jtriley has quit IRC16:45
*** vilobhmm_11 has quit IRC16:47
*** itsuugo has quit IRC16:51
*** chandankumar has quit IRC17:03
*** itsuugo has joined #kolla17:06
*** vilobhmm_11 has joined #kolla17:16
*** jasonamyers has quit IRC17:19
*** jerryz has joined #kolla17:20
*** achanda has joined #kolla17:28
*** sdake_ is now known as sdake17:33
sdakerhallisey sorry was afk17:33
sdakethat is good news, havey ou managedt o convert all of the containers that use ansible?17:33
sdakerhallisey i changed the blueprint from needs review because the work isn't finished yet for needs review17:34
rhalliseysdake, I have a few left, but there's a bigger issue... that haproxy is totally blocking me from testing17:34
sdakeneeds review = the patches are in the queue17:34
sdakearey ou able to reproduce that problem you have?17:34
rhalliseyya just run AIO from master17:35
sdakeif so, I would be happy to work up a patch for you17:35
rhalliseybreaks every time17:35
sdakerhallisey when I run on aio from master it works likea champ every time17:35
rhalliseywaa17:35
sdakeso i can't reproduce it17:35
rhalliseyon baremetal?17:35
sdakebut i can speculate as to what the problem is17:35
sdakeon bare metal17:35
rhalliseyhttps://bugs.launchpad.net/kolla/+bug/149178217:35
openstackLaunchpad bug 1491782 in kolla "Fail to create haproxy mysql user" [Critical,Triaged]17:35
sdake1 or 3 node controllers17:35
rhalliseyit's that bud17:35
rhalliseybug17:35
sdakeya - i'll submit a patch against it in 30 mins - could you test it?17:35
rhalliseyya sure17:36
sdaketoday?17:36
rhalliseydo you know what it is?17:36
rhalliseyya for sure17:36
rhalliseyit's driving me crazy..17:36
sdakei htink haproxy+mariadb are not setup by the time they are accessed17:36
sdakethe proper thing to do is use wait_for prior to setting up the haproxy user17:36
sdakelet me double check the bug17:37
rhalliseyI've tried adding some waits.. maybe I did it incorrectly17:37
sdakenote that code is not using haproxy, it is accessessing the db directly17:37
sdakewherei tsays creating haproxy user in the mariadb section, it connects directly to the database ip not the haproxy ip17:37
sdakei did have a question, is your vm time set properly17:38
sdakeas in do you use ntp or set the time manually correctly?17:38
sdakeand is your vm single processor?17:39
rhalliseyI'm on baremetal17:39
sdakeoh interesting17:39
sdakelet me hack together a patch and test in my local environment17:40
rhalliseyok thanks.  That would help a lot17:40
*** loth has joined #kolla17:40
*** sdake_ has joined #kolla17:41
*** SourabhP has quit IRC17:42
*** sdake has quit IRC17:44
*** itsuugo has quit IRC17:47
sdake_rhallisey you said it only happens on aio?17:53
sdake_have you tried multinode playbook?17:53
sdake_or inventory file i mean17:53
rhalliseysdake_, haven't used it no17:53
sdake_ok, would you try it please?17:54
sdake_you have to modify the multinode inventory file to suit your machine name17:54
sdake_and your machine name must be in /etc/hosts17:54
sdake_this may be an issue only with AIO ansible_connection=local17:54
sdake_kolla-ansible deploy -i ansible/inventory/multinode after modifying the multinode file17:55
rhalliseyk17:55
sdake_do you have a firewall enabled on the machine?17:55
rhalliseyya17:55
rhalliseyis this all in the multi node docs?17:56
sdake_after the deploy please test telnet localhost 330617:56
sdake_i am pretty sure my wait for solution wont work for you17:57
sdake_i think what is happening is ansible tries to connect  to localhost330617:57
sdake_mariadb doesn't bind to the localhost, but the specific host ip17:57
sdake_rhallisey i'd like you to test now so i can get on with my day:)17:58
sdake_someone else reported this bug17:58
sdake_and i need you to help me debug it17:58
sdake_since i can't reproduce in my environment17:58
sdake_but I run sans firewall17:58
rhalliseyTrying ::1...17:58
rhalliseytelnet: connect to address ::1: Connection refused17:58
rhalliseyTrying 127.0.0.1...17:58
rhalliseytelnet: connect to address 127.0.0.1: Connection refused17:58
sdake_havey ou deployed already rhallisey ?17:59
sdake_it will definatelybe refused if you haven't deployed17:59
rhalliseywhen am I doing the telnet after AIO or after multinode17:59
rhalliseyI'm confiused where we are here in testing18:00
rhalliseywhich am I going with18:00
sdake_eithe one18:00
sdake_do aio18:00
rhalliseyk18:00
sdake_does aio EVER work?18:00
rhalliseyno, it use to18:01
rhalliseythis error would show up occasionally, now it shows everytimes18:01
rhalliseyeverytime*18:01
sdake_same hardware?18:01
rhalliseyya18:01
sdake_do this before deplloying18:02
sdake_inside kolla-ansible tool in the tools directory18:02
rhalliseyonce I rebased last thusday I think18:02
sdake_where ansible is run18:02
*** jmccarthy has quit IRC18:02
sdake_make sure to run ansible iwth -vvv flags18:02
sdake_you have to hack the script18:02
rhalliseyk18:03
sdake_i want to see what the login_host is set to18:03
rhalliseywait what..18:04
rhalliseyit worked18:04
rhalliseyhold on..18:05
sdake_ok telnet localhost 330618:05
rhalliseysame error as above18:05
sdake_ok did you run with -vvv?18:05
rhalliseyya18:06
rhalliseyit got past the haproxy user creation though18:06
sdake_ok so I can close the bug then or will you try again pls :)18:06
sdake_run ./cleanup-containers -fv18:06
rhalliseyya I'll try again I'm just confused how this is happening :/18:07
sdake_me too18:07
sdake_that is why we get paid the big bucks bro18:07
sdake_because we can fix all this sshit :)18:07
*** SourabhP has joined #kolla18:07
sdake_let me ask did you have a deploy already active this time when you redeployed?18:07
rhalliseyno18:08
rhalliseythe difference is18:08
rhalliseyI was running the ansible command by hand18:08
sdake_what command did you type?18:09
rhalliseysudo ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml18:09
sdake_looks right18:09
sdake_pretty sure that is what the shell script does18:09
sdake_except the shell script doesn't run as sudo18:09
rhalliseyit is, 2x checking though18:09
sdake_did you run the shell script kolla-ansible with sudo?18:09
rhalliseyya I did notice that18:09
rhalliseydid not run w/ sudo18:10
rhalliseyfor shell script18:10
sdake_well duh :)18:10
sdake_you have to run as root user18:10
sdake_lets see if that is the issue18:10
sdake_cleanup-containers -fv18:10
sdake_and then lets try without the sudo18:10
rhalliseyno it seems like the opposite18:10
rhalliseyrunning with root wans't working18:10
sdake_oh running without root worked?18:11
rhalliseyya18:11
rhalliseyhold on a sec.  I want to run the old command again.  This is confusing18:11
sdake_sorry i go fast when i debug18:11
sdake_i usually debug 4 or 5 things at a time and bisect18:11
rhalliseyno problem I'm sitting waiting for this stuff to run mostly18:12
rhalliseyok running the old command again...18:12
rhalliseywhich is: sudo ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml18:12
rhalliseyuh that's now working too.. what! O.o18:14
* rhallisey looks a recent merged patches18:15
rhalliseysdake_, Idk seems to work then.  Oh well18:17
rhalliseywfm18:17
rhalliseystill don't know what caused that..18:17
sdake_are you running cleanup-containers -fv inbetween?18:17
rhalliseyya18:17
rhalliseysorry no18:17
rhalliseyI do18:17
rhalliseydocker ps -aq | docker rm -f18:17
rhalliseydocker ps -aq | xargs docker rm -f18:17
sdake_thats the same thing i think18:17
rhalliseyya18:18
rhalliseyprobably18:18
sdake_try again 2 more times pls18:18
rhalliseyworked on try 1..18:21
rhalliseyI don't know what to say.. I still feel like whatever this was is still hanging around18:21
rhalliseynot sure though, seems to be working now18:22
*** shardy is now known as shardy_afk18:22
rhalliseyseems to work, sdake_ close it18:23
rhalliseysdake_, might have been the wait added in haproxy-ansible that fixed this18:24
rhalliseyweird though, added that and it still didn't work for me18:24
rhalliseyoh well18:24
sdake_did you try with both sudo and without sudo?18:45
*** sdake_ is now known as sdake18:45
sdakei am not keen to close it because several people have reported it18:45
sdakecould you add that master currently works for you and it did not previously?18:45
sdakerhallisey ^^18:45
rhalliseysdake, ya I added some comments18:48
*** diogogmt has quit IRC18:51
rhalliseyboth sudo and non sudo worked18:51
*** diogogmt has joined #kolla18:52
*** shardy_afk is now known as shardy19:18
*** devlaps has joined #kolla19:51
*** achanda has quit IRC20:01
*** daneyon has joined #kolla20:17
*** shardy has quit IRC20:29
*** achanda has joined #kolla20:35
*** achanda has quit IRC20:35
*** achanda has joined #kolla20:35
*** daneyon_ has joined #kolla20:36
*** daneyon has quit IRC20:39
*** rhallisey has quit IRC20:41
*** dwalsh has quit IRC21:40
*** gfidente has quit IRC21:55
*** banix has quit IRC22:48
*** jtriley has joined #kolla22:50
*** sdake has quit IRC22:56
*** openstackgerrit has quit IRC23:16
*** openstackgerrit has joined #kolla23:16
*** jtriley has quit IRC23:16
jerryzsdake: i built the image successfully but failed to push them to local private registry. http://paste.openstack.org/show/463696/23:18
*** banix has joined #kolla23:21
*** jtriley has joined #kolla23:51
*** achanda_ has joined #kolla23:55
*** banix has quit IRC23:56
*** achanda_ has quit IRC23:57
*** achanda has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!