Sunday, 2016-03-27

*** allen_gao has joined #kolla00:01
*** vhosakot has joined #kolla00:05
*** ccesario has quit IRC00:07
vhosakotsdake: you need help to debug testr issue let me... got few mins now00:08
vhosakotlet me know*00:08
vhosakotsdake:  I see the docker socker PS00:09
sdakeyour on ubuntu00:11
sdakewhat is the nme of /run socket in ubuntu for docker00:11
sdakei'd like to know that00:11
sdakevhosakot ^00:21
vhosakotsdake: /run socket... ok, let me check00:21
*** vhosakot has quit IRC00:22
*** vhosakot has joined #kolla00:22
vhosakotsdake: what shoud I check ?00:24
vhosakot$ ls -lrt /run/docker.sock00:24
vhosakotsrw-rw---- 1 root docker 0 Mar 24 01:01 /run/docker.sock00:24
vhosakotsdake: ^^^00:24
sdakenice00:27
sdakeso this shoudl work00:27
vhosakotsdake: I tested ccesario's patch set, and see that it does not work, I will give me comments in the review00:31
*** achanda has quit IRC00:32
*** allen_gao has quit IRC00:33
*** allen_gao has joined #kolla00:41
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794500:51
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794500:56
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794501:00
vhosakotsdake: I saw your reply for the bug https://bugs.launchpad.net/kolla/+bug/1562231... yes, in the mariadb container, mariadb.log is at /var/log/kolla/mariadb/mariadb.log as expected. But, mysql.log and mysql.err are in /var/log/ instead of /var/log/kolla/mariadb/01:03
openstackLaunchpad bug 1562231 in kolla mitaka "lights out recovery patches may have caused problems with mariadb" [Critical,Confirmed]01:03
sdakelooks like the gate is working https://jenkins07.openstack.org/job/gate-kolla-dsvm-build-centos-binary/563/console01:07
*** Marga_ has joined #kolla01:11
*** Marga_ has joined #kolla01:12
openstackgerritCarlos Cesario proposed openstack/kolla: Added hostname param into kolla_docker  https://review.openstack.org/29798401:25
*** achanda has joined #kolla01:32
*** achanda has quit IRC01:37
*** Jeffrey4l has joined #kolla01:38
openstackgerritCarlos Cesario proposed openstack/kolla: Change keystone log dir  https://review.openstack.org/29796701:41
*** ayoung has joined #kolla02:00
*** iceyao has joined #kolla02:05
*** achanda has joined #kolla02:06
*** alisonh has left #kolla02:09
sdakepbourke you around?02:14
sdakeSamYaple you around?02:14
*** iceyao has quit IRC02:17
*** iceyao has joined #kolla02:18
*** vhosakot has quit IRC02:38
*** ccesario has joined #kolla02:52
*** klint has joined #kolla02:53
ccesariosdake what need to be rechecked ? https://review.openstack.org/#/c/297984/02:54
patchbotccesario: patch 297984 - kolla - Added hostname param into kolla_docker02:54
sdakeccesario the gate is totally busted as you can see from your review02:54
sdakewhen i put recheck in the review log it  triggers gerrit to ask jenkins to retest the patch02:55
sdakeif you have been watchin irc today you have seen my 25 patches to fix the gate02:55
sdakepatch attempts that is02:55
sdakethat is finally working02:55
sdakeso it just need approvals rom the core review tema02:55
ccesariosdake: ohh... understood...02:55
sdakeatm master and mitaka branches are blocked02:55
ccesarioI saw your patches....02:56
sdakebecause the gate is broken02:56
sdakethere is a mail to this effect on the mailing list02:56
sdakei'd recommend setting up a [kolla] filter on openstack-dev maiing list02:56
sdakeso you can see high priority koll arelated topics02:56
ccesariosdake: thanks by infos ...02:57
sdakehappy to help02:57
*** vhosakot has joined #kolla03:01
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794503:02
*** allen_gao has quit IRC03:04
ccesariosdake: regarding bug id #1531407 , is something like this that is needed (if needed) https://github.com/ccesario/kolla/commit/917f1659e9f8a15bf645216b0fd2e9ea278f0ac403:06
sdakeccesario typically generic tools to cleanup volumes are not ideal - too much chance for something to go wrong.  I'd prefer a straight listing of volumes to cleanup as is done in cleanup-containers.03:07
sdakefor extra credit, we need the same thing with cleanup-images03:08
sdakewhich atm cleans up all images in the system03:08
sdakerather then just those related to kolla03:08
*** allen_gao has joined #kolla03:09
ccesariosdake: well... I'm only based on bug description and discussion data .... in short .. "clean named volume"  ... ehehhe03:12
ccesariois there any doc with all named volumes created by kolla?03:12
*** achanda has quit IRC03:13
ccesarioI need to sleep.....  have everyone a good night!!!03:18
ccesariosdake: thanks by good infos!!!03:19
sdakeJeffrey4l around?03:20
openstackgerritHui Kang proposed openstack/kolla: Add Kuryr Docker container  https://review.openstack.org/29800003:59
*** salv-orlando has joined #kolla04:03
*** ayoung has quit IRC04:04
*** SiRiuS_ has quit IRC04:11
*** iceyao has quit IRC04:11
*** achanda has joined #kolla04:14
openstackgerritMerged openstack/kolla: Changes horizon log location to kolla_logs volume  https://review.openstack.org/29795204:14
*** salv-orlando has quit IRC04:15
*** achanda has quit IRC04:19
openstackgerritHui Kang proposed openstack/kolla: Add consul Docker container  https://review.openstack.org/29800104:20
Jeffrey4lsdake, yes04:34
*** achanda has joined #kolla04:37
*** allen_gao has quit IRC04:41
*** allen_gao has joined #kolla04:42
*** allen_gao has quit IRC04:51
*** allen_gao has joined #kolla04:59
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794505:22
openstackgerritSteven Dake proposed openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794505:23
*** iceyao has joined #kolla05:24
*** salv-orlando has joined #kolla05:27
*** salv-orlando has quit IRC05:36
openstackgerritSteven Dake proposed openstack/kolla: [WIP] Try overlayfs for storage driver in gate  https://review.openstack.org/29801106:38
Jeffrey4lsdake, vhosakot sup?06:55
vhosakothey Jeffrey4l how are you ?06:56
Jeffrey4lfine06:56
Jeffrey4lvhosakot, sdake told me ping vhosakot when i back06:56
*** iceyao has quit IRC06:56
vhosakotJeffrey4l: ah ok.. I dont know :)06:57
vhosakotJeffrey4l: let me remember if I need to get any information from you for the bug-fixes I"m working on now :)06:57
Jeffrey4lvhosakot, never mind.06:57
vhosakotcool06:57
Jeffrey4lvhosakot, what's it?06:59
vhosakotJeffrey4l: do you know if coolsvap is working on droproot for haproxy..?  i dont see coolsvap around here07:00
sdakerunning gat with overlayfs07:02
sdakegate07:02
*** salv-orlando has joined #kolla07:03
*** iceyao has joined #kolla07:03
sdakewhat the hellis the deal with rax.ord07:03
sdakeevey rax.ord jo fails07:04
Jeffrey4lvhosakot, https://review.openstack.org/245013 it has been long time since he last PS pushed. I think you can talk with him first and see what the status for that PS.07:04
vhosakotJeffrey4l: ah ok thanks a lot!07:05
sdakepersonally i'd just teak it over07:05
sdakecoolsvap not on irc often07:05
sdakehard to get ahold of07:05
vhosakotah ok07:06
vhosakotI saw your overlayfs PS.. cool... the gate's kernel has overlayfs ?07:06
openstackgerritKuo-tung Kao proposed openstack/kolla: add unit tests for build script  https://review.openstack.org/29042307:09
*** vhosakot has quit IRC07:10
*** salv-orlando has quit IRC07:10
sdakeJeffrey4l needs ack: https://review.openstack.org/#/c/297945/07:11
patchbotsdake: patch 297945 - kolla - Fix gate to use world writeable docker socket07:11
sdakeonly cento07:12
sdakes07:12
sdakecneots7 has overlyafs backported07:13
*** salv-orlando has joined #kolla07:18
*** salv-orlando has quit IRC07:22
*** allen_gao has quit IRC07:31
*** allen_gao has joined #kolla07:40
sdakeJeffrey4l https://bugs.launchpad.net/kolla/+bug/156244807:41
openstackLaunchpad bug 1562448 in kolla mitaka "rax.ord has consistent failure with IP checking" [Critical,Confirmed]07:41
*** iceyao has quit IRC07:59
*** stvnoyes has quit IRC08:09
*** stvnoyes has joined #kolla08:10
sdakemandre around?08:11
sdakelook at the performance difference of overlayfs vs btfs08:13
sdakeoverlayfs: https://review.openstack.org/#/c/298011/108:13
patchbotsdake: patch 298011 - kolla - [WIP] Try overlayfs for storage driver in gate08:13
sdakebtrfs https://review.openstack.org/#/c/297945/08:14
patchbotsdake: patch 297945 - kolla - Fix gate to use world writeable docker socket08:14
sdakewell cats i'm off to bed08:16
*** salv-orlando has joined #kolla08:22
*** achanda has quit IRC08:23
*** achanda has joined #kolla08:27
*** sdake_ has joined #kolla08:28
*** achanda has quit IRC08:30
*** sdake has quit IRC08:31
*** salv-orlando has quit IRC08:31
*** achanda has joined #kolla08:32
*** jmccarthy has quit IRC08:36
*** jmccarthy has joined #kolla08:37
*** achanda has quit IRC08:41
openstackgerritKuo-tung Kao proposed openstack/kolla: add unit tests for build script  https://review.openstack.org/29042308:46
*** salv-orlando has joined #kolla09:04
*** salv-orlando has quit IRC09:12
*** allen_gao has quit IRC09:16
*** allen_gao has joined #kolla09:24
*** achanda has joined #kolla09:41
*** achanda has quit IRC09:46
*** pbourke has quit IRC10:16
*** pbourke has joined #kolla10:16
*** salv-orlando has joined #kolla10:44
*** tuvenen has quit IRC10:48
*** elemoine has quit IRC10:48
*** salv-orlando has quit IRC10:48
*** tuvenen has joined #kolla10:50
*** elemoine has joined #kolla10:51
openstackgerritJeffrey Zhang proposed openstack/kolla: Handle multi Ethernets case in the gate  https://review.openstack.org/29023810:58
*** weiyu has joined #kolla10:58
SamYaplemorning11:08
*** achanda has joined #kolla11:14
openstackgerritSam Yaple proposed openstack/kolla: Test  https://review.openstack.org/29802911:18
*** allen_gao has quit IRC11:18
*** achanda has quit IRC11:19
*** allen_gao has joined #kolla11:24
openstackgerritSam Yaple proposed openstack/kolla: Test  https://review.openstack.org/29802911:25
*** SiRiuS_ has joined #kolla11:29
Jeffrey4lSamYaple, morning11:42
Jeffrey4lthe gate fix is alreadly in the queue, no need for test. https://review.openstack.org/29794511:42
SamYapleJeffrey4l: thats a bad fix11:44
SamYaplechanging permissions and blaming sudo -E?11:44
SamYaplereally?11:44
SamYaplesudo hasnt changed in years11:44
SamYapleand changing socket permissions is just a bad move, regardless if its "just in the gate"11:44
Jeffrey4li am also think it is related to the sudo, which change some environment.11:45
Jeffrey4lSo any better solution?11:45
SamYapleJeffrey4l: yea but i dont feel like doing it, so i abandoned my patchset11:46
Jeffrey4lSamYaple, means? don't get your point.11:47
SamYaplethere are better solutions than that Jeffrey4l . I dont feel like fixing it right now so i abandonded my patchset11:47
Jeffrey4lroger.11:48
*** weiyu has quit IRC11:52
*** allen_gao has quit IRC11:53
*** reddy has joined #kolla11:54
*** allen_gao has joined #kolla12:00
openstackgerritKuo-tung Kao proposed openstack/kolla: add unit tests for build script  https://review.openstack.org/29042312:23
*** iceyao has joined #kolla12:44
openstackgerritJeffrey Zhang proposed openstack/kolla: Handle multi Ethernets case in the gate  https://review.openstack.org/29023812:52
*** sdake has joined #kolla12:56
*** sdake_ has quit IRC12:58
*** klint has quit IRC12:59
*** achanda has joined #kolla13:17
*** achanda has quit IRC13:23
*** salv-orlando has joined #kolla13:37
*** salv-orlando has quit IRC13:48
ccesariomorning....13:53
*** reddy has quit IRC13:53
ccesariothe kolla gate logs is down ?13:54
*** achanda has joined #kolla13:57
*** achanda has quit IRC14:08
*** inc0 has joined #kolla14:16
openstackgerritSerguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support  https://review.openstack.org/29128514:22
*** intr1nsic has quit IRC14:24
*** intr1nsic has joined #kolla14:29
*** salv-orlando has joined #kolla14:30
*** jtriley has joined #kolla14:34
*** salv-orlando has quit IRC14:35
sbezverkJeffrey4l ping if you are around14:35
Jeffrey4lsbezverk, pong14:35
Jeffrey4lsbezverk, sup14:36
sbezverkJeffrey4l I am failing to understand what you did not like in this line: /var/lib/cinder/volumes/*14:39
sbezverkI mean it is how openstack doc says tgtd.conf should be modified..14:39
Jeffrey4lsbezverk, i means just use `echo "include /var/lib/cinder/volumes/*" > /etc/tgt/tgtd.conf`14:41
Jeffrey4lsbezverk, i means just use `echo "include /var/lib/cinder/volumes/*" >> /etc/tgt/tgtd.conf`14:41
Jeffrey4lthis should work as expected. no need introduce a tgtd.conf.1 file14:41
Jeffrey4lor use `sed` to insert a line at the begin of the file sbezverk14:42
*** allen_gao has quit IRC14:43
sbezverkJeffrey4l The requirement was to this line as 1st line in the config file, in your examples 1: tgtd.conf will be completely overwritten, 2: this line will be added to the end of existing file neither of this satisfy the requirement14:46
Jeffrey4lsbezverk, I am not sure(do not know) whether it is needed to be the first line. But If so, you can use sed to do this.14:46
Jeffrey4lsed -i '1 /var/lib/cinder/volumes/*' /etc/tgt/tgtd.conf14:48
Jeffrey4lsbezverk, ^^14:48
sbezverkJeffrey4l If it were not requirement, I would have just added to the end with >>, I will check with sed.. still do not get why so much fuzz with my solution..14:48
*** allen_gao has joined #kolla14:48
Jeffrey4lsbezverk, sed is simple a directly.14:49
sbezverkJeffrey4l ok, thanks for command, never used sed before to add line..14:50
Jeffrey4lwhen changing file content, sed is the best tool sbezverk :D14:51
sbezverkJaffrey4l have you tried this command? on my cenots it fails :-(14:53
sbezverksed -i '1 /var/lib/cinder/volumes/*' test.conf14:54
sbezverksed: -e expression #1, char 3: unknown command: `/'14:54
*** allen_gao has quit IRC14:54
sbezverkalso tried this: sed -i '1 \/var\/lib\/cinder\/volumes/*' test.conf14:56
sbezverksed '1 i /var/lib/cinder/volumes/*' test.conf : this one worked..15:00
*** allen_gao has joined #kolla15:01
openstackgerritJeffrey Zhang proposed openstack/kolla: Implement nova-ssh container  https://review.openstack.org/29796315:02
openstackgerritSerguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support  https://review.openstack.org/29128515:04
*** inc0 has quit IRC15:06
*** inc0 has joined #kolla15:06
*** jtriley has quit IRC15:06
*** achanda has joined #kolla15:09
Jeffrey4lSamYaple, pls re-consider this commit https://review.openstack.org/#/c/290238/315:10
patchbotJeffrey4l: patch 290238 - kolla - Handle multi Ethernets case in the gate15:10
openstackgerritSerguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support  https://review.openstack.org/29128515:11
SamYapleJeffrey4l: ill unblock i havent looked at the review though. i dont recall the issue with it15:12
Jeffrey4lSamYaple, thanks.  rax-iad node has two Ethernets, which result the ubuntu deploy job failed.15:13
SamYapleJeffrey4l: oh right thats for a slignly different reason though15:14
*** achanda has quit IRC15:14
SamYapleits because the hostname is still set for the ip on the eth0 interface when it should be set for eth115:14
SamYaplethats right your patch isnt going to work on multinode15:15
Jeffrey4lSamYaple, correct.15:15
Jeffrey4lSamYaple, we have no multinode jobs now.15:15
SamYapleJeffrey4l: we do15:15
SamYapleits in experimental15:15
SamYaplewaiting on something from infra15:16
Jeffrey4lSamYaple, moreover, this script name is deploy_aio not deploy_multinode15:16
* Jeffrey4l is checking that.15:16
SamYaplethats fine but to make this work aio is goign to break15:16
SamYaplethats why i blocked15:16
Jeffrey4lyes, you told me before. But I still confused why. I need theck that experimental jobs first.15:17
Jeffrey4lSamYaple, even if you are right, how could we fix the aio case? it happend now and there. we need fix this.15:18
SamYapleJeffrey4l: there is a patch up to fix it I havent finished yet15:19
SamYapleill look at it again15:19
Jeffrey4lSamYaple, could you explain why my PS is not work on multinode?15:22
openstackgerritSam Yaple proposed openstack/kolla: Fix /etc/hosts in gate  https://review.openstack.org/29724715:23
SamYapleJeffrey4l: the same reason its failing now. youll just make it work only on AIO and itll have to be reverted to work on AIO and multinode anyway15:24
Jeffrey4lSamYaple, the multi node job is not completed now. it just build the image without any deploy.15:24
Jeffrey4lhttps://github.com/openstack/kolla/blob/master/tox.ini#L17615:25
*** dims has quit IRC15:27
SamYapleJeffrey4l: im well aware of the state of it. i wrote all of it. im telling you what is needed to make it functional (and again, we are waiting on zuulv3 from infra)15:28
*** jtriley has joined #kolla15:28
Jeffrey4lSamYaple, so could we just fix the current issue before? We'd better make the gate always green. Otherwise we need write much recheck recheck recheck.15:29
Jeffrey4lbefore the zuulv3 come out.15:29
openstackgerritSam Yaple proposed openstack/kolla: Fix /etc/hosts in gate  https://review.openstack.org/29724715:30
SamYapleJeffrey4l: thats what that patchset is right there https://review.openstack.org/29724715:30
SamYapleif you want a _REALLY_ quick one, just change the hostname15:31
openstackgerritSam Yaple proposed openstack/kolla: Fix /etc/hosts in gate  https://review.openstack.org/29724715:33
SamYapleJeffrey4l: the only reason the gate is having issue right now with rax is because the hostname points to eth0, and we have a change that says it should point to eth115:33
SamYapleso the quickest fist is just a hostname change, that wont fix multinode though15:33
*** dims has joined #kolla15:34
openstackgerritSam Yaple proposed openstack/kolla: Fix /etc/hosts in gate  https://review.openstack.org/29724715:35
Jeffrey4lSamYaple, yea. that is better. lets wait the gate result.15:36
*** salv-orlando has joined #kolla15:36
SamYapleJeffrey4l: i think this latest one will fix it, but not positive15:37
*** jtriley has quit IRC15:40
*** salv-orlando has quit IRC15:42
*** jtriley has joined #kolla15:42
*** inc0 has quit IRC15:44
openstackgerritJeffrey Zhang proposed openstack/kolla: Implement nova-ssh container  https://review.openstack.org/29796315:49
openstackgerritHui Kang proposed openstack/kolla: Add Kuryr Docker container  https://review.openstack.org/29800015:56
*** jtriley has quit IRC16:07
openstackgerritHui Kang proposed openstack/kolla: Add consul Docker container  https://review.openstack.org/29800116:08
*** salv-orlando has joined #kolla16:09
*** achanda has joined #kolla16:11
*** salv-orlando has quit IRC16:12
*** achanda has quit IRC16:16
sbezverkSamYaple ping if you have time16:32
*** mbound has joined #kolla16:32
*** Jeffrey4l has quit IRC16:56
*** iceyao has quit IRC17:05
*** jtriley has joined #kolla17:25
*** mbound has quit IRC17:31
*** jtriley has quit IRC17:35
openstackgerritSerguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support  https://review.openstack.org/29128517:36
*** rstarmer has joined #kolla17:48
*** jasonsb has quit IRC17:58
*** achanda has joined #kolla18:14
*** dims has quit IRC18:15
*** achanda has quit IRC18:20
*** dims has joined #kolla18:22
*** vhosakot has joined #kolla18:31
*** achanda has joined #kolla18:35
vhosakotis infra or gate-kolla-docs broken ?   gate-kolla-docs failed and no logs are seen... isn't this odd   https://review.openstack.org/#/c/297963/318:39
patchbotvhosakot: patch 297963 - kolla - Implement nova-ssh container18:39
*** Marga_ has quit IRC18:42
*** Marga_ has joined #kolla18:42
*** Marga_ has quit IRC18:45
sdakehey folks18:46
vhosakothey...18:50
vhosakotis infra or gate-kolla-docs broken ?   gate-kolla-docs failed and no logs are seen... isn't this odd   https://review.openstack.org/#/c/297963/318:50
patchbotvhosakot: patch 297963 - kolla - Implement nova-ssh container18:50
sdakeany core reviewers around to ack this? https://review.openstack.org/#/c/297945/18:53
patchbotsdake: patch 297945 - kolla - Fix gate to use world writeable docker socket18:53
*** SiRiuS_ has quit IRC19:12
openstackgerritSerguei Bezverkhi proposed openstack/kolla: iscsi container with lvm2 support  https://review.openstack.org/29128519:19
*** sdake has quit IRC19:20
sbezverksdake vhosakot hi, can we chat about wild cards for iscsi?19:20
vhosakotsbezverk: wildcard what ? wildcard ip address for the initiator ?19:21
vhosakotbbiab... 20 mins19:23
sbezverkvhosakot yep, about ip address used to listen for incoming iscsi sessions19:25
*** SiRiuS_ has joined #kolla19:32
openstackgerritHui Kang proposed openstack/kolla: Add consul Docker container  https://review.openstack.org/29800119:44
*** vhosakot has quit IRC19:55
*** vhosakot has joined #kolla19:58
*** achanda has quit IRC20:06
*** vhosakot has quit IRC20:15
*** mikelk has joined #kolla20:33
openstackgerritHui Kang proposed openstack/kolla: Add Kuryr Docker container  https://review.openstack.org/29800020:33
*** mikelk has quit IRC20:39
*** mikelk has joined #kolla21:00
*** mikelk has quit IRC21:04
*** mikelk has joined #kolla21:04
*** mikelk has quit IRC21:06
*** sdake has joined #kolla21:36
*** vhosakot has joined #kolla21:47
*** salv-orlando has joined #kolla22:09
*** sdake has quit IRC22:18
*** vhosakot has quit IRC22:35
*** achanda has joined #kolla22:39
*** sbezverk has quit IRC22:52
*** sbezverk has joined #kolla22:53
*** vhosakot has joined #kolla22:56
*** salv-orl_ has joined #kolla22:57
*** salv-orlando has quit IRC22:57
*** vhosakot has quit IRC22:58
*** vhosakot has joined #kolla22:58
*** SiRiuS_ has quit IRC22:59
*** Marga_ has joined #kolla23:18
*** vhosakot has quit IRC23:24
*** vhosakot has joined #kolla23:24
*** ccesario has quit IRC23:27
*** vhosakot has quit IRC23:30
*** vhosakot has joined #kolla23:33
openstackgerritMerged openstack/kolla: Fix gate to use world writeable docker socket  https://review.openstack.org/29794523:42
*** cfarquhar has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!