Wednesday, 2015-10-21

*** tummy has joined #kolla00:00
sdake_thanks docaedo00:01
sdake_docaedo are you using --push?00:02
docaedonp - I've been a big fan from the beginning, just didn't have the opportunity to be as involved as I wanted, so just get to cheer on from the sidelines00:02
docaedoyes, pushing to a local registry running on a different machine here00:02
sdake_what is your build command option00:02
sdake_(what did you type in)00:02
*** jasonsb has joined #kolla00:02
docaedotools/build.py --registry 192.168.123.99:5000 --base ubuntu --type source --push00:03
sdake_you need -n too i think00:03
sdake_i haven't much experience with the --registry option its new00:04
sdake_but you probably need -n kollaglue00:04
sdake_unless that is default00:04
*** cloudnau_ has joined #kolla00:04
sdake_otherwise looks good00:04
sdake_push on my gear (750 intel pcie ssd 1.2 tb) takes 15 min build 15 min push for all containers00:04
docaedocool, just following along with http://docs.openstack.org/developer/kolla/deploy-all-in-one-node.html at this point.00:05
sdake_on my old raid 1+0 ssds build took 30 min push took 30 mins00:05
sdake_i think we need to add a "pushed image x" etc along the way00:05
sdake_because it just stalls out for 30 minute sto 1 hour and people think its busted00:05
sdake_while what its doing is sitting in a loop pushing images00:05
sdake_if its not printing its pushing00:05
docaedoyeah that would be great to see...  It's definitely still working, and CPU and network spike for a bit now and then - I'll be patient for a bit though (in fact, time to go eat some dinner I think)00:06
sdake_enjoy00:06
sdake_ttyl00:06
docaedoTomorrow I'm going to ask some clarifying questions around adding the app-catalog-ui to horizon as a build option00:07
*** cloudnautique has quit IRC00:07
docaedoI think I have my head wrapped around how i would do it, but before I start playing around and eventually commit for review, want to make sure my approach is sensible00:07
*** sdake has joined #kolla00:08
sdakethe short answer is we don't quite know how to handle plugins yet ;)00:08
*** cloudnau_ has quit IRC00:08
docaedoI suspected that was the case.  This might be a fun learning exercise then, and is as safe a plugin as you can find (due to it being incredibly simple, with no additional external dependencies)00:09
*** daneyon_ has quit IRC00:09
sdakewe have a meetup friday at 2:30 perhaps you can come then and we can discuss plugins, I'd like to use some of our meetup time for that prior to the binge drinking :)00:10
*** sdake_ has quit IRC00:11
docaedoI think I can make it (don't remember when I fly out on Friday but I think I'll have the time)00:13
*** diogogmt has quit IRC00:21
kfox1111hehe.00:23
kfox1111docaedo: you beet me to it.00:23
kfox1111I was going to ask for apps-catalog-ui to get added to the horizon container, but was waiting for the rdo package to get all the way through.00:23
*** achanda has quit IRC00:23
kfox1111we could have a docker env that enable's disables the plugin through the horizon enabled directory.00:24
kfox1111one way or another, I'm going to have to slide it into the research clouds kolla horizon container anyway. :)00:25
*** achanda has joined #kolla00:26
sdakewhat we want i think is a tarball that ends up containing all the plugins00:27
sdakeintegrated into the build system00:27
sdakeso we can build from source or packaging00:27
sdakebut we aren't clear how to do it yet00:27
sdakei'm sure people will come up with some bespoke options00:27
kfox1111its in pypi today,00:27
sdakebut we want it to work for everything00:27
kfox1111and....00:27
kfox1111https://bugzilla.redhat.com/show_bug.cgi?id=126837200:28
openstackbugzilla.redhat.com bug 1268372 in Package Review "Review Request: openstack-app-catalog-ui - openstack horizon plugin for the openstack app-catalog" [Medium,Assigned] - Assigned to mrunge00:28
kfox1111thats the rdo source rpm.00:28
sdakesay kfox1111  i'll brb i need to shut down to install my vpn keys00:28
*** sdake has quit IRC00:28
docaedofwiw, just now the build failed - got all successfully built images except for:00:29
docaedoERROR:__main__:ironic-px Failed with status: error00:29
kfox1111trying kolla with ironic? :)00:29
kfox1111or just building everything?00:29
docaedojust building everything, then will do all-in-one deploy on a VM00:30
docaedoI suspect I can probably move on to the next step at this point, as all the images I actually need are built00:31
kfox1111docaedo: I have to head out in a minute. but with the packages, I think the tweaks to the horizon Dockerfile would basically be yum install openstack-app-catalog-ui for rdo, apt-get install python-app-catalog-ui for deb/ubuntu, and pip install app-catalog-ui for source.00:31
*** sdake has joined #kolla00:31
kfox1111sdake: do you have history for while you were gone?00:32
docaedoyep :)  Except also need to wrap that in an config option for horizon so people can easily choose to enable/disable00:32
kfox1111right.00:32
docaedo(and after pip install for that option, still needs to copy a few bits to the right places I believe)00:32
kfox1111a snippet that if APP_CATALOG_ENABLED == False, move the enabled files out of the way. or something like that.00:33
sdakekfox1111 no00:33
kfox1111sdake: k. I think the only thing you missed was:00:33
kfox1111this: I have to head out in a minute. but with the packages, I think the tweaks to the horizon Dockerfile would basically be yum install openstack-app-catalog-ui for rdo, apt-get install python-app-catalog-ui for deb/ubuntu, and pip install app-catalog-ui for source.00:34
*** dolpher has quit IRC00:34
kfox1111ok. really gota head out this time. thanks.00:36
*** sdake_ has joined #kolla00:42
*** sdake has quit IRC00:45
sdake_kfox1111 yes but we want it to work well for all plugins without modification to the dockerfiles ;)00:49
sdake_or with a one time global modification that the operators dont have to do themselves00:51
*** sdake_ has quit IRC00:53
*** sdake has joined #kolla00:53
*** jasonsb has quit IRC01:03
*** sdake_ has joined #kolla01:05
*** sdake has quit IRC01:06
*** unicell has quit IRC01:20
*** alisonh has quit IRC01:24
*** sdake_ is now known as sdake01:31
*** dims has quit IRC01:34
*** alisonh has joined #kolla01:39
*** dolpher has joined #kolla01:40
*** diogogmt has joined #kolla01:42
*** alisonh has quit IRC01:44
*** alisonh has joined #kolla01:49
*** alisonh has quit IRC01:51
*** cemason has joined #kolla01:59
*** cemason has quit IRC02:04
kjellymorning02:05
*** alisonh has joined #kolla02:08
*** tfukushima has quit IRC02:08
*** jasonsb has joined #kolla02:13
*** alisonh has quit IRC02:14
*** CBR09 has joined #kolla02:15
*** kjelly has quit IRC02:15
sdakehey kjelly02:18
sdakessam you about?02:18
*** kjelly has joined #kolla02:18
sdakeSamYaple?02:18
sdakemorning kjelly02:18
sdakejpeeler rhallisey ?02:18
*** alisonh has joined #kolla02:18
sdakemandre pbourke?02:18
sdakeharmw?02:19
sdakecoolsvap02:19
sdakeneed couple reviewers02:19
*** tfukushima has joined #kolla02:19
mandrehey sdake, which one?02:20
sdakemoment02:20
sdakehttps://review.openstack.org/23781602:20
sdakehttps://review.openstack.org/23780002:21
sdakei announced the releease this morning but have yet to tag it02:21
sdakebecause I made the mistake of trying one last build before tagging :)02:21
kjellyI have one idea aobut report bug. When user report bugs, we need to sha to find what the image user use. I think write a script used for finding all image sha of kolla container. How do you think ?02:23
sdakediagnostic tools are cool02:23
sdakewill you be at summit?02:23
mandreyou can hardly call it a mistake :)02:24
kjellyNow if user want to find the image sha of running container, it need to use `docker inspect`02:24
sdakewe have a 40 minute session on diagnostics02:24
kjellysdake: yes, I will go to summit.02:24
sdakewil you make the kolla sessions?02:24
kjellysdake: I will join kolla sessions.02:25
sdakemandre ;-)02:25
CBR09hi all, sdake, when it tag and release liberty-stable? @@02:26
sdakecool well I look forward to meeting you02:26
sdakecbr09 we have two patches that need a +2 and a +a02:26
sdakethen one of those patches needs a backport to liberty02:26
sdakethen liberty is being tagged02:26
sdakeI hope it wil happen in the next  few hours but everyone is afk02:26
kjellysdake: me, too.02:27
CBR09and images on docker hub?, when they up? (ubuntu)02:28
sdakewe ar edistributing the build between 3 folks02:28
sdakeso hopefully tomorrow02:29
*** rhallisey has quit IRC02:29
CBR09yea, thanks02:29
CBR09I need them soon (images + release liberty) and deploy private env with kolla02:30
sdakehow many nodes ?02:30
CBR09ah, it's only for testing02:31
CBR09about 5 nodes for tests02:31
CBR09if openstack-in-docker is ok, we'll plan it for production02:33
sdakehow many production node?02:33
CBR0920 compute nodes02:35
sdakenice02:35
CBR0915 storage nodes02:35
sdakethats alot of storage!02:35
CBR09but it seems still far away02:35
CBR09: )02:35
sdakewell kolla is pretty solid02:35
sdakebut I think it will take a ouple weeks for liberty to fully shake out from here02:36
CBR09yea, I'll only deploy on test env after kolla release liberty02:37
CBR09hope it release soon : )02:38
sdakeliberty releases in the next 24 hours02:38
sdakebut i think we will find little bugs here and there02:38
sdakedepends how crazy people get with backports02:38
CBR09of course : )02:38
sdakewe had talked about a liberal backport policybut I really want to rethink that for the next few months02:38
sdakeso people have a chance to play with kolla in a stable way02:39
sdakeperhaps for mitaka our backport policy coulcd be more liberal02:39
sdakebut i'm just one person in the community its relaly a group decision02:39
CBR09yea, I know02:40
sdake3 control nodes?02:40
CBR09not deploy with HA02:41
CBR09only one control nodes02:41
sdakedangerous02:41
sdakeyou sure about that?02:41
CBR09I know it02:41
CBR09but if I deploy with HA, it seems difficult to administr : )02:42
CBR09after one week, I'll imporve it02:43
CBR09mean add HA into my kolla env02:44
sdakeadmin with ha is same as without02:45
CBR09oh I'll rethink it02:48
sdakeyou do need 3 nodes though02:49
sdake2 wont do it02:49
CBR09because i want to keep it as simple as possible02:49
sdakeharmw jpeeler rhallisey SamYaple coolsvap around?02:49
CBR09yea, I know if deploy with HA, need 3 nodes control02:49
sdakefull control node softwar erquires 8gb ram02:50
sdakeso the machines can do double duty as storage/compute nodes02:50
*** cemason has joined #kolla02:51
CBR09yea, we can mix it02:51
sdakecbr i get simple,  that is entire design philosophy behind kolla :)02:52
CBR09: D02:52
*** achanda has quit IRC02:53
*** cemason has quit IRC02:53
CBR09thank for your advice : )02:53
sdakehappy to help ;)02:54
sdakepaying good money for a core reviewer :)02:55
sdakei guess inc0 will be on in about 4 hours02:55
*** achanda has joined #kolla02:56
*** achanda has quit IRC02:57
sdakemandre ping02:57
sdakeharmw aren't you awake :)02:59
sdakejpeeler its only midnight!03:00
CBR09and no core reviewers at here : )03:00
kjellysam will be online after one hour, I guess.03:01
sdakekjelly nah he is back on a different schedule now03:01
sdakenormal us schedule03:01
kjellysdake: :(03:02
sdakecoolsvap is usually around this hour i think03:03
sdakewish i hadn't announced the release while tagging03:03
sdakei was doing two things at once03:03
sdaketagging and writing eail03:03
sdakethen i'm like "ok just one more build" :)03:03
sdakesince my name goes on the tag03:04
sdakei rebuilt all variants and boom 3 things blew up03:04
sdakefor those that didn't see the release announcement here it is http://sdake.io/2015/10/20/announcing-the-release-of-kolla-liberty/03:11
sdakekolla powered -> https://www.oracle.com/corporate/pressrelease/oracle-openstack-4-oracle-linux-101915.html03:20
*** tpot has quit IRC03:37
CBR09yea I saw03:39
CBR09ah sdake: purpose behind break all openstack services into containters (nova-api, nova-schduler,...) is easy to upgrade03:42
CBR09what's else?03:42
sdakemakes whole system more composable03:43
sdakeimmutability03:43
CBR09if only break project-level (nova project in a container, glance project in a container), what is the difference?03:43
sdakemagic container properties -> http://sdake.io/2015/04/13/preserving-contaner-properties-via-volume-mounts/03:43
CBR09I see, now it's too much containers and hard to manage containers03:45
CBR09you see what I'm getting?03:52
CBR09problem about manage containers03:52
sdakewell ansible manages the containers for you03:59
sdakebasically you ahd to manage all thoe thigns as processes prior03:59
sdakewith filesystems03:59
sdakeand files03:59
sdakeand confg03:59
sdakeand all kinds of stuff all over the place04:00
sdakenow it goes in one immutable object04:00
sdakeper service04:00
sdake90 things instead of tens of thousands04:00
sdakedoes that make more sense or less :)04:00
*** daneyon has joined #kolla04:04
*** daneyon_ has joined #kolla04:05
CBR09but for operation?04:06
*** cloudnautique has joined #kolla04:06
CBR09ex: when I have errors for glance04:06
CBR09I must see all glance containers04:07
CBR09and it seems not convenient04:07
*** daneyon has quit IRC04:09
coolsvapsdake, hi04:25
sdakecoolsvap need reviews plz04:25
sdaketop two in the queue04:25
coolsvapsdake, just logged in04:26
coolsvapthere in a mn04:26
sdakecbr I personally believe we can make kolla have a better service assurance and diagnostic experience with containers then existing systems without containers04:26
*** achanda has joined #kolla04:27
openstackgerritMerged openstack/kolla: Make Ceph install from Source on RPM  https://review.openstack.org/23781604:29
openstackgerritMerged openstack/kolla: Increase Ceph RPM gpg key timeout to 90 seconds  https://review.openstack.org/23780004:30
*** achanda has quit IRC04:32
*** achanda has joined #kolla04:35
*** bmace has quit IRC04:40
*** bmace has joined #kolla04:41
*** tummy has quit IRC04:42
*** diogogmt has quit IRC04:45
*** tfukushima has quit IRC04:46
*** daneyon_ has quit IRC04:48
*** tpot has joined #kolla04:49
sdakecoolsvap till there?04:53
coolsvapyes04:54
openstackgerritSteven Dake proposed openstack/kolla: Make Ceph install from Source on RPM  https://review.openstack.org/23787204:54
sdakeneed love on that one04:54
sdakeits a backport04:54
sdakemandre !!!!!!04:54
sdakemandre can you please ack that backport04:54
sdakeinbox overload!!04:55
coolsvapi didnt notice i am still marked away04:55
mandrehere you go sdake04:56
sdakeok time to build it all again04:57
sdakewish me luck :)04:57
sdakebrb04:57
mandredidn't we have a policy at some point where backports required only one +2 before +A?04:58
*** sdake_ has joined #kolla05:00
*** sdake has quit IRC05:01
coolsvapsdake, anything to look into once you trigger push?05:02
*** tummy has joined #kolla05:05
sdake_coolsvap huh?05:08
sdake_the liberty metrics are finalized on stackalytics if folks want to see05:09
sdake_http://stackalytics.com/?metric=commits&release=liberty&module=kolla-group05:09
sdake_grats to sam for hitting #1 in commits05:09
sdake_but grats to everyone  for making the project a success!05:09
sdake_wow our review queue is packed already05:12
sdake_doesn't anyone ever sleep ;)05:12
openstackgerritMerged openstack/kolla: Make Ceph install from Source on RPM  https://review.openstack.org/23787205:12
coolsvapsdake_, just asking :)05:13
sdake_i will be tagging as soon as these builds finish05:13
sdake_coolsvap if you want to deploy stable/liberty as a second sanity check it would be apprecited05:14
sdake_mandre if you want to be a third sanity check that would totally rock ;)05:14
sdake_AIO would be good enoough i think05:15
*** tummy has quit IRC05:16
sdake_if your going to commit to that let me know05:16
sdake_if not let me know05:16
*** openstackgerrit has quit IRC05:16
*** openstackgerrit has joined #kolla05:16
coolsvapsdake_, i will do05:16
mandresdake_, which one you want me to test? centos source or binary05:17
sdake_do source05:17
sdake_or binary05:18
sdake_your choice05:18
sdake_jusst let me know and I"ll do the other05:18
sdake_i'm buidling both atm05:18
sdake_then i'm building oracle linux05:18
sdake_then i'm building ubuntu05:19
sdake_but i'd be happy if you jut built one and tested either centos binary or centos source05:19
sdake_i can build fast because I have pcie-ssd05:19
sdake_make susre to replac your etc dir to build05:19
sdake_or openstack-base wont build05:19
*** tummy has joined #kolla05:21
sdake_remember, git checkout stable/liberty05:21
sdake_not master05:22
coolsvapi will check centos-source05:22
sdake_cool05:22
sdake_make sure to create a vm or something to test it actually works05:24
coolsvapyes05:25
sdake_ok designate fails to build on binary05:25
sdake_expected05:25
sdake_friday designate got changed in some big way05:26
sdake_which broke it badly for us05:26
sdake_but it doesns't matter05:26
sdake_it just busts our gate but not our functionality05:26
sdake_since we don't deploy designate05:26
sdake_oraclelinux fails to build05:28
sdake_gnocchi fails to build from source05:29
mandrejust kicked a centos binary build05:31
sdake_i htink we need to fix oracleinux05:31
sdake_it shoudl be easy hiopefully05:31
*** tummy has quit IRC05:32
sdake_oraclelinux builds in master05:33
*** tfukushima has joined #kolla05:33
sdake_have a fix for oraclelinux05:55
sdake_please before heading off to bed let me get it tested and get +2 and a +a on it05:56
*** CBR09 has quit IRC06:04
sdake_since you two are testing centos, i'll test oraclelinux06:05
sdake_ok?06:05
sdake_coolsvap and mandre?06:05
mandrestill building sdake_, i have slow hardware..06:05
sdake_roger06:06
sdake_but does that sound ok?06:06
sdake_i have already build centos binary and source :)06:06
sdake_400 bucks for pcie-ssd well worth the money :)06:06
mandrei'm only building a subset of images, the ones we're deploying with ansible06:06
mandreso far so good06:06
sdake_do you have a script that does that?06:06
sdake_can you do a deploy as wel?06:06
mandrei will06:07
sdake_cool06:07
sdake_ok oraclelinux builds now binary except gnocchi and magnum06:07
mandrenah, not using a script, simply used the regex in the buildprofile patch06:08
sdake_right06:08
coolsvapsdake_, roger that i am doing similar to mandre builidng only required images06:11
sdake_is there any way to do06:12
sdake_    {% if install_metatype == 'rdo' %}06:12
sdake_if install_metatyep 1= 'rdo'?06:12
sdake_!= I mean?06:12
openstacksdake_: Error: "=" is not a valid command.06:12
sdake_will that work?06:12
sdake_nm foudn a different way to do it06:15
*** CBR09 has joined #kolla06:23
*** daneyon has joined #kolla06:26
*** daneyon_ has joined #kolla06:27
*** daneyon has quit IRC06:31
sdake_hey coolsvap mandre have patch coming for https://bugs.launchpad.net/kolla/+bug/150832607:00
openstackLaunchpad bug 1508326 in kolla "enhance dry-ness of base dockerfile.j2" [Critical,Confirmed] - Assigned to Steven Dake (sdake)07:00
sdake_testing it now07:00
*** daneyon has joined #kolla07:02
sdake_this is to fix oracle linux07:03
sdake_i think we need 3 more patches before we are wrapped07:05
sdake_how much time do you guys have left?07:05
*** tfukushima has quit IRC07:06
*** daneyon_ has quit IRC07:06
*** daneyon has quit IRC07:06
*** tfukushima has joined #kolla07:07
coolsvapsdake_, i am around07:07
coolsvapat least 4 hrs07:07
sdake_i'll be  done in 30 mins07:08
sdake_then 1 more hour to test the followon fix for oracle inux07:08
sdake_it takes me 1 hour to build 4 distros07:08
*** jmccarthy has joined #kolla07:14
*** tpot has quit IRC07:19
*** jongchoi has joined #kolla07:31
coolsvapsdake_, brb from lunch in 20 mins07:31
openstackgerritMartin André proposed openstack/kolla: Fix cleanup-containers to cleanup all kolla images  https://review.openstack.org/23791807:47
openstackgerritMartin André proposed openstack/kolla: Fix cleanup-containers to cleanup all kolla containers  https://review.openstack.org/23791807:50
*** dims has joined #kolla07:58
SamYaplemorning08:05
*** dims has quit IRC08:05
SamYaplemandre: that cleanup-containers08:08
mandrehi08:08
SamYapleyou dont need toe eval08:08
SamYaplethe expanion happens in the initial shell08:08
SamYapleits an array so it just dumps out08:08
SamYaplethe script actually works, minus the fact that it leaves around ceph and cinder containers08:09
mandrereally? it didn't work for me08:09
SamYapleyes like i just tried it08:09
SamYaplethe array expands in the main shell, the subshell has nothing to expand08:09
*** achanda has quit IRC08:10
mandreI'll try again in a few minutes, deploying right now...08:12
*** achanda has joined #kolla08:13
*** achanda has quit IRC08:15
*** achanda has joined #kolla08:20
mandreah, my bad SamYaple08:20
mandrei was working on stable/liberty and submitted my patch to master, where it's already fixed08:20
mandrehttps://github.com/openstack/kolla/commit/1e86af763ba514843326885a8b172f6e548f8be408:20
mandreneeds to be backported08:20
SamYapleyea that sounds right08:20
openstackgerritMartin André proposed openstack/kolla: put conatiner name to array in cleanup-containers  https://review.openstack.org/23792608:22
*** gfidente|afk is now known as gfidente08:23
mandrecontrary to my patch this one only works with bash4, but it shouldn't be no problem08:24
mandreI think only osx ships by default with bash308:25
SamYaplemandre: i think we state we target bash4 somewhere08:37
SamYaplebut hey if you want bash3 t o work and eval is the only option, go for it08:37
SamYapleim not going to block something simple and silly like that08:38
mandrenah, there is no reason for it08:38
mandreSamYaple, can we merge https://review.openstack.org/#/c/233993/?08:40
SamYaplechecking08:40
SamYapleyes08:41
SamYaplethat doesnt change the existing gate08:41
*** pbourke has quit IRC08:42
*** pbourke has joined #kolla08:42
mandrecool, give me 5 min to review it then08:43
mandresdake_, successful build & deploy of stable/liberty for centos binary08:43
sdake_mandre we need a change for oraclelinux08:44
sdake_which will affect those testing results i think08:44
SamYaplehave we _still_ not tagged?08:44
mandreyou have a patch ready?08:44
sdake_no oraclce linux doesn't buidl08:44
SamYapleonly a week behind :(08:45
sdake_yes i have a patch i am testing atm08:45
*** athomas has joined #kolla08:45
mandrepush it so I can kick a new build before heading back home08:46
sdake_i get htis error with ironic-discover any ideas08:46
sdake_http://paste.fedoraproject.org/281778/4171611408:46
SamYaplesounds like you arent running with --no-cache08:47
SamYapleconsidering you have an old  version of pip08:47
sdake_i am running with --no-cache actually08:48
*** jongchoi has quit IRC08:48
sdake_should i run without it?08:48
*** achanda has quit IRC08:48
SamYaplei spoke wrongly --no-cache is right08:48
SamYapleok well keep in mind that has pip 7.1.0 installed something went wrong08:48
SamYaplethe latest pip should always be installed since we install with get-pip08:49
sdake_on binary buidls?08:50
sdake_this is binary buid08:50
SamYapleoh yea then thats not going to work08:50
SamYaplethats explictly for source builds08:50
sdake_ok so thats another bug08:51
* sdake_ fucking groans08:51
*** sdake_ is now known as sdake08:51
SamYaplesdake: you need to tag at somepoint08:51
SamYaplethis week overdue this is becoming habbit and i dont like it :/08:51
SamYapleand that only affects master not liberty anyway08:52
sdakei'd like to tag in the next few hours08:52
sdakeliberty oracle linux is broken08:52
sdakeoh this upper constraint wasn't backported?08:52
SamYapleno it needs to be...08:52
*** mbound has joined #kolla08:52
SamYaplebut it hasnt been done since we were suppose to tag a week ago08:52
openstackgerritSam Yaple proposed openstack/kolla: Ironic binary shouldnt use upper-constraints  https://review.openstack.org/23793808:55
openstackgerritMerged openstack/kolla: In gate functional testing  https://review.openstack.org/23399308:56
openstackgerritSteven Dake proposed openstack/kolla: Improve dry-ness of base dockerfile.j2  https://review.openstack.org/23793908:56
sdakecan't tag when shit is DOA08:57
sdakeanyway lets focus on getting the problems solved in the next few hours08:57
sdakewe are super close08:58
SamYapleyea thats my point though this effort should have happened a week ago but laziness08:58
sdakenot lazy08:58
sdaketoo much workload on my plate cant do it alone08:58
sdakeand i'm not - everyone is working really hard08:58
sdakeanyway lets focus on getting the code base operational08:59
sdakeso that upper constraints work isn't in liberty atm?08:59
openstackgerritSam Yaple proposed openstack/kolla: Add build profiles to build.py  https://review.openstack.org/23794009:00
openstackgerritSam Yaple proposed openstack/kolla: In gate functional testing  https://review.openstack.org/23794109:00
SamYaplesdake: nope but i can backport it09:00
sdakelets not add fuel to fire please :)09:00
sdakei'd just like to fix oraclelinux and then tag09:01
sdakethen go wild09:01
*** openstackgerrit has quit IRC09:01
SamYaplejust fyi we need upperconstriants to gate09:01
*** openstackgerrit has joined #kolla09:01
sdakei am building src rpms atm09:01
sdakeroger09:01
sdakewe can backport09:01
sdakei jsut wnat ot tag as soon as possible09:01
*** pbourke has quit IRC09:01
*** pbourke has joined #kolla09:02
sdakemandre that patch is up above09:02
sdakethe dryness patch09:02
sdakethere is a backport needed on top of that though09:02
sdakeso you will hae to wait for that if you want it09:03
sdakeotherwise coolsvap and i can test09:03
sdakebut if you want ot review thta patch it would be helpful09:03
*** jmccarthy has quit IRC09:03
sdakecentos source centos binary oraclelinux binary buids with that patch09:07
sdakesource is still buidling09:07
sdakeoraclelinux source that is09:07
sdakeok everything builds with that patch except the upper constraints on ironic09:09
sdakeand designate09:09
sdakeso please give it the ack love09:09
SamYapledesignate is unrelated09:09
sdakeye i know09:10
sdakei dont care about desinate being broken09:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for repeatable builds  https://review.openstack.org/23794209:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for keystone  https://review.openstack.org/23794309:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for ceilometer  https://review.openstack.org/23794409:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for cinder  https://review.openstack.org/23794509:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for designate  https://review.openstack.org/23794609:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for glance  https://review.openstack.org/23794709:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for gnocchi  https://review.openstack.org/23794809:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for heat  https://review.openstack.org/23794909:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for horizon  https://review.openstack.org/23795009:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for ironic  https://review.openstack.org/23795109:10
SamYapleyoure welcome09:10
openstackgerritMerged openstack/kolla: put conatiner name to array in cleanup-containers  https://review.openstack.org/23792609:10
openstackgerritSam Yaple proposed openstack/kolla: Use openstack/requirements for ironic  https://review.openstack.org/23795109:12
sdakeplease ack folks https://review.openstack.org/23793909:12
SamYaplewant to see gate first09:12
sdakeok09:13
sdakefwiw I tested everything but ubuntu09:13
sdakewe need to get an ol gate operational as well09:13
SamYapleubuntu hasnt broken in quite a while09:13
sdakeya less combos of stuff to go wrong :)09:13
SamYapleby design. I could be pulling in 10 repos as well09:14
SamYaplei say neigh!09:14
sdakeat some point we shoudl do binary ubuntu too :)09:14
sdakedont they produce binary packages?09:14
SamYaplenever gonna happen09:14
SamYapleyea but no delorean type packages09:14
SamYapleso it would have to be implemented post-stable09:14
sdakeya that blows09:14
SamYapleive already told the cloud-archive people im not doing it unless they can provide something delorean like09:15
SamYaplebut they have no reason to do so :/09:15
SamYapleits not like that owuld ever be good anyway09:15
SamYapleit would be about as good as delorean, which is bad and breaks for days and weeks09:16
sdakedelorean works pretty well most of the time09:16
sdakeespecially now they are doing gating09:16
sdakedelorean gates now09:16
SamYaplewell that might be helpful09:16
sdakethat is what we are using09:16
sdakewe were not using it prior09:16
SamYaplethat should prevent the day/week breakage09:16
sdakeright09:16
SamYapledo they full openstack gate? or just install09:16
sdakeit will ensure delorean master is alway in pretty good shape09:16
sdakenot sure what the gate process is09:16
sdakei'll find out if you like09:16
mandreheading home, bye09:16
sdakeat a more reasonable hour of the day  :)09:17
sdakebye mandre09:17
sdakethanks09:17
SamYapleif its not functional testing i dont think we want that voting in kolla then09:17
sdakei'll find out what theier ci process is09:17
sdakered hat actually has pretty advanced internal ci systems09:18
sdakewhereami.org !#!#09:18
sdakewhat is the upper requirements thing btw09:19
sdakesince i actually took pto for a weeeknd and the queue has 40 patches in it09:20
sdakeI haven't had a chance to catch up from friday09:20
SamYapleits sorta like tested version pinning09:20
sdaketestsed y who09:21
SamYapleopenstack/requirements09:23
*** jmccarthy has joined #kolla09:23
SamYapleits what the rest of the community gates, constraints09:24
SamYapleits new in liberty09:24
sdakeyup09:24
sdakei saw it in the marketing slides09:24
SamYaplei would so love it if people would review my patches :(09:27
*** tfukushima has quit IRC09:28
pbourkeSamYaple: paste me some09:29
SamYaplepbourke: https://review.openstack.org/#/q/status:open+project:openstack/kolla,n,z09:29
SamYaple:P09:29
SamYaplepbourke: im most interested in rabbitmq testing on centos https://review.openstack.org/#/c/235756/09:29
SamYaplethen the ceph changes https://review.openstack.org/#/c/236754/09:30
SamYaplethose are my biggest "i dont want to keep floating these large patches" patches09:30
pbourkefor these openstack/requirements backports - did we checkout the liberty tag of the requirements in the base image09:31
sdakehttps://review.openstack.org/#/c/237939/ is ready for merge09:31
SamYapleyea pbourke09:31
pbourkegreat09:31
*** openstackgerrit has quit IRC09:31
sdakedesignate is only failing job09:31
sdakeor build i mean09:31
*** openstackgerrit has joined #kolla09:31
SamYaplesdake: looks good09:31
sdakepbourke if you would do the honors please09:32
sdakeso I can go to bed in the next 2 hours09:32
SamYaplehey should our "expected to fail" images actually break the gate?09:32
sdakeno but someone would have to add designtae to the test code09:32
SamYapleif we block designate and then it starts working the gate will fail again though09:32
SamYaplei dont want that09:32
sdakeya it is not ideal09:32
SamYapleshouldnt it just warn?09:32
sdakeit should fail if something happens we dont expect09:33
sdakewe dont expect designate to break09:33
sdakeexcept apparently now we do :)09:33
SamYaplebut if we block desginate and then it starts successeding it should FAIL09:33
SamYapleit shouildnt*09:33
sdakeit will fail09:33
sdakeor maybe it doesn't09:33
SamYaplei know it will, im saying i dont think that it should09:34
sdakei dont recall what the test case does09:34
SamYapleit fails09:34
SamYapleantoher time09:34
openstackgerritMerged openstack/kolla: Improve dry-ness of base dockerfile.j2  https://review.openstack.org/23793909:34
SamYapleive got to do seperate exlcuded images in teh gate anyway09:34
SamYaplesdake: you want me to cherrypick?09:35
sdakeno i got it09:35
sdakei need to add a patch on top09:35
sdaketo make ol actually work in liberty as well09:35
SamYapleyou arent going to cherry-pick a breaking patch right?09:36
openstackgerritMerged openstack/kolla: Add build profiles to build.py  https://review.openstack.org/23794009:36
SamYaplewe shouldnt even be breaking in a single patchset09:36
sdakestable/liberty is already broken09:36
SamYapleif its going to break you should update it to make it work for the branch in question09:36
sdakethis patch is a dependency to fixing it09:36
SamYapleso its not _new_ breakage?09:36
sdakeno09:36
SamYapleok thats fine09:36
openstackgerritSteven Dake proposed openstack/kolla: Improve dry-ness of base dockerfile.j2  https://review.openstack.org/23796109:39
openstackgerritSteven Dake proposed openstack/kolla: Make Oracle Linux with RDO  https://review.openstack.org/23796209:43
*** exploreshaifali has joined #kolla09:43
openstackgerritSteven Dake proposed openstack/kolla: Make Oracle Linux compatible with RDO  https://review.openstack.org/23796209:44
*** tfukushima has joined #kolla09:44
SamYaplesdake or pbourke https://review.openstack.org/#/c/237941/09:49
SamYaplethis will get project-config moving with infra09:49
SamYapleits a dependant patch09:49
SamYaplecoolsvap: for the win!09:51
SamYaplethanks09:51
coolsvapSamYaple, wc!09:51
openstackgerritSam Yaple proposed openstack/kolla: Pin Magnum in liberty branch  https://review.openstack.org/23796509:54
openstackgerritMerged openstack/kolla: In gate functional testing  https://review.openstack.org/23794109:54
openstackgerritMerged openstack/kolla: Add nova-spicehtml5proxy console  https://review.openstack.org/23666910:01
*** tfukushima has quit IRC10:02
*** dolpher has quit IRC10:02
*** bigjools has quit IRC10:04
*** tfukushima has joined #kolla10:13
openstackgerritMerged openstack/kolla: Improve dry-ness of base dockerfile.j2  https://review.openstack.org/23796110:13
*** bigjools has joined #kolla10:16
*** bigjools has quit IRC10:16
*** bigjools has joined #kolla10:16
*** tfukushi_ has joined #kolla10:19
*** tfukushima has quit IRC10:22
*** rhallisey has joined #kolla10:23
*** dims has joined #kolla10:34
*** achanda has joined #kolla10:36
*** achanda has quit IRC10:37
openstackgerritSam Yaple proposed openstack/kolla: Ironic binary shouldnt use upper-constraints  https://review.openstack.org/23793810:54
openstackgerritSam Yaple proposed openstack/kolla: Automate setting up a cache tier  https://review.openstack.org/23675611:06
openstackgerritSam Yaple proposed openstack/kolla: Allow specifying erasure as the pool type  https://review.openstack.org/23675411:06
openstackgerritSam Yaple proposed openstack/kolla: Allow ceph pool names to be configurable  https://review.openstack.org/23675511:06
*** tfukushi_ has quit IRC11:12
*** asalkeld_ has quit IRC11:32
*** dolpher has joined #kolla11:35
openstackgerritPaul Bourke proposed openstack/kolla: Add documentation around how to build behind a proxy  https://review.openstack.org/23759811:35
*** exploreshaifali has quit IRC11:38
*** daneyon has joined #kolla11:45
*** daneyon_ has joined #kolla11:52
sdakesamyaple you about11:53
sdakeSamYaple getting error trying to deploy with missing flag TASK: [common | Starting log_data container] **********************************11:53
sdakefailed: [localhost] => {"changes": ["{\"status\":\"Pulling repository docker.io/kollaglue/oraclelinux-binary-data\"}\r\n", "{\"errorDetail\":{\"message\":\"Error: image kollaglue/oraclelinux-binary-data:latest not found\"},\"error\":\"Error: image kollaglue/oraclelinux-binary-data:latest not found\"}\r\n"], "failed": true, "status": ""}11:53
sdake[sdake@bigiron ~]$ docker images | grep oraclelinux-binary-data11:54
sdakekollaglue/oraclelinux-binary-data                         latest              f201f6d909c2        11 minutes ago       189.6 MB11:54
pbourkesdake: I got that exact error yesterday!11:54
pbourkewtf11:54
pbourkedrove me insane11:54
sdakedid yo usole it?11:54
pbourkeno :(11:54
*** daneyon has quit IRC11:54
pbourkeended up having to spin up a registry11:55
pbourkeit makes no sense11:55
pbourkei wonder is it with ol only11:55
*** thumpba has joined #kolla11:55
*** dwalsh has joined #kolla12:03
*** vbel has quit IRC12:04
* sdake burns more electrcity rebuilding for the milliontih time12:04
*** vbel has joined #kolla12:04
sdakemorning vbel12:07
*** jmccarthy has quit IRC12:08
*** jmccarthy has joined #kolla12:08
*** openstackgerrit has quit IRC12:16
*** openstackgerrit has joined #kolla12:16
*** kproskurin has joined #kolla12:16
kproskurinHi guys, I trying to build docker images for Kolla using ./tools/build.py base --base ubuntu --type source12:18
sdakemorning12:18
sdakei''d recommend using a registry12:19
sdakehttp://docs.openstack.org/developer/kolla/deploy-all-in-one-node.html12:19
*** daneyon_ has quit IRC12:19
kproskurinand designate-base is broken with DEBUG:__main__:designate-base:RequirementParseError: Missing distribution spec /designate12:19
kproskurinoh12:19
sdakeyes we know designate is broken12:19
sdakeits a-ok since ansible deosn't deploy designate atm12:19
sdakeso the broken contianer isn't helpful anyway :)12:19
kproskurinOh ok. I actualy tried to build all in one, but it was broken on so many places so I start to go from a basics to the top12:20
sdakestable/liberty shoudl work like a champ12:21
sdakewe will be publishing docker hub images shortly12:21
kproskurinIs it going to release like… today?12:21
sdakei am taggin as soon as this tesst completes successfully12:21
sdakeso yes is the answer12:21
kproskurinGreat12:21
kproskurinSo I should wait a little bit and just use yours prebuilded images? (sorry Im really new in OpenStack and Kolla)12:22
sdakeyou can build your own using that link i showed you above12:22
sdakeit will be done faster then our push very likely12:22
kproskurinWell, that is what I tring to do right now. But building all was failed in like 20 images12:24
kproskurinacording to log12:24
sdakewhat is your geogrpahy?12:24
kproskurinRussia12:24
sdakei see - russia may have connectivity problems with the repos used to build kolla12:25
sdakewestern europe seems fine though12:25
sdakeso ymmv12:25
sdakeyou can use --retries 2012:26
sdaketo really keep trying over and over to get built images ;)12:26
sdakethe default is 312:26
*** daneyon has joined #kolla12:26
kproskurinWell maybe. I’ll try to rebuild all with log pointed to file, so I could check all errors. But there is a LOT of logs, so I though I could rebuild failed imges one by one, so I started with designate-base and you said it’s broken.12:27
sdakeignore designate12:28
kproskuringot it12:28
sdakeignore magnum12:28
sdakeignore gnocchi12:28
sdakeresst should build12:28
kproskurinok, thank you12:28
sdakesure no problem12:29
kproskurinBtw, why ubuntu dont have binary install? I mean, only sourse is awalible for it12:29
kproskurinNo liberty pkg for ubuntu yet?12:30
*** thumpba has quit IRC12:30
sdakeyou mean docker hub images?12:30
kproskurinyes12:30
sdakethere were some last minute regressions, so I waved off the tag and we decided to spend today fixing the problem12:30
sdakei am going to tag as I said within the hour hopefully12:31
sdakethen we will push to the hub12:31
kproskurinok, ty12:31
sdakepbourke     'mem_limit has been moved to host_config in API version 1.19'12:32
sdakeany idea?12:32
*** dolpher has quit IRC12:33
*** dolpher has joined #kolla12:34
sdakeapprently we need a pin on docker-py12:41
sdake1.2.3 works12:41
sdake1.3.1 does not12:41
*** thumpba has joined #kolla12:47
pbourkesdake: sounds like you're hitting more of the issues I did yesterday13:01
pbourkesince then I've nuked my machine and am rebuilding13:01
pbourkesdake: SamYaple reckoned ansible 1.9.4 solved the above problem but I got another issue with that (can't remember what it was off top of my head)13:04
sdakepbourke that oraclelinux patch can get a +2 workflow now please13:05
sdakeand then I'll tag the releae13:05
sdakei am pretty confident kolla works well13:06
sdakeI think the problems are with docker-py and doccker and ansible version interactions13:06
pbourkeyou need to take the workflow -2 off13:06
sdakepbourke also as reference, you absolutely need to be running with ntpd13:07
sdakeok ready to rock13:07
openstackgerritMerged openstack/kolla: Use openstack/requirements for repeatable builds  https://review.openstack.org/23794213:08
openstackgerritMerged openstack/kolla: Use openstack/requirements for keystone  https://review.openstack.org/23794313:10
openstackgerritMerged openstack/kolla: Use openstack/requirements for ceilometer  https://review.openstack.org/23794413:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for cinder  https://review.openstack.org/23794513:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for designate  https://review.openstack.org/23794613:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for glance  https://review.openstack.org/23794713:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for gnocchi  https://review.openstack.org/23794813:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for heat  https://review.openstack.org/23794913:11
openstackgerritMerged openstack/kolla: Use openstack/requirements for horizon  https://review.openstack.org/23795013:11
sdakegroan13:13
sdakei really didn't just want ot merge 40 fucking patches before tagging13:14
openstackgerritSteven Dake proposed openstack/kolla: Use openstack/requirements for ironic  https://review.openstack.org/23795113:18
openstackgerritMerged openstack/kolla: Pin Magnum in liberty branch  https://review.openstack.org/23796513:21
SamYapleim about13:24
SamYaplesdake:13:24
SamYapleahhh you guys merged all those patches13:25
SamYapleno no13:25
pbourketag from the ref before the merges13:26
pbourke?13:26
SamYaplethe upper-constraints one13:26
mandreuh? nothing on gerrit indicated we shouldn't merge those patches13:30
mandrehaven't checked #kolla before reviewing13:30
SamYapleits my fault mandre13:31
SamYaplei expected taging to happen first13:31
kproskuringuys, it’s seems to ironic-pxe image build is broken too. http://fpaste.org/281901/34254144/13:31
kproskurinJFYI13:31
openstackgerritMerged openstack/kolla: Ironic binary shouldnt use upper-constraints  https://review.openstack.org/23793813:32
openstackgerritSam Yaple proposed openstack/kolla: Fix oslo.log pinning  https://review.openstack.org/23807313:34
SamYaplesdake: ^^ that absolutely must merge13:34
SamYapleif not logging and neutron are foobar13:34
sdakeok guys13:34
sdakejesus please stop merging patche13:34
sdakes13:34
sdakei am going to do a full rebuild13:35
SamYapleyep13:35
sdakeno approvals on any patches13:35
sdakesam please tell me what you think needs to be done13:35
SamYapleexcept that one. its a requirement13:35
sdakebecaue I am beat13:35
sdakeand I hitt the wall about 6 hours ago13:35
SamYaplego to bed then. ill handle this13:35
sdakeno i got it13:35
SamYapleill check everything thats merged13:35
sdakei can build13:35
sdakeits easy13:35
sdakeok get it merged13:35
sdaketell me when done13:35
SamYaplebuilding isnt broken13:36
sdakeand i'll build13:36
SamYapleits launching13:36
sdakeok get the tree into a stable state and let me know when to pull the tag trigger13:36
sdakewe are doing it this morning please13:36
SamYapleyup13:36
SamYaplewill do13:36
sdakei just tested before al those patches went in and everything was working fantastically13:36
SamYaplei should have -2 until tag13:37
mandresdake, you can still tag the ref you tested13:37
sdakemandre i need patches after that ref13:37
sdakethey hadn't merged yet13:38
mandrethere is only the magnum pinning13:39
mandreand we're not deploying magnum with ansible13:40
mandreoh, ok i see13:40
sdakethe oracle patch13:40
sdakewas what iw as testing13:40
mandrethere is still https://review.openstack.org/#/c/237962/13:40
mandrestill hasn't merged13:40
sdaketook me 1.5 hours to test it because my computers are afu because i am in the middel ofa 10gb upgrade13:41
SamYaplemandre: yes that is why we cant tag13:41
SamYaplebut the constraints patch means the log patch must merge too13:41
sdakeright that is the only patch that was supposed to go in ;-)13:41
SamYapleother wise its all borked13:41
SamYaplei should have -2 the first patch in the series13:41
sdakeshit happens13:41
SamYaplei have upstream patches to fix the requirements repo13:41
SamYaplethey havent merged yet13:41
sdakelets get moving guys ;)13:41
sdakeits t-5 days late here13:41
sdakelets just let em merge and dfix the mess13:42
sdakethey are all one liners13:42
sdakeso it shouldn't be too bad13:42
mandreyou can wait a long time, zuul hasn't picked your patch13:42
SamYapleif someone else can ack this https://review.openstack.org/#/c/238073/ so its ready to merge once i finish testing13:42
sdakelooking13:42
sdakeoslo.log 1.12.1 is the one that is the non-busted one samyaple?13:43
SamYapleyes13:43
sdakecool patch looks good13:43
SamYapletechinicall 1.12.0 and up13:43
SamYaplebut the upstream patch is for 1.12.113:44
*** dims has quit IRC13:45
*** dims has joined #kolla13:46
sdakebrb checking overlowing inbox13:46
sdakeweek before summit = overload13:46
*** sdake_ has joined #kolla13:47
*** dolpher has quit IRC13:48
openstackgerritMerged openstack/kolla: Make Oracle Linux compatible with RDO  https://review.openstack.org/23796213:48
*** stvnoyes1 has joined #kolla13:49
*** dolpher has joined #kolla13:49
*** sdake has quit IRC13:51
SamYaplePSA: when deploying liberty update your /etc/kolla/kolla-build.conf13:54
SamYapleotherwise you pull in master13:54
*** nihilifer has quit IRC13:55
*** dwalsh has quit IRC13:55
*** sdake_ has quit IRC13:57
openstackgerritSam Yaple proposed openstack/kolla: Fix oslo.log pinning  https://review.openstack.org/23807313:57
*** sdake has joined #kolla13:58
SamYapleyou guys are all the best13:58
*** nihilifer has joined #kolla13:58
SamYaple+2 for all of you13:58
sdakeeh?13:59
SamYaple-1 for sdake13:59
sdake-5 for sdake13:59
SamYaple:P13:59
mandrejust noticed it :)13:59
sdakethats -5dake13:59
SamYaple-5daque14:00
SamYaplestupid tab complete14:00
sdakelol14:00
sdakeis all hat is left for tag is a retest?14:01
*** CBR09 has quit IRC14:01
SamYapleyes14:03
*** achanda has joined #kolla14:05
openstackgerritMerged openstack/kolla: Use openstack/requirements for ironic  https://review.openstack.org/23795114:06
*** achanda has quit IRC14:09
*** jongchoi has joined #kolla14:09
mandrebed is calling me. good night14:11
*** sdake has quit IRC14:12
*** daneyon has quit IRC14:12
*** daneyon has joined #kolla14:14
SamYaplethanks mandre  night14:14
*** dwalsh has joined #kolla14:14
*** kjelly_ has joined #kolla14:23
*** jongchoi has quit IRC14:28
*** vinkman has joined #kolla14:41
*** tfukushima has joined #kolla14:52
*** tfukushima has quit IRC14:52
*** diogogmt has joined #kolla15:12
*** blahRus has joined #kolla15:17
*** tfukushima has joined #kolla15:20
*** cloudnautique has quit IRC15:29
*** dims_ has joined #kolla15:31
*** dolpher has quit IRC15:32
*** dolpher has joined #kolla15:33
*** dims has quit IRC15:35
*** daneyon has quit IRC15:36
*** tummy has joined #kolla15:41
*** vbel has quit IRC15:48
SamYapleok guys another ack here please https://review.openstack.org/#/c/238073/ , then we should be able to tag once testing is complete15:50
*** gfidente is now known as gfidente|afk15:51
*** inc0 has joined #kolla15:57
inc0hello, do we have meeting tonight?15:57
SamYapleyes15:58
*** cloudnautique has joined #kolla16:00
*** cloudnautique has quit IRC16:00
*** cloudnautique has joined #kolla16:01
openstackgerritMerged openstack/kolla: Fix oslo.log pinning  https://review.openstack.org/23807316:04
SamYaplewell that was a whole bunch of last minute merging16:05
*** exploreshaifali has joined #kolla16:05
docaedoyay for moving fast :)16:06
docaedoThis error (was trying to do all-in-one) probably means I'm missing a pre-req or something in my environment right?16:07
docaedo# tools/kolla-ansible -i ansible/inventory/all-in-one -p ansible/site.yml deploy16:07
docaedoDeploying Playbook : ansible-playbook -i ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml ansible/site.yml16:07
docaedoERROR: merge_configs is not a legal parameter in an Ansible task or handler16:07
docaedoCommand failed ansible-playbook -i ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml ansible/site.yml16:07
*** kjelly_ has quit IRC16:10
*** inc0 has quit IRC16:12
pbourkeansible 1.9.4?16:12
*** inc0 has joined #kolla16:13
docaedopbourke: yep, that's my problem for sure here .. I started from a clean Ubuntu 14 VM and was following the steps in docs which didn't specify a particular version of ansible, so just did apt-get install and hvae v1.5.416:15
pbourkedocaedo: try installing from pip. sorry I think there's a patch up to doc the versions better16:15
SamYapledocaedo: merge_configs is a module i created for kolla16:16
bmacei think usually doing something like a pip install -r requirements.txt and then test-requirements.txt should get in a decent place, or at least that is the intent of those files :)16:16
SamYaplebut you need ansible >=1.9.316:16
SamYapleansible is not in requirements.txt for licencing reasons i think16:17
docaedowill get ansible via pip - it's not in rquirements ;)16:17
SamYapleeither way newer ansible and youll be good16:17
bmaceoh?  that is sort of odd / too bad.  it is certainly a main dependency :/16:17
SamYaplebmace: ansible is gplv3 so its a no go for openstack requirements.txt16:17
SamYaplei dont make the rule16:18
pbourkethat is odd16:18
SamYaplei barely follow them16:18
SamYapletalk to sdake16:18
*** dolpher has quit IRC16:19
*** tummy has quit IRC16:25
*** jmccarthy has quit IRC16:25
pbourkeSamYaple: dont suppose you ever encountered this on ubuntu?16:25
pbourke$ docker logs rabbitmq16:25
pbourkeERROR: epmd error for host myhost: address (cannot connect to host/port)16:25
*** tummy has joined #kolla16:26
SamYapleyea16:26
SamYaplesomething something erlang cnat bind to an address16:26
SamYaplewhich version of rabbitmq?16:26
pbourkeold one on oraclelinux, 3.4.1-1.0.1.el616:27
*** achanda has joined #kolla16:28
pbourkefirst time ive seen this though16:28
SamYapleim pretty sure we made >=3.5.4 a requirement....16:28
SamYaplelet me check if that was just master16:28
SamYaplepbourke: https://github.com/openstack/kolla/commit/4527bb8074e65fa5e6d74559e0534799cd63266616:29
SamYapleyea we pinneded to 3.5.5 for centos in liberty16:29
SamYapleare you sure you dont have that?16:29
pbourkeyeah I remember that one16:29
pbourkeactually I have on master too using the latest pkg. must be something with my host16:31
*** jasonsb has quit IRC16:32
nihiliferdo we have meeting now?16:32
pbourkesame question16:33
SamYapleyes16:35
*** dims_ has quit IRC16:36
SamYaplewe are suppose to at least16:36
*** dims has joined #kolla16:36
SamYapleGive sdake a few minutes and then I suppose well cancel16:36
SamYaplenot seeing anyone eles around either16:37
inc0yeah, not too much of us16:37
bmacerhallisey is sometimes a sub but i don't think sdake gave the agenda to anyone else, that i know of.16:37
inc0I guess because we'll see each other in less than a week16:37
*** cloudnautique has quit IRC16:37
SamYaplehavent heard from rhallisey this morning16:37
SamYapleyou around ryan?16:37
*** exploreshaifali has quit IRC16:38
*** CBR09 has joined #kolla16:39
rhalliseySamYaple, hey16:39
SamYaplehey man16:39
rhalliseyI didn't hear from sdake16:39
SamYapledidd sdake get you to sub todays meeting?16:39
SamYapleok16:39
SamYapleits cool we can cancel it16:39
*** athomas has quit IRC16:39
rhalliseyI don't know what we can go over tbh16:40
rhalliseydid we cut liberty16:40
SamYapleactually let me check the agenda16:40
SamYaplenope16:40
inc0sdake popped an email on openstack-dev suggesting that we did16:40
SamYapleinc0: i am well aware16:40
SamYapleive been irratated at him for the past week for these reasons :P16:40
rhalliseyhehe16:40
SamYapleall patches have landed that i know of16:41
SamYapleall branches are working as far as i know16:41
rhalliseyI don't have anything to announce/discuss so unless anyone else does we can just cancel16:41
SamYapleif you want to help do some testing against head of liberty16:41
SamYaplewhen sdake gets up well tag16:41
rhalliseybmace, did you have something you wanted to bring up16:41
bmacerhallisey: i think sdake was going to talk about the cli, but that can probably wait for tokyo16:42
inc0well guys, going off then16:43
rhalliseysounds good16:43
rhalliseyinc0, night16:43
SamYaplenight inc016:43
bmacenite inc016:43
inc0cya all in few days16:44
rhalliseyanyone getting to tokyo early?16:44
SamYapleill be there sunday morning i believe16:44
SamYaplelet me check16:44
*** inc0 has quit IRC16:44
rhalliseyI arrive Sat night16:44
*** jmccarthy has joined #kolla16:44
rhalliseygoing to try and get on the time16:44
pbourkesun morning also16:45
SamYaplei arrive 10:35PM 25OCT16:45
SamYaplewhich is.... Sun16:45
SamYapleso ill be there sun night16:46
rhalliseyI'm trying to wake up at like 5am every morning to start time zone adjustment16:46
SamYapleeveryone staying Shinagawa Prince?16:46
rhalliseyit's a struggle16:46
SamYapletell me about it rhallisey. im switching 3rd shift to first shift..... to third shift again :/16:47
rhalliseyoh jeeze16:47
SamYaplei said screw it ill sleep when im tired and drink when im not16:47
rhalliseyI'm also at shinagawa prince16:47
rhalliseyhehe16:47
docaedoSamYaple: that works best in my experience16:47
pbourkeare we sticking to irc for comms over there?16:48
SamYapleidk16:48
SamYapleyou guys have my number right?16:48
rhalliseynot sure16:49
pbourkenope but I'll only have data for the week I think16:49
pbourkeapparently you can get data only sims16:49
SamYaplepbourke: google chat group then?16:49
pbourkeyeah that works well16:49
SamYapleirc notifications, not everyone can get them to thier phone16:49
pbourkeyeah irc not so mobile friendly16:50
pbourkenoone use whatsapp?16:50
pbourkeis it more of a european thing16:50
SamYaplei dont like capitalist companies that sell out pbourke16:51
pbourkeSamYaple: fyi had to remove the 127.0.0.1 line from my /etc/hosts ...16:51
pbourkegoogle's not?16:51
rhalliseyI was going to use gchat16:51
SamYaplethat sounds familiar pbourke. something about resolving the wrong ip16:52
SamYaplealright well you guys can reach my gchat at sam@yaple.net16:52
rhalliseycool16:52
SamYapleif someone wants to setup a hangout group ahead of time that probably be safest16:53
pbourketrying to figure out how to do that now16:53
rhalliseywe can get an etherpad put our gmail accounts16:53
rhalliseyhttps://etherpad.openstack.org/p/summit-gchat16:55
SamYaplei wonder if i will blend in there...16:56
rhalliseyi'll make a group if when we grab a few more16:58
SamYapleoh yea i need to get cash and yen16:59
pbourkepicturing sdake passed out on his keyboard...16:59
SamYaplethats a wierd thing to be picturing17:03
bmacelol17:05
*** jmccarthy has quit IRC17:10
rhalliseylol17:11
*** jmccarthy has joined #kolla17:17
*** jmccarthy has quit IRC17:21
*** kfox1111 has quit IRC17:25
*** kfox1111 has joined #kolla17:26
*** jasonsb has joined #kolla17:28
*** unicell has joined #kolla17:31
*** CBR09 has quit IRC17:40
*** exploreshaifali has joined #kolla17:40
*** exploreshaifali has quit IRC17:53
*** kproskurin has quit IRC17:54
*** daneyon has joined #kolla17:57
*** tummy has quit IRC17:57
*** tfukushima has quit IRC17:59
*** shardy is now known as shardy_afk18:02
*** tfukushima has joined #kolla18:03
*** dims has quit IRC18:03
*** dims has joined #kolla18:04
*** tfukushima has quit IRC18:07
*** tummy has joined #kolla18:19
*** tummy has quit IRC18:20
*** exploreshaifali has joined #kolla18:31
*** thumpba has quit IRC18:34
*** tfukushima has joined #kolla19:04
*** jasonsb has quit IRC19:04
*** tfukushima has quit IRC19:09
*** jasonsb has joined #kolla19:11
*** daneyon has quit IRC19:14
*** achanda has quit IRC19:16
*** gfidente|afk has quit IRC19:20
*** tummy has joined #kolla19:26
*** tummy has quit IRC19:28
*** shardy_afk is now known as shardy19:32
*** thumpba has joined #kolla19:35
*** apmelton has quit IRC19:37
*** thumpba has quit IRC19:41
*** openstackstatus has joined #kolla20:06
*** ChanServ sets mode: +v openstackstatus20:06
*** tummy has joined #kolla20:10
*** tummy has quit IRC20:15
*** achanda has joined #kolla20:16
*** tummy has joined #kolla20:16
*** tummy has quit IRC20:17
*** dims has quit IRC20:18
*** cloudnautique has joined #kolla20:18
*** dims has joined #kolla20:18
*** achanda has quit IRC20:22
*** tummy has joined #kolla20:23
*** tummy has quit IRC20:23
*** tummy has joined #kolla20:27
*** tummy has quit IRC20:28
*** tummy has joined #kolla20:33
*** sdake has joined #kolla20:35
sdakehi20:35
sdakeSamYaple is kolla ready for tag?20:35
sdakesorry fell asleep20:35
*** sdake_ has joined #kolla20:36
sdake_bmace about?20:40
*** sdake has quit IRC20:40
bmacehey sdake :)20:41
*** achanda has joined #kolla20:42
*** sdake_ is now known as sdake20:44
*** achanda has quit IRC20:46
*** cloudnau_ has joined #kolla20:50
*** cloudnautique has quit IRC20:53
*** shardy has quit IRC20:54
*** achanda has joined #kolla20:57
*** dwalsh has quit IRC20:58
*** sdake has quit IRC20:58
*** sdake has joined #kolla20:59
docaedoQuestion about building and deploying locally - I ran build, it worked and pushed everything (except for ironic-px) up to my registry21:00
*** tpot has joined #kolla21:00
docaedobut when I run the all in one example, it is looking for images tagged 1.0.0-liberty .. do I change openstack_release in the group_vars/all.yml file? Or would I need to tag all those images or something?21:01
*** cloudnau_ has quit IRC21:04
*** tfukushima has joined #kolla21:05
*** cloudnautique has joined #kolla21:09
*** tummy has quit IRC21:10
*** achanda has quit IRC21:10
*** jongchoi_ has joined #kolla21:11
docaedochanging openstack_release to latest makes the magic start to happen :)21:24
sdakeya you have to do that atm21:34
sdakechange globals.yaml21:34
sdakethere is a releae tag in there21:34
docaedosdake: got it, thanks21:35
docaedoSo close!21:36
docaedoTASK: [common | Starting log_data container] **********************************21:36
docaedofailed: [localhost] => {"failed": true, "parsed": false}21:36
docaedo[...]21:36
docaedoKeyError: 'ExposedPorts'21:36
docaedo(that happens every time, multiple tries)21:37
vinkmanThat is a docker 1.8.3 thing,21:40
*** tpot has quit IRC21:40
vinkmanSam Yaple has created a patch which we picked up for our Ansible RPM, you can apply the patch by hand to your deployment node to get around that though…21:42
docaedowheee!  so fun having all kinds of little version mismatches (just today I got bit by novaclient==2.32.0)21:42
docaedopatch would be nice, can you point me to it? Might be easier than downgrading docker to a previous version21:43
bmaceperhaps slightly better than downloading the rpms by hand from rpmfind like we did 15 years ago, but not much :/21:43
docaedo(oh I'm doing this on ubuntu, but that probably doesn't matter for the patch)21:44
sdakedocaedo we are hard pinned to docker 1.8.2 unfortuatenlly21:47
sdakedocker 1.8.3 had a api change in a stable branch21:47
sdakewhich broke everything that depended on the api21:47
docaedoah ok, that's too bad about that breakage.  that's what we get for working in opensource ;)21:48
sdakedocaedo if your on an rpm system, you cn find the rpms location by looking at etcyum.repos.d/docker-engine.repo21:48
sdakein that directory is a http url and docker 1.8.2 is located there21:48
sdakeyou also need ansible 1.9.421:48
docaedoI'm not on RPM, I have never been able to make myself like the OS's that use the RPMs, I stick with debs whenever possible21:49
vinkmanPatch info: https://github.com/ansible/ansible-modules-core/pull/2258/commits21:49
docaedobut this should be easier enough to sort out I think21:49
docaedooh yeah just patching those two lines in docker should get me back in shape21:50
*** unicell1 has joined #kolla22:01
*** jongchoi_ has quit IRC22:02
*** unicell has quit IRC22:02
*** jongchoi_ has joined #kolla22:06
*** thumpba has joined #kolla22:07
*** cloudnautique has quit IRC22:09
*** cloudnautique has joined #kolla22:09
*** jongchoi_ has quit IRC22:10
sdake1.0.0-liberty is tagged22:13
sdakeenjoy22:13
docaedonice work!22:13
docaedoclose again :)  Is this a common issue?  (So far all the things I've hit, you guys have known immediately what to do, keeping my fingers crossed)22:19
docaedoTASK: [common | Starting log_data container] **********************************22:19
docaedofailed: [localhost] => {"changed": false, "failed": true}22:19
docaedomsg: Docker API Error: image ID '' is invalid22:19
*** sdake_ has joined #kolla22:22
sdake_docaedo are you deploying with pull_policy: missing22:23
*** dolpher has joined #kolla22:23
sdake_fwiw i haven't seen that error before22:23
docaedoquite possibly am deploying that way22:23
docaedoI'll try setting to "always"22:24
*** sdake has quit IRC22:24
*** diogogmt has quit IRC22:24
docaedook that didn't help :)22:25
* sdake_ looks down the barrell of a 45k amex bill22:30
* sdake_ groans22:30
sdake_boy my wife can shop!22:31
vinkmanwow… did she buy a car on her credit card…22:32
sdake_H&B22:36
sdake_docaedo i have noticed kolla doesn't seem to work without a private registry when i tried the last couple of days22:36
sdake_i think a regression in one of the upstream ansible modules22:36
*** jasonsb has quit IRC22:37
sdake_nothing to do with kolla specifically22:37
docaedoI do have a private registry though, and built everything first. all success except for ironic-px (or something close to that)22:37
sdake_wht build command did you use22:37
*** thumpba has quit IRC22:38
docaedopython tools/build.py --registry 192.168.123.42:5000 --base ubuntu --type source --push22:38
sdake_i did succesfullly deplooy centos and oracle linux this morning22:38
docaedothen trying to deploy with22:38
docaedotools/kolla-ansible -i ansible/inventory/all-in-one -p ansible/site.yml deploy22:38
sdake_run your registry on port 400022:39
docaedoguess I could change the base to centos just for playing around22:39
sdake_i think keystone nd your registry aregetting mixed up22:39
docaedoregistry is on a different server though22:39
sdake_paste your globals.yml file plz22:39
sdake_are you running docker iwth --insecure-registery 192.168.168.123.42;5000?22:40
docaedoyes, running docker with that22:40
docaedokolla_base_distro: "ubuntu"22:40
docaedokolla_install_type: "source"22:40
docaedokolla_internal_address: "192.168.122.200"22:40
docaedodocker_registry: "192.168.123.42:5000"22:41
docaedodocker_pull_policy: "always"22:41
docaedonetwork_interface: "eth0"22:41
docaedoneutron_external_interface: "eth1"22:41
docaedoopenstack_release: "latest"22:41
docaedo(globals.yml)22:41
sdake_set the true to false22:41
sdake_the secure registry option22:41
sdake_200 is an unused address in your network correct?22:41
docaedounused address, correct22:42
*** thumpba_ has joined #kolla22:42
*** jasonsb has joined #kolla22:42
docaedoyou mean set this? docker_insecure_registry: "True"22:43
sdake_docker-py version?22:43
sdake_pip show docker-py22:43
sdake_yes set that to true22:43
docaedoVersion: 1.5.022:43
sdake_tools/cleanup-containers -fv22:44
sdake_kolla-ansible deploy22:44
*** thumpba_ has quit IRC22:44
sdake_leae all the other options off22:44
docaedogot it22:44
docaedoexact same error :/22:45
docaedoTASK: [common | Starting log_data container] **********************************22:45
docaedofailed: [localhost] => {"changed": false, "failed": true}22:45
docaedomsg: Docker API Error: image ID '' is invalid22:45
sdake_ps -ef | grep docker22:46
docaedoroot       801     1  0 15:15 ?        00:00:02 /usr/bin/docker daemon --insecure-registry 192.168.123.42:500022:47
sdake_kernel version is livid ?22:48
*** thumpba has joined #kolla22:48
sdake_are you using btrfs?22:50
sdake_my best guess is your docke registry version is busted22:50
docaedoubuntu 14.04 Trusty ..22:50
sdake_oh well you need to run the correct kernel22:51
sdake_14.04 doesn't work out of the box22:51
docaedoah got it - "apt-get install linux-image-generic-lts-vivid" would be the instruction to follow here22:52
sdake_yup thats the one22:53
sdake_without that, your built images wlil be busted22:53
sdake_you will probably unfortunately have to rebuild22:53
*** tpot has joined #kolla22:53
docaedoah ok cool - will re-build the images now, no biggie22:54
docaedonice thing to kick off and check back on later :)22:54
docaedoappreciate your help too, I know you have a lot on your plate pre-summit and all ;)22:54
docaedolooking forward to saying hi in Tokyo22:55
*** thumpba has quit IRC22:55
*** thumpba has joined #kolla22:58
*** thumpba has quit IRC23:04
*** diogogmt has joined #kolla23:06
sdake_agree docaedo23:11
*** diogogmt has quit IRC23:12
*** mfalatic has quit IRC23:22
*** dims_ has joined #kolla23:29
*** dims__ has joined #kolla23:31
*** dims has quit IRC23:31
*** sdake_ has quit IRC23:33
*** dims_ has quit IRC23:34
*** exploreshaifali has quit IRC23:38

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!