Tuesday, 2015-06-16

*** diogogmt has quit IRC00:04
*** diogogmt has joined #kolla00:07
*** jasonsb has joined #kolla00:16
sdakepbourke awake ?00:21
*** bmace has quit IRC00:21
*** bmace has joined #kolla00:23
sdakebmace around?00:23
lothsdake: need to be reviewer to vote?00:24
bmacemaybe ;)00:24
sdakenope anyone can vote loth00:24
sdakeneed to have signed the cla i think tho00:24
sdakehttps://review.openstack.org/#/c/189157/00:24
sdakebmace plz review :)00:24
bmaceyeah, i have been looking at it00:24
bmacelooking good so far00:24
sdakepretty different from v1.0 huh :)00:25
bmacea bit00:25
bmaceas long as all I find is typos I'll be giving it a +1 :)00:26
sdakei type fast with lots of mistakes :)00:27
bmacei type at medium speed, with a lot of mistakes00:27
sdakehaha00:27
sdake110wpm or so here00:27
sdakeless when writing code00:27
sdakebut that is my copy speed00:28
bmaceever play typing of the dead?  nothing like using your typing powers to kill zombies!00:28
sdakesoudns interesting :00:28
sdake)00:28
loththat game's amazing00:28
bmaceamazing is a good term for it :)00:29
lothwill really teach you proper punctuation and symbols if you turn the difficulty up00:29
lothalso http://play.typeracer.com/00:29
sdakei dont even know what i type it just comes out00:29
sdakei think a word and out it appears00:29
bmacei use a mechanical keyboard.. i end up typing very very loudly I think.  nothing like being charged by the undead to make you pound that keyboard.00:30
loth100 ansible tasks seems a bit low if its doing everything00:30
sdakeloth possible samyaple gave the quote based on yaodu00:30
sdakejust to show it snot a billion tasks :)00:30
sdakebut something decomposable and solveable00:30
sdakeits not00:31
lothin my rough bare-metal ansible deployment that covers everything i have 250~00:31
bmacei think it lays out 7 tasks / role, so as the number of containers grow the tasks will grow, but nothing huge per container at least.00:31
lothof course the containers will take care of a lot of those tasks00:31
sdakethe difference between 100 and 250 isn't significnat imo00:32
sdake100 tasks in ansible is pretty small00:32
sdakeand its mostly cut and paste00:32
bmacewhich is sort of a shame.  maybe harder to do reuse in ansible tasks vs. real code00:33
*** dims has quit IRC00:33
bmacedone00:35
bmaceship it ;)00:35
sdakeall we need to do is clone samyaple a few times00:35
sdakeand we are good togo00:35
lothone thing i can see needing is a kolla requirements doc for what OS we support deploying on and what network configurations should already be setup00:37
bmaceclone him and wait about 20 years, or you are talking about transporter malfunction type cloning?  lets just hope we don't end up with evil SamYaples.. with beards.00:37
sdakeagree our docs need some love00:39
sdakebmace evil samyaple - I think we already got one of those :)00:40
sdakesamyaple I jest :)00:40
lothas an operator i like the 'keystone.aug' function since often times deployment methods dont give you the options needed for your targted use case00:46
*** dims has joined #kolla00:46
bmacelol00:47
*** jtriley has quit IRC00:49
lothsdake: I see '/etc/kolla/keystone.aug' mentioned and also '/opt/kolla/configs' are we storing configs in two locations?00:50
sdake /opt/kolla/configs are on the host00:50
sdake /etc/kolla/keystone.aug is on the deployment system00:51
sdakeloth make sense?00:57
loth(ansible location) /etc/kolla/keystone.aug -> (docker host)  /opt/kolla/configs/keystone.conf -> (container) /etc/keystone.conf ?00:59
sdakeroger01:00
sdakeactually it gets merged with the default01:00
sdakeat the ocker host01:00
*** Slower has quit IRC01:00
sdakeat the docker host01:00
lothsdake: I'd like to see a koll-ansible status command, to see which containers are operational or need work01:01
sdake /etc/keystone/keystone.conf01:01
sdakepleae leave comments in the review01:01
sdakejust click a line and type away01:01
sdakethen click save01:01
sdakethen you ahve  to review +1 or -101:01
sdakereview -1 if action is needed on my part01:01
sdakeif you dont click the review button your comments are not saved01:02
lothsdake: add edits here? https://review.openstack.org/#/c/189157/5/specs/ansible-multi.rst01:03
sdakeloth yes01:05
*** bmace has quit IRC01:06
*** Slower has joined #kolla01:07
sdakeslower u around01:07
*** fangfenghua has joined #kolla01:08
sdakefangfenghua around?01:08
* sdake harasses everyone 1:1 :)01:08
*** fangfenghua has quit IRC01:13
lothsdake: replie01:14
lothd01:14
sdakethanks loth01:16
sdakefirst review?01:16
lothi think in that system01:17
sdakecool grats then!  welcome to openstack ;)01:17
sdakeif you want to review more stuff we take more reviews :)01:17
*** bmace has joined #kolla01:18
sdakethe ha spec could use a review as wel01:18
sdakehttps://review.openstack.org/#/c/181983/01:18
*** Haomeng has joined #kolla01:19
*** tobe has joined #kolla01:19
*** Haomeng|2 has quit IRC01:19
loththat svg just outputs raw into my browser heh01:20
*** erkules has joined #kolla01:21
*** erkules_ has quit IRC01:23
lothsdake: missing mongo/ceilometer mentions in https://review.openstack.org/#/c/181983/5/specs/high-availability.rst are there plans to support that or no?01:23
sdakeya you can ignore tht01:23
sdakewe don't currently implement ceilometer01:24
*** jtriley has joined #kolla01:24
sdakelooking for someone to tackle that01:24
sdakewe have a mongodb container not sure on its status01:24
sdakehttps://blueprints.launchpad.net/kolla/+spec/ceilometer-container01:25
lothunfortunetly ceilometer is a pretty big requirement for a lot of users :(01:25
sdakeno assignee01:25
sdakethere is nothign unfortunate about it01:25
sdakeits schedueld for liberty01:26
sdakeand priority high01:26
sdakei suspect will be tackled in l2 or l301:26
sdakeccrouch has a public github with a fork of it partially working01:26
sdakewhen i said you can ignore that above, i was referring to xvg, not ceilometer01:29
sdakesvg that is01:30
sdakeloth if you want to review code ,you can add kolla to your watched projects list in gerrit01:31
sdakewill help you learn the codebase and structure of the project01:32
sdakeand the openstack workflow01:32
sdakeping me if you need help figuring that out ;)01:32
jasonsbsdake: did you decide on mid-cycle meetup days yet?01:32
sdakeits not particuarly obvious01:32
sdakejasonb 17th is deadline for voting01:32
jasonsbah ok01:33
sdakethen i need a couple days turnaround with  facilities01:34
sdakejasonb settling the date is right at the top of my list :)01:34
jasonsbsdake: no problem at all01:34
jasonsbif we are going to help kolla we need to ramp up regardless of meetup01:35
sdakecsco's facilities people need 3 weeks turnaround01:35
sdakeerr lead time i mean01:35
jasonsbbut its tantalizingly close01:35
jasonsbwe would like to do some source installs and work out a way to do upgrades01:35
jasonsband contribute as much as we can along the way01:35
sdakecool there are a few folks working on from source01:36
jasonsbeven without upgrades its still good stuff01:36
sdakedo you have a preferred container os01:36
jasonsbubuntu at the moment01:36
jasonsbi wasn't sure what you thought of that01:36
sdakeok well that is a good place to start01:36
sdakefedora, ol, centos are only container oses implemented at the moment01:36
jasonsband i was also curious to talk to you more about dockering the big tent01:36
jasonsbwrt to fedora01:37
sdakesure what would you like to know01:37
*** zhiwei has joined #kolla01:37
jasonsbto be honest, as we ramp up, we will track closer to head than the distros can01:37
jasonsbso a combination of distro + source is probalby where we will end up01:37
sdakewe would absolutely take a container os implementaton for ubuntu01:37
jasonsbexcellent01:38
sdakeand from source absolutely take that01:38
jasonsbexcellent01:38
jasonsbi was sort of thinging kolla was the way to package big tent01:38
jasonsbbecause we need to ramp up testing01:39
sdakeya we have our roots in rdo but open to source packaging01:39
jasonsbwhat was the reasoning for rdo?01:39
jasonsbbroadest distro ?01:39
sdakei'd prefer to only package things IN the big tent though01:39
sdakeopen source freely available packaging seemed easy early team were all rpm experts from rht01:39
jasonsboh sure makes sense01:40
sdakeso for example i'd prefer not to package stackforge projects01:40
sdakeor containerize them for example01:40
sdakebut we haven't set that boundry in any team meetings01:40
jasonsbhmmmmm01:41
jasonsbthis will be interesting01:41
jasonsbthis is good place for tc + testing to step in and give some guidance01:41
jasonsbyou aluded to this in vancouver01:41
sdakeif you look at our launchpad it is filled with openstack git namespaced projects that are un-containerized01:41
sdakeby tc you mean technical committee?01:41
jasonsbyes01:42
sdakei dont think we really need much guidance there01:42
sdakecould you expand on your thoughts?01:42
sdakeprojects define their own mission not the tc :)01:42
jasonsbi was thinking tc could set tags for things which kolla would containerize01:42
jasonsb(distro-worthy)01:42
sdakeour mission is here https://wiki.openstack.org/wiki/Kolla01:43
jasonsboh, your right, projects do define01:43
jasonsbi was hoping once something was deemed worthy of containerizing, qa would measure it01:43
jasonsbi'm using qa term loosely01:44
jasonsbfull disclosure, i'm in tailgate, which wants to find an answer for qa in big-tent01:44
sdakewhat is tailgate01:44
jasonsbhttps://etherpad.openstack.org/p/openstack-tailgaters01:45
sdakedon't be offended i don't know - too many names01:45
jasonsbnot offended at all01:45
jasonsbwe got together on friday of vancouver01:45
jasonsbto try to find answers for qa in big-tent01:45
jasonsbits also partially a matter of qa going on inside companies (redhat + canonical + rackspace + cisco, etc)01:46
jasonsbwhich didn't have a community, and hence alot of duplicated effort01:46
jasonsbi like the idea of combining kolla and thomas goirand's packing-as-upstream along with some kind of qa-in-big-tent01:47
jasonsbits ambitious but the idea is appealing i think01:47
sdakeanyone can edit our meeting agenda, suggest introducing your effort to the team at our next team meeting01:49
jasonsbi would love to01:49
sdakei think its too early for us to tackle QA as an objective though01:49
jasonsblets give tailgate little bit more time01:49
jasonsbi would like to have actionable things01:49
jasonsband we are just starting down that road01:49
jasonsbbut i sure appreciate your support01:50
*** dims has quit IRC01:50
jasonsbin any case, we will participate in irc and weeklies01:51
jasonsband see what we can do which aligns with your bp's01:51
sdakecool we are going through a fairly large change in architecture around ansible deployment atm01:52
sdakeso things are going to change01:52
sdakelooks like this version will make it through the guantlet :)01:53
sdakehttps://review.openstack.org/#/c/189157/01:53
jasonsbgood stuff01:54
jasonsbi hope we can help in effort01:54
sdakecool welcome aboard :)01:55
jasonsbmight take some translation in our installer01:55
jasonsbbut if we can move over to this model that would be great01:55
jasonsbthank you sir, sure appreciate01:55
sdakeenjoy01:56
jasonsbthe trick will be to find a way to align ourselves with kolla so we can contribute short-term01:57
sdakeyou mean the qa part01:57
jasonsbi think we can01:57
sdakei dont have any easy answers there ,we have a pretty full plate for l2 and l301:57
jasonsbmore on the ansible+source+ubuntu peices01:57
sdakethat would be of emmense help01:58
jasonsbideally we can make our installer for our product kolla compatible01:58
jasonsbwe have to ramp up on your bp's more01:58
sdakeor just use kolla as an upgtream :)01:58
jasonsbexactly01:59
jasonsbwe have to make a few adjustments to get everything to line up01:59
jasonsbbut then we can just work on kolla which would be awesome01:59
sdakeif you need help seeing an example ol from source container try pinging bmace02:00
sdakefeeding time i'm off02:02
jasonsboh nice, i'll do that02:04
*** alisonholloway has quit IRC02:08
bmacei think pbourke had a review up or already committed the code for the ol from source base container.02:20
*** fangfenghua has joined #kolla02:25
*** alisonholloway has joined #kolla02:30
*** fangfenghua has quit IRC02:30
*** bradjones has quit IRC02:35
*** bradjones has joined #kolla02:35
*** bradjones has joined #kolla02:35
*** juggler has quit IRC02:39
*** alisonholloway has quit IRC02:50
*** jtriley has quit IRC02:50
*** jtriley has joined #kolla03:20
*** tobe has quit IRC03:20
*** tobe has joined #kolla03:23
*** vinkman has quit IRC03:32
*** sdake has quit IRC03:32
*** Haomeng|2 has joined #kolla03:37
*** Haomeng has quit IRC03:40
*** jtriley has quit IRC03:44
*** nihilifer has joined #kolla03:46
*** dims has joined #kolla03:46
*** dims has quit IRC03:51
*** fangfenghua has joined #kolla03:55
*** nihilifer has quit IRC03:56
*** alisonholloway has joined #kolla04:07
SamYaplewow lots of stuff here04:08
SamYapleanyone want to summarize the days conversation for me?04:08
SamYaplei saw a "new containers dont need to support selfconfiguration"04:08
SamYaplethat interests me, be cause i could drop in ceph in a heartbeat04:08
*** sdake has joined #kolla04:17
sdakemandre awake ?04:22
SamYaplehey sdake, did yo usee my question above?04:23
sdakeno sir04:23
sdakefire away again plz04:23
SamYaple04:08 < SamYaple> wow lots of stuff here04:23
SamYaple04:08 < SamYaple> anyone want to summarize the days conversation for me?04:23
SamYaple04:08 < SamYaple> i saw a "new containers dont need to support selfconfiguration"04:23
SamYaple04:09 < SamYaple> that interests me, be cause i could drop in ceph in a heartbeat04:23
sdakewho said containers dont need to support self config04:23
sdakedid you read the spec04:24
SamYaplei think you? hold on lots of scroll back04:24
sdake*new* containers04:24
SamYaplei said new...04:24
sdakeoh04:24
SamYaplelol04:24
sdakejust woke up04:24
sdakefrom a nap04:24
SamYapleyoure cool04:24
sdakeslack plz :)04:24
sdakeplz review spec04:25
sdakei'd like it merged asap04:25
sdakeand want to fix errors or problems04:25
SamYapleanyway, if *_-new-_* containers dont need self config i could drop ceph in like BAM04:25
SamYaplesdake: im ocmmenting on it now04:25
sdakemandre not around?04:25
SamYaplei dunno04:25
sdakesamyaple what do you think of this status idea loth had04:36
SamYapleis loth tyler wilson?04:36
sdakeyup04:36
SamYapleim responding to it now04:37
SamYaplebut the status is in the wrong location04:37
SamYaplekolla-ansible is a wrapper04:37
SamYapleit doesnt _do_ things04:37
SamYapleit calls things04:37
SamYapleI dont want to have a tool that can't be consumed by native ansible04:37
sdakewell your the expert04:37
SamYapleim ok with ansible tasks to pull status info though, which could then be wrapped by kolla-ansible04:38
sdakei saw it and it hit my -ETOOHARD bucket04:38
sdakeconsidering we have about 5 weeks to work with04:38
SamYapleyea it should go on the todo list04:38
SamYaplei dont htink it will be hard04:38
SamYaplebut it shouldnt hold up the spec04:38
sdakewe can file a wishlist bug for it04:38
sdakeif the review hits the repo04:38
sdakeor a low priority blueprint04:39
*** jtriley has joined #kolla04:41
lothSamYaple: thats what I meant for it to call, sorry if that wasnt clear04:41
sdakeboy tis hot here04:41
sdake100f at night04:41
sdakerediculous04:41
lothI dont expect the shell script to do anything except interact with our deployment method04:41
sdaketime to get out the outdoor cooler04:42
SamYapleloth: no problem, i just wanted to make it clear. Your suggestion should probably be above. I do like the idea alot, but i think its a feature and not a requirement to hold up the spec04:42
SamYapleim a big fan of on call status checks04:42
sdakeya spec is minimum set of things needed to get us rolling04:42
lothas a real-world use of the project, there is no way im running a blind kolla upgrade without knowing things first :)04:43
SamYapleloth: agreed04:44
sdakedidn't say we wouldn't do it04:44
sdakespecs are guidelines to get people on the same page about implementation04:44
sdakeso it doesn't hae to be communicated 10 different times to 10 different people04:44
sdakeand we dont end up with dueling implementations :)04:44
sdakebut thank you for your contribution - it is valued :)04:45
SamYaplei think the spec will also undergo slight changes in the coming weeks04:46
SamYapleissues we cant anticipate04:46
SamYaplethe general idea will stay the same though04:46
sdakeguideline04:46
SamYaple^^04:46
sdakeno need to update teh spec imo :)04:46
*** jtriley has quit IRC04:46
SamYapleif its a major change?04:46
sdakeread containerize-openstack.rst04:46
sdaketell me if what we have today is anything like that spec reads :)04:46
SamYaplefair enough. but old info should be remove04:47
sdakei guess if someone wants to update it to the current state that wfm04:47
sdakei dont have time for that :)04:47
*** tobe has quit IRC04:47
sdakeas in - its not a priority for me, but for someone else it maybe ;)04:48
SamYaplesdake: reviewed. only one major thing that was a concern to me04:49
sdaketaking a look04:49
sdakesamyaple instead of writing an essay about why my shell script is bad, could you suggest an alternative wording :)04:53
sdakeTIA :)04:53
sdakeor check out the review and make changes as you like04:54
sdakethe second would be preferred ;)04:54
SamYaplefine04:54
SamYaplebe that way04:54
sdakewhich way?04:54
SamYaplemaking me do work04:54
sdakebeen expense reporting days around here, my whole day has been grumpy04:55
sdake5 hours of beating oracle into submission is not fun04:55
sdakeone more reason not to travel!04:55
sdakeadd yourself as a coauthor while yoru at it since its mostly your ideas :)04:56
sdakeare the work items accurate04:56
sdakei'll leave a few comments i noticed as errors too04:57
sdakeok put my comments in ;)05:00
sdakei'd actually do the job myself but i need to ptfo05:01
sdakeand i don't want to hold things up longer05:01
*** tobe has joined #kolla05:07
*** nihilifer has joined #kolla05:26
*** gfidente has joined #kolla05:36
*** gfidente has joined #kolla05:36
*** tobe has quit IRC05:37
openstackgerritSam Yaple proposed stackforge/kolla: Ansible multi-node specification  https://review.openstack.org/18915705:46
*** tobe has joined #kolla06:02
*** shadower has quit IRC06:06
*** shadower has joined #kolla06:06
*** Haomeng|2 is now known as Haomeng06:08
*** alisonholloway has quit IRC06:12
*** sdake has quit IRC06:14
*** inc0 has joined #kolla06:16
inc0good morning06:16
nihilifero/06:17
*** dasm|afk is now known as dasm06:21
SamYaplehey guys06:22
*** fangfenghua has quit IRC06:28
*** bmace has quit IRC06:35
*** bmace has joined #kolla06:47
SamYapleeveryone review the multinode spec? lets get this merged in06:53
digaSamYaple: Hi06:54
digagood spec idea06:55
SamYaplesdake did the heavy lifting, i just did the latest revision07:06
SamYaplediga: any thoughts?07:06
digaYes, I am going through the spec now07:06
SamYapleoh boy....07:07
SamYaple;)07:07
diga:)07:07
inc0I haven't seen new version yet07:09
SamYaplehttps://review.openstack.org/18915707:09
inc0thank you SamYaple07:09
*** mstachow has quit IRC07:09
openstackgerritSam Yaple proposed stackforge/kolla: Ansible multi-node specification  https://review.openstack.org/18915707:10
SamYapledont freak out guys, just removed whitespace07:10
inc0getting your ATC the hard way I see?07:11
inc0;)07:11
SamYapleeh ivs had ATC07:11
SamYapleive*07:11
SamYapleno ATC for stackforge anyway07:11
inc0ahh, damn it07:13
*** zhiwei has quit IRC07:13
SamYaplelike i said inc0, docs are a core project07:13
SamYaplecontribute to them, its quick and easy07:14
inc0well, I have heat for that, so I don't worry too much07:14
inc0I've already got several patches in07:14
SamYapleyea but the docs suck sometimes ;)07:14
inc0heat too, sometimes, but don't tell anyone;)07:15
inc0on the other hand, there is nova...07:15
*** akwasnie_ has joined #kolla07:15
*** Haomeng|2 has joined #kolla07:15
*** shardy_ has joined #kolla07:15
*** shardy has quit IRC07:16
inc0about spec, we haven't yet decided which way will be default07:17
SamYapleitll be a wont07:17
SamYaplevote*07:17
SamYapleduring the mettings, sdake put it on the agenda07:18
inc0on meeting?07:18
inc0kk07:18
SamYapledont let it hold up the spec07:18
inc0I'll try to attend, but that's kinda hard for me...1am07:18
SamYapleits basically 1am for me too, i work 3rd07:18
*** Haomeng has quit IRC07:18
inc0I think I'll just tell sdake my feelings before since I already know what I want:)07:19
*** shardy_ has quit IRC07:21
*** shardy has joined #kolla07:21
SamYaplesmae07:21
*** fangfenghua has joined #kolla07:23
*** Haomeng|2 is now known as Haomeng07:24
*** bradjones has quit IRC07:30
*** bradjones has joined #kolla07:36
*** bradjones has joined #kolla07:36
*** mickt has joined #kolla07:38
*** tobe has quit IRC07:40
jmccarthymorning07:46
*** tobe has joined #kolla07:47
digaSamYaple: see this - http://paste.openstack.org/show/294841/07:49
digaI am installing kolla where my openstack is already setup07:49
SamYaplemorning jmccarthy07:49
SamYaplefangfenghua: you around?07:49
digaGetting this error07:49
diganow able to pull all the images07:50
SamYaplediga: yea keystone cli is deprecated07:50
SamYapleits been that way for a while07:50
SamYapleopenstack is the new cli07:50
digaSamYaple: okay07:50
digado I need to download it manually07:51
SamYaplepython-keystoneclient will sitll be used for imports (but the cli portiion is no longer being developed)07:51
digabut I never got this error before07:51
SamYapleim pretty sure this needs a patch to resolve07:51
SamYaplelet me check hte code07:51
SamYaplediga: it is probably a package update07:52
*** shardy_ has joined #kolla07:52
digaokay07:52
digaits issue only related to keystone CLI, right ?07:52
*** shardy has quit IRC07:53
digaSamYaple: then CLI portion should be removed here, otherwise it will give error everytime07:54
SamYaplecorrect07:55
*** shardy_ has quit IRC07:57
*** shardy has joined #kolla07:58
*** shardy has quit IRC07:58
*** shardy has joined #kolla08:01
digaSamYaple:08:02
digaSamYaple: Heyy08:02
digamy setup is ready now, now heading with Ansible multinode08:02
*** tobe has quit IRC08:06
*** jmccarthy has quit IRC08:13
*** tobe has joined #kolla08:16
*** jmccarthy has joined #kolla08:18
inc0SamYaple, akwasnie_ and me were just having a discussion about installation from source08:22
inc0do you have a moment to discuss this topic?08:22
SamYaplemaybe...08:23
inc0thing is, we want for people to choose which way they want to deploy it right? source or packages08:24
SamYaplekinda08:24
inc0but we can't make this kind of decision while container build, because there is no openstack.env there08:24
akwasnie_hi08:25
inc0and we don't want to pull sources from github on deploy, because that would be...suboptimal08:25
SamYapleright so the source build structure is only for people wanting to deploy from source08:25
SamYaplekolla wont build any images for it08:25
SamYaplekolla will only build "official" binary images08:25
SamYaplebut source built containres should be able to be deployed the same way08:25
inc0well, that might also be hard if we'd want to use tripleo. TripleO wants sources, and I kinda agree08:26
inc0especially if we consider multi-os08:26
SamYapleso triple-o can build there own containers?08:26
SamYaplewe dont build the containers with the deploy tools08:26
inc0I guess at some point they will08:26
SamYaplewe dont deploy from source at runtime either08:27
inc0yeah, but we're kinda coupled with os package repos08:27
inc0and that might bite us08:27
SamYaplei would be ok with a kolla "official" from source container, but that isnt going to be configurable08:27
SamYapleitll be tags or master08:28
inc0so we'd ditch yum based builds alltogether...which I'd like, but that would be hell lot of work08:28
SamYapleno08:28
SamYaplewe can support all as automated builds08:28
SamYaplecentos-binary-base08:29
SamYapleubuntu-source-base08:29
SamYapleubuntu-binary-base08:29
SamYaplethats are uniquie images08:29
inc0yeah, but Dockerfiles of services would need that kind of info08:29
SamYaplewhy08:29
inc0because there is RUN yum install ...08:29
inc0ofc we can have keystone-binary and keystone-source containers08:30
inc0but that would double number of containers08:30
inc0if we add multihost, it goes exponential08:30
*** mstachow has joined #kolla08:30
SamYaplei dont think you are understanding the structure08:31
SamYaplethe dockerfiles are unique08:31
SamYaplealways08:31
SamYaplethe only thing binary/source share are some scripts08:31
SamYaplescripts dont install packages08:31
SamYaplemultihost wont require different containers (that defeats the purpose)08:32
inc0multi-os, my mistake08:32
SamYapleso for each "{distro}-{type}-" iteration would be unquie containers yes08:32
inc0yeah, that's what I'm referring to08:32
inc0we want to add new base OS, we have to make bunch of new containers08:33
SamYapleyea os I imagine that we will only hard support Ubuntu and Centos binary and maybe source08:33
SamYaplethe rest may break08:33
inc0and I mean a lot if we consider big tent08:33
SamYaplethats the only way to go about it though08:33
SamYapleand its a good way too in my opinion08:33
inc0there is always some possible magic in ./build08:33
SamYaplethats a bad idea in my opinion08:34
SamYapleits not nearly as flexible and very confusing08:34
mstachowgood morning :)08:34
SamYaplemorning mstachow08:34
* mstachow exited because of FF VII !08:34
SamYaplemstachow: wait whats this news?08:35
inc0yeah, I guess that would be hard. but I don't like idea of shitloads of containers as well08:35
SamYapleinc0: the containers/Dockerfiles are the easy part08:35
inc0but scripts may differ as well08:35
mstachowSamYaple Mariadb 10 is working fine. I've got broken network configuration.08:35
inc0in terms of file locations and so on08:35
SamYaplei looked into this inc0, the files would be only slightly different in _some_ cases, not the majority08:36
SamYaplethat can be fixed with a simple if then08:36
SamYaplebecause we are calling the binary directly, the distro built init scripts arent used08:36
SamYapleso way less differences08:36
*** erkules has quit IRC08:36
*** erkules has joined #kolla08:36
openstackgerritMichal Stachowski proposed stackforge/kolla: Galera container  https://review.openstack.org/18722508:37
inc0making default of source installations might give us some additional flexibility08:37
SamYapleinc0: with the stable release naming thread going on upstream, that may be what we do08:37
SamYaplebut we dont have source containers so it wont be the default for liberty that can be almost gauranteed08:38
mickthi guys, a quick Q: I've just done dev-quickstart and the *-data containers show Exited -08:51
micktecdc53f6eb5a        kollaglue/centos-rdo-mariadb-data:latest        "/bin/bash"            9 minutes ago       Exited (0) 9 minutes ago08:51
*** zhiwei has joined #kolla08:52
micktea3869bc8283        kollaglue/centos-rdo-nova-compute-data:latest   "/bin/true"            45 minutes ago      Exited (0) 45 minutes ago                           compose_computedata_108:52
micktNo logs for these that I can find and "docker-compose logs ecdc53f6eb5a" returns the following:08:52
micktCan't find a suitable configuration file. Are you in the right directory?08:52
micktSupported filenames: docker-compose.yml, docker-compose.yaml, fig.yml, fig.yaml08:52
mickt Anyone hit this and know how to resolve?08:52
*** zhiwei has left #kolla08:53
SamYaplemstachow: that is functioning as designed08:53
SamYapleits a "data" container, its just to reserve the space08:53
SamYaplei will be turning that into a "sleep" command later so the containers stay active08:53
SamYaplemickt: ^^08:54
pbourkemickt: also you need to specify a yml file to compose08:55
pbourkee.g. docker-compose -f compose/maria.yml logs08:55
micktcheers to both09:02
inc0duh. you made me sad person SamYaple09:09
inc0but I have a gut feeling that source install can be done right somehow09:09
inc0maybe dynamic Dockerfile generation?09:09
SamYapleinc0: i like generated things, but will that really be more effiecent?09:11
SamYapleand my word isnt law inc0 ;)09:11
inc0well what I essentialy mean, community likes to add things. Look, we're merging oraclelinux now, and its good!09:12
inc0and at some point I suspect we'll have shitloads of more or less supported base images09:12
SamYapledefine supported09:12
SamYaplei imagine there will be a regression test in the future and i bet we only support centos/ubuntu for regression and major tests09:13
inc0you can pull our repo and set up working openstack at any point09:13
inc0what I essentially mean, there will be shitloads of base distros because each corpo has their own favorite distro and ops will push to have their own favorite distro09:14
nihiliferthe problem in having many base images will be responsibility for supporting concrete containers in some distros09:14
inc0and if we force adding new distros with *every* single container together...even reviewing this thing will be huge pain09:14
nihiliferwill we require making images for centos, ubuntu, oracle for every new contributor?09:14
SamYaplehow else would you propose to do it?09:15
inc0nihilifer, that's exactly what I'm reffering to09:15
SamYaplecode generation will be the same amount of work, just more complicated09:15
inc0well, puppet did that by providing an abstraction layer of sort09:15
SamYaplesure. but this is layers and complication09:15
SamYapleit is still the same amount of work, just more inaccessible09:16
inc0less than shitloads of containers imho09:16
nihilifermaking generated Dockerfiles will be hard, but will not break stuff with responsibility09:16
nihiliferand will not make some distros less supported09:16
SamYaplehaving seperate containers will gaurantee things wont break09:16
inc0with each new image you'll expose its API, like "install_package"09:17
inc0I disagree09:17
inc0we make container upgrade09:17
inc0and some base OS won't like it09:17
inc0by the time you make all OS happy, new upgrade will be rolling out09:17
SamYaplewhat you guys are proposing is alot of overhead. if you want to write the code and make a spec I am cool with that. I dont see it being simpilier or more useable, but I would love to see it09:18
inc0I'm not saying its the way to go09:18
nihiliferseparate Dockerfiles are simplier IMO only now09:18
*** dims has joined #kolla09:18
inc0but I don't think having exponential number of dockerfiles is the way as well09:18
nihiliferimagine creating new containers for i.e. suse after i.e. year09:19
nihiliferwhen kolla will be much more complex09:19
inc0I guess that's good thing to discuss broadly and find best way early on09:19
SamYapleoh you must be under the impression that to build a new container you must support all distros09:19
SamYaplethat is not the case09:19
inc0rhel probably will be rolling soon, even tho it might be similar to centos09:19
inc0ubuntu/debian09:19
inc0but you must support distros this container is already supporting09:20
inc0essentially what I mean is to somehow decopule support of service containers from support of base distros09:20
SamYapleas I said, "support" is relative. I see ubuntu/centos being first class citizens, the rest would not be09:21
inc0so you have to fix a bug only once09:21
SamYaplea bug that only exist in one distro is far more likely09:21
inc0yes, but we'll have lots of these too09:21
inc0essentially, we'll be fighting with dependencies a lot09:22
inc0ask ceilometer how they manage notifications...its just one type of message, but it happends every service has their own schema and it changes09:22
SamYaplewhat do you propose09:22
inc0and it's still around openstack09:22
inc0I need to think. I'll come back with something later on09:23
SamYaplesure09:23
inc0that's non-trivial at best09:23
*** dims has quit IRC09:23
SamYaplefor the record, dockerfile should be really simple for what we are doing. scripts too. I dont see there being much overhead at all09:24
inc0well, it should, but even file locations will be pain09:25
inc0and all the small differences09:25
SamYaplelike what09:25
SamYapleif we are calling the binary, we are calling the configs in most cases too09:25
SamYaplethe differences are really minimal09:25
inc0I'm not saying they are big, I'm saying there will be lot of them09:26
SamYaplethere are no config differences between ubuntu and centos, I verified by comparing kolla to yaodu09:26
SamYapleal lthe binaries are the same, al lthe configs are too09:26
inc0package naming might slightly differ09:26
inc0versions09:26
inc0in repo09:26
SamYaplehence seperate dockerfiles09:26
inc0yeah, but for example you want to deploy nova compute09:27
inc0and new feature comes with libvirt xxx09:27
inc0and as it happends this version is default in 50% of distros09:27
inc0and ok, we might not use this feature, but that's suboptimal09:28
SamYaplethis scenario makes no sense09:28
SamYapleuse it or dont is a config option the user has control over at time of deploy09:28
inc0allright, different PATH might bite us in scripts09:29
SamYaplethats why i call /usr/bin/env09:29
inc0I mean, it all will be solvable09:30
inc0even easily solvable09:30
inc0and maybe its just a matter of creation list of howtos of script writing09:30
inc0and small tools to make stuff easyier09:30
SamYapleno the scripts are across all containers. that wouldnt add overhead from the many dockerfiles09:30
inc0python is for that, because it has several os-compatible abstractions in stdlib09:31
SamYaplethose changes would be need anyway09:31
inc0let's pay this topic a bit more thought09:33
inc0and revisit it later with more people09:33
inc0maybe create a spec like multihost09:34
SamYaplethat would be the way to go09:34
*** tobe has quit IRC09:46
*** tobe has joined #kolla09:56
*** vbel has quit IRC10:39
*** vbel has joined #kolla10:40
*** tobe has quit IRC10:50
*** tobe has joined #kolla10:51
*** tobe has quit IRC10:56
*** rhallisey has joined #kolla11:14
openstackgerritMichal Jastrzebski (inc0) proposed stackforge/kolla: Keepalived container  https://review.openstack.org/18798111:15
*** ChanServ sets mode: +o rhallisey11:15
rhalliseymorning11:15
inc0hello rhallisey11:16
mstachowo/ rhallisey11:17
jmccarthyo/11:20
*** dims has joined #kolla11:20
rhalliseyhey!11:22
*** dims has quit IRC11:25
SamYaplehey rhallisey11:25
SamYaplenew spec is out. please review11:26
SamYapleneed ot get it merged11:26
inc0we need to look how to decouple tripleo's config generation from different logic11:26
inc0like package installation11:26
SamYapleinc0: can you elaborate on that?11:27
inc0SamYaple, yesterday we had a talk with slagle, and we agreed that crudini won't be long term solution for tripleo as well (Steven included that into spec)11:27
SamYaplei read some of that, yes11:28
inc0tripleo will want to place config outside container, which is cool11:28
SamYapleawesome11:28
inc0but we need to check out puppet scripts if we can limit then to *just* create config11:28
inc0not do any other installations, app running and so on11:28
SamYaplewhich scripts?11:28
inc0that would be container role11:29
*** dims has joined #kolla11:29
inc0that's one thing I need to find out, I don't know tripleo flow well enough to point you to exact place and problems11:29
SamYapleso something to keep in mind. ansible is able to track when something tchanged and trigger a task. if you are making config changes external, ansible will not know it needs to restart the container11:29
inc0maybe there won't be any at all11:29
rhalliseyinc0, I'm also still investigating this11:29
rhalliseyI'm not sure if I like the plan yet11:29
inc0of crudini removal?11:30
inc0you were one who wanted to push full configs into container in the first place;)11:30
rhalliseycorrect I think that's a good feature, but it needs to be used correctly11:30
inc0agree on that, I think best way would be for tripleo to just create config11:31
rhalliseyone of the advantages to having containers is they can come with config build in11:31
inc0and let heat deploy container11:31
inc0why is that an advantage?11:31
SamYaplerhallisey: how will that work for multiple nodes though?11:31
slaglei didn't exactly say crudiini wouldn't be the long term solution for tripleo11:31
rhalliseyremoves some complication11:32
inc0immutability you mean?11:32
slaglemerely that i don't know that we've picked the long term solution11:32
SamYapleconfig built in just doesnt work large scale11:32
rhalliseybut, I know that might not be possible if you want to customize your setup11:32
inc0well, we kinda agree that crudini doesn't seem like the way to go - no big decissions yet11:33
rhalliseyinc0, when I came up with the idea to push in config the goal was to try and stockpile containers that can be consumed11:33
rhalliseytry and hit 95% of the use cases11:33
inc0but you can't really do that upstream11:34
inc0addresses may differ11:34
inc0if anything11:34
rhalliseyya so there will be a few things that will change across all containers11:34
rhalliseycrudini can finish that off11:34
SamYaplerhallisey: you back from pto?11:35
rhalliseySamYaple, ya11:35
SamYaplecool11:35
inc0essentially what I'm saying, I don't want to be responsible for configs, that's a swamp that can pull you in11:35
SamYapleinc0: agreed11:35
SamYaplei just spent an hour going over the new "bare minimum options" needed to run kilo11:35
inc0TripeO did fine job sorting this thing out, lots of hours went to this config generation11:35
SamYapleand thats after i had a template for juno11:35
SamYaplelots of things changed11:35
inc0I'd be keen to take laverage on this11:36
rhalliseyinc0, I do agree to, but I'm not saying kolla generates all these.  That's what the config files are for11:36
rhalliseybut kolla hosts those containers11:36
rhalliseyin its namespace11:36
inc0but, as you deploy base system, for example by ironic11:36
inc0that's not too big of an overhead to include one additional folder with configs11:36
inc0and containers on deploy will consume this11:36
inc0and we will provide runtime without configs.11:37
inc0that's basic idea I guess11:37
inc0what do you think?11:38
SamYaple+111:38
rhalliseythe way I envisioned kolla to be a 'central hub' of containers11:38
rhalliseywe provide the basic and you built the more advanced11:38
rhalliseybut we host them11:38
inc0problem is, installators are hard. Bacause of all these little decisions11:39
inc0I'd rather let someone else do them. Or kinda-exsternal-to-kolla Ansible11:39
inc0instead of providing container to deploy, we'll provide container, you provide config, and deploy that11:40
inc0kinda like with stack and environment in heat11:40
inc0template and environment*11:40
rhalliseyit wasn't 100% what I had in mind originally, but I understand your point11:41
SamYaplehas anyone suggested using kubernetes?11:42
inc0ew...11:42
SamYapleim kidding, dont hurt me11:42
inc0well I was going to play with tectonic+kolla11:42
rhalliseyI don't think it has all the support we need11:42
rhalliseykube that is11:43
rhalliseybrb11:43
SamYaplerhallisey: interestingly, the "we provide runtime, you provide configs" doesn't break kubernetes or something like coreos fleet11:43
SamYaplei like that11:43
inc0it's kinda elegant approach in my opinion...and leaves us a lot of space to "wash our hands"11:45
inc0let ops do configs, we'll never be better at this than people who hand tailored these for last few years11:46
rhalliseymy proposal is similar in that we don't have to be responsible for all containers.  I just want to encourage people to share them and to avoid a sometimes scary config setup11:48
rhalliseywhenever possible11:48
inc0we can still do that - we'll have ansible module11:49
inc0and people can commit to ansible part, and this will generate configs11:49
rhalliseybut the difference is what we encourage people to use as their primary use case of kolla11:49
rhalliseydo we encourage them to just make their own config or pull form our stash to see if some work for you and if not build your own11:50
inc0for me it's like11:50
inc0hey, you want to try this out? use ansible, it will do this with one command11:50
inc0you want to really deploy it? We get that configs are detailed enough for you to play with, here they are11:51
inc0put them on git, make gerrit over them11:51
SamYaplehey you see random configs from an article that you think fixes your problem and you want to try them out? copy/paste them11:51
SamYaplei like that part anyway11:52
rhalliseyI do too that's why I want this method11:52
rhalliseythe way were telling people to use it is slightly different11:53
SamYaplehow so?11:53
rhalliseybut it's find.  It's just my opinion11:53
rhalliseyI want them to pull containers with config instead of building it11:54
inc0I think we can get good marketing around that11:54
inc0it will boil down to how our initial howtos in docs will look like11:54
SamYaplerhallisey: oh sure11:54
rhalliseyI guess it's pretty similar11:54
rhalliseyI don't know11:55
rhalliseyinc0, yes exactly11:55
inc0that's something we need to think about, agree11:55
inc0after that, people will know how that tool works anyway, so they can make their own educated decisions11:55
SamYaplethe initial ansible deploy can be one command with no config changes (except for the host inventory)11:56
SamYaplei have all the barebones templates prepared11:56
inc0with good tutorial of kolla+ansible, I think its achievable to make initial deploy easy enough11:56
*** jtriley has joined #kolla11:56
*** athomas has quit IRC11:56
inc0so we can keep ease of use and config decoupled11:56
inc0anyway, lunch time for me, bbl11:57
*** inc0 is now known as inc0|afk11:58
*** fangfenghua has quit IRC11:58
*** jtriley has quit IRC12:01
*** athomas has joined #kolla12:05
*** dwalsh has joined #kolla12:18
*** dwalsh has quit IRC12:36
*** diogogmt has quit IRC12:54
*** nihilifer has quit IRC13:00
*** dwalsh has joined #kolla13:14
*** Haomeng|2 has joined #kolla13:16
*** inc0|afk is now known as inc013:19
*** Haomeng has quit IRC13:19
*** dasm is now known as dasm|afk13:20
*** jtriley has joined #kolla13:31
*** sdake has joined #kolla13:32
*** sdake has quit IRC13:32
*** sdake has joined #kolla13:33
inc0hi sdake, mind if I start bugging you from very morning?13:34
sdakemorning13:34
sdakeinc0 give me 5 minutes for my eyes to warm up13:35
inc0counting13:35
inc0;)13:35
sdakeinc0 did you review the ansible-multi spec13:35
sdakeif not go do that13:35
inc0yes, +1 from me13:35
sdakecool13:35
inc0also, if I couldn't attend to todays meeting (hours are horrible for me..) I want to cast my vote on default config option13:36
inc0and that's 3rd - bind-copyalways13:36
openstackgerritMichal Stachowski proposed stackforge/kolla: Galera container  https://review.openstack.org/18722513:39
sdaketoday is tuesday13:39
sdakewe have meetings on wednesday13:39
inc0or even thursday in my case;)13:40
inc0yeah, my mistake13:40
sdakemandre awake still?13:45
mandrehi sdake, I'm here now13:47
sdakeok inc0 shoot13:49
*** nihilifer_ has joined #kolla13:49
inc0soo, along with akwasnie_ and mstachow today we brainstormed around installing from source13:49
inc0because there is a problem - we want to install everything on container build13:50
sdakeagree, how is that a problem13:50
inc0and at the same time we can't really parametrize build13:51
sdakewe have unique docker files for everythhing13:51
inc0yeah, and that's that...we'll have expontential number of Dockerfiles13:51
sdakeexponential is wrong word :)13:51
inc0number of base os * 2 (source|binary) * number of services13:51
sdakeright13:52
inc0so basically there will be number of services ** (2*number of os)13:52
sdakeok13:52
sdakedockerfiles are easy to write13:52
sdakeits the start.sh that takes all the time13:52
*** gfidente is now known as gfidente|afk13:52
inc0that's also may slightly differ13:53
pbourkeinc0: if the start.sh differ slightly we can use if/else cases13:53
inc0our idea is to have docker file with placeholer like ENV %%deploy_from_source%%13:53
inc0and if we call ./build --source our build script will add this env to dockerfile13:54
inc0and then we call RUN install.sh13:54
inc0and inside install.sh there will be logic to install from source or from packages depending on this env13:54
inc0since installation from source will be somewhat similar on every os13:54
inc0we could even try to decouple it alltogether13:55
inc0pbourke, we'll have lots of if/elses;)13:56
inc0but that's problem of multios, which isn't trivial itself13:56
sdakei disagree ont he lots of conditions required13:56
sdakelets tackle one problem at a time shallw e :)13:56
sdakewhich is the dockerfiles13:56
sdakeI haven't used ENV before let me read the docs13:56
inc0it just adds environment val13:57
inc0and it's there even for container build afaik13:57
nihilifer_doing RUN install.sh has one big disadvantage - we lose caching commands by Docker13:58
sdakeinc0 are you suggesting build at runtime?13:58
inc0nihilifer_, but we can't use if in dockerfile as well13:58
inc0no, I'm suggesting build it once with or without this variable13:58
inc0and while building, logic will slightly differ depends on this env value13:59
nihilifer_I see also another problem with such parametrized Dockerfile. how we will build it as prebuilt container in registry?14:00
sdakeRUN install.sh is runtime building14:00
sdakewe don't want to do runtime buiding14:00
sdakethat slows down things considerably14:00
mandresdake: i'm about to take off, anything you wanted?14:00
sdakemandre sec i sent you private mesages but apparently to wrong person14:01
SamYaplenihilifer_: losing the command caching history of docker is not a concern in my opinion14:02
nihilifer_inc0: to sum it up, I agree that we shoudn't have as many wxplicitly written Dockerfiles as currently. but I also think we should find another solution that making RUN something.sh with strong env dependencies14:02
nihilifer_explicitly*14:02
SamYaplefor the record, I like the  "number of base os * 2 (source|binary) * number of services" for Dockerfiles, it will not duplicate scripts14:03
inc0I'd guess most of Dockerfiles will actually be copypasta with little differences14:04
SamYapleinc0: i think you are wrong14:04
SamYaplemost of them will be uniqie to distros14:04
inc0as I said, installation from source on ubuntu won't be THAT different from one on centos14:04
SamYapleright, for the openstack sources14:04
SamYapleand we can talk about that for sure14:04
SamYaplewe may be able to keep _those_ files the same14:04
sdakewe should follow the same model openstack or not for all dockerfiles14:05
inc0I don't think we'll install other stuff from sources tho?14:05
SamYaplesdake: fair point. i do not feel as strongly, but i wont fight that point14:05
SamYapleinc0: the mariadb container will not be from source. niether will the pass. or the dependencies. or rabbitmq14:05
sdakeso i udnerstand the concern14:05
sdakelets take a real world example14:05
sdakeol, centos, fedora, rhel, ubuntu, debian14:06
sdakethat is 6 distros14:06
openstackgerritMichal Stachowski proposed stackforge/kolla: Galera container  https://review.openstack.org/18722514:06
sdakeand we have about 30-40 containers14:06
SamYaplecentos/fedora/rhel count as one due to symlink'd Dockerfiles (except for the base)14:06
*** nihilifer_ is now known as nihilifer14:07
*** kevsi has joined #kolla14:07
inc0SamYaple, that will create symlink spaghetti in many cases :/14:07
SamYapleinc0: i dont like symlink spaghetti either14:07
SamYaplebut i like it better than generated dockerfiles14:07
inc0and 99% may not be different...but there will always be 1%14:08
sdakemy calculator is not working14:08
SamYapleinc0: you have very valid points. And I want to rework the build system. But I dont think it will happen before liberty with the massive amount of multinode we need done14:08
sdakewhat is 6^4014:08
*** dwalsh has quit IRC14:08
SamYapleuhhh alot14:08
*** diogogmt has joined #kolla14:09
SamYaple1.33674945388437 * 103114:09
sdakethat is the # of docker files we are talking about?14:09
SamYaple1.33674945388437 * 10^3114:09
inc0:D14:09
SamYapleno it is not14:09
rhalliseylo14:09
rhalliseylol14:09
sdakelets get a handle on how many docker files we are talking about14:09
SamYaple6*4014:09
sdakecan someone put a real # on it plaz14:09
sdakemy brain doesn't operate at 7am14:09
inc01336749453884373406783884597657614:10
*** diogogmt has quit IRC14:10
sdakeso 240 dockerfiels?14:10
SamYaplesdake: correct14:10
sdakeok, well that is a pita but manageable14:10
SamYaplebut i disagree with the numbers for various reasons14:10
sdakejust thinking worst case14:11
sdakeif we had to maintain 300 docker fies, coudl we do it14:11
sdakethe answer is yes14:11
inc0thing I'm more afraid will be cost of applying new services14:11
SamYapleI think we should have a matrix of "supported" distros, Ubuntu/Centos would be first clase citizens for example14:11
sdakeif we had to maintain 300 start.sh could we do it14:11
sdakenot sure14:11
inc0because testing every new container on every supported os will be high14:11
sdakei think we want to be careful about throwing around the word support14:11
sdakesupport is something downstream do14:12
SamYapleif we require a new container to be implemented across all distros, this will never work14:12
inc0so we'll end up with containers that only support subset of these...pretty random at the end14:12
sdakewe will "maintain" :)14:12
SamYaplenot if we treat ubuntu and centos as "maintained"14:12
SamYapleyea14:12
SamYapleso ubuntu/centos require these containers, the rest are wishlist/best effort14:13
sdakethere isn't even ubuntu code i nthe code base atm14:13
inc0but then we shouldn't agree on any other distro in core...maybe something like contrib14:13
SamYaplei know, but you get teh point14:13
mandrei'm off good night14:13
mandrezZZ14:13
SamYaplenight mandre14:13
sdakewe have a strong contigent from oracle who has an interestin ol14:13
inc0gn mandre14:13
sdakethink ol should be first class as well, assuming the oracle cats intend to maintaint hem14:13
inc0I'm pretty sure RH people would like to see rhel there as well14:13
sdakenight mandre thanks14:14
SamYaplefair enough, but these are distinctions we can make to keep the number of maintained dockerfiles ot a minimum14:14
rhalliseymandre, see ya14:14
inc0however similar that would be to centos, it will be rhel...14:14
sdakeinc0 we can't support rhel as first class becuase we cna't ibuidl the containers without licenses14:14
sdakeunless the rht contigent commit to doing that work14:15
sdakei actually have a site license, but I cant share it :)14:15
inc0another idea, one SamYaple didn't like ;) how about making sort of puppet-like cross-os APIs?14:15
inc0so by definition of base container you implemnt things like install_package14:16
sdakei think the general rule we should make is that any group that commits to maintaining a various distro - we maintain14:16
inc0and in dockerfile we'll replace %%install_package%% python-pip to apt-get install python-pip14:16
sdakethe group that is closest to the upstream implements it, we a a team maintain it14:16
sdakenew implementations can lead with centos14:17
sdakeor from source some other distro of choice14:17
pbourkesdake: I think that's reasonable14:17
sdakeif the maintainers fall away, perhaps maintenance for the distro drops away as well14:17
inc0so we'll have just centos binary and later keep pushing source install to a point it will be only maintained way?14:17
sdakeno i want rdo maintenance14:18
inc0at the end we'll have centos-binary, centos-source, ubuntu-source, rhel-source14:18
inc0and 2 docker files - centos binary and source?14:18
inc0per container?14:18
sdakeinc0 we ballparked that at 300 dockerfiles14:18
sdakedockerfiles take 5 minutes to write14:19
inc0what does "ballparked" mean?;)14:19
*** dwalsh has joined #kolla14:19
sdake"in the neighboorhood of"14:19
sdake"around"14:19
sdakesorry for my slang14:19
inc0thank you14:20
inc0no worries, I'm learning happily, just forgive me if I pop questions like that14:20
sdakeits a-ok14:20
sdakei try to teach new people lots of things :)14:20
sdakeits part of my charm :)14:20
SamYaple"charm"14:20
sdakerather teach peopel lots of new things14:20
sdakehmm that came out wrong ;)14:21
sdakeso from source, i'd like to lead there with centos as well14:21
sdakeits neutral ground as far as i'm concerned14:22
SamYaplebut my  yaodu ubuntu-source is already done....14:22
SamYaple;)14:22
inc0I think if we keep our guard high, we can keep source pretty universal14:22
sdakesamyaple should be an easy port ;)14:22
sdakei mean for new containers14:22
SamYapleinc0: for the final step. but lots of the containers have packge installs right as you would need to do the source install14:22
sdakeso the model is new work goes into cnetos-source and centos-rdo (if available)14:23
SamYapleso you would have yet another container layer to keep the all the same Dockerfiles14:23
SamYaplethe contaents should be similiar, but it wont be identical14:23
inc0how about message like that: source and centos-binary is a must, other is as-needed-basis?14:23
sdakeinc0 i recognize what you propose (generate dockerfiles) but *really* think it is the wrong way to go14:23
sdakeinc0 i wasn't finished lead with centos binary and source14:23
sdakeand the other distro related interesets can fill in tthe blanks14:24
sdakeit hsould be mostly c&p14:24
inc0I'm not emotionally bound to "generated Dockerfiles". Just trying to not get into lots of dependencies for new containers14:24
sdakeand we can gate the build for each distro seprately per source/binary14:24
sdakethis is somethign we should probably vote on as a community14:25
sdakei'll add to agenda for weekly meeting14:25
inc0let's first pop up spec and then gather ideas14:25
sdakei dont want specs14:25
inc0why? maybe someone will come out with better solution14:26
sdakethe general guideline for a spec is "if its going to create a bunch of discussion, lets do it in a spec"14:26
inc0?14:26
sdakeinc0 spec introduces alot of overhead and slows the project down14:26
sdakejust htis ansible-multi spec takes two weeks to go from first draft to approval14:26
sdakein that case it was necesary14:26
sdakein this case it is not14:26
sdakedaneyon wrote teh ha spec a month ago still not hit the repo14:27
inc0first containers from it are almost in;)14:27
sdakethe specs process in mature projects is necessary becaue there are hundreds of people working on the code base14:27
sdakewe have maybe 20 people14:27
sdakewe can manage without specs for the most part14:27
inc0allright..but I think we should at least brainstorm arount it14:28
sdakei have heard time and time again from mature projects the developers are threatening to rage quit over the specs process14:28
inc0maybe leave it for midcycle? Policy decision thingy14:28
sdakei want to avoid that problem14:28
sdakelets vote this week just to get a general consensus14:28
sdakesee if there is any major heartburn14:28
sdakeand we can bring up at midcycle for further discussion/refinement14:28
inc0fair enough14:29
inc0for now, to not keep akwasnie_ back at her work, let's agree to create another Dockerfile for source right?14:29
*** diogogmt has joined #kolla14:30
pbourkeSamYaple: wrt to adding variables for tarballs in source based downloads. would having a file with default urls for each service that build sources sound ok to you?14:30
pbourkethen buildconf can override per service if required14:31
pbourkeinc0: that's the direction Im going in https://review.openstack.org/#/c/191833/114:31
pbourkeinc0: akwasnie_: are you creating source installs for centos?14:31
sdakeinc0 pbourke can you guys sync on a best practice14:33
pbourkeyup thats where I was headed14:33
sdakepbourke i know its outside your immediate goals, but if you could work with akasnie_ on centos source installs first that would rock ;)14:34
sdakeis there a from source blueprint?14:34
sdakepbourke if you could also comment on the ansible_multi.rst spec that would rock :)14:35
pbourkesdake: I can do that. no bp that I know of, I was doing it implicitly as part of the OL bp14:35
pbourkesdake: already +1'd the ansible spec14:35
sdakemake a new blueprint plz14:35
sdakenice i guess i need to take a look at who to haraass to review it :014:36
sdakeits a a big change, want to make sure people are on board14:36
pbourkeim very pleased with it14:36
sdakewe already decided we are doing it with our mission statement14:36
sdakenow its a matter of how14:36
sdakei'll target form source for l214:37
sdakelink blueprint once its available plz14:37
sdakewith relevant decisions here14:37
pbourkeok ill draft it up now. akwasnie_ ping me when you're free14:37
sdakeinc0 what is akwasnie_'s location (or tz)14:38
inc0other side of hall from me;) so Poland14:38
pbourkenot too far away then :) (ireland for me)14:38
sdakepbourke what is your tz?14:38
sdakenice your both in same tzs14:38
sdakesort of14:38
pbourkeUTC+114:38
sdakewe should add a developers list to our wiki14:39
sdakewith tz info14:39
sdakesince we are globally distributed that should help communication14:39
sdakepbourke can you start out the list - alphabetical - above core reviewer in the wiki14:40
inc0sdake, there is bp about source14:40
sdakeinc0 link for pbourke to add relevant decisions to whiteboard14:40
inc0https://blueprints.launchpad.net/kolla/+spec/install-from-source14:40
pbourkeok im going to add the tz list first, then will look at bp14:41
inc0lets work around this one14:41
sdakei set to essential14:41
sdakeenjoy :)14:41
sdakeit was already marked for l214:41
inc0pbourke, as we'll leave our beloved work soon, let's talk tomorrow14:42
pbourkeinc0: sure :)14:42
sdakepbourke add the core team to the list of developers plz14:42
sdakewhen you make the wiki changes14:42
sdakeinclude irc nick and utc offset14:42
inc0brb14:43
sdakekolla is ON at 5am-10am my tz and 6pm-12am my tz :)14:43
sdakeand if I make any rash decisions at  this hour argue with me plz, my brain needs booting at 7am :)14:44
sdakei try to take a nap during the day to be fresh at our later tz offsets relative to me, so feel free to argue with me anytime :)14:45
kevsiSamYaple: Thanks for clarifying the 4 points in review comments.14:46
*** vinkman has joined #kolla14:49
sdakekevsi welcome aboard :)14:50
sdakekevsi thanks for the review - highly appreciated14:50
sdakeonly 8am - already feels like sleepy time14:51
pbourkesdake: want me to merge the core list with the new table and just add a column for core?14:53
pbourkeor leave as is14:53
sdakeleave core team separate in list14:54
pbourkekk14:54
sdakeactually column would work14:54
pbourkehttps://wiki.openstack.org/wiki/Kolla#Active_Contributers14:54
sdakeif you do that, put my name at top plz so people know how to harrass first :)14:54
pbourkethere is the start, each will need to update and add their own TZ as I dont know most of them14:54
pbourkealso Im missing a lot of people14:55
sdakepbourke next step is send an email to the mailing list asking people to populate themselves - use [kolla] tag14:55
sdakepbourke and add core team into active contributors14:55
sdakespelled contributors incorrectly btw :)14:55
pbourkedoh14:55
sdakeya I change my mind alot14:55
sdakesmart people do it all th time - get used to it :)14:55
sdakeor learn to like it :)14:56
pbourkeso you mean merge the lists14:56
sdakeI'd suggest a "Role" column14:56
pbourkeyeah14:56
sdakeand put developer/core/ptl14:56
pbourkeyour wish is my ... :)14:56
sdakeplz14:56
*** jasonsb has quit IRC14:56
sdakemy offset is UTC-714:57
*** jasonsb has joined #kolla14:57
sdakewhile your editing :)14:57
kevsisdake: thanks for the welcome14:57
sdakejpeeler rhallisey around?14:58
sdakesamyaple what is your offset?14:58
jpeeleri'm here14:58
sdakejpeeler what si your offset14:58
sdakepbourke is kind enough to edit the wiki for us and populat eour tzs14:58
rhalliseysdake, ya14:59
jpeelerUTC -4:00 here on east coast (think Ryan is that too)14:59
rhalliseyya same EST14:59
sdakepbourke rhalliseyjpeeler are utc-714:59
sdakejut put offset, not EST/Irish Summertime/etc14:59
jpeeleruh, -414:59
sdakethere done armchair editing :)14:59
*** sami__ has joined #kolla14:59
*** blahRus has joined #kolla15:00
sdakepbourke don't forget our newest core Harm Weites :)15:00
*** sami_ has quit IRC15:01
sdakepbourke if you dont want to do it, let me know and i'll finish it up15:01
jpeelerhonestly i think it would be less confusing if we collected both daylight savings and not15:01
pbourkeno worries, on it15:01
inc0me, akwasnie_ and mstachow are GMT+215:01
inc0and nihilifer15:01
sdakejpeeler idea for tz is just to get a ballpark around when someone might be around15:02
inc0its CEST15:02
* jpeeler always prefers more info over less15:02
*** jasonsb has quit IRC15:02
jpeeleri'm not editing it though!15:02
sdakejpeeler lol15:02
sdakewell if you put in CEST/PST/EST/MST, put after the offfset so ppl can sort by offset plz :)15:03
sdake(vs sorting by randomly named timezones that someone came up with15:03
sdakedaneyon hansen is PST - gmt -815:04
sdakenot sure what tz martin andre is15:04
sdakejapan whatever that is15:04
pbourkeI reckon that's enough, easier to let people fill in the rest themselves15:05
pbourkeill send a note on ML15:05
sdakepbourke please remove bold on my name, but put me first15:05
sdakeagain so people know who to harass:)15:06
pbourkeok im adding harmw then Im done!15:07
sdakeand change "Core" to "Core Reviewer"15:07
sdakeand PTl to "Project Technical Lead (PTL)15:07
sdakeok when you are done let me know and i'll adjust as necessary :)15:07
* sdake hates editing wikis15:07
sdakeWeites is harm's last name :)15:09
sdakepbourke thanks for the heavy lifting o nthe wiki :)15:10
pbourkeyou must have got it wrong in the core nomination mail then ;)15:10
sdakeya I did fail15:11
sdakebut I got it right in irc :)15:11
pbourkedoes the ML auto preprend [openstack-dev] or do add all tags yourself?15:11
sdakethat auto-prepends15:12
sdakejust add [kolla]15:12
pbourkethanks15:12
sdakeexplain why we want to know (for tz / contact communication info)15:12
SamYaplecatching up hold15:13
sdakesire any message for the queen15:14
sdakenone that need be spoken15:14
sdakesuch an epic quote15:14
SamYaplepbourke: re vairables for tarballs. My opinion is the tarball should be outside the container. This can be downloaded via teh .buildconf file. It can also be manually placed should the builder so please15:14
SamYaplepbourke: gitclones/tarballs should NOT be downloaded in the container15:15
sdakesamyaple what about downloading during docker build step?15:15
SamYaplekevsi: anytime!15:15
pbourkeSamYaple: what sdake said15:15
sdakeI don't want to download tarballs during the building process15:15
sdakeoutside the container15:16
sdakeand I dont want to check tarballs into the repo either ;)15:16
SamYaplesdake: downloading tarballs outside the container is a must here15:16
rhalliseysdake, wow how many time have you seen 300 :P15:16
SamYapleno checking into repos needed15:16
sdakeover 9000!15:16
sdakei've got a collection of movies and I watch them15:16
sdakewhen things go bad, I watch no country for old men :)15:17
SamYaplesdake: i dont know my offset15:17
sdakesamyaple what is your timezone15:17
SamYapleCST15:17
sdakeUTC-515:17
SamYaplecool. i wont remember15:17
sdakei'll add to wiki hang tight15:17
pbourkeso you mean as part of the container startup process? doesn't sound right?15:17
sdakeassuming you dont mind people knowing your offset15:17
sdakewe dont want to do as part of startup process any building15:18
SamYaplei dont care?15:18
SamYapletarballs are checked/downloaded when the .buildconf script is sourced. This allows the most flexibility15:18
SamYaplethen we simple ADD them into the container15:18
SamYaplenot container dependacies15:18
SamYapleno*15:18
pbourkenot convinced15:19
SamYaplefor the record, if you look at yaodu history I have about 5000 permutations of this. what im proposing is the best way and i will talk about it as long as needed15:19
SamYapleeverything you have proposed/done i already did15:19
*** nihilifer has quit IRC15:19
SamYaplei can go over why it didnt work15:20
sdakesweet would love to learn from your experiences15:20
sdakewhat precisely do you do in yaodu15:20
sdakefor the build part15:20
SamYaplehopefully someone can propose a better way, that would be nice15:20
SamYapleso for the build part the "build" script did the downloading15:20
SamYaplethe dokcer file simply did an ADD on the tarball into the container15:21
SamYaplethe tarball was a variable that could be pulled formanywhre15:21
SamYaplethat oculd be expanded into a git clone/ref checkout as well15:21
SamYaplebut the key is keeping the download external to the container15:21
sdakethis was to solve the multi-version problem?15:21
sdakeeg, deployingmaster vs stable?15:21
SamYapleyes. it also solved upgrades (juno to kilo was a 2 line change in the whole project)15:22
SamYapleexpanding the buildconf file to support all the variations would work well. git clone/refcheckout/custom tarball/official tarball etc15:22
SamYaplein the end the container only needs to know "i have a tarball, extract and install"15:23
sdakepbourke I understand samyaple's rationale, think it is the way to go15:24
sdakebut it will require surgery to the build script15:24
*** gfidente|afk is now known as gfidente15:24
SamYaplewrong sdake15:24
sdakepbourke the main reason is to support the case of installing kilo vs liberty and the various stable branches without having to change the dockerfile15:25
SamYaplewhen the buildconf is sourced it will execture code. custom tarballs can be specified/downloaded in the buildconf15:25
sdakei think we dont want ot edit the dockerfiles if we can help it15:25
SamYapleno change to build script15:25
sdakestand corrected then :)15:25
pbourkeright but hang on15:25
sdakeare the environment variables available in the docker build operation?15:26
pbourkewhy not have what you want to download as a variable that is sed'ed into the dockerfile, similar to the FROM line15:26
sdakepbourke how does that work for buld-all?15:26
sdakesamyaple same q for u :)15:27
pbourkeyou have a file with key/value env pairs, one per line. KEYSTONE_TAR=http://...15:27
pbourkebuild-all sources this15:27
SamYaplepbourke: that is ugly. and requires modification to the build scripts. AND requires the container to download the tarball15:27
SamYaplesome people build these cotainers on hosts without internet connections15:27
sdakeI think we have to accept containers will be built from a lcoation that has internet connections15:28
SamYaplepbourke: and what about ref changes?15:28
sdakewe make that assumption all over the place15:28
pbourkeyeah that's a requirement15:28
SamYaplehow would you do that in a container?15:28
SamYaplesdake: nah there is no place that requires it with teh appropriate caches15:28
SamYaplebut i accept internet as a requirement, sure15:28
SamYaplei dont want to get sidetracked15:28
sdakehey folks, we have 14 people in the ctive contributors list, and that is just the people that are here in the last 1 hour of pbourke's amazing job of editing the wiki for this purpose :)15:29
SamYapleyay pbourke15:29
sdakeask rhallisey about the times when we had 2 people in our meetings - me and him :)15:29
rhalliseyya you all  missed out15:30
pbourkeSamYaple: ok it sounds like you've thought a lot about this tarball issue and been through the mill on it. just wanted to be sure we'd considered all options and understand why you want to avoid downloading as part of the build15:31
SamYaplepbourke: i can speak further on it if you wish15:31
SamYapleand answer any questions you have15:31
sdakewhat is the exact issue with downloading inside the docker build context?15:31
sdakei'm fuzzy on that15:32
pbourkei need to read the bp and digest what we know15:32
pbourkedid inc0 link it15:32
sdakeyes he did but it has scrolled away15:32
sdakeit is in the logs15:32
sdakerhallisey could you do me a  solid since you have oper15:32
pbourkesdake: internet access Im guessing?15:32
inc0https://blueprints.launchpad.net/kolla/+spec/install-from-source here you go15:32
SamYaplei have screaming baby, conversation will have to wait15:32
pbourkeinc0: thanks15:32
sdakepbourke samyaple said he accepts that and didn't want to get sidetracked on that conversation15:32
sdakeso i'd rather stay on the main track which is? :)15:33
sdakejsut so I know, when people ask me15:33
sdakewhich invariably will happen15:33
inc0there isn't much to read about, we really need to check all that stuff15:33
sdakerhallisey can you change the topic of the channel to add a "This channel is logged.  Weekly Kolla*"15:33
pbourkeinc0: you can say that again, three words currently on it :)15:33
*** rhallisey sets mode: +o sdake15:34
* sdake was delegating not asking for ops :)15:34
*** rhallisey sets mode: -o sdake15:34
rhalliseyI take them!15:34
*** ogelbukh has joined #kolla15:35
sdakepbourke recommend linking a log to this day's eavesdrop discussion15:35
sdakeso people know how we got to where we are in the future15:35
SamYapleso. why not download in the container? what happens if we want to support testing patch and providing a ref_change? (I do want that)15:36
SamYaplepbourke: how would you do that?15:36
SamYaplefrom a dockerfile15:36
inc0downloading in container on startup will be painful in dc15:37
inc0with network proxies, firewalls, and all that stuff15:37
sdakenot on startup15:37
inc0on build?15:38
sdakedocker build existss for a reason - tobuild :)15:38
SamYapleinc0: before build15:38
sdakerhallisey would you mind making that topic change plz :)15:38
pbourkeSamYaple: you could make it a variable but I think Im on board with you now anyway15:38
sdakeor are you just typing slowly :)15:38
pbourkeSamYaple: your way is more flexible15:38
rhalliseysdake, was talking to someone sorry15:39
sdakenp15:39
pbourkeit also nails the issue of proxies as inc0 mentions15:39
rhalliseythat's why I gave ops :)15:39
rhalliseyjust a second15:39
SamYaplepbourke: you cant actually make it a variable since you need to git checkout/cherry-pick/generate tarball (last step optional)15:39
*** jtriley has quit IRC15:39
sdakeso if I coud get a list of the top 3 reasons we don't pull/download tarballs inside Dockerfile they woudl be what:15:39
sdakenot being dense, but I know I will be asked by many people over and over15:40
sdakeand I want to understand the reasons15:40
inc0installation from source also requires installation of dependencies15:40
inc0probably something like pip install -e .15:41
pbourkeinc0: yes but those can be cached15:41
inc0can we do that in Dockerfile?15:41
SamYaplesdake: 1. firewall/proxy/networking 2. cannot be flexible/cannot support ref_changes 3. containers have extra deps (git)15:41
SamYaplei guess thats my answer? 2 is the selling pont for me15:41
pbourkeyeah 1 and 3 I would not lose sleep over15:42
SamYapleDockerfiles getting a tarball is a known point. they know how to "take it from here"15:42
SamYaplethat is big for readability15:42
inc0I have to run now, please let me know tomorrow what did you find out15:42
pbourkeinc0: ill update the bp15:42
inc0thank you15:42
inc0we'll sync up tomorrow and split work items15:42
SamYaplehttps://github.com/SamYaple/yaodu/blob/master/ansible/roles/docker_build/templates/ubuntu/keystone/Dockerfile.j2#L4-L815:43
inc0have a nice day guys, bye15:43
sdakewhat is the ref change thing you talk about15:43
SamYapleall ^ that is the ADD and install of openstack15:43
SamYapleinc0: bye!15:43
SamYaplesdake: git fetch https://SamYaple@review.openstack.org/stackforge/kolla refs/changes/86/191486/1 && git cherry-pick FETCH_HEAD15:43
SamYaplewe can test changes from a commit before merge15:44
SamYaplewe can be a devstack replacement as an added value with no extra work15:44
sdakeoh please not more pain :)15:44
sdakei can only take so much :)15:44
SamYaplesdake: this is pleasure. get you senses right15:45
sdakeoh perhaps im confusing the two :)15:45
SamYapleanyway, its literally requires no extra work to allow ref/changes _if_ we pull outside the container15:45
sdakeso the main reason I see is to be able to cherrypick changes wihtout hand-editing the dockerfile15:45
ogelbukh5315:46
sdakei'll go with that argument15:46
SamYapleprobably the biggest, but it does make other changes easier too15:46
*** absubram has joined #kolla15:46
SamYapleyour company has a patch to neutron, generate a tarball locally and put it in the right place. then it deploys. bam15:46
sdakeya makes sense15:46
sdakethanks15:46
*** sami_ has joined #kolla15:47
*** jtriley has joined #kolla15:47
sdakeone cisco perk is i get to use company rate on hotels/car rentals15:48
*** inc0 has quit IRC15:48
sdakeboy I'd like to take advantage of that with a vacation :)15:48
*** rhallisey changes topic to "Weekly Kolla meetings will be held every Wednesday 1600 UTC for even weeks of the month and 2200 UTC for odd weeks in #openstack-meeting-4 | https://wiki.openstack.org/wiki/Meetings/Kolla | Install from source discussion http://eavesdrop.openstack.org/irclogs/%23kolla/%23kolla.2015-06-16.log.html#t2015-06-16T14:40:58"15:48
rhalliseysdake, how's that look15:48
pbourkesdake: good discount?15:48
sdakerhallisey we dont need the install from source discussion in the logs15:48
sdakerather in the topic15:48
sdakewhat we need is a "This channel is logged @"15:48
sdakeopenstack requires us to notify people the channel is logged15:49
sdakeand we aren't doing that15:49
rhalliseyO.o I misunderstood15:49
sdakenp15:49
*** sami__ has quit IRC15:49
*** rhallisey changes topic to "Weekly Kolla meetings will be held every Wednesday 1600 UTC for even weeks of the month and 2200 UTC for odd weeks in #openstack-meeting-4 | https://wiki.openstack.org/wiki/Meetings/Kolla | This channel is logged here: http://eavesdrop.openstack.org/irclogs/%23kolla/"15:50
sdakethanks - more in compliance :)15:50
*** dwalsh has quit IRC15:50
sdakethis is part of the channel logging change that we didn't follow15:50
sdakeoh well cant fix the past15:50
rhallisey:)15:50
sdakebut now everyone knows :)15:50
bmacetoo bad there isn't an eavesdrop.nsa.gov.. then we wouldn't even need our own bot.. just look at their logs ;)15:51
*** rhallisey has quit IRC15:51
*** rhallisey has joined #kolla15:51
*** fangfenghua has joined #kolla15:52
SlowerI was reading you're supposed to put it in the channel topic that we are logging15:58
*** sami__ has joined #kolla15:59
*** fangfenghua has quit IRC16:00
bmaceit is at the end16:02
*** sami_ has quit IRC16:02
*** dwalsh has joined #kolla16:02
Slowerah I'm oldschool16:04
Slowertxt based client16:04
sdakebmace i suspect there is :)16:04
jmccarthysdake: re:multi_ansible bp feedback: Thanks ! - Yea I sort of knew it was probably out of scope of that blueprint but went ahead and asked the question anyway - I'll follow that other blueprint and check what's cooking there. Yea from backup or maybe audit point of view ., folks may want to know what/when changes have been made across nodes over time or that sort of thing I was thinking16:05
sdakeslower add your name to the kolla dev wiki if you like16:05
*** jtriley has quit IRC16:05
sdakeya makes sense, blueprints are just an implementation guideline not comprehensieve "here is how it must be done" :)16:06
sdakeI dont know if you saw v1.0 but v2.0 is much different16:06
sdakebased upon the 40 feedback items from version 116:06
sdakeI htink I got everyone's concerns convered :)16:06
sdakelooking good so far, lots of +1's :)16:06
sdakeslower https://wiki.openstack.org/wiki/Kolla16:08
rhalliseylol 'Developer-wannabe'16:09
jmccarthylol16:10
sdakeeither your a devleoper or not :)16:10
*** nihilifer has joined #kolla16:10
sdakeso I changed that16:10
rhalliseypretty funny :D16:10
*** daneyon has joined #kolla16:11
sdakedaneyon around?16:11
*** sami__ has quit IRC16:13
*** sami__ has joined #kolla16:14
*** daneyon_ has joined #kolla16:14
sdakedaneyon_ around?16:14
daneyon_ya, give me a few though16:14
sdakeping me when avialable16:14
SamYapleok guys i need sleep16:17
*** daneyon has quit IRC16:17
*** vinkman has left #kolla16:17
Slowersdake: cool, done16:17
SlowerI did developer-wannabe though :)16:17
sdakein your case its appropriate ;)16:18
sdakej/k16:18
Slowerhaha16:18
SlowerI thought so :)16:18
sdakecan you change it to developer plz16:18
SlowerI was j/k16:18
sdakeI appreciate how you view the distinction16:18
sdakebut either ppl are developers or not develoeprs :)16:19
*** dasm|afk is now known as dasm16:19
dasmsdake: and how about semi-developers?16:19
dasmwhen someone is half-active? ;)16:19
Slowerlazy-developer? :)16:19
sdakeif your part time, but an active contributor16:20
sdakeyour still an active contributor16:20
sdakei am part time on kolla ;)16:20
sdakeactually more realistically I am 100% on two projects :)16:20
dasmsdake: which one part? between 00-12 or 12-24?16:20
Slowerhaha16:20
Slowerya he only works 12 hrs a day on it.. half time16:21
sdakedasm just add in developer there for yourself16:21
sdakewe have alot of peeps that are only 20-50% time on kolla16:21
sdakemandre is probably like 20% and he is a core reviewer :)16:21
dasmsdake: done16:23
dasmso right now there are 6 CR + 1 PTL + 10 devs... 17 ppl for Kolla project.16:23
sdakethere are more unaccounted in the wiki16:24
sdakethat list is only 1 hour old ;)16:24
dasmah... that's why i didn't see it previously ;)16:24
*** daneyon_ has quit IRC16:25
*** daneyon has joined #kolla16:25
daneyonsdake hey!16:28
sdakedaneyon will you copresent iwth me at summit16:29
sdakeKolla: Deploying OpenStack Using Ansible in Docker Containers16:29
daneyoni would be honored to16:29
Slowertokyo here we come!16:29
sdake3 cheater words :)16:29
daneyonDocker16:29
daneyoncontainers16:29
daneyonbeer16:29
sdakefour if you count containers :)16:30
Slowerhaha16:30
rhalliseyha!16:30
daneyonrhallisey getting ready to test the latest cinder ps16:31
daneyoni assume the only thing i need to do to prep is create my cinder vg, correct?16:31
rhalliseydaneyon, no I create the vg in a script16:32
rhalliseyall you need is docker 1.716:32
daneyonoh16:32
*** nihilifer has quit IRC16:32
daneyonwill the script bypass creating the vg if it exists?16:32
Slowerbeer saki cigars ... need a 4th16:33
rhalliseyif it exists with X name then it won't16:33
Sloweroh 3 cheater words, I'm good then16:33
rhalliseydaneyon, you can create it by hand just call it the same name you pass as the 'volume group' param16:33
daneyonI'm not a big fan of the vg create script16:34
rhalliseyI think that's the name16:34
daneyonI setup my lab env to use a real phys vol for my cinder vg16:34
Slowerya we need to have a check in there16:35
rhalliseydaneyon, ya you can use that just use the same name16:35
daneyonI think we should make it configurable between a real volume and a loopback/file backed volume16:35
Slowerdaneyon: definitely16:35
daneyonIt should be pretty easy to expose a param like USE_LOOPBACK or something like that.16:35
sdakeslower rhallisey daneyon jpeeler plz review https://review.openstack.org/#/c/189157/16:36
rhalliseydaneyon, ok I'm cool with that16:36
daneyonI think volume-group-create.sh in the cinder-vol start script should only be executued if a param like CREATE_VOLUME_GROUP=true16:37
Slowerdaneyon: I think we should iterate on it16:37
daneyonfair enough16:37
Slowerin fact you should test a change to add physical volume support since you have that set up ;-)16:37
daneyonok, let me work on updating Docker to 1.716:38
rhalliseydaneyon, ya we didn't have it setup :P16:38
rhalliseyhence the backing file16:38
*** jmccarthy has quit IRC16:38
daneyonSlower I will do just that. Excited to test this stuff out!!!!16:40
*** akwasnie_ has quit IRC16:41
Slowerdaneyon: very cool!16:43
daneyonSlower rhallisey I cant get 1.7 installed due to deps: docker-selinux selinux-policy16:43
daneyonDo you use --skip-broken or how do u install the 2 deps?16:44
daneyonI'm going to try skipping the deps16:46
daneyonI guess ^ didn;t work16:46
daneyonsdake do you have any advice on how to get around this: https://gist.github.com/danehans/d79a4077c9cfea89984416:47
sdakedownload the rpm16:48
sdakevia curl16:48
sdakerpm -Uvh --nodeps file.rpm16:48
daneyonsdake nevermind, i think i got it16:48
daneyonya, duh16:48
SlowerI think we were just downloading the binary :)16:50
Slowerbecause evil16:50
*** dwalsh has quit IRC16:52
*** dwalsh has joined #kolla16:56
Sloweris bashate failing  normally?16:59
openstackgerritimain proposed stackforge/kolla: Set up glance to use a data container.  https://review.openstack.org/19197517:01
*** jtriley has joined #kolla17:02
*** jtriley has quit IRC17:06
*** sdake has quit IRC17:19
*** sdake_ has joined #kolla17:19
*** sami_ has joined #kolla17:24
*** sami__ has quit IRC17:27
*** dwalsh has quit IRC17:30
*** jasonsb has joined #kolla17:35
*** athomas has quit IRC17:41
*** jtriley has joined #kolla17:51
*** dwalsh has joined #kolla17:55
*** daneyon_ has joined #kolla17:57
*** daneyon has quit IRC18:00
*** fangfenghua has joined #kolla18:06
openstackgerritJeff Peeler proposed stackforge/kolla: Fix Heat container env vars and dependencies  https://review.openstack.org/18997418:08
jpeeleri'm a bit confused how gerrit has conflicts, but then when i rebased locally none were present18:08
*** fangfenghua has quit IRC18:12
*** gfidente is now known as gfidente|afk18:24
*** diogogmt has quit IRC18:25
*** bmace has quit IRC18:34
*** daneyon has joined #kolla18:42
*** nihilifer has joined #kolla18:45
*** daneyon_ has quit IRC18:45
*** nihilifer has quit IRC18:45
*** bmace has joined #kolla18:46
*** nihilifer has joined #kolla18:46
*** diogogmt has joined #kolla18:47
daneyonrhallisey Slower what version of device-mapper are you using with 1.7?18:47
*** diogogmt has quit IRC18:48
rhalliseydevice-mapper-1.02.93-3.fc21.x86_6418:48
*** jruano has joined #kolla18:51
lothsdake_: i need to revote?18:52
harmwsdake_: underscore-alert18:54
daneyonrhallisey me too18:54
rhalliseydaneyon, are you having issues?18:54
bmacei tried device mapper a few times on systems that had old aufs revs but i got some odd failures pretty consistently on several different os types with device-mapper19:02
bmacemuch happier with an up to date aufs, as far as stability / lack of errors19:02
daneyonrhallisey i am trying to get 1.7 to run19:03
daneyonworking through it... i think19:03
Slowerdaneyon: I'm pretty sure we just curl'd the binary and copied it over what was there and it magically worked19:04
SlowerI could be wrong though.. I'm old19:04
rhalliseythat's right looking for link..19:05
*** diogogmt has joined #kolla19:08
*** fangfenghua has joined #kolla19:12
*** sdake_ is now known as sdake19:13
sdakeloth each review needs a vote ya19:13
sdakeloth its not like a mandatory thing19:13
sdakeits up to you19:14
sdakecurl of docker 1.7 from upstream does not work19:14
sdakeyou have to use the rpm version19:14
*** sdake has quit IRC19:15
*** sdake has joined #kolla19:15
*** fangfenghua has quit IRC19:16
*** jruano has quit IRC19:18
Slowersdake: are the bashate tests always failing or am I missing something?19:22
Slowerhttps://review.openstack.org/19197519:23
sdakewe are waiting on the cinder review to hit the repo19:23
rhalliseySlower, the new cinder patch will remove like 50 of those errors19:23
Slowerok cool19:24
rhalliseyand swift will need to be fixed later19:24
sdakerhallisey if you could rubber stamp https://review.openstack.org/#/c/189166/ - that would fix that problem :)19:24
rhalliseyoh :)19:24
rhalliseyCinder has first +2 :D19:27
sdakejpeeler I noticed you reviewed https://review.openstack.org/#/c/189157/ but didn't provide a vote19:28
sdakewould you mind voting plz19:28
sdakerhallisey can you review https://review.openstack.org/#/c/189157/19:28
sdakeneed to get this spec approved or fixed to unblock loads of people19:28
sdakeharmw ^^ :)19:28
rhalliseysdake, ya still reviewing19:28
sdakeha spec same story19:28
harmwyo19:29
sdakeplease place specs at your highest review priority :)19:29
sdakewow its hot i nphx19:29
harmwicecream alert!19:29
sdakesnowball earth alert :)19:29
sdakebmace if ou wouldn't mind reviewing would appreciate as well :)19:30
bmacesure thing19:31
bmaceah, guess it was re-patched since my last +1.. :/19:32
sdakeanyone else is welcome to review as well ;)19:32
sdakeya sam edited it19:32
sdakeanyone that is a contributor to kolla, please feel free to add your name/utc/irc nick here if you want19:34
sdakehttps://wiki.openstack.org/wiki/Kolla19:34
sdakeslower since your around and not busy welding, perhap you can review the ha and ansible-multi specs too :)19:34
Slowersdake: haha19:38
Slowerdamnit19:38
bmace+1 on the spec.  still looks good to me and the sort of issues being brought up are small enough that i don't think we need a bunch more spec iterations on them.  better to stay out of a deep level of detail in a spec anyway unless you want it immediately irrelevant / out of date once real dev starts19:38
sdakebmace that owuld be a great comment to leave in the review :)19:39
sdakeI know exactly what you mean19:39
jpeeleragreed - do we have a policy of all cores voting on a spec?19:39
sdakeno such policy19:40
sdakeit would be nice if the core reiewers were in agreement though19:40
sdakerequiring a unanimous vote on a spec seems onerous to me - we dont even require that for acceptance to the core reviewer team19:41
sdakewe require 3 votes for core reviewer and no veto19:41
sdakemaybe we should just adopt that for specs19:41
*** dasm is now known as dasm|afk19:42
jpeelermaybe that in addition to some length of time to assure everybody sees it19:43
bmacenice to have some defined criteria at least, even if it is just 2 + ptl, since it would be odd to not have ptl weigh in on spec level stuff.19:43
SlowerI basically brought up the idea of maintaining 2 installation methods to ensure an agnostic interface to the containers19:45
bmacei guess it depends on what you mean by installation methods?  supporting copy in / copy over is pretty darn agnostic.  those configs can be generated / managed in whatever way someone wants.19:46
SlowerI mean ansible + something else19:49
Slowerbut I guess in teh spec it is saying it will continue to support crudini19:49
bmacesure, but ansible in the end is just passing in regular openstack service config files,  nothing ansible specific.  so from a container point of view ,the containers know nothing about ansible.  it is completely agnostic of the install process.19:50
*** inc0 has joined #kolla19:53
sdakebmace agree with your assessment19:54
inc0good evening19:54
sdakejpeeler the spec has been up for a week+, ha spec up for a mo19:54
sdakebmace problem with 2+ptl is if ptl is the spec author19:54
Slowersdake: link to ha spec?19:54
jpeeleri wasn't worried about the existing specs, just was talking about if a new policy were formed19:55
sdakebmace spec authors can't approve their own changes19:55
Slowersdake: so are we going to ditch the compose dir and stop testing env file config of containers?19:55
sdakeslower https://review.openstack.org/#/c/181983/19:56
bmacemakes sense sdake.19:56
sdakeslower no19:56
sdakecompose dir staying19:56
sdakekolla being renamed kolla-compose19:56
sdakewe will gate the two major config strategies separately19:56
sdakeocne we have gating that works :)19:57
sdakehopefully for each container distro + install method (source/binary) avialable19:57
inc0wow, that escalated quickly, this is new idea?19:57
sdakeinc0 we have always had ci gating as a goal19:57
Slowersdake: well that's kind of what I was thinking.. sounds good19:57
inc0I know, but I mean kolla-compose19:58
sdakeinc0 this is nothing new, we have discussed it for the last 3 mo19:58
sdakeinc0 I thought that was in the spec?19:58
sdakeit was in one version I wrote atealset :)19:58
sdakemaybe I imagined writing it let me check the  spec19:58
inc0as different install strategu19:59
bmacei remember reading it :)19:59
sdakewhat we are not goint tto do slower is continue to make new containers using crudini19:59
sdakeunless at request19:59
Slowerright, or unless contributed I presume?19:59
sdakeright19:59
sdakeif somone really wants to do the work, wfm :)19:59
Sloweryeah I hear ya19:59
sdakeslagle suggested this idea20:00
inc0idea is to allow deployment tool to prepare full config file, which is cool for tripeo I guess20:00
sdakeit wasn't mine :)20:00
sdakeinc0 what is it that yo uthink a new idea was generated around?20:02
*** jasonsb has quit IRC20:02
inc0renaming kolla to kolla-compose20:02
inc0I must have missed that20:02
*** jasonsb has joined #kolla20:02
sdakebmace confirmed it was in atleast one version of the spec :)20:02
inc0yea I believe you, I might misread this part, I dont worry too much20:03
inc0after a thought:)20:03
bmaceit is down near the end, at least in the current rev, under Work Items20:06
inc0yeah, I see it, I guess I didn't read work items too carefully20:06
inc0mea culpa20:06
sdakethat is the most important part ;)20:06
inc0and kolla will just hold containers right?20:09
sdakehuh?20:10
inc0sorry, its 10pm for me20:10
sdakecould you expand on your question20:10
inc0we'll have kolla-compose and kolla-ansible right?20:10
sdakeright20:10
sdakethese aren't new repos20:10
sdakethese are shell scripts20:10
inc0aaaa20:10
sdakei guess that could have been more clear :)20:10
inc0now it makes sense;)20:10
inc0I misunderstood this part20:11
inc0again 10pm, my mind isn't used to work now20:11
harmwok, notes on mansible pushed20:13
*** sdake_ has joined #kolla20:16
*** fangfenghua has joined #kolla20:17
openstackgerritMichal Jastrzebski (inc0) proposed stackforge/kolla: Keepalived container  https://review.openstack.org/18798120:17
*** jtriley has quit IRC20:18
openstackgerritSteven Dake proposed stackforge/kolla: Make get-image.sh bashate compliant  https://review.openstack.org/18915620:18
openstackgerritSteven Dake proposed stackforge/kolla: Make swift bashate compliant  https://review.openstack.org/18916620:18
sdake_rhallisey/jpeeler if you could rubber stamp those two reviews, they are a rebase - gerrit got busted somehow20:19
sdake_or harmw use your new +2 powers :)20:19
*** sdake has quit IRC20:20
jpeelersdake_: what was the reason you changed the backend to use qemu directly?20:21
sdake_where?20:21
sdake_oh because I dont run libvirt20:21
sdake_I guess I could have documented that :)20:22
sdake_our docs recommend turning off libvirt20:22
*** fangfenghua has quit IRC20:22
sdake_is the reason20:22
jpeelerimage can be built anywhere though20:22
sdake_so get_image as is is not usper compatible with our dev quickstart20:22
sdake_yes but typically they are built on the same system20:22
sdake_i couldn't test it with it as is20:23
jpeeleryeah i'm not saying the change is wrong or anything, just curious20:23
sdake_thats why :)20:23
sdake_harmw re ansible spec thanks for comments - if you thin kthey  warrant a new spec revision, please vote -1 if you think we are good to go vote +1 or +220:24
harmwwell, I'm not sure if they do... I'd like some clearification, so yes I'd love to see them adressed/added20:25
harmwthen again, it's just some grey-area text20:25
harmw(I want to know how it works a week from now, without having to re-read the whole damn thing again like I just did :P)20:27
sdake_samyaple when you arise, spec needs an update20:44
sdake_samyaple I'd do it myself but there are technical questions I don't have the answers to20:44
sdake_name for midycle - Kollapalluza20:47
inc0I'm curious, what's history of this name?20:49
rhalliseylol20:51
inc0http://www.urbandictionary.com/define.php?term=palooza ah...20:51
inc0that's my second new word in English today!20:51
rhalliseyinc0, haha! nice!20:51
rhalliseyinc0, I wan't laughing at you , but rather the name :)20:52
rhalliseyit's very funnt20:52
rhalliseyfunny20:52
sdake_blame robyn20:52
rhalliseyI like it20:52
daneyonhow the heck is anyone getting docker 1.7 to run20:52
sdake_daneyon maybe your rpm is bust20:53
daneyonI'm on 3.19.5-200.fc21.x86_6420:53
daneyonI'm following: https://github.com/stackforge/kolla/blob/master/devenv/kollanode.yaml#L164-L16720:54
daneyonseems like devicemapper is a problem. I'm using device-mapper-1.02.97-1 was using .93 and same problem20:55
inc0anyway, I just came here for late call20:57
inc0take care, see you all tomorrow20:57
*** inc0 has quit IRC20:58
SlowerI've never had devicemapper issues20:58
Slowerdidn't even know it had a package20:58
sdake_slower why does that not surprise me :)20:58
Slowerdaneyon: setenforce 0 ?20:58
Slowergeez20:59
openstackgerritMichal Rostecki proposed stackforge/kolla: Add designate-sink service  https://review.openstack.org/18939320:59
daneyonSlower seems like I'm hitting this: https://github.com/docker/docker/issues/1288920:59
openstackgerritMerged stackforge/kolla: Make get-image.sh bashate compliant  https://review.openstack.org/18915621:00
openstackgerritMerged stackforge/kolla: Make swift bashate compliant  https://review.openstack.org/18916621:00
rhalliseydaneyon, just a second21:00
sdake_daneyon that curl line is wrong21:01
sdake_use the rpm version21:01
sdake_the upstream version is busted with fedora21:01
SlowerI don't dare try to reproduce it here.. :)21:02
daneyonadding --storage-opt dm.override_udev_sync_check=true got docker daemon to start, but it sounds like it can cause unexpected bahavior21:02
*** dwalsh has quit IRC21:03
Slowerdoesn't sound good.. docker has issues already..21:04
daneyonnow hopefully it will work with the cinder container patch21:04
daneyonSlower To test the cinder patch, I need to build my cinder images instead of pulling the from the registry, correct?21:06
rhalliseydaneyon, correct21:07
daneyonthx21:07
*** jtriley has joined #kolla21:14
*** jtriley has quit IRC21:19
*** nihilifer has quit IRC21:23
*** fangfenghua has joined #kolla21:23
*** fangfenghua has quit IRC21:28
*** juggler_ has joined #kolla21:40
*** gfidente|afk has quit IRC21:47
sdake_daneyon did you get my msg about that link being wrong in the curl in the heat etmplate21:58
sdake_you need to download the rpm from redhat, it is dynamically linked21:58
daneyonsdake_ let ,e try the rh rpm22:01
daneyonhowever, i got 1.7 started but my system still doesn't seem to be working right22:01
*** sdake_ is now known as sdake22:02
*** juggler_ is now known as juggler22:04
rhalliseydaneyon, https://fedorapeople.org/~rhallisey/docker-engine-1.7.0-0.1.rc1.fc21.x86_64.rpm22:05
rhalliseythat's what I used22:05
daneyonrhallisey thx22:05
*** rhallisey has quit IRC22:22
daneyonrhallisey or Slower 2 questions Are you using fedora atomic for your host OS? Are you using compose or just running docker with the env file?22:32
*** openstackgerrit has quit IRC22:38
*** openstackgerrit has joined #kolla22:38
*** diogogmt has quit IRC22:39
*** diogogmt has joined #kolla22:41
*** pbourke has quit IRC22:44
*** pbourke has joined #kolla22:44
*** jtriley has joined #kolla23:03
*** fangfenghua has joined #kolla23:04
*** fangfenghua has quit IRC23:04
*** shardy has quit IRC23:05
*** jtriley has quit IRC23:07
sdakesamyaple alive yet23:07
sdakediga23:16
sdakecan you add your name here plz23:16
digahi sdake23:16
digawhere ??23:16
sdakehttps://wiki.openstack.org/wiki/Kolla23:16
sdakeonl yif you want23:16
sdakenot mandatory by any means23:16
digasure23:16
sdakehelps people figure out your tz fo rcommunication purposes23:17
digaokay23:18
digasdake: done :)23:23
*** blahRus has quit IRC23:26
*** absubram has quit IRC23:31
*** jasonsb has quit IRC23:42

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!