Monday, 2018-08-20

*** zaneb has quit IRC00:41
*** ricolin has joined #openstack-tc01:02
*** dangtrinhnt_ has joined #openstack-tc01:31
*** dklyle has joined #openstack-tc02:42
*** david-lyle has quit IRC02:43
*** dklyle has quit IRC02:43
*** dklyle has joined #openstack-tc02:43
*** Bhujay has joined #openstack-tc03:18
*** gcb_ has joined #openstack-tc03:23
*** Bhujay has quit IRC03:26
*** Bhujay has joined #openstack-tc04:16
*** jaosorior has joined #openstack-tc04:31
*** gcb_ has quit IRC05:10
*** e0ne has joined #openstack-tc05:26
*** e0ne has quit IRC06:00
*** e0ne has joined #openstack-tc06:42
*** e0ne has quit IRC06:43
*** jaosorior has quit IRC07:17
*** tosky has joined #openstack-tc07:31
*** jaosorior has joined #openstack-tc07:37
*** dtantsur|afk is now known as dtantsur08:25
*** cdent has joined #openstack-tc08:37
*** e0ne has joined #openstack-tc08:58
*** jpich has joined #openstack-tc09:00
* cdent makes yet another "what is the tc really" post to os-dev09:05
dimso/10:22
dimslots to catch up on :)10:22
* cdent waves to dims10:22
dimshi cdent10:23
*** dtantsur is now known as dtantsur|brb10:27
*** e0ne has quit IRC10:51
cmurphywelcome back dims10:55
*** Bhujay has quit IRC11:17
*** Bhujay has joined #openstack-tc11:40
*** e0ne has joined #openstack-tc11:47
*** jroll has quit IRC12:00
*** jroll has joined #openstack-tc12:01
*** ricolin has quit IRC12:09
*** cdent has quit IRC12:14
*** Bhujay has quit IRC12:16
*** Bhujay has joined #openstack-tc12:16
*** needssleep is now known as TheJulia12:23
TheJuliao/12:24
*** dtantsur|brb is now known as dtantsur12:45
*** cdent has joined #openstack-tc12:48
*** zaneb has joined #openstack-tc12:55
*** mriedem has joined #openstack-tc13:23
dimsthanks cmurphy13:39
*** cdent has quit IRC13:43
*** cdent has joined #openstack-tc13:53
openstackgerritMerged openstack/project-team-guide master: Remove proactive backport stable instructions  https://review.openstack.org/59319813:57
*** Bhujay has quit IRC14:02
openstackgerritTobias Urdin proposed openstack/governance master: Update Puppet PTL IRC nick  https://review.openstack.org/59363714:17
*** e0ne has quit IRC14:28
*** efried has joined #openstack-tc14:34
efriedō/14:34
*** e0ne has joined #openstack-tc14:35
ttxo/14:36
*** annabelleB has joined #openstack-tc14:42
*** ricolin has joined #openstack-tc14:47
*** cdent has quit IRC14:50
*** lbragstad has joined #openstack-tc14:54
*** cdent has joined #openstack-tc15:18
efriedtc-members: For those of you who have been following the dev ML thread on placement extraction (http://lists.openstack.org/pipermail/openstack-dev/2018-August/133445.html)...15:27
* mnaser has been following quietly :X15:28
efriedIn the nova-scheduler meeting this morning (http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-08-20-14.00.html) we started discussing how the decision should actually get made.15:28
efriedI.e. should it be democratic? Who should get a vote? Should all votes weigh the same? Who would even decide on *these* questions?15:29
efriedAnd the idea came up that we could possibly ask the TC to govern the process. Not make the decision - just help us wade through the politics, mechanics, process, etc.15:29
efriedSo15:29
mnaserefried: that is a very interesting thing to bring up honestly.  maybe we can look at how the decision to split nova to cinder was done?15:30
smcginnisThat was a very different time though.15:30
efriedOkay. I wasn't around for that, so I would be relying on others.15:30
mnasermaybe those who were around could comment about it, i'm sure that was a painful split too15:30
* mnaser personally doesn't see why it's a big issue of splitting it out especially with how nicely zuul allows us to build dependency chains across projects15:31
mnaserbuild x feature in placement, depends-on in a nova change that consumes it,15:31
smcginnisYeah, I'm still not clear why the push to keep it in Nova honestly.15:32
efriedI agree: I don't see any situations where depends-on would be worse than having patches in series.15:33
mnasermy concern is would it be extra work for everyone if no one else is consuming/using it15:34
mnaseri.e. in deployment tool world we need to figure out how to do the entire split without breaking $world15:34
persiaCould have a higher-level depends-on that covered it (e.g. requirements).15:34
efriedcdent has been leading the thinking through that15:34
mnaserif we have to do all of that for no one except nova to end up consuming it (i think the important thing to note is *consume* it, not *report* to it)15:34
efriedmnaser: There's also the issue of core/maintainer team separation.15:35
efriedThere are at least three people who should be placement cores who are not nova cores. And will probably not become nova cores due to their focus being primarily on placement code.15:35
mnaserefried: is there anything stopping the nova team from adding members to core and telling them "you're core for placement, please kindly don't +A anything that doesnt touch placement"15:36
mnaseri like to think we all trust each other pretty well :D15:36
efriedmnaser: I've asked that question. It's just "not done".15:36
efriedThe reasons are weak IMO, because I agree we should be able to trust, but that seems like a non starter.15:36
smcginnisefried: The core question is a key one in my mind for why this makes sense to separate.15:36
smcginnismnaser: No comment.15:37
mnaserwell15:37
mnaserperhaps we can ask if infra would be interested in https://gerrit.googlesource.com/plugins/owners/+/refs/heads/master/README.md ?15:37
jrollwe've been talking about the "partial core" thing for years and teams refuse to do it, I'm not sure it's worth bringing up in this context15:38
mnaseras an interim solution if there are some who are not comfortable of giving "full core"15:38
smcginnisHmm, k8s-like OWNERS. Maybe could work. But does seem like a bigger thing than just making placement its own team.15:38
jrollit'll just derail15:38
cdenteven if we made some "placement-only" cores, that wouldn't address the issues with competition for blueprint space15:38
smcginnisjroll: ++15:38
mnasercdent: thats valid too re: blueprint space15:38
smcginnisAnd cdent: ++15:38
mnasercdent: is this type of conversation pressing to have now pre-PTG?15:39
mnaseror maybe is this something we can find time for at the PTG?15:39
efriedI would love the PTG conversation to be "HOW are we going to do this?" as opposed to "ARE we going to do this?".15:40
cdentthe hope was to get it resolved before the ptg, so that we could focus the ptg on dealing with resolving the technical problems. based on my experience with working to move this forward for the past two years, putting it off to the ptg has meant that it doesn't get done15:40
cdentefried++15:40
mnaserefried: i agree15:40
mnaseri wonder if we can extract commits done inside the specific paths that placement api includes15:40
cdentthough it would be nice for the ptg to be about big picture planning, nova historically has resisted that in favor of details for the immediate cycle15:40
cdentthis has happened again and again15:40
mnaseri.e.: nova.api.openstack.placement, placement docs15:41
mnasertry to come up with a list of all placement API (server side, not consumer side)15:41
mnaserand then just make a poll for those commiters..15:41
cdentmnaser: that's in progress, the list of people in my email message are those people15:42
cdent(the long one in response to doug)15:42
cdentthat list of people is the top ten committers on placement service side code15:43
mnasermaybe if we can come up with a transparent way of determining all placement committers (that we all agree too) and then setup a vote for all of them15:43
cdentit's hard to get super accurate results because of file moves, and different opionions on whether a commit or loc ought to mean more15:44
efriedBut mnaser ++ this is just the kind of thing I was hoping to get out of this conversation.15:44
* cdent nods15:44
jrollI agree that the decision should be made by the heavier placement contributors, but I do think we need to get agreement from nova leadership that they'll live by the decision, even if they don't agree with it15:44
mnaseri dont think # of commits or loc means more or not imho15:44
mnaserthe same way we do our ptl elections15:44
efriedjroll: Exactly.15:44
smcginnisIn or out, no weight.15:44
smcginnisBut there are some more involved in placement than others, so just being part of the identified group of "contributors" does seem like it would be missing a semi-important aspect of it.15:45
smcginnisI do think that would be a first step though.15:46
efriedI'm fairly confident the result would be the same, tbh.15:46
* cdent nods15:46
zanebI haven't read the whole thread, but if it's going to be in a separate repo within the Nova project then it can easily have its own core team enforced by Gerrit ACLs15:46
smcginnisI suppose placement isn't old enough to have URLs that are not https. ;)15:46
efriedThe main rub is as jroll says: whatever process we come up with has to be agreed upon by the nova leadership.15:47
jrollzaneb: that 'if' is the primary question15:47
efriedzaneb: So far the consensus in the pro-extraction camp is to extract fully into an independent repository.15:47
smcginnisI would say if the placement contributors are in favor of full extraction, the existing nova core can weigh in but shouldn't have any veto power on it.15:48
zanebjroll: the thread starts at least with the premise that it will at least be in a separate repo as a given, and that the primary question is whether it should be inside or outside the Nova project15:48
* zaneb continues reading15:48
efriedsmcginnis: ++  But does the TC (or *anyone*) have the authority to enforce that or any other procedural decision here?15:49
smcginnisYes15:49
jrollzaneb: fair15:49
efriedOh. Well then.15:49
smcginnisWe don't want to have to, but when it all comes down to it, yes.15:49
smcginnisI very much hope that isn't even necessary to be considered an option.15:50
* efried puts in back pocket15:50
efriedI agree15:50
*** edleafe has joined #openstack-tc15:50
jrollthe nova team may not have a real veto power, but they can always do things like not remove the placement code from nova or stop depending on placement15:50
smcginnisIf a team of people are working on something and they want to control its direction, then just because they work along side another group of people, that shouldn't have an impact on it.15:50
edleafejroll: the placement code will remain in Nova, albeit frozen15:50
jrolledleafe: then not freeze it, whatever, you get the point15:51
edleafejroll: yep15:51
jrollI understand the TC could overrule somehow to "force" them not to do these sorts of effective veto things, but I don't believe the TC will do that15:51
smcginnisForking is an option. A bad one, but an option.15:51
jrollforking nova?15:51
edleafesmcginnis: the idea is that it would be temporary15:52
efriedcdent: ^ is a good point - the etherpad talks about what happens to the placement project after the fork, but what about the old placement code on the nova side? Does it get removed? Frozen?15:52
jrolltechnically that works, but a fork would be dead without nova leadership15:52
smcginnisHaha, I suppose there are some that might condifer that, but I meant just placement jroll.15:52
zanebwe really really really want people to agree on the best way forward amongst themselves (though of course we are happy to help that process along)15:52
jrollsmcginnis: yeah, but if nova doesn't consume said fork... what's the point15:53
edleafesmcginnis: get placement to a stable place, freeze it, and then extract. Nova would continue to its version of placement. When the new placement is up and running, Nova can delete its placement code and work with the service from the separated code15:53
jrollwhat I'm saying is nova leadership has an effective veto whether or not they have a technical one15:53
cdentefried: I left it off simply because I hadn't thought of it yet, but presumably we'd freeze it until such a point as we've demonstrated the new stuff is healthy and then let it be removed as/when people were happy15:53
zanebthat said, technically the TC has the power to impose a solution. we just want to avoid having to use it15:53
smcginnisSomething just seems really wrong if the people working on placement want it separate and one of its consumers (granted one of its primary/only(?) consumers) could effectively shoot it down. Or even want to.15:54
cdentefried: because of the way placement works and uses config and exposes it's testable-ness, there should be very very little difrent between an in tree and an out of tree placement15:55
zanebedleafe: isn't that exactly how Gantt failed?15:55
edleafezaneb: nope15:55
edleafegannt failed because scheduler and nova were tightly bound15:55
edleafetrying to remove the code resulted in an unworkable mess15:55
edleafeSo we dropped gannt and focused on cleaning up the interface15:56
edleafethis was all pre-placement15:56
efriedSo *if*, hypothetically, the TC imposed a process, what would it be?  [any contribution] == [one vote]? Weighted by amount of contribution? Do cores get more say? etc?15:56
edleafeOnce scheduler and nova had a clean interface, then it would be separated15:56
jrollsmcginnis: I agree, I just want to point out that it could happen, if people so desired15:56
edleafeBut with placement, the decision was made to leave the scheduler in nova, and instead run a separate placement service15:57
edleafePlacement was always supposed to be separate15:57
edleafeIt was kept in Nova because some thought it would allow faster development15:57
edleafeExtraction was always "next cycle"15:58
jrollI would have to re-read to confirm, but I don't think anyone in the thread is saying it should be in nova forever, just 'not now'15:58
dhellmannI can't imagine a scenario in which we "impose" a process on anyone to make this decision. If the people involved want some outside mediation, we can help with that, but imposing something hardly seems like a recipe for future successful collaboration.15:58
cdentjroll: I think that's a correct interpretation, but it has been "not now" every six months for the last two years15:58
efriedAgree dhellmann, swhat I'm looking for here, "outside mediation"15:58
jrollcdent: yep15:59
dhellmannfrankly, if we've reached a point where we think the people involved can't make the decision for themselves without any help then I think the project is already showing signs of failing15:59
dhellmanns/the project/placement/15:59
cdentdhellmann: I think that's an extremely unfair interpretation15:59
efrieddhellmann: I think that's the issue. It's not placement people who are making it difficult.15:59
jrollcdent: to be clear, extracting it now seems right to me, but I'm not well informed on the details :)15:59
cdentefried++15:59
edleafePlacement is finally ahead of Nova. IOW, Nova still has to do work to implement the newer features of placement. So now is an ideal time to freeze placement development, extract, and then continue separately15:59
edleafeNova isn't currently bottlenecked by placement16:00
dhellmanncdent : do you somehow anticipate the 2 separate teams working better together than what we have now that is leading to this even being a question?16:00
efrieddhellmann: My answer to that is actually "yes".16:01
cdentdhellmann: the main advantage and improvement I can see is one of the things that eric has mentioned: placement expertise can be localized16:01
cdentand people who are not and never will be cores in nova can be in placement16:02
* jroll wishes he could stick around for this but has to eat so he doesn't pass out during meetings later16:02
* cdent pauses for efried 16:02
efrieddhellmann: Of note, the teams won't be all that "separate" in terms of personnel. I anticipate there being about the same number of still-nova-core placement cores as non-nova-core placement cores.16:02
dhellmannI can see how that would make some people happy. I don't see how that makes collaboration happen more smoothly.16:02
smcginnisI don't think it's about making some people happy. It's about letting a team control their own project.16:04
edleafedhellmann: if the idea is that Nova will be the only consumer of placement, I would agree with you16:04
dhellmannsmcginnis : I agree, in principle. But setting the situation up so that the decision is made through confrontation doesn't feel like a good way to start out.16:05
smcginnisWell, back to my earlier comment, I don't even see why this is confrontational. If the team working on placement wants to extract it to its own thing, why is this even an issue.16:06
dhellmannthat's an excellent question16:07
dhellmannI believe there have been a couple of technical answers to that question, so it sounds like all of the people involved do not yet agree.16:07
edleafesmcginnis: and this isn't a reactionary move. This has been the intent since placement was started16:07
smcginnisedleafe: Another good point.16:07
edleafesmcginnis: We simply feel that now is an ideal time to do this16:10
cdentyes.16:11
*** tellesnobrega has joined #openstack-tc16:11
smcginnisIt sounds like it to me, but again something I think should be up to the folks working on placement.16:11
efrieddhellmann: The dissenters have been a vocal minority, and of people who aren't historically heavy placement contributors.16:11
efriedcorollary: The dissenters seem mostly concerned with the impact to the nova project16:12
edleafeefried: I haven't heard of any specifics as to how Nova would suffer. Just some hand-wavy generic statements16:13
edleafeDo you know of any?16:13
efriededleafe: I have heard specific arguments, but none that I thought had a lot of merit, no.16:14
edleafethx16:14
efrieddhellmann: ^16:14
*** e0ne has quit IRC16:16
*** bswrchrd has joined #openstack-tc16:18
efriedSo dhellmann "it sounds like all of the people involved do not yet agree" <== depends what you mean by "people involved".16:20
efriedMajor contributors to placement itself agree (though Jay is a loud +0), assuming contribution is measured by commits. If we include reviews, we get a little bit of a shift toward the dissenting side.16:20
efriedIf we include "architecture" - the talkytalk that leads to code and reviews - a little more shift.16:20
dhellmannwho owns the code today?16:20
efrieddhellmann: "owns" how?16:20
evrardjpdhellmann: isn't that the Nova PTL? ;p16:21
dhellmannit's in the openstack/nova repo, right?16:21
efriedyes16:21
dhellmannso then I would expect the nova core team to be involved in the decision16:21
dhellmannnot solely, but to be included16:21
efriedWell and good. How involved? One vote per? And to the exclusion of other contributors?16:21
evrardjpMaybe I am out of bounds here, but that's a nova thing, so nova team decides, and if no consensus Nova PTL decides?16:21
efriedokay16:21
dhellmannI don't think we've had to resort to formal voting structures in the past. Why do we need that for this decision?16:22
cdentevrardjp: what is "the nova team"? Is it just the cores? What does it means when some signficant (large) chunk of the code was composed by non-cores?16:23
efrieddhellmann: In case not doing that leads to stalemate, which is a distinct possibility.16:23
smcginnisEven though I've admitted I don't fully understand the issue, this is all coming across as a hostage situation. That's extreme, but there are parts about it that seem that way based on what I've seen so far.16:23
efriedYeah smcginnis, good analogy. I was going to say, it feels like Georgia asking the Union whether it's allowed to secede.16:24
evrardjpcdent: prior doesn't matter -- code dies at every commit. Ppl actively working on it now "owns" the code. Core or non core it doesn't matter to me.16:24
cdentevrardjp: sure, same thing: significant maintainership of placement is not nova-cores16:24
mnaserso i did some quick hacking and i identify 51 authors that have worked on the placement code16:24
mnaserwhat's against setting up a quick poll for those and asking them on their say in that?16:25
efriedevrardjp: Most commits and reviews in the last, say, six months => Jay, Chris, me, Tetsuro, Ed. (cdent does that sound about right?) That's two nova cores (one heavily pro-extraction, one vocally +0) and three non-nova cores (all pro extraction).16:25
mnaserthe code i used to build it out: http://paste.openstack.org/show/728437/16:25
dhellmannlook, there's nothing at all preventing you from extracting the code into its own repository today. you can just do that, but it would *fail* if the teams using the code don't agree to use that version of the code. so if the nova team isn't convinced, how would a vote help that?16:26
efriedmnaser: I like that. As informational, not actionable, it can't hurt, can it?16:26
mnaserthere's some automation in there but mostly seems to be folks with actual commits in there16:26
evrardjpagreed with mnaser view's except I think this idea should come from melwitt , but I am pedantic there :p16:26
cdentmnaser: doing a "quick poll" doesn't address dhellmann's main concern (as I understand it): We need to all work together after this. There seems to be concern that that might be challenging.16:26
dhellmannyes, that's exactly my concern16:26
mnaserIMHO: if you want to split placement, you're going to have to front the extra work, so it will be a bit more heavy on the placement team16:27
edleafeThe problem with any kind of vote is social. If the Nova supercores don't want it to happen, it isn't going to happen.16:27
cdentmnaser: that's understood. I've already done it 3 times in the past two years (as experiments)16:27
dhellmannI have no doubt of our ability to solve any technical issues with extracting the code.16:27
mnaseri like to think if the nova team has most things taken care for them in terms of extracting the entire code base, it won't be that much of an issue to deal with16:27
mnaserbut if it starts taking up their cycles, i can imagine it not being a subject of interest for them16:27
* dhellmann has to step away16:28
mnaserhell, if it comes down to it, this feels much easier for me on a deployer, but start a new project called $something_other_than_placement, copy the code over, and slowly start extracting things out of the nova version until its non existant16:28
mnaserand if nova cores are -2'ing a reasonable patch to remove functionality from the "internal" placement out to the new external service.. then we can discuss that16:29
mnaserbut it feels easier to have a seperate service run side by side for migration purposes rather than take one down and replace it, but thats just my operator hat16:29
edleafemnaser: it already runs as a separate service16:30
cdentmnaser: that's a completely doable thing, and is within the options already being discussed.16:30
mnaseredleafe: oh i'm aware, but it feels like the current move is removing it from nova and putting it somewhere else, in the same cycle16:30
mnaseralso maybe as an intermediate step, instead of nova.api.placement living in nova/, we just move that to a seperate repo and it gets imported instead.. as i'm thinking out loud, maybe others already came to this conclusion, but code living in a seperate repo doesn't have to be tied to the idea of it being consumed by other projects16:31
*** mriedem has quit IRC16:32
edleafemnaser: the plan has *always* been for placement to be separate. This isn't a new thing. It just keeps getting postponed until "next cycle" for $REASONS. Now that placement is ahead of Nova, it seems like the ideal time to finally do it.16:32
edleafemnaser: Nova only communicates to placement via HTTP.16:32
mnaseri mean, some sort of compatibility shim for 1 cycle would be nice at least, even if its just importing something from the placement libs16:33
cdentmnaser: that's not necessary. placement in nova and placement out of nova are the same thing16:34
edleafemnaser: I'm not sure I follow. Nova doesn't work directly with any placement code. Nothing on the Python level16:34
mnasercdent: but think of deployment tools/downstream tools16:34
mnasere.g in openstack ansible we deploy the placement api wsgi which comes in the nova package16:35
* cdent nods16:35
mnasernow we have to build out a whole new role that deploys placement alone, rdo/etc have to rebuild new packages that are outside the nova namespace, etc16:35
efriedI agree with dhellmann that it's not about technical challenges. There's nothing there that we can't overcome relatively easily.16:35
* cdent nods at efried 16:35
mnaserefried: the reason i go back to technical challenges is i'm hoping that's the only reason that's holding us back from doing it16:35
efriedmnaser: It's not. It's not even one of the main reasons.16:36
cdentefried++16:36
mnaserwell, i'm hoping that we're discussing on technical terms of "this is a better solution" rather than "i dont like this"16:36
edleafemnaser: it seems to be a fear among some nova cores that an independent Placement will go rogue and thumb its nose at Nova16:36
efriedwhich would of course be suicide16:37
mnaserpretty much, considering it is the biggest and heaviest consumer16:37
efriedassuming it was even considered16:37
efriedwhich it wouldn't be16:37
efriedthat's just... silly.16:37
mnaserand i'd hope that in this case, we can figure it out if it comes down to that.16:37
efried++16:38
mnaseri.e. if placement says "no, you cant do this, because we built this other feature you should leverage"16:38
edleafeefried: that's why I asked if you were aware of any technical objections16:38
efriedwhich happens all the time today.16:38
mnaserthen that's fine, but if placement says "no you cant do that because we don't want to"16:38
mnaserthat's different16:38
efried"because we want to express our independence from Nova, like a rebellious teenager".16:38
efriedYeah, I hope we're all more mature than that.16:38
mnaseri like to think we're not in a place where that's an issue.  if anything, i feel like this might help blossom placement and increase the velocity of stuff being added to it16:39
evrardjpmnaser: we wouldn't have to build a new role for placement, but it's indeed a pain I wanted to discuss just after :)16:39
cdentI'd just like to note that we're doing a lot of speculating here, without all the relevant people16:39
edleafe"You don't understand what my life is like!!"16:39
efriedmnaser: ++16:39
mnaserbecause now placement devs feel free to iterate quicker, as long as we agree to maintain some sort of jobs to make sure that you dont break downstream consumers (such as nova)16:39
edleafecdent: true, this is just based on the email thread16:39
mnaserso having jobs inside nova etc, but that's a given16:39
edleafemnaser: of course. Nobody wants to break anything16:40
mnaserthe only reason i'm not fully supportive of it yet is that i know mel as PTL mentioned that she sees value in keeping it, and i would want to hear her side of it16:40
cdentmnaser: yes we've already got stuff in place so that nova functional tests can still run a placement16:40
mnaserbecause i'm sure as a PTL she might be seeing things that i have no idea in terms of roadmap/etc16:41
efriedmnaser: Yes. Nothing really changes there. Nova scheduler is running placement. We flip from installing it from the nova project to installing it from the placement project and we're done.16:41
* efried rereads melwitt's contribution to the ML thread...16:41
mnaser(with my deployer hat on though, i'd still hope that for one cycle we can still maintain nova-placement-wsgi in repo)16:41
mnaserthat way it helps us transition a tad bit easier16:41
cdentmnaser: yes, we'd want to do that. there's at least two ways to accomplish that16:42
evrardjpin the past things were pulled out of the repositories and transitioned into things like oslo. Isn't that similar? If not, why? could we make it similar?16:43
cdentevrardjp: this is more like cinder leaving nova, rather that oslo. oslo is shared code16:44
efriedcdent: What does it mean to extract "as a repo within the compute project"?16:44
evrardjpcdent: I agree, but we said cinder leaving nova already -- I am curious why it's not like oslo.16:44
evrardjpwhy can't this new place be shared?16:44
efriedshared in what sense evrardjp?16:45
evrardjpif new place happens16:45
evrardjpefried: I am new. I am just comparing to things to understand.16:45
cdentefried: compute is the overall project of which mel is the ptl. It has several repos. nova is the biggest, but there's also novaclient, os-traits, others. as a collection they are "compute"16:45
cdentbeing a repo in the compute project means that placement is still "compute"16:46
mnaserefried, cdent i think the better term is the compute team16:46
mnasernova team, subprojects inside16:46
mnasers/subprojects/projects/16:46
cdentone of the concerns with that is the perception of not bein separate enough16:46
evrardjpcdent: that can be resolved separately?16:47
evrardjpcan that*16:47
mnaser*personally* i dont write stuff that talks to placement but if my application depended on it but it lived under nova, it would feel.. weird.16:47
fungioof, i go to lunch and you people leave me hundreds of lines of scrollback16:47
fungier, i mean, thanks!16:47
mnaserfungi: have fun :)16:47
efriedcdent: What are the process implications of that? Taking the examples you gave, they inherit nova-core and then get to add extra cores. Is that the extent of it?16:47
evrardjpfungi: hahah yw16:47
evrardjpefried: you could have different cores on different repos...16:47
mnaseri think that solves the velocity issues but it might not resolve the issue that folks will still think its a nova thing that i can use16:47
cdentmnaser: yes that16:47
evrardjpmnaser: but that can later be changed in governance by having this repo as its own thing16:48
evrardjpif needed16:48
mnaseri.e. think cinder depending on an api that is not nova specific but lives in nova16:48
mnasersure, that is a valid point too16:48
mnaserthis can be split into two steps, and that way it'll still somewhat be under nova control16:48
mnaseruntil it can graduate to be it's own thing.16:48
cdentefried: from a purely technical standpoint there is little that _has_ to be different between placement within nova, but separate repo, and placement its own project team16:48
mnaserand that way it's just a matter of a governance patch16:48
efriedSorry I'm slow, but now I even more don't understand the difference.16:49
mnaseri think splitting this into smaller pieces *might* make it a little easier16:49
efriedIt's just a governance patch?16:49
evrardjpto what I hear, there are two opinions, one that consider it would hurt the nova catching up features, and one that consider it wouldn't hurt16:49
mnaserso step 1: split placement repo outside nova repo, but keep it under nova team16:49
cdentthe reasons I would like to see it be its own project team, now, are at leat twofold: if we're going ot make change, let's make a lot of change because we seem incapable of moving quickly on this issue.16:49
mnaserstep 2: move placement outside nova team (governance patch)16:49
mnaseri feel like step 2 can happen quite easily and quickly, step 1 is the hard one.16:50
cdent2) there is a real perception issue out there in the world, it's been mentioned in the thread, and mentioned in other discussions. those perceptions matter16:50
edleafemnaser: IMO, the reverse is true16:50
cdentas evidenced by this discussion16:51
edleafemnaser: the code is essentially separate; we would just do some directory shuffling.16:51
*** ricolin has quit IRC16:51
mnaseredleafe: i guess i have this sort of perception that the code is heavily tied into nova16:51
efriedwhat does governance mean in this context? That placement doesn't get its own PTL? That the nova core team has "architectural control"? That the blueprint/spec process is not separated?16:51
mnaserso extracting it out seems like a big task but i might not know that16:51
mnaserefried: without placement in it's own team, placement's ptl is the nova team ptl16:52
jrollare the anti-extract people okay with extracting to a separate repo, but within nova governance?16:52
mnaserhowever, core's on project is a decision of the ptl16:52
jrollefried: right, it means it's another nova project, just like python-novaclient or os-traits16:53
jroller, another compute project16:53
mnaseryep ^16:53
edleafeefried: all of the above16:53
zanebmnaser++16:53
evrardjpthen as a separate repo, you can decide things easier, IMO.16:53
edleafeefried: we are also tied to all of Nova's processes, Nova's release cycle cadence, etc16:54
efriedjroll: melwitt (the ptl) is in favor of extraction but remaining under compute (http://lists.openstack.org/pipermail/openstack-dev/2018-August/133452.html)16:54
mnaserright, but as a project under governance, you'd have to be using the openstack release process and likely you'll be on a similar cadence16:54
mnaseryou can still do releases of deliverables seperately16:55
jrollefried: and the others?16:55
mnaseri.e. you can do placement 2.0.5 if the nova ptl OK's it16:55
edleafemnaser: sure. I was just pointing out the implications16:55
mnaseryou dont have to release all nova deliverables all at once16:55
mnasersmcginnis: can maybe confirm16:55
jrollmnaser: correct16:55
evrardjpedleafe: a team can have multiple deliverables that have different releasing cadences16:55
efriedjroll: dansmith has expressed that he wants to make sure we're not arguing for full extraction for the wrong reasons (http://lists.openstack.org/pipermail/openstack-dev/2018-August/133454.html) but also that there are issues of dev velocity and collaboration which argue against extraction at all (http://lists.openstack.org/pipermail/openstack-dev/2018-August/133516.html)16:55
evrardjpoh mnaser said it. :)16:56
jrollefried: trying to get a feel for if extract-within-governance has the same issues as extract-and-separate-governance16:56
edleafeevrardjp: yes, as long as the PTL embraces that16:56
jrollefried: thanks16:56
efriedjroll: jaypipes came in with a nominal +0, but it's definitely ambivalence as opposed to apathy (http://lists.openstack.org/pipermail/openstack-dev/2018-August/133510.html)16:56
efriedjroll: The remainder of the voices have been pro, afair16:57
mnasergiven that the PTL feels it's okay for it to live in a separate repo.. i would proceed.  once there are actual real consumers of placement beyond nova, then we can move it out of governance.16:57
jrollefried: I did read the thread, but wasn't sure if there was other discussion. thank you16:57
efriedjroll: Certainly there has been other discussion, but not really anything that hasn't been said in the ML thread. I could be wrong.16:58
jroll👍16:58
mnasergiven that no one actually consumes placement right now, i dont see a super important need to split it out to its own team, but if we can get through step 1 and move it into a seperate repo, it'll help the developers start working on it16:59
cdentmnaser: what do you mean when you say "no one actually consumes placement" and what's your data?16:59
mnasercdent: from reading that topic, it looks like reporting happens but not consumption, though i may be wrong16:59
mnaserso the only consumer of data seems to be nova, where other tools are just reporting17:00
efriedI'm not sure I agree with the distinction between "reporting" and "consuming".17:00
cdentboth dan and jay have said that without looking at all the data17:00
* jroll thinks placement is clearly its own team, thinks that is a positive thing, and thinks we should structure governance accordingly17:00
efriedjroll: ++17:00
mnaserso: create `openstack/placement`, cores are nova-cores + whomever the ptl deems is good for that and it's a project under `nova` team.  once that step is done, we can look into moving it out into its own team in governance17:00
cdentmnaser: just to be clear, why wait?17:01
mnasercdent: honestly?  because this is probably the easiest way to get this accomplished.  this is a good compromise from both teams to split it out17:01
mnaseronce nova seems to realize that "hey this ain't so bad"17:01
cdentI would hope you would be honest with me all the time :)17:01
efriedmnaser: IMO that's one of the major concerns. I would like to see the placement core team to be independent regardless of the governance dealy.17:01
mnaserthen it might be easier to drop it entirely after17:01
mnaserefried: i like to think that the ptl will put those who are appropriate to be cores on placement17:02
efriedmnaser: But if we start off with nova-core == placement-core, and a -1 to adding a new core is essentially a veto, it sets us up for a continuation of some of the political issues we have today.17:03
cdentcore-ness is only one of several issues related to independence17:03
efriedmnaser: issues which are strong motivators for this initiative in the first place.17:03
efriedyeah17:03
mnaserafaik core-ness is not happening because nova doesn't do "partial cores"17:03
efriedmnaser: Partially correct, yes.17:03
efriedmnaser: Also, politics.17:03
mnaseri dont think its because ptls want to disallow people who know placement to not touch it17:03
evrardjpnova or compute partial cores?17:05
*** mriedem has joined #openstack-tc17:05
*** e0ne has joined #openstack-tc17:05
*** jpich has quit IRC17:05
*** annabelleB has quit IRC17:06
evrardjpjust curious if cores on traits are the same as nova, etc.17:07
evrardjpfor example17:07
efriedevrardjp: In that example, os-traits doesn't have its own core team at all - it's fully inherited from nova.17:08
efriedevrardjp: os-vif is maybe a better example: https://review.openstack.org/#/admin/groups/1175,members17:08
efriednova-core, plus three17:08
mnaserhttps://review.openstack.org/#/admin/groups/572,members novaclient seems to have a different team17:09
evrardjpso that fits the bill?17:09
efriedmnaser: no, same thing.17:09
efriedmnaser: nova-core, plus two.17:09
mnaseri mean, i think as a start, nova-core + 2-3 placement specific cores17:09
mnaserheck, they cant even block code from merging if it's up to that, but there's no need to assume bad intentions17:10
mnaserthis will start the process of separation and allow increased velocity and maybe take a small load off the placement team17:10
efriedmnaser: Mechanically, what is the difference between "under nova" and "independent"? A choice between two different and mutually-exclusive governance patches?17:14
*** mriedem has quit IRC17:14
*** annabelleB has joined #openstack-tc17:15
*** e0ne has quit IRC17:15
dimsi like the os-vif model17:15
dhellmanntc-members: I'm about to propose a bunch of patches to update our repositories for the python3-first goal.17:15
efriedmnaser: I.e. could we do all the things - create the repo, set up the core team, extract the code, set up the infra, etc. - and let the governance patches be the deciding ground for that piece?17:15
openstackgerritDoug Hellmann proposed openstack/governance master: import zuul job settings from project-config  https://review.openstack.org/59370117:16
openstackgerritDoug Hellmann proposed openstack/project-team-guide master: import zuul job settings from project-config  https://review.openstack.org/59370417:16
mnaserefried: under nova would need the PTL ok to split the code inside the team.  your own team would involve an entire application process (afaik)17:16
mnaserabout what is placement, what is it good for, what does it do, etc.17:16
*** dtantsur is now known as dtantsur|afk17:17
cdentmnaser: agree some of that would be necessary (and some of it already exists) but ttx appeared to suggestion some of it could be fast-tracked (if that's the way things went): http://lists.openstack.org/pipermail/openstack-dev/2018-August/133495.html17:18
mnaserright, but i dont see the big reason to make all those majors changes for that at the moment.  i'd start with a split under compute team.17:18
mnaserif it's because you don't want to see nova-core in the list of cores, i think if we split placement, the initial core team of placement *should* be nova-core.17:19
cdentI'm going to need to leave soon, but I guess I can/will catch up in the logs. Before I go, just want to thank everyone for paying so much attention.17:19
cdentmnaser: it doesn't really have much to do with cores at all17:19
dhellmannhttps://review.openstack.org/#/q/topic:python3-first+(+openstack/service-types-authority+OR+openstack/project-team-guide+OR+openstack/project-navigator-data+OR+project:openstack/governance+OR+project:openstack/openstack-specs+OR++project:openstack/election+OR+project:openstack/goal-tools+)+is:open17:19
cdentit's about a) striking while the iron is hot, b) addressing long held perception issues about what is possible17:19
mnaseri doubt most people even know our governance model and its depths, if openstack/placement is a thing, most people dont even know that its under nova team17:19
mnaseri don't think that way of going about things is more productive, i dont think anyone looks at governance and says "oh openstack/placement is a nova thing, nevermind" .. the governance stuff is very much just a 'political' thing.  we can look into it, but it certainly doesnt change much17:21
mnaserrepo name is what most people look at anyways17:21
mnaserwho controls openstack/os-vif or openstack/os-brick .. dunno but if i need to consume them, i will17:21
cdentwe may wish to get some input from people who have wanted to use or develop against  placement on that account. I've heard different things from different people17:22
efriedHow many of the action items are common to both approaches, and not blocked by the decision? E.g. can we create placement and placement-specs repositories in gerrit, start shoving code in them, and set them up for zuul while we're still discussing governance?17:22
dimsefried : do you see a push back for the os-vif model? (new placement-core with nova-core as included group)?17:22
mnaserefried: given that melwitt said she's okay with that, then yes, i think it would be okay.17:22
efrieddims: I think that would be fine, assuming reason is used when nominating and ratifying additional placement-core team members.17:23
dimsright17:23
efriedmnaser: I was asking from a technical standpoint whether we can get things accomplished while we're still discussing the governance decision.17:24
efriedor if there's some aspect of that where we would be blocked until that decision is finalized.17:24
mnaserefried: i think if the ptl said they'd be okay with splitting repos, then i dont see the big problem with it. i do think you still need to use nova-specs for now17:25
mnaserbecause specs are a team thing rather than a project thing (i think).17:25
cdentefried: nothing is blocking us from making physical extraction progress, in large part because we'll want to do a lot of it in a third repo that we then push to gerrit17:25
dimsefried : the mechanics is here - https://docs.openstack.org/infra/manual/creators.html - "Add New Repository to the Governance Repository" is optional, you can start without governance and then submit to governance17:25
dimsexactly cdent17:26
efriedWell then, cdent, I say we get started with those parts of the process, since the PTL is in favor of *some* form of extraction. Get some momentum going.17:26
dims++ efried cdent17:27
edleafeefried: I have some cycles to work on that17:27
edleafeBut let's discuss in -placement17:27
cdentefried: we already are, behind the scenes experiments have been in progress17:27
cdentwith tools and strategies for extraction17:27
efriedcdent: Cool, let's raise the curtain.17:27
*** lbragstad has quit IRC17:28
cdentefried: third times a charm? or is fourth?17:28
cmurphyI think this has moreorless been said but in terms of a decision process I believe we do already have a process, which is that the PTL is the "the buck stops here" person, it's ultimately up to her to decide what happens to the compute project17:28
efriedcmurphy: The counterargument is that, when in the course of OpenStack events it becomes necessary for one project to dissolve the political bands which have connected it with another...17:29
dimscdent : this time do it in a openstack/ repo :)17:29
cdentdims: my constant desire to get consensus and agreement before doing things has not served me well in this instance17:30
cdentit apparently makes me look disruptive. very sad.17:31
edleafeefried: so eloquent!17:31
melwittI'm in favor of making progress -- and thus extracting placement into its own repo under compute. but I don't agree that "placement is ahead of nova" and there are features that don't yet exist in placement, that we need in nova, that are part of what placement was designed for as a project in nova. affinity, numa, shared storage. it doesn't make sense to me to split placement out into a separate organization while we are in the middle17:31
melwitt of implementing features that will require tightly coupled cooperation. that's my opinion17:31
efried /nick tjefferson17:31
cdentmelwitt: I hear you, but I don't agree with your assertion that there is any tight coupling there.17:32
melwittokay17:32
efriedmelwitt: Do you feel like cooperation would suffer?17:32
edleafemelwitt: My concern is the unspoken assumption that there would not be cooperation17:32
edleafeOr a diminished level of cooperation17:33
dimsedleafe : y that would be weird17:33
melwittthat is why, for example, in a corporate situation you don't split teams whose components need to integrate closely together into separate organizations. things go much more quickly and smoothly if the group is a cohesive entity moving toward a common goal. and IMO the compute project is that common goal17:34
dimsmelwitt : so would  (new placement-core with nova-core as included group) work for you?17:35
mnaseri dont think there is any scenario in all of those where i would be okay with the placement repo cores not included nova-core for start17:36
mnaseri'm hoping thats a given17:36
melwittnova-core inclusion is a minimum, IMO17:36
dimsmnaser : 3 choices (just nova-core in charge, placement-core including nova-core in charge, placement-core seeded with folks in nova-core in charge)17:37
dimsack melwitt17:38
dimsi am hoping more folks get added to placement core as they get active and then we can revisit in a release or two?17:39
dimsmelwitt : one argument against it if i read correctly was that not all nova-core(s) are active in placement. right?17:40
evrardjpmelwitt: what we've moved to in openstack-ansible is that every repo gets its own core team, and we integrate the "global OSA" core team into each of the roles. We have a completely different structure, but that allows malleability17:40
dhellmannthat sounds like how oslo is set up, too17:41
dimsevrardjp : for the longest time, oslo has been doing the same17:41
evrardjpyup :)17:41
evrardjpJust saying, we've got prior expertise there :)17:41
melwittdims: I think you'd have to clarify that with those who are against it17:41
evrardjpit's been good to us so far17:41
*** e0ne has joined #openstack-tc17:42
dimsmelwitt : guess for the new repo to be under nova in governance, nova-core would be a must17:43
dimsmelwitt : just looking at different view points17:43
cdentNow I really gotta go. Will catch up later. Thanks again.17:43
*** cdent has quit IRC17:43
efriedI need to run as well. Thanks very much for the discussion, all.17:44
dimsedleafe : efried : may be we should start there ... :)17:44
efrieddims: Acknowledged.17:44
edleafedims: I don't know of anyone who said they didn't want nova cores to be placement cores.17:45
edleafeCurrent nova cores only use their powers in the areas they have expertise. I wouldn't expect that to change17:46
dimsedleafe : ++17:46
dimsso let's get rolling with a gerrit repo request edleafe17:47
dimsmelwitt : ^17:47
*** e0ne has quit IRC17:51
*** diablo_rojo_ has joined #openstack-tc17:53
*** diablo_rojo_ has quit IRC17:53
*** diablo_rojo has joined #openstack-tc17:53
dhellmanntc-members: did anyone have anything to add to the searchlight PTL appointment after ttx's comments? https://review.openstack.org/#/c/590601/17:54
* cmurphy 's opinion is unchanged17:58
mugsieyeah, I think we give the new team a cycle, and see what happens18:00
openstackgerritAndreas Jaeger proposed openstack/governance master: Add operations-guide repo for Operations Guide team  https://review.openstack.org/59124818:01
openstackgerritMerged openstack/governance master: Reorganise OpenStack-Ansible deliverables  https://review.openstack.org/58944618:02
openstackgerritMerged openstack/governance master: Move refstack-client, refstack and python-tempestconf to interop WG  https://review.openstack.org/59017918:02
openstackgerritMerged openstack/governance master: Add a house rule about how to signal appointed PTLs  https://review.openstack.org/59079018:02
openstackgerritMerged openstack/governance master: appoint Omer Anson PTL for Dragonflow for Stein  https://review.openstack.org/59147018:03
openstackgerritMerged openstack/governance master: appoint Sam Yaple PTL of Loci for Stein  https://review.openstack.org/59147418:05
openstackgerritMerged openstack/governance master: appoint Claudiu Belu PTL of Winstackers for Stein  https://review.openstack.org/59147618:07
*** e0ne has joined #openstack-tc18:14
*** lbragstad has joined #openstack-tc18:17
*** tellesnobrega has quit IRC18:31
*** cdent has joined #openstack-tc18:34
*** e0ne has quit IRC18:42
*** mriedem1 has joined #openstack-tc18:42
*** hongbin has joined #openstack-tc18:51
fungiokay, i think i'm about caught up finally18:52
fungicmurphy: while the ptl is the "the buck stops here" person for what happens to the compute project, a split-out repository under its own team isn't necessarily happening *in* the compute project (though it might be nice for everyone involved if the plan was for it to be anyway)18:53
fungimnaser: i can think of a number of reasons why nova-core might not be a member of placement-core even if it's within the nova team as a whole. that's entirely up to the ptl to decide. it might be a little weird, but our governance really says nothing about core review teams in that regard18:55
*** annabelleB has quit IRC18:58
*** annabelleB has joined #openstack-tc19:02
*** mriedem1 is now known as mriedem19:04
*** e0ne has joined #openstack-tc19:06
cmurphyfungi: that was partly my point and i think partly the direction of the conversation (I'll admit I skimmed it), really the placement team could create whatever repositories they want with whatever governance and core structure they want, but what happens to the *compute* project is up to melwitt, and it seems like whether or not nova will willingly consume the split out project is the crux of the19:14
cmurphyquestion19:14
fungiindeed, i wholeheartedly agree19:16
*** dkrol has joined #openstack-tc19:16
efriedThe fact that the core teams will greatly overlap should hopefully mitigate that level of drama.19:20
efriedif there was any danger of it in the first place.19:20
cdentIs there?19:21
efriedAre you asking me?19:22
cdentNot you specifically. It was a question that was raised earlier in the discussion but never really answered19:23
zanebI feel like we should be focusing less on how to handle a nuclear scenario than on making sure we never get near that scenario coming about19:24
dhellmannzaneb +119:25
dhellmanntc-members, do we want to have a "team photo" taken with the TC at the PTG?19:25
TheJuliaI think it would be a good idea19:25
smcginnisThat might be fun.19:25
cdentI'm confused/concerned that people see "being independent" as nuclear?19:25
zanebdhellmann: +119:25
*** e0ne has quit IRC19:26
dhellmanncdent : the nuclear option is more having some outside body get too involved in what should be a decision by the folks directly involved19:26
cdentrather than something we should be striving for given that we've talked frequently about wanting to make nova smaller/less massive in various dimensions19:26
fungii'm on the fence about the photo. not sure if that makes us seem more exclusive, or more approachable19:26
zanebcdent: failing to agree and having a fork, of either placement or Nova or both, with the TC knocking heads together to sort it out is the nuclear scenario19:27
zanebmetaphorically speaking, obviously19:27
dhellmanndiscussions about how to vote and how to weigh votes makes it seem like the process is being engineered to ensure an outcome instead of just getting folks to agree on a plan like we would for any other change19:27
cdentzaneb: ah okay, if we had not brought it up with the tc at all, yet, would it feel different?19:28
cdentfungi: I agree that photos are weird that way19:28
cdentI tend to not want to do them19:28
dhellmannon the other hand, being married to a historian, I see the value in a record of that sort19:29
efrieddhellmann: Realistically, *any* variant of the democratic process will yield the same result.19:29
efrieddhellmann: So in the sense that we're trying to get it to *be* a democratic process at all, yes, we're trying to engineer an outcome.19:30
zanebcdent: it's fine to bring it up! but there has been a lot of discussion along the lines of exactly which powers the TC would invoke to force a decision if we had to, and while that's academically interesting, let's not get to the point where we have to19:30
fungiyeah, i was basically watching the ml thread and waiting for someone to approach the tc collectively19:31
dhellmannefried : in what way is it not democratic now?19:31
*** EvilienM is now known as EmilienM19:31
cdentfungi: as you'll recall, efried approached the tc as a result of joint discussion in the scheduler meeting19:31
fungii'm also very much in favor of focusing on mediation rather than dictating a solution19:31
efrieddhellmann: Well, the other options on the table include "the Nova PTL decides". That's not democratic.19:32
fungicdent: yep! ;)19:32
efrieddhellmann: There's also been an undercurrent of "there exists a vocal minority with effective (if not explicit) veto powers".19:32
dhellmannefried : do you think melwitt would just make that decision on her own without consulting everyone involved?19:32
zanebefried: PTLs are elected every cycle...19:32
efriednonono, of course not.19:33
efriedbut19:33
efriedmight also not take a vote.19:33
dhellmanndo you think that minority should not have any say? or that they should just be overruled by a vote?19:33
fungii'm less interested in any vocal minority with effective veto powers, and more interested in any minority who feels disenfranchised and unable to decide their destniy as a group19:33
dhellmannwhat is the effective result if they are ignored and the extraction happens? is that somehow going to convince them that it's a good idea after the fact?19:33
efrieddhellmann: All extremely good questions, and exactly why we're here.19:34
dhellmannok, well, I'm waiting to see what happens as you continue to try to convince them, because that seems like the only way forward to me19:34
efriedPut another way: *should anyone* have veto powers? If so, based on what criteria?19:35
fungii have to wonder whether the situation be any better for the nova team if the majority of the placement-only contributors get fed up and go work on something else?19:35
efriedfungi: Unfortunately, that's the kind of thing that has led to the current shortage in nova dev/reviewer volume.19:35
dhellmannefried : you're presenting this as "them" trying to force "you" to do something you don't want, but I see it that way from both sides. If there is no compromise position and there is no consensus then there needs to be more discussion.19:36
fungiwe've got an established culture of trying not to tell people they can't work on what they want to work on, mainly because that comes with significant risk that they'll work on it anyway but just not include us any longer19:36
efrieddhellmann: That's a great ideal. But there will always be situations where complete agreement is not possible.19:37
* jroll wants to be clear that when I was talking about an effective veto, I wasn't saying that it will or should happen, just that it's a possible outcome of the nuclear option (the TC making the decision that placement should have separate governance)19:37
dhellmannconsensus is not the same as 100% agreement19:37
* jroll didn't mean for it to derail the discussion19:37
fungistill, better to start from an expectation that a mostly mutually-beneficial compromise can be reached19:37
zanebjroll: hold up. the nuclear option is the TC making any decision at all19:38
dhellmannttx's recent vote related to searchlight is a great example of that: He said he opposed the appointment but would live by the decision of the rest of the group. That means we can have consensus.19:38
cmurphyagain we actually do have a pretty clear process on this that really doesn't involve the TC at all https://governance.openstack.org/tc/reference/charter.html#project-team-leads19:38
dhellmanncmurphy : exactly19:38
jrollzaneb: sure. though I think my hypothetical effective veto thing only happens with a particular decision19:38
smcginnisI don't 100% buy the PTL argument.19:39
efriedsmcginnis: ++19:39
dhellmannsmcginnis : "all disputes should be resolved through active debate and discussion"19:39
dhellmannthe PTL is the last resort19:39
efriedBecause the whole point of this discussion is that a hypothetical placement PTL would have different interests than the nova PTL.19:39
fungicmurphy: that process only necessarily applies if the dispute really is in their team, and not between their team and another group of people who don't want to be in their team19:39
jrollI also want to point out, once again, that this discussion started with efried asking if the TC might be willing to guide the discussion/decision, not step in and make a decision19:40
cdentjroll++19:40
dhellmannefried : I think you're doing melwitt a disservice by implying that she would not be objective.19:40
jroll15:29:39          efried | And the idea came up that we could possibly ask the TC to govern the process. Not make the decision - just help us wade through the politics, mechanics, process, etc.19:40
smcginnisPTL is the last resort for the project. But if a group is trying to leave that project, the PTL is just another voice, IMO.19:40
smcginnisjroll: ++19:40
efrieddhellmann: Well, it's not her job to be objective. It's her job to act in the best interests of *nova* - see above.19:40
cmurphythey are free to leave the project but not free to change the direction of that project19:40
fungicompletely agree19:41
mnaseri agree with cmurphy19:41
fungior rather, not free to change the direction of that project without agreement from that project's ptl19:41
cmurphyright19:41
smcginnisWho is trying to change the direction of Nova?19:41
*** annabelleB has quit IRC19:41
dhellmannhow is placement going to be successful at all as a separate project if the placement team and nova team can't work together? this step of extract seems like the first of many possible conflicts.19:41
efriedNobody has said the teams can't work together.19:42
dhellmannthen why do you need someone from the outside to help make this decision?19:42
smcginnisHow is extraction going to stop nova's interaction with placement being much different than it is today. There's a large part of a thought process I'm missing in all this.19:42
efriedsmcginnis: ++19:43
dhellmannsmcginnis : there seems to be an assumption that the nova team would use the version of placement that is pulled out before they agree. I don't want to make that assumption.19:43
jrolldhellmann: this came up when the placement team was talking during a meeting about how to navigate the decision, if there should be a vote or what: http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-08-20-14.00.log.html#l-6619:43
dhellmannwe don't want 2 placement services.19:43
jrolland efried came here asking if the TC would be willing to guide that process, not help make the decision19:44
dhellmannwhat help is needed, then?19:44
smcginnisIf all the folks working on placement are working on the independent one, then I would think anyone that wants to use placement would use the non-stale version of it.19:44
jrolland we kept asking what if until we were all discussing this under the assumption agreement could not be reached19:45
efrieddhellmann: We're not asking, "Help us work together." We're good on that. And I definitely don't see the nova team pulling a take-ball-and-go-home and refusing to use the new project - that's silly. We're asking "help us decide how to decide".19:45
dhellmannwhether or not placement is ready to be in its own repo is a technical decision. how do you make other technical decisions and why does that approach not work in this case?19:45
dhellmannI'm not even hearing agreement on that point so far19:46
jrollI was under the impression the technical decision of separate repos was agreed upon (and if not, the PTL wants to do it, so I think worst case the ball stops with her)19:47
efried"ready to be in its own repo" is not at question.19:47
efriedyeah19:47
zanebmelwitt and dansmith were both in favour of it being in it's own repo, as I understood it. I haven't seen anyone against that yet19:47
dhellmannok, great!19:47
jrollthe governance is the question - does that repo live under the compute umbrella or elsewhere?19:47
efried^^19:48
dhellmannso how does the nova team settle other questions of policy and why does that approach not work for making this decision?19:48
* jroll wonders how long it has been since nova leadership disagreed on a thing19:50
mnaserdhellmann: the nova team would like to split it into a project inside the compute team19:50
mnaserhowever, others feel like that's not enough and would like to move it into its own team19:51
dhellmannok, and what are the 2 sides doing to resolve that disagreement?19:51
efriedPosting on the ML. Discussing in nova IRC meetings. Reaching out to you.19:52
*** annabelleB has joined #openstack-tc19:53
zanebefried: 'We're asking "help us decide how to decide".' OK, here's how you decide. You talk about the pros and cons until you come up with a consensus everyone can live with, even if it wasn't their first choice.19:53
dhellmannright19:53
zanebwhat you don't want to do is take a vote19:53
efriedSo how do we define consensus?19:54
zanebbecause that solidifies people's positions into camps, and that's the opposite of what you need19:54
efriedVote is a way to achieve consensus that people can understand.19:54
dhellmannefried : everyone agrees they can "live by" the outcome, even if they don't necessarily like it19:54
jrollconsensus is a decision everyone agrees to live by, even if they don't like the decision19:54
zanebefried: OpenStack works by the principle of lazy consensus, so we define consensus as when people stop complaining19:54
* jroll tosses dhellmann a zinger-brownie19:54
dhellmanna vote is a way to count19:54
dhellmannit is not a way to reach consensus19:54
dhellmannyou can use it to see how people feel about a decision, but a vote has no argumentative power19:55
efriedNone of that answers the question, except what zaneb says, which is basically that anyone has veto power by not quitting complaining.19:55
cdentpoint of order here: we can't make consensus if we don't have all the parties involved participating19:55
efriedWe're never going to get everyone participating in a single venue at the same time. The ML thread has done the best job of flushing out the various voices, and I don't think discussions outside of that have added anything technical to the discussion.19:56
cdentso trying to build consensus _here_ without melwitt, dansmith, jaypipes and, based on recent inputs, members of zun is embedding positions and causing a lot of confusion19:56
cdentefried: I agree.19:56
efriedYeah, I don't want to try to build consensus here!19:56
dhellmannefried : if you have one person who won't come to any agreement, then you have to question whether that person should be involved in the discussion. But I thought more than one person did not agree in this case?19:56
efriedI want to understand *how* one would build consensus at all.19:56
dhellmanncommunicate, discuss, argue -- as zaneb said, make your case and weigh both sides19:57
zanebefried: if somebody won't stop complaining you need to listen to them until you're sure you understood their concern and addressed it, or until you're very very sure that they're a crank that can/should be ignored19:57
efrieddhellmann: Yes, to my understanding, there are two. Neither are heavy contributors to placement code. Both are approaching the topic from the point of view of what's best for nova.19:58
dhellmannis the placement team not concerned about that at all?19:58
efriedYes, which is why we're here.19:58
dhellmanndo you think their arguments are completely wrong?19:58
mriedemam i in that group? i'd like to know if i'm assumed to be part of a group w/o actually being asked19:59
dhellmannyou should be talking to *them* though, right? you don't need to convince us19:59
cdentmriedem: no, I keep hoping you'll input _something_19:59
efriednot "completely". But not with enough compelling merit to sway it the other way - *in my opinion*19:59
mriedemhey,19:59
dhellmannso it sounds like there needs to be some sort of compromise position19:59
mriedemi've made it through at least the first couple of sentences of the first email20:00
mriedemand etherpad20:00
* efried deflects zinger-brownie to mriedem20:00
dhellmannchange is hard, and introduces risk, and risk brings fear. so if you want to make change, you have to show how you're going to deal with the risk involved. doing that is going to require accepting that even if you don't think their position has merit, it still has to be addressed, because that's how you collaborate.20:01
cdentdhellmann: one of the original questions was whether or not a thing which is currently being identified as "the placement team" needs to convince another group (any other group). The discussion here indicates that thay at least should and to have best form must.20:01
cdentThe feeling on my part is that if a group wants to be self-determining there's is not to convince to be allowed, but rather to be convinced they should not20:03
dhellmanncdent : I think that the nova team owns this code right now based on our governance structure. the set of people who are contributors to the code intersect with the set of people who are formally on the nova team. and I think the union of those sets needs to reach consensus.20:03
cdentthat's not how the conversation has gone thus far20:03
cdentwhat's happened instead is that as soon as some members of nova said "hmmm, maybe not, people came to a screeching halt"20:03
dhellmannso, go argue with those people20:03
*** diablo_rojo has quit IRC20:04
cdentdhellmann: I'm in this channel because eric came here to ask for advice20:04
cdentand this is where discussion is happening20:04
cdentlater I will go argue with whoever needs to be argued with20:04
zanebit's worth noting that melwitt's position would be more accurately described as "maybe not *yet*"20:05
dhellmannok, I'm trying to give you that advice20:05
cdentdhellmann: I've not asked for the advice. efried has.20:05
efriedThere not being officially any such thing as the "placement team" makes it hard to reach "consensus", where that's defined as, "The 'placement team' has heard your objections, taken them into consideration, and tried to mitigate them as best as possible, and has decided to move forward with XYZ anyway." It's a chicken/egg kind of thing.20:05
dhellmannyou is plural20:05
dhellmannis it somehow unclear who needs to be involved in the discussion, then?20:06
efriednot at all.20:06
jrollefried: "we hear you but are doing it anyway" doesn't sound like consensus to me :/20:07
efriedhuh?20:07
zanebdhellmann: no, no, y'all is plural20:08
dhellmannzaneb : y'all is also plural, yes20:08
efriedjroll: oh, you mean the part where "I don't like it but I can live with it" is consensus, but "I don't like it" is veto. Right. That's a problem IMO.20:08
dhellmannwhich I guess makes "all y'all" meta-plural?20:08
jrollefried: sorry, maybe I misread, but it sounds like you're defining consensus as "The 'placement team' has heard your objections...and has decided to move forward with XYZ anyway."20:08
scasn.b. "all y'all" is the plural form -- "y'all" can refer to singular or plural20:09
zanebscas: false20:09
dhellmannthe thing all y'all need to agree on is not "can placement be its own team" but "will nova use the placement service after it is managed by another team"20:09
efriedjroll: The stuff in the ... is important too, but yes; that's the middle ground zaneb mentioned above.20:09
dhellmannbecause the first question does not need anyone else's input, but is moot if the answer to the second question is no20:10
efrieddhellmann: That answer is certainly yes.20:10
dhellmannis it?20:10
dhellmannthen what's the problem exactly?20:10
efried"consensus" that it should be done.20:10
efriedcomplaining == veto20:10
dhellmannah, but if you do not have consensus on the second question, then you have not agreed20:10
efriedThe second question is not the one we need consensus on.20:11
efriedIt's the question of "should we extract, and how far?"20:11
dhellmannoh, I think you're wrong on that20:11
scaszaneb: i'm only going on the time i lived in the southern US20:11
cdentefried: I believe what dhellmann is trying to say is: you can fork if you want to, but will anybody use it?20:11
dhellmannbecause forking placement and not having nova delete the old copy seems pretty pointless20:11
dhellmannnot just anybody. will the existing users use it?20:12
efriedI really, really don't believe anyone has said or even implied that they would not use an extracted placement service. cdent, true?20:12
cdentI've heard no one say that anywhere, except in this channel20:13
dhellmannis that not implied by the sentiment that it isn't ready to be extracted?20:13
efriedI don't think so, no. Maybe I'm misunderstanding something.20:13
dhellmannmaybe we should ask that question of the people who think it isn't ready, then20:14
smcginnisAgain, I think everyone is in agreement that extraction to its own repo is fine, from what I've seen.20:14
dhellmannwould they help make the extracted version work? would they deprecate/delete the old one?20:14
cdentefried: it _may_ be. if people believe that "concurrent developement" is required, then they will do that20:14
smcginnisIt's a question of ownership.20:14
zanebplacement and Nova both need each other. the solution isn't to be found in defining the group of 'placement developers' so they can decide, which is another way of saying defining the people who are not placement developers and therefore don't get a say20:14
zanebthe solution is everyone agreeing together20:14
cdentIs it perhaps the case we all talking out the sides or our mouths and being mealy-mouthed? I dion't know if we are, but it certainly feels like we're behind some vaseline or something.20:15
cdentbecause we keep going around in circles20:15
jrollperhaps it's the case that we're all making assumptions about the anti-placement-in-its-own-governance people's motivations, because they aren't talking here20:16
cdentperhaps20:16
mriedemi would benefit from less fox news-style "i've heard" and "people are saying" and just state things directly20:17
cdentthat would be nice20:17
mriedemre: my question above about which group i'm perceived to be in20:17
cdentmriedem: still none20:17
cdentnobody knows20:17
cdentwhich is fine20:17
mriedemnote: i accept nazi gold20:18
smcginnismriedem: That's for you to define.20:18
mriedemtoo soon?20:18
cdentmriedem: apparently you've brought things to a crashing halt, anything else to add?20:20
mriedemi assume everyone in this channel is just exhausted at this point,20:21
mriedemsince this convo started several hours ago20:21
*** diablo_rojo has joined #openstack-tc20:21
mriedemand i was out for a few hours, and then it's still going20:21
mriedemso assuming people are taking a break20:21
cdentfair enough20:22
* cdent eats some cookies20:22
mriedemin general, i think we all know placement is going into it's own repo, that was the plan from the start20:23
mriedemgovernance was never really talked about until now, at least not publicly20:23
mriedemi wasn't around for nova-volume becoming cinder so don't really know what that experience was like20:23
mriedemplus, what came first? ironic or the nova-bm driver?20:23
mriedemjroll: ^?20:24
jrollmriedem: nova-baremetal was first20:25
dtroyerFWIW, I really think trying to compare this to nova-volume -> cinder is not worth it, darn near everything was different back then except we used Python…20:25
jrollmriedem: and nova very much wanted it out, there was no disagreement, heh20:25
jrollother than like... upgrade procedures/testing/whatever20:25
mriedemjroll: in folsom/grizzly the upgrade procedure would have just been, "upgrade everything at the same time else dragons"20:26
jrollmriedem: sorry, migration not upgrade20:26
jrollsean and dan very much did not want to screw the users over20:27
zanebdtroyer: +1. I think that was being used as a proxy for figuring out the mechanics of voting or whatever, but that isn't where the solution lies. The solution lies in finding out why people disagree about the next step to take.20:27
fungiat this point what i'm hearing is that at least some contributors working on the placement service feel under-represented in the decision-making body which controls it, and would like more control over the direction of the service. i concur we've heard little argumentation yet from people who feel that's a bad idea, but also agree we aren't the ones they (either contingent) should be trying to convince20:31
fungiat this stage20:31
cdentfungi: that is probably a latent concern, but isn't one of the main ones that have been broadcasted. where lack of representation has been expressed as more of a concern is with non-nova consumers of placement (real and potential) such as zun or cinder20:34
cdentwho are in the group of potential contributors20:34
mriedemi personally think placement on its own governance-wise makes sense, if it's meant to be consumed by multiple projects (cyborg, cinder, neutron, ironic, cyborg, at least) and it has its own entry in the service catalog; the fear is a new leadership team taking it in a radically different direction wrt things like microversions (they are annoying so let's not use them) or not having the same types of concerns about upgrades20:35
mriedemcdent: i know you're no fan of microversions20:36
cdentso: a goal with independent governance is trying to build in equal treatment of all potential services20:36
mriedemalso,20:36
cdentmriedem: that's not _quite_ accurate. I wouldn't get rid of them at this point.20:36
cdentI think _if_ there were any change with regard to microversions, it would be "needing a spec for every single one" and the commitment to CD that they sometime imply20:37
fungicdent: if under-representation in the present governing body is only a latent concern, then what other reasons are there to form a separate team? to me, that's pretty much the only thing you get by having your own governance: self determination20:37
cdentbut nobody has said "let's do that". that's just things I've said at various times, and I'm not in charge20:37
mriedemcdent: no, but if placement is on its own and you run for and are elected as ptl,20:38
smcginnisSelf determination and the potential for others to join that wouldn't if it was part of nova.20:38
cdentfungi: what I said: to build in equal treatment of all potential services20:38
mriedemyou could say, "i don't think we should do microversions, or have a spec for all of them"20:38
melwittI think placement on its own governance-wise makes sense *at some point* but not *now* being that we are still tightly coupled and still have not implemented the features we *need* in placement20:38
melwittit makes no sense to me to split them out in different directions right now20:38
cdentmriedem: do you think after all this time that I would not be consensus oriented? I'm painfully consensus oriented20:38
smcginnismelwitt: Are you concerned they would not be implemented?20:39
mriedemcdent: i have a hard time knowing which end of the spectrum you're on at times,20:39
mriedemwrt design philosophy vs just getting something done20:39
mriedemthe main contributors to placement, namely cdent, jaypipes and efried, are all highly opinioned individuals20:40
melwittsmcginnis: I wouldn't go that far, but I think of this like an org structure. if you separate things into different orgs that could have different goals, you are reducing the ability of things to get done efficiently and cooperatively20:40
fungicdent: if you don't feel that you can build in equal treatment of all potential services while under the current governance, then that's exactly as i stated. you seek self-determination so that you may choose that path20:40
cdentmriedem: I think you're pretty aware of the stuff I've actually implemented, as different from things I'm willing to talk about20:40
cdentI'm willing to consider plenty of things20:41
mriedemmelwitt: we probably need a define a list of what nova needs that's not done yet20:41
mriedemif we're going to use that as a reason for keeping it in compute for governance20:41
melwittmriedem: yep, I think we should. I listed some in my ML responses20:41
smcginnismelwitt: I could see that in poorly run orgs, but I would hope with open source that would not be an issue.20:41
melwittmulti-cell affinity is a big one that I know Oath needs. we need NRP integration for vCPUs, NUMA, dedicated CPUs20:42
jrollsmcginnis: to mel's point, it took a long long time for nova and ironic to work well together, even though we had some common goals20:42
cdentmelwitt: those are indeed feature we all want to see happen, but how/why is there a coupling between nova and placement on those things?20:43
melwittsmcginnis: I wouldn't say it's only for "poorly run orgs". it's just what happens when you separate things under different goals, they will not be working together as well as they would under a common goal and direction20:43
mriedemit took a long time to get volume multiattach done across 2 teams and 2 apis too, but we didn't really argue about stuff, it was just a lot of cooks in the kitchen20:43
cdentassuming the nature of the current interface20:43
cdentmelwitt: and why is it you feel that a repo in nova governance is easier to manage than one that has it's own governance? what's the barrier there?20:44
mriedempeople20:44
* fungi wonders to what extent within openstack any team necessarily works with a common goal and direction20:44
mriedemit's about people20:44
mriedemthis whole debate is about people20:44
cdentsay more please mriedem20:44
efriedmelwitt: I agree collaboration is needed for those things, but only one of them requires new placement work - the rest need nova to implement the client side of what's already been done in placement. And I (still) don't see collaboration suffering as a result of this move.20:44
mriedemif we rename placement, let's name it soylant20:44
melwittcdent: there's a coupling because it will take iteratively landing things on either side to get it right. we know this. and I think it makes the most sense to keep us under one common group to do that with the least amount of friction20:45
zanebmelwitt: do you feel like the number of shared personnel might help to mitigate that in this case?20:45
cdentwe're already under one common group: openstack?20:45
melwittzaneb: it might. but looking at it from a higher level, I don't see how it makes sense to separate into separate groups under separate governance while this type of development is happening20:46
zanebefried: I replied to your email with a list of questions y'all can try asking each other to try to move closer to consensus20:47
efriedzaneb: Thanks.20:47
mriedemmelwitt: by multi-cell affinity do you mean just modeling affinity in placement in general?20:47
jrollso it sounds like a concern is silos between teams, which is historically a problem in openstack. I wonder if there's something we can do to ensure that doesn't happen20:47
melwittwe are not all tightly coupled under "openstack". we created placement to solve specific problems in nova and we are still right in the middle of solving those problems, in nova, with placement. and we still need specific features in placement. so it doesn't seem like the time to split it out as completely separate20:48
melwittI think eventually it will be completely separate and that's a vision we all have, but I don't think _now_ is the time for that20:48
efriedI don't agree we're in the middle.20:48
mriedemas efried said, i thought we had the things in place in placement with NRP to already support numa and pcpus?20:48
cdentmelwitt: if we keep waiting until nova is "done" with placement we will never extract. at the moment placement is well ahead of nova20:48
melwittyou don't think multi-cell affinity and shared storage support is in the middle?20:49
mriedemthe missing piece was the nova client side stuff for numa and pcpu20:49
cdentso now is a good time to break, if we ever plan to20:49
melwittI disagree20:49
cdentmelwitt: was that in response to me or matt?20:49
mriedemwe don't have a concrete plan for modeling affinity yet do we?20:49
melwittcdent: no, sorry. it was in response to "now is a good time to break"20:49
mriedemb/c that problem is f'ing hairy20:49
efriedmelwitt: For nrp and shared storage, I think the placement side is done - certainly done enough that tweaks can be developed whether we're together or separate, even if it consumed a lot of resources to split.20:50
melwittmriedem: we don't20:50
mriedemefried: i'd agree with that20:50
mriedemthe shared storage stuff is problems in nova20:50
mriedemas far as i know20:50
zanebcdent: what does the word 'extraction' mean in that context?20:50
efriedmelwitt: WRT NUMA affinity, what mriedem said. We're pretty far from even having conceived a solution to that.20:50
efriedbut again, extracting placement shouldn't prevent us from developing that solution.20:50
cdentzaneb: that's a good question. I think that's part of the issue here. But in this case I mean "make placement maximally available to all services"20:50
zanebextraction like hostage extraction, or extraction like tooth extraction?20:51
zanebcdent: is that part in dispute?20:51
melwittI'm talking about just regular affinity, with multiple cells. we are still blocked by the inability to do an "up-call" with a split MQ architecture and we need true affinity modeling in placement to solve that20:51
cdentzaneb: above in response to fungi I suggested that remaining under nova governance puts other projects at a disadvantage for influencing placement20:51
mriedembut we don't have a plan yet for what is needed in placement right?20:51
melwittnot that I'm aware of20:52
mriedemcdent: i wouldn't agree with that20:52
mriedemironic has gotten stuff in that they needed20:52
mriedemcyborg is working with us right?20:52
zanebcdent: I think that's a fair concern, and should be a legitimate subject of debate20:52
cdentzaneb: this is somewhat the same as the concern that mriedem was implying before: some parts of nova feel like nova will be at advantage if placement is under its own governance20:52
mriedemcinder is the only team, i'm aware of, that is hesitant to use placement while it's under nova governance20:52
mriedemsome parts of *openstack*?20:53
mriedemneutron is cool with using placement since routed networks20:53
mriedemin like pike?20:53
efriedWhat we heard from Zun, it sounds like they might be hesitant too - or at least prefer a world where their patches/blueprints would get as much attention as Nova's.20:53
mriedemmight have been ocata20:53
fungithough it does seem like once placement reaches the point at which it can be installed separate from installing nova, so that other projects can more easily declare a dependency on it in so-called "stand-alone" deployment contexts20:53
cdentI'd like to hear more from zun and blazar and cyborg when we have the chance20:53
zanebcdent: like mnaser said earlier, I'm not totally convinced that most people would even know the difference though20:53
cdentzaneb: what fungi just said20:54
cdentthe dependency weight of being 'in nova' creates a huge python import debt20:54
mriedemok so it's that other projects don't feel their requirements are being met and we (nova specs core) aren't spending time reviewing their proposals20:54
fungibeing separately installable doesn't necessarily mean separate governance however20:54
melwittthere are a number of things that are "done" in placement already, but I expect that a flurry of bugs may shake out when we integrate, and I think it would be helpful to go through that process as one group, as well20:54
mriedemfwiw, i don't know of any cinder or zun specs to nova for placement that are being ignored20:54
mriedemdo they exist?20:54
fungipython-novaclient can be installed separately from nova, yet is governed by the same team (as a crude example)20:54
mriedemor are they magical "if you extract they will come"?20:55
mnaseri mean my argument was does anyone even know who owns os-vif and os-brick?20:55
mriedemi do :)20:55
zanebcdent: oh yeah, it totally needs to be a separate repo, and there is consensus on that. everybody here is on board20:55
mnasermriedem: most probably don't :p20:55
mriedemit should be on the quiz20:55
cdentmriedem: maybe the specs don't exist becuase people have given up? I don't know about that kind of thing with regard to placement, but I'm certainly aware of that with lots of nova features20:55
cdentcf starlingx20:55
cdent(to name just one example)20:56
mriedemstarlingx has put up nova specs,20:56
mriedemwhich have had thoughtful review20:56
mriedemthat doesn't mean we should accept them though20:56
cdentsure20:56
mriedems/starlingx/windriver/20:56
zanebefried: you can also read hongbin's email as carefully but not directly saying that he doesn't care whose governance it's under as long as it doesn't ignore their patches20:56
smcginnisAre there any challenges to creating an openstack/placement and openstack/placement-specs repo and getting that moved out, then having a placement-core group created that can contain nova-core, at least to start?20:57
mriedemhongbin: you're here right?20:57
hongbino/20:57
cdentsmcginnis: we've already established that's going to happen20:57
mriedemhongbin: what changes does zun need in placement that are being ignored by nova-core today?20:57
smcginniscdent: Including a -specs repo?20:57
hongbinmriedem: we haven't started adopting placement yet, so we don't have any patch so far20:58
cdentsmcginnis: the earier discussion said not a specs repo, if the initial assumption is under nova (so uses nova-specs)_20:58
cdentsmcginnis: at this point there are only two or three pending specs that involve change in placement itself20:58
dhellmannmaybe that point need further discussion, then. it seems like an opportunity for compromise and planning ahead.20:58
cdentand the hope/expectation is that we can/will slow down to allow the nova-side to catch up20:58
mriedembut we haven't fully gotten around to stein specs time yet20:58
mriedemthey will come20:58
zanebdhellmann++20:59
cdentand we should stop them because we didn't finish _anything_ on the nova side with regard to placement20:59
mriedemin rocky?20:59
mriedemconsumer generations was added to placement in rocky and nova is using it21:00
efriednope21:00
mriedemalloc candidates member of is being used21:00
mriedemby the nova pre-request filtering stuff21:00
mriedemallow reserved equal to total21:00
mriedemi see several things done on both sides in rocky21:01
mriedemforbidden traits21:01
mriedemoptionaly placement db21:01
mriedem*optional21:01
cdentsorry, I've over generalized. we didn't finish near as much as we planned. I'm not sure why that's super relevant here, though, other than pointing out my logic flaw21:01
mriedemthat's my point21:02
mriedemi'm not sure what else was planned for rocky that didn't get done21:02
TheJuliaFor my understanding, how is nova sizing/planning work?21:03
efriedConsumer gen (https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:consumer_gen), reshaper (https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/reshape-provider-tree), nrp in allocations (https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:use-nested-allocation-candidates)...21:03
mriedemfor the tc people in here that don't work on nova,21:03
mriedemi don't want generalizations to lead them to believe what reality is in nova21:03
mriedemor what's getting done21:03
efriedShared storage (aborted attempt in libvirt)21:04
mriedemsure, that was never a blueprint right?21:04
mriedemit wasn't a concerted effort,21:04
efriedFor some values of "never".21:04
mriedemand i'm pretty sure when you guys declared mission accomplished i said, "let's maybe test it first"21:04
cdentmriedem: we did some detailed progress on things, but didn't progress on the big picture of nested resourece providers or shared providers as the big main selling points21:04
efriedTo give a concrete example, IMO the reshaper series could have been completed in rocky if we had had a couple more qualified core reviewers early on to land the placement side of it.21:05
mriedemefried: sure, but the reason there is a -2 on the api change is to make sure the client side bits are good21:05
mriedemthis is why volume multiattach took like at least 3 different APIs in cinder,21:05
mriedembefore we had it all working properly on the nova side21:05
efriedYes, and I'm saying the client side could have gotten more, earlier attention if the placement side had been completed earlier.21:05
efriedPoint being, I don't get this argument that splitting placement out will somehow *slow* progress.21:06
mriedemand if placement were on its own with its own core team, if we found issues in the reshaper API, would those just be considered bug fixes or a new microversion21:06
mriedemanyway, that's theoretical21:07
mriedemefried: i believe what is not being said publicly is that progress could be slowed by a new core team21:07
mriedemwith different ideas on what placement, ideally, should be21:07
efriedHow could it?21:07
efriedHm.21:08
mriedemcase in point: the consumer generation fiasco with storing projects and users in placement21:08
mriedembecause that's too keystone-y21:08
mriedemhere i'm wildly generalizing,21:08
mriedembecause i wasn't personally heavily invested in that debate21:08
mriedemi just knew it slowed shit to a crawl for awhile21:08
efriedAnd that would have been... worse with a separate placement-core team?21:09
cdentmriedem: I get your point, but that's wasn't the problem in that case, just to be clear. and presumably we'd still have most of the same existing cores21:09
efriedseparate/different?21:09
efriedYeah, given that we're talking about at least starting off with placement-core being a superset of nova-core, the same people would be able to land changes as can today.21:09
mriedemand then dansmith and i came in and tried to move forward, burning some bridges in the process21:09
cdentso what you're really saying is: the problem here is that cdent and edleafe being cores is a problem21:09
mriedemi think that's the fear no one is saying21:10
mriedembecause feelings can get hurt21:10
efriedThat's... outrageous.21:10
bswrchrdwow21:10
cdentI think they're more hurtful when it is _not_ said21:10
cdentit is better to address these things out in the open21:10
mriedemafter how many hours in this channel talking about this now? :)21:11
cdentit's been obvious since the beginning of the discssuion21:11
efriedcoming up on 6h, with about 45 minutes for lunch.21:11
cdentdo you have this fear mriedem, or are you trying to interpret the fears of other people?21:11
mriedemif the initial placement-core is a superset of nova-core, then i think it's less of an issue21:11
zanebok wat just happened here21:12
efriedzaneb: Elephant materialized21:12
mriedemcdent: at times i do yes, but less about you - i didn't realize we were talking about ed being core right away21:12
TheJuliazaneb: possibly in the form of a small mushroom cloud21:12
mriedemi'm not sure why everyone else is so aghast21:13
efriedmriedem: How about, we're talking about that being a decision for placement-core rather than for nova-core.21:13
cdentmriedem: nobody is making any assumptions about cores at this point, except apparently people being worried that some potential cores can't be trusted21:13
mriedemnobody?21:14
cdentmriedem: the people who aren't core right now that have been mentioned (by efried) are me, edleafe, tetsuro, but since we haven't even made a real plan there's nothing solid. gotta get past the first hurdle, yeah?21:14
cdentit would certainly make sense given commit and review history21:15
mriedemi believe the plan is affected by that concern21:15
cdentyes, I agree with you, and I'm grateful that you've made it visible21:15
efriedYeah, if by "assumptions" you mean it's a foregone conclusion that these people will be made cores, then no. I would expect core nominations and appointments to undergo the same process as for any other team.21:15
efriedand as with any other instance of that process, if folks have concerns, they will need to air them explicitly so they can be discussed.21:16
efriedRight now it's easy to say "X shouldn't be a nova core" because X is placement-focused. Which is masking whatever real issues people have ^21:17
mriedemi'd -1 ed for placement core if that helps21:17
cdentI'd like to say publically that working under this cloud for many months has bene exhausting and incredibly dispiriting21:17
mriedemno offense, but if we're being honest21:18
cdentso having the elephant materialized is rather a relief21:18
mriedemsubsystems in nova is less a blocking factor, alex and ken'ichi were mostly nova api when made core21:18
mriedemit's more about interactions with the group in addition to be technical experts in their given subsystem21:18
mriedemi.e. is person x going in the same direction as the rest of the team, or are we always arguing21:19
cdentis singlemindedness in a group a virtue?21:19
TheJuliacdent: I would say not a virtue21:20
efriedSure gets things done. But are they the right things?21:20
TheJuliaAre they for the common good kind of question21:20
efriedNot for nothing, but the lack of singlemindedness is why we're having a hard time right here.21:20
mriedemalso,21:20
mriedemi take issue with *all* nova core members at various times, whether i state it publicly or privately or not21:21
mriedembut that's me, and i'm assuming it's true of the others21:21
mriedemand the same in all core teams21:21
TheJuliaefried: I'm kind of reading it differently though, and maybe I'm missing context by spending a good chunk of my day focused on other things21:22
efriedTheJulia: Heh, lucky you :)21:22
bswrchrdefried: maybe it's not singlemindedness but the ability to compromise? I'm a total outsider since Folsom, it just looks like there's a lot of "it's my way, deal with it"21:23
efriedDissenting voices are necessary for spirited discussion and lead to progress; often to better progress than if everyone thinks the same.21:23
efriedbswrchrd: Yes, and that's just what I'm getting at.21:23
mriedemi'm not saying there shouldn't be dissent21:23
efriedWhen the dissenting voice is from someone in a position of power, that gets treated differently than when it's not.21:23
mriedemthere frequently is with a general understanding of what the problem is and that it's a valid problem worth fixing21:23
mriedemas i said this morning in the scheduler (placement) meeting (was that today?)21:24
mriedemyesterday?21:24
mriedemi give weight to maintaineres21:24
mriedem*maintainers21:24
cdentit was today but it was days and days ago21:24
mriedemso when it came to the consumer generation kerfuffle between cdent/edleafe and jaypipes,21:25
mriedemnot being heavily involved from day 0 but knowing we were blocking progress on stuff,21:25
mriedemi went with who i expected to be around to maintain the thing, which was jay over ed for me21:25
cdenti don't think this is a great example, because in the end it was demonstrated that jay's way was wrong in several ways21:25
cdentand we had to go back to doing it in a way that was more aligned with what ed was trying to accomplish21:26
mriedemi'm likely not caught up on why - is that gibi's ML thread?21:26
efriedno21:26
cdentI agree that often jay is the right choice when presented with a choice involving the db, but it's been demonstrated a lot of times that we all have valid input21:27
mnaserforgive me if this might be oblivious but was jay's solution (in that case) the technically better way as agreed by most at the time?21:27
mriedemhonestly i'd need to dig up any scheduler meetings where we tried to summarize and shit or get off the pot21:28
efriedmnaser: My interpretation is that that was not the tiebreaker21:28
cdentmnaser: I don't know that it matters, and I need to move locations to go home21:28
cdentmy family is pulling me away21:28
cdentback in about 30m21:28
mnasercdent: it's probably getting late there, you should :p21:28
*** cdent has quit IRC21:28
mnaseri'd hope that the decision was just what was deemed to be the better, more correct and technically better solution at the end of the day21:30
efriedno, it wasn't, and I think that's a major point here.21:30
mriedemhonestly i'll have to go back and read through scheduler meeting logs to put this into context21:30
mnasermriedem: thanks for looking into that21:32
mriedemso jay's spec change merged on may 21 https://review.openstack.org/#/c/565565/21:33
* edleafe catches up21:34
edleafeThe problem wasn't technical merit. The problem was not working together.21:34
mriedemi don't see anything in the last 3 scheduler meetings about that change before that spec update was merged21:35
mriedemefried asked for status on june 4 http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-06-04-14.04.log.html#l-3721:35
mriedemi complained about it on june 11 http://eavesdrop.openstack.org/meetings/nova_scheduler/2018/nova_scheduler.2018-06-11-14.02.log.html#l-27121:35
edleafeInstead of working together on the patch series I had been working on, Jay created a whole separate series.21:35
mriedemfin21:35
mriedemi mostly remember "let's not use objects b/c we don't like objects" and jay, dan and me saying "but we use objects to model everything, so let's be consistent"21:36
* dims reads scrollback21:37
edleafemnaser: the overarching problem was, by Jay's own admission, was that he did it because he knew he could get away with it.21:37
mriedemi assume there is more to the differences in the two series21:37
edleafemriedem: it was because "we don't like objects"21:38
mriedemthat's it?21:38
edleafeit was because they weren't needed21:38
mriedemwe use them to model pretty much all data in nova/placement right? including all the stuff before this in placement21:38
mriedemwe don't have anything in the api code that just messes with sqla ORM dict-like objects right?21:39
edleafemriedem: look, I'm not going to re-argue the technical details. The only issue for me was the way it was handled21:39
mriedemwell,21:40
edleafeEven if Jay's approach was 100% better, you don't work like that in a community21:40
mriedemif the technical detail was, "hey let's be consistent" and "i don't care about consistency, i'm not changing this" which prompted jay to write an alternate21:40
mriedemthat's important informatoin21:40
mriedemi can't speak for jay or what his motives were21:41
mriedemedleafe: i know you are very prone to doing things a particular way per your style concerns, which i've taken issue with in the past21:41
edleafefair enough21:42
edleafeBut you've dealt with that by addressing me and explaining your POV21:42
edleafeJay stopped responding before I implemented the objects. The only feedback was from others, who thought it was overkill.21:43
edleafeSo I reverted, and continued21:43
edleafeAll without feedback from Jay21:43
edleafeI got some from Dan, and was implementing what he requested21:43
edleafeWhen Jay dropped his series21:44
edleafeYou really should discuss this with Jay21:44
edleafeHe has been very up front about it21:44
edleafeAnd to relieve your and others' concerns, I'm not really interested in being a core21:45
edleafeI switched a lot of my focus to internal projects after those events21:46
edleafeI don't need that aggravation21:46
mriedemi would have thought at some point within the month and a half before landing jay's updated spec this would have been discussed in the scheduler / placement meeting for those that aren't involved in all discussions in the -placement channel21:47
mriedemas an outsider, i only cared about moving forward21:47
mriedemdealing with the placement crew can be exhausting21:47
mriedembecause of the highly opinionated nature of the people working on it21:48
mriedemwhich is a lot of why i want nova-core at least a subset of the placement-core when it's split out21:48
edleafemriedem: sorry. At that point I stopped caring.21:49
mriedemthat's fair21:49
mriedemjust explaining i personally came into the tail end of a shit storm21:49
edleafeI had an opportunity to work on some internal stuff, so I dropped running the scheduler meetings and stopped reviewing21:49
mriedemand wanted to make progress21:49
*** annabelleB has quit IRC22:00
*** cdent has joined #openstack-tc22:05
*** zaneb has quit IRC22:47
*** annabelleB has joined #openstack-tc22:48
*** hongbin has quit IRC22:49
*** annabelleB has quit IRC23:01
*** annabelleB has joined #openstack-tc23:04
*** zaneb has joined #openstack-tc23:07
*** tosky has quit IRC23:08
*** annabelleB has quit IRC23:37
*** bodgix has joined #openstack-tc23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!