Friday, 2015-06-12

nibalizerdoes puppet-* have a similar list? or just each module's own metadata.json ?00:00
nibalizercrinkle: ^?00:00
crinklenibalizer: no, each module has its own dependencies00:00
*** dannywilson has quit IRC00:00
jeblairthe more i think about it, the more i think that maybe we should take the approach of using metadata.json to tell zuul-cloner which repos to use00:00
*** yamada-h has joined #openstack-infra00:01
jeblairit's a slightly different approach than we've used for integration testing before (where we usually just have a single job, and the list of repos is defined in the job one way or another)00:01
crinklesome things in metadata.json are external dependencies that zuul doesn't have knowledge of00:02
crinklelike puppetlabs/apt etc00:02
jeblairbut this means that the foo-beaker job and the bar-beaker job all work with the correct and minimal set of requirements automatically (and we can share the job defn for any puppet module)00:02
jeblaircrinkle: (yeah, so maybe the spec helper says "i can zuul this one; i have to puppet module install this other one")00:02
*** Sukhdev has quit IRC00:03
crinklejeblair: so when you say spec helper do you mean spec_helper_acceptance.rb within the module or a script in jjb?00:03
jeblaircrinkle: sha.rb00:03
*** Sukhdev has joined #openstack-infra00:03
*** yamamoto has joined #openstack-infra00:03
nibalizerthe metadata.json is the source of truth I would use00:04
jeblairthe only other trick with this approach is that we have to tell zuul to combine these modules into a shared change queue, which it will only do if job names match across repos; that's taken care of in infra because of the apply job, but we may need, temporarily, a way to bind all of the openstack-puppet repos together if they don't share an integration test job.  we've done that before with a fake project, so that's not too hard.00:04
nibalizerjeblair: ah so i was wondering about that00:04
nibalizereach puppet module has its own beaker tests right now, there isn't a shared test00:05
nibalizerif that makes any sense00:05
nibalizerso you can't (right now) treat it like devstack00:05
*** yamada-h has quit IRC00:05
*** radez_g0n3 is now known as radez00:05
nibalizernow it would be really cool to have a puppet-go-make-openstack that does exercise all the modules in one test00:06
nibalizerbut until that appears I don't think we're supposed to make them the same job name and share a queue00:06
openstackgerritWayne Warren proposed openstack-infra/zuul: WIP: Support GitHub PR webhooks
nibalizerunless its smart enough to say "i am a job testing puppet-nova and pupept-keystone and puppet-glance, so I must run each of their tests in sequence"00:06
jeblairnibalizer, crinkle: the critical question is whether you want the modules to test unreleased code of other modules00:06
jeblairfor infra, that is yes00:07
nibalizerwe have to answer 'yes' to that question to get 'depends-on' right?00:07
jeblairnibalizer: yep00:07
crinkleyes, we want that00:07
*** Sukhdev has quit IRC00:08
jeblairwhat that does mean is that you can end up with master of one module not working with latest release of another00:08
jeblairyou're locked into either using master everywhere, or releases everywhere (and releases should be simultaneous)00:08
jeblairagain, in infra, we're okay with that.  openstack itself has decided that in some cases, it wants to work with releases and not unreleased code.  so it's in a sort of hybrid state right now, with some jobs installing from git, and others installing some things from releases.00:09
crinklewe do synchronized releases00:10
*** camunoz_mtg is now known as camunoz00:10
*** Zhongjun has joined #openstack-infra00:10
crinkleso modules with the same major version work with each other00:10
jeblairthat sounds reasonabl. if you're okay with those caveats, then i'd continue along this line.00:10
crinkleand modules on master work with each other00:10
*** claudiub has joined #openstack-infra00:10
nibalizerjeblair: do you think we should have an rm -fr /etc/puppet/modules/* at the top of ?00:11
*** puranamr_ has joined #openstack-infra00:11
*** puranamr has quit IRC00:11
nibalizerI feel like we should, depending on how zuul-cloner feels about cloning into a repo that already exists00:11
nibalizerbut even so, if something was removed from modules.env zuul-cloner wouldn't deal with taht00:12
*** markvoelker has joined #openstack-infra00:12
anteayaj^2: pleia2 helped me find the log of the last time I asked this question:
anteayathanks pleia200:12
jeblairso i think this is a nice idea: have sha.rb read metadata.json and for each dep, if it is in gerrit and zuul-cloner exists, zuul-cloner it, otherwise, puppet-module-install it.  that means sha.rb works in ci, and locally, and works generically for any puppet module in our system.00:12
anteayaj^2: it appears that direct-release affects how bugs are closed in your projects00:13
anteayaj^2: do you plan on creating releases of your repos?00:13
jeblairnibalizer: i think we leave the apply-test alone for now and do something different with beaker, yeah?00:13
nibalizerif clark were here he would ask that we use git clone instead of puppet module install00:13
nibalizerbut not enought information is available in metadata.json to do that I think00:14
nibalizernot unless you want to interrogate the forge api to figure out the project URL00:14
crinkleyeah that's not really sustainable00:14
nibalizerjeblair: I think its just a bug in the apply test, doesn't matter to this conversation00:14
nibalizerim cribbing the apply-test for my reasoning about this00:14
nibalizerbut jeblair yea I think your idea works00:15
*** fallenpegasus has joined #openstack-infra00:15
nibalizermaybe we just curl the tarball from the forge and ignore puppet-module-install00:16
jeblairso maybe we try that out in a few places, and if it works, that would be a really nice thing to break out into something we can gem install00:16
jeblairand then that's just "the way" you do module testing on our platform00:16
j^2anteaya: not that I know of. We've been just creating "stable/<blah>" branches.00:16
j^2We don't have releases per se00:17
jeblairanteaya: it means that a bug is marked released as soon as a patch that "fixes-bug" that bug is merged00:17
anteayajeblair: oh okay thanks00:17
*** markvoelker has quit IRC00:17
anteayaj^2: to you want to have bugs marked released as soon as a patch marked fixes bug is merged for your repos?00:17
*** marun has joined #openstack-infra00:18
jeblairianw: i think that sounds generally reasonable for a short period, particularly for a non-voting job.  i think we've done similar with libvirt before.  it's one of the things we'd like to fix with real infra packaging work.00:18
j^2anteaya: yep that's exactly what I'd like00:18
anteayaj^2: okey dokey, then that is what the direct-release option does in gerrit/projects.yaml00:19
*** Kennan2 is now known as Kennan00:19
anteayaj^2: thanks for your patience00:19
jeblairnibalizer: i thought we did rm the directories in apply-test;  regardless, i _think_ that zuul-cloner will take them over and dtrt00:19
j^2anteaya: :)00:20
*** ddieterly has joined #openstack-infra00:22
jeblaircrinkle, nibalizer: what's the best way to determine a dependency is on gerrit, and where?00:22
*** marun has quit IRC00:23
jeblairlooking at ours, we have things like "openstackci/vcsrepo"00:23
jeblairand actually, anything we auto-publish will be under openstackci/00:24
jeblairthat's awkward00:24
nibalizeryea metdata.json doesn't really have all the information00:24
jeblair    { "name": "openstackinfra/vcsrepo" },00:24
jeblair    { "name": "openstackinfra/jenkins" }00:24
jeblairoh right we changed it to openstackinfra00:24
nibalizerstackforge/* and openstack/* is sufficient though?00:25
nibalizerthats a forge-name00:25
*** puranamr_ has quit IRC00:25
jeblair    { "name": "stackforge/openstacklib", "version_requirement": ">=5.0.0 <6.0.0" }00:25
nibalizerso that resolvs to gerrit's stackforge/puppet-openstacklib00:26
jeblairthat's sort of weird since we don't control that namespace00:26
nibalizerthe puppet-openstack people do00:27
*** julim has quit IRC00:27
*** ociuhandu has quit IRC00:27
openstackgerritJeremy Stanley proposed openstack-infra/system-config: Add Apps Site to System Config
jeblaireven if everything were under openstackinfra/, we'd still have to map that to at least 3 gerrit namespaces00:27
jeblairi think that's throwing a significant wrench in this00:28
nibalizerso, a mordredesque idea, would be to invent a git_dependencies: { } object into metadata.json00:28
ianwjeblair: actually ... hmm, the fix is in
jeblaircan we do that?00:28
*** zz_dimtruck is now known as dimtruck00:29
nibalizerI think so, this is adding new fields not changing the meaning of old fields like last time00:29
ianwjeblair: but guess what, i think our old friend of image builds failing is coming into play00:29
jeblairand tools don't blow up with new fields?00:29
nibalizerreally any field in that blob is created by someone00:29
ianw <- Exception: Failed to clone openstack/nova00:29
jeblairnibalizer, crinkle:
*** mtanino has quit IRC00:30
*** asettle has joined #openstack-infra00:31
nibalizerjeblair: I don't have the authority to say if we can or can not add fields arbitrarily to that00:32
nibalizer is the closest I can find to a spec00:32
jeblairnibalizer: could use a new file00:33
*** yamamoto has quit IRC00:33
nibalizeris this how clonemap.yaml was meant to be used?00:33
*** shuoy has quit IRC00:33
jeblairnibalizer: that's not a bad idea00:34
nibalizeryou still have to read metdata.json to find puppet-forge dependencies though00:35
crinkleso what we already is just have spec_helper_acceptance.rb know what modules it should clone from git00:35
nibalizerand you have to filter out dependencies satisfied by clonemap.yml00:35
crinkleso adding that stuff to a different file doesn't accomplish anything00:35
nibalizerya i mean the dumb way would be to change all those 'pupet module installs' to be shellouts to zuul-cloner00:36
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Add jhesketh user and sshkey
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Add jhesketh to infrastructure servers
nibalizerand just have a human figure out what uses zuul-cloner and what uses puppet-module-install00:36
crinklenibalizer: no those things can't be installed with zuul-cloner00:36
jeblaircrinkle, nibalizer: check out idea3 in etherpad00:36
*** asettle is now known as asettle-pto00:37
jeblairthat actually is basically the idea we had started with (before all this), but it's moving the list of repos to zuul-cloner from JJB into the modules, so it's more templatable00:37
jheskethAnd with that, I bravely run away to an appointment00:37
jeblairyeah, spec_helper_acceptance would still install any deps that zuul-cloner did not install00:37
nibalizerjhesketh: :)00:37
nibalizergratz, btw00:37
jheskeththanks :-)00:38
nibalizeroh it would basially [ -f dir] || puppet module install ?00:38
crinklei don't entirely see the value in splitting it out, sha.rb could just know which modules need to be zuul-cloned and do it there00:38
nibalizercrinkle: i guess we started out by saying 'that information is in metadata.json anyways, why duplicate'00:39
nibalizerso thats where we started00:39
*** sigmavirus24 is now known as sigmavirus24_awa00:39
nibalizernow we are somewhat afield00:39
crinklenibalizer: but not all the information we need is there00:39
crinkleso we're adding more information in strange places00:39
nibalizerno, its not00:39
crinklethe simplest thing is just to tell the spec helper to do the thing since most of the logic is there anyways00:40
crinklewe also use one module that breaks the mold, our openstack_extras module isn't depended on by anything but it's used in the tests00:41
crinkleso we'd clone that from git master anyways00:42
*** stevemar has joined #openstack-infra00:42
jeblairon idea3, can we remove the line "  This has the issue that it doesn't install the non-gerrit dependencies, still need that from somewhere" ?00:42
nibalizerso I thought there was a problem to do this with differing testss00:42
jeblaircause i think that is addressed by line 27 (spec_helper_acceptance.rb satisfies any dependencies not already satisfied)00:42
nibalizerlike an example is that keystone's tests don't also run the nova tests, so you could land something in keystone that breaks nova right?00:43
nibalizeri know thats not the exact problem at hand...00:43
jeblairnibalizer: yes, we call that an asymmetric gate00:43
jeblairthe only way to avoid that is to run symmetric jobs/tests on all repos that participate00:44
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Remove suds package from global-requirements
jeblairthat line in idea3 is really bothering me, can we either agree that it's a problem or remove it?00:44
nibalizerjeblair: so wouldn't we be creating one of those with any of these options?00:44
*** tiswanso_ has quit IRC00:45
*** r-daneel_ has joined #openstack-infra00:45
nibalizerjeblair: better?00:45
jeblairdoesn't beaker run sha.rb?00:45
*** tiswanso has joined #openstack-infra00:45
*** r-daneel has quit IRC00:45
jeblairwe can do that if it makes it clearer :)00:46
*** alivigni has quit IRC00:46
nibalizerI didn't see the part where Idea 3 was using a jjb job, I thought all that was going to be in the sha.rb00:46
*** baoli has joined #openstack-infra00:47
jeblairnibalizer: okay, so about asymmetric gates, yes, it's really easy to do here.  especially if, say for use, we do this with vcsrepo.  it would need to run the func tests for _every_ one of our modules to ensure that nothing breaks00:47
jeblairnibalizer: we could do that, since after all, we never change vcsrepo anyway.  or, instead, we could throw one job on it and say "if it works there, it will probably work for the others" and be done with it :)00:47
*** radez is now known as radez_g0n300:47
*** fallenpegasus has quit IRC00:48
jeblair(i would probably vote for the latter)00:48
openstackgerritDawid Malinowski proposed openstack-infra/jenkins-job-builder: Add support for OWASP Dependency-Check Plugin
jeblairnibalizer: with idea3, i believe we're encoding the list of "things that should be installed from git" into the clonemap... oh i see....00:49
jeblairnibalizer: you're perhaps saying that sha.rb can handle doing that00:50
crinkleit has to know that stuff for when devs are running it locally00:50
crinkleso we might as well use that knowledge and zuul-cloner things to it00:50
crinkleand add *00:50
nibalizeryea that makes sense to me00:51
*** fallenpegasus has joined #openstack-infra00:51
jeblairdoes idea3 look right now?00:52
nibalizerthough I don't have a strong opinon on this version vs the last version (where jjb was doing the zuul clonery bits)00:52
nibalizerit sounds like crinkle is against having another file with a list of dependiencs in it00:53
crinklei'm happier with idea 3 now than when it was jjb doing it00:53
jeblairi'm sympathetic, but without the information of forge-module-name -> gerrit-repo-name, i'm not sure how else we can do it.  we have to add that info somewhere.00:53
crinkleif zuul-cloner wants to read a yaml file then that's okay00:54
*** koolhead17 has joined #openstack-infra00:54
crinklejeblair: well that info is in sha.rb00:54
crinklebut it doesn't matter entirely whether it's hardcoded in sha.rb or if it reads it from another file00:54
*** salv-orlando has joined #openstack-infra00:55
*** stevemar has quit IRC00:55
jeblaircrinkle: i think what i'm instictively trying to do is to get a chunk of code that can do this generically so we can move the data away from the code00:55
*** shuoy has joined #openstack-infra00:55
crinkleas long as its available to the dev on their laptop00:55
crinklejeblair: sounds fine to me00:55
jeblairbecause when this is done, this is going to be in 300 git repos00:55
crinklejeblair: what is going to be in 300 git repos? all the modules have different dependencies so they'll all have different clonemaps00:55
crinklebut the model is there, yes00:56
nibalizeryea Idea 3 is starting to look really good00:56
*** baoli has quit IRC00:57
*** abitha has quit IRC00:58
jeblairis the thing added necessary?  i think if zuul-cloner is not available, then all modules in metadata.json have not been satisfied, so they all need to be puppet module installed?00:58
crinklei think jeblair is right00:59
nibalizerso idea 3 has no metadata.json in it00:59
nibalizerI don't want two lists of openstack modules, because that will just get out of date instantly00:59
jeblairnibalizer: oh, i imagined it just had the normal and complete metadata.json00:59
nibalizerjeblair: so this is what it looks like right now01:00
*** juggler has quit IRC01:00
jeblairnibalizer: i think the problem with that is that when you publish a module, it needs to have the full deps listed in metadata.json01:00
nibalizerI would like to move the block of 'stackforge' stuff, the data anyways, into clonemap01:00
*** juggler has joined #openstack-infra01:00
nibalizerwhy is that a problem? I'm saying deduplicate the sha.rb and clonemap.yaml, is all01:01
*** salv-orlando has quit IRC01:01
jeblairnibalizer: i'm saying no data in sha.rb, list of all deps it metadata.json, list of git repos in clonemap (which is a subset of the previous)01:02
*** sputnik13 has quit IRC01:02
nibalizerthat works for me01:03
nibalizerso I could delete my line01:03
nibalizerand the bottom line of Idea3 could be appended with ", with data sourced from metadata.json"01:03
openstackgerritDawid Malinowski proposed openstack-infra/jenkins-job-builder: Add support for OWASP Dependency-Check Plugin
*** baoli has joined #openstack-infra01:10
jeblairnibalizer, crinkle: did i summarise pros/cons accurately?01:10
*** marcusvrn has joined #openstack-infra01:11
nibalizerya i think so01:11
crinklejeblair: i think so01:11
nibalizercrinkle: what about Idea 101:11
nibalizerwell the core of it, one list of modules01:11
nibalizerare the dependencies really disjoint?01:11
jeblair(idea1 does work well for infra, means we don't have to fiddle with as many files :)01:12
jeblair(just install everything whether we need it or not)01:12
*** alexsyip has quit IRC01:13
crinklei'm not a fan of it because it means that the logic is in two places01:13
nibalizerin idea 1?01:13
crinklenibalizer: yes, when it's run in ci then the logic is in jjb, when it's run on a laptop the logic is in sha.rb01:14
crinkleif i need to update something i need to update it in both places01:14
crinkleit it's broken in one place i might not be able to reproduce it in the other place01:14
*** shuoy has quit IRC01:15
nibalizercrinkle: in the infra version of this we keep the list of modules in a git directory, the the laptop workflow is to pull that file and use it01:16
nibalizerthat refers to the data01:16
nibalizerwe will always have two pieces of logic, I think01:16
jeblairnibalizer: ( automated the laptop workflow)01:16
nibalizerdepending on context01:16
jeblairnibalizer: in infra, we might still want to install external dependencies via modules.env, but as long as we do that before we run beaker, the rest should hold01:18
*** koolhead17 has quit IRC01:18
openstackgerritMerged openstack-infra/system-config: Add Apps Site to System Config
jeblair(that way we don't have the "global requirements" problem)01:18
crinkleso we'd need another for openstack-puppet01:20
crinklewe have a lot of modules though, it takes a long time to download all of them :/01:21
nibalizerthat would ensure the same versions of all modules for every test (modulo zuul )01:21
crinklei suppose infra does too01:21
jeblaircrinkle: it's faster with zuul-cloner, but that's small comfort for the laptop use-case01:21
nibalizerwhich seems more controlled than each module expressing different dependencies01:21
nibalizeroh I hadn't thought of that01:21
jeblairyeah, in infra we basically want to ignore per-module deps most of the time.01:22
nibalizeryea what we put in metadata.json is ... a suggestion01:23
nibalizernot what we actually do01:23
*** patrickeast has quit IRC01:23
nibalizerand we're just trying to be nice to the poor person who tries to use a subset of our modules01:23
crinklebut we treat these modules like packages, the metadata.json is a contract01:23
jeblairyeah, infra is not as good at this as puppet-openstack :)01:24
nibalizercrinkle: but there is another contract though, which is that puppet-glance and puppet-swift can both be in the same modulepath01:24
nibalizerand thats what one list gets you01:24
nibalizeri think01:24
nibalizerat least I think thats the idea behind devstack and global-requirements01:24
nibalizerwhich I'm trying to adapt to puppet I think01:24
*** koolhead17 has joined #openstack-infra01:25
crinklediscovering that puppet-glance and puppet-swift are broken when installed together is for the integration test to find out, not the functional test01:26
openstackgerritIan Wienand proposed openstack-infra/nodepool: Enhance logging around image building
*** annegentle has joined #openstack-infra01:26
nibalizerso is beaker a functional or integration test?01:27
jeblairnibalizer, crinkle: i added a note to idea3 about the way we will install deps in infra.  i also added idea3b which is the earlier 'run zuul-cloner from jenkins before running beaker' variant of the idea.01:27
crinklenibalizer: we're using it as a functional test, we could add another thing that uses it as an integration test01:27
crinklebut there's a whole other spec on that i think01:28
nibalizerya I think i've become obsessed with doing some kind of devstack-puppet and that's making it hard for me to focus on keeping scope down in this conversation01:28
nibalizerso idea3 looks fine for me01:28
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Delete leaked instances
crinklejeblair: 3b seems sort of like 1 to me01:30
jeblairnibalizer: modules.env is like openstack/requirements, except that we aren't syncing them to metadata.json.  if we add that step, they will be even more similar.  i do not believe we should do what openstack does and support modules using different versions of dependencies.01:30
*** otter768 has joined #openstack-infra01:31
nibalizeri agree, we should support 1 version of stdlib and if other versions work thats cool but not a supported feature01:31
*** annegentle has quit IRC01:31
nibalizercan I ask another question about the asymetric gate?01:31
jeblaircrinkle: very similar, but in 1, we had sha.rb depending on a global list of modules, but in 3 it's optional (and sha.rb only depends on the local lib).  granted, that's not all in the etherpad.  i'll add more words.01:32
*** yamamoto has joined #openstack-infra01:32
jeblairnibalizer: certainly01:32
nibalizerjeblair: so if puppet-keystone-1 and puppet-nova-1 both pass check and get put in the puppet-openstack-beaker gate queue, then zuul fires up a test with both of them in it, in which directory does it run 'bundle exec rspec spec/acceptance' ? If its in the nova dir it runs the nova tests ... but those aren't the keystone tests... but if everything passes the keystone stuff still lands?01:34
*** hdd has quit IRC01:34
*** dims_ has quit IRC01:35
*** baoli has quit IRC01:35
*** otter768 has quit IRC01:35
jeblairnibalizer: imagine "gate-puppet-nova-beaker" and "gate-puppet-keystone-beaker" and "gate-puppet-integration" jobs01:35
nibalizerokay and gate-puppet-integration is some other thing ok01:36
jeblairnibalizer: gate-puppet-nova-beaker clones puppet-nova, then runs beaker in it;  likewise puppet-keystone01:36
nibalizerthat does make sense01:36
nibalizerand in that case zuul is just helping us ensure the order that things land in isn't going to break stuff01:36
jeblairand gate-puppet-integration is like devstack; it clones them both and runs something else :)01:36
nibalizeryes yes01:36
fungiimagine replacing devstack with "apply all the puppet modules with default values" and then maybe run tempest smoke tests against the resuly01:36
nibalizerso in your idea3 you reccomend they share a change queue, why?01:36
fungier, people clearly are coming to the same conclusions. i'll go back to maintenance plans ;)01:37
jeblairnibalizer: because we're actually more concerned with "gate-puppet-keystone-beaker" and "gate-puppet-something-beaker" in this case (where puppet-keystone depends on puppet-something)01:37
nibalizerfungi: no thats totally what I want to build, but isn't in scope for this discussion01:37
*** stpierre has quit IRC01:37
jeblairnibalizer: and "gate-puppet-keystone-beaker" is going to incidentally zuul-clone puppet-something and us it in its tests01:38
nibalizerso what would share a change queue in that case? Is 'shraing a change queue' different from 'having the same test name' and 'sharing a gate together' ?01:38
funginibalizer: i was merely giving an example of an integration test01:38
jeblairnibalizer: having the same job name causes projects to share a change queue (it's just the mechanism in place right now, it will change in zuulv3)01:38
jeblairnibalizer: it is probably what you mean by "sharing a gate together", but i tend to get really specific and technical talking about this :)01:39
nibalizerand you should because there are clearly still holes in my knowlege01:39
nibalizerokay I think I'm getting it01:40
jeblaira shared change queue means all projects in it land changes in strict sequence, and changes ahead in the queue will be available to changes behind (via zuul-cloner)01:40
* nibalizer nods01:41
*** sigmavirus24_awa is now known as sigmavirus2401:43
*** koolhead_ has joined #openstack-infra01:44
*** asettle-pto has quit IRC01:44
nibalizerso i think Idea3 is something I can get behind01:45
nibalizerjeblair: it sounds like you like idea301:45
nibalizercrinkle: ?01:45
crinklei am ++ idea301:45
crinkle3a mainly01:45
*** yamamoto has quit IRC01:46
*** r-daneel_ has quit IRC01:46
*** achanda has joined #openstack-infra01:46
*** koolhead17 has quit IRC01:47
*** ayoung has joined #openstack-infra01:49
StevenKcrinkle, nibalizer: Can I bug you to look at ? Specifically, am I doing it in a silly way and a clue for the precise test would be lovely01:50
nibalizerStevenK: whats the way you want the string to look?01:51
StevenKnibalizer: -> translate-dev_openstack_org01:51
nibalizerit looks like you're trying to nil.gsub and thats barfing01:52
nibalizerso maybe thing.gsub unless thing.nil?01:52
StevenKnibalizer: But it shouldn't be nil :-(01:52
*** spzala has quit IRC01:52
StevenKI don't think URI changed that much for precise :-/01:53
openstackgerritMerged openstack-infra/infra-specs: Add spec for shade
*** fallenpegasus has quit IRC01:53
StevenKnibalizer: I'm happy to get at a Precise machine and poke at this, but I'm not clear how to debug it01:53
*** camunoz is now known as camunoz_away01:54
openstackgerritMerged openstack-infra/infra-specs: Host a code search service
StevenKnibalizer: I was doing it using regsubst(), but the regex was getting horrible and as I was about to add support for :443 (which may not be there), I yearned for actual ruby01:56
*** sarob has quit IRC01:56
*** unicell has quit IRC01:56
crinkleugh, looks like URI for ruby 1.8.7 uses URI.parse() instead of URI()01:57
crinklecomparing and
StevenKOh BLAH01:57
StevenKWhy can't we have nice things!01:57
crinklelooks like .parse will work on 1.9.301:58
StevenKAh ha, nice01:58
*** asettle has joined #openstack-infra01:58
openstackgerritmelanie witt proposed openstack-infra/project-config: Make check|gate-tempest-dsvm-cells voting
*** sabeen1 has joined #openstack-infra01:58
StevenKcrinkle: Thanks!01:58
openstackgerritMerged openstack-infra/infra-specs: Add maniphest bug tracking spec
*** asettle is now known as asettle-pto01:59
*** yonglihe has quit IRC01:59
*** yamamoto has joined #openstack-infra01:59
*** yonglihe has joined #openstack-infra01:59
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add spec covering puppet 4 readiness
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add spec for puppet apply work
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Perform puppet module functional testing
*** markvoelker has joined #openstack-infra02:01
*** achanda has quit IRC02:02
fungispec-o-rama! (quite the spec-tacle)02:02
fungii guess they all merge-conflicted on the index list02:02
nibalizerfungi: that was a groaner, but i liked it02:03
*** yanfengxi has joined #openstack-infra02:04
*** dims has joined #openstack-infra02:05
openstackgerritMerged openstack-infra/infra-specs: Perform puppet module functional testing
openstackgerritMerged openstack-infra/infra-specs: Add spec covering puppet 4 readiness
openstackgerritMerged openstack-infra/infra-specs: Add spec for puppet apply work
*** markvoelker has quit IRC02:07
*** yamahata has quit IRC02:09
*** yamamoto has quit IRC02:09
*** bknudson has quit IRC02:10
*** prad_ has quit IRC02:16
openstackgerritmelanie witt proposed openstack-infra/project-config: Make tempest-dsvm-cells job voting
*** teran has quit IRC02:17
*** Zhongjun has quit IRC02:18
*** claudiub has quit IRC02:25
*** marcusvrn has quit IRC02:26
*** shuoy has joined #openstack-infra02:27
*** yamamoto has joined #openstack-infra02:28
*** shuoy has quit IRC02:28
*** salv-orlando has joined #openstack-infra02:36
*** dims has quit IRC02:39
*** salv-orlando has quit IRC02:41
*** asettle-pto has quit IRC02:43
*** esmute has quit IRC02:47
openstackgerritSteve Kowalik proposed openstack-infra/puppet-zanata: Correctly determine the server id
ianwfungi: so rax-iad.devstack-centos7 & rax-dfw.devstack-f21 have both failed to build, can you restart them?02:51
*** ddieterly has quit IRC02:52
fungiianw: sure, just a sec02:53
ianwfungi: so modulo the complete magic REST interface, i'm just going to use a combo of , + cron to try keeping on this02:55
fungithey're running now. keep in mind that manual image updates don't write to the log, but i'll let you know when they succees, or what the error is if they fail02:55
fungier, s/succees/succeed/02:55
ianwfungi: so i think it explains why all the reruns worked ... other nodes had the right kernel02:56
*** julim has joined #openstack-infra02:58
*** bhunter71 has quit IRC02:59
*** yonglihe has quit IRC02:59
*** rkukura has quit IRC03:00
*** rkukura_ has joined #openstack-infra03:00
*** wenlock has joined #openstack-infra03:01
*** harlowja_at_home has joined #openstack-infra03:02
*** camunoz_away is now known as camunoz03:05
*** SumitNaiksatam_ has joined #openstack-infra03:05
timrcjeblair, Do all the jobs that run for a given project in a given pipeline have to run on the same Jenkins master?03:06
*** SumitNaiksatam has quit IRC03:07
*** stevemar has joined #openstack-infra03:09
*** julim has quit IRC03:09
*** SumitNaiksatam_ has quit IRC03:10
fungitimrc: not at all03:10
timrcI guess it's more appropriate to use QueueItems for a given Change?03:10
timrcfungi, Ah, okay.03:10
fungitimrc: jobs are entirely discrete and run on any master which has an available worker registered to run them03:11
*** marun has joined #openstack-infra03:11
*** yonglihe has joined #openstack-infra03:11
fungitimrc: if you go to our zuul status page and check out the links for all the in-progress jobs you'll see that jobs for a given change are running on a variety of different jenkins masters03:12
fungithat allows us to distribute load across multiple masters effectively, since past about 100 slaves on a single master jenkins starts getting cranky03:13
nibalizerfungi: do the masters only talk to a single region or anything like that?03:14
funginibalizer: nope, all over the map03:14
nibalizeras you may have noticed, cody has asked us to find the 'scale' button and press it03:15
funginodepool just round-robins which master it will register the next ready node to03:15
funginibalizer: press harder03:15
nibalizertimrc: ^^03:15
fungiit's pressure-sensitive03:15
timrcfungi, Right.  I just wasn't sure if jobs were batched but it makes sense and is even better if jobs for any given change can be run on multiple masters.03:16
fungithankfully, with our design, the "scale" button is mostly just getting bigger instance quotas from our providers03:16
nibalizertimrc: so i tried to re-create my 'nodes available by type' chart with upstream data03:17
*** baoli has joined #openstack-infra03:17
nibalizerand its way harder because of the multi jenkins03:17
*** marun has quit IRC03:17
fungiand then adding more of one not-nodepool server here or there as we cross certain thresholds (spin up an additional jenkins master, or add another git server to the farm, or add more logstash workers, or add more space for log storage, or whatever)03:17
*** SumitNaiksatam has joined #openstack-infra03:18
*** sigmavirus24 is now known as sigmavirus24_awa03:18
fungiadding more zuul mergers too. that was a relatively recent additional scale point. separating a merger daemon out of the scheduler so that we could run multiple merge workers on dedicated servers03:19
*** mwagner_afk has joined #openstack-infra03:20
vipulCan someone help me debug a readthedocs issue03:21
vipuli just submitted a pre-release tag, which kicked off the correct job, which seems to pass on the jenkins side..03:22
vipulbut docs not getting updated on the readthedocs site03:22
*** dimtruck is now known as zz_dimtruck03:23
*** asettle has joined #openstack-infra03:23
*** SumitNaiksatam has quit IRC03:24
*** geoffarnold has quit IRC03:25
openstackgerritTony Breeds proposed openstack-infra/yaml2ical: Add meeting length parameter
openstackgerritTony Breeds proposed openstack-infra/yaml2ical: Fix issue with meetings that start on day1 and end on day2
*** geoffarnold has joined #openstack-infra03:26
timrcfungi, Looking forward to offloading image building from nodepool.03:26
*** koolhead_ has quit IRC03:28
*** wenlock has quit IRC03:29
*** geoffarnold has quit IRC03:30
*** ivar-lazzaro has quit IRC03:30
*** geoffarnold has joined #openstack-infra03:30
*** otter768 has joined #openstack-infra03:32
timrcnibalizer, Looks like I'll be headed your way for oscon.03:32
timrcLet's do ELK for system logs!03:32
*** baoli has quit IRC03:33
*** otter768 has quit IRC03:36
*** dims has joined #openstack-infra03:40
*** tiswanso has quit IRC03:41
*** stevemar has quit IRC03:41
*** stevemar2 has joined #openstack-infra03:41
*** dpaterson has quit IRC03:41
*** fifieldt has joined #openstack-infra03:42
*** baoli has joined #openstack-infra03:43
*** baoli has quit IRC03:44
*** dguerri` is now known as dguerri03:44
fungiianw: in rax-dfw is ready03:44
fungithe other is still building03:45
*** dims has quit IRC03:45
*** geoffarnold has quit IRC03:45
ianwfungi: thanks, centos one hopefully has the right kernel now...03:47
gusSo how do I debug why eventlet can't import eventlet.greenthread in gate?03:48
*** esmute has joined #openstack-infra03:48
gusor perhaps there's already some known breakage going on?  I'm not clear from the scrollback...03:50
*** markvoelker has joined #openstack-infra03:50
*** geoffarnold has joined #openstack-infra03:50
fungigus: none to my knowledge03:52
ianwgus: does it work locally?03:52
*** esmute has quit IRC03:52
nibalizertimrc: woo03:53
*** ddieterly has joined #openstack-infra03:53
fungigus: since hasn't been approved yet, i'm going to declare it not my fault ;_03:54
timrcWow I'm an idiot.  So fungi and jeblair the reason that I was getting the not_registered was because I forgot to add the job to projects.yaml and zuul was looking for build:job-name:default-label-for-project03:54
*** dguerri is now known as dguerri`03:54
*** jerryz has quit IRC03:54
fungitimrc: i'm sure i've made the same error at least once03:54
*** markvoelker has quit IRC03:55
fungiianw: in rax-iad is ready03:56
ianwfungi: ok, thanks03:58
ianwfungi: is the nodepool host in UTC or something else?  just figuring out what 14:00 means to it03:58
*** rossella_s has quit IRC03:58
fungiianw: utc03:58
*** ddieterly has quit IRC03:58
fungiall is utc03:58
*** rossella_s has joined #openstack-infra03:58
*** HeOS has quit IRC04:00
ianwfungi: great, can you do me a favor and uname -a devstack-centos7-rax-iad-301876504:00
ianwthe devstack-gate scripts only do this in setup, so it's hidden unless we get to copy the logs out04:01
*** fallenpegasus has joined #openstack-infra04:02
*** fedexo has joined #openstack-infra04:03
openstackgerritMerged openstack/diskimage-builder: CentOS-6 resize support
*** jamespage has quit IRC04:05
*** gnuoy has quit IRC04:05
fungivipul: i'm not finding the hook-cue-rtfd log from your pre-release tag04:06
fungiit's possible that i should just be going to sleep now04:06
*** gnuoy has joined #openstack-infra04:06
*** jamespage has joined #openstack-infra04:06
fungiianw: checking, just a sec04:06
fungiianw: Linux 3.10.0-229.el7.x86_64 #1 SMP Fri Mar 6 11:36:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux04:07
openstackgerritMerged openstack-infra/irc-meetings: Add meeting_id and agenda_url for QA meetings
openstackgerritMerged openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly infra team meeting.
*** stevemar2 has quit IRC04:12
*** arxcruz has quit IRC04:13
fungivipul: oh, i figured out why i couldn't find the log. that job's logs get pushed to swift now04:13
*** harlowja_at_home has quit IRC04:14
*** hdd has joined #openstack-infra04:14
ianwfungi: hmm, that's not the right kernel, it should be kernel-3.10.0-229.4.204:14
fungivipul: says it successfully hit rtfd's update trigger api endpoint at 03:16:54 utc04:15
ianwfungi: can you get me the build log?04:15
fungiianw: i didn't save the terminal buffer from that since it succeeded. is it possible the job ran on a node which had already booted from the earlier image04:15
ianwfungi: yeah, that's probably it ... can we clear them all out?04:16
fungiit should echo the image name in the console log04:16
fungiianw: looking for whether it says near the beginning of the console log04:17
ianwfungi: don't think so ...
*** Sukhdev has joined #openstack-infra04:19
fungioh, hrm maybe we never added the builder macro to echo that in all jobs04:21
fungiyeah, you can see it in unit test jobs like
fungioh well, one more item for the to do list04:22
fungii'll correlate the build time from the nodepool log instead04:23
fungiianw: yep, as suspected that's the issue. that node was launched at 2015-06-12 03:37:5204:24
fungithe new image wasn't ready for 20+ minutes after that04:24
fungii'll mark any remaining ready devstack-centos7 nodes in rax-iad for deletion just in case04:25
fungithere's only one, and its creation time was 15 minutes after the new image went ready, so should be fine at this point04:26
fungiokay, i think i'm done for the evening. overdone even. later everyone04:28
*** marun has joined #openstack-infra04:29
ianwfungi: thanks for the help04:29
*** mgedmin has quit IRC04:30
*** Mmike has quit IRC04:31
*** frickler has quit IRC04:31
*** mgedmin has joined #openstack-infra04:31
*** fitoduarte has quit IRC04:35
*** fallenpegasus has quit IRC04:42
*** unicell has joined #openstack-infra04:49
*** Mmike has joined #openstack-infra04:49
*** Mmike has joined #openstack-infra04:49
*** abitha has joined #openstack-infra04:50
*** salv-orlando has joined #openstack-infra04:50
*** maishsk_afk has quit IRC04:52
*** salv-orlando has quit IRC04:53
openstackgerritMerged openstack/diskimage-builder: Dont fail if were missing setfiles
*** ddieterly has joined #openstack-infra04:54
*** frickler has joined #openstack-infra04:54
*** marun has quit IRC04:54
*** abitha has quit IRC04:56
openstackgerritMerged openstack-infra/project-config: Fix abandon permissions for mox3 repo
*** ddieterly has quit IRC04:58
*** chlong is now known as chlong_mtg04:59
*** geoffarnold has quit IRC05:02
*** fawadkhaliq has joined #openstack-infra05:03
*** salv-orlando has joined #openstack-infra05:03
*** geoffarnold has joined #openstack-infra05:04
openstackgerritMerged openstack-infra/devstack-gate: Add support for DEVSTACK_GATE_SETTINGS
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add project_id and agenda_url for weekly akanda meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for heat meetings
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly keystone meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly OpenStackClient meetings
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly product team meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly swift meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add project_id and agenda_url for weekly tacker meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add project_id and agenda_url for weekly training-guides meeting
*** bkero has quit IRC05:10
*** bkero has joined #openstack-infra05:10
*** BharatK has joined #openstack-infra05:12
*** maishsk_afk has joined #openstack-infra05:17
*** yfried has joined #openstack-infra05:22
*** harlowja_at_home has joined #openstack-infra05:23
*** koolhead17 has joined #openstack-infra05:25
*** geoffarnold has quit IRC05:29
*** maishsk_afk has quit IRC05:30
*** geoffarnold has joined #openstack-infra05:30
*** BharatK has quit IRC05:31
*** otter768 has joined #openstack-infra05:32
*** otter768 has quit IRC05:37
*** harlowja_at_home has quit IRC05:37
*** AK has joined #openstack-infra05:39
*** markvoelker has joined #openstack-infra05:39
*** AK has quit IRC05:39
*** AzherKhan has joined #openstack-infra05:39
*** markvoelker has quit IRC05:44
*** fawadkhaliq has quit IRC05:44
*** marun has joined #openstack-infra05:51
*** fawadkhaliq has joined #openstack-infra05:51
*** koolhead17 has quit IRC05:54
*** zz_naotok has quit IRC05:54
*** ddieterly has joined #openstack-infra05:55
*** marun has quit IRC05:56
*** BharatK has joined #openstack-infra05:56
openstackgerritMerged openstack-infra/elastic-recheck: Add query for ceph snapshot delete race fail bug 1464259
openstackbug 1464259 in Cinder "EC2VolumesTest fails with rbd backend" [Low,Triaged]
*** koolhead17 has joined #openstack-infra05:57
*** ildikov_ has quit IRC05:58
*** ddieterly has quit IRC06:00
*** jtomasek has joined #openstack-infra06:00
*** fawadkhaliq has quit IRC06:01
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml
*** BharatK has quit IRC06:04
*** chlong_mtg is now known as chlong06:06
*** hdd has quit IRC06:07
*** sdake has quit IRC06:08
*** koolhead17 has quit IRC06:10
*** HeOS has joined #openstack-infra06:11
*** koolhead17 has joined #openstack-infra06:11
*** ildikov_ has joined #openstack-infra06:11
*** armax has quit IRC06:13
openstackgerritSteve Kowalik proposed openstack-infra/puppet-zanata: Correctly determine the server id
*** BharatK has joined #openstack-infra06:16
*** HeOS has quit IRC06:16
*** amotoki has joined #openstack-infra06:16
*** Sukhdev has quit IRC06:19
*** mrunge has joined #openstack-infra06:23
*** camunoz has quit IRC06:27
*** bhunter71 has joined #openstack-infra06:28
*** devvesa has joined #openstack-infra06:30
*** k4n0 has joined #openstack-infra06:33
*** harlowja_at_home has joined #openstack-infra06:35
openstackgerritSteve Kowalik proposed openstack-infra/system-config: Pass through zanata client parameters
*** soren has joined #openstack-infra06:38
openstackgerritSteve Kowalik proposed openstack-infra/project-config: Support pushing translations to Zanata
*** HeOS has joined #openstack-infra06:44
*** Guest____ has joined #openstack-infra06:45
*** amotoki has quit IRC06:47
*** harlowja_at_home has quit IRC06:47
*** amotoki has joined #openstack-infra06:50
*** Guest____ is now known as jcoufal06:51
*** jcoufal is now known as Guest7641006:51
*** maishsk_afk has joined #openstack-infra06:52
*** deepakcs has joined #openstack-infra06:53
*** Guest76410 has quit IRC06:53
*** jcoufal_ has joined #openstack-infra06:53
*** dtantsur|afk is now known as dtantsur06:54
*** HeOS has quit IRC06:55
*** maishsk_afk_ has joined #openstack-infra06:55
*** ddieterly has joined #openstack-infra06:56
*** maishsk_afk has quit IRC06:56
*** maishsk_afk_ is now known as maishsk_afk06:56
*** sabeen1 has quit IRC06:59
*** derekh has joined #openstack-infra06:59
*** ddieterly has quit IRC07:00
openstackgerritBrian Exelbierd proposed openstack-infra/yaml2ical: Add project and agenda URLs to the bottom of calendar descriptions
*** Ala has joined #openstack-infra07:07
*** maishsk_afk has quit IRC07:08
*** ianw has quit IRC07:08
*** ianw has joined #openstack-infra07:09
*** isviridov_away is now known as isviridov07:10
*** yanfengxi has quit IRC07:11
*** markus_z has joined #openstack-infra07:14
*** ianw has quit IRC07:15
*** fedexo has quit IRC07:15
*** ianw has joined #openstack-infra07:15
*** fedexo has joined #openstack-infra07:16
*** ianw has quit IRC07:20
*** markvoelker has joined #openstack-infra07:28
*** jerryz has joined #openstack-infra07:31
*** gordc has joined #openstack-infra07:31
*** maishsk_afk has joined #openstack-infra07:32
*** markvoelker has quit IRC07:33
*** otter768 has joined #openstack-infra07:33
*** frickler_ has joined #openstack-infra07:37
*** frickler_ has quit IRC07:37
*** shardy has joined #openstack-infra07:37
*** otter768 has quit IRC07:38
*** samuelBartel has joined #openstack-infra07:39
*** jlanoux has joined #openstack-infra07:40
*** koolhead17 has quit IRC07:40
*** scheuran has joined #openstack-infra07:43
*** arxcruz has joined #openstack-infra07:43
*** macjack has joined #openstack-infra07:44
*** bexelbie|away-le has joined #openstack-infra07:46
*** bexelbie|away-le is now known as bexelbie07:46
*** Hal has joined #openstack-infra07:50
*** Hal is now known as Guest1314307:51
*** dtantsur is now known as dtantsur|bbl07:51
*** _nadya_ has joined #openstack-infra07:53
*** fedexo has quit IRC07:56
openstackgerritJoshua Hesketh proposed openstack-infra/system-config: Add jhesketh to infrastructure servers
*** mpaolino has joined #openstack-infra07:58
*** mpaolino has quit IRC07:59
*** teran has joined #openstack-infra08:00
*** ZZelle has quit IRC08:02
*** dims has joined #openstack-infra08:02
*** ZZelle has joined #openstack-infra08:02
*** dims has quit IRC08:07
vponomaryovAJaeger: Hello, if you have time, please, look at this one-liner -
*** chlong is now known as chlong_afk08:16
*** fdegir has joined #openstack-infra08:16
*** _nadya_ has quit IRC08:18
*** pblaho has quit IRC08:19
*** HeOS has joined #openstack-infra08:19
*** jistr has joined #openstack-infra08:20
*** claudiub has joined #openstack-infra08:22
*** maishsk_afk has quit IRC08:26
*** lxsli is now known as lexloofer08:26
*** HeOS has quit IRC08:31
*** _nadya_ has joined #openstack-infra08:32
*** isviridov is now known as isviridov_away08:33
*** ildikov_ has quit IRC08:34
*** pblaho has joined #openstack-infra08:34
*** cdent has joined #openstack-infra08:35
*** e0ne has joined #openstack-infra08:38
*** dizquierdo has joined #openstack-infra08:38
*** fhubik has joined #openstack-infra08:42
*** ruagair has quit IRC08:43
*** smyers has quit IRC08:46
*** vipul has quit IRC08:47
*** wayneeseguin has quit IRC08:48
*** vipul has joined #openstack-infra08:48
*** jerryz has quit IRC08:49
*** NobodyCam has quit IRC08:49
*** NobodyCam has joined #openstack-infra08:50
*** crinkle has quit IRC08:50
*** esp has quit IRC08:52
*** smyers has joined #openstack-infra08:52
*** med_ has quit IRC08:53
*** vponomaryov has quit IRC08:53
*** bauwser has joined #openstack-infra08:53
*** vponomaryov has joined #openstack-infra08:53
*** esp has joined #openstack-infra08:53
*** bauwser has quit IRC08:54
*** jyuso1 has quit IRC08:54
*** isviridov_away is now known as isviridov08:56
*** claudiub has quit IRC08:57
*** e0ne has quit IRC08:57
*** claudiub has joined #openstack-infra08:58
*** ParsectiX has joined #openstack-infra09:00
*** nijaba has quit IRC09:01
*** woodster_ has quit IRC09:01
*** bauzas has joined #openstack-infra09:03
*** chlong_afk has quit IRC09:03
*** wayneeseguin has joined #openstack-infra09:04
*** afazekas has joined #openstack-infra09:04
*** dguerri` is now known as dguerri09:05
*** mfmcdonagh has joined #openstack-infra09:07
*** mcdonagm has joined #openstack-infra09:07
*** jyuso1 has joined #openstack-infra09:07
*** _nadya_ has quit IRC09:08
*** nijaba has joined #openstack-infra09:09
*** pelix has joined #openstack-infra09:09
*** kushal has joined #openstack-infra09:10
*** jyuso1 has quit IRC09:13
*** markvoelker has joined #openstack-infra09:16
*** spredzy is now known as spredzy|afk09:21
*** markvoelker has quit IRC09:21
*** pblaho has quit IRC09:23
*** ildikov_ has joined #openstack-infra09:25
*** marun has joined #openstack-infra09:29
*** marun has quit IRC09:34
*** dizquierdo has quit IRC09:45
*** kaisers1 has joined #openstack-infra09:48
*** dims has joined #openstack-infra09:49
*** ociuhandu has joined #openstack-infra09:50
*** dims has quit IRC09:50
*** toabctl has quit IRC09:52
*** toabctl has joined #openstack-infra09:52
*** dims has joined #openstack-infra09:56
*** BharatK has quit IRC09:59
*** kaisers has joined #openstack-infra10:02
*** e0ne has joined #openstack-infra10:04
*** e0ne is now known as e0ne_10:04
*** ParsectiX has left #openstack-infra10:05
*** ParsectiX has joined #openstack-infra10:05
*** e0ne_ is now known as e0ne10:06
openstackgerritMerged openstack-infra/project-config: Fix enabling of rally project in ci jobs
*** ams__ has joined #openstack-infra10:06
*** ParsectiX has left #openstack-infra10:06
*** ildikov_ has quit IRC10:07
*** alexpilotti has joined #openstack-infra10:07
*** maishsk_afk has joined #openstack-infra10:08
*** ParsectiX has joined #openstack-infra10:10
*** yfried has quit IRC10:10
*** BharatK has joined #openstack-infra10:11
openstackgerritDi Xu proposed openstack-infra/jenkins-job-builder: Support deep merge of defaults
*** pc_m has joined #openstack-infra10:14
*** bexelbie is now known as bexelbie|afk10:17
openstackgerritBradley Jones proposed openstack-infra/project-config: Create Magnum UI repo
*** dizquierdo has joined #openstack-infra10:22
*** kaisers1 has quit IRC10:34
*** kaisers has quit IRC10:34
*** maishsk_afk has quit IRC10:35
*** maishsk_afk has joined #openstack-infra10:36
*** bexelbie|afk is now known as bexelbie10:37
*** ianw has joined #openstack-infra10:42
openstackgerritIan Wienand proposed openstack/diskimage-builder: Update default Fedora to 22
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add YUM variable to for Fedora >= 22
openstackgerritIan Wienand proposed openstack/diskimage-builder: Cleanup yum downloading
openstackgerritIan Wienand proposed openstack/diskimage-builder: Revert "Revert "Ensure DIB_RELEASE is exported for fedora""
*** k4n0 has quit IRC10:44
*** koolhead17 has joined #openstack-infra10:44
*** koolhead17 has quit IRC10:47
*** BharatK_ has joined #openstack-infra10:49
*** maishsk_afk has quit IRC10:53
*** maishsk_afk has joined #openstack-infra10:55
*** dtantsur|bbl is now known as dtantsur10:57
*** fifieldt has quit IRC10:58
*** crinkle has joined #openstack-infra10:59
*** BharatK_ has quit IRC11:00
*** yamamoto has quit IRC11:01
*** fdegir has quit IRC11:01
*** BharatK has quit IRC11:02
*** maishsk_afk has quit IRC11:03
*** fdegir has joined #openstack-infra11:03
*** AzherKhan has quit IRC11:05
sdaguejhesketh: it's times like this where I wish you already had infra-root :)11:05
sdagueneed a patch promoted11:05
jheskethsdague: heh, nearly11:06
*** shardy_ has joined #openstack-infra11:06
*** shardy has quit IRC11:07
jogojhesketh: any idea why ES is backed up / how to tell why11:07
*** fhubik is now known as fhubik_afk11:07
*** BharatK has joined #openstack-infra11:09
jheskethjogo: unfortunately the most insight I have at the moment is
jogohmm is slow for me too11:09
jheskethlooks like something is chewing up gearman looking at the queues11:10
sdaguejhesketh: that's probably all the gate reseting off of zuul11:10
sdaguees nodes being slow is typically an io issue on one of the nodes in the cluster11:10
jheskethyeah zuul is not being very responsive to me either11:10
sdaguewhich is often a noisy neighbor issue11:11
jogosdague: I wonder if some log grew recently11:11
*** shardy_ has quit IRC11:11
sdagueyou want to look at the elasticsearch nodes in cacti for that11:11
sdagueit's almost always the search cluster backend11:11
*** shardy has joined #openstack-infra11:12
sdaguees1 is blank in cacti - that can't be good -
sdaguedid that node get lost?11:12
jogosdague: is almost full11:12
jheskethI think it's more than just es having trouble11:13
jheskethzuul's tcp connections  don't look too healthy either11:13
sdaguejogo: yeh, someone was mentioning that in channel11:13
sdaguejhesketh: yeh, but I think they are independent events11:13
jheskethright, possibly11:14
*** BharatK_ has joined #openstack-infra11:14
jheskethor as you say, noisy neighbor/provider issue(s)11:14
*** hichihara has quit IRC11:14
jogoq-agt is 5.8 MB lol11:16
*** koolhead17 has joined #openstack-infra11:17
*** marcusvrn has joined #openstack-infra11:17
jogo1.2 MB at INFO level11:18
*** marcusvrn has quit IRC11:23
*** w__ has joined #openstack-infra11:26
*** baoli has joined #openstack-infra11:28
*** olaph has quit IRC11:28
*** shardy_ has joined #openstack-infra11:33
*** bexelbie is now known as bexelbie|lunch11:35
*** shardy has quit IRC11:35
*** fhubik_afk is now known as fhubik11:35
*** otter768 has joined #openstack-infra11:35
*** ildikov_ has joined #openstack-infra11:35
*** baoli has quit IRC11:36
*** baoli has joined #openstack-infra11:37
flip214Is broken? still?11:37
*** e0ne is now known as e0ne_11:38
*** ParsectiX has quit IRC11:39
*** shardy_ has quit IRC11:39
*** shardy has joined #openstack-infra11:39
*** otter768 has quit IRC11:40
*** yamamoto has joined #openstack-infra11:42
*** krtaylor has joined #openstack-infra11:42
*** yamamoto_ has joined #openstack-infra11:42
*** rkukura has joined #openstack-infra11:46
*** rkukura_ has quit IRC11:46
sdagueit's very slow11:47
*** yamamoto has quit IRC11:47
sdaguewe need a fungi back to help sort what's going on I think11:47
*** e0ne_ has quit IRC11:49
*** iurygregory has left #openstack-infra11:50
*** deepakcs has quit IRC11:50
*** markvoelker has joined #openstack-infra11:50
*** danpb has joined #openstack-infra11:51
*** danpb has left #openstack-infra11:52
*** scheuran has quit IRC11:52
fungii see an apache process eating 100% of a cpu11:53
StevenKMmmmm, nom nom nom11:53
fungii'm betting if i restart apache, we'll see it go right back. if this is someone looping really fast over the status api then i'll need to do some access log analysis to track down and block them11:54
fungiokay, apache is started again11:56
*** esmute has joined #openstack-infra11:56
*** marcusvrn has joined #openstack-infra11:56
*** marcusvrn1 has joined #openstack-infra11:57
*** rossella_s has quit IRC11:58
*** rossella_s has joined #openstack-infra11:58
*** mrunge has quit IRC12:00
flip214looks much better, thanks!12:01
*** marcusvrn has quit IRC12:01
*** esmute has quit IRC12:01
fungiyeah, so far i haven't seen apache start to chew up the cpu again, but i'll keep an eye on it12:02
*** w__ has quit IRC12:02
*** macjack has left #openstack-infra12:05
*** marcusvrn1 has quit IRC12:06
*** dprince has joined #openstack-infra12:06
openstackgerritMonty Taylor proposed openstack-infra/shade: Add role grant/revoke methods
*** marcusvrn has joined #openstack-infra12:13
*** bexelbie|lunch is now known as bexelbie12:14
*** ddieterly has joined #openstack-infra12:19
*** julim has joined #openstack-infra12:19
*** ociuhandu has quit IRC12:20
*** BharatK has quit IRC12:20
*** aysyanne has joined #openstack-infra12:21
*** BharatK has joined #openstack-infra12:23
*** bknudson has joined #openstack-infra12:25
*** ddieterly has quit IRC12:26
*** ParsectiX has joined #openstack-infra12:26
*** claudiub has quit IRC12:27
*** claudiub has joined #openstack-infra12:27
sdaguefungi: we need a promote on -
sdagueneutron jobs a really high fail rate with the pymysql driver change, which is gumming up everything12:28
*** linuxmaniac has joined #openstack-infra12:31
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Separate out custom yaml tags into separate classes
openstackgerritDouglas Mendizábal proposed openstack-infra/project-config: Move dogtag ca tests from experimental to standard checks
*** doug-fish has joined #openstack-infra12:35
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Support lazy resolving of include yaml tags
*** isviridov is now known as isviridov_away12:38
*** ParsectiX has quit IRC12:39
*** pblaho has joined #openstack-infra12:41
*** EricGonczer_ has joined #openstack-infra12:44
*** afazekas has quit IRC12:46
*** ParsectiX has joined #openstack-infra12:48
*** ldnunes has joined #openstack-infra12:49
*** dpaterson has joined #openstack-infra12:50
*** rlandy has joined #openstack-infra12:51
*** spzala has joined #openstack-infra12:51
*** fhubik is now known as fhubik_afk12:52
*** maishsk_afk has joined #openstack-infra12:52
*** kaisers has joined #openstack-infra12:53
*** fhubik_afk is now known as fhubik12:53
*** BharatK_ has quit IRC12:54
devanandafungi: this looks incorrect to me --,members12:54
devanandafungi: specifically, the problem is that I can no longer approve changes to ironic/stable/kilo12:54
*** salv-orl_ has joined #openstack-infra12:54
devanandaoh - i wonder if ths is the result of the group being renamed, but membership not moving?12:54
*** salv-orlando has quit IRC12:54
dtantsurdevananda, oh, so I'll face the same problem with discoverd group renaming?12:55
devanandadtantsur: dunno. maybe?12:56
devanandaI'm not sure what caused this issue12:56
*** BharatK has quit IRC12:57
*** mpaolino has joined #openstack-infra12:57
*** isviridov_away is now known as isviridov12:58
*** ddieterly has joined #openstack-infra12:58
*** ParsectiX has quit IRC12:59
*** fhubik has quit IRC12:59
*** hdd has joined #openstack-infra13:00
*** e0ne has joined #openstack-infra13:01
*** dboik has joined #openstack-infra13:02
*** krtaylor has quit IRC13:02
*** dims is now known as dimsum__13:02
*** annegentle has joined #openstack-infra13:04
*** ParsectiX has joined #openstack-infra13:04
*** abregman has joined #openstack-infra13:06
*** dboik has quit IRC13:07
*** BharatK has joined #openstack-infra13:07
*** maishsk_afk has quit IRC13:07
fungidevananda: i think it must not have been updated when the other server project acls were batched for individual stable-maint13:08
*** tiswanso has joined #openstack-infra13:09
*** rguillebert has joined #openstack-infra13:09
*** kgiusti has joined #openstack-infra13:09
fungidevananda: it looks like on, for example, nova the stable-maint-core reviewers have added project-specific stable maintainers chosen from that project's core review group13:10
fungidevananda: i've added stable-maint-core as an included group in ironic-stable-core now13:10
fungier, in ironic-stable-maint13:10
*** koolhead17 has quit IRC13:11
*** BharatK has quit IRC13:11
*** koolhead17 has joined #openstack-infra13:12
fungimtreinish: mriedem_away: adam_g: zul: Daviey: flaper87: if one of you is okay adding devananda to,members it sounds like he has some stable backports pending on ironic which need approving13:12
*** achanda has joined #openstack-infra13:13
flaper87fungi: I'm more than happy to have him there.13:13
flaper87devananda: fungi ^13:14
*** alivigni has joined #openstack-infra13:14
*** peristeri has joined #openstack-infra13:15
fungithanks flaper87!13:15
*** koolhead17 has quit IRC13:16
*** ociuhandu has joined #openstack-infra13:19
*** hrubi has quit IRC13:19
*** sdake has joined #openstack-infra13:21
Davieydevananda: I am guessing you are familair with the process and policy?13:23
devanandaDaviey: yah. been working with adam_g on ironic for a while13:24
*** ociuhandu has quit IRC13:24
Davieydevananda: Pukka.  +113:24
devanandai'm delighted if stablemaint-core want to / will handle ironic's stable branches13:24
*** ociuhandu has joined #openstack-infra13:24
devanandabut also like to keep an eye on them myself13:24
*** krtaylor has joined #openstack-infra13:25
*** koolhead17 has joined #openstack-infra13:26
*** dboik has joined #openstack-infra13:28
*** dansmith is now known as superdan13:29
*** kushal has quit IRC13:29
*** achanda_ has joined #openstack-infra13:29
openstackgerritJulia Kreger proposed openstack-infra/shade: Correct get_machine_by_mac and add test
*** achanda has quit IRC13:31
*** rfolco has joined #openstack-infra13:32
*** mriedem_away is now known as mriedem13:33
mriedemfungi: devananda: should we drop,members now? ironic-stable-maint replaces that now13:35
devanandamriedem: yes13:35
*** bradjones has quit IRC13:35
*** otter768 has joined #openstack-infra13:36
*** bradjones has joined #openstack-infra13:38
*** bradjones has quit IRC13:38
*** bradjones has joined #openstack-infra13:38
*** amitgandhinz has joined #openstack-infra13:38
*** derekh is now known as derekh_afk13:39
fungii can clear out and lock/hide that old group13:39
docaedofungi: thanks for those last fixes to the app-catalog adition :) I think only thing left (assuming it's up and running fine?) is to switch DNS righ?13:40
*** otter768 has quit IRC13:41
fungidocaedo: it's not up and running yet. i need to get a few minutes to manually boot a server for it, and then i'll get you the ip address so you can test it out and make sure it's doing what you expect web-wise13:42
fungibut after that, yes, dns change13:43
docaedofungi: that's great, understood - thanks much to you and everyone else on this channel for all the help. It's been a great experience from my side, and my understanding and appreciation for all things infra has grown 100x13:44
*** sslypushenko has quit IRC13:45
docaedoI love that I now have a tangible example of "config as code" I can demonstrate and talk13:45
docaedoabout with reasonable detail and confidence :)13:45
*** kaisers has quit IRC13:48
*** tvanderwiel has joined #openstack-infra13:50
*** woodster_ has joined #openstack-infra13:51
*** dguitarbite has quit IRC13:51
*** krtaylor has quit IRC13:51
*** armax has joined #openstack-infra13:52
*** sslypushenko has joined #openstack-infra13:53
*** maishsk_afk has joined #openstack-infra13:54
*** wenlock has joined #openstack-infra13:54
*** rlandy has quit IRC13:54
fungidocaedo: we have some pre-baked slide decks if you want to present them at conferences, or write your own of course!13:55
*** rguillebert has quit IRC13:55
docaedoI saw the set nibs used recently, that the deck you're talking about (with animated brad pitt gif I think?)13:56
fungii don't know about any animated brad pitt13:57
openstackgerritDaniel Watkins proposed openstack-infra/project-config: Add coverage jobs for cloud-init for both supported Pythons.
fungiwell, except for bakshi's depiction of him in cool world13:57
docaedo(I might be crazy, now I'm going to find it to be sure :) )13:58
mordredfungi: guess what?13:58
mordredfungi: apparently the gate is goign to blow up when we upgarde to 3.4.213:59
fungidocaedo: most of our collaboratively-maintained infra decks are available at
fungimordred: let's not do that then13:59
*** lucasagomes has joined #openstack-infra13:59
mordredfungi: something about a bug in mock13:59
*** annegentle has quit IRC14:00
mordredfungi: lucasagomes knows all the things I think14:00
*** olaph has joined #openstack-infra14:00
lucasagomesmordred, hi there... well not all, but I know a bit14:00
fungidocaedo: oh, and the source for them is at maintained through our usual code review14:00
lucasagomesfungi, mordred this is the issue14:00
docaedofungi: thanks - here's the one: (but I'll leave off, you folks have some work to do!)14:00
lucasagomesin the gate we run 3.4.0 so that bug doesn't affect the gate, but once it's updated to >=3.4.2 we are going to hit that14:01
*** sigmavirus24_awa is now known as sigmavirus2414:01
fungilucasagomes: mordred: yikes. that's a fun one14:01
fungiopen for 3 months and counting14:02
fungiwith a patch14:03
fungisometimes when i think openstack projects are bad about ignoring bugs with proposed fixes, i just have to look around at other free software projects to see that we're at least not alone14:04
*** fallenpegasus has joined #openstack-infra14:04
*** maishsk_afk has quit IRC14:05
lucasagomesfungi, :-) you should follow the glibc development that's good for our ego14:06
fungimeep, my compose key has gone all broken!14:07
*** shardy_ has joined #openstack-infra14:07
*** annegentle has joined #openstack-infra14:07
mordredfungi: that's what you get for trying to use more than one mouse button and a touch screen14:07
mordredfungi: don't you know, the Cult of Jobs has declared such things Bad14:08
*** EricGonc_ has joined #openstack-infra14:08
*** achanda_ has quit IRC14:08
*** shardy has quit IRC14:09
fungixev says the keycodes in my .Xmodmap are still correct14:09
*** ParsectiX has quit IRC14:10
fungireapplying it through xmodmap seems to have restored things to normal. i wonder how it got unmapped?14:10
fungii runs in my .xinitrc for crying out loud14:10
*** wenlock_ has joined #openstack-infra14:10
*** rguillebert has joined #openstack-infra14:10
fungier, it runs14:11
*** maishsk_afk has joined #openstack-infra14:11
*** EricGonczer_ has quit IRC14:11
*** dizquierdo has quit IRC14:13
*** shardy_ has quit IRC14:13
*** shardy has joined #openstack-infra14:13
*** maishsk_afk_ has joined #openstack-infra14:14
*** gordc has left #openstack-infra14:15
*** maishsk_afk has quit IRC14:16
*** maishsk_afk_ is now known as maishsk_afk14:16
*** eharney has joined #openstack-infra14:16
*** bnemec has joined #openstack-infra14:16
*** hdd has quit IRC14:17
*** hdd has joined #openstack-infra14:17
*** annegentle has quit IRC14:20
fungidocaedo: for near-to-mid-term purposes, what size nova instance should i want for in particular how much memory and storage are we looking at?14:20
*** sputnik13 has joined #openstack-infra14:20
mordredfungi: ALL THE MEMORIES!!!!14:21
fungimordred: so long and thanks for all the memories?14:21
docaedofungi: I expect this site to eventually be in the top 10 of all internet sites, so let's treat it as a very important pet.  256gb ram, 2tb SSD local storage, 17 cores.14:22
fungihow about in the next 6 months? ;)14:23
docaedofungi: actually doesn't need much since it's just static site so a moderately small VM can handle a lot of traffic - right now it's on two VMs behind a load balances (expected a big spike of traffic around the summit) ..14:24
docaedofungi: so - probably single VM with 8gb of ram would be more than sufficient, what are the flavor choices?14:24
fungidocaedo: we generally don't go sub-1gb ram or over 30gb14:25
openstackgerritDoug Hellmann proposed openstack-infra/irc-meetings: Add a script for building courtesy ping list for PTLs
fungidocaedo: what's the current memory footprint in its current vm?14:25
*** dizquierdo has joined #openstack-infra14:26
*** timcline has joined #openstack-infra14:26
docaedofungi: great question, I'll find out, hopefully can get answer quickly, will let you know.14:26
*** yamamoto_ has quit IRC14:26
fungiand how much did it spike during teh summit? did you have any trending to see what happened with memory pressure, cpu, et cetera?14:26
*** bauzas is now known as bauwser14:26
fungii would like to make sure it size it appropriate to handle traffic levels that pair saw during the summit if you have numbers14:27
fungier, make sure i size it appropriately14:27
*** bauwser has left #openstack-infra14:27
*** kushal has joined #openstack-infra14:28
docaedofungi: good questions :)  I'm asking the right people now, will let you know as soon as I've got an answer.14:29
*** timcline has quit IRC14:29
fungidocaedo: awesome. sorry i didn't think to ask earlier! :/14:29
openstackgerritMerged openstack-infra/git-review: Add utf-8 char support
docaedofungi: no problem, I should have thought about it myself too. at some point it occured to me, but then I forgot again :)14:30
*** krtaylor has joined #openstack-infra14:32
*** sputnik13 has quit IRC14:32
*** rfolco has quit IRC14:34
*** geoffarnold has quit IRC14:34
openstackgerritJeremy Stanley proposed openstack-infra/git-review: Add reviewers on upload
*** zz_jgrimm is now known as jgrimm14:39
*** weshay has joined #openstack-infra14:39
*** _jreslock has joined #openstack-infra14:40
marcusvrnasselin: hi14:40
*** jgrimm is now known as zz_jgrimm14:41
asselinmarcusvrn, hi14:41
*** yamamoto has joined #openstack-infra14:43
*** yamamoto has quit IRC14:43
marcusvrnasselin: I'm finishing the date filter for scoreboard...but I don't know which approach is better: add a date picker plugin or just enter the date manually14:44
marcusvrnwhat do you think?14:44
*** hdd has quit IRC14:45
asselinplugin is probably more user friendly14:45
asselinpatrickeast is the main developer14:45
*** abregman has quit IRC14:45
marcusvrndo you know when he is online?14:45
asselinhe's not online now, but definitely ping him later14:46
fungijeblair: i think part of the git-review feature we were debating earlier this week is already partly written by jd__ in
marcusvrnI'll do that14:46
asselinmarcusvrn, he should be soon...he's in us pacific time I believe14:46
*** salv-orl_ has quit IRC14:47
marcusvrnasselin: hmm nice! I'll try to ping him later14:47
*** hdd has joined #openstack-infra14:47
*** mrunge has joined #openstack-infra14:47
jeblairfungi: indeed that looks similar!14:47
fungiouch, our node graph looks pathological. suspecting we have a huge node leak again. checking now14:48
jeblairooh ooh ooh!14:48
fungiand, yes, this would be a great opportunity to test-drive the metadata matching14:49
jeblairyeah, i think my change is just failing tests because i forgot to git add a test file. brb14:49
*** e0ne is now known as e0ne_14:49
openstackgerritJames E. Blair proposed openstack-infra/nodepool: Delete leaked instances
jeblairrunning local tests14:50
*** s0nea has quit IRC14:50
*** koolhead17 has quit IRC14:51
*** sabeen1 has joined #openstack-infra14:52
openstackgerritPaul Belanger proposed openstack-infra/infra-specs: Host Stackalytics Service
*** weshay has quit IRC14:53
jeblairfungi: yeah, i think that passes tests generally.  i may still have a race in the test i'm adding, but i think it's safe to go aheand and run that commit in prod if we want to try it out.14:53
*** maishsk_afk has quit IRC14:53
fungii'm game. in a few minutes i'll have a more traditionally-assembled alien node uuid list which will provide a good spot-check14:54
*** s0nea has joined #openstack-infra14:54
*** sabeen2 has joined #openstack-infra14:54
*** yamahata has joined #openstack-infra14:54
fungii can go ahead and stop puppet on nodepool.o.o14:54
*** maishsk_afk has joined #openstack-infra14:54
*** zz_dimtruck is now known as dimtruck14:54
fungihrm, though if we restart nodepoold right now we're likely to tank dib updates14:55
*** e0ne_ is now known as e0ne14:55
openstackgerritJulia Kreger proposed openstack-infra/project-config: Update bifrost job settings
*** Ala has quit IRC14:56
*** tiswanso has quit IRC14:56
*** sabeen1 has quit IRC14:56
*** annegentle has joined #openstack-infra14:58
*** abregman has joined #openstack-infra14:58
*** esmute has joined #openstack-infra14:59
*** yamamoto has joined #openstack-infra15:00
fungijeblair: since gfw changes have apparently in the past few days started to cause problems reaching 29418/tcp from china and the https support in git-review is really only solid in master since the last release, i'm trying to mop up changes which are fit to be in 1.25.0 and tag that today. do you mind weighing in on 160152 and 180178 (they're both short a +2)?15:00
openstackgerritlifeless proposed openstack/requirements: Remove VERBOSE global state.
openstackgerritlifeless proposed openstack/requirements: Group pure and IO functions in
openstackgerritlifeless proposed openstack/requirements: Move into the python package.
openstackgerritlifeless proposed openstack/requirements: Add basic testing of options -> parameters.
openstackgerritlifeless proposed openstack/requirements: Don't write partial requirements files.
openstackgerritlifeless proposed openstack/requirements: Convert test_update_suffix to unit tests.
openstackgerritlifeless proposed openstack/requirements: Ignore the dist directory.
openstackgerritlifeless proposed openstack/requirements: Move test_update to be unit tests.
openstackgerritlifeless proposed openstack/requirements: Convert test_pbr to unit tests.
openstackgerritlifeless proposed openstack/requirements: Split main out a little for testing.
openstackgerritlifeless proposed openstack/requirements: Make _copy_requires pure.
openstackgerritlifeless proposed openstack/requirements: Reduce dataloss window through interrupted writes.
openstackgerritlifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are.
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt.
openstackgerritlifeless proposed openstack/requirements: Add upper-constraints.txt generator.
openstackgerritlifeless proposed openstack/requirements: Make _write_setup_py pure.
*** hichihara has joined #openstack-infra15:01
jeblairfungi: will do15:01
fungioh yeah, 66 rax-dfw.aliens, 7 rax-iad.aliens, 44 rax-ord.aliens15:01
fungihpcloud only has those 4 "locked" instances, so we don't appear to be leaking there at least15:02
*** tiswanso has joined #openstack-infra15:03
fungijeblair: so anyway, i'm leaning toward just cleaning these up normally and not restarting nodepoold while we have image updates underway. what's your opinion?15:03
*** rfolco has joined #openstack-infra15:04
*** ildikov_ has quit IRC15:04
jeblairfungi: okay :(15:04
*** tonytan4ever has joined #openstack-infra15:04
* russellb wonders why this didn't go into gate queue:
*** esmute has quit IRC15:05
*** sdake_ has joined #openstack-infra15:05
fungijeblair: i say once image updates complete we give it a shot. we seem to have some not-so-slow leaks in rax this week, so i expect we'll be able to see it doing its job fairly quickly anyway15:05
mordredI guess  lifeless is up15:06
fungihe never sleeps15:06
lifelessits not me thats not sleeping :/15:07
clarkblifeless o/15:07
*** jcoufal_ has quit IRC15:07
mordredand a clarkb15:07
lifelessclarkb: o/ how goes the spawn?15:07
fungilifeless: well, it's now _also_ you that's not sleeping ;)15:07
jeblairfungi: i have looked at and it lgtm.  but um. just to make sure my reading comprehension is up to par.  that whole discussion was about using ssl in _tests_ right?15:07
clarkblifeless not sleeping either15:07
lifelessclarkb: it gets better... in about 30 years15:07
fungijeblair: correct, for retrieving the updated gerrit.war15:07
mordredI was not sleeping yesterday15:07
fungijeblair: integration testing15:08
lifelessmordred: also you cold be reviewing!15:08
mordredbut it wasn't for those reasons - it was because jetlag + conference15:08
jeblairfungi: okay.  that is an admirable level of thoroughness.  :)15:08
mordredlifeless: I could, that is correct15:08
fungijeblair: simple and just wanted to clear it out before release since it's an easy one15:08
*** rkukura has quit IRC15:08
fungijeblair: i'm assuming this was to fix some problem pelix had running git-review integration testing locally in hp15:09
*** rkukura has joined #openstack-infra15:09
*** sdake has quit IRC15:09
*** sdake has joined #openstack-infra15:10
lifelessmordred: once you've done the pyCon AU thing of course :)15:10
mordredlifeless: oh yeah. I shoudl do that15:11
dhellmannmordred: we have mox3 all cleaned up now, so I was going to do a release on Monday. The code in your github repo matches what was released as 0.7.0, although there's no tag for that release in the repo itself. I'm going to call the next release, with the requirements updates,
*** alex_xu is now known as alexus15:11
mordreddhellmann: ++15:11
*** achanda has joined #openstack-infra15:11
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add project_id and agenda_url for weekly product team meeting
fungijeblair: clarkb: pleia2: SergeyLukjanov: jhesketh: mordred: AJaeger: anteaya: sdague: i'd like to declare a soft freeze on new project creation today. i want to start teeing up the stack of project rename changes shortly and would like to avoid creating more spurious merge conflicts if possible15:12
pelixjeblair fungi: problem was that urlopen ignores proxies by default, switching to requests showed some issues around SSL configuration with python 2.7.15:12
openstackgerritFlavio Percoco proposed openstack/requirements: Use pyngus>=1.3.1
pelixIt's still not clear to me whether the last statement by saying that the extra libraries only silence the warning as opposed to adding pure python implementation of SSL that can be configured as expected to close off some SSL vulnerabilities.15:13
pelixhowever it's probably no more/less insecure that before15:13
pelixjeblair fungi: ^^15:13
*** mrmartin has joined #openstack-infra15:13
fungipelix: yeah, that's a battle we face with pretty much everything using requests now15:14
*** salv-orlando has joined #openstack-infra15:14
*** dannywilson has joined #openstack-infra15:14
*** sdake_ has quit IRC15:14
fungipelix: you can either solve it by pip installing requests[security] explicitly or running a newer python interpreter15:14
jeblairmordred: lgtm, but you have spent some time with those options, maybe you should look at it too15:15
fungipelix: or you can ignore it and it's no less secure than it was before requests/urllib2 started echoing that warning15:15
mordredjeblair: I will now look at it15:15
*** puranamr has joined #openstack-infra15:15
openstackgerritMerged openstack-infra/git-review: Switch to requests to support proxying of 'https'
fungiokay, i think i have the current alien leak mopped up for the moment15:16
pelixfungi: indeed, but felt that the warning should be left there so someone running the tests can decide whether they would like to do something about the SSL or not15:16
fungipelix: yep15:16
mordredjeblair: ah! neat - Ive been setting push url - I didn't know about pushinsteadof15:17
mordredbut I like it15:17
*** e0ne is now known as e0ne_15:18
sdaguefungi: ok, fine by me. I will not +A any more of those today.15:18
fungisdague: awesome--thanks!15:19
fungialso for those interested, the maintenance plan for today's renames is shaping up at
fungithe current count is 60 repos15:19
mordredjeblair: I should really finish my use-push-url patch15:19
mordredalthough I have been using it as the git-review on my laptop for, you know, almost a year now15:20
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly akanda meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly keystone meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly product team meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly swift meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly tacker meeting
openstackgerritClint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly training-guides meeting
fungimordred: yeah, i was going to ask if you had time to polish it up today for inclusion in 1.25.0 but i think maybe we just start releasing more often and have a 1.26.0 rsn for that15:20
*** armax has quit IRC15:21
fungialso i was wondering whether we should switch the doc job for git-review to only publish on release and not post15:21
fungisince i have a feeling not a lot of people are running git-review from master, having the published documentation reflect newer features than are present in the latest release could be misleading there15:22
mordredfungi: well, I just hit recheck on it15:22
*** dprince has quit IRC15:22
mordredbecause I think the old failures were an environmental not-related-to-patch issue15:22
mordredfungi: I also agree about release docs15:22
fungioh, cool15:22
*** mpaolino has quit IRC15:23
fungiyeah, i'll whip up the job change for that real quick now15:23
*** MarkAtwood has joined #openstack-infra15:23
*** michchap has quit IRC15:23
*** ildikov_ has joined #openstack-infra15:23
*** armax has joined #openstack-infra15:24
mgagnemordred: alright, I can't find the historical data. Where does the jeepyb name come from?15:24
mordredmgagne: it's short for "Gerrit Project Builder"15:24
jeblairfungi: shall i rebase/stack the rename changes, or were you itching to do that?15:24
mordredmgagne: which is inspired by jenkins job builder15:24
mgagnemordred: thanks!15:25
mordredmgagne: but it's a weird phonetic reworking of how the acronym of that would sound spoken15:25
*** achanda has quit IRC15:25
mordredmgagne: it's the worst name I've ever made15:25
*** koolhead17 has joined #openstack-infra15:25
openstackgerritGal Sagie proposed openstack-infra/project-config: dragonflow : move from stackforge/ to openstack/
mgagnemordred: I can't type it right, have to google it everytime15:25
jeblairafter naming it so, mordred is officially no longer allowed to name projects.  we have to get a special dispensation from the bikeshed subcomittee of the tc nomenclature working group each time he starts a new project.15:25
mordredmgagne: (GPB is short for "Google Protocol Buffers"...)15:25
fungijeblair: if you want to, have at it. it looks like none of,n,z have changed since i put together the renames list, so everything should be safe now15:25
*** michchap has joined #openstack-infra15:26
mgagnefungi: add jeepyb to the list :D /jk15:26
openstackgerritMerged openstack-infra/storyboard-webclient: Removed eslint from compile step
fungimgagne: heh15:26
openstackgerritMerged openstack-infra/storyboard-webclient: Remove limit parameter from browsing
*** e0ne_ is now known as e0ne15:27
jeblairalso, is anyone else having problems with the rename etherpad?15:27
jeblairhuh.  that's interesting.15:28
*** AzherKhan has joined #openstack-infra15:28
mordredjeblair: I agree15:28
jeblairthere's a rogue abiword.  killing.15:28
*** annegentle has quit IRC15:28
*** spzala has quit IRC15:28
jrolldhellmann: did you ever end up writing a spec for servers switching to semver?15:28
*** annegentle has joined #openstack-infra15:29
*** pradk has joined #openstack-infra15:30
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Make Python 3.4 voting on git-review again
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Only update got-review docs on release
jeblairfungi: Got Review?15:32
jeblairi do!15:32
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Only update git-review docs on release
fungime too15:32
openstackgerritMerged openstack-infra/git-review: get_remote_url(): also honor url.*.pushInsteadOf
jeblairi'm still getting kicked off of etherpad regularly15:33
fungijeblair: when that's happened to me in the past, i've found restarting my browser (iceweasel/firefox) makes it stop15:33
jeblairi have not done that in several days, and i have had zuul status running.  that's probably a good idea.15:34
jeblairyou know, i'm really not happy that people removed the depends-on lines i added to project rename patches.15:35
*** ildikov has joined #openstack-infra15:36
*** ildikov_ has quit IRC15:37
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
*** otter768 has joined #openstack-infra15:37
*** rguillebert has quit IRC15:38
openstackgerritClint Adams proposed openstack-infra/git-review: Add git-review -l as a possibility in man page synopsis and usage doc
*** mrmartin has quit IRC15:38
*** dizquierdo has quit IRC15:40
openstackgerritClint Adams proposed openstack-infra/git-review: Add “git-review -l” to man page synopsis and usage doc
*** devvesa has quit IRC15:41
*** harlowja_at_home has joined #openstack-infra15:41
*** otter768 has quit IRC15:41
*** isviridov is now known as isviridov_away15:42
*** patrickeast has joined #openstack-infra15:42
anteayafungi: soft freeze on project-creation acknowledged15:44
*** alexsyip has joined #openstack-infra15:44
fungithanks anteaya15:44
*** dangers_away is now known as dangers15:45
*** maishsk_afk has quit IRC15:45
openstackgerritDaniel Watkins proposed openstack-infra/project-config: Add coverage jobs for cloud-init for both supported Pythons.
*** maishsk_afk has joined #openstack-infra15:45
fungijeblair: yeah, i think a lot of people still aren't aware of the possibility that their changes can be altered in gerrit and no longer match their local copy, and that they should refresh from gerrit any time they go to make new edits15:46
*** maishsk_afk has quit IRC15:46
Clintfungi: do you know where i might see the breakage 170324 is intended to fix?15:46
anteayafungi jeblair no in one case one person felt their depends on was stale and removed it intentionally15:47
fungiClint: add a change to review-dev or in the openstack-dev/sandbox repo on review.o.o with a non-latin-1 character in the commit subject, then git review -l for that repo15:47
anteayaI commented that the depends on was not stale and was required to track a through review15:47
*** tiswanso has quit IRC15:48
fungiClint: i take it you're considering writing the missing regression test for that?15:48
fungiClint: if so, thanks!15:48
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Add configuration switches for features that make Neutron unstable
Clintfungi: i'm trying to understand the change first, but i was thinking non-ascii rather than non-latin1, so that is a helpful bit of info15:49
*** dtantsur is now known as dtantsur|afk15:49
fungiClint: well, i say non-latin-1 just to be sure it's not something easily transcoded15:49
mordredjeblair: a rogue abiword? sigh15:49
jeblairanteaya: thanks.  it indeed still depends on a change whether the change has merged or not.  i want a depends-on pointing to governance for every project rename change.15:50
*** achanda has joined #openstack-infra15:50
*** rguillebert has joined #openstack-infra15:50
fungiClint: non-ascii would probably work, but snowman or similar would be a more thorough confirmation15:50
Clintfungi: “” look fine to me, which is why i was confused15:50
anteayajeblair: they added them back but not as a depends on, as a link to a governance change in the commit message15:50
mordredjust don't name a file that and expect to check the file out of VCS on solaris ...15:51
Clintdo i even have a font withi snowman installed15:51
jeblairanteaya: <sigh> then i will have to do it again.15:51
*** shardy_ has joined #openstack-infra15:51
anteayanot sure why they don't like depends on in the commit message15:51
anteayajeblair: yeah, sorry :(15:51
*** kutija has joined #openstack-infra15:51
SpamapSfungi: the right way to say it instead of 'non-latin-1' is likely "multi-byte utf-8"15:51
jeblairanteaya: in the future, i'm going to take a _very_ hard line on this and will not fix them.  it's in the docs.  anything lacking a depends-on will be dropped from the renames.  day-of if need be.15:51
SpamapSfungi: possibly even "more than 3 byte utf-8"15:52
anteayajeblair: okay thanks for letting me know, I was soft on it as I obviously missed how important it is15:52
fungiSpamapS: possibly. though i think we'll run into gerrit issues too in that case15:52
anteayajeblair: I will be clearer in future15:52
*** shardy has quit IRC15:52
fungiSpamapS: depending on whether it also tries to store that in the database, which currently only supports 3-byte codepoints because yay mysql15:53
ClintSpamapS: “ is multi-byte utf-8 :p15:54
SpamapSClint: you're multi-byte utf-815:54
*** tiswanso has joined #openstack-infra15:55
*** kutija_ has quit IRC15:55
anteayajeblair fungi I don't want to undo anything you have done, what can I do to help at this point?15:55
jeblairanteaya: in a few minutes, i will ask you to re-review several of the changes15:55
* anteaya stands by15:55
anteayajeblair: will do15:55
openstackgerritTom Cammann proposed openstack-infra/project-config: Create new stackforge project for Cathead
*** spzala has joined #openstack-infra15:56
fungianteaya: yep, and also reviewing the etherpad for inconsistencies would be awesome. the cut-and-paste bits are scripts i'll be running on relevant systems, but having them verbatim in the etherpad helps make them reviewable15:56
*** shardy_ has quit IRC15:57
*** shardy has joined #openstack-infra15:57
electricalnibalizer: do you know how i can test with rspec-puppet if i receive a warning or not? I'm printing out a warning in some cases and want to make sure it does :-)15:57
*** spzala_ has joined #openstack-infra15:57
anteayafungi: confirming this is the etherpad in question:
*** rossella_s has quit IRC15:58
fungianteaya: yep!15:58
anteayagreat, will peruse15:58
*** rossella_s has joined #openstack-infra15:58
*** rguillebert has quit IRC15:59
anteayafungi: I will notify you if I see anything worth questioning, I won't edit it myself15:59
fungianteaya: well, if you do edit it, i'll see the color highlights (as long as you're not purely deleting), but whatever works best for you16:00
*** sputnik13 has joined #openstack-infra16:00
anteayaah okay thanks16:00
*** rlandy has joined #openstack-infra16:00
*** spzala has quit IRC16:01
*** spzala_ is now known as spzala16:01
fungianteaya: _hopefully_ it's all accurate since i scripted extraction of the rename mapping from the actual code changes, and then scripted generation of the commands from the result16:02
fungiwhen dealing with 60 project renames, i don't trust myself not to miss something16:03
anteayaI hope so too16:03
anteayaand share your thoughts16:03
AJaegerfungi: I'm fine with the soft-freeze.16:04
Clintfungi: i'm still not seeing a problem, even with chinese16:04
openstackgerritZhenguo Niu proposed openstack-infra/project-config: Add ironic-dashboard to openstack
AJaegerfungi: Let's extend it to all the relevant files that we touch during the rename.16:05
anteayaI don't see chef-pacemaker on the etherpad (it is an abandoned patch, so makes sense), do you want me to delete it from the infra wikipage?16:05
nibalizerelectrical: i dont rspec puppet so :shrug:16:05
*** wuhg has joined #openstack-infra16:05
electricalhehe okay16:05
AJaegerEven a chnage to make a job non-voting might cause a merge conflict...16:05
*** jlanoux has quit IRC16:06
*** mrmartin has joined #openstack-infra16:06
openstackgerritJeff Peeler proposed openstack-infra/project-config: Make kolla functional check voting
fungiAJaeger: yep, mostly that's just going to be new project creation, but you're right there's a chance other changes touch some of those (not sure i want to freeze zuul/layout.yaml and jenkins/jobs/projects.yaml but i guess we can)16:07
openstackgerritDirk Mueller proposed openstack-infra/project-config: Start with a green field for RPM packaging
AJaegerfungi: if you want to approve something urgent, go for it. I'll take it slower today...16:08
*** arxcruz has quit IRC16:08
pleia2j^2: left a comment in your governance patch16:08
anteayafungi: I'll just remove the mention of chef-pacemaker in the infra wiki, it is abandoned and isn't on the eitherpad16:08
j^2pleia2: looking16:08
*** harlowja_at_home has quit IRC16:08
AJaegerfungi, anteaya: Anything else you need from me? Otherwise i disappear again...16:09
anteayaAJaeger: just reviews on patches that get rebased16:09
openstackgerritDirk Mueller proposed openstack-infra/project-config: Start with a green field for RPM packaging
anteayapossibly anytime from now to rename16:09
anteayaAJaeger: and thanks16:09
openstackgerritFrank van Gemeren proposed openstack-infra/jenkins-job-builder: Add support for Gitlab Plugin
openstackgerritFrank van Gemeren proposed openstack-infra/jenkins-job-builder: Use an extra level in the XML
*** AzherKhan has quit IRC16:10
AJaegeranteaya: Ok, will review some later.16:11
*** AzherKhan has joined #openstack-infra16:11
anteayaAJaeger: thanks16:11
*** ddieterly has quit IRC16:11
*** sdake_ has joined #openstack-infra16:12
*** puranamr_ has joined #openstack-infra16:12
*** puranamr has quit IRC16:13
*** puranamr_ has quit IRC16:13
*** tonytan4ever has quit IRC16:14
jeblairanteaya: sorry, taking longer than expected.  maybe another 15 minutes to get those changes ready.16:14
anteayajeblair: no rush from me, dealing with email16:14
*** frickler_ has joined #openstack-infra16:14
*** frickler_ has quit IRC16:14
pleia2j^2: thumbs up16:15
j^2pleia2: thanks for that catch :)16:15
pleia2now we do have the issue of the rename change depending on the governance change, but I think it's unlikely that the TC will approve the goverance change before our rename, jeblair thoughts? re: and the 2nd Depends-On?16:16
*** sdake has quit IRC16:16
*** bnemec has quit IRC16:16
jeblairpleia2: ah, yeah, we should reverse that; at that point it's a simple add to existing approved program.  i will fix that in my surgery, thanks.16:17
pleia2jeblair: great, thanks16:17
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add unstable Neutron job
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Add configuration switches for features that make Neutron unstable
fungithe alien mop-up hasn't really solved the node starvation much. looks like we're getting an "unknown error" trying to launch in hpcloud. checking for other leaks there now16:22
*** dguerri is now known as dguerri`16:22
*** puranamr has joined #openstack-infra16:23
*** e0ne has quit IRC16:24
*** koolhead17 has quit IRC16:24
fungiahh, yep. large floating-ip leak there16:25
fungi585 fips not associated with any instance16:25
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add create method for secgroup rule
greghaynesah, were node starved?16:27
*** gyee_ has joined #openstack-infra16:28
*** dprince has joined #openstack-infra16:28
*** Swami has joined #openstack-infra16:29
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add create method for secgroup rule
openstackgerritDirk Mueller proposed openstack-infra/project-config: Start with a green field for RPM packaging
dhellmannjroll: ttx and I discussed that, and we thought the mailing list thread was sufficient documentation for now16:32
jrolldhellmann: great, thanks :)16:32
*** ashleighfarnham has joined #openstack-infra16:33
*** samuelBartel has quit IRC16:33
*** puranamr has quit IRC16:33
*** doude has quit IRC16:34
dhellmannjeblair, fungi: speaking of specs, should I put one together about my ideas for reviewing tag requests, or should I start a mailing list thread first/instead?16:34
*** wznoinsk has quit IRC16:35
dhellmannjeblair, fungi : the tl;dr is to have a repo with yaml files indicating the next requested tag for a project, to give us something to review, and in phase 1 use those files to create tags by hand and in phase 2 have a job do the tagging for us on merge. Details on file format, etc., TBD but would include version, sha, series, and any special highlights to note in the announce email.16:36
fungidhellmann: a spec might be a better place to start, since this is going to be heavy on the "what is possible in our toolchain and what do infra admins want to be stuck supporting"16:36
marcusvrnpatrickeast: ping16:36
jeblairdhellmann: i think it will need an infra-spec eventually; so either list+spec or just spec.16:36
*** esmute has joined #openstack-infra16:36
*** MarkAtwood has quit IRC16:36
*** puranamr has joined #openstack-infra16:36
fungii'm basically okay with the "we have a repo where people can upload requests to have a release manager tag something" plan, but once we step past that into automation is where it gets concerning for me16:37
dhellmannyeah, that part is pretty fuzzy so I'm not in a rush to take that step16:37
fungii would still like to see support in gerrit where it should be rather than some elaborate machine to automate this16:37
jeblairfungi: ++16:38
jeblairi thought i heard sdague was going to work on that ;)16:38
flaper87fungi: just a heads up, images seem to have been correctly created16:38
dhellmannjeblair: nice try ;-)16:38
sdaguejeblair: you keep hearing wrong :)16:38
jeblairi know what i heard; not my fault you said "tag" and "gerrit" :P16:39
fungiflaper87: awesome, thanks for checking!16:39
*** olaph has quit IRC16:40
fricklertonyb: are you still interested in getting vivid to run? and could use a bit more review.16:42
fricklertonyb: once these are merge, we should be ready to get some nodepool instances with vivid, I did that already in my local setup16:43
greghaynesjeblair: fungi AIUI we dont publish the nodepool logs for image uploads because some creds get leaked there? Has there been any thought to exposing the warning and above logs only (I assume creds are only leaked on debug)?16:43
*** AzherKhan has quit IRC16:44
fungigreghaynes: i don't honestly know. it needs to be investigated/researched16:44
jeblairdhellmann, fungi: yeah, i _think_ there was some talk about putting a signed tag block in the yaml that's reviewed, in which case, maybe i could be comfortable with it.  definitely spec worthy.16:44
*** olaph has joined #openstack-infra16:44
fungijeblair: dhellmann: right. if that's a route we want to go i can play around with some tooling options to extract and propose and reapply a tag object16:45
dhellmannjeblair: what does that buy us?16:45
dhellmannI guess we don't just want a bot signing the packages?16:45
fungidhellmann: it would allow the projects' devs to submit tags, and someone else to decide whether they were okay and let them through into the release pipeline16:45
jeblairdhellmann: the main thing this is dancing around is that right now, we have tas that are signed by a human that is part of a trust network.  we can have a bot sign tags, but that is worth less.16:46
jeblair"we have tags"16:46
*** Sukhdev has joined #openstack-infra16:46
fungialso if it's a mechanism anyone can use to propose a tag object they've created, then we get to preserve signatures from the dev teams who worked on the project rather than a release manager form some other tangentially related team16:47
dhellmannok, that makes sense16:47
*** cdent_ has joined #openstack-infra16:49
*** cdent has quit IRC16:50
*** cdent_ is now known as cdent16:50
*** ashleighfarnham has quit IRC16:50
fungiit also might make a good coordination point since the dev proposing the release can also propose release notes along with the tag object, and all that can get fed into something like automated release announcements too16:52
dhellmannfungi: yeah, that's what I meant by "highlights" in the description ^^16:53
openstackgerritJames E. Blair proposed openstack-infra/project-config: networking-bgpvpn: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
openstackgerritJames E. Blair proposed openstack-infra/project-config: Project rename stackforge/ironic-discoverd -> openstack/ironic-inspector
openstackgerritJames E. Blair proposed openstack-infra/project-config: vmware-nsx: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move zvm-driver to stackforge-attic
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook*
openstackgerritJames E. Blair proposed openstack-infra/project-config: networking-midonet: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Remove old Fuel plugins
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
openstackgerritJames E. Blair proposed openstack-infra/project-config: networking-ovn: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-odl into the openstack namespace
openstackgerritJames E. Blair proposed openstack-infra/project-config: networking-cisco: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: networking-ofagent: move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: dragonflow : move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/octavia -> openstack/octavia
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
anteayait will be a patch bomb kind of day16:54
mesteryhowdy infra folks! I can't seem to edit the members of the neutron-stable here (team,info), is that be design?16:54
jeblairanteaya: here's what i did for the governance changes -- any new programs have a "Depends-On:" header.  any simple repo additions to existing programs have a note that says "Related governance change" so we know the cleanup patch has been proposed.16:54
jeblairanteaya: and stackforge attic moves have neither16:54
anteayajeblair: very good16:54
* anteaya reviews16:55
*** mrmartin has quit IRC16:55
*** jith_ has quit IRC16:55
jeblairanteaya, fungi, pleia2, AJaeger: there were some _serious_ merge conflicts in there, and git did a terrible job on its own.  so they are going to need real re-review.  particularly around l2gw and mistral.16:56
anteayathanks for the heads up16:56
jeblair(like, it was merging projects together and stuff)16:56
* anteaya starts with the head of the stack16:56
*** Guest13143 has quit IRC16:56
fungimestery: the stable-maint-core team owns the per-project stable-maint teams16:57
jeblair(in case you are wondering, they are in "least number of merge conflicts" order :)16:57
anteayaha ha ha16:57
anteayathere's always a plan16:57
*** sarob has joined #openstack-infra16:57
mesteryfungi: OK, cool, I'll work with those folks. Thanks!16:57
jeblairi'm going to take a short break and then review them myself.  biab.16:57
fungimestery: they want to vet new additions to make sure the people being proposed are intimately familiar with the backport standards and stable release management guidelines16:57
fungijeblair: thanks for untangling all that16:58
*** unicell has quit IRC16:58
pleia2I'm packing up now to take the husband to the doctor, likely won't be back until mid-rename16:58
fungipleia2: g'luck16:58
patrickeastmarcusvrn: pong16:58
fungithe fip leak cleanup seems to be getting our node starvation back under control16:58
anteayajeblair: yes, thank you16:59
anteayapleia2: good healing energy to surround you, your husband and the doctor16:59
*** lucasagomes is now known as lucas-beer17:00
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add unstable Neutron job
marcusvrnpatrickeast: hi! I'm working on some improvements of scoreboard17:01
patrickeastmarcusvrn: awesome!17:01
marcusvrnpatrickeast: I have talked to asselin and he said that you are the main dev17:02
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Add configuration switches for features that make Neutron unstable
marcusvrnpatrickeast: I implemented a date filter instead of timeframe in order to search by periods17:02
*** lucas-beer has left #openstack-infra17:03
*** viglesias has joined #openstack-infra17:03
patrickeastmarcusvrn: ooh nice, have you posted a review for it?17:03
*** viglesias has left #openstack-infra17:03
marcusvrnpatrickeast: not yet, to finish it I have to decide which approach is better: add a date picker plugin (more user friendly) or just leave the field to enter manually the date17:04
*** annegentle has quit IRC17:05
marcusvrnwhat do you think17:05
patrickeastmarcusvrn: gotcha, i’m cool with either one… any way to choose a date range is better than none ; )17:05
patrickeastmarcusvrn: maybe as a starting point you could just use a html5 date input or something, should work on most browsers to make it at least somewhat easy to enter in tiems17:06
vipulcan anyone help fix a readthedocs issue?
patrickeastmarcusvrn: but if you want to put in a nice date picker im totally on board17:06
marcusvrnpatrickeast: oh, nice! I'll take a look on that17:07
marcusvrnpatrickeast: good, let me see what I can do :)17:07
*** shardy has quit IRC17:07
*** salv-orl_ has joined #openstack-infra17:08
marcusvrnpatrickeast: and I think two more interesting improvements could be: pagination and a score/summary of the search17:08
*** mriedem has quit IRC17:09
*** ashleighfarnham has joined #openstack-infra17:09
patrickeastmarcusvrn: yea definitely, both of those were things i had wanted to add and just didn’t have the time initially17:09
*** jerryz has joined #openstack-infra17:09
patrickeastmarcusvrn: would help make it much nicer to use17:09
openstackgerritPaul Belanger proposed openstack-infra/system-config: WIP: Create stackalytics.o.o under -infra
AJaegerjeblair: looks broken, it adds midonet in addition to the rename17:10
patrickeastmarcusvrn: iirc i even had a ‘start’ and ‘count’ parameter for the api endpoint for doing pagination17:10
patrickeastmarcusvrn: and just didn’t do anything with them17:10
openstackgerritDirk Mueller proposed openstack-infra/project-config: Start with a green field for RPM packaging
anteayajeblair: do you want me to -2 to prevent merge, or not do that now?17:10
openstackgerritPaul Belanger proposed openstack-infra/puppet-stackalytics: WIP: Initial commit for puppet-stackalytics
marcusvrnpatrickeast: yep, I saw those parameters17:11
AJaegeranteaya: let's -2 the first patch in the series17:11
jeblairAJaeger: yeah, that should be sufficient17:11
marcusvrnpatrickeast: yep, nice to know that those improvements are desired. I'll work on those improvements17:11
jeblairAJaeger: thanks, that does indeed look broken :/17:11
*** salv-orlando has quit IRC17:11
anteayaAJaeger: okay which you have done17:11
*** hichihara has quit IRC17:12
patrickeastmarcusvrn: cool, thanks for helping out with it!17:12
jeblairAJaeger: the midonet change itself looks okay though, so that should be easy to fix.  i'll continue reviewing up to l2gw and then fix it.17:13
waynrzuul question: is there a good example of an alternative to jenkins' "matrix" style job in project-config?17:13
openstackgerritPaul Belanger proposed openstack-infra/system-config: WIP: Create stackalytics.o.o under -infra
*** markus_z has quit IRC17:13
waynralso: can we set any arbitrary job parameter using "parameter-function"? not just modify a set of predefined parameters?17:14
AJaegeranteaya: I'll +2 what I've done.17:14
AJaegeranteaya, jeblair: Is the bottom of the stack? Will either of you -2 it?17:14
waynralso: (related to the matrix question) i'm hoping there is a way to queue the same job more than once, each time with a different set of variables17:14
anteayaAJaeger: got it17:15
*** marcusvrn has quit IRC17:16
*** claudiub|2 has joined #openstack-infra17:16
*** marcusvrn has joined #openstack-infra17:16
*** yamamoto has quit IRC17:17
waynrhmmm seems like i might have to implement matrix support myself17:18
*** claudiub has quit IRC17:19
jeblairwaynr: parameter function can do anything17:19
openstackgerritMerged openstack-infra/devstack-gate: revert to eventlet based keystone upgrade for juno -> kilo
waynrcool, that was my impression so far just wanted to be sure17:19
anteayaAJaeger: what is broken on the midonet patch?17:20
jeblairwaynr: instead of adding matrix to zuul, consider using jjb templating to explode what you need into many jobs.  that way the report to the user looks like "job-variant1: SUCCESS\n job-variant2: SUCCESS"17:20
AJaegeranteaya: is the broken one17:20
anteayaoh okay17:21
*** sarob has quit IRC17:21
AJaeger185705 adds midonet setup besides the rename17:21
russellbi've got a patch that won't go into the gate queue.  It uses Depends-On and the other change has been merged already.
waynrjeblair: ah right, that's what i was thinking a month ago when i last worked on this17:21
AJaegerrussellb: There's no automatic cross-project way to trigger it17:22
*** tvanderwiel has quit IRC17:22
*** unicell has joined #openstack-infra17:22
jeblairrussellb: oh, hrm.  it's possible the enqueing there doesn't work across change queues.  can you you re-approve?17:22
*** jaypipes has joined #openstack-infra17:22
russellbi've rechecked a couple times17:22
russellbjeblair: you'll have to re-approve :-)17:22
AJaegerjeblair: let me approve, you already did ;)17:22
jeblairrussellb: sadly, due to a gerrit bug, recheck doesn't work :(17:22
waynrwhen specifying a zuul template for a particular project is it possible to expand that template using a list of values for a key? rather than copying the template for each variation17:22
russellbjeblair: oh ok, thanks for clarifying, i didn't know that17:22
jeblairoh that's a project config change17:23
*** gyee_ has quit IRC17:23
jeblairare we freezing the whole repo or just part of it?17:23
*** puranamr_ has joined #openstack-infra17:23
anteayaI'd like to freeze the whole thing17:24
anteayathese renames are very fragile17:24
anteayaI don't want to unwind in case of a needed rebase17:24
jeblair(apparently people think this is easy)17:24
AJaegerjeblair: shall I remove my approval,  russellb looked innocent17:24
anteayaI don't know who they are17:24
fungi"oh, it can go in stackforge now, we'll just rename it later"17:25
*** abregman has quit IRC17:25
* fungi loves when people say that17:25
*** salv-orlando has joined #openstack-infra17:25
*** yamamoto has joined #openstack-infra17:25
AJaegerjeblair: you beat me - thanks17:25
jeblairAJaeger: yeah, either way17:25
*** puranamr has quit IRC17:26
jeblairrussellb: we'll approve it after the renames, okay?17:26
* russellb pouts17:26
russellbok :)17:26
* anteaya hands russellb a cookie and glass of milk17:26
jeblairrussellb: it does _actually_ touch a file in a rename change17:27
dhellmannis there a way to delete or mark a story in storyboard as invalid?17:27
*** wznoinsk has joined #openstack-infra17:27
* dhellmann struggles with a new ui17:27
*** yamamoto has quit IRC17:27
*** mriedem has joined #openstack-infra17:27
russellbjeblair: true17:27
jeblairrussellb: you might want to rebase it on just in case17:27
*** yamamoto has joined #openstack-infra17:27
*** Sukhdev has quit IRC17:27
jeblair(or at least check if it's going to conflict)17:28
*** salv-orl_ has quit IRC17:28
* jeblair goes back to staring at changes cross-eyed17:28
russellbjeblair: ok, will do17:29
* anteaya is listening to opera17:29
anteayait is helping to stave off some cross-eyed17:29
*** puranamr_ has quit IRC17:29
*** alaski is now known as lascii17:30
openstackgerritRussell Bryant proposed openstack-infra/project-config: Use DEVSTACK_GATE_SETTINGS in networking-ovn
*** akrivoka has joined #openstack-infra17:30
*** puranamr has joined #openstack-infra17:30
jeblairanteaya, AJaeger: in 186532 the jenkins-jobs stanzas are changing17:30
russellbrebased, no conflict17:30
jeblairthey go from 'chef-test-jobs' to a list of 5 jobs17:31
jeblairis that intentional?17:31
anteayanot from me17:31
anteayajeblair: is the last patchset from me?17:31
jeblairno it's from me17:31
openstackgerritMerged openstack-infra/git-review: Add reviewers on upload
jeblairi'm asking you in case you know anything about it17:31
anteayajeblair: in 25 they were all a list of 5 jobs17:32
AJaegerjeblair: it rings a bell, let me dig a bit...17:32
AJaegerjeblair: see change I56eee9e76b50d95bfcb38a6b9d2942e2113673da17:32
anteayajeblair: oh yes, I see what you are saying17:32
anteayamy suspicion is they changed the jobs in the middle of the rename17:32
AJaegerjeblair: yes, they did - and I didn't notice during review ;(17:33
jeblairso the rename is lagging behind reality because of the "improvement" in I56eee9e76b50d95bfcb38a6b9d2942e2113673da17:33
anteayaI just added chef-rake-integration to get jenkins to pass17:33
AJaegerjeblair: exactly17:33
AJaegerjeblair: do you want me to change it or will you do it?17:33
jeblairAJaeger: i'll do it17:33
*** Sukhdev has joined #openstack-infra17:33
*** Swami has quit IRC17:34
*** MarkAtwood has joined #openstack-infra17:34
*** sarob has joined #openstack-infra17:34
anteayasorry I didn't dig back far enough to find out exactly what happened17:34
jeblairokay, the rest of that change lgtm17:37
*** cdent has quit IRC17:37
*** mrmartin has joined #openstack-infra17:37
*** otter768 has joined #openstack-infra17:38
*** radez_g0n3 is now known as radez17:38
*** abregman has joined #openstack-infra17:39
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Fix repositories section of puppet4 spec
mmedvedehi infra, I have a zuul question. Is it possible to configure zuul to only report job failures, and not merge failures? I could not find it in zuul docs.17:40
jeblair188030 also has a jjb change, but i think it looks sensible17:40
jeblairwe might want to ask people not to do that in the future17:40
*** amotoki has quit IRC17:41
anteayajeblair: sorry I am not seeing the jjb change in 18803017:41
jeblairit's mentioned (or at least, alluded to) in the commit message, so i presume any changes are correct.  :)17:41
*** tonytan4ever has joined #openstack-infra17:41
jeblairanteaya: the change in jenkins/jobs/projects.yaml17:42
*** otter768 has quit IRC17:42
fungias in not make modification to job configuration in rename changes beyond changing the names of the projects?17:43
anteayathe removed pep8, py27, py34 and went with pypi jobs and python jobs17:43
fungiseems like a sane requirement, for expediency of maintenances17:43
anteayawell in moving to openstack some projects need to drop rtd in favour of docs.o.o17:44
jeblairyeah.  though we should think about the impact of things like 'stackforge-specs-jobs' -> 'openstack-specs-jobs'17:44
jeblairanteaya: and that17:44
jeblairbut maybe we could limit it to changes related to the rename at least :)17:44
anteayaI'm open to discussing how to handle that17:44
uberjaypossibly interesting? something I ran into when manually enqueuing a missed change (zuul enqueue ...):
fungifair enough. there are some cases where it makes sense related to the rename itself, tes17:44
fungier, yes17:44
anteayaas I disagree with reconfigureing jobs in the midst of a rename17:44
anteayaa la chef17:44
uberjay(exception in zuul.WebApp, persistent, had to kill zuul-server and restart it)17:45
*** aysyanne has quit IRC17:46
*** achanda has quit IRC17:46
fungiuberjay: interesting. this morning when i got online our zuul status page was performing terribly and i found a forked apache process eating tons of cpu. restarting apache seemed to clear it up17:46
fungiprobably not related17:46
marcusvrnpatrickeast: I used html5, it's clean and simple to use17:46
*** notnownikki has quit IRC17:46
uberjayfungi: oh, weird... yeah, i don't *think* related, but this did completely break the web updates (they were frozen in time from when i enqueued the job) it didn't actually appear to affect processing the event stream and triggering jobs with jenkins, though17:47
anteayajeblair: am I waiting for you to respin 186532?17:47
anteayajeblair: or should I play through?17:48
*** jistr has quit IRC17:48
fungiuberjay: running zuul from master or some particular release?17:48
AJaegerjeblair: in the added/subtracted lines don't match either - and I found two problems17:48
jeblairanteaya: i will do 186532 now17:49
jeblairAJaeger: thanks17:49
AJaegeranteaya, fungi, jeblair: Please double check it's a large change and I'm not seeing what's changed17:49
anteayajeblair: okay17:49
uberjayfungi: great question! i'll check. i'm using whatever asselin's os-ext-testing repo pulls.17:49
uberjayyeah, master and up-to-date!17:50
fungiokay, it seems our node starvation situation is now fully recovered and we're making a ton of headway on the queue backlog17:50
uberjayfungi: I had run "zuul enqueue --trigger gerrit --pipeline check --project openstack/cinder --change 188300,2"17:50
fungiuberjay: i'll keep an eye out. you might find more context around that exception in your debug logs17:51
*** pelix has quit IRC17:52
uberjayah, interesting, yes there is more17:52
fungiuberjay: mainly curious how you ended up with a changeish associated with an unnamed project17:53
sdaguefungi: woot woot17:53
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook*
openstackgerritJames E. Blair proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
openstackgerritJames E. Blair proposed openstack-infra/project-config: Remove old Fuel plugins
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
openstackgerritJames E. Blair proposed openstack-infra/project-config: Project rename stackforge/ironic-discoverd -> openstack/ironic-inspector
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/octavia -> openstack/octavia
openstackgerritJames E. Blair proposed openstack-infra/project-config: dragonflow : move from stackforge/ to openstack/
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move zvm-driver to stackforge-attic
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
fungiand there go all our available non-devstack nodes again ;)17:53
jeblairthat's _only_ a change to the chef change, the rest are rebases (and some still contain uncorrected errors)17:53
anteayaokay thanks17:54
jeblairanteaya, AJaeger: but that should mean we can review from chef -> puppet17:54
anteayaI'll start at chef and keep going17:54
*** esmute has quit IRC17:54
asselin_uberjay, fungi that issue is a bug....there's a storyboard entry for it....17:54
fungiasselin_: oh, excellent17:54
jeblairanteaya, AJaeger: if you have already reviewed chef, an inter-patchset diff is probably sufficient.17:55
anteayaokay thanks17:55
AJaegerjeblair: line numbers look great ;)17:55
uberjayasselin_: fungi ahhh, ok! i just wanted to make sure someone knew about it :)17:55
*** Sukhdev has quit IRC17:56
jeblairfixing puppet change now17:56
*** gyee_ has joined #openstack-infra17:57
*** annegentle has joined #openstack-infra17:58
asselin_uberjay, fungi but I can't find it...must be past the 100 page pagination17:58
krotscheckSo, I have a projects-config patch with a +2A, and a depends-on on a patch that has just merged this morning. I've asked for a recheck, which passed, but the patch isn't landing. Any suggestions?
uberjayasselin_: yeah, i was just looking for it and couldn't find it...17:58
asselin_uberjay, but it's nice to know how to easily reproduce it!17:58
patrickeastmarcusvrn: wow, thats cool, i was expecting a lot more code changes than that17:58
anteayakrotscheck: please mark your project config change wip until after today's rename is complete17:59
patrickeastmarcusvrn: i put a comment on there, i realized as i was reviewing it that my most often used url is to just have ‘timeframe=24’ which would be hard with having to supply a start and end date only17:59
anteayakrotscheck: we can help you get it through after that17:59
jeblairanteaya: that seems unecessary?17:59
* krotscheck is confused?17:59
*** achanda has joined #openstack-infra17:59
jeblairkrotscheck: after the rename ask someone to re-approve it17:59
marcusvrnpatrickeast: me too....hehehe I started coding it and than it was done :)17:59
krotscheckjeblair: You got it.18:00
*** e0ne has joined #openstack-infra18:00
openstackgerritMerged openstack-infra/devstack-gate: collect grenade pluginrc if it exists
marcusvrnpatrickeast: do you think we can keep both filters, timeframe and date? It's actually a good idea18:01
EmilienMjeblair: you already did, but feel free to take over anything you need in the puppet migration patch.18:02
AJaegerjeblair: found first problem in - one ACL line removed by accident18:02
patrickeastmarcusvrn: yea i’m thinking maybe both, at least for a url parameter18:02
patrickeastmarcusvrn: the rest api piece maybe doesn’t need both… not sure the easiest way18:02
*** ivar-lazzaro has joined #openstack-infra18:02
*** yamahata has quit IRC18:03
patrickeastmarcusvrn: i’m ok doing something like; if there is a start/end specified then ignore the timeframe18:03
*** cloudnull is now known as cloudkiller18:03
marcusvrnpatrickeast: I can do it, if you want18:03
jeblairEmilienM: can you look at the comments in patchset 19 of 176326 and tell us what you think?18:04
jeblairEmilienM: (don't update it yourself, i'll do that)18:04
marcusvrnpatrickeast: support url parameter is easy18:04
jeblairAJaeger: ^ i found another one too18:04
EmilienMjeblair: I don't don anything on it from now18:04
*** annegentle has quit IRC18:05
*** cloudkiller is now known as cloudnull18:06
AJaegerjeblair: and I found one more in zuul/layout18:07
AJaegerEmilienM: Just add coments and tell us whether the changes are intented or not18:07
EmilienMAJaeger: looking18:07
*** mrmartin has quit IRC18:07
AJaegerEmilienM: Please both on comments in changeset 19 and 2018:07
*** ivar-lazzaro has quit IRC18:07
AJaegerMy head is spinning from reviewing 176326 line by line ;(18:08
jeblairfungi: sudo mv /var/lib/git/{stackforge/puppet-openstack,extras}.git18:08
jeblairfungi: that looks suspicious ^18:08
* AJaeger needs a break now...18:09
jeblairfungi: i think that is pervasive (eg, does not just affect that command)18:10
anteayaAJaeger: understood, thank you18:10
fungijeblair: interesting. i'll see if i can figure out where that came from18:11
EmilienMAJaeger: commented, sorry for typos/errors.18:11
anteayaEmilienM: thanks for being here to help us clean them up18:12
fungijeblair: i wonder if it's an error in the change i pulled it from18:12
EmilienManteaya: well, this is the least I can do18:12
anteayaEmilienM: thank you, :)18:12
*** e0ne has quit IRC18:13
fungijeblair: oh! i see the issue. i was using _ as a separator. lemme refactor my scripts and regenerate those blocks18:15
*** yamamoto has quit IRC18:15
fungithat's obviously going to be wrong all over the place for puppet modules particularly18:15
*** ashleighfarnham has quit IRC18:15
*** ivar-lazzaro has joined #openstack-infra18:16
*** achanda has quit IRC18:17
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Add meeting for the OpenStack Diversity Workgroup
*** esmute has joined #openstack-infra18:19
*** Sukhdev has joined #openstack-infra18:19
*** e0ne has joined #openstack-infra18:19
*** ashleighfarnham has joined #openstack-infra18:19
*** dprince has quit IRC18:20
fungijeblair: all swapped out now. let me know if you spot anything else odd-looking18:25
*** e0ne is now known as e0ne_18:25
*** puranamr has quit IRC18:26
fungijeblair: interestingly, that turns out to have been the only project with an _ in it, but i redid the scripts i used to generate all of that anyway for future sanity18:27
jeblairfungi: cool18:27
*** yamahata has joined #openstack-infra18:27
*** amrith has joined #openstack-infra18:27
jeblairi'm still combing through the puppet change18:28
*** yamahata has quit IRC18:29
fungii added a link to a paste of my script-generating-script for posterity18:29
amrithgreetings, anyone seeing trouble with the recent change to requirements.txt to use oslo.concurrency 2.0?18:29
*** yamahata has joined #openstack-infra18:29
*** annegentle has joined #openstack-infra18:30
*** e0ne_ has quit IRC18:30
fungiamrith: are you using a mirror of pypi?18:32
amrithfungi, no18:32
*** wenlock_ has quit IRC18:32
amrithI'm able to install v2.0.0 if I just pip install18:32
amrithbut when I run tox, I get this error18:33
*** jaypipes is now known as leakypipes18:33
amrithamrith@amrith-work:/opt/stack/trove$ pip list | grep oslo.concurrency18:33
amrithoslo.concurrency (2.0.0)18:33
*** tvanderwiel has joined #openstack-infra18:33
fungiamrith: that's odd. the error message makes it sound like it didn't see 2.0.0 on pypi18:33
*** wenlock has quit IRC18:34
fungiit's not complaining about a version conflict, but that it can't find it at all18:34
dhellmannamrith: what's in your ~/.pip/pip.conf file18:34
*** sdake_ is now known as sdake18:34
amrithdon't have one18:34
dimsum__amrith: looks like a local issue, CI jobs ok?18:34
amrithhi dimsum__18:34
amriththis is desktop18:35
amrithhi dhellmann18:35
amrithI don't have a ~/.pip18:35
amrithcould it be someplace else18:35
*** Swami has joined #openstack-infra18:35
dstufftis it a linux machine18:36
dstufftor OSX18:36
dstufftor something else18:36
* fungi hopes it's openvms18:36
amritham searching /etc18:36
amrithnot anyplace on the machine18:37
amrithamrith@amrith-work:/$ sudo find . -name pip.conf18:37
*** wenlock has joined #openstack-infra18:37
jeblairEmilienM, fungi, anteaya, AJaeger: i found several more issues in the puppet patch18:37
jeblairEmilienM: i'll need responses on those18:37
anteayaokay, I'm still on the zvm-driver to attic patch18:37
anteayasorry I'm slow18:37
EmilienMjeblair: looking now18:38
jeblairanteaya: i have spent 50 minutes reviewing the puppet change.18:38
anteayaI believe it18:39
dhellmannamrith: which version of pip?18:39
*** wenlock has quit IRC18:39
dstufftamrith: can you do pip install -vvvv oslo.concurrency and give me output18:39
anteayatook me over an hour to figure out what was happening with the chef change18:39
amrithdhellmann, 7.0.318:39
anteayaand I still didn't get it right18:39
dstufftthe whole output18:39
*** bknudson has quit IRC18:39
*** wenlock has joined #openstack-infra18:40
AJaegerjeblair: some of those are duplicates from what I found and EmilienM had commented in changeset 20 on it18:40
amrithdstufft, please see
AJaegerjeblair: the new one I noticed are the stackforge/openstack ACLs18:40
dstufftamrith: can you do it inside of a virtualenv so it's not picking up the system libs18:40
amrithdstufft, one second18:40
jeblairAJaeger: okay.  i'm copying the comments from 20 to 19 now so they are all in one place.18:41
AJaegerI should have said: The stackforge/openstack ACL changes are something I didn't note.18:41
AJaegerjeblair: ok.18:41
EmilienMjeblair: commented now18:41
*** akrivoka has left #openstack-infra18:41
*** leakypipes has quit IRC18:41
AJaegerjeblair: thanks for catching all these!18:41
bexelbieonce a patch has passed code-review - what is needed to get jenkins to finish hte verified?18:41
AJaegerbexelbie: did you read the Infra Manual?
amrithdstufft, just recreating venv18:42
amrithproblem is that it fails18:42
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add create method for secgroup rule
dstufftfails installing setuptools or pip I bet?18:43
fungibexelbie: one of the core reviewers who is in favor of it will set workflow +1 (approval) and then the machinery jumps to action retesting and finally merging it to the published repo18:43
*** jaypipes has joined #openstack-infra18:43
jeblairAJaeger, EmilienM: done; so everything should be captured in PS 19 now.18:43
amrithdstufft, see here18:43
amrithvenv create fails18:43
bexelbieAJaeger, yes18:43
bexelbiefungi, that is what I expected as well18:43
*** eantyshev has quit IRC18:43
*** ildikov has quit IRC18:43
*** ildikov has joined #openstack-infra18:43
dhellmannamrith: try: ./.tox/venv/bin/pip install oslo.concurrency==2.0.018:43
bexelbieI just didn't see it queued on zuul - and was curious18:44
dhellmannoops, left out the -vvv18:44
dstufftamrith: /opt/stack/trove/.tox/venv/bin/pip -U -vvvv install oslo.concurrency==2.0.018:44
dhellmannamrith: ^^18:44
dstufftdo that18:44
dstufftwhat dhellmann said18:44
*** kushal has quit IRC18:44
jeblairEmilienM: okay, i'm reading your responses now.  to make sure i understand, you want to keep monasca and tripleo using their own gerrit acl files, right?18:44
bexelbiefungi, n/m workflow +1 - that is the blocker .. I missed that somehow in my read18:44
AJaegerjeblair: looks fine18:45
amrithdstufft, dhellmann please see I changed the command around to pip install -U -vvvv18:45
fungibexelbie: yeah, by convention usually at least two core reviewers need to code-review +2 it and then one of them will also workflow +1 it to head into the testing gate for final merge verification18:45
anteayaI'm now at the puppet change and standing by18:46
anteayaas wading in now feels pointless to me18:46
bexelbiefungi, makes sense once I see the word "workflow" in there .. somehow missed it in my reads (plural :( )18:46
dhellmanndstufft: could amrith's problem be a fastly cache issue?18:46
dhellmannamrith: can you see this page?
jeblairokay, i think i understand the changes that need to be made to the puppet change.  starting on them now.18:47
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Add configuration switches for features that make Neutron unstable
dhellmannamrith: and can you wget
* anteaya makes another cup of tea18:47
amrithdhellmann, yes. wget on that URL succeeds.18:47
dhellmannamrith: you're not using some sort of proxy are you? corporate, personal, ssh tunnel, etc.?18:48
amrithand I can see it in a browser.18:48
amrithdhellmann, no.18:48
amrithon the machine where this pip install fails, I can wget that URL18:48
amrithsame machine18:48
amrithsame command line18:48
dhellmannamrith: do you see the 2.0.0 file listed on ?18:49
amrithI get a file called 2.0.018:49
*** claudiub|2 has quit IRC18:49
*** jaypipes is now known as leakypipes18:50
amrithOn that URL, I see a link to oslo.concurrency-2.0.0.tar.gz18:50
amrithwhich points to ../../packages/source/o/oslo.concurrency/oslo.concurrency-2.0.0.tar.gz#md5=7c8fbc47d9cf940a76aef92d2831ed\18:50
dhellmannamrith: I'm out of ideas. The file is there, and you can see it. Maybe dstufft has something else to try18:50
*** annegentle has quit IRC18:50
*** wenlock has quit IRC18:50
*** ams__ has quit IRC18:50
*** esmute has quit IRC18:50
*** ZZelle_ has joined #openstack-infra18:51
dimsum__amrith: on the same command line? "curl -ks | grep 2.0.0"18:52
dstufftsorry, was poking the Fastly control panel to see if something was cached differently18:52
*** kushal has joined #openstack-infra18:52
amrithamrith@amrith-work:/opt/stack/trove$ curl -ks | grep 2.0.018:52
amrith<a href="../../packages/py2.py3/o/oslo.concurrency/oslo.concurrency-2.0.0-py2.py3-none-any.whl#md5=96f018d27e4512426878c9ebac05433f" rel="internal">oslo.concurrency-2.0.0-py2.py3-none-any.whl</a><br/>18:52
amrith<a href="../../packages/source/o/oslo.concurrency/oslo.concurrency-2.0.0.tar.gz#md5=7c8fbc47d9cf940a76aef92d2831ed0f" rel="internal">oslo.concurrency-2.0.0.tar.gz</a><br/>18:52
amrithgist coming up18:52
*** wenlock has joined #openstack-infra18:53
dstufftamrith: what if you add --no-cache-dir18:54
dstufftto the pip install command.18:54
*** wenlock has quit IRC18:54
amrithok, coming up18:54
*** ociuhandu has quit IRC18:54
*** annegentle has joined #openstack-infra18:54
jeblairEmilienM: i don't understand why you want to have access to deprecated modules that you are not moving over.18:55
jeblairare they not actually deprecated yet?18:55
EmilienMjeblair: what do you suggest?18:56
EmilienMthey are but I guess some people are still using them18:56
EmilienMthough we don't patch on it18:56
*** wenlock has joined #openstack-infra18:56
jeblairis anyone going to be making changes to them at all?18:56
amriththat appears to be working a lot harder18:56
EmilienMhonestly, I prefer to keep these modules in stackforge18:56
amrithdstufft, and it succeeded.18:57
jeblairEmilienM: will any patches be landing to these modules?18:57
amrithdstufft, one second18:57
dstufftfor some reason cache wasn't getting expired for /simple/oslo.concurrency/18:57
EmilienMjeblair: I don't think so or very rarely18:57
dstufftdid your wallclock go backwards in time by any chance18:57
jeblairEmilienM: the difference between "no" and "very rarely" is huge.18:58
jeblairEmilienM: let's assume "very rarely"18:58
amrithit is a vm without time sync18:58
jeblairEmilienM: who will be approving them?18:58
amrithbut the time appears to be correct18:58
EmilienMjeblair: why can't we dupplicate the gerrit file?18:58
amrithyes, june 12th18:58
EmilienMjeblair: still us I guess18:58
jeblairEmilienM: this is not a technical problem.18:58
dstufftamrith: you can delete the cache, it's gonna be at like ~/.cache/pip/18:58
jeblairEmilienM: then it seems to me like they are part of the puppet openstack project.18:58
EmilienM and are clearly dead.18:59
EmilienMand we don't support them.18:59
dstufftI think maybe we should just not cache the /simple/ pages18:59
jeblairEmilienM: then you should change their READMEs to say they are dead and then we can mark the projects as read-only.18:59
amrithdstufft, just did that and will retry18:59
EmilienM has no activity and we won't patch it anymore18:59
EmilienMjeblair: sounds like a great idea18:59
*** wenlock has quit IRC19:00
EmilienMjeblair: please don't move them though, until will kill them, I suggest we keep them on stackforge19:00
*** ayoung is now known as ayoung-mtg19:00
*** wenlock has joined #openstack-infra19:00
jeblairEmilienM: that's fine. i don't want to move anything we don't have to.19:00
amrithdstufft, will irc you as soon as it completes, thanks much.19:00
jeblairEmilienM: what about puppet-vswitch?19:00
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add unstable Neutron job
EmilienMjeblair: like puppet-ceph, we like it but it's not openstack. IMHO it should not be in openstack but rather stays on stackforge19:02
*** wenlock_ has joined #openstack-infra19:02
EmilienMjeblair: if it's a big deal though, I'm ok to move it19:02
*** hdd has quit IRC19:03
jeblairEmilienM: it's getting its own core group then and is otherwise going to be unrelated to your other work.  it won't be able to group bugs with your other project bugs, etc.  you can't have an openstack project on stackforge.19:03
*** hdd has joined #openstack-infra19:04
amrithdhellmann, dimsum__, dstufft, worked like a champ, thanks so much!19:04
*** wuhg has quit IRC19:04
dhellmanndstufft: nice work19:04
dhellmannamrith: great!19:04
EmilienMI suggest: 1/ it stays on stackforge 2/ we keep the current gerrit permissions (puppet-group, us) to manage it19:04
dstufftamrith: I opened up to track ditching the cache for those responses since their usefulness is somewhat limited anyways19:04
jeblairEmilienM: i don't understand why.  it seems like you want to pretend it's not part of your openstack project, yet, run it like it is.19:05
EmilienMjeblair: well, who would have permissions then? we are doing reviews on this module now19:06
jeblairEmilienM: why don't you think it's part of your project then?19:06
EmilienMjeblair: I'm fine if we move it, seriously19:06
EmilienMjeblair: let's go ahead, we move it too19:06
EmilienMjeblair: because we did beaker tests, and we review/patch code quite often19:07
EmilienMwe can pretend to maintain it19:07
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging
jeblairi don't understand19:07
jeblairdoes anyone else want to try to figure this out?19:07
nibalizerfigure out which modules go to openstack/ ?19:08
jeblairEmilienM: what do you mean "pretend to maintain it"?19:08
EmilienMjeblair: we do reviews/code on this modules. We also care about its CI19:08
jeblairit's one question: is puppet-vswitch a constituent repo of the puppet-openstack project?19:08
jeblaireverything i can see says "yes"19:08
EmilienMso I guess we are the ones who take care of it19:08
EmilienMjeblair: it's actually a dep of puppet-neutron when running OVS plugin19:09
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add create method for secgroup rule
EmilienMjeblair: let's move it19:09
jeblairEmilienM: it's your call -- you're the ptl19:09
EmilienMjeblair: it's my call and I say yes19:09
EmilienMwe move it19:09
jeblairokay done19:09
*** ivar-lazzaro has quit IRC19:09
*** dontalton has joined #openstack-infra19:09
*** e0ne has joined #openstack-infra19:09
*** pradk has quit IRC19:10
jeblairEmilienM: i'm going to leave the puppet-modules acl config in place for the other three projects with the understanding that we're just going to use that to merge the end-of-life changes for those, and then we will remove them19:10
EmilienMjeblair: ack19:10
jeblairfungi: please add stackforge/puppet-vswitch -> openstack/puppet-vswitch to the move19:11
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging
fungijeblair: oh, was it not in the original patch?19:14
openstackgerritMerged openstack-infra/git-review: Add “git-review -l” to man page synopsis and usage doc
jeblairfungi: it was not.  we just decided to change the color on that bikeshed.19:14
fungijeblair: i like the new color. adding19:14
*** yamamoto has joined #openstack-infra19:15
*** amrith is now known as _amrith_19:15
*** tqtran has joined #openstack-infra19:16
openstackgerritJames E. Blair proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
jeblairagain, that's _only_ the puppet change; the rest are just rebases19:17
anteayavery good19:17
jeblairi need to get lunch now.  if anyone wants to work on the l2gw change, feel free to pick it up19:17
anteayaenjoy lunch19:17
*** sdake_ has joined #openstack-infra19:17
armaxfungi: is there anything I could do to help with
jeblairor, any changes that need updating.  i'm releasing the lock, as it were.19:17
*** e0ne is now known as e0ne_19:18
anteayaarmax: do you understand the comments on it?19:18
anteayaarmax: can you reply to the comments?19:18
*** pblaho has quit IRC19:18
armaxanteaya: it looks like the patch went through a bad rebase19:18
anteayathat seems to be the case19:19
anteayait is close to the tail end of the patch series19:19
*** esmute has joined #openstack-infra19:19
anteayaif you want to try to fix the rebase go ahead19:19
anteayabut do pull it down with git review -d <patchnumber>19:19
anteayato preserve its place in the stack19:19
armaxif fungi gives me the go ahead, I’ll take care of it19:19
fungiwas midonet supposed to move in there, or no?19:20
anteayano, midonet is way earlier19:20
fungiokay, just checking19:20
fungibecause midonet is on my list, just making sure it's supposed to be19:20
anteayamidonet patch:
anteayait is19:20
fungiahh, yep. okay19:20
*** sdake has quit IRC19:21
*** yamamoto has quit IRC19:21
fungiarmax: yeah, jeblair's the one who's been handling the rebase of that stack, but i doubt he'd mind you correcting 18570519:21
armaxfungi: ok :)19:21
fungior at least leaving explicit comments as to what should be fixed in it19:21
anteayaarmax: I think it is yours and one after that as the tail19:21
fungiwhichever works best for you19:21
armaxfungi: yes, midonet lines should not belong to 18570519:22
armaxI’ll clean them up19:22
anteayaarmax: thank you19:22
armaxbear with me19:22
*** e0ne_ is now known as e0ne19:22
armaxthank you guys for your effort!19:22
*** vponomaryov has quit IRC19:23
fungiarmax: you should see the list. it's now up to 61 repos getting renamed today19:23
armaxfungi: that’s a lot of beers for you, right there!19:23
* anteaya with a fresh cup of tea heads into the puppet patch19:23
*** mdenny has joined #openstack-infra19:24
*** annegentle has quit IRC19:24
armaxfungi: or your beverage of choice, when we meet at the next summit!19:24
*** puranamr has joined #openstack-infra19:24
dhellmannjeblair: I have a new spec for infra-specs, but it's not clear to me where to put it in the toctree. Do new things go under "Priority Efforts"?19:25
fungiarmax: also beer ;)19:26
*** sdake_ is now known as sdake19:26
fungiokay, puppet-vswitch has now been spliced into the appropriate places in
fungidhellmann: approved specs19:27
fungidhellmann: because once it gets approved... that's what it is!19:27
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
dhellmannfungi: ok, that felt premature :-)19:27
fungifeels that way until you realize that it's never added to the repo until it gets approved19:27
*** bhunter71 has quit IRC19:27
fungiso you're proposing a spec for approval, it goes in the approved specs section19:28
fungiif you're proposing a spec that shouldn't be approved, then i'm not sure there's much point in proposing a spec ;)19:29
*** bhunter71 has joined #openstack-infra19:29
fungitautological categorization19:29
openstackgerritDoug Hellmann proposed openstack-infra/infra-specs: Centralize Release Tagging
anteayaEmilienM: I made a comment on two puppet repos that are in the rename patch that I don't see in the governance repo19:31
anteayaEmilienM: can you create a patch to the governance repo adding them and add a comment on your patch with a link to the governance repo patch?19:32
*** puranamr has quit IRC19:32
anteayasorry I made the comment on
anteayanot sure if I was clear19:34
anteayathe comment was about two puppet repos19:34
EmilienManteaya: I'll do the patch in governance *after* migration so we are sure I don't miss something :-)19:35
EmilienManteaya: does it work for you? I think I'll do it on 'early next week'19:35
*** puranamr has joined #openstack-infra19:35
anteayaEmilienM: well we like to have the governance patch as reference before we merge the project-config change19:36
anteayathen the trail doesn't get lost19:36
anteayathe governance change won't merge this afternoon19:36
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
anteayaand you can offer another patchset to it if we need to amend it19:36
EmilienManteaya: in the thread, jeblair said we can do the governance update after, since we have the basic structure already approved by TC19:36
anteayaokay I won't interrupt19:36
EmilienManteaya: ok, I'll provide the patch ASAP19:37
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
armaxanteaya, fungi: rebased the bottom of the pile19:38
anteayaarmax: thank you19:38
armaxanteaya, fungi: I release my lock19:38
armaxanteaya, fungi: I think I got it right19:38
armaxanteaya, fungi: but one might never know when it comes to me, so watch out19:39
*** dboik has quit IRC19:39
*** otter768 has joined #openstack-infra19:39
anteayaarmax: I'll look in a bit, don't want to switch in mid-review19:39
anteayaarmax: I'll be aware, thanks19:39
armaxanteaya: tests passed locally, so I am confident19:39
armaxanteaya: but it’s friday of a long, long week….so...19:39
*** sabeen2 has quit IRC19:40
*** tonytan4ever has quit IRC19:40
*** sabeen1 has joined #openstack-infra19:41
fungiif anyone wants a break from reviewing project rename changes, here are my proposed release notes for git-review 1.25.0 which i have tagged but not yet pushed (hence no checksums in the draft)
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Add configuration switches for features that make Neutron unstable
*** otter768 has quit IRC19:43
asselin_uberjay, fungi, jeblair  I'm seeing this too again today. any easy way to disable cross-project dependencies in zuul?
asselin_this takes down the whole ci system19:47
anteayajeblair: I spotted one error in the puppet patch19:48
anteayajeblair: will post when I'm finished my pass19:49
uberjayasselin_: ah, is that what's causing it? i don't know enough about zuul's codebase, just noticed it happened when i manually queued a job (with zuul enqueue). doesn't happen otherwise... at least, not so far. (I could be wrong, though...)19:50
asselin_uberjay, is yours working still?19:50
uberjayasselin_: it does seem to be fine right now. when that happened earlier I had to restart the zuul-master process. (and had to kill -9 to get it to exit...)19:51
uberjayno issues currently...19:52
*** dontalton has quit IRC19:52
*** tonytan4ever has joined #openstack-infra19:52
asselin_uberjay, which projects are you monitoring?19:52
uberjayoh. heh. I guess I probably don't deal with any cross-project deps, since I'm only monitoring cinder :D19:52
asselin_I added manila and os-brick recently. /me digs into zuul code19:54
*** puranamr has quit IRC19:56
*** dboik_ has joined #openstack-infra19:56
*** puranamr has joined #openstack-infra19:57
*** rossella_s has quit IRC19:58
*** rossella_s has joined #openstack-infra19:59
*** kgiusti has left #openstack-infra19:59
jeblairfixing puppet change20:00
jeblairEmilienM: what's the status of puppet-ceph?20:02
jeblairi just noticed it's part of the check-tripleo-{jobname} job20:02
EmilienMjeblair: puppet openstack has no core power on it20:02
jeblairalong with all the other puppet modules20:03
EmilienMjeblair: this module is not part of puppet openstack project20:03
jeblairok.  why is it part of a tripleo integration test?20:04
EmilienMjeblair: because tripleo is consuming this module20:04
EmilienMso it pulls out the code when deploying in CI20:04
jeblairokay.  we should remove it from the integration test, but that can wait.20:04
*** amitgandhinz has quit IRC20:05
openstackgerritJames E. Blair proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
jeblairanteaya, AJaeger: sorry for any eye-damage i may have caused ^ :)20:06
anteayajeblair: no complaints here, thank you for your continued willingness to fix all the things20:07
*** dboik_ has quit IRC20:07
*** sslypushenko has quit IRC20:07
*** linuxmaniac has quit IRC20:07
*** pc_m has quit IRC20:07
*** teran has quit IRC20:07
*** frickler has quit IRC20:07
*** jd__ has quit IRC20:07
*** swat30 has quit IRC20:07
*** SlickNik has quit IRC20:07
*** chmouel has quit IRC20:07
*** dmellado has quit IRC20:07
*** ruhe has quit IRC20:07
*** NikitaKonovalov has quit IRC20:07
*** DinaBelova has quit IRC20:07
*** reazem has quit IRC20:07
*** jogo has quit IRC20:07
*** zaneb has quit IRC20:07
*** zxiiro has quit IRC20:07
*** bookwar has quit IRC20:07
*** redrobot has quit IRC20:07
*** frickler_ has joined #openstack-infra20:07
*** Guest19563 is now known as dan20:07
*** sslypushenko has joined #openstack-infra20:07
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
*** dmellado has joined #openstack-infra20:07
*** zaneb has joined #openstack-infra20:07
* anteaya heads in again20:07
*** teran has joined #openstack-infra20:08
*** pc_m has joined #openstack-infra20:08
*** dboik has joined #openstack-infra20:08
*** jogo has joined #openstack-infra20:08
fungiarmax: thanks, 185705 is looking better now20:08
*** jd__ has joined #openstack-infra20:08
*** redrobot has joined #openstack-infra20:08
*** swat30 has joined #openstack-infra20:08
armaxfungi: np20:08
*** SlickNik has joined #openstack-infra20:08
*** redrobot is now known as Guest6707420:08
*** bookwar has joined #openstack-infra20:08
fungiokay, unless anybody has any objections/additions to i'll push the tag after i get through a few of the rename reviews20:08
fungiwow, these patches dogpiled +2s while i wasn't looking. awesome20:09
*** linuxmaniac has joined #openstack-infra20:09
dhellmannI have a patch that's approved but not merging. It has 2 depends-on listed, but both of them have already merged. Can anyone spot anything else about this that would be blocking it from merging?
anteayafungi: your etherpad looks fine to me20:10
*** EmilienM is now known as EmilienM|afk20:10
*** ruhe has joined #openstack-infra20:10
fungidhellmann: did it get approved before one of its depends-on?20:11
fungiif so it'll need to be reapproved now. rechecking won't help20:11
dhellmannfungi: it did20:11
dhellmannah, ok, I thought rechecking would do it20:11
fungidhellmann: you can add a workflow +1 or get dims to remove and add his again20:11
*** DinaBelova has joined #openstack-infra20:11
*** zxiiro has joined #openstack-infra20:11
EmilienM|afkjeblair, anteaya: I have to be afk now, I agreed with crinkle she can help if you have more questions.20:12
dhellmannfungi: thanks, I went ahead and did W+120:12
*** NikitaKonovalov has joined #openstack-infra20:12
*** reazem has joined #openstack-infra20:12
*** chmouel has joined #openstack-infra20:12
anteayaEmilienM|afk: thank yoiu20:12
fungidhellmann: the problem with recheck is that if an account applies a vote which is identical to the existing vote then gerrit doesn't emit the vote with the accompanying comment in the event stream, so when the new verify +1 gets left by jenkins on top of an existing verify +1, zuul never sees that in the stream and doesn't know to trigger gating20:12
anteayacrinkle: hello there20:12
crinkleanteaya: hello20:13
anteayawelcome to the fun20:13
anteayalots for everybody20:13
crinkleyay \o/20:13
dhellmannfungi: that makes sense, I'll keep that in mind for next time20:13
anteayacrinkle: we are over here if you want to play along:
crinkleanteaya: ty20:14
anteayacrinkle: do speak up if you see anything amiss on the etherpad20:14
crinkleanteaya: will do20:14
anteayafungi generated quite a bit of it and I haven't had a chance to eyeball it yet20:14
jeblairfungi, dhellmann:
openstackgerritJulia Kreger proposed openstack-infra/shade: Correct get_machine_by_mac and add test
jeblairsome small progress on that20:15
*** puranamr has quit IRC20:15
*** dangers is now known as dangers_away20:16
dhellmannjeblair: nice20:16
anteayaokay the stack has enough reviews, just waiting on jenkins to return on the puppet patch and the two following patches20:19
*** Sukhdev has quit IRC20:19
*** krtaylor has quit IRC20:19
*** e0ne has quit IRC20:19
*** dboik has quit IRC20:19
* anteaya moves to the rename etherpad20:19
asselin_uberjay, I have the issue reproduced in my dev environment20:19
uberjayasselin_: excellent!20:20
anteayajeblair fungi any thoughts about using incident for the rename?20:22
fungisince nodepool is mostly idle now (current demand is mostly met) i've restarted it with 190827 locally applied20:23
fungijeblair: ^20:23
jeblairanteaya: not strong ones20:23
*** whitenoi1e has joined #openstack-infra20:25
*** nfedotov has joined #openstack-infra20:25
fungilogs suggest it deleted 23 leaked instances20:25
fungino, wait, 5020:25
fungithough i suppose those could be retries20:25
funginope, unique node ids20:26
fungiso 5020:26
jeblairthat was a lot in a short amount of time.20:26
fungiit's about what i've been seeing20:27
*** greghaynes has quit IRC20:27
fungii bet it was almost all rax again. analyzing deeper20:27
*** pradk has joined #openstack-infra20:27
fungiyep, all rax20:27
*** olaph has quit IRC20:28
fungimostly dfw and ord which is where i've been seeing them pile up all week20:28
fungiso i think this is working20:28
fungiscarily well so far20:28
*** annegentle has joined #openstack-infra20:29
*** puranamr has joined #openstack-infra20:29
anteayaa sharp knife apparently20:29
*** olaph has joined #openstack-infra20:30
*** mrunge has quit IRC20:30
jeblairfungi: wow, these are instances that are leaking _after_ nodepool tries to delete them20:31
*** esmute has quit IRC20:31
fungiyeah, i think rax nova is reporting successful deletion and then not following through?20:31
*** esmute has joined #openstack-infra20:31
jeblairso openstack says "yep, i'll delete that for you."  and then doesn't.20:31
jeblairyeah, and we actually check too....20:31
jeblairso they must be changing state to 'deleted' but not going away20:32
jeblair(since of course openstack has been lying about that for years)20:32
fungithose 50 seem to have all accumulated in the ~5 hours since i last cleaned them up, but i haven't seen the count tick upward again yet since the nodepoold restart knocked out those20:33
jeblairoh, hrm.  we don't wait for deletion; i thought we did.20:33
openstackgerritWayne Warren proposed openstack-infra/zuul: WIP: Support GitHub PR webhooks
openstackgerritWayne Warren proposed openstack-infra/zuul: Add 'merge' github webhook event.
openstackgerritWayne Warren proposed openstack-infra/zuul: Allow list values in template parameters.
*** radez is now known as radez_g0n320:34
fungiokay, i'm going ahead and releasing git-review 1.25.0 and will send the release announcement once i confirm everything looks okay and i collect final artifact checksums to include20:35
*** samuelBartel has joined #openstack-infra20:35
*** alexpilotti has quit IRC20:35
*** ayoung-mtg has quit IRC20:36
*** alexpilotti has joined #openstack-infra20:36
fungiClint: thanks for your help going through those remaining patches20:36
Clintsure, no problem20:37
jeblairi'm fixing the mistral patch20:37
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
jeblairpuppet patch has a problem too.  fixing that.20:38
*** abitha has joined #openstack-infra20:40
openstackgerritJames E. Blair proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
openstackgerritJames E. Blair proposed openstack-infra/project-config: Move networking-l2gw project under openstack namespace
electricalfungi: jeblair when ever you guys have  spare moment, could use a vote :-)20:40
openstackgerritJames E. Blair proposed openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
*** nfedotov has quit IRC20:40
*** nfedotov has joined #openstack-infra20:40
anteayaah the missing 's'20:41
*** tonytan4ever has quit IRC20:41
openstackgerritSpencer Krum proposed openstack-infra/system-config: Print the node definition before apply test
*** pc_m has quit IRC20:42
openstackgerritMerged openstack-infra/devstack-gate: fix grenade phase check
anteayafungi: my pass of the rename etherpad turned up nothing worth comment20:46
openstackgerritMerged openstack/diskimage-builder: Revert "Remove unused map_nbd function"
fungianteaya: thanks!20:48
*** annegentle has quit IRC20:48
anteayaI'm standing by on the jenkins tests for puppet et al20:48
anteayaif you think of anything else that needs doing prior to 2200 do say so20:48
*** dboik has joined #openstack-infra20:49
jeblairi'm going to try to squeeze in a break before then.20:49
anteayajeblair: sounds like a good idea20:50
anteayajeblair: I'll keep an eye on the jenkins jobs20:50
*** ayoung-mtg has joined #openstack-infra20:50
*** sputnik13 has quit IRC20:54
*** sputnik13 has joined #openstack-infra20:55
*** peristeri has quit IRC21:00
anteayafungi: do those centos jobs look like they are failing to you?21:01
fungianteaya: which ones?21:01
*** tiswanso has quit IRC21:02
*** puranamr has quit IRC21:02
fungithey're just crazy slow. until they get up around 20-25 minutes i don't assume they're going to time out21:02
anteayathey are at the 18 minute mark21:03
fungii've seen them pause for 5-10 minutes and then resume pretty often21:03
anteayaah let's hope21:03
*** puranamr has joined #openstack-infra21:03
*** mriedem has quit IRC21:05
anteayawell the last one in the stack finished successfully21:07
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Add meeting for the OpenStack Diversity Workgroup
*** davideagnello has quit IRC21:08
*** derekh_afk has quit IRC21:08
*** krtaylor has joined #openstack-infra21:08
*** davideagnello has joined #openstack-infra21:08
*** eharney has quit IRC21:09
openstackgerritRamy Asselin proposed openstack-infra/zuul: Fail fast on invalid cross-project dependencies
*** esmute has quit IRC21:09
asselin_uberjay, stop the bleeding fix ^^21:09
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Add meeting for the OpenStack Diversity Workgroup
asselin_fungi, jeblair thoughts? ^^21:10
*** dpaterson has quit IRC21:10
anteayayay, jenkins is all happy through the rename stack21:11
*** esmute has joined #openstack-infra21:12
fungiasselin_: that seems better than nothing, though i wouldn't be surprised to find out there's a better place to trap that21:12
asselin_fungi, yeah...looking some more...21:13
*** HeOS has joined #openstack-infra21:13
*** EricGonc_ has quit IRC21:14
asselin_fungi, stack trace with that change:
*** esmute has quit IRC21:14
*** esmute has joined #openstack-infra21:15
*** asahlin has quit IRC21:15
asselin_fungi, apparently none is valid: change = Change(None)21:15
*** ldnunes has quit IRC21:15
*** amitgandhinz has joined #openstack-infra21:16
*** asahlin has joined #openstack-infra21:16
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: Report all unreleased library changes
openstackgerritDavide Guerri proposed openstack-infra/shade: Improve documentation for create_port()
openstackgerritDavide Guerri proposed openstack-infra/shade: Add more parameters to update_port()
*** esmute has quit IRC21:16
*** dguerri` is now known as dguerri21:17
asselin_so not so simple21:18
*** esmute has joined #openstack-infra21:18
*** annegentle has joined #openstack-infra21:19
*** ayoung-mtg has quit IRC21:20
openstackgerritDavide Guerri proposed openstack-infra/shade: Add more parameters to update_port()
*** amitgandhinz has quit IRC21:20
fungiasselin_: oh, ugh21:20
*** ivar-lazzaro has joined #openstack-infra21:23
*** Sukhdev has joined #openstack-infra21:25
*** doug-fish has left #openstack-infra21:26
*** hrubi has joined #openstack-infra21:27
*** esmute has quit IRC21:27
openstackgerritWayne Warren proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.
openstackgerritWayne Warren proposed openstack-infra/zuul: WIP: Support GitHub PR webhooks
openstackgerritWayne Warren proposed openstack-infra/zuul: Allow list values in template parameters.
*** pradk has quit IRC21:28
*** esmute has joined #openstack-infra21:30
*** ayoung-mtg has joined #openstack-infra21:32
asselin_fungi, I bet this is the line causing the issue:
*** gyee_ has quit IRC21:33
*** zz_jgrimm is now known as jgrimm21:33
*** esmute has quit IRC21:33
*** sdake_ has joined #openstack-infra21:36
*** HeOS has quit IRC21:36
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: Add
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: Add
*** esmute has joined #openstack-infra21:37
fungilooks like zuul might actually be pretty idle by the time we start our maintenance21:37
*** dboik has quit IRC21:38
*** rlandy has quit IRC21:39
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: Add
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: Add
fungijeblair: now we've caught 23 aliens in hpcloud and 65 in rackspace according to nodepool logs21:40
*** sdake has quit IRC21:40
*** otter768 has joined #openstack-infra21:40
anteayathe power at my house is flickering21:40
*** rlandy has joined #openstack-infra21:40
anteayait might go out21:40
fungii know how it feels21:40
jeblairstatus alert Gerrit will be offline for project renames between 22:00 and 22:30 UTC21:40
jeblairhow's that look ?21:40
*** kfox1111 has joined #openstack-infra21:40
anteayafungi: :)21:40
kfox1111Any known breakage on the websites?21:40
anteayajeblair: looks good21:40
*** soren has quit IRC21:40
jeblair#status alert Gerrit will be offline for project renames between 22:00 and 22:30 UTC21:40
openstackstatusjeblair: sending alert21:40
anteayakfox1111: which website?21:41
kfox1111the summit video's are not all showing up anymore.21:41
anteayakfox1111: link?21:41
fungithough getting all the github changes completed may take a little longer than usual because it's so clicky21:41
fungikfox1111: contact info for reaching the people who control the www site is listed at
openstackgerritDavide Guerri proposed openstack-infra/shade: Add get_server_external_ipv6() to meta
armaxanteaya: ping21:42
anteayaarmax: hi21:42
armaxanteaya: how’s everything going?21:42
armaxanteaya: you said you may need me around this time today21:42
-openstackstatus- NOTICE: Gerrit will be offline for project renames between 22:00 and 22:30 UTC21:43
*** ChanServ changes topic to "Gerrit will be offline for project renames between 22:00 and 22:30 UTC"21:43
fungiianw: i think your centos7 check job on 179689,34 is looping indefinitely21:43
armaxanteaya: am I still on the hook?21:43
anteayaarmax: for the rename things, hopefully the patches are all set21:43
armaxanteaya: ok21:43
anteayaarmax: always :)21:43
fungiianw: looks like it probably tanks the worker in such a way that zuul thinks there was a bug and helpfully restarts the job for you21:43
anteayawe should be good, don't be suprised by a last minute question though21:43
armaxanteaya: the l2gw looks good to me now21:43
anteayame too21:43
armaxanteaya: tucked nicely within the many layers of blankets21:44
*** sdake_ has quit IRC21:44
*** HeOS has joined #openstack-infra21:44
*** otter768 has quit IRC21:45
openstackstatusjeblair: finished sending alert21:45
armaxanteaya: can there be any last minute additions to the lsit?21:46
armaxanteaya: just idle curiosity, when is there going to be another window like this?21:47
anteayaarmax: no21:47
anteayaarmax: we collect them on our meeting agenda wikipage:
armaxanteaya: I am wondering there will be other likes these coming up?21:47
armaxanteaya: gotcha21:47
anteayaand when we have another bunch we schedule another windo21:47
*** esmute has quit IRC21:48
armaxok, so the process is: file a patch, add yourself to the list21:48
armaxsit tight and wait21:48
armaxsounds good21:48
armaxthank you21:48
anteayathank you21:48
j^2thank me?21:49
*** sarob has quit IRC21:49
anteayaj^2: thank you21:49
*** esmute has joined #openstack-infra21:49
* j^2 isn’t very good at IRC jokes21:49
j^2anteaya: :D21:49
anteayaI have a good one once every 5 yeaers21:49
anteayaI hit one last year so this is the 4 year desert21:50
*** alivigni has quit IRC21:51
jeblairanteaya: mind if i take over the -2 on the first change?21:51
anteayait is yours21:52
jeblairanteaya: it's there; feel free to change your vote21:52
openstackgerritJohn L. Villalovos proposed openstack-infra/yaml2ical: Add 'outfile' var that can be used in templates
jeblairi'm going to mass review them when it's time.  :)21:53
* anteaya stands by21:53
jeblairpuppetmaster cron is stopped21:56
*** esmute has quit IRC21:56
*** samuelBartel has quit IRC21:58
*** esmute has joined #openstack-infra21:59
fungilooks like it's just that one group to be renamed at step 1222:00
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Create individual ICS files and add to webpage
fungii'll take care of running the scripts i put in the etherpad22:01
jeblairready to start?22:01
anteayafungi: that is the only group I saw that needed renaming22:01
* anteaya is ready22:01
* jlvillal thinks he just proposed some awesome stuff ;)22:01
anteayafungi: I put a note about 2 groups that I think will be redundant22:01
jeblairzuul is stopped22:01
jeblair#status alert Gerrit is offline for project renames.  ETA 20:3022:01
openstackstatusjeblair: sending alert22:01
*** esmute has quit IRC22:01
fungianteaya: saw, thanks22:01
anteayaokay welcome22:02
jeblair#status alert Gerrit is offline for project renames.  ETA 22:4022:02
*** patrickeast has quit IRC22:02
*** patrickeast has joined #openstack-infra22:03
jeblairfungi: let me know when gerrit is stopped and i'll start clicking22:03
fungiready for me to stop gerrit, or are we waiting for the alert to complete?22:03
fungioh, doing22:03
-openstackstatus- NOTICE: Gerrit is offline for project renames. ETA 20:3022:03
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 20:30"22:03
*** hdd has quit IRC22:04
fungiokay, gerrit is now completely down. starting to run lots of scripts everywhere22:04
*** spzala has quit IRC22:05
*** MarkAtwood has quit IRC22:05
*** esmute has joined #openstack-infra22:06
*** dimtruck is now known as zz_dimtruck22:06
openstackstatusjeblair: finished sending alert22:06
openstackstatusjeblair: sending alert22:06
*** tvanderwiel has quit IRC22:07
fungilucene reindex is underway22:07
superdanwoot, early friday!22:07
* superdan goes poof22:07
-openstackstatus- NOTICE: Gerrit is offline for project renames. ETA 22:4022:08
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 22:40"22:08
*** johnsom has joined #openstack-infra22:08
openstackstatusjeblair: finished sending alert22:10
fungii've got the jenkins workspace cleanups going now while i wait for the lucene reindex to complete22:11
fungigit servers are already knocked out22:11
anteayaworkspace cleanups is step 16, yeah?22:12
fungiyeah but it can really happen whenever22:12
anteayak, thanks22:12
fungias long as there aren't jobs running for those repos22:12
anteayaah cool, just trying to follow along22:12
fungiwe're a little past the halfway point on the reindex now22:12
fungii've also got the .gitreview updates scripted and can blast those out once we're back up and running again22:13
fungitrying not to delay the onset of our weekend any longer than necessary ;)22:13
anteayatoday has been a full day of rain22:14
*** esmute has quit IRC22:15
anteayathe github changes must be fun to do22:16
*** ayoung-mtg is now known as ayoung22:16
anteayaor tedious, tedious is another word22:16
anteayathought so22:16
anteayayou disappeared with no sound22:17
anteayafigured you were having a lot of no fun22:17
*** sc` has joined #openstack-infra22:17
*** esmute_ has joined #openstack-infra22:17
fungiokay, 7 and 16 have completed22:18
fungijeblair: need help with the github tedium?22:18
jeblairfungi: sure, why don't you start with the puppet ones22:19
jeblairfungi: i just updated the etherpad with strikethrough, i will continue to keep it updated22:19
*** nfedotov1 has joined #openstack-infra22:19
fungistarting with the puppet ones. we'll see how fast you reach me22:19
*** armax has quit IRC22:20
*** esmute_ has quit IRC22:20
fungii'm crossing them out as i start to work on them (lock acquired!)22:20
*** esmute has joined #openstack-infra22:20
jeblairk, switching to that mode too :)22:21
*** nfedotov has quit IRC22:21
*** nfedotov1 has quit IRC22:21
fungii'll skip down a ways22:22
*** esmute has quit IRC22:24
*** sabeen1 has quit IRC22:25
*** esmute has joined #openstack-infra22:26
*** leakypipes has quit IRC22:26
*** esmute has quit IRC22:27
*** puranamr has quit IRC22:28
*** esmute has joined #openstack-infra22:29
*** greghaynes has joined #openstack-infra22:30
*** xgerman has joined #openstack-infra22:30
*** puranamr has joined #openstack-infra22:31
* jeblair is out22:31
* jeblair gives his mouse back to li22:31
fungifinished as well22:31
anteayaha ha ha22:32
fungii use a very large arcade-style trackball instead22:32
fungibecause at least it feels like i'm playing centipede that way22:32
fungiokay, ready for me to start gerrit?22:32
anteayaI loved centipede22:32
marcusvrnpatrickeast: hey...I have not finished yet, but what do you think about this:
jeblairfungi: i think so22:33
fungiit's on its way back up22:33
jeblairstarting zuul22:33
fungii can confirm it looks to be working22:33
*** annegentle has quit IRC22:34
btullyi can confirm as well22:34
btullynice job!22:34
fungithere's still more to do ;)22:34
jeblairrestoring queues22:34
*** annegentle has joined #openstack-infra22:34
jeblairready for merge-bomb?22:34
* anteaya braces22:34
anteayafungi: step 12 before or after merge bomb?22:35
jeblairsame time is fine22:35
openstackgerritDavide Guerri proposed openstack-infra/shade: Add more parameters to update_port()
fungiyeah, as long as nothing else triggers manage-projects in the meantime22:35
jeblairpuppetmaster is stopped so that's safe22:35
fungiyep, renaming the lone group now22:36
*** esmute has quit IRC22:36
jeblairgertty is doing its thing22:36
jeblairand now it's nodepool's turn22:38
*** sarob has joined #openstack-infra22:38
anteayago nodepool22:39
fungigo magic nodepool, go!22:39
patrickeastmarcusvrn: nice! it might be better to put it at the top of the table if possible, i feel like more often then not the query i pick goes off the screen so having them up at the top by the names would be easier to see22:39
patrickeastmarcusvrn: but i like having those stats22:39
anteayalight on precise and centos off the start22:40
jeblairstatus ok Gerrit is back online.  Zuul reconfiguration for renamed projects is still in progress, ETA 23:30.22:40
jeblairhow's that ?22:40
jeblair#status ok Gerrit is back online.  Zuul reconfiguration for renamed projects is still in progress, ETA 23:30.22:40
openstackstatusjeblair: sending ok22:40
*** ChanServ changes topic to "Gerrit is offline for project renames. ETA 20:30"22:42
-openstackstatus- NOTICE: Gerrit is back online. Zuul reconfiguration for renamed projects is still in progress, ETA 23:30.22:42
jeblairoh, that seems buggy.22:42
jeblairi guess that only works if you issue the update _after_ the first one is complete.22:43
jeblairi'll work on fixing22:43
crinklesubmitting a change to openstack/puppet-keystone works \o/22:43
jeblaircrinkle: you'll need to recheck it after zuul config updates22:43
*** nikeshm has quit IRC22:43
crinklejeblair: ah ok22:44
fungicrinkle: totally not done here22:44
crinklemy hopes are dashed22:44
*** miqui has quit IRC22:44
ianwfungi: ok, i don't have time to look into it ATM ... my checker shows that all centos7 hosts built correctly but as you noted yesterday it's hard to see what image things are running on juts from the console log22:44
*** whitenoi1e has quit IRC22:44
anteayano just put them on hold for about 45 more minutes22:44
*** whitenoise has quit IRC22:44
*** sdake has joined #openstack-infra22:44
fungicrinkle: also i have .gitreview updates for all your projects prepped to push up as soon as we get near the end22:44
openstackstatusjeblair: finished sending ok22:45
fungicrinkle: so you'll have lots of very easy one-line patches to review22:45
crinklefungi: cool ty22:45
*** annegentle has quit IRC22:45
anteayayay nodes for all jobs22:45
marcusvrnpatrickeast: hmm nice! I will check how I can do it22:46
tonybfrickler_: Thank.  I've looked at those reviews but my puppet skills are (pretty much) non-existent so I doubt my +/-1 would mean anything.22:47
*** marcusvrn_ has joined #openstack-infra22:47
tonybfrickler_: I will learn enough to do a reasonable review on Monday22:47
marcusvrnpatrickeast: but now I have to go :) have a nice weekend22:47
tonybfrickler_: because yes I'd very much like vivid (well really rolling ubuntu-dev) in nodepool.22:47
openstackgerritMerged openstack-infra/project-config: networking-ovn: move from stackforge/ to openstack/
fungiand so it begins!22:49
*** ChanServ changes topic to "Active incident: venom related reboots | Related work in #openstack-infra-incident"22:50
anteayathey all seem in good shape22:50
patrickeastmarcusvrn: thanks, you too22:50
fungimake it rain rename patches22:50
anteayajust waiting on the centos ones22:50
*** whitenoise has joined #openstack-infra22:50
*** whitenoise has joined #openstack-infra22:50
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs | bugs | source"22:50
jeblairthose are a little stale  :/22:51
*** whitenoi1e has joined #openstack-infra22:51
anteayaha ha ha22:51
anteayais chanserv playing topic roulette?22:51
*** puranamr has quit IRC22:51
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs | bugs | source"22:51
ianwfungi: might help with this one ... if it is again back to the oom situation22:51
j^2anteaya: looks like it22:51
*** puranamr has joined #openstack-infra22:52
*** puranamr has quit IRC22:52
*** marcusvrn has quit IRC22:52
*** marcusvrn_ is now known as marcusvrn22:52
*** puranamr has joined #openstack-infra22:52
jeblairall changes have nodes now22:52
jeblairwe're 16 minutes out depending on how happy centos6 is22:53
anteayalast centos jobs started about 9 minutes ago22:53
openstackgerritIan Wienand proposed openstack-infra/devstack-gate: [WIP] run centos7 with neutron
*** dguerri is now known as dguerri`22:54
*** sigmavirus24 is now known as sigmavirus24_awa22:54
*** wenlock_ has quit IRC22:55
openstackgerritMerged openstack-infra/project-config: Move networking-odl into the openstack namespace
openstackgerritIan Wienand proposed openstack-infra/project-config: Add uname -a to net-info macro
ianwfungi: ^ this would also help in figuring out what is running22:58
ianwwithout having to find someone to log in22:59
*** esmute has joined #openstack-infra23:03
*** esmute has quit IRC23:04
anteayathe centos job at the top of the gate has been running 22 minutes23:04
anteayahow long is the timeout period?23:05
openstackgerritMerged openstack-infra/project-config: vmware-nsx: move from stackforge/ to openstack/
anteayaoh done23:05
openstackgerritMerged openstack-infra/project-config: networking-midonet: move from stackforge/ to openstack/
fungianteaya: 30. so cutting it close, yes23:05
anteayanew top of gate has been going 23 minutes23:06
*** rfolco has quit IRC23:06
anteayajust one more centos still running behind it23:07
anteayarest are all green23:07
openstackgerritMerged openstack-infra/project-config: networking-cisco: move from stackforge/ to openstack/
fungifingers and eyes crossed23:08
openstackgerritMerged openstack-infra/project-config: networking-ofagent: move from stackforge/ to openstack/
openstackgerritMerged openstack-infra/project-config: networking-bgpvpn: move from stackforge/ to openstack/
*** salv-orlando has quit IRC23:08
openstackgerritSpencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env
openstackgerritMerged openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook*
openstackgerritMerged openstack-infra/project-config: dragonflow : move from stackforge/ to openstack/
openstackgerritMerged openstack-infra/project-config: Project rename stackforge/ironic-discoverd -> openstack/ironic-inspector
openstackgerritMerged openstack-infra/project-config: Rename stackforge/octavia -> openstack/octavia
openstackgerritMerged openstack-infra/project-config: Move zvm-driver to stackforge-attic
openstackgerritMerged openstack-infra/project-config: Remove old Fuel plugins
anteayaall the rest are done23:09
openstackgerritMerged openstack-infra/project-config: Puppet: move from Stackforge to OpenStack
openstackgerritMerged openstack-infra/project-config: Move networking-l2gw project under openstack namespace
openstackgerritMerged openstack-infra/project-config: Rename stackforge/mistral to openstack/mistral
jeblairthat's the set23:09
j^2Thanks everyone!23:09
anteayanow .gitreview files for everybody23:10
jeblairnot yet23:10
fungino, now puppet goes back on23:10
HenryGNice work folks! I just switched my remote urls and all looks great! Thanks!23:10
fungiand then once manage-projects applies all those changes, we push .gitreview updates23:10
anteayaI got excited23:10
*** abitha has quit IRC23:11
jeblairfungi: i'll run by hand now23:11
fungisounds good23:11
jeblairfatal: destination path '/etc/puppet/modules/apps_site' already exists and is not an empty directory.23:12
jeblairfor later23:12
*** fallenpegasus has quit IRC23:12
fungier, huh23:13
fungiyeah, guess i missed something reviewing that23:13
fungii was going to try to launch the server for it today23:13
*** EricGonczer_ has joined #openstack-infra23:13
fungibut we're waiting confirmation of the resource consumption at its current hosting location so i can size the flavor appropriately23:14
jeblairfungi: i think that was the puppet module git checkout on the puppetmaster23:14
jeblairprobably just need to rm that dir and let it recreate it23:14
openstackgerritJohn L. Villalovos proposed openstack-infra/yaml2ical: Add docs on biweekly-odd vs biweekly-even
fungioh, got it23:16
fungianyway, will do23:16
*** EricGonczer_ has quit IRC23:18
*** abitha has joined #openstack-infra23:22
*** openstackgerrit has quit IRC23:22
*** openstackgerrit has joined #openstack-infra23:22
fungionce the manage-projects run completes, i've got the .gitreview changes ready to cram up into the gerrit23:23
*** ashleighfarnham has quit IRC23:23
*** wenlock has quit IRC23:23
*** davideag_ has joined #openstack-infra23:23
jeblairgit* is done; review is running now23:23
HenryGCan we do our own .gitreview update patch?23:24
fungiHenryG: you could, but i have them scripted up already for all 61 renamed repos23:24
HenryGfungi: cool23:24
* HenryG waits23:24
fungiso it will take me, literally, seconds23:24
fungijust waiting until the renaming is actually complete before i push them23:25
*** Sukhdev has quit IRC23:25
fungiwe're basically in a holding pattern until all the acl updates are applied by puppet23:25
*** davideag_ has quit IRC23:25
*** rlandy has quit IRC23:25
* anteaya imagines planes circling overhead23:26
fungiand also i'm taking advantage of the brief quiet to eat dinner23:26
* johnsom passes out pretzels23:26
anteayapretzels are good23:26
openstackgerritSpencer Krum proposed openstack-infra/project-config: Test that the mdoules.env file in infra is sorted
*** davideagnello has quit IRC23:27
*** rlandy has joined #openstack-infra23:27
openstackgerritSpencer Krum proposed openstack-infra/system-config: Alpha-sort modules.env
*** abregman has quit IRC23:27
openstackgerritSpencer Krum proposed openstack-infra/system-config: Bring in module to manage update-alternatives
openstackgerritJohn L. Villalovos proposed openstack-infra/irc-meetings: Update text on Ironic bare metal meeting
jlvillalNobodyCam: I added you as a reviewer to:   Updating the text a little for the Ironic meeting.23:31
* jlvillal smacks forehead for wrong channel23:31
*** bexelbie has quit IRC23:32
anteayajlvillal: not to worry23:32
jlvillalanteaya: Thanks :)23:32
*** sputnik13 has quit IRC23:33
fungijeblair: looks like manage-projects just completed?23:33
jeblairreview.o.o done23:33
jeblairfungi: you may want to wait for zuul to be updated though23:34
fungiotherwise we're sure to have some odd test results23:34
fungijenkins job updates too i expect23:34
jeblairThe authenticity of host ' (2001:4800:7818:104:be76:4eff:fe04:b7cc)' can't be established.23:34
jeblairi think i'm going to say 'no' to that one.23:34
fungijust as well, we'll delete it soon23:35
fungii would skip that23:35
*** EricGonczer_ has joined #openstack-infra23:35
jeblairetherpad* are disabled23:35
openstackgerritSpencer Krum proposed openstack-infra/system-config: Add puppet-community/archive module
*** alexsyip has quit IRC23:36
fungihuh. i wonder if that's because of clarkb's local patches fixing the summit bugs23:36
jeblairThe authenticity of host ' (2001:4800:7815:104:be76:4eff:fe03:64a7)' can't be established.23:36
fungianother mordred demo23:36
jeblairThe authenticity of host ' (' can't be established.23:36
jeblairi guess i'll say 'yes' to that one23:36
fungithat ones not online yet, but should be agreed23:36
openstackgerritSpencer Krum proposed openstack-infra/system-config: Load in nanliu/git module
*** EricGonczer_ has quit IRC23:37
jeblairchanged: []23:38
*** Sukhdev has joined #openstack-infra23:38
*** EricGonczer_ has joined #openstack-infra23:38
jeblairi think it's reloading now23:38
jeblairthough it's also possible it's stuck in a loop23:39
jeblairi'll restart it23:40
*** Swami has quit IRC23:40
fungithat's remarkably unfortunate23:40
*** otter768 has joined #openstack-infra23:40
*** EricGonczer_ has quit IRC23:41
waynrcan anyone explain the difference between a zuul Ref and a zuul Change?23:41
waynrthe zuul merger seems to treat the two differently23:41
openstackgerritFlavio Percoco proposed openstack/requirements: Use pyngus>=1.3.1
jeblairwaynr: one is a commit in a repository, one is a proposed commit that hasn't landed yet23:42
jeblairfungi: restarted23:42
jeblairlooks like all the jenkinses are done now as well23:42
waynroh...i've been using Ref all along, I guess I should have been using Change23:43
waynrfinding some bugs in my github connection when attempting to implement a reporter23:43
fungii should probably hold off pushing these until i confirm we have common node types registered in gearman again23:43
*** sarob has quit IRC23:44
asselin_does zuul promote make  a change run sooner?23:44
asselin_in an independent pipeline?23:44
fungiasselin_: it reorders a shared change queue in a dependent pipeline23:44
asselin_I see...seems like it went to the back of the list now23:44
*** otter768 has quit IRC23:45
jeblairfungi: puppet is complete23:45
fungiasselin_: for an independent pipeline it's not much help, no23:45     : ok=0    changed=0    unreachable=0    failed=123:45
jeblairoh, disabled there too23:45
fungiyeah, because we have your alien cleanup patch applied23:46
asselin_fungi, that ok...I guess i have to promote everything else to get the one I want to run first.....23:46
openstackgerritZhenguo Niu proposed openstack-infra/project-config: Add ironic-dashboard to openstack
jeblairasselin_: it re-enqueues the change, so the job requests go to the back of the gearman queue23:47
jeblair(zuul is not actually responsible for ordering)23:47
*** ajmiller has quit IRC23:48
*** puranamr has quit IRC23:48
fungijeblair: i don't see any job definitions in gearman with no registered workers, and all the node types i think we care about seem to be present, so pushing the .gitreview updates now23:48
jeblairand there they go :)23:49
*** dan is now known as Guest7440923:49
*** dan_ has joined #openstack-infra23:50
*** dan_ is now known as Guest6854923:50
jeblairjust as a really rough estimate, i'm guessing that took about 0.5 person-hours per repo.23:53
jeblairwhich makes this nearly a week's work.  certainly in france.23:55
fungiyeah, especially if you count all the time the maintenance plan fairy spent last night to leave that etherpad under my pillow, the time you spent trying to hammer the stack of commits into shape, the multiple people reviewing them all multiple times23:55
jeblair(and it's only so _low_ because we batched them)23:55
anteayayeah I would say I worked for about 8 hours total on this23:55
anteayaha ha ha23:55
anteayaman in france is hard to get anything done23:55
anteayathe holidays are interrupted by holidays23:55
anteayamay in france23:55
openstackgerritMichal Rostecki proposed openstack-infra/project-config: Determining Rally-Devstack integration on pre_test_hook
sc68caldon't forget the 6 week vacation23:55
fungiwe interrupt this regularly scheduled holiday to bring you an emergency holiday23:56
anteayasc68cal: that is july I think23:56
anteayafungi: that's about it23:56
*** puranamr has joined #openstack-infra23:56
*** ZZelle_ has quit IRC23:57
*** bkero has quit IRC23:57
jeblairfungi: i'm imagining the maintenance plan fairy is not a disney fairy.23:58
jeblairfungi: more like a treacherous fairy of old.23:58
*** rlandy has quit IRC23:58
openstackgerritWayne Warren proposed openstack-infra/zuul: Add basic Github Zuul Reporter.
*** sarob has joined #openstack-infra23:58
fungijeblair: let's just say you don't want to gaze upon its likeness unless your sanity points are still mostly intact23:59

Generated by 2.14.0 by Marius Gedminas - find it at!