Monday, 2017-10-30

*** alumno has joined #zuul04:08
*** alumno has quit IRC04:32
*** hhcmralgsp has joined #zuul06:37
*** hhcmralgsp has quit IRC06:38
*** xoqbebvbqj has joined #zuul07:16
*** xoqbebvbqj has quit IRC07:16
*** hashar has joined #zuul07:49
*** smyers has quit IRC09:02
*** smyers has joined #zuul09:04
*** xinliang has quit IRC10:30
*** xinliang has joined #zuul10:42
*** xinliang has joined #zuul10:42
*** dmsimard is now known as dmsimard|afk11:05
*** bhavik1 has joined #zuul12:00
*** bhavik1 has quit IRC12:13
*** hashar has quit IRC12:37
*** hashar has joined #zuul13:59
openstackgerritMerged openstack-infra/zuul-jobs master: add more debugging to the upload-pypi role  https://review.openstack.org/51439414:48
*** dmsimard|afk is now known as dmsimard15:30
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Zuul: add file extension to playbook path  https://review.openstack.org/51613516:10
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use cached branches on tenant reconfiguration  https://review.openstack.org/51597116:10
*** bhavik1 has joined #zuul16:33
*** bhavik1 has quit IRC16:41
* SpamapS reads the section of docs about shared queues16:50
ShrewsDo I really need a company-mandated training course to know that "different people have different ideas". Geez17:10
* Shrews grumbles under his breath17:10
*** hashar is now known as hasharAway17:16
*** harlowja has joined #zuul17:19
*** hasharAway has quit IRC17:23
dmsimardShrews: the ethics thing? heh17:24
dmsimardShrews: you'd be surprised about what is common sense for you and me isn't for everyone and it's stuff that's more or less required being in a publicly traded company and all17:25
openstackgerritPaul Belanger proposed openstack-infra/zuul feature/zuulv3: Fix syntax with gear unRegisterFunction()  https://review.openstack.org/51640317:26
pabelangerjeblair: SpamapS: ^should fix our governor thread.17:27
pabelangerNot sure the best way to test that in gate, maybe some way we can mock load17:27
*** hashar has joined #zuul17:28
jeblairpabelanger: yeah, this is a case where i would be happy to have a test which mocked out os.getloadavg() and did a 'status' call to gearman to verify that the function was unregistered17:29
pabelangeryah17:30
SpamapShow did that slip through?17:30
SpamapShas the executor just been crashing at high load?17:30
pabelangernot sure about crashing17:30
SpamapSseemed like it was working so.. ?17:30
pabelangerI just seen the loadavg on http://grafana.openstack.org/dashboard/db/zuul-status17:30
pabelangerthen looked17:31
jeblairjust there's an exception handler, so it's just no-opping17:31
pabelangerbut ianw did restart zuul this morning and noticed the exception17:31
jeblairpabelanger: did you want to write the test, or should i take a stab at it?17:32
jeblairSpamapS: i'm guessing now that we have 10 executors, we're just dealing with the load naturally most of the time.17:33
pabelangerjeblair: Yah, I don't mind give it a try. But if going to hold up 516403 maybe you want to take the stab17:33
SpamapSjeblair: but at the time we wrote it.. it was unregistering things in the log.. so weird.17:34
jeblairpabelanger: i think we can merged 403 without it.  it's all yours.  let me know if i can help.17:34
pabelangerk17:34
SpamapSI can write the test too17:36
SpamapSsince it's my code originally17:36
jeblairSpamapS: the original version did not have an exception handler, so it would have emitted a log line saying "unregistering", then hit the error and the thread would have died17:36
SpamapSawesome17:37
SpamapSpabelanger: were you writing a test then?18:37
pabelangerSpamapS: I am, but haven't started just yet. Working on logstash-workers atm18:38
pabelangerSpamapS: https://review.openstack.org/516403/ isn't +A so, if you want to add to it or append as follow up, wfm18:39
pabelangeror we can just land and I was going to work on it this evening18:39
SpamapSpabelanger: I'm going to poke at it now18:40
SpamapSI actually recall wanting to write one and then just pushing forward because everything was on fire18:40
openstackgerritAndreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Remove zuul-migrate job  https://review.openstack.org/51602818:40
jeblairSpamapS: 18:47 < openstackgerrit> James E. Blair proposed openstack-infra/gear master: server: make stats more efficient  https://review.openstack.org/51642218:47
* SpamapS looks18:48
jeblairSpamapS: our logstash gearman queue is 600k entries long, which made me realize geard can totally handle that, because everything related to queue lengths is O(1), except those stats calculations.18:48
jeblair(which are O(n))18:49
SpamapSjeblair: I"m surprised to year that the workers stat isn't all that useful.18:50
SpamapSs/year/hear/18:50
SpamapSbut I suppose if it's a stable worker set that makes sense.18:50
jeblairSpamapS: i think the reason i say that is because it's only an aggregate count of workers.  that's useful in some cases, but others you really need to know workers by function.18:51
jeblair(basically, it would be useful if you have a dynamic set of workers all with the same functions)18:52
jeblairSpamapS: i'm happy to keep it if you think it's valuable.  i don't have an idea of how to calculate it without looping though (though generally that should be a pretty fast loop)18:54
jeblairSpamapS: okay, i think i have an idea :)18:58
SpamapSjeblair: yeah workers by function is far far far more useful19:01
SpamapStotal workers is a bit of a corner case19:01
SpamapSOh interesting19:02
SpamapSjeblair: gear has an OS X bug19:02
SpamapS  File "/Users/cbyrum/src/openstack-infra/zuul/.tox/py36/lib/python3.6/site-packages/gear/__init__.py", line 2698, in Server19:02
jeblairmeh, my idea is hard.  i'm going to leave the change as-is for now (dropping workers)19:02
SpamapS    edge_bitmask = select.EPOLLET19:02
SpamapSAttributeError: module 'select' has no attribute 'EPOLLET'19:03
* SpamapS curses this stupid mac19:03
jeblairSpamapS: oh, yeah, geard doesn't work on osx.  gear client does though.19:03
SpamapScan't run unit tests for zuul because of it tho19:03
* SpamapS deals19:03
ShrewsSpamapS: yeah, that particular bit of mac-osx-iness was the final straw (of many) that drove me away from ever using a mac for dev again19:06
Shrewsi know there's a workaround with kqueue, but it just kept popping up19:08
SpamapSShrews: I suppose if we make it work on OS X we get *BSD for free.19:22
SpamapSbut I find myself working in my Ubuntu VM more and more19:22
SpamapSif nothing else, the vim settings are better19:22
SpamapShrm proving harder than I thought.. have to monkey patch stuff before the executor starts20:07
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for override-checkout, deprecate override-branch  https://review.openstack.org/51645121:11
SpamapSyou know, I used to think zuul was about scaling to a massive team...21:50
SpamapSIt's pretty awesome just using it for 2 people.21:50
SpamapSjeblair: zuul meeting today.. I'm double booked for the first 30min. But would like to discuss turning our sights on 3.0 soon... possibly targetting a release around PTG-ish time.21:53
jeblairSpamapS: ack.  i plan on sending out an email with the priorities list we brainstormed at the last ptg today or tomorrow.  i think that'll be good to help us see the path to get there.  i agree that timeline (feb) is plausible.21:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for override-checkout, deprecate override-branch  https://review.openstack.org/51645122:00
jeblairit's zuul meeting time in #openstack-meeting-alt22:00
SpamapSjeblair: awesome. I hope to have enough capital and data from my early experiments to make a strong push for some GoDaddy teams to adopt it fully (otherwise we'll probably standardize on Jenkins Pipeline and groovy.. blech)22:00
*** hashar has quit IRC22:11
openstackgerritIan Wienand proposed openstack-infra/zuul feature/zuulv3: Check start time for wait_time key  https://review.openstack.org/51646522:29
jeblairthe override-checkout change is ready for review: https://review.openstack.org/51645123:03

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!