Monday, 2016-01-04

*** darvon has quit IRC00:00
*** pfalleno1 has quit IRC00:02
*** Qiming has joined #openstack-infra00:04
*** pfallenop has joined #openstack-infra00:05
*** darvon has joined #openstack-infra00:05
*** salv-orl_ has joined #openstack-infra00:06
*** otter768 has quit IRC00:06
*** salv-orlando has quit IRC00:09
*** markvoelker has joined #openstack-infra00:12
*** Qiming has quit IRC00:18
*** tzn has joined #openstack-infra00:18
*** zeih has joined #openstack-infra00:30
*** zeih has quit IRC00:34
*** oomichi has joined #openstack-infra00:41
*** otter768 has joined #openstack-infra00:55
*** dingyichen has quit IRC00:57
*** dingyichen has joined #openstack-infra00:58
*** camunoz has quit IRC01:01
*** camunoz has joined #openstack-infra01:01
*** aeng has quit IRC01:04
*** pahuang has quit IRC01:05
*** tzn has quit IRC01:09
*** salv-orl_ has quit IRC01:11
*** zz_dimtruck is now known as dimtruck01:12
*** salv-orlando has joined #openstack-infra01:12
*** aeng has joined #openstack-infra01:17
*** dimtruck is now known as zz_dimtruck01:22
*** pahuang has joined #openstack-infra01:23
*** chlong has joined #openstack-infra01:25
*** tzn has joined #openstack-infra01:26
*** Qiming has joined #openstack-infra01:28
*** armax has quit IRC01:29
*** zeih has joined #openstack-infra01:31
openstackgerrithardik proposed openstack-infra/project-config: Add Job for mistral-docker-imagebuild  https://review.openstack.org/26124901:35
waynrcan anyone tell me if this is within the normal variation of run times for the jenkins-job-builder-compare-xml test: https://review.openstack.org/#/c/263062/01:35
*** zeih has quit IRC01:35
waynrit looks to be within the general range of values for commits in the jjb-2.0.0-api topic01:36
waynri only looked at a couple recent runs for reviews on the master branch of jenkins-job-builder but they were in the ~5m range01:38
*** tzn has quit IRC01:41
*** tzn has joined #openstack-infra01:53
*** moravec has quit IRC01:56
*** masber has quit IRC01:57
*** tzn has quit IRC01:58
*** Sukhdev has joined #openstack-infra01:59
*** gongysh has joined #openstack-infra02:00
*** zz_dimtruck is now known as dimtruck02:01
*** pahuang has quit IRC02:08
*** aeng has quit IRC02:09
*** baoli has joined #openstack-infra02:09
*** pahuang has joined #openstack-infra02:10
*** baoli has quit IRC02:10
*** dimtruck is now known as zz_dimtruck02:11
*** zhurong has joined #openstack-infra02:13
*** baoli has joined #openstack-infra02:16
*** masayukig has quit IRC02:22
*** aeng has joined #openstack-infra02:22
*** masayukig has joined #openstack-infra02:23
*** baoli has quit IRC02:29
*** zhenguo has joined #openstack-infra02:29
*** zeih has joined #openstack-infra02:32
*** masber has joined #openstack-infra02:33
*** pahuang has quit IRC02:35
*** zeih has quit IRC02:36
*** baoli has joined #openstack-infra02:37
*** baoli has quit IRC02:43
*** Liuqing has joined #openstack-infra02:46
*** sdake has joined #openstack-infra02:47
*** pahuang has joined #openstack-infra02:48
*** sdake_ has joined #openstack-infra02:49
*** sdake has quit IRC02:52
fungifor those reading scrollback, reminder i'm not around monday (stuck in a car most of the day), but will still be around all of tuesday as usual02:54
*** dkranz has joined #openstack-infra02:54
Clintfungi: good luck escaping the car02:55
pleia2fungi: safe travels!02:55
fungithanks!02:55
*** baoli has joined #openstack-infra02:56
fungii'll make sure someone leaves the window cracked so i don't suffocate in there02:56
*** krtaylor has joined #openstack-infra02:56
pleia2hehe02:56
*** gmann has quit IRC02:59
*** sdake_ is now known as sdake03:00
*** baoli has quit IRC03:06
*** dkranz has quit IRC03:07
crinklefungi: will you want to be doing the paste downtime on tuesday? or save that for later?03:12
openstackgerritJoshua Hesketh proposed openstack-infra/statusbot: Post message to twitter on 'ok' status  https://review.openstack.org/26309903:13
fungicrinkle: i was toying with doing it from my hotel room right now03:13
fungii think i might take this opportunity to replace the old mysql 5.1 trove instance we had for it before with a mysql 5.6 instance too, so we don't need a second db transfer later03:14
fungilemme go do that real quick first and retest it03:14
crinklecool03:14
openstackgerritJoshua Hesketh proposed openstack-infra/statusbot: Post message to twitter on 'ok' status  https://review.openstack.org/26309903:14
*** yamahata has quit IRC03:16
openstackgerritJoshua Hesketh proposed openstack-infra/puppet-openstackid: Write update output to a logfile  https://review.openstack.org/26263003:18
fungiokay, newer mysql 5.6 trove instance created, tested and updated in hiera03:25
*** Sukhdev has quit IRC03:26
fungii'll do a quick outage of paste.o.o by stopping apache and lodgeit long enough to dump the db, source it in the trove instance, and then reenable/update puppet and start services again03:26
fungii've created http://paste.openstack.org/show/482926 as a canary to confirm the dump/load was complete03:28
*** unicell has quit IRC03:28
*** unicell has joined #openstack-infra03:28
*** unicell1 has joined #openstack-infra03:31
*** zeih has joined #openstack-infra03:32
*** binbincong has joined #openstack-infra03:33
fungidump complete, loading into trove now03:33
*** unicell has quit IRC03:33
*** coolsvap|away is now known as coolsvap03:33
fungithe export is just shy of 1gb, so not too long03:34
*** Sukhdev has joined #openstack-infra03:34
fungimysqld is also stopped on paste.o.o now so we don't accidentally connect to the new db and get confused while testing it out03:35
fungiimport looks good from the cli. updating puppet now03:37
*** zeih has quit IRC03:37
*** beekneemech has quit IRC03:37
*** bnemec has joined #openstack-infra03:39
*** unicell has joined #openstack-infra03:39
fungimmm, puppetboard says we have a lot of failed nodes, in particular all our jenkins masters?03:40
*** unicell1 has quit IRC03:41
openstackgerritMerged openstack-infra/zuul: Bump APScheduler to >=3.0  https://review.openstack.org/26063703:41
fungilooks like the issue with the jenkins masters is that they're failing to update the python-jenkins package to the latest release?03:46
*** Sukhdev_ has joined #openstack-infra03:47
*** Sukhdev has quit IRC03:49
openstackgerritMerged openstack-infra/zuul: Deprecated tox -downloadcache option removed  https://review.openstack.org/25667103:50
jheskethfungi: hmm looks like python-jenkins is already at the latest... maybe the nodes are having trouble querying pypi?03:51
*** links has joined #openstack-infra03:54
fungipossible03:56
fungias for paste, it looks like when puppet ran it didn't update the dburi in /srv/lodgeit/openstack/manage.py03:56
fungii'm going to manually update the script while i look into what's going on with it03:56
*** larainema has quit IRC03:58
*** masber has quit IRC03:58
fungitest pastes are working as expected now, including the test paste i created immediately prior to the db dump03:59
*** gmann has joined #openstack-infra03:59
fungiand mysqld is definitely not running, which means we're hitting the trove instance03:59
fungiso just need to figure out why the manage script didn't get the update03:59
*** davideag_ has quit IRC04:00
fungioh, i may have enabled puppet mid-ansible-run04:00
fungithe "successful" report from 03:49 utc took 0 seconds04:01
fungiand reported no changes04:01
fungiwaiting for the next pulse to see what happens04:01
*** zz_dimtruck is now known as dimtruck04:02
fungias soon as i see it update correctly, i'll un-wip 26232104:03
*** kushal has joined #openstack-infra04:04
*** dcentral has joined #openstack-infra04:04
* jhesketh nods04:04
fungiand then we're just down to two remaining servers with local mysql databases?04:05
*** masber has joined #openstack-infra04:05
fungihrm, the subsequent puppetdb report from 04:07 also shows no changes for paste.o.o04:09
fungidouble-checking that what we have in system-config is actually correct04:10
*** dimtruck is now known as zz_dimtruck04:11
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/26294504:12
*** sdake has quit IRC04:14
fungithe system-config checkout in /opt/system-config/production on paste.o.o shows its last commit was december 104:18
fungileads me to suspect ansible is not updating system-config there04:18
fungisame on nodepool.o.o04:19
fungiso seems ansible isn't propagating system-config updates?04:19
openstackgerritKen'ichi Ohmichi proposed openstack/requirements: Bump minimum tempest-lib version  https://review.openstack.org/26310604:20
fungiit's updating hiera correctly though04:21
fungiso the problem is that the new hiera keys are not being called from the stale version of system-config on the server04:21
openstackgerritGal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate  https://review.openstack.org/26298104:23
clarkbI dont think its puppet applying yet04:24
fungioh, hrm04:26
*** vilobhmm11 has joined #openstack-infra04:26
fungiso it's still calling back to puppetmaster via puppet agent?04:26
fungii guess i can try manually running `puppet agent --test` and see what happens? is that still safe?04:27
*** rguillebert has quit IRC04:27
fungiand yeah, digging into the puppet role in ansible i don't see it doing any git checkout or looking at anything in /opt locally on the servers04:28
*** gongysh has quit IRC04:28
fungiwhich supports your theory04:28
fungiyeah, roles/puppet/library/puppet is still calling apply04:30
*** zeih has joined #openstack-infra04:33
*** otter768 has quit IRC04:34
*** kushal has quit IRC04:35
nibalizerthe way it would copy the code is with rsync04:35
*** kushal has joined #openstack-infra04:35
nibalizerbut it should be still agent04:35
fungithanks clarkb, that provided enough debugging to remind me that until 262321 merges i can't remove the old paste_mysql_root_password hiera key nor leave the local mysqld stopped04:36
nibalizerfungi: did you mean still calling agent?04:36
funginibalizer: yeah04:36
nibalizerok04:36
fungirather than apply04:36
funginibalizer: why rsync and not just git?04:37
nibalizeri asked that question as well04:37
*** zeih has quit IRC04:37
nibalizerit is faster to rsync04:38
fungiare we needing to apply some sort of transformation of what we have in system-config git now?04:38
nibalizerrsyncing the modules directory has the nice effect of making sure every node runs the same puppet code04:39
nibalizerif two nodes both ran install_modules.sh at different times (after someone landed something on a module) they might get different versions04:39
nibalizersortof like the project-config-ref issue x 6004:39
fungioh, syncing all modules, not just system-config04:40
fungigot iy04:40
fungiit04:40
crinklepaste seems to be down?04:41
crinklenm it is back up04:42
fungii think puppet stopped it in a failed attempt to restart it when i did the apply a minute ago04:42
fungii manually started the openstack-paste service which brought it back up again04:43
*** Sukhdev_ has quit IRC04:43
*** Sukhdev has joined #openstack-infra04:44
*** apoorvad has joined #openstack-infra04:45
*** treaki_ has joined #openstack-infra04:47
*** treaki__ has quit IRC04:51
fungianyway, if it seems to remain stable now, 262321 should be ready to go in. i've cleared my wip04:53
*** armax has joined #openstack-infra04:53
fungiif someone gets to that in the next few minutes, i'll take care of the manual followup cleanup mentioned in my review comment04:54
crinklenibalizer: ^ seemed to be here04:55
nibalizersure04:58
fungi'preciated!04:58
*** gnuoy has quit IRC05:00
*** jamespage has quit IRC05:00
*** davideagnello has joined #openstack-infra05:00
*** jamespage has joined #openstack-infra05:00
*** gnuoy has joined #openstack-infra05:00
*** dchen has joined #openstack-infra05:02
*** davideagnello has quit IRC05:05
*** salv-orl_ has joined #openstack-infra05:07
*** salv-orlando has quit IRC05:07
openstackgerritMerged openstack-infra/system-config: Revert "Add a local MySQL database to paste.o.o"  https://review.openstack.org/26232105:15
fungicool, i'll do the last manual cleanup now05:15
*** baoli has joined #openstack-infra05:18
*** dchen has quit IRC05:19
*** apoorvad has quit IRC05:20
*** dchen has joined #openstack-infra05:21
*** apoorvad has joined #openstack-infra05:22
*** baoli has quit IRC05:23
*** apoorvad has quit IRC05:25
*** Eva-i has quit IRC05:26
*** abregman has joined #openstack-infra05:27
fungiokay, puppetmaster has updated with that, i've cleaned up the old hiera key and uninstalled the local mysql service and the puppet manifest is applying cleanly05:32
fungiand paste still seems to be running fine05:32
fungii'll take that as a cue to get some sleep. day full of driving coming up05:33
crinkleo705:33
*** zeih has joined #openstack-infra05:35
*** sam_wan has joined #openstack-infra05:37
*** zeih has quit IRC05:39
*** markvoelker has quit IRC05:39
*** dchen has quit IRC05:44
*** harlowja_at_home has joined #openstack-infra05:51
*** masber has quit IRC05:55
*** davideagnello has joined #openstack-infra06:01
*** zz_dimtruck is now known as dimtruck06:03
*** Sukhdev_ has joined #openstack-infra06:04
*** salv-orlando has joined #openstack-infra06:06
*** davideagnello has quit IRC06:06
*** Sukhdev has quit IRC06:07
*** harlowja_at_home has quit IRC06:08
*** salv-orl_ has quit IRC06:09
*** dimtruck is now known as zz_dimtruck06:12
*** masber has joined #openstack-infra06:17
*** vilobhmm11 has quit IRC06:19
gsagieHello all, regarding https://review.openstack.org/#/c/262981/2/zuul/layout.yaml trying to put python3 tests in the check (non voting) i guess the way i did it is not the correct way, can anyone please suggest?06:22
*** vilobhmm11 has joined #openstack-infra06:25
*** masber has quit IRC06:25
craigeHow long ago did you run that rechack gsagie?06:30
*** camunoz has quit IRC06:30
gsagiejust run it now craige06:31
gsagiefew minutes ago06:31
gsagiethe syntax seems ok to you?06:31
craigeOk. I couldn't see any obvious problems so let's see how that goes :-)06:31
gsagiecraige: ok thanks!06:32
*** FallenPegasus has joined #openstack-infra06:33
*** larainema has joined #openstack-infra06:33
craigeIt's failed again gsagie but I'd think it's a problem with your change, unless I've missed something.06:34
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/26314306:35
gsagiecraige: you mean its not a problem with my change ? or it is?06:35
*** otter768 has joined #openstack-infra06:35
gsagiei havent seen any example of a job that has this as a check, so i am assume its something there06:36
craigeYou've still got other references to python3 in that file.06:36
craigeShould they be removed to?06:36
gsagiecraige: where?06:37
craigeI'm now sure it's your change and you've not successfully removed pthon3-jobs as you'd hoped.06:37
craigeLines 378 - 38206:39
gsagiei am not sure you look at the correct patch, mine is https://review.openstack.org/#/c/262981/06:40
*** markvoelker has joined #openstack-infra06:40
craigeI'll double check06:40
*** otter768 has quit IRC06:41
*** irenab has quit IRC06:42
*** camunoz has joined #openstack-infra06:44
*** markvoelker has quit IRC06:45
*** masber has joined #openstack-infra06:47
craigeHad the right change but was slightly confused gsagie06:47
*** jtomasek has joined #openstack-infra06:51
*** armax has quit IRC06:52
gsagiecraige: np06:52
*** Sukhdev_ has quit IRC06:52
craigeI think I see where your problem lies gsagie06:54
craigeYou remove python3-jobs from the check but python-jobs remains in the template. I don't *know* that's a problem but it's suspicious to me.06:54
craigeI'm looking for examples of how to acheive what you're trying to do properly.06:55
*** chlong has quit IRC06:55
*** isaacb has joined #openstack-infra06:56
gsagiecraige: thanks, i am trying to run python3 tests but want them to be non-voting (as Andreas suggested in the comment, because before that i removed it completely and it pass jenkins)06:57
gsagiebut i guess i did it wrong (just copy paste python3-jobs to check06:58
craigeThat makes sense.06:59
craigeYour change doesn't look that different from others in that file either06:59
craigeI can't find any other examples of "python3-jobs" being used in the check field, gsagie.07:02
*** davideagnello has joined #openstack-infra07:02
gsagiecraige: yeah i know, searched that as well :)07:02
craige:-)07:05
craigeI've not looked at that file before so I'm trying to get my head around it as well.07:05
TheloHi all, I just deploy a CI using : http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/README.md, at the end, should there be jobs automatically loaded inside jenkins or I need to load some by myself?07:06
*** davideagnello has quit IRC07:07
craigeOn line 378 gsagie, python30jobs is defined as "gate-{name}-python34" - does such a file exist for dragonflow? If it doesm you could call that check directly.07:07
*** aopincar has joined #openstack-infra07:08
*** sam_wan has quit IRC07:11
*** irenab has joined #openstack-infra07:13
craigeBoth andreas and myself have added what we think is the answer to your change, gsagie07:16
gsagiecraige: saw, thanks, will address it soon :)07:17
gsagiethanks for your help07:17
*** oomichi has quit IRC07:17
craigeno probs gsagie. I got a lot out of it too :-D07:17
*** vilobhmm11 has quit IRC07:18
*** aopincar has quit IRC07:20
*** lennyb_ has joined #openstack-infra07:31
*** isaacb has quit IRC07:34
*** ifarkas has joined #openstack-infra07:34
*** salv-orlando has quit IRC07:34
*** aopincar has joined #openstack-infra07:35
*** salv-orlando has joined #openstack-infra07:35
*** _nadya_ has joined #openstack-infra07:37
*** amotoki has joined #openstack-infra07:38
*** salv-orlando has quit IRC07:42
*** salv-orlando has joined #openstack-infra07:42
*** treaki_ has quit IRC07:43
*** aopincar has quit IRC07:43
*** kevinbenton has quit IRC07:49
*** isaacb has joined #openstack-infra07:50
*** kevinbenton has joined #openstack-infra07:54
*** zz_dimtruck is now known as dimtruck08:00
*** markus_z has joined #openstack-infra08:02
*** davideagnello has joined #openstack-infra08:03
*** arxcruz has joined #openstack-infra08:05
* ttx yawns. Happy new year everyone08:07
*** isaacb has quit IRC08:08
*** davideagnello has quit IRC08:08
GheRiverottx: Happy new year!08:08
*** kevinbenton has quit IRC08:08
gsagieHappy new year ttx!08:08
gsagieand everyone else , and special thanks to everyone in the Infrastructure team making our lifes a lot simples :)08:09
gsagiesimpler08:09
*** hdd has quit IRC08:09
*** dimtruck is now known as zz_dimtruck08:10
*** masber has quit IRC08:11
openstackgerritThierry Carrez proposed openstack-infra/irc-meetings: Noop whitespace change to resync calendars  https://review.openstack.org/26316208:12
dmelladohappy new year everyone ;)08:12
*** zeih has joined #openstack-infra08:18
*** samuelBartel has joined #openstack-infra08:18
openstackgerritMerged openstack-infra/irc-meetings: Noop whitespace change to resync calendars  https://review.openstack.org/26316208:19
*** jordanP has joined #openstack-infra08:20
*** _nadya_ has quit IRC08:20
*** ildikov has quit IRC08:21
*** ildikov has joined #openstack-infra08:21
*** Qiming has quit IRC08:24
*** dingyichen has quit IRC08:24
*** bexelbie_ has joined #openstack-infra08:26
*** esikachev has joined #openstack-infra08:27
*** matrohon has joined #openstack-infra08:28
*** sam_wan has joined #openstack-infra08:28
*** flepied has joined #openstack-infra08:28
*** zeih has quit IRC08:28
*** xek_ is now known as xek08:29
*** bexelbie_ is now known as bexelbie08:29
*** ihrachys has joined #openstack-infra08:31
*** jed56 has joined #openstack-infra08:32
*** salv-orlando has quit IRC08:34
*** salv-orlando has joined #openstack-infra08:35
*** otter768 has joined #openstack-infra08:36
*** lezbar has joined #openstack-infra08:39
*** Hal has joined #openstack-infra08:39
*** masber has joined #openstack-infra08:39
*** Hal is now known as Guest6615708:40
*** markvoelker has joined #openstack-infra08:41
*** otter768 has quit IRC08:41
*** jlanoux has joined #openstack-infra08:42
*** lezbar has quit IRC08:43
*** shardy has joined #openstack-infra08:44
*** markvoelker has quit IRC08:45
*** aspiers has joined #openstack-infra08:46
*** pblaho has joined #openstack-infra08:48
*** peterlisak has joined #openstack-infra08:48
*** _nadya_ has joined #openstack-infra08:49
*** lezbar has joined #openstack-infra08:58
*** links has quit IRC09:00
*** oomichi has joined #openstack-infra09:00
*** fhubik has joined #openstack-infra09:00
*** fhubik is now known as fhubik_brb09:01
*** ihrachys_ has joined #openstack-infra09:02
*** links has joined #openstack-infra09:04
*** ihrachys has quit IRC09:04
*** davideagnello has joined #openstack-infra09:04
*** sshnaidm_ has joined #openstack-infra09:04
*** kzaitsev_mb has joined #openstack-infra09:04
*** egonzalez has joined #openstack-infra09:04
*** masber has quit IRC09:05
*** dcentral has quit IRC09:06
*** Eva-i has joined #openstack-infra09:07
*** sdake has joined #openstack-infra09:08
*** davideagnello has quit IRC09:08
*** jistr has joined #openstack-infra09:12
odyssey4memorning all, for some reason one of our job skipping rules is not taking effect any more, eg https://review.openstack.org/258196 should only run the 'gate-openstack-ansible-docs' job, but is instead running all jobs09:15
odyssey4meit should skip based on https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1994-L200009:16
*** sfinucan has joined #openstack-infra09:17
*** ihrachys_ has quit IRC09:17
*** ihrachys has joined #openstack-infra09:17
*** yaume has joined #openstack-infra09:18
*** ihrachys has quit IRC09:19
*** ihrachys has joined #openstack-infra09:20
openstackgerritMerged openstack-infra/system-config: Fix stackforge and github links  https://review.openstack.org/26286309:21
*** fhubik_brb is now known as fhubik09:21
*** jcoufal has joined #openstack-infra09:21
openstackgerritMerged openstack-infra/project-config: Add release-schedule-generator project  https://review.openstack.org/26113509:22
*** Qiming has joined #openstack-infra09:25
*** dcentral has joined #openstack-infra09:26
*** dcentral has quit IRC09:27
*** ihrachys has quit IRC09:30
*** ihrachys has joined #openstack-infra09:30
*** ihrachys has quit IRC09:30
openstackgerritMerged openstack-infra/project-config: Magnum: Add new job to do mesos functional testing  https://review.openstack.org/26189409:31
*** [1]Thelo has joined #openstack-infra09:32
openstackgerritMerged openstack-infra/project-config: New Project - ekko  https://review.openstack.org/26261409:33
*** ihrachys has joined #openstack-infra09:33
*** Thelo has quit IRC09:34
*** [1]Thelo is now known as Thelo09:34
openstackgerritMerged openstack-infra/project-config: Add feature/2.0.x branch reporting to #openstack-infra  https://review.openstack.org/26282909:34
*** esikachev has quit IRC09:37
*** ihrachys has quit IRC09:38
*** lxsli_festive is now known as lxsli09:39
openstackgerritMerged openstack-infra/infra-manual: add additional information about APIImpact  https://review.openstack.org/23372909:41
openstackgerritMerged openstack-infra/infra-manual: Moved Python project guide to Project Team Guide  https://review.openstack.org/24485109:41
*** ihrachys has joined #openstack-infra09:43
*** ihrachys has quit IRC09:43
openstackgerritRamana Raja proposed openstack-infra/project-config: Add Manila with CephFSNative driver CI job  https://review.openstack.org/25932309:46
*** zeih has joined #openstack-infra09:46
*** rguillebert has joined #openstack-infra09:47
*** pblaho has quit IRC09:48
*** pblaho has joined #openstack-infra09:49
*** goodygum has joined #openstack-infra09:50
openstackgerritMerged openstack-infra/infra-manual: Remove StackForge rename details Creator's Guide  https://review.openstack.org/25368709:51
*** HeOS has joined #openstack-infra09:54
*** vipuls has quit IRC09:55
*** SlickN1k has quit IRC09:55
*** spiffxp_ has quit IRC09:55
*** SlickN1k has joined #openstack-infra09:56
*** spiffxp_ has joined #openstack-infra09:57
*** vipuls has joined #openstack-infra09:58
*** cdent has joined #openstack-infra09:58
*** fhubik is now known as fhubik_brb09:58
*** zz_dimtruck is now known as dimtruck10:01
*** FallenPegasus has quit IRC10:02
*** BobBall-XMAS is now known as BobBall10:02
openstackgerritKen'ichi Ohmichi proposed openstack/requirements: WIP: Cap Babel for avoiding gate issue  https://review.openstack.org/26319110:02
*** openstackgerrit has quit IRC10:02
*** openstackgerrit has joined #openstack-infra10:02
*** Daisy_ has joined #openstack-infra10:03
*** coolsvap is now known as coolsvap|away10:04
*** davideagnello has joined #openstack-infra10:05
*** masber has joined #openstack-infra10:05
*** Daisy_ has quit IRC10:08
*** Liuqing has quit IRC10:08
*** zhurong has quit IRC10:10
*** dimtruck is now known as zz_dimtruck10:11
*** davideagnello has quit IRC10:11
*** luv has left #openstack-infra10:11
*** luv has joined #openstack-infra10:11
*** zeih has quit IRC10:12
*** acabot has joined #openstack-infra10:13
openstackgerritGal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate  https://review.openstack.org/26298110:13
*** HeOS has quit IRC10:15
*** zeih has joined #openstack-infra10:17
*** ihrachys has joined #openstack-infra10:18
*** kzaitsev_mb has quit IRC10:19
*** jistr has quit IRC10:24
*** pblaho has quit IRC10:24
*** ihrachys has quit IRC10:24
*** arxcruz has quit IRC10:24
*** fhubik_brb has quit IRC10:24
*** ihrachys_ has joined #openstack-infra10:24
*** SotK_ is now known as SotK10:28
*** jistr has joined #openstack-infra10:30
*** aopincar has joined #openstack-infra10:30
*** jistr has quit IRC10:30
*** samueldmq1 is now known as samueldmq10:34
*** otter768 has joined #openstack-infra10:37
*** kzaitsev_mb has joined #openstack-infra10:40
*** markvoelker has joined #openstack-infra10:42
*** otter768 has quit IRC10:42
*** ganso has joined #openstack-infra10:45
openstackgerritKen'ichi Ohmichi proposed openstack/requirements: WIP: Cap setuptools for avoiding gate issue  https://review.openstack.org/26319110:45
*** sam_wan has quit IRC10:45
*** markvoelker has quit IRC10:46
*** sam_wan has joined #openstack-infra10:48
*** fhubik_brb has joined #openstack-infra10:49
openstackgerritBeth Elwell proposed openstack-infra/project-config: New project for Ironic UI plugin  https://review.openstack.org/25484510:52
*** tzn has joined #openstack-infra10:54
openstackgerritThierry Carrez proposed openstack-infra/infra-manual: Update release management chapter  https://review.openstack.org/26061010:55
*** hashar has joined #openstack-infra10:59
*** arxcruz has joined #openstack-infra11:00
*** zeih has quit IRC11:03
openstackgerritKen'ichi Ohmichi proposed openstack/requirements: WIP: Cap setuptools for avoiding gate issue  https://review.openstack.org/26319111:05
*** e0ne has joined #openstack-infra11:06
*** ihrachys_ has quit IRC11:07
*** davideagnello has joined #openstack-infra11:07
*** ihrachys has joined #openstack-infra11:08
*** rfolco has joined #openstack-infra11:11
openstackgerritKen'ichi Ohmichi proposed openstack/requirements: Cap setuptools for avoiding gate issue  https://review.openstack.org/26319111:12
*** davideagnello has quit IRC11:12
*** markmcd has quit IRC11:14
*** zeih has joined #openstack-infra11:15
*** Liuqing has joined #openstack-infra11:15
*** kzaitsev_mb has quit IRC11:16
*** markmcd has joined #openstack-infra11:16
*** sdague has joined #openstack-infra11:21
*** zz_dimtruck is now known as dimtruck11:22
*** markmcd has quit IRC11:22
*** markmcd has joined #openstack-infra11:24
*** zeih has quit IRC11:24
openstackgerritGal Sagie proposed openstack-infra/project-config: Remove python3 checks from Dragonflow gate  https://review.openstack.org/26298111:29
*** daemontool has joined #openstack-infra11:29
*** shardy has quit IRC11:29
*** shardy has joined #openstack-infra11:30
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: Send instructions to workers to upload metadata  https://review.openstack.org/26321811:30
*** claudiub has joined #openstack-infra11:36
*** fhubik_brb is now known as fhubik11:40
*** dims has joined #openstack-infra11:40
*** dims has quit IRC11:40
*** dims has joined #openstack-infra11:41
*** pblaho has joined #openstack-infra11:41
*** jistr has joined #openstack-infra11:41
*** pblaho has quit IRC11:42
*** pblaho has joined #openstack-infra11:42
*** Guest66157 has quit IRC11:43
*** sam_wan has quit IRC11:45
*** kzaitsev_mb has joined #openstack-infra11:48
openstackgerritMerged openstack-infra/storyboard-webclient: Display the most recent commit SHA on the about page  https://review.openstack.org/25858311:48
*** cdent has quit IRC11:48
*** BobBall has quit IRC11:53
*** kzaitsev_mb has quit IRC11:53
*** erlon has joined #openstack-infra11:53
*** fhubik is now known as fhubik_brb11:57
*** GnomeKing has joined #openstack-infra11:57
*** fhubik_brb is now known as fhubik12:00
*** FallenPegasus has joined #openstack-infra12:02
*** chlong has joined #openstack-infra12:03
*** hashar has quit IRC12:03
*** sshnaidm_ has quit IRC12:04
*** kzaitsev_mb has joined #openstack-infra12:04
*** zhurong has joined #openstack-infra12:06
*** salv-orl_ has joined #openstack-infra12:06
*** salv-orl_ has quit IRC12:07
*** salv-orl_ has joined #openstack-infra12:07
*** FallenPegasus has quit IRC12:08
*** salv-orlando has quit IRC12:09
*** tzn has quit IRC12:10
*** markvoelker has joined #openstack-infra12:12
*** kzaitsev_mb has quit IRC12:12
kragnizhey, could someone add me as the initial member of release-schedule-generator-core and release-schedule-generator-release?12:15
*** kdas_ has joined #openstack-infra12:17
*** dimtruck is now known as zz_dimtruck12:17
*** markvoelker has quit IRC12:17
*** kushal has quit IRC12:19
*** zeih has joined #openstack-infra12:20
*** zz_dimtruck is now known as dimtruck12:21
*** kdas_ has quit IRC12:22
*** kushal has joined #openstack-infra12:22
*** masber has quit IRC12:24
*** gordc has joined #openstack-infra12:24
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Don't hide paging controls for xs window sizes  https://review.openstack.org/26323512:28
*** Liuqing has quit IRC12:29
*** doug-fish has joined #openstack-infra12:31
*** tzn has joined #openstack-infra12:32
*** links has quit IRC12:34
*** _nadya_ has quit IRC12:38
*** otter768 has joined #openstack-infra12:38
*** sdake has quit IRC12:39
*** sdake has joined #openstack-infra12:40
openstackgerritMerged openstack-infra/storyboard-webclient: Use a modal to add projects  https://review.openstack.org/25787212:41
*** Daisy has joined #openstack-infra12:42
*** otter768 has quit IRC12:43
*** rhallisey has joined #openstack-infra12:45
*** arxcruz has quit IRC12:46
*** zul has quit IRC12:47
*** zul has joined #openstack-infra12:47
openstackgerritRyan Hallisey proposed openstack/diskimage-builder: The mirror for installing epel is timing out  https://review.openstack.org/26205012:49
*** jistr has quit IRC12:50
*** pblaho has quit IRC12:50
*** thorst has joined #openstack-infra12:50
*** pblaho has joined #openstack-infra12:52
*** sdake_ has joined #openstack-infra12:53
*** sshnaidm_ has joined #openstack-infra12:54
*** markvoelker has joined #openstack-infra12:55
*** gongysh has joined #openstack-infra12:55
*** GnomeKing is now known as BobBall12:56
openstackgerritJoshua Hesketh proposed openstack-infra/project-config: (WIP) Upload metadata for pseudo folder  https://review.openstack.org/26324012:56
*** _nadya_ has joined #openstack-infra12:57
*** sdake has quit IRC12:57
*** Daisy has quit IRC12:58
*** jistr has joined #openstack-infra13:02
*** baoli has joined #openstack-infra13:05
*** dosaboy_ is now known as dosaboy13:05
*** mgrosz has joined #openstack-infra13:07
*** mwagner_lap has quit IRC13:07
*** larainema has quit IRC13:08
mgroszHello, I would like to add Vitrage documentation to the following web page: http://docs.openstack.org/developer/openstack-projects.html. Haw can it be done? What configuration do I need to add?13:08
*** kzaitsev_mb has joined #openstack-infra13:08
*** davideagnello has joined #openstack-infra13:09
fungimgrosz: vitrage needs to be maintained by an official openstack project team if it's going to publish to docs.openstack.org13:11
*** fhubik is now known as fhubik_brb13:11
fungithe docs team has, in the past, expressed concern over unofficial projects publishing documentation on that site13:12
*** davideagnello has quit IRC13:13
*** salv-orl_ has quit IRC13:13
*** fhubik_brb is now known as fhubik13:14
*** salv-orlando has joined #openstack-infra13:14
*** dprince has joined #openstack-infra13:18
*** dkranz has joined #openstack-infra13:19
*** edmondsw has joined #openstack-infra13:20
*** chlong has quit IRC13:20
*** otter768 has joined #openstack-infra13:20
zaroyolanda: ping13:26
mgroszfungi: thanks. What does it mean technically to "be maintained by an official openstack project team"? Only by that?13:26
*** pradk has joined #openstack-infra13:29
SamYapleodyssey4me: did you get an answer to your job skipping rules not effecting anymore?13:30
*** amuller has joined #openstack-infra13:31
*** amrith is now known as _amrith_13:31
*** jpr1 has quit IRC13:32
*** daemontool has quit IRC13:33
*** chlong has joined #openstack-infra13:33
*** daemontool has joined #openstack-infra13:33
*** daemontool has quit IRC13:33
*** aopincar has quit IRC13:33
*** ihrachys_ has joined #openstack-infra13:34
*** daemontool has joined #openstack-infra13:34
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Add reno jobs for ironic-python-agent  https://review.openstack.org/25873613:35
*** otter768 has quit IRC13:35
*** baoli_ has joined #openstack-infra13:36
*** larainema has joined #openstack-infra13:36
*** ihrachys has quit IRC13:36
*** fhubik is now known as fhubik_brb13:37
*** fhubik_brb is now known as fhubik13:38
*** baoli has quit IRC13:38
*** unicell1 has joined #openstack-infra13:38
*** moravec has joined #openstack-infra13:40
*** unicell has quit IRC13:41
*** kzaitsev_mb has quit IRC13:42
*** bcourt has joined #openstack-infra13:45
*** zhurong has quit IRC13:49
*** thiagop has joined #openstack-infra13:49
*** bcourt has quit IRC13:50
*** FallenPegasus has joined #openstack-infra13:51
*** zhurong has joined #openstack-infra13:52
openstackgerritMerged openstack-infra/release-tools: start sending release announcements to openstack-dev by default  https://review.openstack.org/26098913:52
*** Hal has joined #openstack-infra13:53
fungimgrosz: http://governance.openstack.org/reference/new-projects-requirements.html13:53
SamYaplecan someone add me to the ekko-core and ekko-release group? it is a new project I submitted that was recently merged. https://review.openstack.org/#/admin/groups/1236,members https://review.openstack.org/#/admin/groups/1237,members https://review.openstack.org/#/c/262614/13:53
pabelangerohai13:53
*** Hal is now known as Guest2197213:54
*** mwagner_lap has joined #openstack-infra13:55
*** links has joined #openstack-infra13:56
*** FallenPegasus has quit IRC13:56
*** irenab has quit IRC13:57
*** fawadkhaliq has joined #openstack-infra13:59
*** zhurong has quit IRC14:00
*** zhurong has joined #openstack-infra14:04
*** pblaho has quit IRC14:04
*** pblaho has joined #openstack-infra14:05
*** bcourt has joined #openstack-infra14:05
*** links has quit IRC14:07
*** bdemers has joined #openstack-infra14:07
*** otter768 has joined #openstack-infra14:08
*** otter768 has quit IRC14:08
*** davideagnello has joined #openstack-infra14:10
*** sdake has joined #openstack-infra14:11
*** bdemers has quit IRC14:11
*** sdake_ has quit IRC14:12
*** bdemers has joined #openstack-infra14:13
*** hashar has joined #openstack-infra14:14
*** Kennan has quit IRC14:14
*** davideagnello has quit IRC14:15
*** Kennan has joined #openstack-infra14:15
*** zhurong has quit IRC14:16
*** dimtruck is now known as zz_dimtruck14:18
openstackgerritMerged openstack-infra/storyboard-webclient: Tidy up project groups states  https://review.openstack.org/25304914:21
odyssey4meSamYaple nope, no response just yet - I've been waiting for everyone to come back online14:22
odyssey4meSamYaple do you have some jobs working differently too?14:22
*** julim has joined #openstack-infra14:23
anteayaodyssey4me: do a git blame of the skipping rules for zuul/layout.yaml in project-config14:23
*** jswarren has joined #openstack-infra14:23
*** ayoung has joined #openstack-infra14:23
odyssey4meanteaya the skip rule that's not happening hasn't changed, but something else has changed that clearly affects it14:23
anteayaodyssey4me: it is possible that the skipping rules you depend on have been overwritten by a change occuring after yours14:23
anteayaright, if a new rule was added later in the file that affects the regex it could over write the rule you are expecting to work14:24
*** weshay_xchat has joined #openstack-infra14:24
anteayayou can do a git blame yourself or wait for me, but I just came online and am getting oriented so I don't have a time line for when I can get to it14:24
SamYapleodyssey4me: yea a similiar thing to what anteaya said tripped my up with the gate names for multinode14:25
gsagieanyone from project-config that can review this patch: https://review.openstack.org/#/c/262981/   it will be much appreciated, currently blocks us from working on unit tests :)14:25
*** peristeri has joined #openstack-infra14:26
anteayaThelo: you have to define your jenkins jobs yourself, we have no way of knowing what jobs you want to run on your system14:26
zarofungi: was wondering if you could provide an opinion for this? https://review.openstack.org/#/c/260284/14:27
odyssey4meoh yes, in other news the ubuntu-trusty node types seem to have forgotten to resize2fs - they have an 80GB partition, but only 16GB file system14:29
odyssey4mebtw thanks anteaya :) and happy new year to everyone :)14:29
*** jpeeler has joined #openstack-infra14:29
*** jpeeler has quit IRC14:29
*** jpeeler has joined #openstack-infra14:29
anteayaodyssey4me: welcome, happy new year to you as well14:30
SamYaplehappy new year to you as well odyssey4me14:30
SamYapleah beat me to it anteaya14:30
*** jistr has quit IRC14:30
anteayaodyssey4me: can you link to some details on your assertion about the failure to resize?14:30
anteayaodyssey4me: a build log perhaps14:31
anteayafungi: safe travels today14:31
*** jistr has joined #openstack-infra14:31
anteayaand one for the channel, I'm out doing errands following the third-party meeting. My driving service is back from holidays and I have to buy groceries, been out of milk for 4 days. :(14:32
SamYapleanteaya: do you have the ability to members to groups? im not sure who can do that. I have a new project and it has no users to merge code :)14:32
odyssey4meanteaya sure thing: see the disk device size at http://logs.openstack.org/47/252247/7/check/gate-openstack-ansible-commit-nv/02869f3/console.html#_2016-01-04_11_30_28_527 and the file system http://logs.openstack.org/47/252247/7/check/gate-openstack-ansible-commit-nv/02869f3/console.html#_2016-01-04_11_30_28_52314:33
anteayaSamYaple: I do not have the ability to add members to groups. infra-root has gerrit admin permissions, which is what is required to add members to groups14:35
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Allow puppet to set Gerrit sshd options to control connections  https://review.openstack.org/26282014:35
SotKI want to set up the email plugin in storyboard.openstack.org, is there an smtp server somewhere I can configure it to use?14:35
mordredmorning all14:36
anteayaSamYaple: https://review.openstack.org/#/admin/groups/306,members14:36
anteayamordred: morning14:36
mordredSotK: we run email servers on each server as needed14:36
mordredSotK: so 'localhost' will be your best bet14:36
SamYapleanteaya: awesome! monty is on that list ;)14:36
anteayaodyssey4me: thank you, I or someone else will look when we get a chance14:36
mordredanteaya, SamYaple what do I nede to do?14:36
anteayaSamYaple: indeed14:36
pabelangerany diskimage-builder-core care to review: https://review.openstack.org/#/c/262050  Fixes centos7 DIBs because of a changed mirror14:36
SamYaplemordred: 13:54:05 < SamYaple> can someone add me to the ekko-core and ekko-release group? it is a new project I submitted that was recently merged. https://review.openstack.org/#/admin/groups/1236,members https://review.openstack.org/#/admin/groups/1237,members https://review.openstack.org/#/c/262614/14:37
mordredSamYaple: searching for "sam yaple" in gerrit does not find you - who are you?14:38
*** erikwilson has joined #openstack-infra14:38
mordred(in gerrit)14:38
*** erikwilson has quit IRC14:38
SamYaplesamyaple14:38
*** mriedem has joined #openstack-infra14:38
*** kzaitsev_mb has joined #openstack-infra14:38
SamYapleor if caps matter, i think im SamYaple14:38
*** erikwilson has joined #openstack-infra14:38
SotKmordred: Thanks. Is there something I need to add to the puppet manifest to enable that?14:38
*** zeih has quit IRC14:39
mordredwow. they do matter14:39
mordredSamYaple: done14:39
kragnizmordred: while you're on the gerrit groups, could you add me as the initial member of release-schedule-generator-core and release-schedule-generator-release?14:39
mordredSotK: one sec - looking14:39
SamYaplemordred: thanks! and thankns for that link anteaya, i was unware of how that worked14:39
mordredSotK: make sure     manage_exim               => true,14:40
fungiodyssey4me: probably the resize on boot needs to get fired properly in glean? mordred may have more details on what's missing14:40
*** jlvacation is now known as jlvillal14:40
SotKmordred: Will do, thanks.14:40
*** _nadya_ has quit IRC14:40
mordredSotK: is in your openstack_project::template invocation14:41
*** eharney has joined #openstack-infra14:41
zaromordred:  you might be interested in this, was wondering if you would like to add your opinion? https://review.openstack.org/#/c/260284/14:41
mordredfungi: it used to resize on boot14:41
greghaynesopenstackgerrit: mordred fungi There is an element in DIB which resizes rootfs, we might not be using it14:41
greghaynesoh, actually, I fixed a bug with it14:41
greghaynesone sed14:41
fungizaro: i agree with jhesketh that a thread on the -dev ml makes the most sense for coming up with some idea of whether our development community is on the whole in favor, against or indifferent to 26028414:42
anteayaSamYaple: welcome14:42
odyssey4megreghaynes fungi mordred yep, it worked before the holidays :p14:42
fungiSotK: the storyboard server's smtp service should work just fine? a.k.a. 127.0.0.1:25 or ::2514:42
*** zeih has joined #openstack-infra14:43
greghaynesodyssey4me: mordred fungi https://review.openstack.org/#/c/259748/14:43
greghaynesDIB might need a release14:43
fungithanks for tracking that down, greghaynes!14:43
greghayneswhich I was planning on doing today anyways14:43
greghaynesfungi: np14:43
fungiand now i need to check out of this hotel and disappear for most of the day14:44
fungicatch you all tonight/tomorrow14:44
*** irenab has joined #openstack-infra14:44
*** fhubik is now known as fhubik_brb14:44
fungikeep in mind that paste.o.o is using trove again now, so if it becomes completely unusable for some unforseen reason, that might be why14:44
fungibut so far it's looking stable14:44
pabelangerfungi: mind helping: https://review.openstack.org/#/c/250315/7 land for zuul?14:44
anteayafungi: enjoy your day14:45
mordredfungi: oh wow. I missed something completely14:45
anteayayay stable paste14:45
mordredfungi: did we stop using trove for it for a sec?14:45
pabelangerfungi: nevermind :)14:45
fungipabelanger: maybe tomorrow?14:45
anteayayes the trove instance was disconnecting for some reason about 6 months ago?14:45
pabelangerfungi: will find another soul! Enjoy your travels14:45
anteayacan recall the reason or the fix14:46
fungimordred: yeah, for something like a year. that was back before we discovered that rackspace set the connection timeout way short but that we could adjust it in configuration14:46
anteayacan't14:46
anteayaah yes, that was why14:46
mordrednod14:46
greghaynesodyssey4me: Is that actively breaking things? once I cut a DIB release we are going to need to wait until new images go out (24h) before we find out if it actually is the issue...14:46
fungiso we fixed it on review-dev but never got around to moving paste back to trove14:46
fungiuntil last night14:46
pabelangerodyssey4me: keep in mind, there was some changes to the ansible templates in zuul. So, this might be a side affect14:46
fungianyway, /me -> out14:47
pabelangerodyssey4me: mind you, I haven't dived into this issue14:47
*** nelsnelson has joined #openstack-infra14:47
zarofungi: thanks14:47
odyssey4megreghaynes it's a non voting gate check for us, so not crucial - just a canary :)14:47
*** _nadya_ has joined #openstack-infra14:47
*** zeih has quit IRC14:47
greghaynesodyssey4me: ok, awesome14:47
openstackgerritAlexandre Viau proposed openstack-dev/pbr: dont include submodules in _find_git_files  https://review.openstack.org/26329714:53
*** asselin_ has joined #openstack-infra14:54
*** mtanino has joined #openstack-infra14:55
*** ihrachys_ is now known as ihrachys14:55
*** sdake_ has joined #openstack-infra14:55
openstackgerritAlexandre Viau proposed openstack-dev/pbr: dont include submodules in _find_git_files  https://review.openstack.org/26329714:57
*** sdake has quit IRC14:58
*** sdake has joined #openstack-infra15:00
*** rbrndt_ has joined #openstack-infra15:00
*** sigmavirus24_awa is now known as sigmavirus2415:01
*** kgiusti has joined #openstack-infra15:02
*** sdake_ has quit IRC15:03
*** jsavak has joined #openstack-infra15:05
*** amitgandhinz has joined #openstack-infra15:07
*** jaosorior has joined #openstack-infra15:07
*** jaosorior has quit IRC15:08
*** zeih has joined #openstack-infra15:10
*** Daisy has joined #openstack-infra15:10
*** davideagnello has joined #openstack-infra15:10
openstackgerritAlexandre Viau proposed openstack-dev/pbr: include submodules in _find_git_files  https://review.openstack.org/26329715:11
*** kzaitsev_mb has quit IRC15:12
*** zz_dimtruck is now known as dimtruck15:12
*** regXboi has joined #openstack-infra15:12
kragnizanyone in infra-core around to add me to a newly created group?15:13
anteayakragniz: best to drag your url that created the group or repo with you when you ask15:13
anteayaincreases your rate of return on your asking15:13
*** tsg has joined #openstack-infra15:13
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Bump APScheduler to >=3.0  https://review.openstack.org/26201715:13
kragnizanteaya: thanks15:14
anteayakragniz: welcome15:14
kragnizhere's the review: https://review.openstack.org/#/c/261135/15:14
*** zeih has quit IRC15:14
*** fhubik_brb is now known as fhubik15:15
*** Daisy has quit IRC15:15
*** fhubik is now known as fhubik_brb15:15
*** davideagnello has quit IRC15:15
openstackgerritAlexandre Viau proposed openstack-dev/pbr: include submodules in _find_git_files  https://review.openstack.org/26329715:16
*** aorourke has joined #openstack-infra15:17
*** thiagop is now known as thiagop-lunch15:17
*** fhubik_brb is now known as fhubik15:18
*** qadaemon has quit IRC15:18
*** pradk_ has joined #openstack-infra15:19
*** pradk_ has quit IRC15:19
*** pradk has quit IRC15:19
anteayaodyssey4me: did you get anywhere on your skip if regex?15:20
*** markvan has quit IRC15:20
*** masber has joined #openstack-infra15:20
odyssey4meanteaya nope, it seems plausible that one of my consequent checks may have broken things... but I need a better educated mind to validate that suspicion15:21
*** pradk has joined #openstack-infra15:22
*** markvan has joined #openstack-infra15:22
*** AJaeger has joined #openstack-infra15:22
*** sdake_ has joined #openstack-infra15:22
AJaegerHappy New Year, everybody!15:22
anteayawhich consequent checks?15:22
odyssey4mes/consequent checks/subsequent jobs/15:22
anteayaAJaeger: Happy New Year15:23
odyssey4meHNY AJaeger !15:23
anteayaodyssey4me: can you link me or name them?15:23
*** ajmiller has joined #openstack-infra15:23
odyssey4meanteaya https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L2007 was added in Nov, and it seems that the break may have happened at around that time15:23
*** davideagnello has joined #openstack-infra15:24
pabelangerAJaeger: o/15:24
AJaegerodyssey4me: can you give me an example run where this did not work?15:24
*** sdake has quit IRC15:25
SamYapleodyssey4me: it seems like between those two regex you could have no jobs and im not sure how that owuld be handled15:25
anteayaodyssey4me: is http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n2006 your only skip-if clause?15:26
SamYapleodyssey4me: for instance if you updated only https://github.com/openstack/openstack-ansible/blob/master/releasenotes/source/unreleased.rst15:26
*** piet has joined #openstack-infra15:26
anteayaSamYaple: if the skip-ifs manage to remove all jobs from a patch, the patch won't be tested and can't merge15:26
*** weshay_xchat has quit IRC15:26
AJaegerodyssey4me: here's what zuul has in its config: http://paste.openstack.org/show/482946/15:27
anteayaSamYaple: we managed to learn this when skipping some project-config jobs15:27
odyssey4meAJaeger https://review.openstack.org/262370 :)15:27
SamYaplehah ok anteaya15:27
AJaegerodyssey4me: that's a change that only changes documentation - how does that related to releasnotes?15:27
anteayaSamYaple: learn by doing :)15:27
*** erikmwilson_ has joined #openstack-infra15:28
AJaegerodyssey4me: so L2007 should not trigger at all.15:28
anteayaAJaeger: where did you find what zuul has in its config?15:28
odyssey4meAJaeger that job is not skipping all jobs except the docs job, and it started failing after adding the release notes skip15:28
AJaegeranteaya: click on the layout check link for any recent job15:28
odyssey4meSamYaple you have found a nice little problem there :) to date that has not been an issue though as that file is static... but I'll remember that in the future15:29
AJaegerodyssey4me: I think I get what you mean...15:29
*** fhubik is now known as fhubik_brb15:29
*** erikwilson has quit IRC15:29
AJaegerodyssey4me: you mean lines 1998 is ignored?15:29
anteayaAJaeger: thanks15:29
odyssey4meAJaeger yep15:30
*** fhubik_brb is now known as fhubik15:30
odyssey4meinstead of only running the docs job, it's running all jobs15:30
AJaegerodyssey4me: full spec: http://paste.openstack.org/show/482947/15:30
*** mdenny has joined #openstack-infra15:30
AJaegerSo, what happens is that oyu have two regexes that apply and the last is taken, let's look at gate-openstack-ansible-lint15:30
AJaegeronly the releasenotes regex is used for that.15:31
odyssey4meah, I see15:31
AJaegerodyssey4me: so, you need to rewrite those15:31
AJaegerand theny click on the layout link and check how the conditions are applied, see my paste...15:32
*** egonzalez has quit IRC15:32
*** _nadya_ has quit IRC15:32
AJaegerodyssey4me: hope that gets you going15:32
anteayaAJaeger: thanks for walking me through that15:32
* AJaeger has to play with the kids for a bit...15:32
odyssey4meso we need a match that only ever gets a single result15:32
anteayastared at that many times, now it makes sense15:32
anteayaAJaeger: enjoy15:32
AJaegerthanks, anteaya15:33
anteayaodyssey4me: or gets results you want for that file15:33
openstackgerritAdam Coldrick proposed openstack-infra/puppet-storyboard: Add config template for the email plugin  https://review.openstack.org/26330415:33
*** odlD2 has quit IRC15:33
SamYapleso to be clear if a job matches two of the name regex, the job gets the last match AJaeger?15:33
AJaegerSamYaple: yes15:34
SamYapleok ill have t oremember that15:34
openstackgerritGiulio Fidente proposed openstack-infra/tripleo-ci: TEST: this is supposed to trigger a major upgrade  https://review.openstack.org/26046615:34
AJaegerAlways check the layout link and see what it does;)15:34
openstackgerritPaul Belanger proposed openstack-infra/nodepool: Uncap pyzmq requirements  https://review.openstack.org/26201915:34
anteayaodyssey4me: as an example: http://logs.openstack.org/81/262981/4/check/gate-project-config-layout/812636e/console.html#_2016-01-04_11_42_53_12215:35
SamYapleso odyssey4me i guess you wont run into that bug i just said you might15:35
anteayaI have to get ready to go run errands, as I said earlier I'm out of milk in the house, not sure when I will be back15:36
*** mgrosz has quit IRC15:36
*** fhubik is now known as fhubik_brb15:37
*** sdake has joined #openstack-infra15:38
odyssey4meoh dear, my brain just exploded :p15:38
*** jpr has joined #openstack-infra15:38
*** _amrith_ is now known as amrith15:38
*** sdake_ has quit IRC15:39
*** fhubik_brb is now known as fhubik15:40
*** weshay_xchat has joined #openstack-infra15:40
*** FallenPegasus has joined #openstack-infra15:40
*** tonytan4ever has joined #openstack-infra15:41
asselin_does anyone know how gerrit is configured to disable e-mails for 3rd party ci? https://review.openstack.org/#/admin/groups/270,info15:41
SamYapleodyssey4me: you could just do   - name: ^gate-openstack-ansible-(?!(releasenotes|docs)).*$15:43
SamYapleon the release jobs15:43
anteayaasselin_: zaro likely does15:44
*** Sukhdev has joined #openstack-infra15:44
*** FallenPegasus has quit IRC15:45
*** doug-fish has quit IRC15:45
*** aspiers has quit IRC15:45
*** qadaemon has joined #openstack-infra15:46
odyssey4meSamYaple so the goal is to only have the docs job run when only docs are edited, but only release notes run when release notes are edited15:46
SamYapleodyssey4me: i meant keep the docs just, just modify that line above ^15:46
*** mtreinish has quit IRC15:46
SamYaplethat gets you what you want, mostly. cept the docs just would still run...15:47
*** odlD2 has joined #openstack-infra15:47
*** kashyap has joined #openstack-infra15:47
SamYaplei say you redefine the goal to include wanting the docs job to run with the release notes15:47
*** mtreinish has joined #openstack-infra15:48
odyssey4meyeah, I get what you mean - I could simply consolidate the two skips and whether docs or release notes are edited, both jobs run15:48
odyssey4methat would also solve the issue you raised15:48
anteayaasselin_: this is the only thing I found so far: https://review.openstack.org/Documentation/access-control.html#capability_emailReviewers15:48
odyssey4mebut it is a little bit of a waste of nodes, and I was trying to be nice to -infra :)15:49
anteayaodyssey4me: we appreciciate it15:49
anteayabut get your jobs testing what you want to be tested first15:49
SamYaplethat works too. just updating the second job would mean that you are only ever wasting one machine when you do a releasenotes (and thats assuming the docs job isnt useful to the release notes)15:49
asselin_anteaya, thanks will look into that15:49
SamYapleas oppose to combining them and wasting releasenotes everytime you update docs15:50
*** annegentle has joined #openstack-infra15:50
anteayaasselin_: didn't really evaluate to see if it was useful to you, it may not be15:50
SamYaplethough i dont know how frequent you do either of those15:50
anteayahave to run now, see y'all later15:50
*** ari has joined #openstack-infra15:50
odyssey4meSamYaple sure, but I think if the releasenotes/*.rst files are updated then the releasenotes wouldn't build15:50
SamYapleno no we already rules that out15:51
odyssey4meso I think it's best to combine them - it covers all scenario's... even if it is a little more wasteful15:51
SamYaplesince it would be overriden with the release notes task15:51
SamYapleit will run15:51
*** doug-fish has joined #openstack-infra15:51
odyssey4meah yes, of course15:51
*** erikmwilson_ has quit IRC15:53
odyssey4meSamYaple I wonder if the mat can include a negative match - because I could also deliberately exclude ^releasenotes/.* from the docs skip to be more explicit15:54
SamYaplei mean odyssey4me docs is only going to run if you modify the release notes rst (or other matches)15:56
*** doug-fish has quit IRC15:56
SamYapleso you could just do a !releasenotes on the docs job15:56
AJaegerodyssey4me: I'll have an idea, need to check this, should have a patch for you later today... But let's work indpedent on this and see what works better ;)15:56
odyssey4mewhat's getting me is where the clash is actually happening... is it due to the match on the project name?15:57
SamYapleodyssey4me: my understanding is yes15:57
*** tsg has quit IRC15:57
*** tsg_ has joined #openstack-infra15:57
odyssey4meanother option here is that the project match can be removed, as the gate name is enough... and this would also mean that the skip would probably work for other roles too15:57
SamYapleodyssey4me: that _should_ get you what you want http://paste.openstack.org/show/482952/15:58
*** rbrndt_ has quit IRC15:58
SamYaplenot sure that change on the docs job is a valid regex though. but you get the idea15:58
*** corvus is now known as jeblair15:58
odyssey4meAJaeger thanks :) I'll put in a patch shortly, but am curious about your other idea15:59
odyssey4meultimately I'd even like us to skip the releasenotes/docs jobs if there are no docs/releasenotes changes in the patch15:59
odyssey4mebut yeah, perhaps I'm just making my own life too complicated15:59
AJaegerlet's optimize the common case...16:00
odyssey4mein fact, wouldn't it make sense to do that across the board - only run the docs/release notes jobs when there are pertinent changes in the repo at hand?16:01
AJaegerodyssey4me: we do that already16:02
AJaegerfor releasenotes...16:02
*** jsavak has quit IRC16:02
*** qadaemon has quit IRC16:02
openstackgerritGraham Hayes proposed openstack/requirements: Add kosmos to projects.txt  https://review.openstack.org/26331816:02
odyssey4meAJaeger ah yes, we're troublesome due to our not using the stable/* branch names :)16:02
AJaegersee line 206916:03
*** harlowja_at_home has joined #openstack-infra16:04
*** jsavak has joined #openstack-infra16:04
odyssey4meAJaeger ah yes, I remember that - so does that not make http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n2007 redundant then?16:05
AJaegerodyssey4me: I need a bit of time to understand this mess ;)16:05
AJaegeron it now...16:05
*** devananda has quit IRC16:07
odyssey4meAJaeger if we can optimise the use of the docs job in a better way, or all project can in a similar way to the release notes, then I'm totally open to the change :)16:07
AJaegerodyssey4me: we cannot, since projects might document python code via autodocs...16:08
*** bastelfreak is now known as foxxx016:08
odyssey4meAJaeger ah, good call16:08
*** gongysh has quit IRC16:08
*** kzaitsev_mb has joined #openstack-infra16:08
*** bhunter71 has joined #openstack-infra16:09
odyssey4meAJaeger thanks for looking into this, my brain appears to be as badly addled as my liver :p16:09
*** hdd has joined #openstack-infra16:09
*** otter768 has joined #openstack-infra16:09
*** foxxx0 is now known as bastelfreak16:09
*** austin81 has joined #openstack-infra16:10
*** kmartin has joined #openstack-infra16:13
*** kzaitsev_mb has quit IRC16:13
*** otter768 has quit IRC16:13
*** ningy has joined #openstack-infra16:14
*** devananda has joined #openstack-infra16:15
ningy@here could someone help me to take a look at this patch https://review.openstack.org/#/c/262381 ? it's blocking rally monasca test jenkins job16:15
pedroalvarezIt looks like zuul post queue is not moving16:17
AJaegerningy: that's a change for requirements - please state so and ping the requirements cores16:17
AJaegerpedroalvarez: post queue has lower priority16:17
pedroalvarezaha, good to know :)16:18
rajinirIs there an easy way to search the IRC logs?16:18
clarkbrajinir I use google16:18
*** odlD2 has quit IRC16:19
mordredrajinir: site:eavesdrop.openstack.org ^^ that16:19
ningyk. thanks16:19
rajinirsite search, that's great. Many thanks mordred and clarkb16:20
*** erikwilson has joined #openstack-infra16:21
*** treaki_ has joined #openstack-infra16:23
ningy@Ajaeger, is there a channel for requirements? and do u know who are the requirements cores?16:24
*** fhubik is now known as fhubik_brb16:25
AJaegerningy: there's no channel - and you can check yourself, go to your review, click on project-settings icon right to the project line, click on Access and then on the core group16:25
*** fhubik_brb is now known as fhubik16:27
*** harlowja_at_home has quit IRC16:29
AJaegerodyssey4me: and then you even have  ^gate-openstack-ansible.*-pep8$ ;( What fun...16:29
*** odlD2 has joined #openstack-infra16:30
*** erikwilson has quit IRC16:31
openstackgerritSwann Croiset proposed openstack-infra/project-config: Set DocImpact group for LMA projects  https://review.openstack.org/26333416:32
*** thiagop-lunch is now known as thiagop16:32
odyssey4meAJaeger yeah, unfortunately we still have a (barely) active juno branch16:33
*** fhubik has quit IRC16:34
*** jsavak has quit IRC16:34
*** jsavak has joined #openstack-infra16:35
openstackgerritVladyslav Drok proposed openstack-infra/project-config: Add python-ironicclient to PROJECTS  https://review.openstack.org/26333516:36
pleia2good morning16:37
AJaegerhappy new year and good morning, pleia216:38
pleia2AJaeger: thanks! happy new year to you too :)16:39
AJaegerthanks, pleia216:39
*** lindsayk has quit IRC16:39
*** ashleighfarnham has joined #openstack-infra16:39
*** lindsayk has joined #openstack-infra16:40
*** FallenPegasus has joined #openstack-infra16:41
*** hdd has quit IRC16:44
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add an "Unlimited" option to the paging controls  https://review.openstack.org/23599316:45
*** jsavak has quit IRC16:45
*** jsavak has joined #openstack-infra16:46
*** FallenPegasus has quit IRC16:46
*** ifarkas has quit IRC16:47
openstackgerritSwann Croiset proposed openstack-infra/project-config: Set DocImpact group for LMA projects  https://review.openstack.org/26333416:47
*** unicell1 has quit IRC16:47
*** unicell has joined #openstack-infra16:47
*** Qiming has quit IRC16:48
clarkbelasticsearch died on es06 sometime after december 31st. VM has been up 55 days and no OOM killer or ext4 timeouts are logged16:48
clarkbso not sure why it died16:48
*** e0ne has quit IRC16:48
*** sridhar_ram has joined #openstack-infra16:49
clarkbI have started it back up again16:49
clarkband logstash-worker20 tripped the OOMkiller again so its definitely a lot more memory hungry than the old version of logstash :(16:49
*** AJaeger has quit IRC16:50
pleia2:\16:50
greghaynesodyssey4me: Just release new DIB16:50
greghaynesso tomorrow images should be resizing16:51
*** hashar has quit IRC16:51
*** jsavak has quit IRC16:51
*** flepied has quit IRC16:52
*** unicell has quit IRC16:52
*** flepied has joined #openstack-infra16:52
*** rfolco_ has joined #openstack-infra16:53
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Skip openstack-ansible-docs gate/post jobs for juno branch  https://review.openstack.org/26334116:53
odyssey4megreghaynes thanks - will recheck some jobs late tomorrow to confirm16:53
*** rfolco has quit IRC16:54
*** piet has quit IRC16:56
*** rbrndt_ has joined #openstack-infra16:58
*** ihrachys has quit IRC16:59
*** sputnik13_ has joined #openstack-infra16:59
*** sputnik13_ has quit IRC16:59
*** jsavak has joined #openstack-infra16:59
*** nihilifer has quit IRC17:00
clarkbmordred: can we bump the bluebox max node count up for testing again or is it stillgetting cpus replaced?17:00
*** kashyap has left #openstack-infra17:01
mordredclarkb: yes!17:01
mordredclarkb: the cpus have been replaced17:01
mordredclarkb: it is now a great time to bump it again17:01
mordredunless we want to do any testing to see if we should change the flavor definition17:01
mordredbut I suppose just bumping it and then looking at the run times will be a good start17:01
clarkbya thats probably the easiest way to do it17:02
mtreinishclarkb, mordred: have you seen the group_by node provider on: http://status.openstack.org/openstack-health/#/17:04
*** jlanoux has quit IRC17:04
mtreinishI still need to add a run time graph to the second page, so we can see per node_provider run times though17:04
clarkbmtreinish: I haven't17:04
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder  https://review.openstack.org/26334917:04
*** nihilifer has joined #openstack-infra17:04
*** sfinucan has quit IRC17:05
openstackgerritClark Boylan proposed openstack-infra/project-config: Revert "Turn bluebox servers off in nodepool."  https://review.openstack.org/26335017:05
mtreinishclarkb: its a good visualization of how much more things are failing on ovh and bluebox17:05
clarkbmordred: anteaya ^ that change sets us back to using a single test node for now17:05
clarkbwell shouldn;t be failing at all on bluebox because no test nodes17:05
*** piet has joined #openstack-infra17:06
mtreinishclarkb: it goes back like 20 days17:06
clarkbah17:06
*** matrohon has quit IRC17:06
clarkband the lack of swap should account for some of the failures on ovh17:06
*** tlian has joined #openstack-infra17:07
*** armax has joined #openstack-infra17:07
mtreinishwasn't that an issue on only one class of job where things were more ram starved?17:07
clarkbmtreinish: that we know of, I wouldn't be surprised if we are memory starved elsewhere since we apparently lean on swap way more than we should17:08
mtreinish:/ hmm, ok. I wouldn't be too surprised by that I guess. We've had issues in the past with ram consumption17:09
*** kzaitsev_mb has joined #openstack-infra17:09
openstackgerritRamy Asselin proposed openstack-infra/puppet-openstackci: Initial sphynx doc setup for publishing  https://review.openstack.org/25924517:09
*** markus_z has quit IRC17:09
*** kzaitsev_mb has quit IRC17:14
*** gyee has joined #openstack-infra17:14
openstackgerritAri proposed openstack-infra/jenkins-job-builder: Updated to support changes to openshift pipeline plugin  https://review.openstack.org/26335417:16
clarkbcrinkle: did we ever send an email about wiki downtime?17:16
jeblairmtreinish, clarkb: it's worth noting that since we have not completed the transition to dib, some providers don't run all types of jobs17:16
* clarkb wonders if he is on the clock this morning for that17:16
*** tjones has joined #openstack-infra17:17
clarkbjeblair: yup, though I think generally the health dashboard is still only looking at the jobs that can and do run on dib/snapshots17:17
jeblairkk17:17
*** nihilifer has quit IRC17:17
*** samuelBartel has quit IRC17:18
*** nihilifer has joined #openstack-infra17:18
*** Swami has joined #openstack-infra17:18
mtreinishit's still only tempest and grenade jobs17:18
mtreinishwe can expand it to everything pretty easily though17:19
*** sabeen has joined #openstack-infra17:22
*** sdake_ has joined #openstack-infra17:23
*** jistr has quit IRC17:23
zaromorning17:23
*** abregman has quit IRC17:24
crinkleclarkb: no, i can write that up and send it out today17:24
*** sdake has quit IRC17:25
crinkleclarkb: i wasn't sure if paste was going down at the same time or not17:25
clarkbcrinkle: oh right. Do you still want to do it today? I have to pop out at 1pmish assuming ice goes away17:25
clarkbmtreinish: https://jenkins05.openstack.org/job/gate-neutron-dsvm-api/2542/consoleFull is random ovh fail I noticed in gate just now. But I have a hard time understanding how that could be an ovh problem or memory problem. So thats an odd one17:25
openstackgerritPhilip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work  https://review.openstack.org/23981017:25
*** annegentle has quit IRC17:26
*** bharathm has joined #openstack-infra17:26
*** annegentle has joined #openstack-infra17:27
*** piet has quit IRC17:27
*** kzaitsev_mb has joined #openstack-infra17:27
*** piet has joined #openstack-infra17:27
*** sabeen3 has joined #openstack-infra17:27
crinkleclarkb: oops i thought we were doing it tomorrow even though i wrote down today17:27
mtreinishclarkb: actually I know what caused that17:28
crinkleclarkb: let's do tomorrow after the meeting?17:28
clarkbcrinkle: tomorrow should be fine too17:28
mtreinishclarkb: https://github.com/openstack-dev/devstack/commit/0d81785bbe1228e477e395595d37bef9775f1cab17:28
clarkbcrinkle: +117:28
clarkbmtreinish: so is that going to fail neutron across the board?17:29
mtreinishyep17:29
*** sabeen has quit IRC17:29
mtreinishthose neutron api jobs were using a deprecated option, which is on the block for removal soon17:29
mtreinishwe preemptively stopped configuring them in devstack17:29
*** yaume has quit IRC17:30
clarkbarmax: amuller mestery ^ FYI the neutron dsvm api test is probably going to fail a lot until that is addressed17:31
* amuller looking17:31
*** cinerama` is now known as cinerama17:31
pabelangerjeblair: clarkb: do you mind helping land: https://review.openstack.org/#/c/250315/7 for zuul?17:31
*** dtantsur is now known as dtantsur|afk17:32
clarkbthats an interesting design choice17:33
clarkbpabelanger: has a bug been filed upstream?17:34
amullerclarkb: thanks for letting us know17:34
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Merge openstack-ansible skip-if to resolve conflict  https://review.openstack.org/26336017:34
timrcyolanda: *bats eyelashes* https://review.openstack.org/#/c/252094/17:34
hrubiHi, I've reached point in zuul https://review.openstack.org/247500 where the job gate-zuul-python27 complains that the testrepository output is bigger than 50MB. How should I proceed? Revise (new) tests if they can be merged together, so they take less time during setup and produce less output? Or trying to cut down the overall output of all tests, eg. by lowering the log level?17:35
clarkbhrubi: I would decrease the log level17:35
hrubiok, thanks17:35
clarkbhrubi: that much verbosity isn't helpful during nomal test runs17:35
clarkbyou can always increase it o nspecific runs if you have trouble with a particular test17:36
hrubiright17:36
pabelangerclarkb: IIRC, no. I guess they should have done a 3.x.x release or default to false not to break existing installs17:36
clarkbpabelanger: or not use a thing that requires root privs17:36
clarkbimo thats a bug in the lib17:36
pabelangerYa, guess it all comes down to how you launch the application.17:37
clarkb(daemons don't need root)17:37
pabelangeragreed17:37
*** AJaeger has joined #openstack-infra17:37
clarkb+2'd but not approving to give jeblair a chance to look17:39
clarkb(can approve later if that doesn't ahppen)17:39
*** jordanP has quit IRC17:39
*** aopincar has joined #openstack-infra17:39
pabelangerclarkb: thanks. Also note, we'd used the code a few times already for nodepool and elasticsearch (I think?)17:40
*** jsavak has quit IRC17:41
*** masuberu has joined #openstack-infra17:43
jeblairapproved, though it's on a bit of a stack17:44
asselin_clarkb, how did you setup permissions for this: https://review.openstack.org/#/admin/groups/270,info ? I couldn't find it in project-config17:44
AJaegerodyssey4me: your change 263360 is probably the best option - I came up with the same. Restricting docs jobs as well is not worth it...17:44
clarkbasselin_: its in all-projects17:45
*** masber has quit IRC17:45
openstackgerritJan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks  https://review.openstack.org/16311717:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent  https://review.openstack.org/23894817:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter  https://review.openstack.org/24325017:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose  https://review.openstack.org/24748717:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug.  https://review.openstack.org/19245717:47
openstackgerritJan Hruban proposed openstack-infra/zuul: support github pull reqeust labels  https://review.openstack.org/24742117:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.  https://review.openstack.org/19120717:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event  https://review.openstack.org/23920317:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github  https://review.openstack.org/24750017:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub  https://review.openstack.org/23913817:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs  https://review.openstack.org/25844817:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow using webapp from connections  https://review.openstack.org/21564217:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow list values in template parameters.  https://review.openstack.org/19120817:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter.  https://review.openstack.org/19131217:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for github commit status  https://review.openstack.org/23930317:47
openstackgerritJan Hruban proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336417:47
*** yolanda has quit IRC17:48
*** flepied has quit IRC17:48
*** kevinbenton has joined #openstack-infra17:49
odyssey4meAJaeger so https://review.openstack.org/263360 is good then, and you think that https://review.openstack.org/263341 isn't worth it?17:52
asselin_clarkb, ok found it. I seem to have the ability to edit those permissions, but I probably shouldn't: https://review.openstack.org/#/admin/projects/All-Projects,access17:52
asselin_shouldn't have the ability*17:53
clarkbasselin_: I don't think you actually do, you can submit a change to propose the edits which will be ignored17:53
clarkbthough maybe thats a decent way to do it for all projects (we don't currently do it that way)17:53
*** yolanda has joined #openstack-infra17:54
*** ajmiller has quit IRC17:55
*** vilobhmm11 has joined #openstack-infra17:55
clarkbasselin_: if you lcick edit do you get a save changes button or just a save for review button?17:55
asselin_clarkb, https://review.openstack.org/#/c/263371/17:56
armaxclarkb, amuller, mtreinish: I think we already see breakages in the gate17:56
*** sdake_ is now known as sdake17:56
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174317:57
AJaegerodyssey4me: I think you need both, don't you?17:57
odyssey4meAJaeger I do think it makes sense to have both17:58
openstackgerritMerged openstack-infra/project-config: Revert "Turn bluebox servers off in nodepool."  https://review.openstack.org/26335017:58
odyssey4mewe have the scaffolding for docs jobs in place in the juno branch, but running them is a waste as they build no real content17:58
asselin_clarkb, so yes, save for review.17:58
AJaegerodyssey4me: i suggest to base one change on the other so that we can review how they work together.17:59
clarkbasselin_: there is another button "save changes" if yo ucan directly merge the changes without review17:59
*** kzaitsev_mb has quit IRC17:59
asselin_and I don't have that one, as expected17:59
*** ajmiller has joined #openstack-infra18:00
*** odlD2 has quit IRC18:00
openstackgerritJesse Pretorius proposed openstack-infra/project-config: Skip openstack-ansible-docs gate/post jobs for juno branch  https://review.openstack.org/26334118:00
*** trown is now known as trown|lunch18:00
odyssey4meAJaeger done18:01
clarkbasselin_: that was a new feature added in 2.8 iirc. So well after we had jeepyb independently managing acls for us18:01
AJaegerthanks, odyssey4me. I'll wait for jenkins to finish and then review...18:01
clarkb(I personally like the jeepyb approach because it keeps things centralized with lots of prior art and a review body that groks gerrit acls)18:02
asselin_me too...easier to grep for changes too18:02
odyssey4methanks AJaeger18:02
nibalizerya the grepping is key18:03
nibalizerfor me anyways18:03
*** kevinbenton has quit IRC18:03
nibalizerall this got setup way before I got here so being able to cargo cult is great18:03
clarkbsimilar thing with jjb18:03
*** sshnaidm_ has quit IRC18:04
*** harlowja has quit IRC18:04
*** harlowja has joined #openstack-infra18:04
*** _nadya_ has joined #openstack-infra18:04
*** FallenPegasus has joined #openstack-infra18:05
*** salv-orl_ has joined #openstack-infra18:06
*** salv-orl_ has quit IRC18:06
*** thiagop has quit IRC18:07
*** salv-orl_ has joined #openstack-infra18:07
*** nelsnels_ has joined #openstack-infra18:07
*** salv-orlando has quit IRC18:08
*** kevinbenton has joined #openstack-infra18:09
*** thiagop has joined #openstack-infra18:09
clarkboh hrm I think I can set it up so that on logstash 2.0 the http output talks to many hosts. This may mean I won't need the local elasticsearch daemon and will cut back on memory use18:09
* clarkb checks into this18:09
*** nelsnelson has quit IRC18:10
*** doug-fish has joined #openstack-infra18:10
*** otter768 has joined #openstack-infra18:10
*** angdraug has joined #openstack-infra18:10
*** vgridnev has joined #openstack-infra18:11
*** armax has quit IRC18:11
clarkbya it takes an array and will load balance across them18:11
*** tonytan4ever has quit IRC18:11
clarkbI suppose this is worth a shot18:11
AJaegerwow, 109 changes in the post queue of zuul - seems everybody is back to approve ;)18:12
jeblairclarkb: cool18:12
kragnizanyone in infra-core around to add me to a newly created group? Groups created in this review: https://review.openstack.org/#/c/261135/18:13
*** odlD2 has joined #openstack-infra18:13
*** jsavak has joined #openstack-infra18:13
*** vilobhmm11 has quit IRC18:14
pleia2kragniz: I'll have a look18:14
kragnizpleia2: thanks!18:14
*** dkranz has quit IRC18:15
*** otter768 has quit IRC18:15
openstackgerritMerged openstack-infra/project-config: Remove pep8/bashate targets  https://review.openstack.org/26091718:15
clarkblogstash-worker20 is now running without a local daemon and should load balance indexing across the data nodes directly18:17
clarkbif this doesn't completely fall over in the next hour or so I will push a puppet change to deploy logstash 2.0 this way18:17
*** claudiub has quit IRC18:17
*** laurelm has quit IRC18:19
AJaegermordred: could you answer my question for 262600, please?18:19
*** FallenPegasus has quit IRC18:19
pleia2kragniz: since this is release tooling related and dhellmann +1ed the change I'm going to assume for now that it's ok to add you louis@kragniz.eu, the patch author, as core&release here, but you probably want to follow up with him about other members :)18:20
*** FallenPegasus has joined #openstack-infra18:20
kragnizpleia2: will do18:20
kragnizpleia2: thanks for the help!18:20
*** laurelm has joined #openstack-infra18:21
pleia2kragniz: you're welcome18:21
*** sputnik13_ has joined #openstack-infra18:22
openstackgerritMerged openstack-infra/project-config: Basic validation for gerritbot/channels.yaml  https://review.openstack.org/26104618:22
openstackgerritMerged openstack-infra/project-config: Remove redundant node declarations  https://review.openstack.org/26040018:23
*** claudiub has joined #openstack-infra18:23
openstackgerritMerged openstack-infra/project-config-example: Remove pep8 target  https://review.openstack.org/26091918:23
openstackgerritMerged openstack-infra/project-config: Report openstack-specs changes to openstack-dev  https://review.openstack.org/25993218:23
*** e0ne has joined #openstack-infra18:23
openstackgerritMerged openstack-infra/project-config: Use python-jobs template where possible  https://review.openstack.org/26214118:23
*** thiagop has quit IRC18:23
pleia2^^ AJaeger happy new year ;)18:23
*** thiagop has joined #openstack-infra18:24
jesusaurusclarkb: what do you mean 'without a local daemon'? without a local es daemon? i thought a local es daemon did the load balancing18:24
*** _nadya_ has quit IRC18:24
clarkbjesusaurus: ya on old logstash I ran a local es daemon to do load balancing, but that eats a bunch of memory. new logstash can http and load balance itself without a local daemon18:24
clarkbjesusaurus: and since I am having OOMing issues removing the local es daemon and having logstash load balance itself is hopefully going to alleviate memory pressure18:25
jesusaurusoh, so you give it a list of endpoints and it round-robins or somesuch?18:25
*** eil397 has joined #openstack-infra18:25
clarkbyup18:25
jesusauruscool18:26
*** bharathm has quit IRC18:26
openstackgerritMerged openstack-infra/project-config: Remove ACL for refs/heads/release- for mistral  https://review.openstack.org/26037918:26
*** baoli_ has quit IRC18:27
AJaegerpleia2: thanks for all the reviews!18:28
*** Sukhdev has quit IRC18:28
AJaegerpleia2: now we only have 128 open project-config reviews ;)18:29
*** julim_ has joined #openstack-infra18:30
*** baoli has joined #openstack-infra18:31
*** tzn has quit IRC18:31
*** openstackgerrit has quit IRC18:32
*** openstackgerrit has joined #openstack-infra18:32
*** julim has quit IRC18:32
*** tonytan4ever has joined #openstack-infra18:33
sputnik13_can someone with +2 for openstack/requirements please review https://review.openstack.org/#/c/261074/18:33
*** sridhar_ram has quit IRC18:34
sputnik13_it already has a +2, just needs one more18:34
*** bexelbie has quit IRC18:34
*** Guest21972 has quit IRC18:34
sputnik13_aaaand devstack... https://review.openstack.org/#/c/260661/ :)18:35
pleia2AJaeger: it ever ends!18:35
*** ari has quit IRC18:36
*** sabeen3 has quit IRC18:37
AJaegerpleia2: but it's down from over 150 early December...18:38
*** doug-fish has quit IRC18:38
*** trown|lunch is now known as trown18:40
mordredAJaeger: aha! good call18:40
crinkleclarkb: https://etherpad.openstack.org/p/nodepool-wiki-mysql-downtime good?18:41
*** doug-fish has joined #openstack-infra18:41
*** david-lyle_ has joined #openstack-infra18:42
clarkbcrinkle: looks good to me18:42
*** yamahata has joined #openstack-infra18:42
* AJaeger has to leave again...18:43
crinkleclarkb: ty18:43
*** AJaeger has quit IRC18:43
*** bpokorny has joined #openstack-infra18:43
nibalizercrinkle: lgtm18:43
clarkblooks like logstash-worker20 fell over again :/ but not due to an OOM, there are log complains about timestamp formats so addressing those and restarting18:43
*** piet has quit IRC18:43
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci: DO NOT MERGE changes needed for delorean promotion  https://review.openstack.org/25814018:47
*** pvaneck has joined #openstack-infra18:47
*** piet has joined #openstack-infra18:47
*** jsavak has quit IRC18:49
*** ari has joined #openstack-infra18:49
*** doug-fish has quit IRC18:49
*** HeOS has joined #openstack-infra18:50
*** doug-fish has joined #openstack-infra18:50
*** isq has quit IRC18:50
*** isq has joined #openstack-infra18:51
*** doug-fish has quit IRC18:51
openstackgerritMonty Taylor proposed openstack-infra/project-config: Add releasenotes jobs for os-client-config  https://review.openstack.org/26260018:51
*** bharathm has joined #openstack-infra18:51
clarkbbah disk space of course18:52
openstackgerritColleen Murphy proposed openstack-infra/system-config: Upgrade mysql module to 3.6.1  https://review.openstack.org/25764018:52
crinkle^ is ready to re-review18:53
*** boris-42 has quit IRC18:53
crinklealso https://review.openstack.org/#/c/258193 should not make any actual changes to the system on its own if anyone wants to take that plunge18:54
*** angdraug has quit IRC18:55
*** jsavak has joined #openstack-infra18:55
*** kzaitsev_mb has joined #openstack-infra18:56
*** aopincar has quit IRC18:57
*** bnemec has quit IRC18:58
*** vilobhmm11 has joined #openstack-infra18:58
*** jsavak has quit IRC19:01
*** jsavak has joined #openstack-infra19:02
*** piet has quit IRC19:03
openstackgerritMonty Taylor proposed openstack-infra/shade: Normalize server objects  https://review.openstack.org/26262719:05
*** baoli has quit IRC19:06
*** baoli has joined #openstack-infra19:06
*** baoli has quit IRC19:07
*** sdake has quit IRC19:08
*** jsavak has quit IRC19:08
*** jsavak has joined #openstack-infra19:09
*** bgmccollum has joined #openstack-infra19:10
*** sc68cal has quit IRC19:11
*** bharathm has quit IRC19:11
*** FallenPegasus is now known as MarkAtwood19:11
*** baoli has joined #openstack-infra19:11
*** bharathm has joined #openstack-infra19:12
openstackgerritMerged openstack-infra/statusbot: Update to pbr-based build  https://review.openstack.org/9267619:13
openstackgerritMerged openstack-infra/statusbot: Add twitter support to statusbot  https://review.openstack.org/9267719:14
*** sc68cal has joined #openstack-infra19:14
crinklei've found a machine that seems to have some kind of historical significance to it, with these users on it:19:14
crinkleclarkb: clint  cmsj  corvus  devananda  elizabeth  fungi  ironic  jogo  mordred  nobodycam  robertc  shared  slukjanov  stack  yazz19:14
crinkleits ip address is 15.184.52.20019:14
*** dkranz has joined #openstack-infra19:14
clarkbcrinkle: is that addressed to me or am I on the host?19:14
* Clint squints.19:15
crinkleclarkb: you are on the host19:15
crinkleshould any of this be backed up? is it still in use by anybody?19:15
crinklegreghaynes: ^19:15
jeblairi wonder if it's a long-lost hp backup server?19:15
jeblairoh, this is the infra-cloud hardware?19:15
crinklejeblair: yes19:15
greghaynescrinkle: I have nothing that should need backing up19:15
devanandacrinkle: do you know the physical ... oh.19:15
clarkbya I don't have anything needing backups19:15
devanandacrinkle: what is the hostname?19:15
crinkledevananda: bm-aw1az2-freecloud000119:16
devanandaI suspect that's the old jump host19:16
*** HeOS has quit IRC19:16
jeblairfreecloud is an old project19:16
greghaynesSeems plausible19:16
*** regXboi has quit IRC19:17
devanandaI hvae not logged into that host in 18 months. nothing I need is there19:17
pabelangerjeblair: do you mind helping https://review.openstack.org/#/c/261055/ land? Just removing requirements cap for webob19:17
*** _nadya_ has joined #openstack-infra19:17
devanandaSpamapS: it looks like you had some activity on that box last year19:18
jeblairi think it predated trystack19:18
jeblairpabelanger: done19:19
pabelangerjeblair: danke19:19
*** tjones has left #openstack-infra19:19
pabelangerjeblair: do you think we can do another zuul 2.x.x release before zuulv3?19:20
pabelangernot today19:20
*** david-lyle_ has quit IRC19:20
jeblairpabelanger: yeah, don't see why not19:20
openstackgerritPaul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas  https://review.openstack.org/26339819:20
pabelangergreat19:20
*** bnemec has joined #openstack-infra19:20
*** openstackstatus has quit IRC19:20
*** sdake has joined #openstack-infra19:21
*** openstackstatus has joined #openstack-infra19:21
*** ChanServ sets mode: +v openstackstatus19:21
*** sridhar_ram has joined #openstack-infra19:22
openstackgerritgreghaynes proposed openstack/diskimage-builder: Run package-intalls with py3k if we must  https://review.openstack.org/25438619:22
*** regXboi has joined #openstack-infra19:22
clarkbgreghaynes: that commit title always makes me think of eeyore19:22
clarkb"if we must"19:22
openstackgerritMerged openstack/diskimage-builder: The mirror for installing epel is timing out  https://review.openstack.org/26205019:23
greghaynesclarkb: I am glad my feelings toward that bug come through so well in my commit msg19:23
*** odlD2 has quit IRC19:23
clarkbhttps://jenkins02.openstack.org/job/gate-grenade-dsvm/9735/ that job is running on bluebox19:24
openstackgerritMerged openstack-infra/zuul: Remove webob requirements cap  https://review.openstack.org/26105519:26
*** bharathm has quit IRC19:28
clarkbjeblair: are you wanting to do more testing beyond "test runs and works" before bumping max servers back to 39?19:29
*** nmagnezi has joined #openstack-infra19:30
*** ybathia has joined #openstack-infra19:30
*** kzaitsev_mb has quit IRC19:30
jeblairclarkb: nope -- we'll get more info by running real jobs i think19:31
*** [1]Thelo has joined #openstack-infra19:32
*** flepied has joined #openstack-infra19:32
*** bharathm has joined #openstack-infra19:32
*** sabeen has joined #openstack-infra19:33
*** Thelo has quit IRC19:34
*** [1]Thelo is now known as Thelo19:34
*** changbl has quit IRC19:35
openstackgerritJan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks  https://review.openstack.org/16311719:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent  https://review.openstack.org/23894819:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/26336419:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter  https://review.openstack.org/24325019:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose  https://review.openstack.org/24748719:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug.  https://review.openstack.org/19245719:36
openstackgerritJan Hruban proposed openstack-infra/zuul: support github pull reqeust labels  https://review.openstack.org/24742119:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events.  https://review.openstack.org/19120719:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event  https://review.openstack.org/23920319:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github  https://review.openstack.org/24750019:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub  https://review.openstack.org/23913819:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs  https://review.openstack.org/25844819:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow using webapp from connections  https://review.openstack.org/21564219:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Allow list values in template parameters.  https://review.openstack.org/19120819:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter.  https://review.openstack.org/19131219:36
openstackgerritJan Hruban proposed openstack-infra/zuul: Support for github commit status  https://review.openstack.org/23930319:36
*** Kiall has quit IRC19:36
*** Kiall has joined #openstack-infra19:36
*** odlD2 has joined #openstack-infra19:36
*** masuberu has quit IRC19:37
*** sabeen3 has joined #openstack-infra19:39
*** hashar has joined #openstack-infra19:39
*** sabeen has quit IRC19:40
*** fawadkhaliq has quit IRC19:41
*** fawadkhaliq has joined #openstack-infra19:42
*** dims_ has joined #openstack-infra19:46
*** bharathm has quit IRC19:46
*** dims has quit IRC19:47
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174319:47
*** tzn has joined #openstack-infra19:50
*** bharathm has joined #openstack-infra19:50
*** annegentle has quit IRC19:51
*** mwagner_lap has quit IRC19:51
*** annegentle has joined #openstack-infra19:53
*** odlD2 has quit IRC19:55
*** baoli has quit IRC19:56
*** aopincar has joined #openstack-infra19:56
clarkbthta grenade job finished successfully in about 45 minutes19:57
*** rguillebert has quit IRC19:57
clarkbhttps://jenkins04.openstack.org/job/gate-tempest-dsvm-postgres-full/8554/console is now running which will tell us if tempest is happy too19:58
*** daemontool has quit IRC19:59
*** bharathm has quit IRC20:00
*** megm has quit IRC20:00
*** amuller is now known as amuller_food20:00
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174320:01
clarkbnibalizer: how is nodepool against infracloud going?20:02
*** megm has joined #openstack-infra20:03
*** amitgandhinz has quit IRC20:05
*** bharathm has joined #openstack-infra20:05
clarkbnibalizer: is it building and booting our images yet ? would be neat to run some jobs on it20:05
*** amitgandhinz has joined #openstack-infra20:06
*** woodster_ has joined #openstack-infra20:06
*** kzaitsev_mb has joined #openstack-infra20:07
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174320:08
*** odlD2 has joined #openstack-infra20:08
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/26314320:08
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174320:09
openstackgerritDavide Agnello proposed openstack-infra/project-config: Moving Cue rally test to non-voting check job  https://review.openstack.org/25918820:10
*** otter768 has joined #openstack-infra20:11
nibalizeri haven't poked it since we fixed the quota issue20:12
nibalizerand there were some network issues that crinkle helped me resolve20:12
clarkbwas that the security groups?20:13
crinkleit was the dns per subnet issue20:13
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual: Add limitations and caveats to cross dependencies  https://review.openstack.org/26174320:13
nibalizerit was the dns issue20:14
nibalizernodepool is booting a node now, we can see if it works20:14
clarkbdns per subnet? our images should use google20:14
crinkleright, if we didn't specify that they would try to use the beginning of the allocation pool20:14
crinklewe had to set it explicitly20:15
nibalizeri haven't set up our nodepool configuration on my nodepool host20:15
nibalizerjust an example one20:15
nibalizerso its not building our images20:15
clarkbI see20:15
*** otter768 has quit IRC20:16
jeblairnibalizer: i copied the image i was using locally20:16
jeblairlet me use more words20:16
jeblairnibalizer: i copied the images i was using from nodepool.o.o to my local machine, and copied in the relevant record for the 'snapshot_images' table as well20:17
nibalizeroh20:18
jeblairnibalizer: (well, only the first is needed if you want to upload the image which you will probably need to do... only the second is needed if you want to re-use an existing snapshot on a provider the production nodepool knows about)20:18
jeblairi'm apparently out of practice communicating technical things, but it'll get better :)20:18
* nibalizer nods20:18
*** hdd has joined #openstack-infra20:19
nibalizerI've got some other stuff I'm working on today so I won't really dig into nodepool today, but tomorrow I'll probabaly want to engage more on this20:19
openstackgerritPaul Michali proposed openstack-infra/project-config: Skip py27/34 jobs when VPN doc (only) change  https://review.openstack.org/26340920:19
jeblairnibalizer: cool, let me know if i can clarify further :)20:20
*** jcoufal has quit IRC20:20
clarkbits relatively easy to just have localnodepoold do it all20:20
ariCan I get a review - https://review.openstack.org/#/c/263354/20:21
*** bharathm has quit IRC20:21
clarkbtakes 45 minutes for dib builds here20:21
nibalizerclarkb: yea my dib build succeeds20:21
nibalizerthe node doesn't network good once booted though, which is unfortunate20:22
nibalizercirros images get networking so probably something in the dib image20:22
clarkbusing simple-init and glean?20:23
*** Sukhdev has joined #openstack-infra20:23
nibalizerwait no I think I know what the issue is20:24
*** bharathm has joined #openstack-infra20:24
*** krtaylor has quit IRC20:26
*** rfolco_ has quit IRC20:29
crinklegreghaynes: SpamapS: there are files /home/shared/machine-information-tab.txt and /home/shared/machine-information-tab.txt.bak, do you happen to remember these files and recall why .bak has more machines in it?20:29
*** vgridnev has quit IRC20:30
greghaynescrinkle: hrm, are you sure there are more machines? I think I remember doing some work to figure out where the data was incorrect in the .bak and might have removed a couple that were duped or somesuch20:30
*** sputnik13_ has quit IRC20:30
*** aopincar has quit IRC20:31
*** bharathm has quit IRC20:31
crinklegreghaynes: yes, there are several that seem to exist that are missing from certain lists20:31
crinkleall the lists seem to be a little bit different20:32
*** hdd has quit IRC20:32
*** _nadya_ has quit IRC20:32
*** hdd has joined #openstack-infra20:32
*** sputnik13_ has joined #openstack-infra20:32
greghaynescrinkle: Seems about right. The .bak was just a straight copy from the hp wiki IIRC20:32
*** kzaitsev_mb has quit IRC20:33
*** kmartin has quit IRC20:33
*** bharathm has joined #openstack-infra20:34
greghaynescrinkle: none of that should be the source of truth for anything ATM though, the original source for those files was the hp wiki and the source for that was hp's inventory20:34
*** sputnik13_ has quit IRC20:35
clarkblooks like the bluebox postgres tempest run is going to fail, not sure if due to bluebox or the chagne yet20:35
clarkbsomething to look at before bumping to 39 nodes I guess20:36
mtreinishclarkb: looks like it's failing everything cinder20:36
clarkbmtreinish: its from  that https://review.openstack.org/#/c/259515/20:36
clarkbso may just be related to the change20:37
*** sputnik13_ has joined #openstack-infra20:37
crinklegreghaynes: they seem to have disappeared from the wiki and the cmdb so it's all i have to go on20:37
mtreinishyeah, it's the change20:37
greghaynescrinkle: hah20:37
jeblairzaro: what's the possibility of using the workflow plugin with our new gerrit?20:37
jeblairzaro: er, the 'work in progress' plugin20:38
greghaynescrinkle: So it is probably important that what HP thinks we have and what we think we have match20:38
crinklegreghaynes: yes20:38
greghaynescrinkle: does the inventory.json have all the hosts in the machine-infrmation-tab.bak file?20:38
greghaynescrinkle: I think it may...20:39
greghayneser, inventory-full20:39
crinklegreghaynes: no, it has the subset of machines20:39
greghayneshrm20:39
clarkbnotmorgan: not sure how often you deal with icey fun, but beware falling ice20:40
clarkbnotmorgan: and basically beware anyone driving a car right now20:40
notmorganclarkb: grew up in the snow and ice20:40
greghaynesor anyone looking like they are thinking of driving a car20:40
*** piet has joined #openstack-infra20:40
notmorganclarkb: learned to drive on icy mountain roads :)20:40
*** bharathm has quit IRC20:40
greghaynesnotmorgan: The problem is the rest of portland20:40
clarkboh good, just remember no one can drive in ice and/or snow here20:40
greghaynes:p20:40
notmorganclarkb: thanks for the heads up! :)20:40
*** annegentle has quit IRC20:40
clarkbalso I am watching all the ice fall right now20:41
notmorganclarkb: hah i think most people i know even growing up in snow and ice suck at driving in it20:41
*** ihrachys has joined #openstack-infra20:41
greghaynescrinkle: which hosts are missing? Are there any notes on the side in the file for them?20:41
notmorganclarkb: but all wheel drive helps a lot20:41
arizaro# Can I get a review when you have a chance? https://review.openstack.org/#/c/263354/20:42
*** annegentle has joined #openstack-infra20:42
*** bharathm has joined #openstack-infra20:42
*** sputnik13_ has quit IRC20:42
*** Sukhdev has quit IRC20:43
crinklegreghaynes: no, the hosts with errors noted do not correspond to the missing ones20:44
*** esikachev has joined #openstack-infra20:44
crinklegreghaynes: okay, some of them did make it into inventory-full.json, just one had its password typoed20:46
crinklegreghaynes: 10.10.16.12 (which is the bastion) and 10.10.16.13 did not make it20:46
greghaynescrinkle: ok, and that is all commited in system-config now, right?20:46
*** rkukura has quit IRC20:46
greghaynescrinkle: got it, .13 is the bifrost node?20:46
crinklegreghaynes: i'm going to add .12 and .13 in20:46
crinkleyes20:46
greghaynescrinkle: ok, I wonder if there is a way to disable them...20:47
greghaynescrinkle: the reason those arent in there should be obvious...20:47
greghaynesIt is fine to put them in, but it is really easy to foot-gun20:47
crinklegreghaynes: we worked that out: https://review.openstack.org/#/c/231757/27/templates/bifrost/inventory.hpuswest.json.erb20:48
*** tonytan4ever has quit IRC20:48
*** sputnik13_ has joined #openstack-infra20:49
greghaynescrinkle: oh, sweet20:49
greghaynescrinkle: The other bit of useful info is serials20:49
crinklegreghaynes: yeah i was thinking that too20:50
*** gongysh has joined #openstack-infra20:50
greghaynescrinkle: I think bifrost is fine with extra data in the inventory file, I am unsure if we want to make serials public20:50
*** baoli has joined #openstack-infra20:51
crinklegreghaynes: i'm not sure how someone would exploit that20:51
clarkbare they basically just mac addrs?20:51
greghaynesclarkb: nope20:51
*** ihrachys_ has joined #openstack-infra20:51
*** ihrachys has quit IRC20:52
clarkbhttps://jenkins04.openstack.org/job/gate-designate-dsvm-powerdns/374/console another bluebox job20:52
greghaynescrinkle: Yea, I dunno, that is probably an HP internal question thoug20:52
*** weshay_xchat is now known as weshay20:54
sdagueso, what's the story on the pypi wheel mirrors?20:54
*** jsavak has quit IRC20:55
*** jsavak has joined #openstack-infra20:55
*** sarob_ has joined #openstack-infra20:55
*** PsionTheory has joined #openstack-infra20:56
openstackgerritPaul Michali proposed openstack-infra/project-config: Constraint based experimental jobs for neutron-vpnaas  https://review.openstack.org/26339820:56
*** ihrachys_ is now known as ihrachys20:56
*** doug-fish has joined #openstack-infra20:56
*** amitgandhinz has quit IRC20:57
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder  https://review.openstack.org/26334921:01
*** e0ne has quit IRC21:01
*** amuller_food is now known as amuller21:02
*** rkukura has joined #openstack-infra21:04
*** tonytan4ever has joined #openstack-infra21:04
*** ihrachys_ has joined #openstack-infra21:05
*** amrith is now known as _amrith_21:06
*** matrohon has joined #openstack-infra21:06
*** sputnik13_ has quit IRC21:07
openstackgerritMerged openstack-infra/subunit2sql: Fix hard coded filter in get_test_run_series()  https://review.openstack.org/26298621:07
openstackgerritMerged openstack-infra/subunit2sql: Add missing tests for db api functions with implicit joins  https://review.openstack.org/26298721:08
*** tzn has quit IRC21:08
*** ihrachys has quit IRC21:08
*** rbrndt_ has quit IRC21:10
*** sarob_ has quit IRC21:11
*** matrohon has quit IRC21:12
*** dprince has quit IRC21:12
*** baoli has quit IRC21:13
*** baoli has joined #openstack-infra21:13
*** baoli has quit IRC21:14
*** ihrachys_ is now known as ihrachys21:14
*** baoli has joined #openstack-infra21:14
*** matrohon has joined #openstack-infra21:15
*** tzn has joined #openstack-infra21:15
*** hashar has quit IRC21:15
*** bharathm has quit IRC21:16
*** amitgandhinz has joined #openstack-infra21:16
*** kmartin has joined #openstack-infra21:17
dmsimardDoes anyone know what's the right place to ask for help in recovering an account for openstackid.org ?21:19
*** baoli has quit IRC21:19
anteayadmsimard: here is as good a place as any21:19
clarkbdmsimard: on openstackid is a lost password link21:19
anteayaclarkb: ah thank you21:20
dmsimardclarkb: the e-mail address registered is probably the one from my previous employer21:20
dmsimard:/21:20
*** ari has quit IRC21:20
*** ari has joined #openstack-infra21:20
clarkbdmsimard: and you don't remember the password so the reset would be sent to an inaccessible location?21:20
*** tzn has quit IRC21:21
dmsimardclarkb: correct - let me dig some more to try and see if I have the password somewhere :(21:21
clarkbif you hvae the password you can change the email addr associated with the account, if you don't have the password I can find a good contact address to sort it out21:22
*** hdd has quit IRC21:23
anteayaclarkb: you said in backscroll logstash 2.0 is using more memory on 20 than 1.3 was and keeps getting taken out by the OOMkiller21:23
clarkbanteaya: yes, I think I have a viable workaround for that with logstash2.0 though21:24
anteayawoooooo21:24
anteayais it in backscroll? I haven't caught up yet21:24
clarkbyes at 18:09:55 UTC21:25
* anteaya goes back to reading logs and lurking in the stable meeting21:25
*** bhunter71 has quit IRC21:25
anteayathanks21:25
dmsimardclarkb: okay, I'm in, don't see an option to change the e-mail address.. though.21:25
clarkblet me see21:25
*** kgiusti has quit IRC21:25
*** Swami_ has joined #openstack-infra21:25
*** bharathm has joined #openstack-infra21:25
*** Swami has quit IRC21:25
clarkboh, you may have to do it through the foundation profile side?21:26
*** esikachev has quit IRC21:26
anteayaclarkb: so when you say it takes an array do you mean you need more than one server?21:26
*** julim_ has quit IRC21:26
clarkbanteaya: ya so on old logstash we had it talk to a single ES daemon which ran locally, that daemon was then doing load balancing for us. With new logstash we can give it a list and it will load balance for us21:27
anteayaoh, helpful21:27
anteayaso how many servers are you envisioning for a trial run?21:28
clarkbanteaya: I just have it on logstash-worker20 right now, but it is talking to all of the elasticsearch data nodes21:28
dmsimardclarkb: that was it, thanks :)21:28
anteayaclarkb: oh I see what you are saying, I think21:28
anteayaclarkb: how does the memory usage compare, or can you tell yet?21:29
*** gongysh has quit IRC21:29
clarkbanteaya: comparing 01 and 20 is about 1GB difference looks like21:30
clarkbcacti should show that21:30
clarkbgranted 20 has only been running a couple hours under new setup21:30
* anteaya goes to cacti21:30
clarkb01 has been running much longer so has had more time to soak up memory21:30
* anteaya nods21:30
*** ari has quit IRC21:30
clarkbdmsimard: all sorted then? I can find out who to contact if necessary (will ask them to put ocntact info on the website regardless)21:32
*** hdd has joined #openstack-infra21:32
dmsimardclarkb: yeah all good.21:32
anteayaclarkb: how long do you think the logstash 20 server should run to get a realistic sense of its expected memory usage over time?21:34
*** lucasagomes has joined #openstack-infra21:34
clarkbanteaya: probably a day or two with real work (so not during holidays)21:34
anteayafair enough21:34
anteayaso look again the end of this week?21:34
*** lucasagomes is now known as lucas-dinner21:34
clarkbya21:34
jeblairdid i stop holidaying too soon?21:35
anteayaclarkb: cool21:35
clarkbI dunno, I can't tell if everyone is back to normal this week or not21:35
anteayajeblair: I'm glad you're back21:35
* jeblair goes to turn the lights back on21:35
clarkbI myself am in a weird haze of house shopping, doctor visits, and freezing rain21:36
anteayaI had to go shopping today, was out of milk and my taxi was on holidays until today21:36
*** ok_delta has joined #openstack-infra21:36
*** ok___delta has joined #openstack-infra21:36
jeblairfreezing haze21:36
anteayastay inside on the freezing rain days, that can get nasty21:36
clarkbanteaya: yup21:36
anteayaclarkb: how is house hunting going?21:37
anteayamy sister's family went canoeing on christmas day and my brother's family went swimming, cold now though - wore the parka today21:37
clarkbanteaya: so so, it takes time and patience and time21:37
anteayayeah21:38
clarkbzaro: looking at gerrit memory use graphs, we still appear ok21:38
clarkbzaro: but its creeping up in usage. over the last day mean is 7GB and max is 12GB21:38
anteayamriedem: what do you need from infra regarding a channel topic, just someone to change it once you have decided what you want?21:40
*** baoli has joined #openstack-infra21:40
mriedemanteaya: yeah21:40
anteayamriedem: cool21:40
mriedemit's low priority though21:40
clarkbzaro: there was some garbage collecting too, but nothing crazy and not consistently bad21:40
anteayamriedem: yup, just trying to follow along21:41
anteayamriedem: nice first meeting, yay stable team21:41
mriedem\o/21:41
*** tzn has joined #openstack-infra21:41
*** ihrachys has quit IRC21:44
jheskethMorning21:46
openstackgerritColleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition  https://review.openstack.org/20875121:46
openstackgerritColleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env  https://review.openstack.org/20961721:46
bknudson_I thought stable meeting was tomorrow21:46
*** austin81 has left #openstack-infra21:47
clarkbzaro: you can really see how much time we spend above the old 8GB though21:48
anteayamorning jhesketh21:49
clarkbmtreinish: is https://jenkins04.openstack.org/job/gate-designate-dsvm-powerdns/374/console the same issue neutron ran into with the chagne in config for tempest creds?21:49
*** trown is now known as trown|outttypeww21:49
anteayabknudson_: was today21:49
*** matrohon has quit IRC21:49
anteayabknudson_: in -421:50
openstackgerritTimur Sufiev proposed openstack-infra/project-config: Use scripts from horizon repo in integration job test hooks  https://review.openstack.org/26345721:50
*** matrohon has joined #openstack-infra21:51
bknudson_I got messed up on odd/even weeks21:51
anteayaI can never win on those21:51
anteayaI just channel flip and catch the ones I catch21:51
anteayathe ones I chair I hold every week, no changes21:52
bknudson_is this an odd week?21:52
anteayaso I know when they are21:52
anteayabknudson_: aren't they all?21:52
jeblairit's certainly not...21:52
jeblairdrat anteaya beat me to it21:52
anteayaI can't tell what determines an even or odd week21:52
* anteaya beat jeblair at something! first time!21:52
jeblairthat'll teach me to review changes21:53
anteayaha ha ha21:53
anteayayou should stay in channel to win the quip draws21:53
anteayaso yeah, if anyone knows how to determine what constitues an odd week, do share21:54
anteayaI have no idea21:54
anteayatonyb: do you know?21:54
* tonyb reads scrollback21:55
jeblairhttp://git.openstack.org/cgit/openstack-infra/yaml2ical/tree/README.rst#n15221:55
tonybbknudson_: yeas this is an odd week.21:55
jeblair`biweekly-odd` are weeks where the ISO week number is an odd value. Correspondingly `biweekly-even` are weeks where the ISO week number is even. This unfortunately will break down on the transition from 2015 to 2016 as 2015 has 53 ISO weeks (an odd value) and then the first week of 2016 is week 1 (also an odd value).21:55
jeblairso it's *especially odd*21:56
anteayaha ha ha21:56
bknudson_what was last week? 0?21:56
clarkbat Intel they give you a badge size work week calendar to wear with your badge21:56
bknudson_oh, 5321:56
clarkbthats how confusing this stuff is21:56
tonybbknudson_: we had 2 odd weeks in a row21:56
tonybthe last week of 2015 was 53, the first of 2016 is 121:57
jeblairwe need like julian weeks21:57
bknudson_my calender application says this is week 2, so I guess it's not using ISO.21:57
clarkbhttps://jenkins03.openstack.org/job/gate-tempest-dsvm-full/28667/ thats another bluebox run of normal tempest21:57
tonybjeblair: no we need to specify a start date and then biweekly21:57
jeblairor epoch weeks: "weeks since december 31 1969"21:57
tonybwhich is what we really *mean* the odd/even thing was a quick implementation21:57
jeblairtonyb: i was still attempting humor, but in reality, don't we need to do whatever ical does?  does it support this?21:58
* tonyb is coding the start_date thing on top of his outstanding reviews21:58
tonybjeblair: Ahh21:58
tonybjeblair: so yeah iCal does exactly what I said but we currently can't represent that in *our* yaml21:59
*** ningy has quit IRC21:59
tonybwe cheat by guessing the start date basedon the DoW and the time yaml2ical is run21:59
jeblairtonyb: okay cool... so hopefully we can fix this by next year :)21:59
tonybjeblair: so we loose history *and* the event dates can more from year to year22:00
tonybjeblair: yeah22:00
tonybjeblair: actually 2018 is the next time it's a problem22:00
*** sdake has quit IRC22:00
jeblairtonyb: i totally promise to help review that change before 2018.22:00
tonybjeblair: so it isn't time critical ;P22:00
* tonyb will hold jeblair to that :D22:00
*** sdake has joined #openstack-infra22:00
jeblairit could be my 2017 new years resolution22:00
tonybjeblair: or I could do it this week and we could forget about it ;P22:01
*** regXboi has quit IRC22:01
*** jsavak has quit IRC22:01
tonybjeblair: can you look at https://review.openstack.org/#/c/245525/3 and help me understand what I actually need to do?22:02
*** thorst has quit IRC22:02
jeblairtonyb: is that the right change?22:03
*** thorst has joined #openstack-infra22:03
mtreinishclarkb: looks like it22:03
jeblairtonyb: "Set ZUUL_BRANCH for periodic unittest bitrot jobs"22:03
anteayadate +%V22:04
tonybjeblair: yeah BUT not PS4 I don't want to use ZUUL_BRANCH22:04
anteayadisplays the ISO week number22:04
tonybjeblair: I'm not certain I understand why I need to create whoel new set of macros22:04
jeblairtonyb: okay, unexpected change of subject :)  gimme a minute to catch up22:04
tonybjeblair: sorry, I thought we'd done the odd week thing22:05
*** bharathm has quit IRC22:05
*** rbrndt_ has joined #openstack-infra22:05
*** changbl has joined #openstack-infra22:06
*** thorst has quit IRC22:07
jeblairtonyb: yeah, because zuul doesn't set the branch specificier for periodic jobs, the jobs themselves need to specify the branch, and we don't want to touch that for regular jobs22:08
tonybto be very silly: bash -c "[ $(( $( date +%V ) % 2 ) == 0 ] && echo even || echo odd"22:08
*** alexpilotti_ has joined #openstack-infra22:08
jeblairtonyb: the *best* solution would be to modify the zuul timer trigger to do that, but it's not super-easy.22:09
* anteaya hands tonyb another )22:09
tonybanteaya: Gah I pasted the wrong one ;P22:09
*** bharathm has joined #openstack-infra22:10
*** sputnik13_ has joined #openstack-infra22:10
*** bcourt has quit IRC22:10
clarkbzaro: so I think we keep watching it and see how it does as time goes on (and as work picks up post holiday)22:10
clarkbzaro: if it reaches a steady state with this level of load then I think we are good otherwise more memory may be appropriate or those other tuning options you mentioned22:11
*** rhallisey has quit IRC22:11
tonybjeblair: so I'll look at the zuul thing and lean on jhesketh ;P but in the mean time would accepting the somethign liek the review be okay?22:11
*** otter768 has joined #openstack-infra22:12
tonyband isn't that review only modifying the periodic jobs not the regular jobs?22:12
jeblairtonyb: the "pytho27" macro is used *everywhere*22:12
tonybjeblair: Oh I see.  I made bad assumptions.  Thanks.22:14
jeblairtonyb: see http://logs.openstack.org/25/245525/3/check/project-config-compare-xml/67927d2/console.html for all the jobs it changes22:14
* jhesketh reads scrollback 22:15
*** sputnik13_ has quit IRC22:15
tonybjeblair: okay so if I created a python27-branch (or similar) macro that used the branch and explitly called that from the peridoic queue that'd be okay?22:15
jeblairi don't think we should do that before zuulv322:15
tonybjeblair: ... while I look at the zuul thing22:15
*** salv-orl_ has quit IRC22:15
jeblairtonyb: yeah, i think that's the most workable thing at the moment22:15
tonybjeblair: and should I do the zuul trigger thing on zuulv3?22:16
*** bdemers has quit IRC22:16
*** otter768 has quit IRC22:17
*** eharney has quit IRC22:18
jeblairtonyb: yeah, v3 is our priority with zuul22:18
openstackgerritMatthew Treinish proposed openstack/os-testr: Add tool to create a subunit streams  https://review.openstack.org/26346522:18
tonybjeblair: okay thanks for the direction.22:19
*** ok___delta has quit IRC22:19
clarkbKiall: FYI your designate dsvm tempest jobs appear to be failing due to a change in the tempest config (devstack stopped writing deprecated options there)22:19
*** ok_delta has quit IRC22:19
*** mriedem is now known as mriedem_jedi22:20
*** mriedem_jedi is now known as mriedem22:21
*** dkranz has quit IRC22:22
*** matrohon has quit IRC22:23
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: use send-announcements-to metadata for deliverables  https://review.openstack.org/26228122:25
*** alexpilotti_ has quit IRC22:26
tonybokay another subject change .... How do I get something added to the topic of an "offical" channel?22:27
anteayatonyb: tell us what it is and someone with permissions will change the topic22:27
clarkb(or any other channel op)22:27
anteayaso decide what dashboard link you want and then post back here22:27
tonybanteaya: Thanks.22:28
*** larainema has quit IRC22:28
anteayawelcome22:28
anteayatonyb: I'd suggest a url shortener you can redirect, that way the link in the channel topic is the same and you can control the url it redirects to if you want to change the dashboard22:28
anteayadashboard links can get really long22:29
tonybanteaya: That's what I'm looking into right now.  goo.gl and bit.ly seem to modify the URL as the referenced URL changes22:29
anteayatinyurl?22:29
openstackgerritJames E. Blair proposed openstack/gertty: Cache counts of project changes  https://review.openstack.org/26008522:30
*** angdraug has joined #openstack-infra22:30
*** sputnik13_ has joined #openstack-infra22:31
openstackgerritMatthew Treinish proposed openstack/os-testr: Add tool to create a subunit stream  https://review.openstack.org/26346522:31
tonybanteaya: Ahh tiny.cc allows edits.22:32
anteayayay tiny.cc22:33
*** shardy has quit IRC22:33
*** holser_ has left #openstack-infra22:34
*** e0ne has joined #openstack-infra22:34
*** annegentle has quit IRC22:36
*** bdemers has joined #openstack-infra22:37
*** sputnik13_ has quit IRC22:39
jeblairclarkb: (zaro?) what's the status of https://review.openstack.org/18196522:39
*** peristeri has quit IRC22:39
*** darrenc is now known as darrenc_afk22:39
*** bhunter71 has joined #openstack-infra22:40
clarkbI think the assertion is wrong (jgit issue was unrelated)22:41
clarkbbut if gerrit packs for us then we dont need to22:41
jeblairclarkb: i'm not sure it repacks as well as we do22:42
*** zaro has quit IRC22:42
jeblair(we do -afd because nova is big, does it?)22:42
clarkbI do not know what options it uses22:43
jeblairit's probably more complicated than that since it uses jgit -- i think the question is more like "is the algorithm it uses comparable or better at optimizing the size of the nova repo than 'git repack -afd'"22:44
jeblair( ^ + "over time")22:44
openstackgerritColleen Murphy proposed openstack-infra/puppet-infracloud: Add bifrost manifest  https://review.openstack.org/23175722:45
*** tonytan4ever has quit IRC22:46
*** amitgandhinz has quit IRC22:46
*** jpr has quit IRC22:48
*** onovy has left #openstack-infra22:48
*** Sukhdev has joined #openstack-infra22:49
*** vilobhmm11 has left #openstack-infra22:50
craigeo/22:52
*** bharathm has quit IRC22:52
craigeOh jeblair, thanks for gertty, loving it.22:52
jeblaircraige: glad to hear it!22:53
*** zaro has joined #openstack-infra22:53
*** darrenc_afk is now known as darrenc22:54
clarkbIt looks like we can induce a gerrit gc against a specific repo22:55
openstackgerritRamy Asselin proposed openstack-infra/puppet-openstackci: Initial sphynx doc setup for publishing  https://review.openstack.org/25924522:55
clarkbso if we copy say nova, the gc with gerrit and with git we can compare the results22:55
clarkbthat may not be sufficient to say one eay or another though22:55
jeblairclarkb: the trick is we're starting with a repacked nova repo22:55
jeblairafter a week, the effect might be noticable, i don't know22:56
*** woodster_ has quit IRC22:56
jeblairi know that when we established the repack command it was *hundreds of mb* of difference22:56
jeblairso pretty easy to spot :)22:56
anteayashould gc happen prior to each repack?22:57
*** mriedem is now known as mriedem_away22:57
*** sputnik13_ has joined #openstack-infra22:57
tonybcan @irc-ops please update the topic in #openstack-stable to "reviews: http://tiny.cc/os-stable-dash issues: https://etherpad.openstack.org/p/stable-tracker"22:58
jeblairanteaya: i believe the operations performed by a gc are included in our repacks22:58
jeblairtonyb: i don't know what the '@' sign there was for22:58
anteayajeblair: ah22:58
jeblairtonyb: but i'm happy to update it22:58
anteayaI think @is a hipchat ism22:58
anteayaand hipchatters get confused, I saw one in backscroll using hipchat isms22:59
tonybjeblair: Oh somehow I thought that was the accpeted way of denoteing a group rather than individual22:59
* tonyb dosn't know what hipchat is22:59
anteayatonyb: the only group we have in this channel is infra-root22:59
anteayawhich you signal by typing the name22:59
anteayatonyb: lucky you23:00
*** nelsnels_ has quit IRC23:00
tonybanteaya: Ah okay23:00
mordredanteaya: it's not just hipchat, it's also twitter and github and slack23:00
clarkbjeblair gerrit didnt do it until a much newer version aiui23:00
*** nelsnelson has joined #openstack-infra23:00
mordredanteaya: amazingly, people tell me those have "better" UIs than IRC even though they don't have tab-completion without an @ prefix23:00
anteayamordred: @here is from hipchat I do believe23:01
anteayathe person earlier was @here'ing in channel23:01
mordredanteaya: ah. yeah. that isn't going to work :)23:01
*** bharathm has joined #openstack-infra23:01
mordredthe best way to say something to everyone in the channel is ... to say something23:01
pleia2@here and @all are a huge reason I won't use hipchat ;)23:01
anteayawhich is why I figured hipcaht23:01
mordredpleia2: ++23:01
anteayapleia2: I hear that23:01
pleia2(also it crashes all the time in linux and it's not in my workflow)23:01
anteayamordred: yup23:01
mordredpleia2: it's also not open source, and doesn't use an open protocol, and provides no value that I do not receive from things that are open source on open protocols23:02
mordredpleia2: so, basically, yes :)23:02
*** dahoo has joined #openstack-infra23:02
pleia2mordred: yeah23:02
clarkbjeblair I think it is safe to keeo running out of band repacks23:03
craigemordred +123:03
clarkbso easiest thing is leave it as is23:03
jeblairclarkb: cool; then someone with lots of extra time can figure out if 'gerrit gc' is not worse :)23:03
jeblairi'm using the gertty topics feature to review puppet-* changes!23:04
craigeoh, I'll have to play with that feature.23:04
jeblaircraige: i haven't landed it yet, it's here: https://review.openstack.org/26008523:05
openstackgerritMerged openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's sendmail.includeDiff option  https://review.openstack.org/26028323:05
*** ildikov is now known as ildikov_afk23:05
jeblaircraige: if you try it out, make a copy of .gertty.db first because it includes a database migration23:05
craigeah, I wondered why I hadn;t seen it :-D23:05
openstackgerritMerged openstack-infra/puppet-gerrit: Allow puppet to configure the Gerrit's garbage collection options  https://review.openstack.org/26207223:05
openstackgerritMerged openstack-infra/puppet-gerrit: Fix Gerrit's puppet mimetype specifier  https://review.openstack.org/26260123:06
dahooclarkb: hi, i can't login to review.o.o with lp openid today, it kept redirecting me to https://review.openstack.org/#SignInFailure,SIGN_IN,Contact+site+administrator23:06
*** Daisy_ has joined #openstack-infra23:06
jeblairmordred: can you https://review.openstack.org/258718 :)23:06
openstackgerritMerged openstack-infra/puppet-gerrit: Allow direct download of .properties files  https://review.openstack.org/26260323:07
jeblairdahoo: can you log into launchpad itself?23:07
mordredjeblair: done23:07
mordredjeblair: what is that warning?23:07
dahoojeblair: yes23:07
jeblairmordred: docaedo got it talking to rax i think?23:07
*** jtomasek has quit IRC23:07
mordredjeblair: that's so nice23:08
zarojeblair, clarkb : i believe gerrit can schedule a git gc, i'm not sure if a gc includes a repack.  as far as i am aware you cannot schedule a git repack thru gerrit.23:08
dahoojeblair: i delete one email address that was not used anymore in my lp account. it might have caused the issue23:08
* docaedo reads backscroll in hopes of finding out what he did to rax23:09
dahoojeblair: my previous account is zhaoxinyu@huawei.com and the current one is xyzjerry@gmail.com23:09
*** kzaitsev_mb has joined #openstack-infra23:09
*** dingyichen has joined #openstack-infra23:09
jeblairmordred, docaedo: and i think it's in very-new-requests23:09
TheloHi all, I just deploy a CI using : http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/README.md, at the end, should there be jobs automatically loaded inside jenkins or I need to load some by myself.23:09
zarojeblair, clarkb: i think https://review.openstack.org/181965 should be abandoned.23:10
jeblairThelo: i think there's a single test job that should be there23:10
openstackgerritMerged openstack-infra/requestsexceptions: Add SNIMissingWarning  https://review.openstack.org/25871823:10
asselin_Thelo, there should be jobs loaded23:10
clarkbzaro ok can do23:10
*** Daisy_ has quit IRC23:11
docaedojeblair: I don't specifically remember the rax bit, but I know that 258728 fixed at least one of the SSL connections that made my link check thing have the sads23:11
TheloOO23:11
Theloif there is none23:11
Thelowhat should I look at?23:11
*** e0ne has quit IRC23:11
craige261412 is a minor change that could do with an eye over it at your leisure jeblair.23:12
jeblairdocaedo, mordred: requestsexceptions 1.1.2 tag pushed23:12
asselin_Thelo, which project-config repo did you use to start with?'23:12
docaedoway to ring in the new year jeblair!23:12
openstackgerritMerged openstack/gertty: Updated Debian availability.  https://review.openstack.org/26141223:12
jeblaircraige: thanks :)23:12
*** ddieterly has joined #openstack-infra23:13
zarojeblair: gerrit wip plugin is still a no go.  how it's currently implemented doesn't really work right and the right way won't get accepted upstream. I asked DavidO about it at the gerrit hackathon and he said that he's pretty much given up on that.23:13
openstackgerritMerged openstack-infra/puppet-gerrit: Fix to allow Gerrit to download html files directly  https://review.openstack.org/26260523:14
*** gsagie has quit IRC23:14
jeblairclarkb: status of https://review.openstack.org/242715 ?23:14
*** baoli has quit IRC23:14
openstackgerritMerged openstack-infra/puppet-gerrit: Allow puppet to configure Gerrit's receive.maxObjectSizeLimit option  https://review.openstack.org/26261023:14
clarkbjeblair we implemtned the groovy init fix instead, could add that as belt and suspenders or abandon ifwe are happy with groovy23:15
jeblairzaro: hrm.  that's really unfortunate.  i thought it worked in 2.11 and that's a big thing we were hoping to get out of the upgrade.23:15
Theloasselin_: https://git.openstack.org/cgit/openstack-infra/project-config-example23:15
zarojeblair: maybe the last ditch effort is to change gerrit so that states are extendable (i don't believe it is yet).  so that a new state can be added thru the plugin.23:15
Thelothis one23:15
ddieterlyseems like our tempest tests in our gate are failing now23:16
jeblairzaro: perhaps focusing on making sure that notedb can support the concept would be better?23:16
ddieterlyis there an irc channel for tempest?23:16
asselin_Thelo, yeah, that one creates 2 jobs I believe. Do you have your puppet output saved?23:16
Thelosure23:16
Thelolet me paste it23:16
jeblairddieterly: #openstack-qa23:16
ddieterlythanks23:16
zarojeblair: the concept of wip or concept of extendable states?23:16
*** dimtruck is now known as zz_dimtruck23:16
jeblairzaro: either :)23:16
zarojeblair: yeah, makes sense.23:17
*** edmondsw has quit IRC23:17
dahoojeblair: ssh also failed23:17
Theloasselin_: here http://paste.openstack.org/show/482982/23:17
clarkbI wonder if dahoo's account was inactivated?23:17
clarkbdahoo what is the account username/email?23:18
jeblairthat makes more sense if ssh failed23:18
clarkbdahoo and is the account used for CI?23:18
dahooclarkb: Jerry Zhao xyzjerry@gmail.com23:18
dahooclarkb: no23:18
clarkb( I have to feed some babies but can check after)23:19
asselin_Thelo, do you have the output for when you ran puppet the first time?23:19
anteayaclarkb: enjoy babies23:19
*** piet has quit IRC23:19
dahooclarkb: thanks23:19
*** piet has joined #openstack-infra23:20
Thelodoes puppet save the output somewhere? if nom then I don't have it23:21
*** tchaypo has quit IRC23:21
*** tchaypo has joined #openstack-infra23:21
pleia2Thelo: should land in /var/log/syslog23:22
pleia2(though I'm making a lot of assumptions here)23:22
jheskethjeblair: do you have a few minutes to discuss zuulv3?23:22
jeblairjhesketh: yep23:23
Theloasselin_: no I don't have then23:23
asselin_Thelo, check the contents of /etc/jenkins_jobs/config/23:23
asselin_there should be some files there. You can delete them and run puppet again. save that output23:23
jheskethjeblair: now most of the connection stuff has merged, I'd like to be helping out more with the v3 work since I put my hand up.. but it's not clear what the best way to divide that up is or where/what you're up to23:24
jheskethare you tracking the work in an etherpad or something per chance?23:24
jheskethor phrased another way, what else could I be doing to help23:24
jeblairjhesketh: yeah, i've been thinking about that as well.  i've been really roughly attacking the code in changes i've pushed up to gerrit; i think i have some of the really substantial changes at least roughed-in so we can start to see what it looks like23:26
crinklemordred: could you validate whether the last four patchsets from https://review.openstack.org/#/c/198417 are consistent with what you intended as its author?23:26
Theloasselin_: Here, ( now I can see three jobs ) http://paste.openstack.org/show/482984/23:27
dahooclarkb: i am sorry, ssh works. but web login still fails23:27
jeblairjhesketh: i'm wondering if maybe the way forward is to merge that and then start finding smaller areas we can divide an conquer23:27
loquacitiesjhesketh:  just caught up on the docimpact thing23:27
*** gsagie has joined #openstack-infra23:28
jheskethjeblair: yep, so that refactoring is ready for review?23:28
asselin_Thelo, ok...seems there a race or something that caused them to fail loading...23:28
*** baoli has joined #openstack-infra23:28
jeblairjhesketh: a lot of other people put up their hands too, but some of them have different jobs now, so we may want to get another show of hands23:28
*** angdraug has quit IRC23:29
jheskethjeblair: if we divide the work first that might make it easier for people to see what they're raising their hands for23:29
jheskethjeblair: but we could also do a call for reviews if its up to that point yet23:29
jeblairjhesketh: well, i mean, it's terrible -- we would never merge that into the master branch.23:29
jheskethI've held off, for example, as I wasn't sure if it was ready23:29
clarkbdahoo then the account is active23:29
jeblairjhesketh: it doesn't even really work -- all it does is make a single demonstation test pass (but it does do that :)23:30
dahooclarkb: just openid failed to work23:30
*** larainema has joined #openstack-infra23:30
*** baoli has quit IRC23:30
jheskethyeah, so maybe the steps are: 1) define the work to be done after the existing refactors are merged, 2) use that to help create some guidelines on how to review the existing work (ie, it's fine that the tests are turned off for example)23:30
jeblairjhesketh: so if we go with this approach, i think it's worth looking at those changes so we can all follow the progression together and make suggestions, etc... but i'd like to just fall forward and fix things in future patches rather than rebase, etc.23:31
*** baoli has joined #openstack-infra23:31
openstackgerritDoug Wiegley proposed openstack-infra/nodepool: WIP - nodepool setting to make it easier to use neutron provider nets  https://review.openstack.org/26347623:31
jheskethjeblair: so you're saying read, but don't review and just +W them?23:32
Theloasselin_: thanks, is there anything that will trigger jenkins jobs by default?23:32
jeblairjhesketh: yeah?  give that a shot?  if something looks bad, fix it in a new commit? :)  we won't hold to this forever, but here in the really early days, i think it'll help us move quickly -- since we don't need to keep everything working, which is our usual goal -- we actually need to break everything for a bit :)23:33
*** boris-42 has joined #openstack-infra23:33
jheskethjeblair: works for me.. I'll read through the patches and +2 them. Do we still want to require 2*cores23:34
jeblairjhesketh: most of those commits actually tell a decent, if rough, narrative, one of them is just a mess.  sorry.23:34
jheskethor to help reduce reviewer load maybe we just merge them?23:34
jheskethheh, to be expected in such a large refactor though23:34
jeblairjhesketh: yeah, i'm leaning toward merge these as a starting plase, then divide up the work as you suggest (having gone over this will help understand that work better) and work from there23:35
jheskethsounds good23:35
*** pradk has quit IRC23:35
jeblairjhesketh: i have one more patch in my head that i'd like to get in, so maybe we can aim for discussing this in earnest at next week's meeting (or around then if you can't make the meeting)?23:36
jheskethI'll try and review them all today.. I've skimmed a couple so I should be able to get through them (I am, however, taking some leave from tomorrow until next tuesday)23:36
jeblairjhesketh: oh that sounds like it might work out for both of us then :)23:36
jheskethdiscussing the division of the work?23:36
jeblairjhesketh: yeah23:36
jheskethyep, I'll be at that meeting23:37
jeblairjhesketh: and letting folks now it's time to get involved :)23:37
*** baoli has quit IRC23:37
jeblair'letting folks know'23:37
jheskethsounds good to me :-)23:37
jeblairw00t23:37
openstackgerritgreghaynes proposed openstack/diskimage-builder: Run package-intalls with py3k if we must  https://review.openstack.org/25438623:37
jeblairclarkb: now i hear that patch saying "nobody loves me"23:38
jheskethjeblair: in semi-zuul relatedness, there are some changes for enable_swift which affect zuul: https://review.openstack.org/#/q/status:open+topic:enable_swift23:38
jheskethclarkb: ^ if you have some time for enable_swift reviews23:38
jeblairjhesketh: oh sure23:39
jheskethjeblair: hopefully small enough to do before v323:39
jeblairyeah, i think that fits into what we should be maintaining in v2 :)23:39
asselin_Thelo, sorry need to step away. note that there's a bug so running on master doesn't work currently23:39
jheskethcoolioi23:39
asselin_Thelo, you need to run on a jenkins slave23:40
jheskethjeblair: the other one to discuss is the sqlalchemy one... if you've got a moment, can we discuss that to unblock it please? (even if the outcome is "it waits until after v3")23:40
*** bharathm has quit IRC23:40
jeblairjhesketh: which is that?23:41
jheskethhttps://review.openstack.org/#/c/223333/23:41
jheskeththere were 2 discussions. 1) which engine(s) to support, and 2) alembic/multiple table support23:41
*** asselin_ has quit IRC23:41
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Initial add of gentoo support for diskimage-builder  https://review.openstack.org/26334923:41
jheskethso #1 I think I agree with you. If we want to support other engines we can do that another time, so lets just stick with mysql and only test that23:42
jeblairwhew23:42
jhesketh#2 using alembic (which I think is a good idea) made it too difficult to support different tables for results... Different tables could be a useful feature, but not one I care enough about to find a solution just yet23:43
jheskethie if it becomes important later maybe we could find a solution later23:43
jheskethalthough we should perhaps check with mtreinish how he wants results stored for os-health23:43
jeblairyeah, what's the use case for multiple tables?23:44
*** nmagnezi has quit IRC23:44
Theloasselin_: sorry it might be a stupid question but how do I do this? it is simply run a build with a specifc ZMQ event publisher label expression?23:44
*** tzn has quit IRC23:45
mtreinishjhesketh: well I'm not sure the schema matters too much as long as there is a python api for getting at it23:45
*** erlon has quit IRC23:46
*** sigmavirus24 is now known as sigmavirus24_awa23:46
jheskethjeblair: originally a zuul reporter didn't know if a paritcular build set had passed or failed.. it just knew it had to report to a certain reporter23:46
jheskeththat's now refactored enough that we can store a pass/fail in the table23:47
zarojeblair: would you mind taking another look? https://review.openstack.org/#/c/262053/23:47
jheskethbut before then it was useful to have a table for passed builds and one for failed builds23:47
jheskethso that's the history23:47
zaroi will am making more changes like that23:47
jheskeththe other reason would be table size... you could truncate/store a passed table more aggressively than you would a failed table, for example23:48
lifelessdoes infra have a policy on things like the curlsh in https://review.openstack.org/#/c/245362/ ?23:48
jheskethalthough this was before the use case of os-health where keeping the stats is important23:48
jheskethbasically it'd just be as a db optimisation at this point (since the rest can be determined from a query) so it's probably something we can worry about in the future23:49
jeblairzaro: my -1 stands.  in that module unspecified parameters default to '' and we should not write them to config files if they are set like that.  we should be consistent and do that for every parameter.  most of your other changes were fine.  only that one and one other went afoul of the standard.23:49
clarkblifeless ww dont want to gate eg nova on that, but if the test is just for tooz then I dont think we care23:49
*** bharathm has joined #openstack-infra23:49
*** yuanying has quit IRC23:50
jeblairjhesketh: my general feeling is that having zuul manage a single table (or known set of tables rather that arbitrary user defined table names with zuul-defined schemas) and do so using alembic is good.23:50
jheskethyep, I'm in agreement23:51
jeblairjhesketh: i think that a more complicated schema (including zuul-defined user-named tables) is crossing a boundary of concerns, and would like to avoid that23:51
jheskethsure23:51
jeblairjhesketh: (because negotiating who is responsible for the schema starts to get complicated)23:51
*** yuanying has joined #openstack-infra23:51
jheskethokay, so the main thing is to re-roll the patch for just mysql support and make use of the opportunistic testing23:51
jeblairjhesketh: yeah, and i think at least for the moment, all our use cases can handle a single table, so stick with that23:52
zarojeblair: ok, i was a bit confused.  i thought you wanted all vars to take strings as default instead of mixing strings and integers.23:52
jeblairzaro: i think sshd_batch_threads should default to '', and iff it is not '' should we write the value to the file23:53
zarobut your actually talking about setting not setting them if the var is not specified.23:53
TheloHi all, in my case nodepool fails to ssh one of its node (http://paste.openstack.org/show/482987/),  I notice that the node running has no key, so how does nodepool ssh the machine?23:53
zarojeblair: ok. i get it.23:53
jeblairzaro: (basically, it should also look just like the existing "sshd_threads" argument)23:54
openstackgerritMerged openstack-infra/puppet-jenkins: Add cli manifest to Jenkins  https://review.openstack.org/22292323:55
jheskethjeblair: coolio, thanks23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!