Thursday, 2014-10-02

anteayaasalkeld: I'm going with yes, and ttx is the best person to advise you how to proceed00:02
asalkeldok - I am assuming we need to wait00:03
anteayaasalkeld: I'd say that is the safe position00:04
anteayaasalkeld: have you seen this yet? https://wiki.openstack.org/wiki/Branch_Model00:04
anteayamight be useful00:04
asalkeldyeah, been reading that00:04
anteayagreat00:04
asalkeldbut no metion of the commit to "open development"00:04
anteayaasalkeld: this page is good too https://wiki.openstack.org/wiki/PTL_Guide00:04
asalkeldand what happens next00:04
*** mikedillion has quit IRC00:04
asalkeld:-O00:04
anteayaasalkeld: k, perhaps after you learn you could add that section00:05
anteayathe what happens next section00:05
asalkeldsure, sounds like a plan00:05
anteayayeah I'd look for ttx around 10:00 utc tomorrow00:05
anteayahe is your best guide00:05
asalkeldthanks00:06
anteayanp00:06
anteayahappy ptl'ing to you00:06
asalkeldyeah, i hope it's fun and not a drag00:06
anteayait will be fun and a drag00:07
anteayarelish the fun00:07
asalkeldlol00:07
anteayaand recognize that many people depend on you to do the work correctly that is a drag00:07
anteayayou won't know they even know you exist until after the release is out00:07
anteayabut they are there, and they need you00:07
asalkeldsure00:07
*** gyee has quit IRC00:08
anteayaand asking lots of questions is a good direction00:08
anteayaso you are off to a great start00:08
asalkeldsounds a bit like a star wars quote that:-O00:08
anteayaha ha ha00:08
* anteaya adjusts her green ears00:08
*** mikedillion has joined #openstack-infra00:08
asalkeld:-)00:09
anteaya:D00:09
*** _buzz has joined #openstack-infra00:11
*** IAX has quit IRC00:11
*** camunoz_ has quit IRC00:16
*** todd_dsm has joined #openstack-infra00:23
*** todd_dsm has quit IRC00:24
*** ivar-laz_ has quit IRC00:24
*** ivar-lazzaro has joined #openstack-infra00:25
*** ivar-lazzaro has quit IRC00:25
*** ivar-lazzaro has joined #openstack-infra00:26
*** chuckC_ has quit IRC00:26
*** zz_dimtruck is now known as dimtruck00:27
*** ivar-lazzaro has quit IRC00:28
*** ivar-lazzaro has joined #openstack-infra00:28
*** reed has quit IRC00:30
*** praneshp has quit IRC00:31
*** ChuckC has quit IRC00:36
openstackgerritAaron Rosen proposed a change to openstack-infra/project-config: Add publish-to-pypi job for python-congressclient  https://review.openstack.org/12518900:38
*** rmcall has quit IRC00:38
*** yamahata has quit IRC00:41
*** bhuvan has quit IRC00:41
larsksDo folks here manage ask.openstack.org? It seems to be throwing "504 gateway timeout" errors in response to (some?) edit operations.00:45
jaypipesmordred: what did I do now?00:45
clarkblarsks: it is run by the askbot folks00:46
*** bdpayne has quit IRC00:46
larsksclarkb: Huh. Okay. How do we contact the askbot folks?00:47
clarkbI think via reed who isn't here00:47
* clarkb finds him00:47
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add fingerprint for  bug 1376526  https://review.openstack.org/12552600:49
uvirtbotLaunchpad bug 1376526 in openstack-ci "retrying 1.3.0 is broken" [Undecided,Invalid] https://launchpad.net/bugs/137652600:50
*** rainya has quit IRC00:53
*** mestery has quit IRC00:54
openstackgerritClark Boylan proposed a change to openstack-infra/gearman-plugin: Add more logging to saveable listener  https://review.openstack.org/12552700:55
*** armax has left #openstack-infra00:57
*** gokrokve has joined #openstack-infra00:57
*** gokrokve has quit IRC00:57
*** gokrokve has joined #openstack-infra00:58
*** yamamoto has joined #openstack-infra00:59
*** gokrokve_ has joined #openstack-infra01:01
*** praneshp has joined #openstack-infra01:02
*** reed has joined #openstack-infra01:03
*** gokrokve has quit IRC01:04
reedlarsks, ask.openstack.org is managed by a contractor at the moment, although we'd like to have it fully puppetized and have more people capable of fixing it01:06
larsksreed: Thanks. Was hitting a bunch of gateway timeouts and just curious if I should report it somewhere.01:06
*** sarob is now known as sarob_away01:06
reedlarsks, best way to report is on bugs.lanchpad.net/openstack-community and I usually assign them to Evgeny01:07
larsksWill do, thanks!01:07
reedthank you larsks01:08
*** mikedillion has quit IRC01:08
reedlarsks, and if you know any capable puppetizer, I'd be happy to give her/him a contract to improve the situation01:09
*** ChuckC has joined #openstack-infra01:09
*** gokrokve_ has quit IRC01:11
*** chuckC_ has joined #openstack-infra01:11
*** ramashri has quit IRC01:12
*** sdake_ has joined #openstack-infra01:13
*** SumitNaiksatam has quit IRC01:16
*** gokrokve has joined #openstack-infra01:17
*** mriedem has joined #openstack-infra01:18
jogoclarkb: do we support pip < 1.4 in devstack01:18
jogoor anywhere01:18
dstufftjogo: I don't think so01:19
dstufftbut I could be wrong01:19
clarkbno I think pbr drew that line in the sand way back before hong kong01:20
jogocool01:20
dstufftpip < 1.4 is crummy anyways01:20
dstufft:D01:20
jogodstufft: we can drop the workaround for https://github.com/pypa/pip/issues/70901:20
SergeyLukjanovanteaya, It's needed for old versions. The 2014.2 is the first version for Murano done openstackish01:20
*** ramashri has joined #openstack-infra01:21
dstufftah yea01:21
dstufftthat bug was particularly confusing to people :/01:21
jogoI bet01:21
jogodstufft: https://review.openstack.org/12553201:25
*** sdake_ has quit IRC01:26
*** otter768 has joined #openstack-infra01:26
*** yamahata has joined #openstack-infra01:26
*** bknudson has quit IRC01:27
*** dmsimard_away is now known as dmsimard01:27
anteayaSergeyLukjanov: ah okay01:27
*** bknudson has joined #openstack-infra01:27
*** dmsimard is now known as dmsimard_away01:28
*** gokrokve_ has joined #openstack-infra01:29
anteayaI added that information as a comment on the patch01:30
*** gokrokve has quit IRC01:30
anteayafungi clarkb there is no release group, when this patch merges, the missing group will be created? https://review.openstack.org/#/c/125451/1/gerrit/acls/stackforge/murano.config01:31
*** ivar-lazzaro has quit IRC01:31
*** wenlock has joined #openstack-infra01:32
fungianteaya: yeah, or we can rename the milestone group to release manually01:32
*** dkehnm has left #openstack-infra01:35
*** _buzz has quit IRC01:35
*** yamamot__ has joined #openstack-infra01:54
*** dimtruck is now known as zz_dimtruck01:54
*** reed has quit IRC01:55
*** yamamoto has quit IRC01:56
*** tsg has quit IRC01:57
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add fingerprint for  bug 1376526  https://review.openstack.org/12552602:03
uvirtbotLaunchpad bug 1376526 in openstack-ci "retrying 1.3.0 is broken" [Undecided,Invalid] https://launchpad.net/bugs/137652602:03
*** amotoki has joined #openstack-infra02:03
jogowhat was the logstash blackout time frame? the weekend?02:03
jogoso 27th 28th02:04
*** Ryan_Lane has quit IRC02:07
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug #1375108  https://review.openstack.org/12554002:08
uvirtbotLaunchpad bug 1375108 in nova "Failed to reboot instance successfully with EC2 " [High,Confirmed] https://launchpad.net/bugs/137510802:08
*** otter768 has quit IRC02:09
clarkbjogo: ya about that02:09
fungijogo: probably into monday morning since i restarted and lost the queue02:10
anteayafungi: okay thanks I will approve the patch and we can see if the group gets created02:11
*** nosnos has joined #openstack-infra02:14
openstackgerritA change was merged to openstack-infra/project-config: Use correct groups for murano acls  https://review.openstack.org/12545102:15
anteayahow long should it take for the group to be created if it will be?02:15
jheskethanteaya: probably around 15min02:16
fungiyeah, between 15 and 3002:16
fungiit likely just missed the 02:15 pulse02:16
fungiand the puppet run takes somewhere on the order of 10 minutes to complete02:17
fungiso maybe ~02:25 utc check it again02:17
*** sdake_ has joined #openstack-infra02:17
anteayak thanks02:18
anteayafound it: http://puppetboard.openstack.org/node/review.openstack.org02:18
*** ramashri has quit IRC02:22
*** gokrokve_ has quit IRC02:23
anteayacreated: https://review.openstack.org/#/admin/groups/?filter=mur02:27
anteayaSergeyLukjanov: I guess you can add who you need in there02:28
*** otter768 has joined #openstack-infra02:30
*** unicell has joined #openstack-infra02:37
*** shashankhegde has quit IRC02:41
*** sdake_ has quit IRC02:46
SergeyLukjanovanteaya, yeah, thanks02:46
fungiand sorry about several of us going silent on everyone for the past 4+ hours, but https://wiki.jenkins-ci.org/display/SECURITY/Jenkins+Security+Advisory+2014-10-01 (all our jenkins masters are upgraded to 1.565.3 now)02:49
openstackgerritA change was merged to openstack-infra/project-config: Rename the keystone-formula project name  https://review.openstack.org/12424702:51
fungiSergeyLukjanov: why did 124247 get approved?02:53
fungiSergeyLukjanov: we need a maintenance window to do that02:53
SergeyLukjanovfungi, oh, crazy me02:53
SergeyLukjanovfungi, /me propozing a revert02:53
clarkbyou will need to stop puppet real quick too02:53
*** flaviof_zzz is now known as flaviof02:53
fungii just did02:53
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Revert "Rename the keystone-formula project name"  https://review.openstack.org/12554402:54
*** andreaf has quit IRC02:54
fungirun_all.sh was in progress so i killed it with prejudice02:54
*** andreaf has joined #openstack-infra02:54
SergeyLukjanovfungi, clarkb, sorry about this :(02:55
*** yfried|afk has quit IRC02:55
fungiSergeyLukjanov: no worries, just be careful ;)02:55
fungisimply glad i spotted it as soon as it landed02:55
SergeyLukjanovfungi, /me decided to start reviewing infra to help the world02:56
fungiSergeyLukjanov: appreciated!02:56
openstackgerritA change was merged to openstack-infra/project-config: Stop accessbot joining #openstack-packaging  https://review.openstack.org/12485302:56
openstackgerritA change was merged to openstack-infra/project-config: Add merge-check to pylockfile, test for merge-check  https://review.openstack.org/12458802:56
SergeyLukjanovfungi, but I missed the most important part of preparation for it - several cups of coffee02:56
fungibeen there myself02:56
openstackgerritA change was merged to openstack-infra/project-config: Remove github-org from projects.yaml  https://review.openstack.org/12516902:57
fungianyway, you'll want to repropose the original change too, but mark it wip or something (and leave a comment about the old change number so we can see prior review history)02:57
anteayaI've set workflow -1 on the other rename patch this person has: https://review.openstack.org/#/c/124252/02:57
fungianteaya: thank you very much!02:57
SergeyLukjanovfungi, the 2 weeks of the whole days meeting distracting me as anything else could...02:58
SergeyLukjanovfungi, working on re-pushing initial patch02:58
fungiappreciated. probably would be a good idea for someone to also update the link to that patch in the weekly meeting agenda wiki when there's a spare moment02:58
SergeyLukjanovfungi, will do02:59
anteayaSergeyLukjanov: https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames03:00
*** yamamot__ has quit IRC03:01
*** zz_jgrimm is now known as jgrimm03:01
SergeyLukjanovanteaya, yeah, thx, I've never forget this address  :)03:01
anteayafungi: and yay for upgraded jenkins masters03:01
openstackgerritA change was merged to openstack-infra/project-config: Revert "Rename the keystone-formula project name"  https://review.openstack.org/12554403:01
anteayathanks all yon quiet folks03:01
fungiokay, now that's ^ landed i can start puppet again03:01
SergeyLukjanovfungi, yeah, thx03:02
fungidone03:02
*** praneshp has quit IRC03:02
*** yamamoto has joined #openstack-infra03:02
*** hdd has joined #openstack-infra03:02
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Rename the keystone-formula project name  https://review.openstack.org/12554603:02
anteayawe have both -1W'd it03:03
anteayait shall not pass03:03
anteaya:D03:03
*** unicell has quit IRC03:04
fungii don't see the temporarily-new name for that project on gerrit or the git servers, so seems we caught it in the nick of time03:04
anteayayay03:04
anteayafast trigger finger03:04
SergeyLukjanovanteaya, any reason https://review.openstack.org/#/c/124251/ isn't approved?03:05
SergeyLukjanovanteaya, yup, double guarantee ;)03:05
anteayaSergeyLukjanov: nope03:05
SergeyLukjanovanteaya, okay03:05
anteayajust space for everyone to pile on03:05
anteayawe have to keep those review stats up03:05
fungias for the jenkins upgrades, the security threat is past but we have a semi-annoying incompatibility with the new version and the gearman plugin. clarkb and zaro are working through it, but it shouldn't cause any serious issues in the meantime. mostly it could delay job reregistration if we merge changes which change jenkins node labels on jobs, possibly causing them to get the dreaded NOT_REGISTERED03:06
fungistatus in zuul for a bit03:06
anteayaokay03:07
clarkbbut it should be eventually consistent and things will be happy after a time03:07
fungiright03:07
anteayaso if that happens recheck is the way forward?03:07
clarkbjust keep an eye out for that and let us know if it doesn't end up going away after job changes are made03:07
clarkbanteaya: well we want to fix the bug03:07
anteayaspin the wheel and try again?03:07
clarkbI am about to hit jenkins-dev with a ahammer to get more info on it03:07
fungirecheck is the temporary hamster wheel workaround03:07
anteayaawesome03:07
fungispeaking of hamster wheels, mine needs a break so i'm gonna head to bed. night all03:08
*** openstackgerrit has quit IRC03:08
anteayanight fungi03:08
anteayaopenstackgerrit took off03:08
anteayaapparently it thinks fungi is onto a good idea03:08
*** sarob_away is now known as sarob03:09
fungihrm, yeah, i'll fix it real quick03:09
*** pcrews has quit IRC03:10
*** openstackgerrit has joined #openstack-infra03:10
fungiit's all better now (and i'm _really_ going afk this time)03:10
anteayathanks03:10
anteayaand good night again03:11
anteayaand I think that is a really good idea as well03:11
anteayanight03:11
SergeyLukjanovfungi, night03:11
SergeyLukjanovnight anteaya03:11
anteayanight SergeyLukjanov03:12
anteayaand thanks :D03:12
openstackgerritA change was merged to openstack-infra/project-config: Add nova-salt-formula project  https://review.openstack.org/12424803:12
openstackgerritA change was merged to openstack-infra/project-config: Add python and pypi jobs for monasca-persister  https://review.openstack.org/12489903:13
*** homeless has quit IRC03:14
openstackgerritA change was merged to openstack-infra/project-config: Fuel-stats repo for Fuel  https://review.openstack.org/12477303:16
openstackgerritA change was merged to openstack-infra/project-config: Add cinder-salt-formula project  https://review.openstack.org/12424903:18
*** openstackgerrit has quit IRC03:18
*** openstackgerrit has joined #openstack-infra03:18
*** sarob is now known as sarob_away03:18
clarkbso after hitting jenkins-dev a bit with a very loggy build of the plugin I can't reproduce the problems :(03:21
clarkbI think this must be a race in jenkins somewhere03:21
clarkbwhich is why we evenually see it be consistent03:21
*** mmedvede has quit IRC03:23
*** SumitNaiksatam has joined #openstack-infra03:24
*** oomichi has joined #openstack-infra03:25
openstackgerritA change was merged to openstack-infra/devstack-gate: Rename subunit_log.txt to testrepository.subunit  https://review.openstack.org/11806903:26
*** shashankhegde has joined #openstack-infra03:27
*** sarob_away has quit IRC03:28
*** sdake_ has joined #openstack-infra03:29
*** nosnos has quit IRC03:29
*** nosnos has joined #openstack-infra03:30
*** flaviof has quit IRC03:30
clarkbzaro: fungi: I have a theory on what that race is. Its is iterating through all the executors and registering them one at a time03:32
clarkbzaro: fungi: if a node for a label goes away while we are looping that won't be registered and you have to wait for the next round03:33
clarkbmore and more I Think this is less of a critical bug and more of a :/ bug03:33
*** nosnos has quit IRC03:34
clarkbzaro: though I do notice that if we have a job with no labels we don't register that job for all labels. I can't remember if that is what we want or if we want it to be registered for all label03:35
*** mriedem has quit IRC03:41
dimssdague: finally got the thing working! (toggle the button) - had to use apache2 to redirect/proxy to review.apache.org with an exception for hideci.js as chrome did not like me overriding stuff from window.onload - here's my httpd.conf snippet if anyone ends up doing this again03:45
dimssdague: https://gist.github.com/dims/185ed200b3f0a21952ad03:45
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/config: Save last setting of Toggle CI button  https://review.openstack.org/12346403:47
*** praneshp has joined #openstack-infra03:53
*** otter768 has quit IRC03:57
*** praneshp_ has joined #openstack-infra03:57
*** praneshp has quit IRC03:58
*** praneshp_ is now known as praneshp03:58
*** dims has quit IRC04:00
*** dims has joined #openstack-infra04:00
*** bhuvan has joined #openstack-infra04:01
*** shashankhegde has quit IRC04:03
*** dims has quit IRC04:04
*** garyh has quit IRC04:09
*** rushiagr_away is now known as rushiagr04:12
*** todd_dsm has joined #openstack-infra04:13
*** garyh has joined #openstack-infra04:19
*** nosnos has joined #openstack-infra04:19
*** oanufriev has joined #openstack-infra04:23
*** timrc is now known as timrc-afk04:24
*** garyh has quit IRC04:26
*** flaviof_zzz has joined #openstack-infra04:30
*** sarob_away has joined #openstack-infra04:31
*** koolhead17 has joined #openstack-infra04:37
*** koolhead17 has joined #openstack-infra04:37
zaroclarkb: we are registering that job with all executors, that seems to be working.04:47
zaroclarkb: that's a very likely bug you pointed out but that would not be a new bug.04:48
*** gokrokve has joined #openstack-infra04:50
*** todd_dsm has quit IRC04:51
clarkbzaro ya so I dont think this is badly broken04:51
clarkbzaro I dont see jobs with no label registered under all available labels though04:52
*** praneshp has quit IRC04:54
zaroclarkb: they get registered in my setup.04:55
zaroclarkb: i built the plugin against LTS 1.565.3 and am testing it now.  seems like it's working as expected to me.04:56
*** garyh has joined #openstack-infra04:56
zaroclarkb: should i put this build on jenkins-dev?04:58
openstackgerritJoe Gordon proposed a change to openstack-infra/project-config: Add a new openstack-specs repo under the control of the TC  https://review.openstack.org/12550804:59
*** harlowja is now known as harlowja_away05:00
clarkbzaro they are not registed on jenkins dev05:00
clarkbonly jobname is registered. not jobname:foo and jobname:bar and jobname05:01
zaroclarkb: I get those as i am testing.05:01
clarkbzaro also please push the changes necessary to build against newer jenkins. it didnt work for me05:01
clarkbzaro huh05:01
zaroclarkb: only tests failures, it builds and will run.05:02
zaroclarkb: should we test with my build on jenkins-dev?05:02
clarkbI cant buuld it because the test breaks and mvn package fails05:02
clarkbzaro we can but you will need to point it at a geard of your own05:03
zaroclarkb: i skipped the tests, i know why they fail. it's because of the trusty1..10 registration thing i told you about earlier.05:03
clarkbI am about to afk. thoufh I think it can wait for tommorrow if you want sleep05:03
clarkbI really dont think hashars bug is really a bug05:04
zarocool with me.  you think i should still install my build on jenkins-dev though?05:04
clarkbits more a combination of a few things that make it look buggy05:04
zaroclarkb: i concur05:04
*** ildikov has quit IRC05:04
clarkbzaro if you are going to test it tonight go for it05:05
clarkbotherwise we can install tomorrow05:05
zarook. i'll do that, fungi may want to monitor tomorrow since he'll be around earlier than us.05:06
zaroclarkb: before you afk, can you clarify tthe repo steps05:06
zaro?05:06
*** sarob_away is now known as sarob05:06
clarkbzaro ya, when jenkins is busy the reregistration is slow05:07
clarkbI think because it iterates through all executors05:07
zaroyes, i believe it does do that.05:08
clarkbso the steps I listed were me trying to reproduce but without contention I failed05:08
clarkbhowever on 03 what I saw looked like it eventually got to it but it could be slow05:08
zaroi wouldn't doubt that.05:09
clarkbso I think it mostly works. also I tested restarting geard and that worked too05:10
zarowell. i'll do a little more testing with my build on jenkins-dev.  will let you know if i uncover soething that doesn't look right.05:11
clarkbzaro before you update it05:12
clarkbzaro check the thing I mention about it not registering all labels for a unrestricted job05:12
zarowill do05:14
*** jgrimm is now known as zz_jgrimm05:14
*** sarob is now known as sarob_away05:16
*** EntropyWorks has joined #openstack-infra05:18
*** HeOS has joined #openstack-infra05:21
*** gokrokve_ has joined #openstack-infra05:24
*** gokrokve has quit IRC05:26
*** gokrokve_ has quit IRC05:28
*** gokrokve has joined #openstack-infra05:29
*** mrmartin has joined #openstack-infra05:33
*** shashankhegde has joined #openstack-infra05:33
*** gokrokve has quit IRC05:36
*** gokrokve has joined #openstack-infra05:36
*** gokrokve has quit IRC05:41
*** hdd has quit IRC05:45
*** amcrn_ has quit IRC05:49
*** Daisy has joined #openstack-infra05:50
*** Daisy has quit IRC05:51
*** todd_dsm has joined #openstack-infra05:53
*** bhuvan has quit IRC05:53
*** HeOS has quit IRC05:59
openstackgerritA change was merged to openstack-infra/project-config: Add publish-to-pypi job for python-congressclient  https://review.openstack.org/12518906:00
openstackgerritA change was merged to openstack-infra/project-config: Port build-image.sh from old config repo  https://review.openstack.org/12425406:05
openstackgerritA change was merged to openstack-infra/project-config: layout: Use default puppet builder for puppet-vswitch  https://review.openstack.org/12457006:07
*** e0ne has joined #openstack-infra06:07
*** oomichi__ has joined #openstack-infra06:08
*** ociuhandu has joined #openstack-infra06:09
*** ildikov has joined #openstack-infra06:10
*** oomichi has quit IRC06:10
*** mrmartin has quit IRC06:12
AJaegerfungi, clarkb: periodic-gerrit-plugin-delete-project failed with compiler error: https://jenkins06.openstack.org/job/periodic-gerrit-plugin-delete-project-gerrit-plugin/18/console06:14
*** flaper87|afk is now known as flaper8706:14
*** stevemar has quit IRC06:20
zaroclarkb, fungi : i have installed my build of the gearman-plugin.  i don't see any problems when updating project labels.  all the functions seem to update as i expect them.06:20
*** mrmartin has joined #openstack-infra06:21
zaroclarkb, fungi : however i did notice that the previous version of the plugin that was there seemed to have the same functions registered.  so maybe clarkb is seeing something that's wrong but I'm not?06:21
AJaegerzaro, fungi is already sleeping, not sure about clarkb06:22
zaroAJaeger: yeah, it's for tomorrow i guess.  i should be sleeping as well.06:22
AJaeger;)06:23
*** _nadya_ has joined #openstack-infra06:23
*** shashankhegde has quit IRC06:25
*** oomichi__ has quit IRC06:27
*** todd_dsm has quit IRC06:27
*** gokrokve has joined #openstack-infra06:29
*** skeppstedt has joined #openstack-infra06:29
*** _nadya_ has quit IRC06:34
*** gokrokve has quit IRC06:34
openstackgerritMarton Kiss proposed a change to openstack-infra/project-config: Add manifest build to groups portal release job  https://review.openstack.org/12549406:34
*** sdake_ has quit IRC06:38
*** camunoz has quit IRC06:42
*** e0ne has quit IRC06:46
*** pkoniszewski has joined #openstack-infra06:48
openstackgerritFlavio Percoco proposed a change to openstack-infra/project-config: Don't run neutron/heat jobs for glance_store  https://review.openstack.org/12556106:50
*** ashaeron has joined #openstack-infra06:51
openstackgerritMarton Kiss proposed a change to openstack-infra/project-config: Add manifest build to groups portal release job  https://review.openstack.org/12549406:52
*** hashar has joined #openstack-infra06:56
*** BOKALDO has joined #openstack-infra06:56
*** yamamoto has quit IRC06:58
openstackgerritFlavio Percoco proposed a change to openstack-infra/project-config: Add a job for functional tests in zaqarclient  https://review.openstack.org/12556206:59
*** jlibosva has joined #openstack-infra07:00
*** sressot has quit IRC07:00
*** sressot has joined #openstack-infra07:03
openstackgerritFlavio Percoco proposed a change to openstack-infra/project-config: Add a gate job for zaqar-redis  https://review.openstack.org/12556307:09
*** wenlock has quit IRC07:10
openstackgerritChristoffer Skeppstedt proposed a change to openstack-infra/jenkins-job-builder: Serialize git-revision param for trigger_builds  https://review.openstack.org/12496507:12
*** dmellado_ has joined #openstack-infra07:12
*** dmellado has quit IRC07:12
*** dmellado_ is now known as dmellado07:12
*** HeOS has joined #openstack-infra07:15
*** arxcruz has joined #openstack-infra07:18
*** rdopieralski has joined #openstack-infra07:22
*** _nadya_ has joined #openstack-infra07:24
*** Guest68510 has joined #openstack-infra07:25
*** mrmartin has quit IRC07:26
*** MaxV has joined #openstack-infra07:27
*** mrmartin has joined #openstack-infra07:27
*** Daisy has joined #openstack-infra07:28
*** yamamoto_ has joined #openstack-infra07:28
openstackgerritChristoffer Skeppstedt proposed a change to openstack-infra/jenkins-job-builder: Serialize git-revision param for trigger_builds  https://review.openstack.org/12496507:28
*** jcoufal has joined #openstack-infra07:29
*** JayJ_ has quit IRC07:29
*** JayJ_ has joined #openstack-infra07:30
*** gokrokve has joined #openstack-infra07:30
*** r1chardj0n3s is now known as r1chardj0n3s_afk07:33
*** jgallard has joined #openstack-infra07:34
*** jp_at_hp has joined #openstack-infra07:34
*** gokrokve has quit IRC07:35
*** yamamoto_ has quit IRC07:36
*** BobBall_AWOL is now known as BobBall07:37
*** doude has joined #openstack-infra07:39
*** skolekonov has joined #openstack-infra07:41
*** jistr has joined #openstack-infra07:42
*** ZZelle has quit IRC07:43
*** ZZelle has joined #openstack-infra07:43
*** ihrachyshka has joined #openstack-infra07:44
openstackgerritSpencer Krum proposed a change to openstack-infra/project-config: Use beaker to do acceptance testing of Puppet  https://review.openstack.org/12556707:59
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Logstash: Modifying rewrite rules to allow kibana 3  https://review.openstack.org/9316708:03
*** mfer has joined #openstack-infra08:04
*** yamamoto_ has joined #openstack-infra08:05
*** jamespage_ has joined #openstack-infra08:07
*** mfer has quit IRC08:09
*** andreykurilin_ has joined #openstack-infra08:11
*** yamamoto_ has quit IRC08:12
*** lttrl has quit IRC08:12
*** lttrl has joined #openstack-infra08:13
*** jamespage_ has quit IRC08:13
*** andreaf has quit IRC08:17
openstackgerritSpencer Krum proposed a change to openstack-infra/project-config: Use beaker to do acceptance testing of Puppet  https://review.openstack.org/12556708:18
*** koolhead_ has joined #openstack-infra08:19
*** koolhead17 has quit IRC08:21
*** skeppstedt has quit IRC08:23
*** skeppstedt has joined #openstack-infra08:24
*** cody-somerville has quit IRC08:24
*** flaper87 is now known as flaper87|afk08:25
*** rushiagr is now known as rushiagr_away08:27
*** skeppstedt has quit IRC08:28
*** skeppstedt has joined #openstack-infra08:29
*** amuller has joined #openstack-infra08:30
*** LinuxJedi has quit IRC08:33
*** rushiagr_away is now known as rushiagr08:33
*** afazekas has joined #openstack-infra08:34
*** skeppstedt has quit IRC08:36
*** skeppstedt has joined #openstack-infra08:37
*** LinuxJedi has joined #openstack-infra08:39
*** andreykurilin_ has quit IRC08:39
*** skeppstedt has quit IRC08:41
*** LinuxJedi has quit IRC08:41
*** LinuxJedi has joined #openstack-infra08:42
*** yamamoto_ has joined #openstack-infra08:43
*** shardy has joined #openstack-infra08:44
*** skeppstedt has joined #openstack-infra08:46
*** cody-somerville has joined #openstack-infra08:47
*** cody-somerville has quit IRC08:47
*** cody-somerville has joined #openstack-infra08:47
*** cdent has joined #openstack-infra08:48
*** greghaynes has quit IRC08:48
*** yamamoto_ has quit IRC08:48
*** greghaynes has joined #openstack-infra08:51
*** alexpilotti has joined #openstack-infra08:51
*** Daisy has quit IRC08:54
*** dizquierdo has joined #openstack-infra08:57
*** flaper87|afk is now known as flaper8708:59
*** skeppstedt has quit IRC09:06
*** skeppstedt has joined #openstack-infra09:06
*** skeppstedt has quit IRC09:07
*** skeppstedt has joined #openstack-infra09:07
*** zz_johnthetubagu is now known as johnthetubaguy09:08
*** e0ne has joined #openstack-infra09:10
*** mkoderer_cloud has joined #openstack-infra09:12
*** dalgaaf__ has joined #openstack-infra09:13
openstackgerritSerg Melikyan proposed a change to openstack-infra/project-config: Add upload to PyPI for heat-translator  https://review.openstack.org/12557709:14
*** berendt has joined #openstack-infra09:18
*** yamamoto has joined #openstack-infra09:19
*** _nadya_ has quit IRC09:20
*** Longgeek has joined #openstack-infra09:22
*** Longgeek has quit IRC09:22
*** rushiagr is now known as rushiagr_away09:23
*** Longgeek has joined #openstack-infra09:24
*** Longgeek has quit IRC09:26
*** skeppstedt has quit IRC09:26
*** yamamoto has quit IRC09:27
*** skeppstedt has joined #openstack-infra09:27
*** lttrl has quit IRC09:27
*** Longgeek has joined #openstack-infra09:28
*** e0ne has quit IRC09:29
*** sarob_away is now known as sarob09:29
*** gokrokve has joined #openstack-infra09:30
*** skeppstedt has quit IRC09:31
*** rlandy has joined #openstack-infra09:32
*** skeppstedt has joined #openstack-infra09:33
*** e0ne has joined #openstack-infra09:33
*** gokrokve has quit IRC09:35
*** che-arne has joined #openstack-infra09:36
*** cnesa15 has joined #openstack-infra09:37
*** Longgeek_ has joined #openstack-infra09:39
*** derekh has joined #openstack-infra09:40
*** sarob is now known as sarob_away09:41
*** Longgeek has quit IRC09:42
*** pelix has joined #openstack-infra09:51
*** amuller is now known as amuller_lunch09:53
*** cnesa has joined #openstack-infra09:54
*** skeppstedt has quit IRC09:55
*** skeppstedt has joined #openstack-infra09:56
*** rushiagr_away is now known as rushiagr09:58
*** skeppstedt has quit IRC10:00
*** dprince has joined #openstack-infra10:02
*** _nadya_ has joined #openstack-infra10:03
*** oomichi has joined #openstack-infra10:03
*** hashar has quit IRC10:04
*** cnesa has quit IRC10:08
*** ihrachyshka has quit IRC10:12
*** jgallard has quit IRC10:18
*** skeppstedt has joined #openstack-infra10:26
*** parimala has joined #openstack-infra10:27
*** yamahata has quit IRC10:31
*** gokrokve has joined #openstack-infra10:32
openstackgerrityolanda.robla proposed a change to openstack-infra/storyboard-webclient: Only show remove story button for admin users  https://review.openstack.org/12559010:32
*** skeppstedt has quit IRC10:33
*** gokrokve has quit IRC10:36
parimalaHello, I am a newbie,   is there anyone who can help me for OPW?10:38
*** amuller_lunch is now known as amuller10:38
*** pcm_ has joined #openstack-infra10:40
*** cnesa16 has joined #openstack-infra10:42
*** pcm__ has joined #openstack-infra10:43
*** cnesa15 has quit IRC10:43
*** pcm_ has quit IRC10:45
*** nosnos has quit IRC10:50
*** nosnos has joined #openstack-infra10:51
*** nosnos has quit IRC10:55
*** _nadya_ has quit IRC11:05
*** e0ne has quit IRC11:06
*** dmsimard_away is now known as dmsimard11:07
*** e0ne has joined #openstack-infra11:07
*** dims has joined #openstack-infra11:08
*** skeppstedt has joined #openstack-infra11:10
*** ihrachyshka has joined #openstack-infra11:14
*** hashar has joined #openstack-infra11:15
*** JayJ_ has quit IRC11:15
sdaguedims: can you put that on top of the refactor patch that I've got11:15
dimssdague: yep doing that now.11:17
sdaguedims: cool11:17
*** andreaf_ is now known as andreaf11:18
sdagueman... you are on a goofy sleep schedule :)11:18
*** mrmartin has quit IRC11:19
dimssdague: yep. same as you :)11:20
*** LinuxJedi has quit IRC11:22
*** laxity has quit IRC11:22
*** laxity has joined #openstack-infra11:25
*** LinuxJed_ has joined #openstack-infra11:27
*** dprince has quit IRC11:30
*** yamahata has joined #openstack-infra11:30
*** gokrokve has joined #openstack-infra11:30
*** e0ne has quit IRC11:31
*** LinuxJedi has joined #openstack-infra11:31
*** LinuxJed_ has quit IRC11:32
*** asalkeld has quit IRC11:32
*** gokrokve has quit IRC11:34
*** _nadya_ has joined #openstack-infra11:35
*** berendt has quit IRC11:37
*** yamahata has quit IRC11:39
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/config: Save last setting of Toggle CI button  https://review.openstack.org/12346411:40
*** yamahata has joined #openstack-infra11:40
*** baoli has joined #openstack-infra11:42
silehthi guys I have a issue with CI p3k nodes11:42
dimssdague: done. looks good11:43
silehtif you take a look to http://logs.openstack.org/36/125336/2/gate/gate-gnocchi-tox-py34-postgresql/2b4d4cc/console.html11:43
silehttests pass but it shouldn't11:43
silehtand the exact same review: http://logs.openstack.org/36/125336/2/gate/gate-gnocchi-tox-py34-postgresql/740dca5/console.html11:44
silehtthat fail as expected11:44
*** todd_dsm has joined #openstack-infra11:44
silehtI have seen a diff between the nodes used on this jobs11:44
silehtone use tox 1.7 and the other tox 1.811:44
*** Daisy has joined #openstack-infra11:44
silehtbut on tox 1.7, the virtualenv run python 2.7 on python 3.4 jobs ...11:45
silehtsdague, ^11:45
silehtfungi, ^11:45
*** _nadya_ has quit IRC11:45
silehtI will open a bug11:47
*** rdopieralski has quit IRC11:50
sdaguesileht: what's up?11:51
silehtsdague, most of the time on py34 gnocchi job, the version of python installed in the virual is python2.7 instead of python3.411:51
silehtsdague, it's related to the tox version used in the CI nodes11:52
silehtsdague, when tox is 1.8 it works as expected11:52
silehtsdague, if the version in 1.7 the wrong python version is installed11:52
silehtsdague, I'm writting a bug report11:53
sdagueok11:53
*** kgiusti has joined #openstack-infra11:54
silehtsdague, https://bugs.launchpad.net/openstack-ci/+bug/137669111:55
uvirtbotLaunchpad bug 1376691 in openstack-ci "incorrect python version used in py3 virtualenv on certain python 3 nodes" [Undecided,New]11:55
*** dprince has joined #openstack-infra11:55
*** jgallard has joined #openstack-infra11:59
*** rdopieralski has joined #openstack-infra12:03
*** dkranz has joined #openstack-infra12:04
*** weshay has joined #openstack-infra12:05
*** mriedem has joined #openstack-infra12:05
*** dims has quit IRC12:06
*** dims has joined #openstack-infra12:06
*** dims has quit IRC12:06
*** dims has joined #openstack-infra12:07
*** isviridov_away is now known as isviridov12:08
EmilienMjd__: about https://review.openstack.org/#/c/125082/ - what do you think about osmonitor? ospurge already exists so nobody can complain we use "os*"12:09
*** mbacchi has joined #openstack-infra12:13
*** cdent has quit IRC12:16
*** cdent has joined #openstack-infra12:16
*** _nadya_ has joined #openstack-infra12:16
*** mrmartin has joined #openstack-infra12:17
*** bswartz has quit IRC12:18
*** aysyd has joined #openstack-infra12:20
*** timrc-afk is now known as timrc12:26
*** yfried|afk has joined #openstack-infra12:27
*** gokrokve has joined #openstack-infra12:30
*** oomichi has quit IRC12:32
*** adalbas has joined #openstack-infra12:32
*** gokrokve has quit IRC12:35
*** skeppstedt has quit IRC12:37
*** skeppstedt has joined #openstack-infra12:37
*** fifieldt has joined #openstack-infra12:37
*** skeppstedt has quit IRC12:41
*** mmedvede has joined #openstack-infra12:42
*** Adri2000 has quit IRC12:43
*** Adri2000 has joined #openstack-infra12:47
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add fingerprint for bug #1375108  https://review.openstack.org/12554012:47
uvirtbotLaunchpad bug 1375108 in nova "Failed to reboot instance successfully with EC2 " [High,Confirmed] https://launchpad.net/bugs/137510812:47
*** Adri2000 is now known as Guest1081112:47
*** e0ne has joined #openstack-infra12:48
*** miqui has joined #openstack-infra12:50
*** achuprin_ has joined #openstack-infra12:52
*** doug-fish has joined #openstack-infra12:54
*** Daisy has quit IRC12:56
*** skeppstedt has joined #openstack-infra12:57
*** juzuluag has joined #openstack-infra12:58
*** fandi has joined #openstack-infra12:58
*** skeppstedt has quit IRC12:59
openstackgerritJaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Allow multiple comment-added events in gerrit trig.  https://review.openstack.org/12456812:59
*** bswartz has joined #openstack-infra12:59
*** skeppstedt has joined #openstack-infra12:59
openstackgerritJaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Allow multiple comment-added events in gerrit trig.  https://review.openstack.org/12456813:00
*** JayJ_ has joined #openstack-infra13:00
*** skeppstedt has quit IRC13:04
*** dane_leblanc has joined #openstack-infra13:05
*** dims has quit IRC13:06
*** dims has joined #openstack-infra13:07
openstackgerritMarton Kiss proposed a change to openstack-infra/config: Openstackid.org openid instance  https://review.openstack.org/11936413:08
*** mrmartin has quit IRC13:09
*** dims has quit IRC13:11
fungiAJaeger: we can probably drop periodic-gerrit-plugin-delete-project as it's trying to build a gerrit plugin we ended up not using anyway13:15
*** mrmartin has joined #openstack-infra13:15
fungiparimala: did anyone get back to you about your opw questions yet?13:15
AJaegermorning, fungi...13:16
AJaegerok13:16
fungisileht: py34 jobs shouldn't run on py3k-precise nodes, they should run on bare-trusty nodes13:16
fungisileht: i see the bug report... i'll respond there13:17
*** eharney has quit IRC13:17
*** juzuluag has left #openstack-infra13:17
*** berendt has joined #openstack-infra13:17
fungiparimala: there's a list of our irc channels at https://wiki.openstack.org/wiki/IRC and we actually have a specific #openstack-opw for "GNOME OPW mentor, intern and supporter discussions" where you might get better answers (if you haven't tried there already)13:18
*** radez_g0n3 is now known as radez13:20
silehtfungi, thanks13:20
*** skeppstedt has joined #openstack-infra13:22
parimalafungi: Thanks for your response, I will look into the IRC list13:22
fungiparimala: i'm also happy to field any questions i can answer, but i expect the denizens of that channel have much more complete answers than i do13:23
*** fandi has quit IRC13:23
*** mkoderer_cloud has quit IRC13:24
*** JayJ_ has quit IRC13:24
*** JayJ_ has joined #openstack-infra13:25
parimalafungi: I will check13:25
sdakemorning13:25
*** zz_dimtruck is now known as dimtruck13:25
*** Daisy has joined #openstack-infra13:27
*** alexpilotti has quit IRC13:27
silehtfungi, should I change something in the project-config repo ?13:29
*** skeppstedt has quit IRC13:29
*** skeppstedt has joined #openstack-infra13:29
fungisileht: i don't think you need to change anything, but i'm putting a detailed explanation of why in the bug report13:29
*** esker has joined #openstack-infra13:30
*** gokrokve has joined #openstack-infra13:30
*** pkoniszewski has quit IRC13:33
*** _buzz has joined #openstack-infra13:33
*** nelsnelson has joined #openstack-infra13:34
*** skeppstedt has quit IRC13:34
*** dustins has joined #openstack-infra13:34
*** dimtruck is now known as zz_dimtruck13:35
*** gokrokve has quit IRC13:35
*** signed8bit has joined #openstack-infra13:36
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Added tags controllers  https://review.openstack.org/11421713:38
*** todd_dsm has quit IRC13:38
openstackgerritSean Dague proposed a change to openstack-infra/project-config: try out new src libs job on pbr  https://review.openstack.org/12544713:38
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Delete delete-project-gerrit-plugin jobs  https://review.openstack.org/12563613:39
sdaguefungi: ... so I made it pass tests... maybe it's right?13:40
AJaegersdague, nice try ;)13:40
*** mfer has joined #openstack-infra13:41
*** skeppstedt has joined #openstack-infra13:41
sdagueAJaeger: hey, if you know how to fix that... please let me know13:42
sdaguea lot of the templating bits I still don't grok13:42
fungisdague: aha... i agree the parameter expansion error in the job was likely misleading13:43
*** wenlock has joined #openstack-infra13:45
*** r-daneel has joined #openstack-infra13:45
AJaegersdague, I was just commenting on what you told fungi without looking at the patch, will check the patch now and help fixing it...13:46
AJaeger... if needed13:46
*** dustins_ has joined #openstack-infra13:46
*** gokrokve has joined #openstack-infra13:46
sdagueso other things that might be nice to land is - https://review.openstack.org/#/c/124632/ - the hideci change13:48
*** dustins has quit IRC13:48
sdaguethat would have helped a lot realize that some of these things landing had be rechecked to death13:48
sdagueturns out one of the top gate bugs was a tempest test that was recheck grinded in even though it was failing13:49
*** skeppstedt has quit IRC13:49
*** andreaf is now known as andreaf_13:49
*** skeppstedt has joined #openstack-infra13:49
sdagueso... if we are going to take a run at the decouple today - https://review.openstack.org/#/c/125443/ needs to go in13:49
*** amotoki has quit IRC13:50
AJaegersdague, fungi: Should we really have non-voting gate jobs like in 125447?13:51
*** amotoki has joined #openstack-infra13:51
*** sarob_away has quit IRC13:52
*** flaviof_zzz has quit IRC13:52
sdagueAJaeger: it's temporary13:52
sdaguemostly so I don't completely screw pbr as we phase this in13:52
AJaegersdague, understood. Still, what's the best policy here?13:53
*** skeppstedt has quit IRC13:54
fungiAJaeger: normally non-voting jobs shouldn't be in the check pipeline, but i gather there will be a patch later today to either revert that one or switch it to voting13:54
fungier, shouldn't be in the gate pipeline13:54
fungi(e.g. should only be in the check pipeline)13:54
* fungi gets more coffee13:54
AJaegerOK, I'll approve it then...13:55
*** todd_dsm has joined #openstack-infra13:56
*** todd_dsm has quit IRC13:56
*** Guest10811 is now known as Adri200013:58
*** Adri2000 has joined #openstack-infra13:58
*** homeless has joined #openstack-infra13:58
*** tsg has joined #openstack-infra13:58
*** salv-orlando has quit IRC13:58
*** zz_dimtruck is now known as dimtruck14:00
*** pkoniszewski has joined #openstack-infra14:01
openstackgerritA change was merged to openstack-infra/project-config: try out new src libs job on pbr  https://review.openstack.org/12544714:02
*** ildikov has quit IRC14:05
*** ildikov has joined #openstack-infra14:05
*** mestery has joined #openstack-infra14:07
sdagueok, going to drop off for the next hr to run an errand14:07
sdaguefungi: if there is any chance you feel comfortable with fast approving https://review.openstack.org/#/c/125443/ - nothing else can really progress until we have that14:08
*** dalgaaf__ has quit IRC14:08
*** stevemar has joined #openstack-infra14:08
*** Sincler has joined #openstack-infra14:08
openstackgerrityolanda.robla proposed a change to openstack-infra/storyboard-webclient: Allow assigning tasks without expanding the edition box  https://review.openstack.org/12564314:09
fungisdague: yep, it's trivial and we're short reviewers with people travelling et cetera14:11
*** akislitsky has joined #openstack-infra14:12
akislitskyHi, guys! I have created repository on stackforge: https://github.com/stackforge/fuel-stats (https://review.openstack.org/#/c/124773/), but it is empty. Public repository on github was pointed as upstream, but code is not uploaded into fuel-stats. What I need to do to fix it?14:16
*** mestery has quit IRC14:20
sdakewhich repo contains the gating scripts?14:20
sdakelike job-pep8 etc14:21
sdakenm I'm a dummy I found it :)14:21
*** tonytan4ever has joined #openstack-infra14:22
*** malini1 has joined #openstack-infra14:24
*** homeless has quit IRC14:24
*** tsg has quit IRC14:24
*** homeless has joined #openstack-infra14:25
openstackgerritThomas Goirand proposed a change to openstack/requirements: Using django-nose>=1.2 needed by murano-dashboard  https://review.openstack.org/12565114:27
*** prad has joined #openstack-infra14:27
*** ramashri has joined #openstack-infra14:29
*** hdd has joined #openstack-infra14:29
*** flaviof_zzz has joined #openstack-infra14:29
clarkbsileht fungi tox 1.7.2 should support py34. it is one reason the tox upgrade was prereq to moving to py3414:30
clarkbdo we know why 1.8 is required here?14:30
silehtclarkb, the problem is when you use 'baseversion' insteand of 'basepython' to set the python version14:31
silehtclarkb, baseversion only works on tox 1.814:31
*** otherwiseguy has joined #openstack-infra14:32
fungiclarkb: yeah, the "bug" was in gnocchi's tox.ini really14:32
clarkbgotcha14:33
*** kmartin has quit IRC14:33
*** dane_leblanc has quit IRC14:33
silehtfungi, clarkb I have sent a patch to use basepython instead of baseversion in our tox config, to make gnocchi tox 1.7 compatible again14:33
fungiclarkb: however, we were a week after the tox 1.8 release before we actually used it for jobs, which was due to an image update related bug on our side14:33
*** dane_leblanc has joined #openstack-infra14:34
fungisileht: will that break under tox 1.8 though? because that's what we're using now14:34
fungihopefully 1.8 is backward-compat with the old setting14:34
silehtfungi, basepython works with 1.7 and 1.814:34
fungiokay, perfect14:34
fungithen yes, you should definitely do that14:34
silehtfungi, clarkb thanks for your help14:34
funginp14:34
*** pcrews has joined #openstack-infra14:36
*** gokrokve has quit IRC14:36
fungiakislitsky: doesn't look empty to me... i just cloned git://git.openstack.org/stackforge/fuel-stats.git and it has contents14:37
*** cnesa has joined #openstack-infra14:37
*** david-lyle has joined #openstack-infra14:37
fungiakislitsky: aha, looks like maybe the github api failed us again and aborted between project creation and permissions getting applied. i'll fix14:38
*** primemin1sterp is now known as primeministerp14:38
*** marun has joined #openstack-infra14:39
openstackgerritMatthew Treinish proposed a change to openstack-infra/subunit2sql: Add db api function to get the latest run  https://review.openstack.org/11788214:39
*** rainya has joined #openstack-infra14:41
fungiakislitsky: now it's updated on github too14:41
*** shashankhegde has joined #openstack-infra14:41
*** eharney has joined #openstack-infra14:41
*** tteggel has quit IRC14:44
anteayao/14:44
*** skeppstedt has joined #openstack-infra14:45
*** sarob_away has joined #openstack-infra14:45
*** tteggel has joined #openstack-infra14:46
akislitskyfungi, thanx a lot!14:47
*** ihrachyshka has quit IRC14:47
*** gokrokve has joined #openstack-infra14:48
*** zz_jgrimm is now known as jgrimm14:48
fungiyou're welcome14:49
*** armax has joined #openstack-infra14:50
*** datsun180b has joined #openstack-infra14:51
*** thedodd has joined #openstack-infra14:53
*** zaphod42 has quit IRC14:54
*** pkoniszewski has quit IRC14:54
*** dims has joined #openstack-infra14:56
*** pkoniszewski has joined #openstack-infra14:56
*** reed has joined #openstack-infra14:56
AJaegerfungi, clarkb: Could either of you review and approve https://review.openstack.org/124229 , please? That's a further way to make translation updates smaller...14:57
*** isviridov is now known as isviridov_meetin14:57
*** ihre has left #openstack-infra14:58
*** kgiusti has quit IRC14:58
AJaegerakislitsky, it looks fine here: http://git.openstack.org/cgit/stackforge/fuel-stats/tree/14:59
* AJaeger missed the last lines, akislitsky ignore my comment ;)14:59
*** wenlock_ has joined #openstack-infra14:59
*** jlibosva has quit IRC14:59
AJaegerfungi, thanks for approving. I missed that clarkb already reviewed...15:00
*** jlibosva has joined #openstack-infra15:01
openstackgerritA change was merged to openstack-infra/project-config: Cleanup translation files  https://review.openstack.org/12422915:03
*** AJaeger has quit IRC15:09
*** skeppstedt has quit IRC15:10
*** salv-orlando has joined #openstack-infra15:11
*** tsg has joined #openstack-infra15:15
*** tgohad has joined #openstack-infra15:17
*** erikmwilson has joined #openstack-infra15:18
*** pkoniszewski has quit IRC15:19
*** tsg has quit IRC15:20
*** alexpilotti has joined #openstack-infra15:21
devanandamornin, all15:22
devanandaI just want to check if there's a known issue affecting py26,27 unit tests in the gate -- we've got a patch that passes locally for three of us, but fails with import errors repeatedly in the gate15:23
*** annegent_ has joined #openstack-infra15:23
fungidevananda: can you be more specific about what import errors, or provide a link to a job log?15:26
devanandahttp://logs.openstack.org/10/124610/15/check/gate-ironic-python27/6c775d9/console.html15:26
*** dimtruck is now known as zz_dimtruck15:27
devanandafungi: it's not the first error in the file, but this looks peculiar15:27
devananda2014-10-02 11:13:59.816 | du: cannot access ‘./subunit_log.txt’: No such file or directory15:27
clarkbthat is benign15:27
devanandaclarkb: ah, k15:27
clarkbor should be. du is just making noise15:28
*** IAX has joined #openstack-infra15:28
clarkbdevananda how are you testing locally?15:28
fungii wish we collected more detail than just "ironic.tests.conductor.test_managerNon-zero exit code (2) from test listing.15:28
clarkbcentos6 machine?15:28
fungiwell, that example is a py27 job15:28
fungirunning on bare-trusty15:29
clarkboh its both nevermind15:29
devanandaclarkb: there's been a discussion in -ironic of the various ways we've tried to reproduce this locally, everything from a clean .venv up up to making a fresh VM15:29
alexpilottihi guys, I have a project that merged on stackforge, how do I add people (including myself) to the core reviewers and release groups?: https://review.openstack.org/#/admin/groups/452,members15:30
fungidoesn't look like ironic's tox.ini uses sitepackages either15:30
fungialexpilotti: i can do it15:30
*** zz_dimtruck is now known as dimtruck15:30
alexpilottifungi: tx15:30
alexpilottifungi: my email is apilotti@cloudbasesolutions.com15:31
clarkbdevananda so tox -repy27 with that code checked out doesnt do it?15:31
fungialexpilotti: i've added you to both your core and release groups, and you should now be able to add anyone else you need15:31
devanandaclarkb: yup. works fine for me15:31
alexpilottifungi: tx a lot!15:32
fungiyou bet15:32
*** gokrokve_ has joined #openstack-infra15:35
*** maxbit has joined #openstack-infra15:35
sdagueclarkb: so I thought about the deb solver thing last night, I think richardjones built a tool that explores you dependencies and figures out transitive ones you are missing15:35
sdagueso what we could do is require listing all of them in g-r15:36
sdagueand all of them for a project15:36
sdagueso the project would flatten out it's transitive deps15:36
sdaguewhich wouldn't be a pip dep solver, and would have lag, but would be closer15:36
clarkbsdague: no please no :)15:37
clarkbsdague: there was a thread that suggested we do that15:37
clarkband we are at 200 first level deps15:37
clarkbmanaging every single transitive dep is insane15:37
*** shashankhegde has quit IRC15:37
*** sdake_ has joined #openstack-infra15:37
clarkb(the thread on dep ordering)15:37
*** dangers_away is now known as dangers15:38
fungisdague: it also doesn't actually solve the problem since what versions of things we'd end up running change from one moment to the next and are only deterministic if nothing, including ordering, changes, and it's entirely likely that we're running with conflicting transitive deps already15:38
*** gokrokve has quit IRC15:38
fungisdague: unless the suggestion is to do repeated passes until consistency is reached with the desired manifest (which is not guaranteed to happen)15:39
sdaguefungi: it would be closer15:39
sdagueanyway, just a thought. I'm not going to implement it :)15:39
clarkbfungi: you would have to be continuously updating the file15:39
fungiyep15:39
clarkbfungi: like on a ***** cron15:39
*** ashaeron has quit IRC15:39
clarkbdevananda: fails for me...15:39
sdagueclarkb: well, on every release of anything in requirements15:40
sdaguethe requirements don't magically change15:40
clarkbsdague: but their transitive deps do15:40
sdaguenot if you lift them up15:40
clarkbbecause we have no visibility into that without continuously updating them15:40
fungijust because we say we project x depends on y and z, that doesn't mean z can't also declare a dependency on a different version of y15:40
clarkbdevananda: so, ya. fetched the code that failed in jenkins, tox -repy27 on my trusty desktop15:41
*** skolekonov is now known as _skolekonov15:41
clarkbdevananda: ironic.tests.conductor.test_managerNon-zero exit code (2) from test listing.15:41
sdaguefungi: sure I do get there are edge cases here15:41
fungii don't think these are edge cases15:41
alexpilottifungi: I approved the first patch, but the tests fail since requirements include some Windows specific modules15:41
alexpilottifungi: while we fix this, what happens if I just push the patch to the git repository?15:41
fungialexpilotti: yes, we don't have windows machines to run these on15:41
alexpilottifungi: I know that, sure :-)15:41
sdaguefungi: but the fact is... if it all gets installs and runs, there is actually *some* way this is satisfied15:41
fungialexpilotti: you don't have the ability to push patches to that repository and bypass jobs. we would need to disable the jobs15:42
clarkbdevananda: http://paste.openstack.org/show/117802/15:42
*** berendt has quit IRC15:42
fungisdague: i agree, but it may be better to log the state which ended up being used rather than fighting with some superset management which will be guaranteed to bitrot almost instantly15:42
sdaguefungi: maybe15:42
alexpilottifungi: so if I do a git push to the repository, would it lose the sync with the stackforge clone?15:43
sdagueanyway, it's a random idea15:43
sdaguein 15 minutes once the d-g change merges, I'll start back in on libs, and ignore it :)15:43
clarkbdevananda: its super weird to me that importing a test module like that results in logging TRACE messages raher than just dumping to stderr15:43
*** sdake_ has quit IRC15:43
alexpilottifungi: or there’s a job which simply mirrors the conent of the target repo with the stackforge clone?15:43
fungialexpilotti: a git push to what repository?15:43
alexpilottifungi: https://github.com/cloudbase/cloudbase-init15:44
devanandaclarkb: huh. so what's different about your trusty vs. my laptop15:44
sdaguedevananda: tox version?15:44
*** hashar has quit IRC15:44
alexpilottifungi: this is the repo associated with the project15:44
fungialexpilotti: oh, yes, we don't continue to sync with that in any way. it's no longer considered the official repository for the project now that it's been imported into gerrit15:44
*** mrmartin has quit IRC15:44
devananda1.6.0-115:44
alexpilottifungi: cool tx15:44
fungidevananda: we're using tox 1.815:45
clarkbdevananda: 1.7.2 here but I don't think tox is at fault15:45
clarkbdevananda: that looks like straight up broken to me15:45
*** jcoufal has quit IRC15:45
*** zaphod42 has joined #openstack-infra15:45
fungii've manually reproduced this on a held bare-trusty node too, fwiw15:45
fungiand can dig deeper15:45
alexpilottifungi: ok, let me see how to fix the requirements so that linux wont complain15:45
*** zaphod42 has quit IRC15:45
*** zaphod42 has joined #openstack-infra15:46
*** yamahata has quit IRC15:46
*** bdpayne has joined #openstack-infra15:47
*** yamahata has joined #openstack-infra15:47
clarkbdevananda: if I were to blame an external thing, mock is what I would look at first15:47
mkodereris http://status.openstack.org/ down?15:47
*** lucasagomes has joined #openstack-infra15:47
mkodererdoesn't work at least for me....15:48
*** gokrokve has joined #openstack-infra15:48
clarkbmkoderer: the landing page is probably bare. try http://status.openstack.org/zuul15:48
fungidevananda: http://paste.openstack.org/show/117804/15:48
*** rdopieralski has quit IRC15:48
clarkbhrm no the main status page has descriptions for the various other things15:48
mkodererclarkb: tried that too.. seems not to work15:49
mtreinishclarkb: I'm also having issues loading it or any of the pages off the domain15:49
openstackgerritA change was merged to openstack-infra/project-config: Add upload to PyPI for heat-translator  https://review.openstack.org/12557715:49
clarkbhuh15:49
clarkbmaybe I have things cached /me tries different browser15:49
fungiweird. i have no issues. checking to see if dns has gone weird though15:49
*** dustins_ has quit IRC15:49
*** rmcall has joined #openstack-infra15:49
sdagueclarkb: yeh... reload goes dead for me15:50
mtreinishclarkb: well it's just really slow, things are coming up eventually15:50
sdagueis rax rebooting the world agian?15:50
* NobodyCam is on status.openstack.org/zuul and all is working well15:50
sdagueNobodyCam: shift reload15:50
*** gokrokve_ has quit IRC15:50
mkodereryep.. it's really slow15:50
sdagueand see if it still is15:50
clarkbI think www is slow and it serves some things like css iirc15:50
fungihuh, we apparently never added status.o.o to cacti?15:50
clarkbif you have that stuff cached then status.o.o is fine15:50
fungiahh, yeah, maybe the www site is under a ddos again15:51
sdagueclarkb: well it means it seems fine15:51
fungior rackspace cloudsites anyway15:51
sdaguethe js is probably hung pulling updates15:51
*** dustins has joined #openstack-infra15:51
sdaguebecause I'm sitting in a TCP wait state for the main index page15:51
fungiyeah, and www is not slow for me at all either15:52
*** shashankhegde has joined #openstack-infra15:52
fungishift-reload in my browser is also fast for status.o.o so doesn't seem to be impacting everywhere15:52
* clarkb breaks out the chrom* developer tools15:53
clarkbdanger danger15:53
sdagueyeh... it's terribad from here15:53
fungi"As a follow up to our Cloud Server Reboots, we will be performing one further maintenance. On Thursday Oct 2nd starting at 8PM CT we will be making changes which will affect networking. It is expected that there will be two 1 minute interruptions in network connectivity." https://status.rackspace.com/15:53
fungimaybe they started early?15:53
sdague2 minutes in... still didn't get css15:53
mkoderernow it works fast again15:54
mtreinishand now everything is fine for me15:54
sdaguefungi: is that in cloud sites though? or is it served via our apache?15:54
sdagueyep15:54
sdagueoh, rax gremlins :)15:54
*** cnesa has quit IRC15:54
fungisdague: content on status.o.o is served from next-gen opencloud servers, content on www is served from cloudsites15:54
fungiboth in dfw15:55
sdaguefungi: ok15:55
fungioh, and that maintenance announcement says "cloud big data" in the header, so i guess that's just for sahara users15:56
fungiso might not be rax network issues, or might be they haven't added them on their status board yet15:56
*** arxcruz has quit IRC15:57
mkodererahm I have another problem :) I have no clue why this patch doesn't go to the gate queue:15:57
mkodererhttps://review.openstack.org/#/c/124988/15:57
mkodererI already rerun jenkins twice...15:57
fungimkoderer: its parent change is not yet approved15:57
*** kmartin has joined #openstack-infra15:57
*** doude has quit IRC15:57
fungimkoderer: it's claiming to be dependent on https://review.openstack.org/11527315:58
mkodererfungi: ahhhh ok I am blind today15:58
mkodererthx :)15:58
fungino worries15:58
*** ihrachyshka has joined #openstack-infra15:58
devanandaclarkb: the error in your paste doesn't make sense - "context" is imported and used throughout the file15:59
clarkbdevananda: no it isn't...15:59
devananda  38 from ironic.openstack.common import context15:59
clarkbdevananda: not in this code15:59
devanandaoh15:59
clarkbdevananda: http://logs.openstack.org/10/124610/15/check/gate-ironic-python27/6c775d9/console.html#_2014-10-02_11_06_35_357 I fetched and tested the same code that failed in the test ou linked16:00
*** Guest68510 has quit IRC16:00
*** mrmartin has joined #openstack-infra16:00
clarkbwhat is interesting is it shows up in the diff16:01
clarkbso you may need to rebase?16:01
clarkbI think this is git merges gone bad16:01
* clarkb looks in history to find code that removed that line16:02
devanandaclarkb: ahh. yup16:02
clarkbdevananda: 85b3f48eb946c198887aed9bfe89d7892746b9d9 there it is...16:02
devanandaclarkb: fetching that exact rev also fails for me16:02
devanandayea...16:02
clarkbso ya, gate is failing properly16:02
lucasagomeshmm16:02
clarkbthis is why we merge against current tree before testing code16:03
* devananda rebases16:03
clarkbdevananda: and don't forget to add that code back16:03
*** eglynn-office is now known as eglynn-officeafk16:04
devanandaclarkb: cheers, thanks.16:05
clarkbdevananda: lucasagomes: protip you can always fetch the exact same code that zuul tested by copy pasting that line I linked above then running git checkout FETCH_HEAD16:05
clarkbthat gives you exactly the code that was tested16:05
*** mrmartin has quit IRC16:05
*** Daisy has quit IRC16:05
lucasagomesclarkb, cheers! I will never forget that!16:06
*** shashankhegde has quit IRC16:07
*** mmaglana has joined #openstack-infra16:07
*** imcsk8 has quit IRC16:08
*** imcsk8 has joined #openstack-infra16:08
*** e0ne has quit IRC16:08
*** ildikov has quit IRC16:08
openstackgerritA change was merged to openstack-infra/devstack-gate: add support for setting devstack LIBS_FROM_GIT  https://review.openstack.org/12544316:09
*** mmaglana has quit IRC16:09
*** lucasagomes has quit IRC16:10
clarkbBTW we are now running devstack-trusty nodes off of a dib built image in hpcloud \o/16:10
*** shashankhegde has joined #openstack-infra16:11
*** gokrokve has quit IRC16:12
zaromorning16:12
clarkbzaro: good morning16:12
*** Clabbe has quit IRC16:13
clarkbzaro: so the thing I was trying to describe is that if I have a server with slaves that have labels foo and bar and create a job called jobname on that server with no restriction on where the job can run gearman-plugin should register jobname, jobname:foo, jobname:bar right16:13
clarkbzaro: I am only seeing jobname get registered16:13
*** Clabbe has joined #openstack-infra16:13
zaroclarkb: no it should only register jobname i believe. jobname will be your calling card to run on any slave.  i tested and it still works.16:15
clarkbzaro: ok I must've misunderstood the expected behavior then. Thats fine :) fewer perceived bugs is a good thing16:15
*** afazekas has quit IRC16:15
*** yfried|afk has quit IRC16:16
*** sarob_away is now known as sarob16:17
zaroclarkb: cool. i'll try to fix up the tests then push up change to build with LTS 1.565.316:17
clarkbzaro: awesome that would be great16:17
zaroclarkb: did you want to keep the extra logging you added or revert that?16:17
clarkbzaro: no, I think we can remove that16:17
*** erikmwilson has quit IRC16:18
clarkbyolanda: thank you very much for helping out with the dib stuff16:19
clarkbyolanda: it is exciting to be using it on the production slaves16:19
malini1hello - I am working on Project Poppy which uses Cassandra as storage. We would like to start gating against Cassandra if possible.  Any pointers to where I can start ?16:19
*** tonytan4ever has quit IRC16:20
yolandaclarkb, how is that working? i saw you are using dib-trusty16:20
yolandais that giving more performance?16:20
*** tonytan4ever has joined #openstack-infra16:20
clarkbmalini1: we give you the ability to to intsall arbitrary packages in many jobs. you could just install cassandra when you need it in the jobs16:20
clarkbyolanda: no performance is about the same. The big benefit is we were generated the image 5 times per day for hpcloud but now do it once and have the same image across hpcloud16:21
malini1clarkb: is that in the config repo?16:21
clarkbyolanda: so it is a lot more reliable16:21
clarkbmalini1: openstack-infra/project-config houses all of the jenkins jobs now16:21
*** parimala has quit IRC16:23
pleia2good morning16:23
*** MaxV has quit IRC16:23
malini1thanks clarkb! I'll look there16:24
pleia2nibalizer: beaker test - exciting!16:24
zaroclarkb: for next time we need to debug jenkins.. https://review.openstack.org/#/c/82627/16:25
*** sdake_ has joined #openstack-infra16:25
*** cnesa has joined #openstack-infra16:25
clarkbzaro: so I still don't think we want that...16:25
*** oanufriev has quit IRC16:26
clarkbzaro: it produces gigabytes of logs every day which is too much noise to help debugging16:26
*** sarob is now known as sarob_away16:26
zaroclarkb: only if DEBUG level is set.16:26
*** praneshp has joined #openstack-infra16:26
zaroclarkb: it doesn't have to be set in the jenkins config16:26
clarkbzaro: oh I mixed up the two changes I thought you linked to the one that sets it to debugging16:27
clarkbzaro: ya in that case I agree. we can update plugin to do more logging at debug and disable by default16:27
zaroclarkb: yep. the one to set to our jenkins to log at DEBUG level is debateable (88432).  i created that change on a jeblair request.16:29
*** gyee has joined #openstack-infra16:30
clarkbyolanda: in any case you helped get some of the difficult work done so thanks again it was very helpful16:30
clarkbnext I hope to move devstack-precise and devstack-f20 to it16:31
clarkbwhile also sorting out how to dib with rax via nodepool16:31
*** alexpilotti has quit IRC16:32
pleia2re: upcoming talk about our open source infra at All Things Open: http://opensource.com/business/14/10/interview-elizabeth-joseph-hp-openstack16:32
anteayaalright, git.o.o is playing a trick on me16:32
anteayaI can't see the project-config repo16:32
pleia2anteaya: it's there, do you have cgit/ in the url?16:32
anteayaI do16:33
anteayamight cgit be hiding it from me?16:33
pleia2(it's there on the server I hit anyway)16:33
pleia2http://git.openstack.org/cgit/openstack-infra/project-config/tree/16:33
anteayaI often go to git.o.o and then just look up files16:34
clarkbanteaya: can you paste the broken url?16:34
*** derekh has quit IRC16:34
pleia2I see it in the list there too16:34
*** jp_at_hp has quit IRC16:34
anteayahttp://git.openstack.org/cgit16:34
anteayawhat might be happening that I can not see it?16:35
pleia2between os-loganalyze and publications16:35
anteayafirefox and chrome, yes16:35
anteayapleia2: that is where it lives16:35
anteayaI control-F for project-config and have 0 entries16:35
anteayaI'm in the twilight zone again I guess16:36
clarkbanteaya: I don't see it their either, fun16:36
pleia2could be that on one of the servers didn't run create_cgitrepos.py properly16:36
clarkbor maybe cgit cache is confused16:36
openstackgerritA change was merged to openstack-infra/project-config: Sort openstack-infra/-dev entries in layout.yaml  https://review.openstack.org/12539616:36
anteayahttp://imgur.com/NUGrXW516:37
pleia2clarkb: it's git0216:38
*** gokrokve has joined #openstack-infra16:38
pleia2http://git02.openstack.org:8080/cgit16:38
sdaguefungi: hmmm... something's wrong with gate-tempest-dsvm-src-pbr16:38
sdagueit's specified as NOTREGISTERED16:39
sdagueI just rechecked 2 pbr patches16:39
sdague124651,1 - clarkb, fungi, any idea what the definition should be?16:39
anteayapleia2: good eye16:39
pleia2tried them all :)16:40
*** sdake_ has quit IRC16:40
pleia2the rest seem fine16:40
zaromika: Jenkins-job-builder 0.9.0 was just released.16:40
clarkbsdague: the definition? note the NOT REGISTERED thing is probably lag and potentially related to jenkins upgrade16:41
*** shashankhegde has quit IRC16:41
clarkbpleia2: thanks /me looks at 0216:41
*** primemin1sterp has joined #openstack-infra16:42
fungii'll check gearman in a moment to see if that job's registered now16:42
*** primemin2sterp has joined #openstack-infra16:42
clarkbsdague: basically there are a few races in job registration and running jobs16:42
*** 17SAAGJ3L has joined #openstack-infra16:42
*** 7YUAA0IRR has joined #openstack-infra16:42
*** primemin4sterp has joined #openstack-infra16:42
*** primemin3sterp has joined #openstack-infra16:42
*** primemin5sterp has joined #openstack-infra16:42
clarkbsdague: first one is zuul can update before jenkins updates because applying out jenkins job updates is sometimes slow16:42
*** primemin6sterp has joined #openstack-infra16:42
pleia2uh oh16:42
*** primemin7sterp has joined #openstack-infra16:42
*** primemin8sterp has joined #openstack-infra16:42
clarkbpleia2: hrm?16:42
pleia2clarkb: turn on joins16:42
*** rainya has quit IRC16:42
*** tonytan4ever has quit IRC16:42
clarkbprimemin1sterp: reall wanted to join us16:43
clarkbpleia2: project-config is listed in /var/lib/git/openstack-infra on git0216:43
*** primemin9sterp has joined #openstack-infra16:43
*** primemi10sterp has joined #openstack-infra16:43
pleia2clarkb: how about in /etc/cgitrepos ?16:43
*** patrickeast has joined #openstack-infra16:44
clarkbpleia2: yup16:44
pleia2hrm16:44
clarkbso maybe cache weirdness let me see if I can find the cache and kill it16:44
* pleia2 nods16:44
pleia2I think it's /var/cache/cgit by default16:45
fungisdague: gate-tempest-dsvm-src-pbr is registered on both bare-precise and bare-trusty (and not on devstack-.*)16:45
pleia2yeah16:45
*** ramashri has quit IRC16:45
fungisdague: maybe we specified the wrong node label?16:45
*** jistr has quit IRC16:45
fungichecking the config now16:45
sdaguefungi: yeh... or I didn't specify a node label16:45
clarkbfungi: sdague: oh right we needed to specify because default is bare-precise || bare-trusty. whoops16:45
sdagueok16:46
sdaguelet me patch16:46
fungik16:46
clarkbpleia2: but those files are all "data" :(16:46
*** HeOS has quit IRC16:46
*** primemin4sterp has quit IRC16:47
sdaguecan I do pipeline check || gate16:47
*** primemin2sterp has quit IRC16:47
sdagueso that I don't need 2 definitions?16:47
clarkbpleia2: trying to sort out if it is safe for me to just rm the whole cache16:47
clarkbsdague: no16:47
*** gokrokve has quit IRC16:47
clarkbsdague: but you don't need two now do you?16:47
clarkbin the original it was only gate-* used16:47
pleia2clarkb: should be fine16:48
*** gokrokve has joined #openstack-infra16:48
sdagueclarkb: I put 2 in, I guess we can always call it a gate- job16:48
pleia2clarkb: but I can take a few minutes to see if anyone on the internet talks about cache cleanup16:48
*** gokrokve has quit IRC16:48
clarkbsdague: oh when I saw the change the layout.yaml only used gate-16:48
*** gokrokve has joined #openstack-infra16:48
pleia2"Pages are cached in the directory /var/cache/cgit/, so if you update the config file you’ll need to clear the cache by removing the contents of /var/cache/cgit/."16:48
pleia2some dude's blog said that :D16:49
anteayasounds like cache needs to be cleared on config file updates16:49
fungipleia2: some dude(tte)'s blog is always where i get the best documentation16:49
clarkbanteaya: well its supposed to be only like a 5 minutes cache16:49
anteayaah16:49
*** gokrokve has quit IRC16:50
* anteaya refreshes16:50
*** che-arne has quit IRC16:50
*** gokrokve_ has joined #openstack-infra16:50
openstackgerritSean Dague proposed a change to openstack-infra/project-config: specify node type correctly for new -src jobs  https://review.openstack.org/12570716:50
pleia2probably corrupted, so gone a bit sideways and won't refresh properly16:50
anteayastill missing in my browser16:50
sdagueclarkb: what's the advatage of check && gate vs. just gate in naming?16:50
sdagueis that just node preference?16:50
fungisdague: we have used it in the past to shunt check pipeline workers off to lower-performing environments/providers/regions16:51
*** bdpayne has quit IRC16:51
clarkbsdague: ya, in the past we used check as more of a "you can have slower nodes here" method16:51
*** alexpilotti has joined #openstack-infra16:51
clarkbwe could go back to gate- everywheer now if we want to16:51
clarkbbut its a handy trick to have available16:51
fungiso it allows us to have "low priority" and "high priority" versions of the same jobs and choose where to run them16:51
clarkbok I find nothing else about cgit cache deletions16:51
clarkbI am just going to rm everything in /var/cache/cgit16:52
anteayasdague: +216:52
fungiclarkb: big hammer. good choice16:52
*** maxbit has quit IRC16:52
clarkbdone16:52
pleia2 looks good!16:52
* anteaya refreshes16:52
pleia2anteaya: refresh :)16:52
clarkband what do you know. we have project-config now16:52
* sdague hands clarkb 🔨16:52
anteayayay!16:53
pleia2\o/16:53
anteayapleia2 clarkb thank you!16:53
* anteaya goes back to reviewing16:53
*** praneshp has quit IRC16:53
*** hdd has quit IRC16:53
patrickeastHey everyone, not sure who in particular I should ping, I wanted to follow up on a request I sent to the openstack-dev mailing list to get voting permissions for my third party Cinder driver CI (for reference: http://lists.openstack.org/pipermail/openstack-dev/2014-September/047392.html ). I never received any feedback from it and was curious if there was anything we needed to do on our side to move forward with it.16:55
fungipatrickeast: the cinder ptl and/or developer community are the people who should decide that16:55
patrickeastfungi: ok, thanks!16:56
fungipatrickeast: the project infrastructure team merely pushes whatever buttons are needed to reflect cinder's decision in the matter16:56
patrickeastfungi: gotcha16:56
*** Longgeek_ has quit IRC16:57
*** praneshp has joined #openstack-infra16:57
clarkbpleia2: wow all thing sopen then straight to paris?16:59
clarkboh I guess there is a week in the middle16:59
pleia2clarkb: I have a wedding in miami first16:59
pleia2then I'm staying for 4 nights at a suite by the ocean and working from there so I don't need to fly back west16:59
*** _nadya_ has quit IRC16:59
pleia2also, beaches17:00
pleia2so Miami to Paris, then Paris to Philly for another wedding D:17:00
clarkbso you are going from warm sunny south florida to paris in november. sounds fun :)17:00
fungipleia2: sorry i won't be around to cheer you on at ato this year... harder since i'm not living there now. you should totally convince Shrews and olaph to come though!17:00
pleia2fungi: aw, yeah17:00
clarkbfungi: don't you live in the same state?17:01
fungiclarkb: yeah. it's not a small state17:01
clarkbfungi: ~3 hour drive?17:01
fungimore like 4 depending on traffic. i was considering going if i got a presentation accepted, but then didn't get around to proposing one. mea culpa17:02
fungiif it wasn't two weeks before the summit i'd have probably just gone anyway17:02
*** jlibosva has quit IRC17:03
fungibut definitely going to remember to put in a talk for the next one17:03
*** gokrokve_ has quit IRC17:03
pleia2they've been really excited about + supportive of speakers, such a nice group of folks, I'm looking forward to it17:03
clarkbnice. I think mordred said it was good last year or did fungi go too and say that?17:04
*** isviridov_meetin is now known as isviridov_away17:05
fungii went last year, yeah. mordred and fallenpegasus both spoke there on openstack topics17:05
clarkbthough thinking about november is paris reminds me I really need a new coat and probably new gloves17:05
pleia2fallenpegasus is coming along this year too17:06
fungiawesome17:06
*** shashankhegde has joined #openstack-infra17:06
fungia lot of people from the local osug will also be going... they got a stack of comp tickets17:06
pleia2I just bought a new coat when I went to philadelphia at new years and forgot that other places have seasons, go me17:06
fungi(an open stack of comp tickets?)17:06
pleia2(also, grown soft living here)17:06
clarkbI have had my current coat for many many years and it is no longer awesome (really larissa got a new one last winter and I spent all winter wanting it)17:07
pleia2below 45? chilly! my Mainer roots are ashamed :)17:07
anteayaclarkb: I recommend alpaca wool for gloves, hat socks and sweater17:07
fungii will probably be wandering around paris in hawaiian shirts and trying to pretend it's not november17:07
anteayavery light weight but also toasty warm17:07
clarkbanteaya: I don't have to fight canadian winters :)17:08
* fungi lives in a constant state of denial17:08
pleia2fungi: hehe17:08
anteayaclarkb: never ever fight them, you will lose17:08
anteayajoin them17:09
*** ivar-lazzaro has joined #openstack-infra17:09
anteayaand actually alpaca wool is cool for warmer places17:09
openstackgerritA change was merged to openstack-infra/project-config: specify node type correctly for new -src jobs  https://review.openstack.org/12570717:09
clarkbbut ya I have been buying more and more wool17:09
anteayawhereas sheep's wool is very heavy, so deals with temp changes harder with with sheep's wool17:10
*** armax has quit IRC17:10
clarkbwool socks are best socks17:10
anteaya++17:10
anteayathey are17:10
anteayawool keeps you warm even if it gets wet17:10
anteayawhich is why wool is so important17:10
anteayajust don't pair it with silk17:10
*** ivar-lazzaro has quit IRC17:10
fungiin reality, i travel with a military issue trench coat. works well for cool weather and easy to stuff in the bag17:11
clarkbfungi: do you have vibram boots?17:11
sdagueclarkb: ... you know what... do I actually need to modify projects.yaml at all?17:11
*** ivar-lazzaro has joined #openstack-infra17:11
fungino, i have actual tank boots17:11
*** mestery has joined #openstack-infra17:11
fungii just don't wear heavy clothing if i can get away with it17:11
clarkbsdague: yes, you need to add a node: devstack-trusty || devstack-precise line in projects.yaml under the job instantiation17:11
openstackgerritSean Dague proposed a change to openstack-infra/project-config: remove unneeded part of projects.yaml  https://review.openstack.org/12571117:12
sdagueclarkb: .... but largeops doesn't need that17:12
clarkbsdague: the reason you need it that way is because you are using {name}17:12
*** AJaeger has joined #openstack-infra17:12
sdagueoh...17:12
sdagueok17:12
clarkbso it has to be per proejct17:12
fungiand also because you're using node: {node} in the template17:12
sdaguefungi: node doesn't seem to be an issue17:13
sdagueexibit a: large-ops17:13
clarkbsdague: ignore large-ops17:13
sdagueok17:13
clarkbsdague: its completely different17:13
sdagueclarkb: why?17:13
sdagueI get the name thing17:13
clarkbbecause large ops isn't done in a per project way and it is instatiated "globally"17:13
clarkband that global instantiation sets the correct node17:13
*** ZZelle_ has joined #openstack-infra17:14
*** yamahata has quit IRC17:14
*** apmelton has joined #openstack-infra17:14
sdagueok17:14
*** armax has joined #openstack-infra17:14
*** harlowja_away is now known as harlowja17:14
clarkbif you look in projects.yaml there is a devstack-jobs section iirc17:15
clarkbsdague: that is where we set up all of the global cogating jobs that are shared across projects17:15
fungisdague: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n171717:15
fungiand yeah, it's the "devstack-jobs" faux project17:16
AJaegerone question regarding sorting of the rest of layout.yaml: Currently it contains for projects sections like "OpenStack server", "OpenStack clients", "OpenStack documentation" etc. - but jobs are not in the proper sections. Should we just sort them all alphabetical?17:18
*** gokrokve has joined #openstack-infra17:18
AJaegeror stay with the sections as they are and sort within?17:18
*** kashyap has joined #openstack-infra17:18
sdaguefungi: ok gotcha17:18
AJaegerAdvantage of alphabetical is that it's easy to check and the sections are so large that people miss the "section title"17:18
sdagueso if I didn't need {name} I could do that17:18
sdaguebut because I do, I can't, right?17:18
fungisdague: well, with some redesign you probably could17:19
*** tgohad has quit IRC17:19
sdagueok17:19
sdaguehmmm... still NOT_REGISTERED17:19
fungisdague: if devstack-gate was smart enough to know that it should under specific circumstances install $ZUUL_PROJECT from source and not other projects, then you could get away with a generic job rather than a project-specific job i think17:20
sdague122297,117:20
anteayaAJaeger: I like sections, if we can make it work17:20
AJaegeranteaya: it's more difficult to enforce ;)17:20
fungisdague: the job config updates haven't made it into the jenkins masters yet17:20
anteayaAJaeger: it helps people figure out how to compose their patch better17:20
anteayaAJaeger: agreed17:20
sdaguefungi: ok, gotcha17:21
sdaguefungi: what's the normal delay on that?17:21
*** pkoniszewski has joined #openstack-infra17:21
fungisdague: and since this is a node label change, it's also exactly the new lag issue clarkb described that he and zaro are tracking down17:21
AJaegerfungi, clarkb, sdague: Any preference or guidance?17:21
sdagueAJaeger: sections please17:21
sdagueAJaeger: funny because I just was doing this - https://review.openstack.org/#/c/125700/17:22
fungisdague: merged at 17:09 so would have been caught in the 17:15 puppet run a few minutes ago, which would then fire off jenkins job builder on the masters which takes a variable amount of time but on the order of minutes17:22
AJaeger;)17:22
apmeltonwould anyone around here be able to help out with a public key issue with gerrit?17:22
AJaegerOk, I'll first write a test and then sort ;)17:22
fungisdague: and then the next worker to get registered with the correct new node label should push its jenkins master to register the corresponding job:label combo in zuul's gearman17:23
*** pfallenop has quit IRC17:23
malini1clarkb: do the dependent packages always need to come from http://packages.ubuntu.com/trusty/ or can it be from a 3rd party repo (wrt to jenkins gate jobs) ?17:23
anteayaapmelton: we all can but we need to know the problem17:23
fungiapmelton: sure, what error are you getting? can you put it on http://paste.openstack.org/ and let us know the url?17:23
*** rmcall_ has joined #openstack-infra17:23
*** rmcall has quit IRC17:24
*** rmcall_ is now known as rmcall17:24
apmeltonanteaya: fungi: basically even after updating public keys on his account, we are still getting a public key denied with trying to access gerrit through ssh17:24
apmeltonanteaya: fungi: http://paste.openstack.org/show/117845/17:24
*** Ryan_Lane has joined #openstack-infra17:24
*** pfallenop has joined #openstack-infra17:25
fungiapmelton: and nels-n-nelson is the ssh username displayed at https://review.openstack.org/#/settings/ i take it?17:25
apmeltonfungi: yes17:26
*** jgallard has quit IRC17:26
anteayaapmelton: when you input the ssh key how did you copy/paste it?17:26
*** rainya has joined #openstack-infra17:26
anteayawhat editor did you have open to copy the key from?17:26
*** amuller has quit IRC17:26
*** amcrn has joined #openstack-infra17:27
apmeltonanteaya: I believe it was just a cat in a terminal, I've asked nels to join #openstack-infra so he can let us know17:27
apmeltonwe've checked to make sure the ssh key on the web interface matches the id_rsa.pub file17:27
fungisdague: looks like it's correctly registered in zuul now so should be safe to recheck17:27
anteayadebug2: we did not send a packet, disable method17:28
*** rkukura has joined #openstack-infra17:28
anteayaapmelton: thanks, some folks copy/pasting from window's editors end up with newlines in their key17:28
openstackgerritSean Dague proposed a change to openstack-infra/project-config: add the src lib forward testing to all of oslo  https://review.openstack.org/12571517:28
sdaguefungi: thanks for the heads up17:28
fungiapmelton: did you check to make sure the id_rsa.pub is actually the correct public key corresponding to /home/nels.nelson/.ssh/id_rsa too? i've seen people regenerate their public key before and forget to replace the private key along with it17:28
*** ramashri has joined #openstack-infra17:29
fungiwhich can result in exactly this error message17:29
apmeltonfungi: hmmmm will have to ask nels when he gets here17:29
sdaguefungi: sweet, it looks like it did a thing17:30
fungiapmelton: for reference, the command to print the public key material corresponding to that private key is 'ssh-keygen -y -f /home/nels.nelson/.ssh/id_rsa'17:30
*** rmcall_ has joined #openstack-infra17:31
fungiyou should make sure the output of that matches the public key which was uploaded17:31
*** rmcall has quit IRC17:31
rfolcofungi, do I need to manually clone projects at /var/lib/zuul/git/ or zuul does it automatically ?17:31
fungirfolco: the zuul merger daemon should do that automatically if it's running17:32
fungirfolco: take note that it's a separate daemon from the zuul master (scheduler) daemon, and each has its own init script17:33
*** liam__ has joined #openstack-infra17:33
*** mjturek has left #openstack-infra17:33
*** gokrokve has quit IRC17:33
*** liam__ has quit IRC17:33
rfolcofungi, yeah, zuul-merger and zuul-server.... one more question please: do I need to choose between gearman built-in and start gearman manually ? both works ?17:33
*** dane_leblanc has quit IRC17:34
*** cnesa has quit IRC17:34
*** rmcall has joined #openstack-infra17:34
fungirfolco: the built-in gearman server within zuul is what we use in production, though it's designed to also work with a standalone gearman server (however, we may have one or two extensions implemented which are not yet supported in other gearman servers which zuul benefits from)17:35
*** rmcall_ has quit IRC17:35
*** david-lyle has quit IRC17:35
rfolcofungi, great thanks!!17:35
*** cody-somerville has quit IRC17:36
fungirfolco: see http://ci.openstack.org/zuul/launchers.html#id2 for details17:37
*** kashyap has quit IRC17:37
rfolcofungi, nice. We used old standalone gearman, moving to built-in one now. Zuul adds jobs to the pipeline, but it does not trigger any jobs yet.... investigating...17:38
*** dane_leblanc has joined #openstack-infra17:38
*** ameade has joined #openstack-infra17:39
*** tonytan4ever has joined #openstack-infra17:39
fungirfolco: if you're using it with jenkins, that probably implies you don't have the jenkins gearman plugin installed on your jenkins master, the plugin is configured incorrectly, the jenkins master can't reach zuul's gearman service over the network...17:39
*** Ryan_Lane has quit IRC17:40
*** Ryan_Lane has joined #openstack-infra17:41
fungirfolco: you can see what workers and jenkins jobs have been registered into zuul's gearman queue with echo status|nc -q 3 localhost 473017:41
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Stevedore worker plugins  https://review.openstack.org/12550417:41
openstackgerritSean Dague proposed a change to openstack-infra/project-config: add the src lib forward testing to all of oslo  https://review.openstack.org/12571517:41
openstackgerritSean Dague proposed a change to openstack-infra/project-config: decouple oslo libs from integrated gate  https://review.openstack.org/12572017:41
*** bdpayne has joined #openstack-infra17:42
clarkbmalini1: they should come from trusty17:43
rfolcofungi, I see my jobs there. What I find strange is the fact of /var/lib/zuul/git/ is empty17:43
clarkbmalini1: we have very little in the way of vetting 3rd party packages and ensuring that they are kept up to date17:44
clarkbmalini1: this has bitten us in the past17:44
*** mestery has quit IRC17:44
fungithough it's entirely possible for a stackforge project job to add a third-party apt repo, update the package list, and then install packages from it17:45
fungirfolco: have you confirmed that you see zuul-merger in the running process list on your zuul server?17:45
nelsnelsono/17:46
apmeltonfungi: nelsnelson ran ssh-keygen -y -f ~/.ssh/id_rsa | diff ~/.ssh/id_rsa.pub - and produced no meaningful diff17:46
anteayanelsnelson: hello and welcome17:46
nelsnelsonhowdy17:46
rfolcofungi, yes, 1 zuul-merger and 2 zuul-server processes running17:46
*** rainya has quit IRC17:46
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Subscription events now appear in UI  https://review.openstack.org/11440417:46
anteayanelsnelson: what is your latest status? any change in the error message?17:46
nelsnelsonnope17:46
ameadeis it new that devstack is downloading: http://tarballs.openstack.org/trove/images/ubuntu_mysql.qcow2/ubuntu_mysql.qcow217:46
nelsnelson$ ssh -p29418 nels-n-nelson@review.openstack.org17:47
nelsnelsonPermission denied (publickey).17:47
*** terryw has joined #openstack-infra17:47
fungirfolco: and 'echo status|nc -q 3 localhost 4730|grep ^merger:' should show update and merge tasks registered in gearman by your merger (with at least a 1 in the last column)17:47
clarkbameade: looks like that arrived in june17:47
clarkbameade: wiht afefaa7822c189ff9a63fbcde8751e29f995e2c017:48
funginelsnelson: i'll double-check the server ssh log17:48
nelsnelsonthanks fungi17:48
*** otherwiseguy has quit IRC17:48
ameadeweird, something must have changed today because it's taking my devstack nodes forever to get through that step17:48
rfolcofungi, exactly, update and merge tasks shown in the output, 1 in the last column too17:48
ameadeclarkb: thanks, i wonder if trove got turned on or something17:48
funginelsnelson: [2014-10-02 17:46:53,855 +0000] 9c6e13c3 nels-n-nelson - AUTH FAILURE FROM 50.57.17.245 user-not-found17:49
funginelsnelson: you're sure https://review.openstack.org/#/settings/ says your username is nels-n-nelson right?17:49
rfolcofungi, what changed now is that zuul created nova dir /var/lib/zuul/git/openstack/nova/, but its empty17:49
fungirfolco: i'd suggest pouring over the zuul debug log for clues17:50
rfolcofungi, I'll debug it more yes... thanks again!!17:50
*** e0ne has joined #openstack-infra17:50
*** cody-somerville has joined #openstack-infra17:51
*** hdd has joined #openstack-infra17:52
*** rainya has joined #openstack-infra17:52
funginelsnelson: i'm looking in our gerrit backend database and find no account with that username17:53
funginelsnelson: if you're the brian nelson at ibm who created a gerrit account around this time yesterday, your ssh username seems to be brnelson17:54
fungiapmelton: ^17:54
*** cdent has quit IRC17:54
*** dizquierdo has quit IRC17:54
apmeltonfungi: thats not him17:54
nelsnelsonusername should be "nels-n-nelson" according to openstack.org.17:54
funginelsnelson: according to https://review.openstack.org/#/settings/ though?17:55
anteayanelsnelson: review.openstack.org17:55
nelsnelsonoops17:55
nelsnelsonlaunchpad.net17:55
anteayanelsnelson: you log into review.openstack.org17:55
anteayaand set you username17:55
nelsnelsonaccount id 1321517:55
anteayaif you haven't set your username, gerrit doesn't have one for you17:55
funginelsnelson: yeah, you don't have a gerrit username for that account id yet17:56
*** pelix has quit IRC17:56
funginelsnelson: click in the blank next to username and carefully type in what you want17:56
*** FallenPegasus has joined #openstack-infra17:56
funginelsnelson: once its set, it can't be changed17:56
*** kgiusti has joined #openstack-infra17:56
nelsnelsonokay17:57
nelsnelsonthat worked17:58
funginelsnelson: looks like you set it to "nelsnelson"17:58
nelsnelsonyup17:58
fungiokay, great17:58
nelsnelsonwell...  thank you for your assistance, fungi17:59
*** johnthetubaguy is now known as zz_johnthetubagu17:59
funginelsnelson: i think depending on launchpad settings, gerrit may fail to import your username from the openid provider there (perhaps if there are disallowed characters, or could be related to account privacy settings). sorry for any confusion17:59
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572418:00
clarkbya I think its account privacy settings18:00
AJaegersdague, anteaya: I sorted the sections - wasn't as bad as I feared.18:00
*** annegent_ has quit IRC18:00
*** mestery has joined #openstack-infra18:00
*** ctracey_ has joined #openstack-infra18:00
*** stevemar has quit IRC18:00
*** pkoniszewski has quit IRC18:00
*** stevemar has joined #openstack-infra18:01
*** ctracey_ is now known as ctracey18:01
sdagueAJaeger: cool18:01
sdagueAJaeger: how much is outstanding?18:01
sdaguebecause that's going to be a giant merge conflict18:02
anteayaAJaeger: yay!!18:02
anteayaAJaeger: thank you18:02
AJaegersdague: I doubt it will be a large merge conflict. This is the final patch for sorting all projects in layout.yaml18:02
fungispeaking of giant merge conflicts, it'18:02
fungis probably time for a second cleanup pass on the acls18:02
anteayafungi: yes18:02
anteayaclean acls for everyone18:03
AJaegerand I had few entries to sort and few outstanding reviews18:03
fungiand then comparing checksums to find out which ones we can collapse together18:03
AJaegerstill, a quick merge would be nice for everybody18:03
sdagueAJaeger: ok, yeh that's not too bad18:03
malini1thanks for the clarification clarkb. Cassandra is not part of the official ubuntu repo :( So I guess our only option is 3rd party testing18:04
sdagueAJaeger: so... I'd suggest you actually add another section break up18:04
sdagueAJaeger: I had a few additional sections in my stackrc patch18:04
sdaguelike oslo being it's own section18:04
clarkbmalini1: you don't need to do third party testing...18:04
fungimalini1: as i suggested earlier, stackforge jobs are welcome to add a third-party package repo (ppa, whatever), update the package list and install packages from that18:04
*** wenlock_ has quit IRC18:05
fungijust has to happen as part of the job18:05
fungiwe can't pre-configure our workers to support it18:05
AJaegeroslo and specs might be further sections...18:05
*** wenlock_ has joined #openstack-infra18:05
sdaguebecause things like pycadf aren't completely obvious that they are oslo, for instance18:05
malini1fungi: is there an example of where this is already done?18:05
*** david-lyle has joined #openstack-infra18:06
AJaegeranteaya: regarding https://review.openstack.org/#/c/125489/1/zuul/layout.yaml - python-jobs template does not include python33 checks18:06
sdagueand there are times when we want to do something to all of oslo18:06
anteayaAJaeger: I just looked at it and linked18:06
anteayaAJaeger: what is that at the link I included?18:06
*** sabeen has quit IRC18:06
anteayaif it isnt' gate-{name}-python33 then I can't read anymore18:06
fungimalini1: possibly, i'll look real quick. some of the chef cookbook jobs do similar thigs by installing arbitrary ruby gems18:07
AJaegeranteaya: that's the python-jobs file as part of jenkins18:07
anteayaAJaeger: then I am throughly confused18:07
sdagueok, so this is the 'add the library testing to all the rest of oslo' patch - https://review.openstack.org/#/c/125715/ - the devstack patch that makes it functional is stil making it's way through the queues, but if we get the layout there it will mean that's all ready to go18:07
anteayasince that file was what I have been operating under as the source for python-jobs when it is called for a project18:08
AJaegeranteaya: python-jobs template for zuul is defined here:  http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n23918:08
fungimalini1: actually, there's a job in devstack-gate.yaml which runs 'sudo add-apt-repository cloud-archive:icehouse' so you could look at that for possible inspiration18:08
AJaegeranteaya: yeah, jenkins templates and zuul templates are completely different18:08
AJaegeranteaya: zuul templates create jobs18:08
anteayathen I'm wrong and have been for some time18:08
*** annegent_ has joined #openstack-infra18:08
malini1fungi: awesome!! I'll take a look at those.Thanks a lot!18:08
AJaegerReplace my last line with: jenkins templates create jobs18:08
AJaegerand zuul uses those jobs, it never sees the jenkins templates, just the generated jobs18:09
fungimalini1: looks like it's a workaround ironic implemented in their devstack-virtual-ironic nuilder macro18:09
anteayaright, that is what I understood18:09
fungis/nuilder/builder/18:09
anteayaand the jenkins/jobs/project.yaml imports jobs from name-to-import.yaml files in jenkins/jobs18:09
anteayasuch as python-jobs18:10
*** wenlock__ has joined #openstack-infra18:10
malini1fungi: found it. Thanks!18:10
anteayaor infra-publish-jobs.yaml or whatever18:10
*** david-lyle has quit IRC18:10
AJaegeranteaya: and jenkins uses all of this to generate jobs18:11
anteayayes18:11
AJaegerand then zuul works on those jobs - it never sees the jjb templates18:11
anteayaright18:11
AJaegerjjb templates and zuul templates are totally different beasts18:11
anteayaright18:11
AJaegerzuul templates are defined on top of zuul/layout.yaml18:12
*** wenlock_ has quit IRC18:12
anteayazuul templates are defined in zuul/layout.yaml18:12
anteayaand jjb templates are defined in jenkins/jobs18:12
AJaegeranteaya: we're on the same page18:12
anteayaso this is why I am confused about your comment18:12
*** mestery has quit IRC18:12
AJaegeranteaya: my patch https://review.openstack.org/#/c/125489/ is about layout.yaml18:13
*** _nadya_ has joined #openstack-infra18:13
fungidhellmann: any objection to https://review.openstack.org/125715 extending the package-only-dependencies non-voting job to all oslo libs?18:13
anteayaright18:13
AJaegerand you r comment is "gate-{name}-python33 is in python-jobs.yaml: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/python-jobs.yaml#n109 so we could use that here as well"18:13
anteayamy fault, I see that now, I thought it was jenkins/jobs/project.yaml18:13
anteayamy mistake18:13
anteayayou are correct, sorry18:13
AJaegerno problem...18:14
anteayaAJaeger: okay so now I have a question about losing the tarball job18:15
anteayasince the tarball job is not in the python-jobs zuul template18:15
sdagueAJaeger: there is a python3-jobs though right?18:15
anteayayou want to remove it for all those projects?18:15
*** gokrokve has joined #openstack-infra18:15
sdagueAJaeger: is there a reason not to use python3 jobs for mistral?18:16
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Add buildimages job for Sahara  https://review.openstack.org/12572918:16
AJaegersdague: yes, there's python3-jobs18:16
fungisdague: looks like mistral has it check-only and non-voting18:17
AJaegeranteaya, sdague: Let me review my layout cleanup patch once I'm finished with the sorting patch18:17
anteayaAJaeger: sorry18:17
*** mmaglana has joined #openstack-infra18:17
sdagueAJaeger: sounds good18:17
sdagueospurge?18:17
AJaegersdague, anteaya: I added now an oslo section18:17
sdaguehey, can we start requiring a one line comment about what the project is in layout.yaml :)18:17
fungio-spurge!18:18
adam_gare there new nodepool images rolling out that may be causing https://bugs.launchpad.net/openstack-ci/+bug/1376863 ?18:18
uvirtbotLaunchpad bug 1376863 in openstack-ci "ironic jobs failing: error: internal error: creation of non-raw images is not supported without qemu-img" [Undecided,New]18:18
lifelessor we could pull that from setup.cfg18:18
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572418:18
lifelessand not duplicate it :)18:18
lifelesssdague: ^18:18
clarkbadam_g: yes18:18
AJaegersdague: feel free to propose such a patch ;)18:18
sdagueAJaeger: mostly ... I want some context on what these projects are :)18:19
*** zz_gondoi is now known as gondoi18:19
fungiadam_g: clarkb: is it possible we used to have that package on our old images and somehow dropped it?18:19
clarkbadam_g: we update all the images every day in the morning. also we switched to dib built devstack-trusty images18:19
*** HeOS has joined #openstack-infra18:19
AJaegersdague: so, should I enhance my patch? Could you give an example, please?18:19
clarkbfungi: ya I am guessing that the dib builds shed it because they didn't start with it whereas hpcloud/rax both have it for some reason?18:19
fungisdague: you can cross-reference to gerrit/projects.yaml though agreed that's not terribly convenient18:20
clarkbexcept we were using official ubuntu images in hpcloud previously to switching to dib18:20
clarkbadam_g: the really excellent thing is you can build that image yourself. one sec18:20
fungithat's why i find it odd18:20
adam_gclarkb, fungi in previous jobs qemu-utils was still being installed, its just now moved to Recommends instead.18:21
fungiwe're dib'ing from the ubuntu cloud images which in theory are the same as hpcloud's partner images right?18:21
adam_gi can just update the devstack apts if thats whats required18:21
AJaegersdague: cliff is in oslo as well, isn't it?18:21
clarkbadam_g: if you grab openstack-infra/project-config there is a tools/build-image.sh script that will build that image for you18:21
clarkbadam_g: yes I think that is what will be necesary18:21
clarkbfungi: maybe the package changed?18:21
adam_gclarkb, i want to check that out for sure, but need to unbreak this. its blocking ironics RC118:22
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572418:22
openstackgerritA change was merged to openstack-infra/project-config: Fix local bashate runs  https://review.openstack.org/12544118:23
sdaguedo python3-jobs include 34?18:23
fungisdague: no, they're python33 right now18:23
clarkbbecause py34 is currently somewhat broken18:23
sdagueok18:23
openstackgerritA change was merged to openstack-infra/project-config: Allow access to nova-docker stable branches  https://review.openstack.org/12476018:24
anteayaAJaeger: here are all the olso things, cliff is in there: http://git.openstack.org/cgit/openstack/governance/tree/reference/programs.yaml#n15918:24
fungisdague: once we get the last straggler problems worked out for 3.4, the plan is just to switch the python3-jobs template from python33 to python34 jobs and not look back18:24
sdagueok, I was just looking at joe's hacking thing18:24
AJaegeranteaya: thanks!18:24
openstackgerritA change was merged to openstack-infra/project-config: Add pep8 gate job to stackforge/ospurge  https://review.openstack.org/12472918:25
anteayaAJaeger: np18:25
anteayaflaper87: hi18:26
anteayaflaper87: can you convince me you actually want DEVSTACK_GATE_UNSTACK=1: https://review.openstack.org/#/c/125562/1/jenkins/jobs/zaqar.yaml18:26
openstackgerritA change was merged to openstack-dev/hacking: Work toward Python 3.4 support and testing  https://review.openstack.org/11876518:26
*** david-lyle has joined #openstack-infra18:27
openstackgerritA change was merged to openstack-infra/project-config: Update hackings jobs  https://review.openstack.org/12490018:27
sdagueadam_g: so I don't think we want to do this - https://review.openstack.org/#/c/122539/218:28
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572418:29
AJaegersdague, anteaya: hope that's it ^18:29
adam_gsdague, related to the clients-from-master stuff?18:29
sdagueadam_g: yeh18:29
sdagueadam_g: let me get the oslo stuff all sorted out here, then I think this will follow a similar pattern18:30
sdaguewhere in the main tests we do dib from releases18:30
sdagueand dib defines a job which is ironic config + itself at latest git18:30
sdagueto ensure future releases don't break ironic18:30
adam_gsdague, what if lib/dib's install_disk_image_builder() had logic in it to install from git vs master, and that gets toggled between the dib pipeline and others?18:31
adam_gsdague, i'd still like to be dependent on the dib devstack service, for other reasons (this patch stack https://review.openstack.org/#/c/125524/)18:32
adam_ger, s/git vs master/git vs release/18:32
openstackgerritA change was merged to openstack-infra/project-config: Enable functional tests for python-swiftclient  https://review.openstack.org/12481218:32
openstackgerritA change was merged to openstack-infra/project-config: Added jobs for MongoDB and Percona datastores  https://review.openstack.org/12505718:32
anteayacan some kind soul re-enable 10692 brocade-oss-service Brocade Vyatta CI DL-GRP-VYATTA-OSS@Brocade.com please?18:32
anteayaAJaeger: will look in a minute18:33
sdagueadam_g: explain what that patch series needs?18:33
openstackgerrityolanda.robla proposed a change to openstack-infra/storyboard-webclient: Allow assigning tasks without expanding the edition box  https://review.openstack.org/12564318:33
*** mestery has joined #openstack-infra18:34
sdaguealso, before I ruin the world, all of the os- tools have releases, right?18:34
anteayano idea18:34
sdagueadam_g: basically the way we are going to be headed is if you aren't in the openstack servers section or testing section, you will get installed as a pip install - https://review.openstack.org/#/c/125700/1/stackrc18:35
lifelessshould do - a for loop over git describe will tell you that18:35
lifelesssdague: we use them via pip install in tripleos own tests18:36
sdaguelifeless: ok, coolio18:36
sdaguethat was my assumption... I just wanted to make sure18:36
lifelesssdague: we intend to special case when we're testing a commit to one of them18:36
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Add buildimages job for Sahara  https://review.openstack.org/12572918:36
sdaguelifeless: right18:36
adam_gsdague, the patch series is an attempt to centralize DIB usage to lib/dib, so we can easily control the DIB execution environment, to avoid going out to the internet for things like cloud images and packages18:36
lifelesssdague: derekh put some code together to make an ancilliary local pip index18:36
sdaguethat's the logic that's about to land in devstack as well18:36
sdaguelifeless: ok, I do it with git trees, but that's cool18:37
adam_gsdague, if we can just keep the logic for flipping the 'master vs release' for DIB, os-* to lib/dib, we should be okay, no?18:37
anteayamy request is about to get lost so I will point it at fungi or clarkb, can one of you re-enable 10692 brocade-oss-service Brocade Vyatta CI DL-GRP-VYATTA-OSS@Brocade.com please?18:37
lifelesssdague: (thats so that our installer logic doesn't need to be special cased - we just add an index with the local bbuild in it)18:37
sdagueadam_g: no, this is going to be a system level thing18:37
sdaguelifeless: yeh, this is just LIBS_FROM_GIT=oslo.config,oslo.messaging18:38
sdaguefor instance18:38
lifelesssdague: yah, swings and roundabouts18:38
sdagueI have no idea what that means :)18:38
lifelesssdague: it means both ways will work18:38
fungianteaya: i've just activated 1069218:39
sdaguelifeless: nice, I'll have to use that and confuse my western hemisphere friends18:39
*** prad has quit IRC18:39
*** pkoniszewski has joined #openstack-infra18:40
lifelesssdague: http://idioms.thefreedictionary.com/it's+swings+and+roundabouts18:40
fungithat's a new one on me. love it18:41
anteayafungi: thank you18:42
adam_gsdague, so the long term goal is to get all libraries (DIB and os-*) to follow https://review.openstack.org/#/c/125346/4 ?18:43
*** yfried|afk has joined #openstack-infra18:43
sdagueadam_g: yes18:44
*** ashp has joined #openstack-infra18:44
sdagueso that the integrated projects test against released libraries18:44
sdagueand then libraries can create jobs to test their git version against some config18:44
sdagueadam_g: https://review.openstack.org/#/c/125715/ is the config side of that18:45
*** mestery has quit IRC18:46
sdagueadam_g: there was an ML thread on this18:46
adam_gyeah, first time looking at the patches18:47
*** praneshp has quit IRC18:48
adam_gsdague, the thing about DIB and its os-* requirements, is they are not listed in requirements.txt of, say, ironic. so if they weren't listed as LIBS_FROM_GIT, they wouldn't be pulled in elsewhere18:48
*** _nadya_ has quit IRC18:49
sdagueyeh, so that's ok18:49
sdaguehmm... actually18:49
sdagueok, so I need another form of setup_lib that's like the pbr special case18:49
adam_gif install_diskimage_builder()  could handle that with its own logic, then services that need it can just depend on it being enabled18:49
sdagueadam_g: https://review.openstack.org/#/c/125346/4/lib/infra18:50
adam_gright18:50
sdagueso you could do the conditional inline18:50
sdagueor we can make another function for that18:50
sdaguein this case pbr was the only *must* install of the libraries18:50
adam_ghttps://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/ironic#n580 , similar thing happens today in lib/ironic18:51
flaper87anteaya: I would If I knew what that is for but to be completely honest, I followed pretty much what swift/neutron did.18:51
flaper87anteaya: can you advice me on what's best to do?18:51
sdagueadam_g: right, so this will just generalize it18:51
adam_gsdague, makes sense. does https://review.openstack.org/#/c/122539/ seem sane now?18:52
AJaegersdague: could you review https://review.openstack.org/#/c/125724/ again, please?18:53
sdagueadam_g: I guess, what is dib as a service anyway?18:53
sdagueI thought it was a command18:53
lifelessits diabolical18:53
sdaguealso... we do some ... tricksy stuff about services with and without hyphens I thought, so where is the dib service patch?18:54
sdagueor maybe that's just a grenade thing ... can't remember now18:54
adam_gsdague, im not sure the motivation for adding it as a first class service in devstack, but the series was at https://review.openstack.org/#/q/status:merged+project:openstack-dev/devstack+branch:master+topic:dib-gate,n,z18:55
sdagueadam_g: ok, I never looked at those18:55
sdagueyeh, I don't know18:55
*** mrmartin has joined #openstack-infra18:55
openstackgerritA change was merged to openstack-infra/project-config: Don't run neutron/heat jobs for glance_store  https://review.openstack.org/12556118:55
adam_gi dont really have an opinion as to where that should live (lib/dib vs functions-dib/etc) but it makes sense to centralize it if both heat and ironic need it18:56
*** pkoniszewski has quit IRC18:56
*** praneshp has joined #openstack-infra18:56
sdagueso... does this actually do what you think?18:56
sdagueman... this is the ugly18:56
sdagueI'm going to ask dtroyer about that18:57
*** baoli has quit IRC18:57
sdagueoverloading the service construct for package install seems like a bad long term maintainability approach18:57
sdagueAJaeger / anteaya - https://review.openstack.org/#/c/125715/ would be very nice to get in before the devstack patch lands18:58
*** tsg has joined #openstack-infra18:58
harlowjasoren fyi, when i go to http://linux2go.dk/ i get '404 Not Found' 'The requested URL / was not found on this server.' (just thought u'd like to know, i think u use it in your email signature)18:59
anteayaflaper87: hmmm, actually the reason I am asking is due to someone needed to set that to 0 in a followup patch since they didn't need devstack to be unstacked before the tests ran18:59
adam_ghttps://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/dib#n35 oh hum18:59
sdagueadam_g: yeh, so honestly, I think it does what you want18:59
anteayasdague: reviewing, what does DEVSTACK_GATE_UNSTACK=1 do?18:59
sdagueit's just kind of wonky18:59
lifelesssdague: let me pimp bindep at this point18:59
clarkbanteaya: it runs unstack.sh after running devstack19:00
sdaguelifeless: feel free to pimp19:00
sdaguehowever, I'm not quite sure how it applies here19:00
adam_gsdague, it doesnt, that pip_install should be installing DIB from master (or at least thats what i thought it was doing:)19:00
fungianteaya: do my replies to your comments on 125489 make sense?19:00
clarkbanteaya: neutron does it because they do not want all the services to be running when they do functioanl testing. They only want neutron up19:01
flaper87sdague: anteaya but before rnning the test?19:01
flaper87oh mmh, ok19:01
sdagueflaper87: ?19:01
*** rushiagr has quit IRC19:01
flaper87so, I guess zaqar wants UNSTACK too but we need to run zaqar manually19:01
flaper87sdague: nvm, it's about the UNSTACK thing19:01
sdagueflaper87: ok19:01
flaper87I mean, nothing bad with having the other services running19:02
flaper87I guess I could just remove that and let the services run19:02
sdagueflaper87: so you actually want to set a smaller enabled services list19:02
*** SumitNaiksatam has quit IRC19:02
flaper87sdague: that for sure, I just need zaqar to run, TBH19:02
AJaegersdague: 125715 and my 125724 will conflict. Let me approve 715 and then rebase 724...19:03
sdagueAJaeger: cool, thanks!19:03
*** dane_leblanc has quit IRC19:03
sdagueflaper87: and keystone, right?19:03
anteayasdague: pycadf is now a keystone project19:03
sdagueanteaya: oh... right19:03
sdaguewell... close enough :)19:04
anteayasdague: do you still want pycadf in this patch then?19:04
flaper87sdague: oh mmh, right, and keystone19:04
flaper87:D19:04
sdagueanteaya: yeh, it can still be in this patch19:04
anteayakk19:04
*** oanufriev has joined #openstack-infra19:04
sdagueanteaya / AJaeger if you are using gerrit and not gertty - https://github.com/stackforge/gerrit-dash-creator/blob/master/dashboards/gate-changes.dash19:05
*** oanufriev has quit IRC19:05
*** oanufriev has joined #openstack-infra19:05
*** e0ne has quit IRC19:05
AJaegerthanks, sdague19:06
*** sarob_away is now known as sarob19:06
anteayaAJaeger: already approved it so I will move on19:06
sdagueflaper87: https://review.openstack.org/#/c/125563/1/jenkins/jobs/devstack-gate.yaml - could you do that with another param instead?19:07
sdagueAJaeger actually seems to be the template master19:07
*** david-lyle has quit IRC19:07
AJaegersdague: I'm not looking at devstack-gate for now19:07
sdagueAJaeger: ok19:08
anteayafungi: yes your comment in 125489 makes sense, thank you19:08
*** ildikov has joined #openstack-infra19:08
arosenclarkb:  is you're using the latest nodepool it still creates a template vm even though it's using diskbuilder?19:08
flaper87sdague: what param are you refering to ?19:08
sdague{backend}19:08
clarkbarosen: no it shouldn't.19:08
anteayafungi: I had a draft comment up but never got finished my thought so never posted19:08
sdaguelike build a {backend} var so that you don't have to keep creating new templates for new backends19:08
sdagueyou just specify it in job def19:08
flaper87sdague: ah, gotcha, yeah. I guess I could re-use the other job19:08
arosenclarkb:  hrm i have the latest nodepool and it looks like it is ?19:09
flaper87sdague: good point, I'll fix this19:09
arosenis there any config settings i need?19:09
clarkbarosen: you need to set up your providers to use the diskimage19:09
clarkbarosen: I am getting a link19:10
arosenclarkb:  thanks :) :)19:10
fungiyeah, right now it supports both methods19:10
clarkbarosen: https://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#n51819:10
fungisimultaneously, so you can mix and match19:10
fungiso uses whichever one you configure for a given label19:10
openstackgerritA change was merged to openstack-infra/project-config: add the src lib forward testing to all of oslo  https://review.openstack.org/12571519:11
arosenclarkb:  does it pull down the image or does devstack-trusty need to live in glance?19:11
*** bhuvan has joined #openstack-infra19:12
*** bhuvan has quit IRC19:12
*** bhuvan has joined #openstack-infra19:12
fungiarosen: it will download and cache the initial cloud image19:12
fungiarosen: see the elements defined in openstack-infra/project-config for details19:13
openstackgerritDolph Mathews proposed a change to openstack-infra/elastic-recheck: add query for mysql server has gone away  https://review.openstack.org/11917719:13
dhellmannsdague: would you update https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary with whatever new instructions are needed now that ^^ has landed? I haven't had a chance to review that patch yet19:13
clarkbarosen: ya the way dib + nodepool works is nodepool runs dib locally using those elements fungi pointed at. This builds an image based off of official ubuntu/rhel/centos/fedora base images with our additional stuff included. Then it takes that image and uploads it to glance in the providers you have configured19:13
sdaguedhellmann: it's not all landed yet19:14
sdagueI will once it's working19:15
dhellmannsdague: ok, thanks19:15
sdagueprobably tomorrow19:15
dhellmannyeah19:15
sdagueit's actually going to be a bit easier19:15
sdagueI think19:15
dhellmannthis is the same thing you were talking about the other day with the libs thing in devstack, right?19:15
sdagueyep19:17
dhellmannok19:17
sdagueyeh, so the change to devstack will just look a little different - https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Setting_up_Gate_Testing19:17
arosenclarkb:  http://paste.openstack.org/show/117869/ ?19:17
dhellmannsdague: the job setup in project-config will be different, too19:17
sdagueyou don't seem to have the part about the project definition in layout.yaml19:17
sdaguedhellmann: oh there it is19:18
dhellmannsdague: it would be good to have a summary of the testing changes on the ML for the rest of the oslo team, when you're ready19:18
sdagueyeh it will be s/integrated-gate/lib-forward-testing/19:18
sdaguedhellmann: will do19:18
dhellmannsdague: yeah, check my ordering to see if we can collapse some steps or need to reorder them, too, now that oslo is in a separate gate19:18
sdaguedhellmann: yep19:18
dhellmannsdague: cool, thanks19:18
*** rushiagr has joined #openstack-infra19:19
*** yfried|afk has quit IRC19:19
*** _nadya_ has joined #openstack-infra19:19
openstackgerritJeremy Stanley proposed a change to openstack-infra/project-config: Normalize Gerrit ACLs  https://review.openstack.org/12574719:20
*** terryw has quit IRC19:20
sdaguedhellmann: https://review.openstack.org/#/c/125720/ will be the flip of the switch here, I'll test on a bunch of libs that I can find to make sure it looks sane first19:23
*** _nadya_ has quit IRC19:24
dhellmannsdague: sounds good19:24
sdagueit actually needs another patch that makes the new jobs voting before it19:25
sdaguebut right now the new jobs are being sent out non voting so can run some rechecks and make sure they do the right things19:25
*** mmaglana has quit IRC19:26
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572419:28
AJaegersdague: rebased ^, could you and anteaya review again, please?19:28
AJaegerwait, just saw anteaya's nit...19:28
openstackgerritAndreas Jaeger proposed a change to openstack-infra/project-config: Sort and check layout.yaml sections  https://review.openstack.org/12572419:29
AJaegerok, now ready ^19:29
*** armax has quit IRC19:31
anteayaAJaeger: thanks +219:31
*** gondoi is now known as zz_gondoi19:32
*** marun has quit IRC19:32
anteayaif I were to disappear for 2 hours and go for a walk, would I disappoint anyone waiting for me to do something?19:32
anteayaI think I am caught up for the moment19:33
* anteaya puts on shoes19:33
*** IAX has quit IRC19:34
AJaegeranteaya: you reviewed my favourite patch and therefore take all the time you need ;) Thanks!19:34
anteayaokay thanks19:35
anteayaglad at least one person is happy :D19:35
*** dane_leblanc has joined #openstack-infra19:36
*** shashankhegde has quit IRC19:36
openstackgerritSpencer Krum proposed a change to openstack-infra/project-config: Use beaker to do acceptance testing of Puppet  https://review.openstack.org/12556719:36
*** juice has quit IRC19:39
fungisdague: on the "we should run this all the time" comment, that patch was the result of 3 months of letting people merge whatever they want to acls (within reason) so between copying from the correct examples in our documentation and cargo-culting from more recent changes or other files in that repo, i expect the next 3 months to diverge even less19:40
sdaguefungi: that's fair19:40
sdagueI did +2 it :)19:40
fungisdague: otherwise i'd bother to clean that script up enough to feel okay turning it into a lint19:40
fungiyep, thanks!19:40
sdagueok, another gate reset means that the devstack change is at least an hour from merge, so I'm going to go for a ride19:41
fungienjoy the weather19:41
openstackgerritA change was merged to openstack-infra/devstack-gate: Always set DATA_DIR  https://review.openstack.org/12206419:42
openstackgerritA change was merged to openstack-infra/project-config: Normalize Gerrit ACLs  https://review.openstack.org/12574719:42
clarkbok https://review.openstack.org/#/c/125475 is starting to shape up. I haven't been able to properly test it yet but I think that mostly does what we want it to do19:42
clarkbturns out I can't run dib in docker19:42
*** arnaud has joined #openstack-infra19:42
clarkband dib does weekly releases so I am semi optimistic that we can rax dib at some point next weke19:43
*** arnaud__ has joined #openstack-infra19:43
fungiawesomeness19:43
*** IAX has joined #openstack-infra19:43
*** juice has joined #openstack-infra19:45
clarkbtime for lunch. back in a bit19:48
AJaegerenjoy, clarkb19:49
pleia2enjoy19:49
fungiat one point not long ago when we only had one pypi mirror we had agreed that we wanted to get an x.509 certificate from a common certificate authority so we could do https with it19:50
*** annegent_ has quit IRC19:51
fungiluckily i was too lazy^H^H^H^Hbusy to get around to it, since we created new mirror servers with different names and stopped using that one19:51
AJaeger;)19:51
fungiso the question now, is, do we want 4 certs for the existing mirrors (are we pretty sure we're not going to rename them and does the desire still stand), or should i not bother?19:52
*** ociuhandu has quit IRC19:52
*** ihrachyshka has quit IRC19:52
fungibecause i also need to order a signed cert for the new openid service mrmartin and smarcet have been building for us, so if i'm expensing i should expense all at once19:53
*** david-lyle has joined #openstack-infra19:54
mrmartinfungi: for openstackid.org19:54
clarkbmaybe its time for an infra CA?19:54
*** alexpilotti has quit IRC19:54
*** mwagner_lap has quit IRC19:54
fungimrmartin: yeah19:55
clarkbthen we can ssl the mirrors in a less formal way (at least for the public)19:55
fungiclarkb: i'm pretty disinclined to want to manage a dedicated ca for our project internal/ci needs19:55
clarkbya :(19:55
clarkbits not fun19:55
fungiwe'd need a lot of boilerplate around not-at-all-secured-do-not-trust-for-real-things19:56
*** david-lyle_ has joined #openstack-infra19:56
mrmartinfungi: I already built a CA, the funniest thing was to distribute the root ca amongst public browsers19:56
fungithe technical requirements for a certificate authority are simple. i used to manage several hundred of them19:56
mrmartinI guess we don't want this19:57
AJaegerI'm signing off now and would appreciate if https://review.openstack.org/#/c/125724/ goes in today to avoid merge conflicts (final patch for sorting of layout.yaml).19:57
fungithe logistics around properly securing the ca key and setting reasonable expactations is where the complexity lies19:57
*** AJaeger has quit IRC19:57
fungimrmartin: the cert for openstackid.org would be obtained from a globally-recognized ca valid for all reasonably current browsers anyway, so this is more about less important/throwaway services19:58
*** MaxV has joined #openstack-infra19:59
mrmartinfungi: anyway, for openstackid project, do we have some alerting system that constantly checks a service status?19:59
*** david-lyle has quit IRC19:59
mrmartinnot talking about log collection :)19:59
*** datsun180b has quit IRC20:00
fungimrmartin: "we" (project infrastructure team) do not. rackspace has a service they would probably comp us, which we could configure to buzz tipit's pagers in the middle of the night if we wanted, maybe20:00
*** ryanpetrello has quit IRC20:00
*** malini1 has quit IRC20:00
clarkbthere has been interest by some in a nagios server20:00
mrmartinfungi: thanks, good to know that.20:00
fungiinterest in a nagios server which provides reporting, but not a nagios server which wakes me up from pleasant dreams ;)20:01
clarkbindeed but it could wake tipit :)20:01
*** nikhil_k|afk is now known as nikhil_k20:01
mrmartinI'm not sure that tipit will operate this openstackid instance.20:01
clarkbah ok20:02
clarkbin any case I think there are options20:02
fungiyeah, i think real-time functional alerting might make more sense if our root sysadmin team grows naturally into 24x7 coverage with lots of overlap, but that's not likely to be any time soon, if ever20:03
openstackgerritKhai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3  https://review.openstack.org/12575520:04
mrmartinfungi: yeap, but if we want to provide services outside of US, in 24/7, like this openstackid auth, somehow need to keep it running20:04
*** baoli has joined #openstack-infra20:04
zaroclarkb: ^ took longer than i anticipated20:05
fungimrmartin: yep. we do manage to keep our other systems running, mainly by making them reliable, but i agree that's no guarantee/sla20:05
mrmartincould be great to build an EU clone of the infra team, so everybody can sleep well20:05
*** rlandy has quit IRC20:05
fungimrmartin: well, we have SergeyLukjanov in russia (when he's actually in russia)20:05
mrmartin:)20:05
*** radez is now known as radez_g0n320:06
fungimrmartin: the bigger coverage gap for root sysadmins right now is apac20:06
*** shashankhegde has joined #openstack-infra20:06
*** mestery has joined #openstack-infra20:06
fungimrmartin: but also, for any hope of 24x7 coverage we'd need enough people that others could go on vacation or travel to conferences, which a lot of us do a lot of the time20:06
*** radez_g0n3 is now known as radez20:06
mrmartinI always promote this devops opportunity at local user group with no much luck20:06
mrmartinyep, it means at least 4 people per site20:07
mrmartinwith almost equal knowledge about the systems.20:07
fungiand also enough losers like me who have no social life and actually notice things need fixing on a saturday afternoon20:07
*** bknudson has quit IRC20:07
mrmartinmaybe well balanced teams with proper size could save your saturday afternoons20:08
fungieh, for the moment it's fine since there's no pressure that the project will spontaneously fall over if systems happen to be broken on the weekend (though i'd still rather that never happened)20:08
mrmartinfungi, if you have a few minutes today, please review my fantastic improvement to the groups portal release job: https://review.openstack.org/#/c/125494/20:10
fungimrmartin: oh, sure!20:10
mrmartinif this works, it will help us to separate the staging / productive deployments.20:11
mrmartinand I can send in patches without any fear that I broke the productive one.20:11
*** bknudson has joined #openstack-infra20:13
*** jlabocki has joined #openstack-infra20:14
jlabockihello, I am having an issue when trying to change my contact information in gerrit20:14
jlabockiI get "Code Review - Error" Server Error Cannot store contact information20:14
jlabockiis there someone that might be able to help me with this?20:14
*** kgiusti has quit IRC20:14
*** david-lyle_ is now known as david-lyle20:15
jlabockiI'm not able to submit for review without the contact information - fatal: ICLA contributor agreement requires current contact information.20:15
openstackgerritKhai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3  https://review.openstack.org/12575520:15
openstackgerritKhai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3  https://review.openstack.org/12575520:16
*** mwagner_lap has joined #openstack-infra20:17
*** annegent_ has joined #openstack-infra20:18
*** annegent_ has quit IRC20:19
*** dustins has quit IRC20:19
openstackgerritA change was merged to openstack-infra/project-config: Cleanups for layout.yaml  https://review.openstack.org/12548920:20
*** annegent_ has joined #openstack-infra20:20
sdakefungi any thoughts on jlabocki's problem?20:20
*** cnesa has joined #openstack-infra20:21
fungijlabocki: your foundation profile's primary e-mail address needs to be identical to your gerrit account's preferred e-mail address20:21
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Adding query namespace to elastic-recheck  https://review.openstack.org/10195820:21
fungijlabocki: make sure you followed the instructions at https://wiki.openstack.org/wiki/How_To_Contribute#If_you.27re_a_developer in sequence. order matters in the contributor license agreement section there20:22
*** tonytan4ever has quit IRC20:22
*** rushiagr is now known as rushiagr_away20:23
*** rushiagr_away is now known as rushiagr20:23
SergeyLukjanovfungi, mrmartin, don't worry - /me returning back to home in mid Oct :)20:23
*** mestery has quit IRC20:24
mrmartinSergeyLukjanov, I'm not worrying I just want to clone you :)20:24
jlabockifungi: I believe I have followed the steps in order correctly20:25
*** rfolco has quit IRC20:25
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Add buildimages job for Sahara  https://review.openstack.org/12572920:26
fungijlabocki: check the primary e-mail address at https://www.openstack.org/profile/ matches the preferred e-mail address at https://review.openstack.org/#/settings/contact20:26
SergeyLukjanovmrmartin, hm, I have no strong opinion about cloning myself, most proboably I'm against it :)20:26
SergeyLukjanovfungi, could you please take a look at https://review.openstack.org/125729 ?20:27
*** andreaf has joined #openstack-infra20:27
jlabockifungi: it does20:27
SergeyLukjanovfungi, I'd like to make sahara image building tested in gate and eventually publish images to tarballs.o.o as trove doing it20:27
fungijlabocki: and make sure you see "Contact information last updated on <some date and time>." at that second url20:27
*** ryanpetrello has joined #openstack-infra20:27
jlabockifungi: I'm not sure if this matters, but there are no current legal agreements here - https://www.openstack.org/profile/agreements20:28
*** mrmartin has quit IRC20:28
*** otherwiseguy has joined #openstack-infra20:28
jlabockiat the second URL (https://review.openstack.org/#/settings/contact) I do not have a "Contact Information last updated on "20:28
jlabockifungi ^^20:28
*** dprince has quit IRC20:28
fungijlabocki: does https://review.openstack.org/#/settings/ show anything next to "username"?20:29
jlabockiyes, it is set to "jlabocki"20:29
*** cnesa has quit IRC20:30
fungijlabocki: okay, then the error message you're getting definitely implies that you have an icla in a "verified" state at https://review.openstack.org/#/settings/agreements unless you're not using the "jlabocki" account20:30
fungijlabocki: i'm going to check the backend database for gerrit just to make sure we're looking at the same information20:31
jlabockithank you fungi20:31
jlabockifungi: confirmed Status20:31
jlabockiName20:31
jlabockiDescription20:31
jlabockiVerified20:31
jlabockihttps://review.openstack.org/static/cla.html20:31
jlabockiOpenStack Individual Contributor License Agreemen20:31
fungijlabocki: yeah, that looks correct then20:31
*** holser has joined #openstack-infra20:32
fungijlabocki: okay, so you just need to put something in the mailing address and country fields at https://review.openstack.org/#/settings/contact20:32
fungijlabocki: and then when clicking "save changes" it should after that say "Contact information last updated on [...]." there20:33
*** andreaf has quit IRC20:33
*** dustins has joined #openstack-infra20:34
*** dustins has quit IRC20:34
*** SumitNaiksatam has joined #openstack-infra20:34
*** dustins has joined #openstack-infra20:35
jlabockiCode Review - Error20:35
jlabockiServer Error20:35
jlabockiCannot store contact information20:35
jlabockifungi ^^20:35
jlabockiwhen I enter address and country and select "Save Changes"20:35
jlabockion https://review.openstack.org/#/settings/contact20:35
openstackgerritA change was merged to openstack-infra/devstack-gate: Remove Nova v3 API test configuration  https://review.openstack.org/12302720:36
mikazaro: awesome, thanks! (@jjb 0.9.0)20:37
fungijlabocki: that error message usually indicates that the preferred e-mail address listed there does not match the primary e-mail address listed at https://www.openstack.org/profile/20:37
fungijlabocki: i just updated my own contact information moments ago as a test, and the api connection seems to be fine20:38
*** hdd has quit IRC20:41
*** rfolco has joined #openstack-infra20:42
*** mestery has joined #openstack-infra20:43
openstackgerritAndrew Ruthven proposed a change to stackforge/gertty: dburi needs to have sqlite:/// in front.  https://review.openstack.org/12524620:44
*** zul has quit IRC20:44
openstackgerritKhai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3  https://review.openstack.org/12575520:44
jlabockifungi: perhaps I can show you screenshots of https://www.openstack.org/profile/ and https://review.openstack.org/#/settings/contact ? both of them are set to jlabocki@redhat.com20:47
*** andreaf has joined #openstack-infra20:47
*** morgan_remote_ is now known as remote_morgan_20:48
*** ramashri has quit IRC20:48
nibalizerfungi: fwiw i would look at a {nagios,sensu}.o.o20:48
fungireed: can you get tipit to look into the rejections ^ from the foundation member system end?20:48
*** jaypipes has quit IRC20:49
*** scottda has joined #openstack-infra20:49
nibalizerand it would be cool for my team too, since right now we consume infra then attach our own monitoring, if there was a monitoring to auto consume that would be neat20:49
*** scottda has left #openstack-infra20:49
jlabockifungi: http://people.redhat.com/jlabocki/001.png http://people.redhat.com/jlabocki/002.png20:49
jlabockiin case I am just missing something20:50
*** remote_morgan_ is now known as morgan_remote_20:50
*** morgan_remote_ is now known as morgan_remote20:50
*** morgan_remote is now known as remote_morgan_20:51
*** BOKALDO has quit IRC20:52
*** tonytan4ever has joined #openstack-infra20:52
*** r1chardj0n3s_afk is now known as r1chardj0n3s20:52
fungijlabocki: yeah, that looks right to me, and i only find one account in gerrit matching that name and e-mail address... unfortunately i lack visibility into the foundation member database or api logs to see why it might be getting seen as a mismatch there20:53
*** rushiagr is now known as rushiagr_away20:53
jlabockifungi: thank you, so reed is the best person to help me further?20:54
*** bswartz has quit IRC20:55
*** rmcall has quit IRC20:55
*** hdd has joined #openstack-infra20:55
*** HenryG has quit IRC20:55
fungijlabocki: yeah, he at least knows who to badger about this20:56
fungii have some e-mail addresses i can contact people at20:56
*** annegent_ has quit IRC20:56
*** dkranz has quit IRC20:56
fungihe was around and active about 3 hours ago, so there's a good chance he's still around and may see this in a few minutes20:58
jlabockithanks fungi - is there a way I can formally request help? I'm going to go offline shortly and want to make sure someone looks at this20:58
jlabockiok, thanks fungi20:58
*** sdake_ has joined #openstack-infra20:59
fungijlabocki: tell you what, since i have your e-mail address i'll e-mail the contacts i have (including reed) and cc you if that's okat?20:59
fungier, okay?20:59
jlabockiyes, that would be great21:00
jlabockithanks for your help21:00
fungiit's my pleasure... sorry for the complications21:00
*** gokrokve has quit IRC21:00
*** arnaud has quit IRC21:00
*** arnaud__ has quit IRC21:00
*** gokrokve has joined #openstack-infra21:00
fungii didn't choose them, i merely get to apologize for them :/21:00
*** arnaud has joined #openstack-infra21:01
jlabockino problem - I'm sure glueing all these systems together can be fun21:01
*** arnaud__ has joined #openstack-infra21:01
jlabocki:D21:01
*** jamespage_ has joined #openstack-infra21:01
*** jamespage_ has quit IRC21:01
*** amcrn has quit IRC21:01
fungiyeah, really not so much as you might think21:01
*** ramashri has joined #openstack-infra21:02
*** patrickeast has quit IRC21:03
*** patrickeast has joined #openstack-infra21:04
jlabockiwell, thanks - I'm off for a few hours. I'll check back in later and see if it works.21:04
*** amcrn has joined #openstack-infra21:04
*** stevemar has quit IRC21:05
*** erikmwilson has joined #openstack-infra21:05
*** hdd has quit IRC21:05
*** pcm__ has quit IRC21:07
*** dustins has quit IRC21:07
*** patrickeast has quit IRC21:08
*** aysyd has quit IRC21:09
*** tsg has quit IRC21:09
fungijlabocki: i've sent up the emergency flares... you should have a cc21:10
*** flaper87 is now known as flaper87|afk21:11
clarkbadam_g: anything else you need to get the ironic RCs out?21:11
clarkbadam_g: I think you are the first project to have real trouble so its been nice and quiet so far21:11
clarkband I just ruined it21:11
adam_gclarkb, just waitin on this to merge https://review.openstack.org/#/c/125732/21:12
adam_gclarkb, still unclear why thats changed with the image source. will try to poke closer at it later when i have some spare time21:12
clarkbcool21:12
clarkband it looks like the gate is moving21:13
adam_gits as if apt in the DIB based images use --no-install-recommands by default21:13
*** andreykurilin_ has joined #openstack-infra21:13
*** patrickeast has joined #openstack-infra21:13
*** koolhead_ has quit IRC21:14
*** zz_gondoi is now known as gondoi21:15
clarkbis that not ubuntu's default?21:15
pleia2alas, it is not21:15
pleia2not even default in debian these days21:15
*** radez is now known as radez_g0n321:15
clarkbinteresting so ya maybe dib is doing something21:16
pleia2(changed around squeese I think)21:16
pleia2squeeze21:16
clarkbadam_g: but the really cool thing about this is it is now much easier for anyone to replicate our image build process. granted they need a bit of network bandwidth21:17
adam_gclarkb, yeah, i plan to replace my local base dev VM (generated with an ubuntu cloud image + nodepool slave scripts) with a DIB one21:18
clarkbadam_g: also you must brisket with us next time brisket happens21:19
adam_gclarkb, i must. brisket is my spirit animal21:19
*** mbacchi has quit IRC21:22
*** mmedvede has quit IRC21:23
*** patrickeast has quit IRC21:23
*** nikhil_k is now known as nikhil_k|afk21:24
openstackgerritRamy Asselin proposed a change to openstack-infra/devstack-gate: Refactor the hook logic into a reusable function  https://review.openstack.org/12357821:24
*** JayJ_ has quit IRC21:25
*** patrickeast has joined #openstack-infra21:25
*** MaxV has quit IRC21:25
*** JayJ_ has joined #openstack-infra21:25
*** Daisy has joined #openstack-infra21:25
*** malini1 has joined #openstack-infra21:26
*** mfer has quit IRC21:26
*** shashankhegde has quit IRC21:27
dhellmannwhat needs to happen to start publishing the HTML from openstack/governance?21:28
*** andreykurilin_ has quit IRC21:29
clarkbdhellmann: if it needs a special hosting location we will need to spin that up. if it can live on an existing hosting location then just a post job to copy21:29
clarkbdhellmann: do you have an idea of what the hosting would look like? I am assuming not docs.o.o21:30
*** IAX has quit IRC21:30
dhellmannclarkb: yeah, I think that question is probably why it hasn't happened already21:30
*** IAX has joined #openstack-infra21:30
dhellmannclarkb: I'll propose a patch to at least build the docs when patches are submitted21:30
*** shashankhegde has joined #openstack-infra21:31
openstackgerritDoug Hellmann proposed a change to openstack-infra/project-config: Build docs for openstack/governance  https://review.openstack.org/12579621:32
dhellmannclarkb: ^^21:32
dhellmannjogo: ^^21:32
jogodhellmann: I was just wondering about that job ^_^21:33
clarkbI feel like we need a singular "publish.openstack.org" and that will have docs, specs, tarballs, etc all in one place with a shiny dashboard. if only I know how to shiny dashboard21:33
dhellmannclarkb: I'll settle for a dingy dashboard :-)21:33
*** bdpayne has quit IRC21:33
*** ramashri has quit IRC21:33
jogodhellmann: why a template for a single entry?21:33
dhellmannjogo: meh, fiar21:34
dhellmannfair21:34
*** leifmadsen has quit IRC21:34
*** dizquierdo has joined #openstack-infra21:34
sdaguefungi: so the bad luck o scope keeps hitting - https://review.openstack.org/#/c/125346/21:35
sdaguea gate reset just happened21:35
*** ramashri has joined #openstack-infra21:35
sdagueis there a chance we can promote that so that I can actually see if the rest of this is going to work today? otherwise I'm a little afraid of this being in a middle ground overnight21:36
*** otherwiseguy has quit IRC21:37
*** terryw has joined #openstack-infra21:37
*** Ryan_Lane has quit IRC21:37
*** HeOS has quit IRC21:37
openstackgerritDoug Hellmann proposed a change to openstack-infra/project-config: Build docs for openstack/governance  https://review.openstack.org/12579621:37
*** patrickeast has quit IRC21:38
clarkbsdague: the middle ground would be oslo/clients tested only against releases?21:38
*** leifmadsen has joined #openstack-infra21:38
*** patrickeast has joined #openstack-infra21:38
*** FallenPegasus has quit IRC21:38
*** Ryan_Lane has joined #openstack-infra21:39
*** bogdando has quit IRC21:39
sdagueno, the middle ground is actually the devstack patch lands, which has all the dsvm jobs testing with released libraries21:39
sdagueincluding the ones coming from oslo.config21:40
sdagueso it's not actually testing it's own code21:40
sdaguebecause we don't actually know that the new jobs work until the devstack patch lands21:40
*** corvus has quit IRC21:40
*** bogdando has joined #openstack-infra21:40
sdagueso we need to land that patch, verify the jobs are working (fix if they don't), and make the jobs voting (a patch which does not yet exist)21:40
clarkboh right, the other job(s) are in place but are essentially no different than status quo right now21:41
sdagueright21:41
*** corvus has joined #openstack-infra21:41
sdagueI seriously did not think I'd still be here at 5:30pm trying to land this patch21:41
openstackgerritDoug Hellmann proposed a change to openstack-infra/project-config: Build docs for openstack/governance  https://review.openstack.org/12579621:42
*** terryw has quit IRC21:42
*** erikmwilson has left #openstack-infra21:42
jogodhellmann: ^ still wrong I think21:43
*** otherwiseguy has joined #openstack-infra21:43
jogodhellmann: commented inline21:43
anteayaback21:45
*** maxbit has joined #openstack-infra21:45
*** patrickeast has quit IRC21:45
openstackgerritDoug Hellmann proposed a change to openstack-infra/project-config: Build docs for openstack/governance  https://review.openstack.org/12579621:45
*** maxbit has quit IRC21:45
dhellmannthanks, jogo, I knew I had that wrong but couldn't make any of the tests fail :-/21:45
jogoheh, looks good now21:47
*** esker has quit IRC21:48
*** malini1 has quit IRC21:51
*** tsg has joined #openstack-infra21:52
*** dimtruck is now known as zz_dimtruck21:55
*** tsg has quit IRC21:57
*** zz_dimtruck is now known as dimtruck21:58
clarkbsdague: so going back to that, the gate isn't deep, would it be terrible to give it another go? (my concern is that we tell lots of people we only promote to fix gate bugs and this would be unfair to all those people)21:58
sdagueso it's an hour in check, and 2 hours in gate21:59
sdagueto get to the top, probably21:59
sdagueI'm going to be done for the day in less time than that21:59
*** gondoi is now known as zz_gondoi21:59
sdagueso I'm also fine taking the risk that things are exposed overnight21:59
sdaguebut we should realize that they are21:59
*** eharney has quit IRC22:00
clarkbI am fine with the risk I think. Its been so quiet around here that we can afford it22:01
sdagueok, works for me22:01
clarkb(I mean we emergency ninja patched jenkins and no one noticed)22:01
sdagueyeh22:01
sdaguedhellmann: hey, it would be good if you had people not release any new lib versions until we get to the other side of this22:01
*** mestery has quit IRC22:01
sdaguebecause... they may not be testing what they think they are22:01
*** gokrokve has quit IRC22:02
sdagueI think as long as we don't get any releases, we're fine22:02
dhellmannsdague: sure, we can put out a call on the ML22:02
dhellmannsdague: I do most of the releases, but some of the other projects are brave enough to "git tag" themselves22:03
*** mestery has joined #openstack-infra22:03
sdagueit should be resolved by tomorrow... with any luck22:03
*** praneshp has quit IRC22:03
dhellmannsdague: can you give me a short version of a reason? is there an issue, or is it just because you're working through the patches?22:03
dhellmannto the test jobs, that is22:04
*** dkranz has joined #openstack-infra22:04
*** praneshp has joined #openstack-infra22:04
adam_gFWIW ironic is waiting for a gate fix and is planning on merging 2 patches and cutting RC1, the fix for the gate bug failed to merge and has been sent to the back of the queue https://review.openstack.org/#/c/125732/22:04
sdaguedhellmann: so once https://review.openstack.org/#/c/125346/ lands22:04
fungii can look back in on it it later this evening, though i'm told i should go walk on the beach and then engage in mini-golf (or maybe bowling) shortly22:05
sdaguethe olso.config dsvm jobs will no longer be testing oslo.config from git22:05
sdaguethere are new jobs defined non-voting called -src22:05
sdaguethat will22:05
*** tsg has joined #openstack-infra22:05
sdaguebut, we've never seen them actually run with the devstack patches and confirm they do the right thing22:06
*** thedodd has quit IRC22:06
*** rainya has quit IRC22:06
sdaguebecause that patch hasn't landed22:06
sdaguewhich is why they are non-voting22:06
sdaguebut those will end up being the jobs that take over the voting role22:06
*** praneshp has quit IRC22:07
sdagueand the integrated gate will get dropped - https://review.openstack.org/#/c/125720/22:07
sdagueso ... the danger22:07
sdaguesomeone proposes a library change22:07
sdaguesees tests they are used to passing pass22:07
dhellmannsdague: so, just that this is WIP, not that there is currently a race or flakiness in something22:07
sdaguecuts a release22:07
sdaguedoesn't realize they never actually tested things22:07
sdaguedhellmann: right22:07
* dhellmann nods22:07
dhellmannok22:07
sdagueit's the fact that we need to coordinate a bunch of trees22:08
sdagueand this one is taking a long time due to unrelated bugs22:08
sdagueI was hoping to land that patch this morning, then dedicate the day to confirming the behavior22:08
sdague.... such was not life22:08
dhellmannsdague: http://lists.openstack.org/pipermail/openstack-dev/2014-October/047699.html22:08
*** otherwiseguy has quit IRC22:08
*** dangers is now known as dangers_away22:09
sdaguedhellmann: great, thanks!22:09
dhellmannsdague: tell me about it, I've spent the last 2 days trying to merge all of the big-tent blog posts into one coherent set of patches to governance22:09
sdaguedhellmann: heh22:10
sdaguewell I'll probably throw another loop into that with an idea I'm going to put in my TC platform tomorrow :)22:10
* dhellmann reaches for a bourbon on the way to the grill22:10
*** praneshp has joined #openstack-infra22:10
dhellmannsdague: the patch series is up, so pile on22:11
*** gokrokve has joined #openstack-infra22:11
*** mmedvede has joined #openstack-infra22:11
*** Daisy has quit IRC22:15
*** marun has joined #openstack-infra22:15
*** dizquierdo has quit IRC22:16
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for cinder out-of-space bug 1376941  https://review.openstack.org/12580922:16
uvirtbotLaunchpad bug 1376941 in cinder "Cinder dies a horrible death with "Insufficient free space for volume creation on host"" [High,New] https://launchpad.net/bugs/137694122:16
*** sdake_ has quit IRC22:17
*** krtaylor is now known as krtaylor_away22:19
*** patrickeast has joined #openstack-infra22:21
jheskethMorning22:21
anteayamorning jhesketh22:21
*** camunoz has joined #openstack-infra22:23
*** tonytan4ever has quit IRC22:24
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for cinder out-of-space bug 1376941  https://review.openstack.org/12580922:24
uvirtbotLaunchpad bug 1376941 in cinder "Cinder dies a horrible death with "Insufficient free space for volume creation on host"" [High,Confirmed] https://launchpad.net/bugs/137694122:24
sdagueclarkb: so given the slowness... hideci? :) - https://review.openstack.org/#/c/124632/22:24
fungii'm okay with the patch as a stepping-stone but did not approve as clarkb was already looking at that change and discussing it with you a day or so ago22:25
*** zaphod42_ has joined #openstack-infra22:25
*** sarob is now known as sarob_away22:26
clarkbsdague: ok with 124632?22:27
clarkber fungi ^22:27
*** mestery has quit IRC22:27
fungiclarkb: yeah, just now +2'd to make it explicit22:28
fungibut i'll leave it to you to decide22:28
*** jgrimm is now known as zz_jgrimm22:28
*** zaphod42 has quit IRC22:29
fungiin the meantime, the windmill on the green is calling my name22:29
*** lttrl has joined #openstack-infra22:31
*** sandywalsh has quit IRC22:33
*** sandywalsh has joined #openstack-infra22:35
*** andreaf has quit IRC22:36
*** JayJ_ has quit IRC22:36
sdaguefungi: go for it22:36
*** andreaf has joined #openstack-infra22:36
*** annegent_ has joined #openstack-infra22:37
* clarkb reviews22:39
clarkbbeats fighting with this cloud image22:39
clarkbgive mea console :(22:39
*** lttrl has quit IRC22:39
clarkbno wonder people love vagrant22:40
anteayafungi: happy mini golf22:41
*** annegent_ has quit IRC22:41
*** dims has quit IRC22:42
*** dims has joined #openstack-infra22:43
sdagueclarkb: hey... how big an ephemeral disk do we have in hp and rax?22:44
*** ZZelle_ has quit IRC22:45
sdagueclarkb: I'm looking at - https://github.com/openstack-infra/devstack-gate/blob/master/functions.sh#L208-L23422:45
clarkbsdague: I think we get ~250GB total on our hpcloud nodes. so 30GB / and 220GB mounted on /opt22:45
*** zul has joined #openstack-infra22:45
clarkbrax is smaller because we only do 8gigawatt nodes there but its still pretty big22:46
sdagueso... we do our cinder vol backing with lvm on top of loopback22:46
sdaguewhich... I'm not surprised might break some times22:46
sdagueI wonder if it would be better to build the lvm in the ephemeral disk22:46
mtreinishclarkb: ooh, thats a lot of power22:46
*** dims has quit IRC22:47
*** Sincler has quit IRC22:47
jgriffithsdague: another thing I mentioned a while back...22:47
jgriffithsdague: what about actually creating/attaching cinder vols to the instances?22:47
jgriffithsdague: use them to build a VG22:47
sdaguejgriffith: I expect we don't have enough quota to do that22:48
sdaguebut maybe22:48
clarkbsdague: wait I thought we did built it in the ephemeral disk22:48
sdagueit seems like the vg in the ephemeral disk would be good22:48
clarkbsdague: its the only place with enough room22:48
sdagueclarkb: on top of a loop dev22:49
clarkbsdague: oh I see, you want to carve a partition and use it directly22:49
sdagueso we get to go through the linux block stack twice22:49
sdagueyeh22:49
clarkbya we could do somethign like that22:49
sdagueand my general understanding is the loop code is... kind of wonky22:49
jgriffithsdague: I'd agree, that's a better option probably22:49
sdagueso it looks like today we do a 24G lv22:50
*** david-lyle has quit IRC22:51
clarkblet me check rax ephemeral disk size22:52
clarkb(keep in mind this will be a difference between gate and local testing for many/most people)22:52
*** sandywalsh has quit IRC22:53
jgriffithsdague: clarkb FWIW, I'm looking at transitioning to thin as the default for Cinder22:53
sdaguejgriffith: ok... I'm not sure what that means22:53
jgriffithsdague: clarkb might be able to add some "over-provisioning" options or something if that helps22:53
*** sandywalsh has joined #openstack-infra22:53
anteayanibalizer: are you saying https://review.openstack.org/#/c/102020 needs to merge before https://review.openstack.org/#/c/125567/3 ?22:53
jgriffithsdague: Thin Prov LVM so you wouldn't really need 24G22:53
sdaguejgriffith: cool22:53
jgriffithsdague: you'd just need enough to actually "write"22:53
sdaguehmm... actually we seem to be running 2 24G lvms?22:53
clarkbsdague: 72GB22:54
clarkbso I think 80GB total and 8B for swap22:54
anteayaturkeys are roosting, such fun to watch them every evening22:54
*** _buzz has quit IRC22:54
sdaguenope, I guess not22:54
*** wenlock__ has quit IRC22:56
*** dmsimard is now known as dmsimard_away22:56
*** ZZelle_ has joined #openstack-infra22:57
anteayadhellmann: that colour should never be allowed in etherpads, that mustardy dirty yellow, blegh22:58
clarkbanteaya: you get the entire color wheel of ugly colors available to you in etherpad-lite :)22:59
anteayaha ha ha22:59
anteayaoh yay22:59
anteayaI need to write an ugly colour filter22:59
anteayadhellmann: and holy crow that is a rats nest of stuff to organize23:00
anteayadhellmann: big hat tip to you for trying to break it up into manageable pieces23:00
*** marun has quit IRC23:01
*** bhuvan_ has joined #openstack-infra23:03
*** baoli has quit IRC23:04
*** baoli has joined #openstack-infra23:04
*** yamahata has joined #openstack-infra23:05
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: create partition for lvm volume  https://review.openstack.org/12581323:05
sdaguejgriffith: ... ^^^23:05
*** sandywalsh has quit IRC23:05
*** bhuvan has quit IRC23:06
*** zaphod42_ has quit IRC23:06
*** nosnos has joined #openstack-infra23:06
*** zaphod42 has joined #openstack-infra23:07
sdagueclarkb: it's been a long time since I did parted, so hopefully that's right ish...23:08
clarkbsdague: is parted trating you like virsh is treating me?23:08
clarkbsdague: but I found uvtool so I am cheating23:08
*** baoli has quit IRC23:08
sdagueheh23:09
sdagueok... no more work today.23:10
*** HenryG has joined #openstack-infra23:10
clarkbsdague: don't you need to pgcreate too?23:10
jgriffithsdague: nice!23:12
sdagueclarkb: we don't in the devstack code23:12
clarkbhuh til23:12
mtreinishsdague: the pv has to be created somewhere. Does cinder do it?23:12
nibalizeranteaya: i suppose it doesnt have to. it would be a failing nonvoting test if the infra path lands first23:13
sdagueclarkb: I'm basically just bypassing this - https://review.openstack.org/12581323:13
jgriffithmtreinish: IIRC you can just add a raw on vgcreate23:14
sdagueso then the rest of the lvm setup happens per normal23:14
*** shashankhegde has quit IRC23:14
mtreinishjgriffith: ah, ok makes sense. I normally try to avoid using lvm...23:14
clarkbmtreinish: zfs all day every day?23:15
mtreinishjgriffith: yep there it is right in the first section of the vgcreate man page :)23:16
jgriffithmtreinish: what you don't trust me :)23:16
jgriffithLOL23:16
jheskethsdague, clarkb: if you guys have time to look at https://review.openstack.org/#/c/125255/ and https://review.openstack.org/#/c/125313/ they should fix the centos issue we had and give us a chance to test it before re-enabling23:16
sdaguejhesketh: I'll like clarkb take that one, I don't really understand the issues23:17
sdagueand... it's late23:17
*** shashankhegde has joined #openstack-infra23:17
anteayanibalizer: so I can approve the project-config patch or you can set it to wip23:17
sdaguenight all23:17
*** ZZelle_ has quit IRC23:17
anteayanibalizer: which would you like?23:17
jheskethno worries23:17
jheskethseeya sdague :-)23:17
anteayanight sdague23:17
jgriffithniht sdague... thanks!23:17
*** bhuvan_ has quit IRC23:18
clarkbjhesketh: I don't think 125313 will work as you expect because of the openstack_functions.py node selection23:18
mtreinishjgriffith: heh, I was just verifying because you prefaced it with 'IIRC' :)23:19
clarkbjhesketh: also you define node twice23:19
jgriffithmtreinish: I know.. I'm just giving you a hard time23:19
mtreinishwithout that there would have been no reason to look at anything :)23:19
jgriffithmtreinish: you'd be wise to always verify what I say :)23:19
*** annegent_ has joined #openstack-infra23:19
jgriffithmtreinish: I'm a very undefinitive answer"er"23:20
clarkbjhesketh: 125255 lgtm approved23:20
jheskethclarkb: thanks, I'll take a look23:22
*** mriedem has quit IRC23:22
*** grantbow has quit IRC23:22
openstackgerritA change was merged to openstack-infra/project-config: Fix zuul_swift_upload to use old MAGIC_MIME const  https://review.openstack.org/12525523:24
*** annegent_ has quit IRC23:25
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Added functional test tooling  https://review.openstack.org/12581623:25
*** yamahata has quit IRC23:27
*** sarob_away is now known as sarob23:27
*** chair6 has left #openstack-infra23:27
nibalizeranteaya: ill set it to WIP until we have good consensus from the puppet-openstack folks23:28
*** grantbow has joined #openstack-infra23:28
nibalizerso that exact same testing scaffold can be used for the infra puppety things23:28
nibalizerwhich is exciting23:28
*** annegent_ has joined #openstack-infra23:28
anteayanibalizer: thanks23:30
* anteaya is excited23:30
nibalizerya23:30
nibalizeri might have to do it to storyboard really fast so we can Just Do It23:31
openstackgerritMatthew Treinish proposed a change to openstack-infra/subunit2sql: Add db api function to get the latest run  https://review.openstack.org/11788223:31
*** dimtruck is now known as zz_dimtruck23:31
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Added functional test tooling  https://review.openstack.org/12581623:31
*** grantbow has quit IRC23:31
*** annegent_ has quit IRC23:31
anteayanibalizer: keep me posted23:32
*** grantbow has joined #openstack-infra23:36
*** bhuvan has joined #openstack-infra23:36
*** sarob is now known as sarob_away23:37
jheskethclarkb: where/why do I need to update openstack_functions for my centos job? I thought the jenkins gearman plugin looked at the 'node' supplied by jjb?23:43
*** markmcclain has joined #openstack-infra23:44
clarkbjhesketh: it does, but since we "split" the jobs across precise and trusty based on branch we have had to make zuul choose all the nodes for sanity23:45
clarkbjhesketh: otherwise it was becoming too easy for jobs to run on the wrong nodes23:45
clarkbjhesketh: we could have done it the other way around and been very specific about the "special" jobs but there are so many that I decided it was easier to specify everything23:46
*** bswartz has joined #openstack-infra23:47
clarkbhttps://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/openstack_functions.py#n8523:47
*** andreaf has quit IRC23:47
clarkb(fwiw that may haev been the wrong decision ... I take responsibility :) )23:48
*** andreaf has joined #openstack-infra23:48
jheskethclarkb: right, so what does 'node' in jjb actually mean then?23:48
clarkbjhesketh: it tells jenkins which nodes to register the gearman functions on23:48
clarkbjhesketh: so its an optimization and safety net23:48
clarkbactually thats not true23:48
clarkbI found out today that gearman plugin won't register the function on a node unless the label is specifically listed23:49
clarkbso it is required23:49
*** dims has joined #openstack-infra23:49
jheskethclarkb: so if I specify the node in the jjb job then surely that'd be the only node registering with gearman and therefore it'll run on there?23:50
clarkbjhesketh: except that those functions will default you trusty23:51
clarkbjhesketh: and thats the part I may or may not have done the best way. At the time my thought was we have to specify the node for the majority of things so lets do it for all of them23:51
* jhesketh is confused and perhaps needs to read code23:52
*** arnaud__ has quit IRC23:52
*** arnaud has quit IRC23:52
openstackgerritJoshua Hesketh proposed a change to openstack-infra/project-config: experimental-swift-logs-{name}-pep8 on centos  https://review.openstack.org/12531323:53
openstackgerritJoshua Hesketh proposed a change to openstack-infra/project-config: Revert "Revert "Enable the swift logs env vars for all jobs""  https://review.openstack.org/12526223:53
jheskethclarkb: for now though, would that work ^23:53
clarkbno23:53
clarkbit will try to run the job on bare-trusty and fail23:53
clarkbph wait23:53
clarkbyou added to the name as well23:54
clarkbya with that centos6 in the name that will work, did you update the instantiation of the template too?23:54
clarkbso ya I think that will work for selection but may break where ou instantiate the template and run the job in layout.yaml23:54
*** dims has quit IRC23:54
*** dims has joined #openstack-infra23:55
jheskethclarkb: I'm not sure what you mean by instantiate the template sorry?23:57
*** rainya has joined #openstack-infra23:58
clarkbjhesketh: that job template's name is being changed. So the place that creates that template for a project will need to be updated23:58
clarkbusually this happens in projects.yaml under the project in question23:59
*** dims has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!