Thursday, 2014-10-09

*** harlowja is now known as harlowja_away00:01
morganfainbergJayF, there is... a NC hockey fan?00:01
JayFmorganfainberg: moreso than that, I was born and raised in NC00:02
morganfainbergJayF, ahhh00:02
*** melwitt has quit IRC00:02
fungimorganfainberg: we make do with what we can get here00:02
JayFmorganfainberg: like I said, I'm the endangered species of "native NC hockey fan" that nobody outside of Raleigh believes exist00:02
fungimorganfainberg: though fwiw, most of the players on the team are canadians, same with the rest of the nhl00:03
morganfainbergOh obviously i'm outside of Raliegh, so... I'm suddenlyconfused, by world view might be shifting00:03
*** tsg has joined #openstack-infra00:03
morganfainbergsure.00:03
JayFfungi: at least we had Patty O'Sullivan for a season :)00:03
fungibwahahahaha00:03
fungithe exception that makes the rule00:04
* morganfainberg goes back to watching the Kings play (SoCal native here)00:04
*** ccit has joined #openstack-infra00:04
JayFfungi: also Josh Wesley was drafted iirc (by the canes, which is kinda cheating, but still)00:04
JayFmorganfainberg: no you aren't watching the kings play :)00:04
morganfainbergtrue not right now00:04
morganfainbergright now i'm staring at IRC00:04
JayFmorganfainberg: that's not for another 2 hours + banner raising. I just hope seeing the banner is burned into Shark memories so we don't choke in the playoffs again (I've since moved to CA and have Sharks season tickets... so yeah)00:05
*** ccit has left #openstack-infra00:05
JayFmorganfainberg: you have no idea the quantity of smug I was after about 84 games last year (81+3) ;)00:05
openstackgerritA change was merged to openstack-infra/config: Improve jeepyb.rst content  https://review.openstack.org/12412700:05
morganfainberghaha00:05
*** shashankhegde has joined #openstack-infra00:07
openstackgerritA change was merged to openstack-infra/config: Stop statusbot joining #openstack-packaging  https://review.openstack.org/12485200:10
*** yamahata has joined #openstack-infra00:10
*** harlowja_away is now known as harlowja00:11
*** wenlock has quit IRC00:15
*** sunil_ has joined #openstack-infra00:19
*** otherwiseguy has quit IRC00:19
*** terryw has joined #openstack-infra00:19
*** gokrokve has joined #openstack-infra00:21
*** openstackstatus has quit IRC00:23
*** ivar-lazzaro has quit IRC00:23
*** openstackstatus has joined #openstack-infra00:23
*** ChanServ sets mode: +v openstackstatus00:24
sunil_I am trying to install slave for our CI setup following http://www.joinfu.com/2014/02/setting-up-an-openstack-external-testing-system-part-2/...and running into this error:Error: /Stage[main]/Os_ext_testing::Base/File[/opt/nodepool-scripts]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/openstack_project/nodepool/scripts00:24
sunil_does anybody know whats going on there?00:24
*** Sincler has quit IRC00:25
sunil_somebody reported the same error on Sep 29 on IRC but the chat logs don't show any resolution00:25
*** patrickeast has quit IRC00:25
fungidoes jaypipes need to update his blog post to account for the split between the config and project-config repositories maybe?00:25
pleia2or bring it into infra-manual as a 3rd party setup document?00:26
pleia2I'd love to see something more official than a blog post00:26
sunil_is there anywhere I can know more about the split? is there any quick fix I can apply?00:26
fungii keep pressing for that. will be easier to keep updated00:26
fungiblog posts are far too point-in-time for something as dynamic as systems automation software00:27
pleia2yeah00:27
*** mfer has joined #openstack-infra00:27
pleia2if it's something we want to do, I can work on it00:27
sunil_yeah, but there is hardly anything as good as his post which goes through detailed steps for newbies00:27
pleia2sunil_: indeed, sorry for the meta-conversaion :)00:28
*** bnemec has quit IRC00:28
fungisunil_: probably no "quick" fix other than to dive deeper into the documentation we provide at http://ci.openstack.org/ and learn how these components fit together. that's an unfortunate end result of the "give someone a fish" vs "teach someone to fish" style of documentation00:28
fungirecipes are no subsitiute for learning00:28
*** arosen has quit IRC00:28
*** IAX has quit IRC00:29
sunil_agreed, but when ou have deadlines, recipes are awesome...:)00:30
*** hdd has quit IRC00:30
fungisunil_: the official announcement, if it helps: http://lists.openstack.org/pipermail/openstack-dev/2014-September/047207.html00:30
sunil_where can I get more info on that split you talked about00:30
*** prad has joined #openstack-infra00:31
sunil_let me have a look00:31
fungiyeah, some info and pointers to more detailed material are in the announcement00:32
anteayasunil_: tell the people giving you deadlines that unless they give you time to work with us and learn what you are doing your system will always be broken or disabled00:33
fungithere are likely channel denizens in apac timezones starting to wake up now who might be around to provide additional guidance. it's unfortunately getting late-ish in the americas00:33
anteayasunil_: so your deadlines are actually creating obstacles for you to accomplish your goals00:33
sunil_yeah, that sounds odd but its true00:34
anteayathe fact you have a deadline doesn't make you unique to the over 100 people in the same situation as yourself00:34
anteayasunil_: spend some time attending the third party meetings and reading the past longs00:34
anteayalogs00:34
anteayahttp://eavesdrop.openstack.org/meetings/third_party/00:35
pleia2aha! I thought I remembered some patch re: 3rd party to manual https://review.openstack.org/#/c/109800/00:35
pleia2anteaya: would this be a place to transplant jaypipes' docs to?00:35
anteayasunil_: https://wiki.openstack.org/wiki/Meetings/ThirdParty00:36
anteayapleia2: let's bring this up at the infra meeting00:36
pleia2anteaya: ok :)00:36
anteayasince joa actually tried to do that and then abandoned his patch because he was asked to put it in the ci.openstack.org/third-party.rst doc00:37
pleia2gah00:37
anteayaI said I would make the patch with the info and never did00:37
anteayamy heart is to put in in infra-manual00:37
anteayabut nothing has gotten merged to that repo since late july00:37
anteayaso I stopped reviewing it00:37
anteayait just fell down the list00:37
anteayaand jim said he wanted it in ci.openstack.org/third-party00:38
sunil_anteaya: I am just beginning in the openstack world. and there is much to read and learn00:38
anteayaI think it needs to come back onto the table again00:38
anteayasunil_: you have had your first excellent realization00:38
anteayasunil_: well done00:38
* anteaya gives sunil_ a cookie00:38
sunil_:D00:38
fungiour reach exceeds our grasp where documenting things vs building things is concerned, i'm afraid00:39
* pleia2 gives anteaya a cookie too00:39
anteayasunil_: the best thing you can do is get your manager to give you space to learn what it is you are doing00:39
pleia2ok, off to Ubuntu Hour + Debian Dinner for real now, later all00:39
anteayasunil_: if you had 4 to 6 weeks to learn how to be an openstack contributor00:39
sunil_yeah, agreed00:39
anteayasunil_: you would learn so much about how to operate a third party ci00:39
anteayasunil_: send your boss here and I will tell them00:39
sunil_:D00:39
anteayathey might not listen but I am willing to try00:40
anteayasunil_: i'm serious00:40
*** unicell has joined #openstack-infra00:40
anteayaif you don't know what you are doing you are just going to blow up your system and maybe ours00:40
anteayathen i have to chase you down and disable you and you are doing to whine to me about re-enableing your system00:40
anteayait is horribly ineffective00:40
anteayaand I've done it over 50 times with people in exactly your situation00:41
anteayabut it is up to you00:41
sunil_no no...I am not going to do anything which blows up anything00:41
anteayathink again00:41
anteayasunil_: best thing you can do00:42
anteayapush everything off your desk00:42
*** mfer has quit IRC00:42
anteayastudy this: http://docs.openstack.org/infra/manual/developers.html00:42
anteayafollow every instruction00:42
anteayathis should take you a week or more00:42
anteayaask questions about that document00:42
anteayaafter you have worked your way through the document00:42
anteayaand you have successfully committed patches to the sandbox repo00:43
*** markmcclain has quit IRC00:43
anteayathen you can ask about how to set up your ci00:43
*** mmaglana has quit IRC00:43
anteayaand you will be able to answer many of them yourself00:43
anteayasince you will by then understand the developer workflow00:43
sunil_yeah, that's where I started00:43
anteayagood00:43
anteayawhat step are you on00:43
*** terryw has quit IRC00:44
anteayahaev you a launchpad account?00:44
sunil_yup00:44
anteayalets see it00:44
anteayapost the url into channel00:44
sunil_hold on00:44
*** otherwiseguy has joined #openstack-infra00:45
sunil_https://launchpad.net/~sunil-500:46
anteayagreat what it the next step in the developer manual after setting up a launchpad account?00:46
*** yaguang has joined #openstack-infra00:46
anteayais 10-09 september 10?00:47
anteayaso is this a month old or an hour old?00:47
sunil_don't remember...it was a while ago.00:47
anteayamust be a month old00:47
anteayaokay so launchpad account, next step00:47
sunil_but I did set up everything that I needed to00:47
anteayagood00:48
anteayalets see your gerrit account00:48
sunil_signed all the agreements I needed to00:48
anteayagood00:48
anteayareview.openstack.org00:48
anteayalog in00:48
anteayawhat is your gerrit username?00:49
sunil_sunil00:49
*** ayoung has joined #openstack-infra00:49
anteayahave you uploaded a patch?00:50
anteayaor reviewed anything?00:50
sunil_only against sandbox project to test things to see if I get gerritt events and zuul sees them00:51
anteayais this you? https://review.openstack.org/#/q/owner:%22Sunil+Kumar+%253Csunil%2540embrane.com%253E%22,n,z00:51
sunil_yeah00:51
*** JayJ has quit IRC00:52
anteayagood now you need to submit a second patchset to the first patch00:52
anteayanot a brand new patchset00:52
sunil_why? does the sandbox project need me to undo removal of random mytest file?00:53
anteayaI'm rechecking this patchset to get you a fresh copy of how the docs will look once it is merged: https://review.openstack.org/#/c/104951/00:53
*** markmcclain has joined #openstack-infra00:53
openstackgerritA change was merged to openstack-infra/devstack-gate: Update README for post config split  https://review.openstack.org/12547000:53
anteayasunil_: why submit a new patchset to a patch that is a very good question00:54
*** terryw has joined #openstack-infra00:54
anteayasunil_: I'm glad you asked00:54
anteayasunil_: what project do you want to test?00:54
*** otherwiseguy has quit IRC00:54
sunil_I thought sandbox was a scratch pad sort and I could throw anything at it to test my setup00:54
sunil_I am not sure I am following you00:55
*** salv-orlando has quit IRC00:55
openstackgerritA change was merged to openstack-infra/devstack-gate: Better check for pypi mirror host connectivity  https://review.openstack.org/12629000:55
*** mmedvede has joined #openstack-infra00:55
*** hdd has joined #openstack-infra00:55
anteayasunil_: right you aren't00:56
anteayasunil_: look over my questions again00:56
anteayaanswer anything you are able to answer00:56
sunil_you mean "[17:54] <anteaya> sunil_: what project do you want to test?"?00:57
anteayawe can start there00:57
anteayaif you would like to answer that00:57
sunil_oh...wait....:) Eventually, I am interested in the neutron project00:58
anteayayay00:58
anteayaneutron00:58
anteayagreat00:58
sunil_I thought you were asking in the context of that commit I submitted for testing00:58
anteayado you know how to find neutron patch in gerrit00:58
anteayaif you don't know, ask00:58
anteayado you know how to find a neutron patch in gerrit?00:59
sunil_search?00:59
anteayago ahead00:59
*** shashankhegde has quit IRC00:59
anteayasearch for neutron patches in gerrit00:59
anteayapost the url of what you come up with00:59
sunil_first on the list: https://review.openstack.org/#/c/127082/01:00
sunil_submitted on Oct 801:00
anteayathat will do01:00
anteayahow many patchsets does that patch have?01:00
openstackgerritA change was merged to openstack-infra/devstack-gate: Remove TESTR_FULL option for running tempest  https://review.openstack.org/12419001:01
sunil_anteaya: I need to understand where you are going with this?01:01
sunil_2 patchsets01:01
anteayasunil_: great01:01
anteayaI am trying to help you01:01
anteayayou asked for help, I am helping01:01
sunil_ok...:)01:01
sunil_please keep going01:01
*** homeless has quit IRC01:01
anteayaI am teaching you what you need to know to be an effective third party operator01:01
sunil_I appreciate all the help01:01
anteayathis is my teaching style01:01
anteayaokay then, let's proceed01:02
anteayahow did the contributor submit two patchset to the same patch?01:02
anteayarather than two different patchsets like you did in sandbox?01:02
*** stevemar has joined #openstack-infra01:02
anteayaor two different patches like you did in sandbox?01:02
sunil_ah...now that makes sense. where u were going...:) he amended the change. I just did two different things...I didn't care because it was sandbox01:03
anteayaright01:03
anteayaand for you to be effecting in creating something that tests our workflow01:04
anteayaif you know what our workflow is01:04
anteayayour chances of creating something that tests it effectively increases01:04
sunil_yes, I agree01:04
anteayagreat01:04
anteayaso create a second patchset to one of your sandbox patches01:05
anteayaI don't care what the change is01:05
*** JayJ has joined #openstack-infra01:05
anteayajust create a second change on the same patch01:05
*** JayJ has quit IRC01:06
sunil_I will do that from home later in the evening...I need to run now.01:06
anteayaokay01:06
anteayawe will pick up from this point next time01:06
anteayaadieu01:07
sunil_but I got the gist of what you have been saying here01:07
anteayagood01:07
*** JayJ has joined #openstack-infra01:07
anteayaand me telling you wouldn't have been nearly as effective01:07
anteayaas me asking you questions so that you look for it yourself01:07
anteayaeven if you don't know why you are looking at the moment you are looking01:07
anteayaand I'm glad you have an understanding now01:08
anteayai'm offline for the night01:08
fungiw00t! mrmartin is teh geenius. i have openstackid.org up and running now, poked http/https holes in iptables for my source address and can log in with my openstack foundation credentials and set persistent stuff on my id profile. i think this is working01:08
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Add groups portal prod and dev servers to cacti  https://review.openstack.org/12709701:09
anteayafungi: well done01:09
anteayaand yay to mrmartin01:09
clarkbfungi nice01:09
clarkbfungi what was wrong with it?01:09
fungiclarkb: nothing was particularly wrong with it that i could tell01:10
fungiclarkb: retrying the launch worked fine01:10
clarkbhuh ok01:10
fungiclarkb: so presumably something went sideways in rackspace or hung puppet agent or who knows01:11
clarkbya01:11
anteayayay for our own openid soon01:11
anteayaI'm out01:11
anteayanight01:11
fungialso, i noticed rackspace had left us nastygrams that they've been rebooting groups.o.o daily due to memory overuse. it's only a 1gb instance so probably undersized and in need of a rebuild, but since it wasn't in cacti ot01:12
fungier, it's hard to tell what's going on with it for sure01:12
clarkbI am on my way home and will check centos7 images when I get there01:12
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Add subunit2sql gearman workers  https://review.openstack.org/10800301:13
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Add subunit2sql server configuraion  https://review.openstack.org/12706001:13
fungialso lifted my -2 from 127024 so we can add openstackid.org to cacti01:13
fungiand with that i think i'm probably going to knock off for the night and try to look like i haven't been working this whole time when my wife gets home from class01:14
clarkbkk goodnight01:14
openstackgerritA change was merged to openstack-infra/config: Add centos7 to nodepool diskimage config  https://review.openstack.org/12706501:16
*** nkinder has joined #openstack-infra01:18
*** gokrokve has quit IRC01:19
*** todd_dsm has joined #openstack-infra01:27
*** achanda has joined #openstack-infra01:29
*** hdd has quit IRC01:30
*** jerryz has joined #openstack-infra01:34
*** otherwiseguy has joined #openstack-infra01:38
*** terryw has quit IRC01:38
*** otter768 has joined #openstack-infra01:39
ianwclarkb: ^ any sign of things building?01:41
*** sdake_ has quit IRC01:41
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap  https://review.openstack.org/12710601:43
*** baoli has joined #openstack-infra01:43
*** oomichi_ has joined #openstack-infra01:44
openstackgerritClark Boylan proposed a change to openstack-infra/config: Use correct devstack dib element with centos7  https://review.openstack.org/12710701:44
clarkbianw: ^ yup and hit that01:45
clarkbmordred: jhesketh SergeyLukjanov fungi ^ a second set of eyes would be good before I self approve01:45
ianwclarkb: damn it, copy paste error :(01:47
fungiapproved01:47
clarkbfungi: danke01:47
fungiand yeah, easy to type "nodepool" in that file01:47
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap  https://review.openstack.org/12710601:47
*** mmedvede has quit IRC01:48
*** otherwiseguy has quit IRC01:49
*** achanda_ has joined #openstack-infra01:49
*** otherwiseguy has joined #openstack-infra01:49
*** david-lyle has joined #openstack-infra01:50
*** achanda has quit IRC01:52
*** hdd has joined #openstack-infra01:55
*** Ryan_Lane has quit IRC01:55
*** markmcclain has quit IRC01:55
openstackgerritA change was merged to openstack-infra/storyboard-webclient: Subscription  https://review.openstack.org/10400401:55
SergeyLukjanovclarkb, 127107 is lgtm as well01:55
*** todd_dsm has quit IRC01:56
SergeyLukjanovclarkb, and I'm not trying to race you :) I just like to open 30 reviews in tabs and review them :)01:56
clarkbSergeyLukjanov: :)01:56
SergeyLukjanovfolks, if I'm going to make my own installation of infra, will you recommend to use puppet 3 (vs 2), ubuntu 14.04 (vs 12.04)?01:58
clarkbSergeyLukjanov: puppet3 for sure (puppet2.7 is officially eol and we are completely moved to 3 now)01:58
SergeyLukjanovclarkb, oh, great, will notw01:59
SergeyLukjanovnote*01:59
clarkbSergeyLukjanov: We are still mostly precise but should move to trusty in the near future. If you want more garuntees things will work then go with precise. But if you want to get ahead of the curve go with trusty01:59
*** penguinRaider has quit IRC01:59
fungiSergeyLukjanov: feedback on (and patches for) what's broken in 14.04 would be awesome, but if you want something closer to what we run now then 12.0401:59
fungior what clarkb said01:59
SergeyLukjanovyeah, I see 14.04 on master and 12.04 mostly on all other stuff02:00
SergeyLukjanovfungi, clarkb, thx02:00
*** achanda_ has quit IRC02:00
*** achanda has joined #openstack-infra02:02
*** gokrokve has joined #openstack-infra02:03
ianw2014-10-09 01:59:28.409 | fatal: unable to connect to git.openstack.org:02:03
ianw2014-10-09 01:59:28.409 | git.openstack.org: Temporary failure in name resolution02:03
ianwhttp://logs.openstack.org/07/127107/1/gate/gate-config-puppet-syntax/a4a8b31/ - bummer02:04
clarkbsilly dns02:04
*** dimsum_ has joined #openstack-infra02:06
*** nosnos has joined #openstack-infra02:06
openstackgerritA change was merged to openstack-infra/config: Monitor openstackid.org system stats with Cacti  https://review.openstack.org/12702402:06
*** penguinRaider has joined #openstack-infra02:13
*** jeffrey4l_ has joined #openstack-infra02:19
jeffrey4l_hey guys. I create a new project in stackforge with upstream url. But there is nothing in https://github.com/stackforge/nova-salt-formula . The https://git.openstack.org/cgit/stackforge/nova-salt-formula/ repo is right. does anyone know what's going on?02:22
*** gokrokve has quit IRC02:23
openstackgerritKei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Add 'only-successful' and 'fingerprint' options to archive publisher  https://review.openstack.org/12711302:24
*** weshay has quit IRC02:25
*** Longgeek has joined #openstack-infra02:26
*** julim has quit IRC02:27
*** dimsum_ has quit IRC02:28
clarkbjeffrey4l_: ownership wasn't quite right so gerrit couldn't replicate to github, we probably hit an api request limit. I went ahead and fixed ownership so now when you push code to gerrit it should get replicated02:28
openstackgerritKei YAMAZAKI proposed a change to openstack-infra/jenkins-job-builder: Add 'only-successful' and 'fingerprint' options to archive publisher  https://review.openstack.org/12711302:28
*** dimsum_ has joined #openstack-infra02:28
clarkbjhesketh: 126482, touch is enough to make gerrit do the right thing?02:29
clarkbjhesketh: the commit message doesn't really indicate the method used there02:29
jeffrey4l_clarkb, Got. I will try that.02:29
jeffrey4l_thanks a lot02:29
*** zz_dimtruck is now known as dimtruck02:31
*** mmaglana has joined #openstack-infra02:33
*** dimsum_ has quit IRC02:33
openstackgerritA change was merged to openstack-infra/config: Add groups portal prod and dev servers to cacti  https://review.openstack.org/12709702:35
jeffrey4l_clarkb, I push some new code to the gerrit and merged 5 minute ago ( https://git.openstack.org/cgit/stackforge/cinder-salt-formula/ ), but the stackforge is still empty ( https://github.com/stackforge/cinder-salt-formula)02:39
openstackgerritA change was merged to openstack-infra/config: Add syslog tag to os-collect-config logs  https://review.openstack.org/12246602:39
clarkbthat is a different repo you linked02:40
*** jerryz has quit IRC02:42
jeffrey4l_clarkb, I have several repo which both have the same issue. So I tried cinder-salt-formula just now~02:43
clarkbok I fixed the first one you linked02:44
clarkbcan you give me the others?02:44
jeffrey4l_OK. hold on.02:44
*** openstackgerrit has quit IRC02:45
jeffrey4l_There are another two https://github.com/stackforge/cinder-salt-formula    https://github.com/stackforge/neutron-salt-formula02:46
*** Ryan_Lane has joined #openstack-infra02:47
clarkbjeffrey4l_: ok should be happy now02:49
jeffrey4l_clarkb, kk. I just tried nova-salt-formula, it works now. Thanks a lot. ;p02:50
*** mjturek has quit IRC02:54
*** gokrokve has joined #openstack-infra02:54
*** rainya has joined #openstack-infra02:55
*** coolsvap|afk is now known as coolsvap02:55
*** pcrews has quit IRC03:03
*** armax has quit IRC03:03
*** spzala has joined #openstack-infra03:06
*** armax has joined #openstack-infra03:07
*** Ryan_Lane has quit IRC03:08
*** fandi has joined #openstack-infra03:09
*** rushiagr_away is now known as rushiagr03:12
*** stevemar has quit IRC03:12
*** stevemar has joined #openstack-infra03:13
*** dmsimard is now known as dmsimard_away03:15
clarkbianw: centos7 image build is running now03:15
ianwclarkb: fingers crossed!03:16
*** achanda has quit IRC03:19
*** gokrokve has quit IRC03:23
*** achanda has joined #openstack-infra03:24
*** gokrokve has joined #openstack-infra03:24
*** jeffrey4l_ has quit IRC03:25
*** chuckC_ has joined #openstack-infra03:27
*** harlowja is now known as harlowja_away03:29
*** harlowja_away is now known as harlowja03:31
*** amcrn has quit IRC03:32
*** bknudson has quit IRC03:33
*** loki184 has joined #openstack-infra03:33
*** nosnos has quit IRC03:35
*** coolsvap is now known as coolsvap|afk03:37
*** achanda_ has joined #openstack-infra03:39
*** gokrokve_ has joined #openstack-infra03:40
*** achanda has quit IRC03:42
*** gokrokve has quit IRC03:42
*** jeffrey4l_ has joined #openstack-infra03:42
*** coolsvap|afk is now known as coolsvap03:45
*** ryanpetrello has quit IRC03:50
*** ryanpetrello has joined #openstack-infra03:50
*** ramashri has quit IRC03:54
*** gokrokve_ has quit IRC03:57
*** armax has quit IRC03:59
*** spzala has quit IRC04:00
*** tsg has quit IRC04:00
*** rushiagr is now known as rushiagr_away04:08
*** gokrokve has joined #openstack-infra04:09
*** shashankhegde has joined #openstack-infra04:09
*** gokrokve has quit IRC04:10
clarkbianw: there are ready images for centos7 in hpcloud now04:10
*** che-arne has quit IRC04:10
clarkbI don't see any ready nodes though. one is building04:10
clarkbianw: the previous nodes hit Exception: Timeout waiting for ssh access04:12
clarkbnot sure yet if that is just coincidence or maybe the image isn't coming out right04:12
ianwclarkb: awesome!  it's a start04:13
ianwclarkb: know if they were ping-able?04:13
ianwdoes it timeout if the key isnt' right (cloud-init failure, etc), or does that give a different error04:14
*** maxbit has joined #openstack-infra04:14
clarkbianw: I think timeout is what we expect from cloud init failures04:15
clarkbianw: it unpings and I cannot ssh as my user04:15
ianwclarkb: is unpings a thing, or a typo?04:16
clarkbianw: I mean it does not respond to pings04:16
clarkbya my ssh connection timed out too04:17
clarkbI think that if there are cloud init failures we have seen all sorts of weirdness, but it should boot enough to ping04:17
ianwclarkb: ok ... asking the obvious but is there a console log?04:18
*** todd_dsm has joined #openstack-infra04:18
clarkbianw: there is some way to get it, I am not going to go digging for it tonight04:19
clarkbI can neverremember how to get that via nova client04:19
*** tsg has joined #openstack-infra04:20
clarkboh hey its nova console-log04:20
ianwclarkb: no worries, i can try syncing with you early .au time tomorrow04:21
*** baoli has quit IRC04:21
*** todd_dsm has quit IRC04:21
* clarkb wais for the next one to finish building really quickly04:21
clarkbnova console-log returns a newline...04:21
*** Ryan_Lane has joined #openstack-infra04:21
ianwhmm, bootloader maybe?04:24
clarkbya I managed to go to the vnc console really quickly before that node died04:24
clarkband it is unhappy about something booting04:24
ianwthe build-image.sh qcow2 boots for me, but maybe something differs in production04:25
clarkbA start job is running for dev-disk-by\blahblah04:26
clarkbit looks like a bunch of "OK" up to that point04:26
clarkband now (1 of 2) and (2 of 2) of the above is running04:26
clarkbit just timed out waiting04:26
clarkbDependency failed for /boot04:26
clarkband so forth and now dropped to what must be initramfs prompt?04:27
clarkbcentos calls it "Emergency Mode!"04:27
ianwclarkb: arrgh, ok ... first thing i'll do all fresh builds here and see if i can replicate anything like that04:28
clarkbianw: ok. maybe try unsetting release?04:29
clarkbianw: also I hope to publish our dib images in the near future so that you can just grab it and poke at it too04:29
ianwclarkb: yeah, if not, maybe next step is to save the qcow2 somewhere and start poking at it04:29
clarkbbut that requires updates to our apache server on nodepool.o.o that I haven't had time to do04:29
ianwclarkb: ok, well maybe we can figure out a one-off if not getting progress04:30
clarkbya shouldn't be too hard04:30
clarkbthough it is a 2.9GB image04:30
clarkbok back to my regularly scheduled evening. I wish you luck on your end04:30
ianwclarkb: thanks for all your help getting it this far!04:31
*** Ryan_Lane has quit IRC04:32
*** hdd has quit IRC04:33
*** e0ne has joined #openstack-infra04:34
*** amotoki has joined #openstack-infra04:34
*** nosnos has joined #openstack-infra04:35
*** tsg has quit IRC04:37
*** rushiagr_away is now known as rushiagr04:37
*** e0ne has quit IRC04:39
*** rainya has quit IRC04:40
*** gokrokve has joined #openstack-infra04:41
*** gokrokve has quit IRC04:42
*** loki184 has quit IRC04:42
*** gokrokve has joined #openstack-infra04:42
*** mmaglana has quit IRC04:43
*** mmaglana has joined #openstack-infra04:43
*** loki184 has joined #openstack-infra04:47
*** mmaglana has quit IRC04:48
*** gokrokve has quit IRC04:48
*** otter768 has quit IRC04:48
*** e0ne has joined #openstack-infra04:52
*** loki184 has quit IRC04:53
*** e0ne has quit IRC04:56
*** hdd has joined #openstack-infra05:01
*** HeOS has quit IRC05:02
*** HeOS has joined #openstack-infra05:02
*** crinkle has quit IRC05:03
*** pabelanger has quit IRC05:03
*** crinkle has joined #openstack-infra05:03
*** sunil_ has quit IRC05:04
*** sunil__ has joined #openstack-infra05:04
*** jamielennox has quit IRC05:04
*** pabelanger has joined #openstack-infra05:05
*** wenlock has joined #openstack-infra05:05
*** hdd has quit IRC05:06
*** Ryan_Lane has joined #openstack-infra05:08
*** jamielennox has joined #openstack-infra05:09
*** achanda has joined #openstack-infra05:09
*** david-lyle has quit IRC05:10
*** achanda_ has quit IRC05:12
*** sdake has quit IRC05:12
*** Ryan_Lane has quit IRC05:14
*** rainya has joined #openstack-infra05:16
*** achanda_ has joined #openstack-infra05:16
*** rainya has quit IRC05:18
*** wenlock has quit IRC05:19
*** achanda has quit IRC05:20
*** wenlock has joined #openstack-infra05:21
*** jcoufal has joined #openstack-infra05:22
*** achanda has joined #openstack-infra05:24
*** tsg has joined #openstack-infra05:24
*** david-lyle has joined #openstack-infra05:27
*** achanda_ has quit IRC05:27
*** achanda_ has joined #openstack-infra05:29
*** harlowja_at_home has joined #openstack-infra05:32
*** achanda has quit IRC05:32
*** harlowja is now known as harlowja_away05:35
*** harlowja_at_home has quit IRC05:42
*** dimtruck is now known as zz_dimtruck05:42
*** gokrokve has joined #openstack-infra05:43
*** gokrokve has quit IRC05:48
*** yolanda has joined #openstack-infra05:49
*** afazekas has joined #openstack-infra05:51
*** yamahata has quit IRC05:51
*** yamahata has joined #openstack-infra05:52
*** achanda_ has quit IRC05:53
*** dkehnm has quit IRC05:55
*** jeffrey4l_ has left #openstack-infra05:55
*** dkehnm has joined #openstack-infra05:57
*** loki184 has joined #openstack-infra05:59
*** coolsvap is now known as coolsvap|afk06:00
*** shashankhegde has quit IRC06:02
*** loki184 has quit IRC06:09
*** loki184 has joined #openstack-infra06:09
*** coolsvap|afk is now known as coolsvap06:12
*** pkoniszewski has joined #openstack-infra06:13
*** timrc is now known as timrc-afk06:14
*** achanda has joined #openstack-infra06:16
*** tsg has quit IRC06:17
*** HeOS has quit IRC06:17
*** achanda has quit IRC06:20
*** ashaeron has joined #openstack-infra06:21
*** jlibosva has joined #openstack-infra06:22
*** wenlock has quit IRC06:26
*** achanda has joined #openstack-infra06:29
*** achanda has quit IRC06:34
*** pcrews has joined #openstack-infra06:39
*** ashaeron has quit IRC06:41
*** vigneshvar has joined #openstack-infra06:42
*** ashaeron has joined #openstack-infra06:43
*** gokrokve has joined #openstack-infra06:43
*** mrmartin has joined #openstack-infra06:46
*** pcrews has quit IRC06:47
*** gokrokve has quit IRC06:48
*** MaxV has joined #openstack-infra06:49
*** MaxV has quit IRC06:55
*** camunoz has quit IRC06:55
*** k4n0 has joined #openstack-infra06:56
*** flaper87|afk is now known as flaper8706:58
*** r1chardj0n3s is now known as r1chardj0n3s_afk06:59
AJaegertransifex has a partial outage - in case you wonder about failing translation jobs ;(06:59
*** achanda has joined #openstack-infra06:59
*** penguinRaider has quit IRC07:02
*** k4n0 has quit IRC07:02
*** penguinRaider has joined #openstack-infra07:03
*** andreykurilin_ has joined #openstack-infra07:06
*** arxcruz has joined #openstack-infra07:12
*** andreykurilin_ has quit IRC07:13
*** k4n0 has joined #openstack-infra07:15
*** jerryz has joined #openstack-infra07:16
*** doude has joined #openstack-infra07:18
*** yaguang has quit IRC07:21
*** yaguang has joined #openstack-infra07:22
*** denis_makogon has joined #openstack-infra07:22
*** jistr has joined #openstack-infra07:23
*** achanda has quit IRC07:25
*** andreaf has quit IRC07:26
stevemarAJaeger, we commented at the same time :\07:31
AJaeger;)07:31
AJaegerstrange - let me check it out...07:32
stevemarAJaeger, i'm still stuck, but i'll pick this up tomorrow, it's getting late on this side of the planet07:32
AJaegerearly here ;)07:32
stevemarit's well past late, but ya know07:32
*** dizquierdo has joined #openstack-infra07:32
AJaegerstevemar, good night!07:33
stevemarAJaeger, good morning :P07:33
* AJaeger was already wondering whether you moved ;)07:33
stevemarAJaeger, i owe you like 6 beers in paris07:33
AJaegerLet's drink them together ;)07:33
stevemaror wine, it being france and all07:33
stevemardone07:34
AJaegersure!07:34
stevemari'm out for now, see ya !07:34
AJaegerstevemar, see you!07:34
*** andreykurilin_ has joined #openstack-infra07:35
*** skolekonov has joined #openstack-infra07:35
*** luqas has joined #openstack-infra07:35
*** stevemar has quit IRC07:41
*** mrmartin has quit IRC07:42
*** k4n0 has quit IRC07:42
*** gokrokve has joined #openstack-infra07:43
*** jgallard has joined #openstack-infra07:44
*** andreykurilin_ has quit IRC07:44
*** Guest51022 has joined #openstack-infra07:44
*** MaxV has joined #openstack-infra07:44
*** HeOS has joined #openstack-infra07:45
*** gokrokve has quit IRC07:48
*** MaxV has quit IRC07:49
*** achanda has joined #openstack-infra07:50
*** SumitNaiksatam has quit IRC07:50
*** SumitNaiksatam has joined #openstack-infra07:50
*** kashyap has joined #openstack-infra07:51
zarohas07:52
*** Ryan_Lane has joined #openstack-infra07:54
*** k4n0 has joined #openstack-infra07:55
*** dmellado_ has joined #openstack-infra07:56
*** dmellado_ has quit IRC07:57
*** mpaolino has joined #openstack-infra08:00
*** achanda has quit IRC08:01
*** sunrenjie6 has quit IRC08:04
*** jpich has joined #openstack-infra08:05
*** yamamoto has quit IRC08:08
*** shardy_z is now known as shardy08:09
*** hashar has joined #openstack-infra08:10
*** salv-orlando has joined #openstack-infra08:11
*** jistr has quit IRC08:12
*** BobBallAway is now known as BobBall08:15
*** sunrenjie has joined #openstack-infra08:16
*** MaxV has joined #openstack-infra08:20
*** oomichi_ has quit IRC08:24
*** katyafervent_awa is now known as katyafervent08:28
*** derekh has joined #openstack-infra08:30
*** ihrachyshka has joined #openstack-infra08:30
*** jedimike has joined #openstack-infra08:31
*** jistr has joined #openstack-infra08:31
*** jgallard has quit IRC08:35
*** david-lyle has quit IRC08:35
*** loki184 has quit IRC08:37
*** jp_at_hp has joined #openstack-infra08:40
ashaeronAnyone know if it is possible to generate a pydoc for a function by "inheriting" the pydoc from another similar function?08:43
*** gokrokve has joined #openstack-infra08:43
*** vigneshvar has quit IRC08:45
AJaegerashaeron, I suggest to ask on #openstack-dev08:45
ashaeronAJaeger: alright, thanks08:45
*** jgallard has joined #openstack-infra08:46
*** tty57 has joined #openstack-infra08:47
*** dizquierdo has quit IRC08:48
*** gokrokve has quit IRC08:48
*** tty57 has quit IRC08:52
*** loki184 has joined #openstack-infra09:01
*** tty57 has joined #openstack-infra09:01
*** Ryan_Lane has quit IRC09:02
*** penguinRaider has quit IRC09:03
*** dizquierdo has joined #openstack-infra09:06
AJaegerfungi, we've lost again the gerrit IRC bot ;(09:06
*** IvanBerezovskiy has joined #openstack-infra09:09
*** dizquierdo has quit IRC09:15
*** jgallard has quit IRC09:16
*** jgallard has joined #openstack-infra09:16
*** penguinRaider has joined #openstack-infra09:17
*** zz_johnthetubagu is now known as johnthetubaguy09:17
*** ociuhandu has joined #openstack-infra09:23
*** katyafervent is now known as katyafervent_awa09:25
*** sunrenjie has quit IRC09:29
*** denis_makogon has quit IRC09:36
*** Guest51022 has quit IRC09:38
*** gokrokve has joined #openstack-infra09:43
*** pelix has joined #openstack-infra09:44
*** gokrokve has quit IRC09:48
*** yolanda has quit IRC09:48
*** coolsvap is now known as coolsvap|afk09:56
*** lttrl has quit IRC09:57
*** otherwiseguy has quit IRC09:59
*** jgallard has quit IRC10:02
*** lttrl has joined #openstack-infra10:02
*** cdent has joined #openstack-infra10:08
ttxAJaeger: would you mind proposing translations updates for proposed/juno branches for cinder and horizon ? Today is the day :)10:09
ttxAJaeger: johnthetubaguy was trying to generate them for nova, so you can also lend him a hand10:09
*** jerryz has quit IRC10:10
johnthetubaguyAJaeger: happy to help, but the script isn't working for me, -bash: declare: -g: invalid option10:10
jpichttx, AJaeger: FWIW amotoki told the translators team he would do it at 13:00 UTC today, for Horizon10:10
ttxjpich: oh, great10:11
jpichIn case there are people scrambling to meet the deadline in the next couple of hours :-)10:11
*** hashar has quit IRC10:11
ttxI knew it was "today", not sure when toiday though :)10:11
jpichThat's fair enough :)10:11
AJaegerttx, for horizon Akihiro will do it - see http://lists.openstack.org/pipermail/openstack-i18n/2014-October/000806.html10:12
ttxAJaeger: ok, so help only needed for cinder and nova10:12
AJaegerttx, I can do cinder and nova...10:12
ttxAJaeger: awesome, thx!10:12
AJaegerttx, what'S my deadline? ;)10:12
ttxAJaeger: asap10:12
ttxcan wait a couple hours10:13
AJaegerttx, anything I have to care about for proposed/juno? Handle it the same as a stable branch?10:13
johnthetubaguyAJaeger: I have got halfway through nova, just hitting an issue10:13
johnthetubaguyAJaeger: although it might be easier if you just run it on your box, which is fine too10:13
ttxAJaeger: my understanding is that running the comands at https://review.openstack.org/#/c/126922/ on proposed/juno will do it10:13
AJaegerttx, yep10:14
AJaegerjohnthetubaguy, let me do it - I have everything set up ;)10:14
*** tnurlygayanov has joined #openstack-infra10:14
johnthetubaguyOK, cool, setup_loglevel_vars is failing with declare: -g: invalid option10:14
johnthetubaguyduno what that is, so happy for you to do it :)10:15
AJaegerseems to be a bash problem - works fine in the gate adn on my system10:15
*** _nadya_ has joined #openstack-infra10:18
*** yamahata has quit IRC10:19
amotokijpich: ttx: I will propose horizon translations 13UTC today as we planned.10:20
ttxamotoki: thx!10:21
jpichamotoki: Thank you!10:21
AJaegerttx, johnthetubaguy any specific commands to give to git review? IT tries rebasing on master and that fails ;(10:23
johnthetubaguyoh yeah, you need to specifiy the branch10:24
johnthetubaguyjust like stable, but the proposed branch10:24
AJaegerttx, johnthetubaguy please check https://review.openstack.org/12718910:24
AJaegerjohnthetubaguy, thanks10:24
*** psedlak_ has joined #openstack-infra10:25
*** psedlak_ has quit IRC10:25
johnthetubaguyAJaeger: it seems to have deleted lots of things, is that what we would expect?10:25
*** unicell has quit IRC10:25
AJaegerjohnthetubaguy, it should delete files that have less than 20 % translations10:26
AJaegerjust check msgid/msgstr ratio10:26
johnthetubaguyAJaeger: ah, OK, its a kind of trim translations on release10:26
AJaegerjohnthetubaguy, a very recent change to the translation scripts that came to late for Juno - but ttx suggested to apply it for Juno as well...10:27
johnthetubaguycool10:27
AJaegerjohnthetubaguy, already imported in master10:28
johnthetubaguyI saw that in the git commits when looking at why the script failed10:28
AJaegerttx, cinder patch is here https://review.openstack.org/12719110:28
AJaegerI'm out for lunch now ;) If anything is wrong, I'll fix afterwards...10:28
*** unicell has joined #openstack-infra10:29
*** mkerrin has quit IRC10:29
AJaegerttx, visually inspected the deleted files - looks fine to me...10:30
AJaegerjohnthetubaguy, which shell are you using to run the commands?10:30
*** pcm_ has joined #openstack-infra10:31
johnthetubaguybash, but on mac10:31
johnthetubaguyversion 3.2.53(1)-release10:31
johnthetubaguyits 10.8.5 I am running10:32
*** pcm__ has joined #openstack-infra10:32
*** pcm_ has quit IRC10:35
*** mkerrin has joined #openstack-infra10:37
*** gokrokve has joined #openstack-infra10:43
*** gokrokve has quit IRC10:48
*** dimsum_ has joined #openstack-infra10:51
*** lttrl has quit IRC10:53
*** vigneshvar has joined #openstack-infra10:59
*** doug-fish has joined #openstack-infra11:02
*** dmsimard_away is now known as dmsimard11:07
*** ZZelle has quit IRC11:11
*** denis_makogon has joined #openstack-infra11:11
*** ZZelle has joined #openstack-infra11:11
*** MaxV has quit IRC11:12
*** MaxV has joined #openstack-infra11:12
*** dimsum_ has quit IRC11:13
*** dimsum_ has joined #openstack-infra11:13
*** dims_ has joined #openstack-infra11:14
*** loki184 has quit IRC11:14
*** MaxV has quit IRC11:17
*** dimsum_ has quit IRC11:17
*** dmellado_ has joined #openstack-infra11:17
*** dmellado_ has quit IRC11:18
*** fandi has quit IRC11:19
*** trinaths has joined #openstack-infra11:23
*** katyafervent_awa is now known as katyafervent11:24
trinathsHi, How to know a Specific CI activity ?11:24
trinathsI mean, How many patches it tested both voting and Non-voting11:24
trinathsany clue ??11:24
*** dmellado_ has joined #openstack-infra11:25
*** dmellado_ has quit IRC11:25
*** lttrl has joined #openstack-infra11:25
ZZelletrinaths, stackalytics perhaps ?11:26
*** MaxV has joined #openstack-infra11:27
trinathsZZelle: True, but It doesn't help me for CI activity. It gives the latest commented CHANGE ID for CI. Not the count of changes it tested ..11:28
trinathsZZelle: Yes I got it, its with the changes to search criteria. Thanks :)11:29
*** amotoki_ has joined #openstack-infra11:34
*** amotoki_ has quit IRC11:34
*** trinaths has left #openstack-infra11:37
*** bcrochet has left #openstack-infra11:38
*** otherwiseguy has joined #openstack-infra11:38
*** kashyap has quit IRC11:40
*** otherwiseguy has quit IRC11:43
*** gokrokve has joined #openstack-infra11:43
*** julim has joined #openstack-infra11:45
*** amotoki has quit IRC11:45
*** coolsvap|afk is now known as coolsvap11:46
*** sarob has quit IRC11:46
*** gokrokve has quit IRC11:48
*** mgagne has quit IRC11:48
*** zz_gondoi has quit IRC11:49
*** flaviof_zzz has quit IRC11:50
*** StevenK has quit IRC11:50
*** mgagne has joined #openstack-infra11:51
*** mgagne is now known as Guest9205411:51
*** StevenK has joined #openstack-infra11:51
*** gondoi has joined #openstack-infra11:52
*** Guest51022 has joined #openstack-infra11:53
*** tty57 has quit IRC11:58
*** coolsvap is now known as coolsvap|afk12:01
*** che-arne has joined #openstack-infra12:04
*** mmedvede has joined #openstack-infra12:04
*** afazekas has quit IRC12:04
*** weshay has joined #openstack-infra12:10
*** mpaolino has quit IRC12:11
AJaegerjohnthetubaguy, I'm using bash 4 on Linux. Might be that arrays are not part of bash 3.12:13
AJaegerttx, is everything ok with the translation patches?12:13
*** cnesa16 has joined #openstack-infra12:13
johnthetubaguyAJaeger: gotcha, I guess I should/could brew in something newer, no worries12:13
ttxAJaeger: looks good, reviewing now12:14
*** ctlaugh has quit IRC12:14
*** markmcclain has joined #openstack-infra12:15
*** baoli has joined #openstack-infra12:17
*** dkliban_afk is now known as dkliban12:17
*** rushiagr is now known as rushiagr_away12:20
*** sarob has joined #openstack-infra12:20
*** flaviof_zzz has joined #openstack-infra12:22
*** lttrl has quit IRC12:22
*** kgiusti has joined #openstack-infra12:22
*** ctlaugh has joined #openstack-infra12:22
*** openstackgerrit has joined #openstack-infra12:23
*** dims_ has quit IRC12:23
*** mpaolino has joined #openstack-infra12:24
*** mbacchi has joined #openstack-infra12:24
*** dimsum_ has joined #openstack-infra12:24
*** spzala has joined #openstack-infra12:24
fungiAJaeger: thanks, openstackgerrit should be back now12:26
AJaegergood morning, fungi  - and thanks!12:26
*** salv-orlando has quit IRC12:27
*** prad has quit IRC12:28
*** otherwiseguy has joined #openstack-infra12:32
*** marcusvrn_ has joined #openstack-infra12:32
*** nosnos has quit IRC12:35
*** nosnos has joined #openstack-infra12:36
*** otherwiseguy has quit IRC12:37
*** gokrokve has joined #openstack-infra12:38
*** erlon_ has joined #openstack-infra12:38
*** nosnos has quit IRC12:40
*** mpaolino has quit IRC12:42
*** packet has joined #openstack-infra12:43
rfolcofungi, morning. openstackgerrit was down? our zuul reported back without running anything...12:45
fungirfolco: when? uptime seems to be 10 days12:47
krtaylorthe scrollback says "openstackgerrit should be back now", or is that just the irc bot?12:47
fungiopenstackgerrit is nick of our irc bot12:48
rfolcolol12:48
krtaylorok, nothing else then12:48
*** adalbas has joined #openstack-infra12:48
*** wenlock has joined #openstack-infra12:48
fungiso i meant it should be back in the configured irc channels on freenode now12:48
*** JayJ has joined #openstack-infra12:49
fungiAJaeger had reported it as missing in action earlier12:49
rfolcofungi, any pointers on how to debug/fix our zuul to not report back without running any test?12:49
krtaylorrfolco, I guess we have to look elsewhere then12:49
*** rushiagr_away is now known as rushiagr12:49
fungirfolco: you'd need to show me an example of a review on which it reported and an example layout.yaml12:50
rfolcofungi, zuul log says the patch comes in, it adds to pipeline, and it reports back to gerrit12:50
*** miqui has joined #openstack-infra12:50
rfolcofungi, https://review.openstack.org/#/c/125492/12:50
rfolcofungi, http://paste.openstack.org/show/119888/12:50
fungirfolco: i suspect i know what the misconfiguration is, but would need to see the pipeline configuration for your layout.yaml12:51
fungithere's been a misunderstanding around how files filtering on jobs works12:52
*** radez_g0n3 is now known as radez12:52
*** sgordon_ has joined #openstack-infra12:53
fungiprobably worth an faq12:53
rfolcofungi, it has been working fine for hours... the problem started more or less 3 hours ago.12:53
rfolcofungi, http://paste.openstack.org/show/119889/12:53
*** dkranz has quit IRC12:54
fungiokay, it's definitely not what i was thinking, since you're not restricting jobs by file patterns12:55
*** aysyd has joined #openstack-infra12:55
*** zz_dimtruck is now known as dimtruck12:55
fungirfolco: did you restart zuul around the time the misbehavior started?12:56
rfolcofungi, no12:56
fungiokay, so probably not a new change to the zuul project at fault, since you'd have to restart to pick it up12:56
rfolco126061,11 was good, 127203,1 is the first bad12:57
rfolcofungi, and we locked down (pinned) project-config repo to not update it anymore and break us12:57
*** achuprin_ has joined #openstack-infra12:58
*** hdd has joined #openstack-infra12:59
fungirfolco: oh... the one with the empty comment was for a stable/icehouse change12:59
*** yaguang has quit IRC13:00
*** hashar has joined #openstack-infra13:00
*** yaguang has joined #openstack-infra13:00
fungirfolco: on line 29 of your layout.yaml paste, you're configured all jobs to get skipped on stable/havana and stable/icehouse changes13:01
fungirfolco: so zuul literally runs no jobs at all on those changes, and reports back that it successfully did so13:01
*** amotoki has joined #openstack-infra13:01
rfolcofungi, that explains.. correct!13:02
rfolcofungi, will change that thanks a lot for your patience!!!13:02
krtaylorthanks fungi13:02
fungii'm looking back through the pipeline options in our ducumentation for a good recommendation13:02
*** penguinRaider has quit IRC13:02
*** flaviof_zzz is now known as flaviof13:03
fungiaha, the "branch" option on the gerrit trigger for your pipeline13:03
fungirfolco: krtaylor: http://ci.openstack.org/zuul/zuul.html#pipelines13:03
*** hashar_ has joined #openstack-infra13:04
fungirfolco: if you restrict branches on the trigger rather than on the jobs, you will only enqueue changes into that pipeline for the branches you want, rather than enqueue all changes and then limit the jobs to run by branch pattern13:04
*** hashar_ has quit IRC13:05
fungithe latter is what's causing you to report a successful run of no jobs on stable branch changes13:05
*** dimtruck is now known as zz_dimtruck13:05
*** hashar_ has joined #openstack-infra13:06
*** mjturek has joined #openstack-infra13:06
rfolcofungi, nice catch13:06
rfolcosaved us some debug time, owe_beer++ fungi13:06
fungibest of luck with your systems!13:07
*** hashar has quit IRC13:07
rfolcothx again13:08
fungiyw13:08
*** tty57 has joined #openstack-infra13:09
*** dprince has joined #openstack-infra13:09
*** zz_dimtruck is now known as dimtruck13:10
*** sdake has joined #openstack-infra13:12
*** sdake has quit IRC13:12
*** sdake has joined #openstack-infra13:12
*** jaypipes has joined #openstack-infra13:12
*** nkinder has quit IRC13:13
*** hashar_ has quit IRC13:13
*** zz_jgrimm is now known as jgrimm13:13
*** hashar has joined #openstack-infra13:14
*** AJaeger has quit IRC13:17
*** mriedem has joined #openstack-infra13:18
*** xyang0 has joined #openstack-infra13:18
*** vigneshvar has quit IRC13:19
*** spzala has quit IRC13:21
*** jgallard has joined #openstack-infra13:21
*** AJaeger has joined #openstack-infra13:22
*** che-arne has quit IRC13:23
*** dimtruck is now known as zz_dimtruck13:24
*** dustins has joined #openstack-infra13:26
*** otherwiseguy has joined #openstack-infra13:26
*** kgiusti has quit IRC13:28
*** kgiusti has joined #openstack-infra13:29
*** otherwiseguy has quit IRC13:31
*** dangers_away is now known as dangers13:32
*** markmcclain has quit IRC13:33
*** portante has left #openstack-infra13:33
*** eharney has joined #openstack-infra13:39
*** bradjones has joined #openstack-infra13:39
*** zns has joined #openstack-infra13:39
*** aysyd has quit IRC13:40
*** kgiusti has quit IRC13:40
bradjoneshello infra! Was wondering if anyone can help point me in the direction of getting the openstackgerrit bot reporting in the horizon channel13:41
*** imcsk8 has quit IRC13:42
*** imcsk8 has joined #openstack-infra13:42
*** penguinRaider has joined #openstack-infra13:43
*** tsg has joined #openstack-infra13:43
fungibradjones: http://git.openstack.org/cgit/openstack-infra/project-config/tree/gerritbot/channels.yaml13:43
fungibradjones: it's just a code review away ;)13:43
bradjonesfungi: thanks, will update now13:44
*** afazekas has joined #openstack-infra13:45
fungibradjones: also, gratuitous infra documentation link... http://ci.openstack.org/irc.html13:46
* fungi doesn't want to give the impression that asking in #openstack-infra is the only way to discover this information ;)13:47
*** julim has quit IRC13:47
openstackgerritJulie Pichon proposed a change to openstack-infra/project-config: Fix Horizon integration job definition  https://review.openstack.org/12718713:47
*** spzala has joined #openstack-infra13:49
openstackgerritBradley Jones proposed a change to openstack-infra/project-config: Added horizon channel  https://review.openstack.org/12724913:49
bradjonesfungi: sure is the quickest ;)13:49
*** che-arne has joined #openstack-infra13:49
bradjonesfungi: thanks for the help13:50
openstackgerritJulie Pichon proposed a change to openstack-infra/project-config: Fix Horizon integration job definition  https://review.openstack.org/12718713:51
*** otherwiseguy has joined #openstack-infra13:52
AJaegerbradjones, fungi : Do we need to add the havana channel to accessbot/channels.yaml as well?13:54
*** Sincler has joined #openstack-infra13:55
AJaegers/havana/openstack-horizon/13:55
fungiAJaeger: it's not already in there? that surprises me13:55
* AJaeger was wired wrongly ;(13:56
AJaegerI looked for havana, don't know what I smoked ;((((13:56
AJaegerfalse alarm, bradjones and fungi13:56
*** gokrokve has quit IRC13:56
fungiyou were just trying to remind me to delete all those stable/havana branches13:56
fungii'll do that now before i forget again. it's been 9 days since i tagged them all and sent the announcement13:57
AJaegerThanks for always finding something good in my mistakes, fungi!13:57
*** penguinRaider has quit IRC13:59
*** jgrimm is now known as zz_jgrimm13:59
fungithat's why i'm here!13:59
AJaegerAnd that's why I'm glad to have you here ;)14:00
*** esker has joined #openstack-infra14:00
*** nkinder has joined #openstack-infra14:03
*** kashyap has joined #openstack-infra14:04
*** dmellado has quit IRC14:07
*** homeless has joined #openstack-infra14:08
openstackgerritA change was merged to openstack-infra/project-config: Fix Horizon integration job definition  https://review.openstack.org/12718714:08
*** gokrokve has joined #openstack-infra14:09
*** hdd has quit IRC14:09
*** zz_dimtruck is now known as dimtruck14:09
*** dmellado has joined #openstack-infra14:10
*** salv-orlando has joined #openstack-infra14:10
*** pkoniszewski has quit IRC14:11
jpichHow long till I can make use of a "new" job definition, after the infra patch merges?14:12
*** dkranz has joined #openstack-infra14:13
fungijpich: that merge will get picked up in the 14:15 utc puppet apply pulse in a minute, and then it takes around 15 minutes for the job updates to get established on all the jenkins masters14:14
fungijpich: so you could try rechecking an affected change around 14:30 utc14:14
jpichfungi: Super, thank you :)14:14
fungiyou're welcome!14:14
ttxfungi: weird set of 00000 jobs in post pipeline14:15
ttxtriggered roughly 13 min ago14:15
ttxany idea what that is for ?14:16
*** otherwiseguy has quit IRC14:16
AJaegeranybody tagged some branches or releases?14:16
fungittx: i think that's zuul reacting to my stable/havana branch deletions14:16
ttxah, yes that would do that14:16
fungithose should all fail miserably14:16
fungibut i'll keep an eye on one or two and make sure they aren't wreaking some sort of unanticipated havoc14:17
*** mwagner_lap has joined #openstack-infra14:19
*** zns has quit IRC14:22
*** ryanpetrello has quit IRC14:23
AJaegerfungi, once you have some idle time, I would appreciate a review of https://review.openstack.org/#/c/126499/ - this might need more rebases otherwise. This is creating and using two new templates in layout.yaml14:23
openstackgerritEric Harney proposed a change to openstack-infra/git-review: Fix ---list and "departement" typos in man page  https://review.openstack.org/12725614:24
*** dizquierdo has joined #openstack-infra14:26
fungiAJaeger: i'll have a look once i'm done getting stuff prepped for the tc election tomorrow14:26
*** bnemec has joined #openstack-infra14:26
*** bknudson has joined #openstack-infra14:26
*** ihrachyshka has quit IRC14:26
AJaegerfungi, nothing critical - just me avoiding rebases ;) Take your time, TC elections are far more important14:27
*** zns has joined #openstack-infra14:28
*** dimtruck is now known as zz_dimtruck14:29
*** annegent_ has joined #openstack-infra14:31
openstackgerritBradley Jones proposed a change to stackforge/gertty: Use local timezone for the updated column  https://review.openstack.org/12726014:31
*** tonytan4ever has joined #openstack-infra14:32
*** stevemar has joined #openstack-infra14:32
*** habib has joined #openstack-infra14:36
*** charz has quit IRC14:37
*** zaphod42 has quit IRC14:37
*** dustins has quit IRC14:37
*** zz_dimtruck is now known as dimtruck14:37
*** zaphod42 has joined #openstack-infra14:37
*** dizquierdo has quit IRC14:38
*** charz has joined #openstack-infra14:39
*** dustins has joined #openstack-infra14:40
*** markmcclain has joined #openstack-infra14:41
*** markmcclain has quit IRC14:41
*** rainya has joined #openstack-infra14:41
*** k4n0 has quit IRC14:42
*** zaphod42 has quit IRC14:42
*** zaphod42 has joined #openstack-infra14:42
*** pkoniszewski has joined #openstack-infra14:42
*** hdd has joined #openstack-infra14:42
*** markmcclain has joined #openstack-infra14:43
*** hashar has quit IRC14:43
*** isviridov is now known as isviridov_meet14:43
*** IAX has joined #openstack-infra14:46
fungi#status note upgraded all pypi mirrors from bandersnatch 1.5 to 1.6.1 for https://bitbucket.org/pypa/bandersnatch/issue/5214:46
openstackstatusfungi: unknown command14:46
*** zz_jgrimm is now known as jgrimm14:46
*** otherwiseguy has joined #openstack-infra14:47
*** jheroux has joined #openstack-infra14:47
*** bhunter71 has joined #openstack-infra14:49
*** HeOS has quit IRC14:51
*** annegent_ has quit IRC14:51
*** pcrews has joined #openstack-infra14:52
*** gokrokve has quit IRC14:52
*** JayJ has quit IRC14:53
*** markmcclain has quit IRC14:53
*** JayJ has joined #openstack-infra14:54
*** hashar has joined #openstack-infra14:55
*** dizquierdo has joined #openstack-infra14:55
*** bhunter71 has quit IRC14:56
*** AJaeger has quit IRC14:57
ttxclarkb: catching up on the gerrit-powered agenda status14:58
*** yamahata has joined #openstack-infra14:58
ttxclarkb: lbragstad removed some of the check/gate logic, apparently after discussion that jenkins would do it14:59
ttxwhich confuses me a bit15:00
ttxlbragstad: you around ?15:00
lbragstadttx: o/15:00
lbragstadttx: I removed most of that logic since it didn't seem like something the average enduser would be concerned about15:00
ttxwe still need the code to do that, though ?15:01
ttxi.e. checking for meeting conflicts ?15:01
lbragstadttx: yes, that is still done by gerrit-powered-agenda15:01
*** prad has joined #openstack-infra15:01
clarkbWe had talked about making a two step publish process. first step compile second step push to wiki via authenticated slave.15:01
lbragstadthat step could use the meeting object API to check for conflicts15:02
*** HeOS has joined #openstack-infra15:02
ttxhmm, ok, I'll dive a bit more I guess15:02
clarkbthough I think check/gate should look for errors as early in the process as possible15:02
ttxlbragstad: I was about to prepare a change to produce a single .ics15:02
*** datsun180b has joined #openstack-infra15:02
ttxbecause currently it builds one .ics file per meeting15:02
*** atiwari has joined #openstack-infra15:03
ttxwhile currently we have a single one with all meetings15:03
ttxlbragstad: any reason for not doing it in a single file ?15:03
lbragstadttx: when we originally met with the capstone group I thought each meeting was to be represented as a single .ics file?15:04
ttxlbragstad: ah, probably a communication error then15:04
lbragstadttx: I apologize about that15:04
ttxIf we want to preserve the gcal experience, we should let people subscribe to a single ics with all of them15:05
*** spzala has quit IRC15:05
ttxit's an easy fix15:05
ttxjust wanted to make sure the current situation wasn't done on purpose :)15:05
ttxwill give me a nice intro to the code.15:05
*** datsun180b has quit IRC15:06
*** datsun180b has joined #openstack-infra15:06
lbragstadttx: I think that could be done with a flag, unless you outputting a single .ics with all meetings to be the default behavior15:07
lbragstads/you/you think/15:07
*** mfer has joined #openstack-infra15:07
ttxwill do!15:07
lbragstadclarkb: fwiw, we check for conflicts before writing/converting anything and bomb out early15:08
*** zaphod42 has quit IRC15:08
lbragstadttx: don't hesitate to poke at me if you need anything, I can also pick up something if you need me to.15:08
*** jistr has quit IRC15:08
*** zaphod42 has joined #openstack-infra15:09
*** tsg has quit IRC15:09
*** spzala has joined #openstack-infra15:10
lbragstadttx: clarkb note on the project: in June mrodden and I were going through and doing a little bit of a rewrite and discovered an issue with namespaces/imports, which lead us to rename the project to arbiter ( mrodden came up with the cool name).15:10
*** bhunter71 has joined #openstack-infra15:11
*** zaphod42 has quit IRC15:13
*** mrmartin has joined #openstack-infra15:14
*** salv-orlando has quit IRC15:15
*** thedodd has joined #openstack-infra15:15
*** achanda has joined #openstack-infra15:17
*** amotoki has quit IRC15:20
*** julim has joined #openstack-infra15:22
*** ashaeron has quit IRC15:22
*** kashyap has quit IRC15:23
*** achanda has quit IRC15:24
*** dkliban is now known as dkliban_biab15:29
corvusfungi, clarkb, mordred, SergeyLukjanov, jhesketh, ttx: hi there15:30
*** corvus is now known as jeblair15:30
anteayacorvus: welcome back15:30
anteayajeblair: how was vacation?15:30
ttxjeblair: o/15:30
*** lnxnut has joined #openstack-infra15:31
fungiheyhey!15:33
fungibtw, everything fell over as soon as you left, so we all just gave up and drank for the past week and a half15:33
anteayawooooo15:33
jeblairanteaya: excellent, thanks.  i saw some amazing things and ate delicious food.  i stood in a prairie at 14,000 feet with mountains towering over me.15:33
anteayawow15:34
anteayathat sounds awesome15:34
jeblairanteaya, fungi: related to that, i also learned that multi-lingual drinking games are HARD.15:34
*** isviridov_meet is now known as isviridov_away15:34
anteayasounds like tibet15:34
fungijeblair: especially when it involves shochu?15:34
*** dustins has quit IRC15:34
fungi(or whatever the local variant is)15:34
*** skolekonov has quit IRC15:34
jeblairanteaya: it's culturally, but not administratively, tibetan15:35
anteayawish it was both15:35
anteayabut yay culturally tibetan15:35
anteayasounds very spiritually refreshing15:35
jeblairthe aba prefecture15:35
*** TheJulia has joined #openstack-infra15:36
* anteaya looks it up15:36
jeblairi'll let you know when we have some pictures up15:37
*** dustins has joined #openstack-infra15:37
*** HeOS has quit IRC15:38
*** pkoniszewski has quit IRC15:38
anteayajeblair: I can't wait for your pictures15:39
anteayajeblair: did you see temples?15:39
*** spzala_ has joined #openstack-infra15:39
anteayathe internets say there are lots there15:39
jeblairanteaya: yes indeed.  we visited one that was surrounded by a particularly high number of prayer flags15:41
*** HeOS has joined #openstack-infra15:41
*** spzala has quit IRC15:41
*** spzala_ is now known as spzala15:41
anteayaoh lovely15:41
anteayaI feel vicariously spiritually refreshed just hearing about it15:42
anteayathank you15:42
*** denis_makogon_ has joined #openstack-infra15:44
*** alazarev has joined #openstack-infra15:45
zhiyanfungi: hello, may i ask a quick question, i'm not sure why this failure happened in this test http://logs.openstack.org/54/116654/4/check/check-tempest-dsvm-full-icehouse/16b87c3/logs/devstacklog.txt.gz#_2014-10-08_16_29_39_382 , actually the change passed pep8 and dsvm-full checks. thanks.15:45
*** ramashri has joined #openstack-infra15:45
*** kgiusti has joined #openstack-infra15:47
jeblairfungi: know anything about a storyboard-dev.openstack.org server?15:47
*** otherwiseguy has quit IRC15:48
*** HeOS has quit IRC15:49
zhiyanfungi: oh, i got it. nvm.15:49
*** HeOS has joined #openstack-infra15:49
*** hashar has quit IRC15:50
*** zaphod42 has joined #openstack-infra15:52
*** kashyap has joined #openstack-infra15:52
clarkbjeblair welcome back15:55
*** markmcclain has joined #openstack-infra15:56
fungijeblair: hrm... that doesn't ring a bell15:56
*** doude has quit IRC15:56
jeblairclarkb: thanks!15:56
jeblairfungi: i noticed it's spamming me because it does not have a dns entry15:56
fungijeblair: also seems to be not reachable15:56
fungiaha15:57
fungichecking in our tenant then15:57
jeblairmordred: know anything about a server that thinks it is called storyboard-dev.openstack.org?15:57
*** timrc-afk is now known as timrc15:57
fungijeblair: it's definitely in our openstackci tenant in rackspace15:57
fungi23.253.90.20915:58
jeblairfungi: is there a created date?15:58
*** markmcclain1 has joined #openstack-infra15:58
fungi2014-01-02715:58
fungier 2014-01-2715:58
mordredhrm. didnt we have a storyboard-dev server ages ago?15:58
jeblairmordred: never that i'm aware of.15:59
fungiappears we've had a storyboard-dev server *since* ages ago ;)15:59
*** dkliban_biab is now known as dkliban15:59
fungi(at least 9 months anyway)15:59
*** arxcruz has quit IRC15:59
jeblairit's not in puppet or dns; i think it should be deleted15:59
anteayadid it start spamming as a result of the rax restarts?15:59
fungii'm happy to delete it now15:59
mordredI agree15:59
anteayawas that a week ago?15:59
jeblairanteaya: quite possibly15:59
*** mmaglana has joined #openstack-infra16:00
fungiperhaps it was shut down and got inadvertently activated during the rackspace rolling outage16:00
anteayaa gift for your return16:00
*** markmcclain has quit IRC16:00
fungianyway, deleting now16:00
jeblairanteaya: yes, that cron spam was one gift of many :)16:00
anteayawoooo, everything is excited you are back16:01
*** otherwiseguy has joined #openstack-infra16:02
*** Guest92054 is now known as mgagne16:03
*** markmcclain1 has quit IRC16:03
*** armax has joined #openstack-infra16:03
*** mgagne is now known as mgagne_16:03
*** markmcclain has joined #openstack-infra16:04
*** mgagne_ is now known as Guest3117816:04
mtreinishman we run a lot of tests...16:04
clarkbmtreinish just a few16:04
mtreinishI've been running subunit2sql off the gerrit stream since about midnight and it's already at >2.2 M tempest tests executed16:05
*** gondoi is now known as zz_gondoi16:05
mtreinishincluding a bunch of tests I've never seen before16:05
*** derekh has quit IRC16:05
*** Guest31178 has quit IRC16:05
*** Guest31178 has joined #openstack-infra16:05
*** zz_gondoi is now known as gondoi16:05
*** yamahata has quit IRC16:06
*** todd_dsm has joined #openstack-infra16:06
clarkbneat16:06
*** Guest31178 is now known as mgagne16:07
*** kgiusti has quit IRC16:08
*** yaguang has quit IRC16:08
*** tsg has joined #openstack-infra16:10
*** denis_makogon has quit IRC16:10
*** denis_makogon_ is now known as denis_makogon16:11
*** dmakogon_ has joined #openstack-infra16:11
*** dimtruck is now known as zz_dimtruck16:12
*** kgiusti has joined #openstack-infra16:12
mtreinishclarkb: well they were all from manila and other projects where they're writing tests outside the tempest repo...16:15
clarkbfungi I dont know if you saw but late last night the centos7 image was having boot failures. ianw is debugging (ianw's local image does boot with kvm so currently a bit stumped)16:18
clarkbmay try publishing that inage some how to further aid debugging16:19
fungiclarkb: yeah, saw that in the scrollback16:19
*** ChuckC__ has joined #openstack-infra16:19
*** thedodd has quit IRC16:20
*** garyh has joined #openstack-infra16:20
*** yaguang has joined #openstack-infra16:21
*** cdent has quit IRC16:23
*** thedodd has joined #openstack-infra16:23
*** MaxV has quit IRC16:24
clarkbianw also pinged karanbir late last night but didnt seem to know why that was happening16:25
clarkbapparently the base image we start with is the same as what is used in hpcloud16:26
clarkbso dib may be doing somethibg funny16:26
*** david-lyle has joined #openstack-infra16:26
zaroclarkb, fungi : we really need to update gearman-plugin.  the one currently installed doesn't work.16:26
zaromorning16:27
clarkbzaro huh?16:27
clarkbI thought we decided it does work16:28
clarkband we could not reproduce what hashar saw16:28
*** andreykurilin_ has joined #openstack-infra16:28
fungi(modulo that one eventual consistency bug you were ironing out)16:28
*** zz_dimtruck is now known as dimtruck16:29
*** ChuckC__ has quit IRC16:29
fungioh, right, you determined that was probably just a delay waiting to lock you were seeing?16:29
fungior possibly some sort of event batching in jenkins?16:29
clarkbya event batching16:29
*** kgiusti has quit IRC16:31
*** Guest51022 has quit IRC16:31
*** dkliban is now known as dkliban_biab16:31
clarkbzaro is there a change up somewhere with bugfixes?16:32
clarkbI am happy to upgrade the plugin but need more infoos16:33
*** ChuckC___ has joined #openstack-infra16:33
*** ChuckC___ has joined #openstack-infra16:33
*** yaguang has quit IRC16:33
*** melwitt has joined #openstack-infra16:34
*** patrickeast has joined #openstack-infra16:34
*** kgiusti has joined #openstack-infra16:34
*** ChuckC___ has quit IRC16:34
*** AJaeger has joined #openstack-infra16:35
*** ChuckC__ has joined #openstack-infra16:35
zaroclarkb: i guess we didn't test enough.  i took a closer look and was able to repro.  fix is up, https://review.openstack.org/#/c/125755/16:35
*** otherwiseguy has quit IRC16:35
openstackgerritAaron Rosen proposed a change to openstack-infra/project-config: Congress enable nonvoting py33 test  https://review.openstack.org/12714216:35
zaroclarkb: i think i forgot to test one additional case with that change, changing node labels.  i'll need to do that and fix up hashar's nits16:36
openstackgerritpatrick-crews proposed a change to openstack-infra/config: Adding tripleo-ci files to be indexed by logstash  https://review.openstack.org/10784116:36
clarkbzaro can you also explain somewhere what is broken?16:37
clarkbmy testing indicated saveable listener had not changed16:37
clarkband I spent a lot of time in the jenkins source trying to disprove that16:38
fungior were we always technically broken there but behavior in prior versions merely masked it?16:39
*** jpich has quit IRC16:39
*** shashankhegde has joined #openstack-infra16:39
*** gondoi is now known as zz_gondoi16:39
*** luqas has quit IRC16:40
*** habib has quit IRC16:40
*** ChuckC__ has quit IRC16:40
*** bdpayne has joined #openstack-infra16:40
*** melwitt has quit IRC16:41
*** ChuckC__ has joined #openstack-infra16:41
openstackgerritAaron Rosen proposed a change to openstack-infra/project-config: Congress: enable nonvoting py34 test  https://review.openstack.org/12714216:41
clarkb(that change has changed significantly since I first reviewed it. I will try rereviewing soon)16:41
*** melwitt has joined #openstack-infra16:41
*** zz_gondoi is now known as gondoi16:41
AJaegerclarkb, fungi: What do you think of getting the bashate fixes into the config repo? https://review.openstack.org/#/c/118944/16:41
openstackgerritAaron Rosen proposed a change to openstack-infra/project-config: Congress: enable nonvoting py34 test  https://review.openstack.org/12714216:43
pleia2AJaeger: can I borrow you in an hour or so to ask some questions about how the translations workflow currently works with transifex+ci and stuff? (been looking through some scripts but probably faster just to ask higher level questions)16:43
openstackgerritAnita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config  https://review.openstack.org/12607516:43
openstackgerritAnita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config for nodepool  https://review.openstack.org/12607616:43
openstackgerritAnita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config in tools/  https://review.openstack.org/12607716:43
openstackgerritAnita Kuno proposed a change to openstack-infra/project-config: Rename config => system-config in README  https://review.openstack.org/12608016:43
AJaegerpleia2: sure, shoot...16:44
pleia2AJaeger: in another meeting now, but an hour from now?16:44
AJaegerpleia2: ping me and let's see whether it works ;)16:44
pleia2k :)16:44
*** jgallard has quit IRC16:45
jeblairpleia2: clarkb also has knowledgablenessity about this16:46
fungiAJaeger: i'm not opposed to 118944 but don't have time right now to review hundreds of lines of whitespace changes16:46
*** kgiusti has quit IRC16:46
*** bradjones has quit IRC16:46
*** yaguang has joined #openstack-infra16:46
pleia2jeblair: I asked him yesterday, fungi suggested picking AJaeger's brain16:46
fungii just know AJaeger has written a fleet of recent improvements to it16:47
clarkbI can chat too but will be DMVing in near future16:48
*** HeOS has quit IRC16:48
pleia2clarkb: woo, happy OR license day16:48
zaroclarkb: will do, but basically i could not get some of the events to fire when making changes to projects.  for example creating a new project (from a copy) or updating projects thru the REST API.16:48
AJaegerfungi: understood...16:49
*** kgiusti has joined #openstack-infra16:50
zaroclarkb: also jenkins no longer polls the jobs folder for changes.  if you change config.xml files underneath jenkins won't automatically update with those changes. you need to specifically tell it to reload.16:50
AJaegeranteaya: yes, you need to rename the checks - otherwise the jobs will not work at all16:51
anteayaactually the jobs didn't work when they were renamed16:51
anteayaas I had renamed them in the first patchset16:51
flaper87mmh, for some reason there's no member in the zaqar-milestone group and I, obviously, can't add myself. https://review.openstack.org/#/admin/projects/openstack/zaqar,access16:51
flaper87anyone with enough power can add me to that group?16:51
flaper87please :)16:51
*** johnthetubaguy is now known as zz_johnthetubagu16:52
fungiflaper87: done16:52
AJaegeranteaya: did you rename projects.yaml also? You need to change both files16:52
flaper87fungi: cheers16:52
*** gondoi is now known as zz_gondoi16:52
*** shashankhegde has quit IRC16:53
AJaegerpleia2: see also https://review.openstack.org/126574 - I documented the script a bit better (the common file has much better documentation)16:53
anteayaAJaeger: I'll look at that, I'm trying to stay lightly doing stuff while waiting on electoral things16:54
anteayaso yeah, only giving this about 20% of my attention now16:54
pleia2AJaeger: yes, that was helpful16:55
AJaegerpleia2: but ask - and then let's document further if needed ;)16:55
AJaegerpleia2: We could as well write finally a wiki page with details :)16:56
*** ChuckC__ has quit IRC16:57
*** ChuckC__ has joined #openstack-infra16:57
*** dkliban_biab is now known as dkliban16:58
*** gyee has quit IRC17:01
zaroclarkb: i can't get gearman-plugin on jenkins-dev to connect to zuul-dev.o.o17:03
zaroclarkb: i see that there's a gearman process running on zuul-dev but i can't seem to telnet to it.17:03
*** kgiusti has quit IRC17:04
*** zns has quit IRC17:04
*** _nadya_ has quit IRC17:04
*** andreaf has joined #openstack-infra17:05
*** jlibosva has quit IRC17:05
*** jp_at_hp has quit IRC17:07
fungizaro: seems to be listening only on :: not 127.0.0.117:07
fungizaro: i can 'nc :: 4730' and get a socket, but 'nc 127.0.0.1 4730' seems to be refused17:07
*** kgiusti has joined #openstack-infra17:08
*** salv-orlando has joined #openstack-infra17:08
mordredfungi: who needs 127.0.0.1 when you have :: ?17:09
fungimordred: indeed17:10
jedimike:: always makes me think, "haha, a static ip!"17:10
* jedimike slinks away into bad joke corner17:10
pleia2AJaeger: ok, around now, I'm going to start with the stupid questions :) this page is horrible and doesn't actually tell me what projects even have translations, help! https://www.transifex.com/projects/p/openstack/17:11
pleia2I guess I need to sign up for an account?17:11
*** tsg has quit IRC17:11
fungizaro: looks like the configuration may be in need of updating. the gearman status shows no workers at all, not even the merger (which is also running). i even stopped them and started them again17:11
*** tsg has joined #openstack-infra17:11
*** ryanpetrello has joined #openstack-infra17:11
*** koolhead17 has joined #openstack-infra17:11
zarofungi: yeah, it's because the gearman plugin isn't connected to gear server on zuul-dev.  connection is refused17:12
*** tonytan4ever has quit IRC17:12
openstackgerritpatrick-crews proposed a change to openstack-infra/config: Adding tripleo-ci files to be indexed by logstash  https://review.openstack.org/10784117:12
fungizaro: oh, for that matter, the zuul-server process has a defunct child from immediately after i started it. looking in its logs now17:12
*** zns has joined #openstack-infra17:13
fungizaro: and the logs are empty17:13
*** kgiusti has quit IRC17:14
*** habib has joined #openstack-infra17:14
fungizaro: so, yeah, probably the config/layout haven't kept pace with changes in master and need to be revisited17:14
*** habib has quit IRC17:14
*** habib has joined #openstack-infra17:15
*** gyee has joined #openstack-infra17:15
AJaegerpleia2: I'm ready as well.17:16
AJaegerlet me check the transifex page.17:17
pleia2thanks17:17
*** zns has quit IRC17:18
*** kgiusti has joined #openstack-infra17:18
AJaegerpleia2: use https://www.transifex.com/organization/openstack17:18
zarothanks fungi, i'll look into updating the puppet so gear server will work again.17:18
AJaegerthat should work without an account.17:18
pleia2oh, there we go!17:19
*** Ryan_Lane has joined #openstack-infra17:19
AJaegerpleia2: Let's go one step back: What's the background of the questions? What is your goal?17:19
*** harlowja_away is now known as harlowja17:19
*** shashankhegde has joined #openstack-infra17:19
pleia2AJaeger: right, so we're looking to replace transifex (hopefully next cycle) so I need to understand how we're doing things now so I can understand what I need to focus on with pootle and zanata functionality17:19
*** ChuckC__ has quit IRC17:19
*** bswartz has quit IRC17:20
*** unicell has quit IRC17:20
AJaegerpleia2: finally ;) I'm aware of those efforts17:20
pleia2we have pootle and zanata demos up now, but evaluation has kind of stalled because I don't have great instructions for the translators about how they can evaluate them17:20
AJaegerWhat do you think of using this etherpad https://etherpad.openstack.org/p/transifex - and documenting everything there17:20
pleia2wfm17:20
AJaegershall we use the etherpad chat, then?17:21
*** zns has joined #openstack-infra17:21
*** arosen1 has joined #openstack-infra17:21
pleia2k17:21
jedimikewe're getting hit by https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1379201 when building new nodepool images, can't compile openvswitch module, anyone here seen that before?17:21
*** maxbit has quit IRC17:21
uvirtbotLaunchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed]17:21
j^2So i’m seening a lot of merge conflicts in openstack-chef; but all the error says is “Patch in Merge Conflict” and no link to see the conflict. Is there a way to see whats broken?17:21
arosen1Hi, anyone hitting this error today? http://paste.openstack.org/show/119948/ I'm wondering if it's related to having python-six installed from packages and pip (and my system is using six from packages). Jenkins upstream though has python-six installed as a packages too though.17:22
*** maxbit has joined #openstack-infra17:22
*** jgallard has joined #openstack-infra17:22
clarkbj^2 you can run the rebase locally17:22
clarkbgit rebase -i origin/master17:23
j^2should i abandon the review then? or if i push up another review would it get out of that state?17:23
*** alexpilotti has joined #openstack-infra17:23
clarkbpush a new patch with conflicts resolved17:23
j^2clarkb: rock on, thanks!17:23
arosen1hrm i moved six.py from /usr/lib/python2.7/dist-packages on my box so the one from pip is used and that fixes the issue.17:27
arosen1it seems like the depenency of python-debian and six prevent us from really uninstalling it unless we use some nodeps option17:28
fungiarosen1: running in a virtualenv with ststem site-packages enabled i take it?17:29
fungier, system site-packages17:29
ameademtreinish: Hey, i'm trying to override the value for OS_TEST_TIMEOUT in our CI system but devstack-gate does not pass along environment variables into the tox command17:30
ameademtreinish: so it continues to use the default in tempests .testr.conf17:30
ameademtreinish: Right now I have a crazy hack in local.conf to get around it but I'm wondering if there is a better way17:30
*** baoli has quit IRC17:31
*** achanda has joined #openstack-infra17:32
*** baoli has joined #openstack-infra17:32
*** unicell has joined #openstack-infra17:32
arosen1fungi:  this is an issue i hit with the python-openstackclient; devstack just does sudo python setup.py develop; and just runs it like that; so i'm supprised we don't hit this in the gate either.17:32
*** todd_dsm has quit IRC17:32
*** jgallard has quit IRC17:32
vishydo we have any statistics on how long a single recheck takes on average and how long a single reverify takes on average?17:34
*** yfried has joined #openstack-infra17:34
fungijogo: ^ ?17:34
clarkbvishy test time is captured in graphite17:34
*** dimtruck is now known as zz_dimtruck17:35
clarkbbut not time from comment to comment17:35
fungimy guess is he's asking whether anyone has run time series analysis or anything17:35
vishybecause according to jogo’s email we have about 5 rechecks per patchset17:35
fungihuh? looked like he said average was ~0.7 rechecks per patchset17:35
*** habib has quit IRC17:35
clarkbbest case is about 50 minutes. worst case depends on day17:35
fungiunless i misread his e-mail17:35
*** jcoufal has quit IRC17:35
*** habib has joined #openstack-infra17:36
clarkbfungi that is how I read too17:36
*** tty57 has quit IRC17:36
vishyfungi: it said per revision17:36
vishyunless he misstated17:36
fungivishy: oh, you're multiplying by the average patchset count per change17:36
clarkbpatchset == revision17:36
fungigot it17:36
vishyaye17:36
vishyok 5 rechecks per change before merge17:37
fungion average for nova over the course of the past 6 months, sounds like17:37
*** achanda has quit IRC17:37
clarkbyup. and doesnt account for blind rechecks but thats fine17:37
vishyso that is 8700+ hours spent in rechecks over the past 6 months17:38
fungithose are likely statistically insignificant anyway17:38
vishyjust for nova17:38
fungi(the blind rechecks i mean)17:38
vishyQQ17:38
clarkbfungi no they are very significant17:38
fungioh?17:38
clarkbI think blind rechecks are majority of rechecks17:38
*** habib has quit IRC17:38
fungiinteresting17:38
vishyby blind you mean a recheck when we don’t know what the source of the bug is?17:38
fungii assumed you meant rechecking just to see if a change had regressed17:39
clarkbvishy no I mean dev didnt debug -1 at all17:39
clarkbjust rechecked17:39
mtreinishameade: hmm, yeah getting an env variable passed on the way down get's tricky17:39
fungiclarkb: oh, his methodology did try to account for that17:39
clarkbfungi it did?17:39
fungiclarkb: he ignored rechecks where at least one of the same jobs failed on the subsequent run17:39
mtreinishameade: I thought there was a way to get env variables shared by the tox env17:39
mtreinishclarkb: ^^^ do you remember?17:39
clarkboh cool I missed that17:39
ameademtreinish: I know how we can make it work but not sure that is the answer17:40
ameademtreinish: we just add -E to the sudo command17:40
clarkbmtreinish the issue is d-g does not pass env through sudo17:40
fungivishy: so, yes, that estimate doesn't sound especially surprising17:40
*** ivar-lazzaro has joined #openstack-infra17:40
mtreinishah, ok17:40
*** SumitNaiksatam has quit IRC17:40
fungivishy: particularly if taken in context as percentage of overall time spent running jobs17:40
*** akerr has joined #openstack-infra17:41
fungiwhich i would guess is somewhere around an order of magnitude higher17:41
clarkbpep8 failed resulting in recheck happens way more than you expect :( but if jogo filtered that that is great17:41
fungibut having numbers around that too would help17:41
fungivishy: hopefully that is time spent by developers hacking on all their other changes in parallel though, not sitting on their thumbs because they work on only one thing at a time17:42
*** bradm has quit IRC17:43
clarkbhrm need to clarify with jogo17:45
*** katyafervent is now known as katyafervent_awa17:45
*** tonytan4ever has joined #openstack-infra17:46
*** otherwiseguy has joined #openstack-infra17:46
openstackgerritJaime Flynn proposed a change to openstack-infra/jenkins-job-builder: Added flexible publish support  https://review.openstack.org/12730017:50
*** amcrn has joined #openstack-infra17:53
jogoclarkb: ?17:53
*** dkliban is now known as dkliban_brb17:55
clarkbjogo was hoping you might have collected numbers on the rechecks you excluded17:55
clarkbmaybe broken out by job too17:55
jogoclarkb: ahh17:56
jogoI didn't break out by job, but that would be easy to do17:56
jogomost rechecks are valid though17:56
jogovalid == the failed jobs before don't show up after17:56
clarkbok17:56
clarkbI think that contradicts what sdague found in the past which maybe means we are getting better17:57
jogoclarkb: I have some data for you, one moment17:57
*** tgohad has joined #openstack-infra17:58
*** baoli has quit IRC17:59
*** baoli has joined #openstack-infra17:59
*** lnxnut has quit IRC18:00
*** SumitNaiksatam has joined #openstack-infra18:00
*** mattoliverau has quit IRC18:00
*** jhesketh has quit IRC18:00
*** mattoliverau has joined #openstack-infra18:01
*** tsg has quit IRC18:01
*** jhesketh has joined #openstack-infra18:02
*** amcrn has quit IRC18:02
*** zz_dimtruck is now known as dimtruck18:02
*** mfink has joined #openstack-infra18:03
*** andreykurilin_ has quit IRC18:04
*** _nadya_ has joined #openstack-infra18:04
j^2is this a known issue? fatal: unable to connect to git.openstack.org  ?18:05
*** baoli has quit IRC18:05
*** rainya has quit IRC18:05
j^2for reviews18:05
j^2sorry forgot to put that in18:05
pleia2j^2: we see it sometimes, bug 135298718:06
uvirtbotLaunchpad bug 1352987 in openstack-ci "fatal: unable to connect to git.openstack.org:" [Medium,Triaged] https://launchpad.net/bugs/135298718:06
fungij^2: i don't know what you mean by "for reviews"18:06
j^2pleia2: nice thanks18:06
j^2fungi: our reviews when attempting to merge are failing on unable to connect18:06
fungij^2: care to link to an example?18:07
fungij^2: you mean the jobs run on them after they're approved sometimes fail with that error?18:07
*** baoli has joined #openstack-infra18:08
*** derekh has joined #openstack-infra18:08
j^2fungi: http://logs.openstack.org/08/124808/1/gate/gate-cookbook-openstack-telemetry-chef-unit/7017e64/console.html18:08
*** andreaf has quit IRC18:08
*** rainya has joined #openstack-infra18:08
*** che-arne has quit IRC18:09
fungij^2: ahh, yep, looks like a dns resolution error on a worker in rackspace dfw18:09
fungij^2: did you witness a rash of these recently?18:09
*** denis_makogon has quit IRC18:09
pleia2AJaeger: you are AMAZING, thank you so much for taking the time to document this with me today :)18:09
j^2fungi: yep, more or less all morning18:09
fungiick18:10
pleia2(wiki page incoming, it will be awesome)18:10
fungirunning some correlations now18:10
j^2fungi: awesome thanks :)18:10
AJaegerpleia2: you're asking great questions - and documenting this was overdue...18:10
*** dkliban_brb is now known as dkliban_errand18:11
jogoclarkb: http://paste.openstack.org/show/119955/18:11
vishyfungi: obviously people can multitask but I think a big part of the slow review process is because we can’t do these things quickly. It makes the back and forth between reviewers and patch submitters take exponentially longer because you can’t go back and forth multiple times quickly. People lose track of things because of the long cycle times.18:12
SergeyLukjanovjeblair, hey!18:12
fungij^2: yep, there have definitely been a higher number of those today than over the preceding week, and all in rackspace18:12
jogoclarkb: that list stops at the first failure before and after18:12
j^2fungi: lovely, should we hold off and then do recheck no bug on anything effected by it?18:12
j^2like in a few hours?18:13
fungivishy: i totally agree with that. hopefully as devs start to focus more on fixing the bugs causing most of that the situation will improve dramatically18:13
*** baoli has quit IRC18:14
vishyfungi: yes fixing gate bugs and removing unnecessary gating tests18:14
fungij^2: not sure... i'm looking to see if rackspace is admitting to any ongoing issues today with their networks18:14
j^2kk18:14
vishyhopefully we can make some serious progress on that during the kilo cycle18:14
clarkbjogo stops at the first one?18:14
*** dizquierdo has quit IRC18:14
jogoclarkb: first failed job18:15
jogoso if py26 and 27 failed it only shows 26718:15
jogo2618:15
mtreinishjogo: ah, ok that explains all the unit test failures. I was going to say that people recheck on the unit tests way more.18:15
jogojust fixed and re-running18:15
clarkbjogo oh gotcha first per recheck18:16
fungij^2: nothing of note posted on status.rackspace.com but it does look like it's improved dramatically in the past couple hours18:16
j^2fungi: cool cool, thanks for the update18:16
clarkbfungi maybe unbound broke again?18:16
fungiclarkb: maybe. now that you mention it, seems to be all precise nodes18:17
*** pelix has quit IRC18:17
fungiclarkb: though it's possible that the error message git provides has changed between precise and trusty and so my search is being too specific18:17
*** HeOS has joined #openstack-infra18:17
*** kgiusti has quit IRC18:18
fungiclarkb: also not really hitting devstack, mostly just bare and py3k18:19
clarkbhuh18:19
*** amcrn has joined #openstack-infra18:20
*** achanda has joined #openstack-infra18:20
fungii grabbed a random bare-precise node in rax-iad and can resolve git.openstack.org from the command line on it fine though18:20
*** achanda has quit IRC18:20
*** kgiusti has joined #openstack-infra18:21
fungirepeated the same commands being run in the example failure log and got no errors. working as designed18:22
fungiso whatever it is, it's intermittent or has since ceased18:22
*** achanda has joined #openstack-infra18:23
fungialso resolv.conf and unbound configuration look correct18:24
mtreinishameade: yeah, so I expect there is probably a good reason that we don't pass the env through sudo18:24
fungiclarkb: i'm going to guess it's random udp datagram loss through some part of their network18:25
mtreinishbut if there isn't, then I suppose that's a change you could propose18:25
*** achanda has quit IRC18:25
clarkbthere is18:25
fungimtreinish: ameade: by default sudo sanitizes the calling environment because not doing so is a security risk18:25
clarkbwe donr want to make d-g a dependency of tempest18:25
clarkbthis has come up before18:26
openstackgerritJaime Flynn proposed a change to openstack-infra/jenkins-job-builder: Added flexible publish support  https://review.openstack.org/12730018:27
mtreinishclarkb: ok, yeah I think I remeber that now that you said it18:27
*** e0ne has joined #openstack-infra18:28
AJaegerpleia2: please check https://wiki.openstack.org/wiki/Translations/Infrastructure - I've added markup and add some more text18:28
AJaegerpleia2: over to you for any polishing you like to do - or extra questions...18:29
ameadeclarkb, mtreinish: I'm not clear on how that makes d-g a dependency for tempest18:29
pleia2AJaeger: thanks, I'll add some links to scripts on git.o.o too in order to help people find their way18:30
clarkbameade it is not a direct dependency but allows you to do what you are trying to do. then you must always override tempest defaults18:30
clarkbat that point you are dependent on d-g or sonethibg else to properly configure your environment18:30
*** dustins has quit IRC18:31
AJaegerpleia2: Great!18:32
jogoclarkb: http://paste.openstack.org/show/11996718:32
jogonow with all failed jobs18:33
*** dustins has joined #openstack-infra18:33
jogoa lot of py26 jobs18:33
AJaegerpleia2: Let's enhance the bot so that it includes a link to the wiki page - might help the projects to understand what's going on...18:33
AJaegerpleia2: I'll send an email to the i18n mailing list to inform them about the page...18:33
jogomtreinish: ^18:33
pleia2AJaeger: sounds good18:34
*** kashyap has quit IRC18:34
mtreinishjogo: yeah it's still looks like mostly unit tests18:35
openstackgerritYathiraj Udupi proposed a change to openstack/requirements: Add kafka-python dependency needed for ceilometer kafka publisher  https://review.openstack.org/12730918:36
*** achanda has joined #openstack-infra18:36
*** dkliban_errand is now known as dkliban18:38
jogomtreinish: yeah18:38
jogothat is for nova btw18:39
clarkbjogo is it the same 800 change span?18:39
*** mrmartin has quit IRC18:39
jedimikebit of a warning here: precise upgraded the kernel from 3.2.0-69 to 3.2.0-70, if you upgrade, your openvswitch installation will stop working18:41
*** achanda has quit IRC18:41
*** kgiusti has quit IRC18:42
anteayajedimike: good warning18:42
jedimikehttps://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1379201 is open for it with the symptom and cause18:42
uvirtbotLaunchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed]18:42
jogoclarkb: that was 1600 or so changes I think, all in nova last 6 months18:44
*** derekh has quit IRC18:44
openstackgerritA change was merged to openstack-infra/project-config: Congress: enable nonvoting py34 test  https://review.openstack.org/12714218:44
jogoand not sure what the exact number of patch revisions is18:44
*** achanda has joined #openstack-infra18:44
jogobut a lot18:45
*** achanda has quit IRC18:45
jedimikeanteaya, it's been causing us headaches today with devstack testing, doesn't look like there's much option but to pin the older kernel for now18:45
*** kgiusti has joined #openstack-infra18:46
*** andreaf has joined #openstack-infra18:47
*** e0ne has quit IRC18:48
*** spzala has quit IRC18:50
anteaya:(18:52
clarkbjedimike upgrade to trusty18:52
*** dprince has quit IRC18:52
*** otter768 has joined #openstack-infra18:52
pleia2AJaeger: I can't find this (or anything named similarly): "openstack-generate-doc-book (part of openstack-doc-tools repository)"18:53
jedimikeclarkb, yes, I'd very much like to :)18:53
AJaegerpleia2: openstack-doc-tools/os_doc_tools/handle_pot.py is the file and when you run python setup.py install, a script openstack-generate-doc-book is created (see the setup.cfg file)18:54
pleia2AJaeger: aha, I'll edit to make that more clear18:54
bookwarwe'd like to add some functionality to docimpact tag handling, can someone direct me to the source code for this hook? search for docimpact on github didn't show anything useful18:56
*** kgiusti has quit IRC18:57
AJaegerbookwar: it's in jeepby18:58
AJaegerbookwar: jeepyb/jeepyb/cmd/notify_impact.py18:58
*** rushiagr is now known as rushiagr_away19:00
*** achanda has joined #openstack-infra19:00
*** ChuckC__ has joined #openstack-infra19:00
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Script to generate a unique address list for ATCs  https://review.openstack.org/12731519:00
fungianteaya: tristanC: ^ that may be helpful19:01
*** kgiusti has joined #openstack-infra19:01
fungianteaya: tristanC: i'm including its output along with the normal csv file dump in an e-mail to you in moments19:01
pleia2AJaeger: so is tools/generatepot similar to openstack-generate-docbook, and so both would actually land in tools/ and be called openstack-generate-pot & openstack-generate-docbook respectively?19:01
*** achanda has quit IRC19:02
*** akerr is now known as akerr_away19:02
*** akerr_away is now known as akerr19:02
AJaegerpleia2: the goal was to move tools/generatepot to openstack-doc-tools but the final step is missing...19:02
AJaegertools/generatepot is openstack-generate-pot19:02
pleia2hm, so is openstack-generate-docbook actually tools/generatedocbook ?19:03
*** akerr has left #openstack-infra19:03
AJaegerpleia2: there's no tools/generatedocbook anymore but previously it was the same19:03
pleia2gotcha19:03
*** jedimike has quit IRC19:04
anteayafungi: nice job on the comments in there19:04
pleia2ok, https://wiki.openstack.org/wiki/Translations/Infrastructure is prettified with links19:04
anteayalike following the bouncing ball in kids sing-a-long videos19:05
anteayamy kind of comments19:05
fungianteaya: yeah, it's more a demonstration with some code than a serious piece of software19:05
anteayaI like it19:05
fungianteaya: that was driven out of making sure the extra-atcs don't get extra-votes ;)19:06
anteayawhich script removes jenkins and the openstack lists?19:06
anteayathank you!19:06
fungianteaya: that would still be a manual removal19:06
*** dustins has quit IRC19:06
anteayaokay, I would have looked for it anyway19:06
anteayabut good to know19:06
bookwarAJaeger: ia it ok to add "[doc]" tag to the bug title? we'd rather make it configurable, but i am not sure if you let us put this much configuration into project.yaml :)19:06
AJaegerpleia2: thanks!19:06
bookwars/ia/is19:07
AJaegerbookwar: please talk with annegentle19:07
fungianteaya: and it's just those two addresses which jump out at me, skimming the list for anything matching 'openstack\.org' which i don't already know to correspond to an actual human being19:07
anteayagreat19:08
*** mwagner_lap has quit IRC19:08
anteayaI'll look as well but yes, those two are on my radar19:08
anteayahopefully we don't have others19:09
fungianteaya: ideally we would code review an additional list somewhere of these which the script also pulls in, call it "robot-atcs" or something like that. i just wouldn't hard-code those contributor addresses into any of the tooling19:09
*** jcoufal has joined #openstack-infra19:10
*** dustins has joined #openstack-infra19:11
*** otter768 has quit IRC19:12
*** wenlock has quit IRC19:13
openstackgerritAdam Gandelman proposed a change to openstack-infra/project-config: Run sideways ironic greande only on juno branches  https://review.openstack.org/12731919:13
anteayafungi: that sounds like an idea19:14
*** dkliban is now known as dkliban_brb19:15
*** spzala has joined #openstack-infra19:15
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap  https://review.openstack.org/12710619:15
*** shashankhegde has quit IRC19:18
*** annegent_ has joined #openstack-infra19:20
*** sgordon_ has quit IRC19:20
*** hashar has joined #openstack-infra19:22
pleia2jogo: are you in town next week? doing an e-r lightning talk at the summit and could use some slide review (when I write them), could do online if not19:24
*** ChuckC__ has quit IRC19:24
openstackgerritAdam Gandelman proposed a change to openstack-infra/project-config: Adds ironic grenade forward testing  https://review.openstack.org/12732119:26
*** radez is now known as radez_g0n319:26
*** atiwari has quit IRC19:26
*** ramashri has quit IRC19:27
fungianteaya: tristanC: rolls have been sent to you19:27
*** annegent_ has quit IRC19:27
fungitasty, hot, buttery electorate rolls19:27
*** afazekas has quit IRC19:28
fungii think the next iteration on the email_stats.py script should leverage gerrit's rest api rather than relying on a database dump... i think that's actually doable, and should make it possible for anyone to generate the same information without assistance19:29
anteayafungi: yum electoral rolls19:31
anteayaI'm still editing the wikipage19:31
anteayaonce i finish I will move to going over the rolls and thank you19:31
anteayaoooohhhh19:31
anteayathat sounds like a good direction19:32
anteayathe might also free you up on the creation end19:32
anteayathough I would still verify with you19:32
fungii could even have it output a cryptographic checksum of the data we could record for reference19:32
anteayathat would be great19:32
anteayaall offical like19:33
*** otter768 has joined #openstack-infra19:33
fungii'll noodle on that... it's a few months before i need to worry about it again, i hope (so long as no one abdicates easry)19:33
fungis/easry/early/19:33
anteayai hope the same19:35
*** kgiusti has quit IRC19:35
*** ChuckC__ has joined #openstack-infra19:35
*** ociuhandu has quit IRC19:37
*** jamespage_ has joined #openstack-infra19:37
*** kgiusti has joined #openstack-infra19:37
*** jamespage_ has quit IRC19:38
*** e0ne has joined #openstack-infra19:39
*** otter768 has quit IRC19:45
*** ramashri has joined #openstack-infra19:47
*** david-lyle is now known as david-lyle_afk19:47
*** dimsum_ has quit IRC19:48
*** ChuckC__ has quit IRC19:48
*** bradm has joined #openstack-infra19:51
*** MaxV has joined #openstack-infra19:53
*** ivar-laz_ has joined #openstack-infra19:55
*** Longgeek has quit IRC19:55
*** datsun180b has quit IRC19:57
*** andreykurilin_ has joined #openstack-infra19:57
*** ivar-lazzaro has quit IRC19:57
*** maxbit has quit IRC19:59
*** dvorak has quit IRC20:02
*** med_` is now known as med20:02
stevemarsomething going on with check-tempest-dsvm-neutron-icehouse ?20:02
*** med is now known as med_20:02
AJaegerpleia2: thanks for mkaing the wiki page nice!20:03
*** med_ is now known as Guest2028920:03
*** Guest20289 is now known as medberry_cant20:03
stevemarsomething alone the lines of 'connection to /var/run/openvswitch/db.sock failed'20:03
anteayaokay done the latest pass: https://wiki.openstack.org/wiki/TC_Elections_October_2014#Responses_to_TC_Election_Questions20:05
anteayaI hope folks are reading as we go along20:05
anteayagetting hefty20:05
*** shashankhegde has joined #openstack-infra20:06
jogopleia2: yeah I'll be in town next week20:06
jogopleia2: we can do f2f20:06
anteayaas usual, if anyone spots an error of fact or an omission let me know so I can fix20:06
anteayaI'm going to take a walk now and will be back in a few hours20:06
*** kgiusti has quit IRC20:08
*** fifieldt has quit IRC20:08
*** medberry_cant is now known as medberry20:09
*** medberry is now known as Guest2811420:09
*** r1chardj0n3s_afk is now known as r1chardj0n3s20:10
*** kgiusti has joined #openstack-infra20:13
*** jcoufal has quit IRC20:13
*** ivar-laz_ has quit IRC20:15
*** jamespage_ has joined #openstack-infra20:17
pleia2AJaeger: sure thing :)20:17
*** jamespage_ has quit IRC20:17
pleia2jogo: great20:17
*** dvorak has joined #openstack-infra20:17
*** zns has quit IRC20:18
*** esker has quit IRC20:18
fungistevemar: you could search on logstash.openstack.org for that to see if it's common and whether it happens on successful runs as well as failures. if it's common you could try spotting a likely bug on the elastic-recheck page20:19
stevemarfungi, i checked ER page, nothing really came up20:20
*** e0ne has quit IRC20:21
*** fifieldt has joined #openstack-infra20:21
*** e0ne has joined #openstack-infra20:21
fungistevemar: looks very bursty on the 7-day graph in logstash20:22
jogocan someone remove my from sqlalchemy-migrate-core20:23
jogoremove me from*, gerrit won't let me do it20:23
*** tonytan4ever has quit IRC20:23
openstackgerritSpencer Krum proposed a change to openstack-infra/puppet-storyboard: Integration Testing  https://review.openstack.org/12608620:24
*** leifmadsen has quit IRC20:24
fungijogo: done20:24
stevemarfungi, i've had 3 of the same error in the last hour or so20:24
stevemar'ERROR neutron.agent.linux.ovs_lib [-] Unable to retrieve bridges. Exception'20:24
stevemarhttp://logs.openstack.org/75/126475/6/check/check-tempest-dsvm-neutron-icehouse/aa130cc/logs/devstacklog.txt.gz, http://logs.openstack.org/11/126111/3/check/check-tempest-dsvm-neutron-icehouse/b8b6eb6/logs/devstacklog.txt.gz and http://logs.openstack.org/08/126108/6/check/check-tempest-dsvm-neutron-icehouse/1c77c29/logs/devstacklog.txt.gz20:24
jogofungi: thanks20:25
stevemarlet me check log stash for that one20:25
clarkbcould that be related to the thing jedimike pointed out?20:25
*** unicell has quit IRC20:26
fungistevemar: digging in logstash, it cropped up in the icehouse backward-compat jobs for changes on master with the first occurrence at 17:07 utc today20:26
fungistevemar: before that, we saw similar errors in tripleo jobs on the 5th, but nothing between then and when this cropped up a few hours ago20:26
stevemarseems suspicious -_-20:27
fungistevemar: clarkb: yes, sounds very much like what jedimike mentioned above20:27
fungistevemar: bug 137920120:28
uvirtbotLaunchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] https://launchpad.net/bugs/137920120:28
*** baoli has joined #openstack-infra20:28
*** baoli has quit IRC20:28
*** leifmadsen has joined #openstack-infra20:28
*** leifmadsen has quit IRC20:28
*** leifmadsen has joined #openstack-infra20:28
stevemarfungi, silly question, how did you find the bug? it's not on the ER page20:28
*** e0ne has quit IRC20:28
fungiclarkb: should i delete all today's precise devstack images?20:28
*** baoli has joined #openstack-infra20:28
clarkbfungi I dont think so. it will just break again20:29
fungistevemar: jedimike linked it earlier. it's not an openstack bug and nobody's added it to e-r20:29
clarkbwe need a proper fix20:29
clarkbmaybe nodepool script kernel pin?20:29
clarkbthen rebuild?20:29
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard: Consolidated functional test data bootstrap  https://review.openstack.org/12710620:29
*** tonytan4ever has joined #openstack-infra20:29
fungithough i guess we could also add an effects task on openstack neutron20:29
stevemarohhh, I'll try to add it to e-r?20:30
stevemarminus the ?20:30
fungistevemar: go for it20:30
fungii've added neutron to that bug, for tracking purposes20:31
openstackgerritKhai Do proposed a change to openstack-infra/gearman-plugin: update to work with Jenkins LTS ver 1.565.3  https://review.openstack.org/12575520:31
zaroclarkb, hashar: ^20:32
*** zns has joined #openstack-infra20:34
*** otherwiseguy has quit IRC20:34
*** alexpilotti has quit IRC20:35
hasharzaro: hi!  I hope my comments earlier today made some sense20:36
hasharzaro: I don't know Java at all nor do I know about the jenkins api / architecture :(20:36
*** HeOS has quit IRC20:38
zarohashar: yes, thanks for reviewing. i just replied to your comments.  i'm not sure how we are currently getting it to work in our env.20:38
*** rainya has quit IRC20:38
zarohashar: maybe it's because we build our slaves only daily and build them fresh every time :)20:39
*** DuncanT- has quit IRC20:41
*** DuncanT- has joined #openstack-infra20:43
*** koolhead17 has quit IRC20:43
fungijhesketh: mikal: if either if you are around yet, turbo-hipster went off the rails when i deleted nova's stable/havana branch earlier today20:45
*** vhoward has left #openstack-infra20:45
hasharzaro: you also commented about different testing scenarios.  Can they be made actual tests or is that too much hassle?20:46
*** _nadya_ has quit IRC20:48
*** esker has joined #openstack-infra20:50
hasharzaro: will read the new patch tomorrow and might well give it a try on monday (it is holiday in US apparently so that is convenient)20:50
zarohashar: well.  i know the code to register functions works and we do have tests for that.  it's the jenkins events that stopped working as expected so would i be testing the event system?20:51
stevemarfungi, silly question, whats the syntax of the search for logstash? (project and build status)20:51
zarohashar: what? i didn't there was a holiday!  you french know more about us than we do :)20:52
fungistevemar: i usually just search on the failure message and then add columns for things like project and build status to get a quick birds-eye view for sanity20:52
fungistevemar: but the syntax is lucene http://www.lucenetutorial.com/lucene-query-syntax.html20:53
*** david-lyle_afk is now known as david-lyle20:53
stevemarfungi, ah okay like gerrit20:53
fungiyep20:53
hasharzaro: oh miight be mistaken :]20:53
zarohashar: just checked, columbus day.  not really a holiday, not one anybody has to stop working for anyways.20:54
*** pcm__ has quit IRC20:54
hasharzaro: ah we refer to it as IIndigenous People's Day :D20:54
hasharzaro: got it for testing the event system. Probably not much that can be done on that front20:55
stevemarfungi, OK now i'm getting somewhere :)20:55
fungiwe celebrate the hegemony of barbaric imperialist invaders subjugating native peoples everywhere20:55
mtreinishzaro: I'm taking Monday off :)20:55
stevemarTIL log stash20:56
zaromtreinish: celebrating with the indigenous people?20:56
*** rainya has joined #openstack-infra20:56
mriedemwe probably shouldn't even have a pep8 job for sqlalchemy-migrate:20:57
mriedemhttp://logs.openstack.org/17/121517/6/check/gate-sqlalchemy-migrate-pep8/f73fe21/20:57
mriedemthe project has rejected patches to get pep8 to pass20:57
mtreinishheh, no just taking a few days off. It just happened to be columbus day20:57
stevemaryou can become canadian for a day and celebrate canadian thanksgiving on monday20:57
fungii can't think of a better reason to be canadian for a day20:58
*** jcoufal has joined #openstack-infra20:58
*** AJaeger has quit IRC20:59
openstackgerritSteve Martinelli proposed a change to openstack-infra/elastic-recheck: Add query for bug 1379201  https://review.openstack.org/12734621:00
uvirtbotLaunchpad bug 1379201 in openvswitch "openvswitch-datapath-dkms 1.4.6-0ubuntu1.12.04.3: openvswitch kernel module failed to build" [Undecided,Confirmed] https://launchpad.net/bugs/137920121:01
stevemaryay my first ER commit (maybe)21:01
*** bhunter71 has quit IRC21:01
*** dustins has quit IRC21:01
ianwclarkb: hey, as you noticed, no repo ... i rebuilt my images using build-image.sh and it boots OK with kvm locally21:01
ianwclarkb: so two things, first are there any logs of the build available21:02
ianwclarkb: and two, if we can get the built image somewhere public, i can import that fairly quickly into an openstack instance and see if it happens there21:03
clarkbianw yes publicly too at http://nodepool.openstack.org21:03
clarkbfungi ^ thoughts on how to publish a 2.9GB image?21:03
clarkbI am currently at deq so hard for me to do that21:04
*** otherwiseguy has joined #openstack-infra21:04
*** julim has quit IRC21:04
*** markmcclain has quit IRC21:05
waynranyone have advice for setting variables in a shell script but also allowing that script to contain '{}' characters? (jenkins-job-builder)21:06
clarkbwaynr escape the {}s by doubling them up21:07
clarkbso {} becomes {{}}21:07
waynrclarkb: thanks21:07
clarkbianw find the logs?21:07
ianwclarkb: yep, thanks, should have realised they were there ... old centos7 images did have a separate partition for /boot, which seems involved.  digging to see if something related21:08
ianwclarkb: yeah "Using locally cached http://buildlogs.centos.org/centos/7/cloud/CentOS-7-Broken-20140620-Nightly.qcow2"21:11
ianwclarkb: is d-i-b on nodepool updated?21:11
*** chianingwang has joined #openstack-infra21:11
clarkblol "broken"21:11
clarkbit isnt latest dib. iir21:11
clarkbI can fix that later21:11
ianwclarkb: yeah, i think that's the issue21:11
clarkbok thanks21:11
clarkbwe need an explicit install for it then21:12
clarkbright now nodepool gets it as a dep21:12
clarkbianw you can write that change if you like21:12
clarkbor I can in a bit21:12
clarkbabout to get car registered in a new state21:13
ianwclarkb: at vmware, the main build spits out "esx-broken-foo" ... but it was short for "broken-out" as it was split out of something else once and stuck.  caused constant confusion21:13
*** andreykurilin_ has quit IRC21:13
ianwclarkb: ok, i'll have a look now21:13
fungiclarkb: we probably ought to publish images on swift with cdn fronting, ideally21:13
*** ivar-lazzaro has joined #openstack-infra21:14
fungiclarkb: given they're large and relatively static21:14
*** zul has quit IRC21:14
*** HenryG has quit IRC21:14
clarkbfungi++ that is an excellent idea21:14
ianwfungi / clarkb : happy to have a look at that in short-term future21:15
*** ayoung is now known as ayoung-afk21:16
fungiclarkb: ianw: also if our service providers had a mechanism by which we could mark those images we upload public, then we could also publish the latest uuids for them as a convenience (so users of those providers don't have to download and reupload them to use them). no idea if that's even remotely possible though21:17
*** jgrimm is now known as zz_jgrimm21:17
fungiin glance itself, i mean21:17
clarkbhpcloud does but you need extra bits like canonical have iirc21:18
*** homeless has quit IRC21:18
*** zul has joined #openstack-infra21:19
*** homeless has joined #openstack-infra21:19
*** mbacchi has quit IRC21:21
mattoliveraumorning21:23
*** mmedvede has quit IRC21:27
*** jcoufal has quit IRC21:29
*** mfer has quit IRC21:32
*** tonytan4ever has quit IRC21:33
*** froek has left #openstack-infra21:38
*** adalbas has quit IRC21:40
*** shashankhegde has quit IRC21:41
*** mriedem has quit IRC21:41
*** esker has quit IRC21:42
*** zz_gondoi is now known as gondoi21:42
*** shashankhegde has joined #openstack-infra21:42
*** dangers is now known as dangers_away21:47
*** Sincler has quit IRC21:49
*** otherwiseguy has quit IRC21:49
*** xyang0 has quit IRC21:53
*** mmedvede has joined #openstack-infra21:56
mtreinishdhellmann, jeblair, fungi, clarkb, etc.: can you guys take a look at https://review.openstack.org/12247821:59
*** thedodd has quit IRC21:59
mtreinishit's more procedural, because we're already installing it in devstack on every run22:00
mtreinishbut we can't add it to a requirements list and use it until that lands22:00
*** jheroux has quit IRC22:03
*** annegent_ has joined #openstack-infra22:07
*** annegent_ has quit IRC22:07
*** achanda has joined #openstack-infra22:08
*** mfink has quit IRC22:08
*** Sukhdev has joined #openstack-infra22:09
*** packet has quit IRC22:14
*** hashar has quit IRC22:14
*** packet has joined #openstack-infra22:14
fungimattoliverau: do you help maintain the turbo-hipster ci?22:14
fungiif not i'll give jhesketh a few more minutes to suck down his coffee22:15
mattoliveraufungi: Yeah, but not as much as jhesketh.. aka I have access and can poke :P22:17
jeblairmtreinish: lgtm22:17
mtreinishjeblair: cool, thanks22:17
*** mfink has joined #openstack-infra22:18
fungimattoliverau: you might want to disable it before i do22:18
fungimattoliverau: and then possibly see what needs to be done to get it to stop trying to check out the stable/hava branch i just deleted upstream earlier today22:18
fungier, stable/havana22:19
*** packet has quit IRC22:19
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Grant sahara-core to rebase changes in sahara  https://review.openstack.org/12736822:20
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Grant sahara-core to rebase changes in extra sahara projects  https://review.openstack.org/12736922:20
fungimattoliverau: or leave that second part to jhesketh22:20
jeblairfungi: huzzah!22:22
fungijeblair: yes, there was much rejoicing22:23
fungijeblair: other tidbits you probably won't find in meeting logs from while you were out...22:23
openstackgerritKhai Do proposed a change to openstack-infra/jenkins-job-builder: fix delete job command  https://review.openstack.org/12737022:23
*** dkranz has quit IRC22:23
openstackgerritIan Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool  https://review.openstack.org/12737122:23
openstackgerritSergey Lukjanov proposed a change to openstack-infra/project-config: Add sahara buildimages jobs for two more plugins  https://review.openstack.org/12737222:24
jogokrotscheck: ping22:24
krotscheckyeees?22:24
fungijeblair: the zuul pipeline precedence was adjusted to make gate high like pre-release/release/tag, so that check could be at normal and everything else low (this prevented merge-check spikes from delaying check jobs starting)22:24
ianwclarkb /fungi : ^ hopefully that's what you were thinking for nodepools d-i-b?22:24
jogokrotscheck: you are one of resident UI experts right?22:24
fungijeblair: we upgraded all the jenkins masters because of a ton of security vulnerabilities they announced22:25
krotscheckjogo: That’s what the sign on the door says.22:25
mtreinishjogo: oh, good call get krotscheck to makes all the dashboards :)22:25
* krotscheck doesn’t actually have a door.22:25
krotscheckWait a sec, did I just get volunteered for something?22:25
fungijeblair: which left us with maybe a weird situation with job registration for node label changes in the gearman plugin, zaro and clarkb have been hacking on that but it's been basically non-impacting for us22:26
jogokrotscheck: so mtreinish and fungi  and I were talking about http://lists.openstack.org/pipermail/openstack-dev/2014-October/048203.html22:26
jogoand I was thinking if I could get the bits and pieces together, maybe you could help make the UI itself22:26
fungijeblair: also i upgraded bandersnatch on all our pypi mirrors with the latest release in hopes of squashing the hang-on-teardown issue we were seeing causing the mirrors to go stale (though there's also a mitigation for that in place involving timeout+flock)22:27
jogokrotscheck: this is  a very rough idea right now though22:27
krotscheckjogo: Sure, can you find a couple of resources to take over for me on StoryBoard while I switch over to doing dashboards?22:28
zarofungi: i'm not sure how it even works :/22:28
jeblairfungi: oh, was check or gate at low priority before?22:28
krotscheck:D22:28
*** nkinder has quit IRC22:28
jogokrotscheck: I can try to use it and file bugs maybe22:28
* krotscheck is reading the thread.22:29
*** ramashri has quit IRC22:29
jeblairjogo: post-merge and periodic aren't really the same thing22:29
jogokrotscheck: I was thinking make a functional but ugly version first22:29
jeblairjogo: i think there are actually 3 cases we're dealing with:22:29
jogojeblair: ok, so I am at a bit of loss for terminology here22:29
*** dkliban_brb is now known as dkliban_afk22:30
jeblair1) post -- something that runs in response to a specific change merging22:30
krotscheckThis feels almost like a puppetboard for gerrit-ish things.22:30
jeblairthat includes things like documentation publishing, translation updates, updating the branch tarball, etc22:30
* jogo looks up puppetboard22:30
krotscheckjogo: puppetboard.openstack.org22:31
fungiianw: other than a typo i marked inline, yes i think so22:31
jeblairideally, they should actually report back to gerrit, but since gerrit does not include the merge commit sha in the change-merged event, we don't have the info needed for that22:31
jeblairto correct that situation, we should patch gerrit22:31
jeblairit should not be an extensive change22:31
fungijeblair: gate was at normal, check was at low, so we basically shifted gate and check up a notch22:32
jeblair2) low-priority periodic jobs -- something we run daily (current periodic jobs)22:32
jeblair3) continuous -- somewhere between the two -- we run as often as practical in order to narrow the window of breakages22:33
jeblairjogo: ^ all of the preceeding was addressed to you :)22:33
jogojeblair: right, so I like the terminology here too22:34
krotscheckRead-only dashes aren’t that hard.22:34
jeblairjogo: i think that perhaps rather than depending entirely on logstash and graphite (both of which have a loose coupling with zuul) we should use the mysql reporter for zuul and build the dashboard from that22:34
openstackgerritIan Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool  https://review.openstack.org/12737122:35
jogojeblair: so I was thinking a read only dashboard for things that do not report on gerrit22:35
jogomysql reporter for zuul?22:35
jeblairjogo: iow, zuul should be able to provide its own dashboard of runs it has triggered, since it has all of the information necessary (once recorded in mysql)22:35
krotscheckzuul-webclient?22:35
jogojeblair: that sounds even better22:36
*** gondoi is now known as zz_gondoi22:36
*** zns has quit IRC22:36
jogois the mysql reporter an idea or a working thing?22:36
jeblairkrotscheck: ideally yes, it should be a different process; currently the zuul webserver is built-in.  no one has moved it out yet.  i don't think it needs to be a different project though (at this point), just a different process.22:37
*** MaxV has quit IRC22:38
krotscheckjeblair: Seems sane. I don’t know that much about zuul yet, but it’s not like there’s anything impossible left on this planet.22:38
jogojeblair: so one of the benefits of using graphite for this is, there is a lot of great tooling already built a round it22:38
jeblairjogo: https://review.openstack.org/#/c/65885/22:38
krotscheckjeblair, jogo: What kind of a timelilne are we looking at here?22:38
jeblairjogo: i think we might augment it with graphite and logstash, but i think we should not depend on it or logstash because of the too-loose coupling22:39
jogojeblair: why is the loose coupling a concern?22:39
jeblairjogo: with a mysql db, we can have assurance we know each success, failure, timestamp, and log url for each run22:39
mattoliveraufungi: I have turned off TH voting while I take a look at the issue22:40
jeblairjogo: because zuul does not require either of them, and does not even know about one of them22:40
jogojeblair: so using mysql db instead of logstash would be nice22:40
jogobut being able to build a time series and an alert from graphite is really powerful22:40
jeblairjogo: i'm not saying it isn't.  i _do_ think you should use it to build graphs22:41
jogojeblair: and mysqldb to get the specific details22:41
jeblairjogo: but i'm saying the part that lists what the jobs are, what the latest result is, and the result history for each run should be built from local data22:41
fungimattoliverau: thanks!22:41
* krotscheck idly drops https://github.com/mbostock/d3/wiki/Gallery into the graphing conversation.22:41
jogojeblair: agreed, using a mysql db for that would be wondeful22:42
jogokrotscheck: we need more bubble charts22:42
*** HeOS has joined #openstack-infra22:43
jeblairerm22:43
jeblairwhy are more than one result set showing up in the javascript ci tables in gerrit?22:43
jogojeblair: I see the building the list of specific jobs etc and building the general tracking as two equally important parts22:43
anteayastevemar: are you canadian?22:43
*** groknix has joined #openstack-infra22:44
jeblairjogo: yes, we need both22:44
*** prad has quit IRC22:44
fungijeblair: sdague is trying to refine the "experimental results mask check results" issue with the table. that's an iteration in that direction aiui (pipeline names mentioned in the result comments are working into this next)22:44
anteayastevemar: I can't imagine many non-canadians knowing about thankgiving being on monday22:44
jeblairfungi: but it's showing results from old patchsets22:44
jeblairfungi: cf https://review.openstack.org/#/c/65885/22:45
jeblairfungi: only the last one is relevant22:45
*** kgiusti has quit IRC22:45
jogojeblair: so this came up in part because of the rough roadmap to continuous testing22:45
jeblairfungi: also, experimental results did not mask check results22:45
jogojeblair: and what the status of that is, so besides a dashboard. what is the status?22:45
jeblairjogo: yeah, i think we need to get the dashboard up.  there may be some small changes to zuul after that, but mostly the dash.22:45
jeblairjogo: i think first step in the dash is to get the mysql reporter merged and start using it22:46
jeblairjogo: (so we have data to work with)22:46
jogojeblair: can the mysql db include links to the logs?22:46
jeblairjogo: maybe clarkb or fungi would be interested in reviewing https://review.openstack.org/#/c/65885/22:46
fungijeblair: those are all results from the most recent patchset22:46
stevemaranteaya, i hope so, we almost shared a back to toronto 2 conferences back :P22:46
fungijeblair: indicating all the rechecks performed on it22:46
fungijeblair: i think the concern expressed was that "voting" experimental job results look the same as voting check results when mashed together into one table22:47
*** HeOS has quit IRC22:48
jeblairjogo: i think it should, or at least, the information needed to construct it.  i'm not sure whether the current revision of that patch includes it22:48
fungiand the other concern it was attempting to address is people recheck-spamming a semi broken change until they get a passing grade22:48
fungiwhich does show in the comments, but is not immediately obvious when glancing at the results table22:48
anteayastevemar: did we, did I know you are canadian and forgot?22:48
anteayaI can't imagine forgetting22:48
jeblairfungi: ah yes, you are right they are all for the current patchset.  however, it was a deliberate choice for it to show only the most recent test22:48
anteayastevemar: where are you?22:49
jogofungi: won't continuous jobs not  be tied to patchsets?22:49
jogoerr jeblair ^22:49
anteayastevemar: now I remember, d'oh, you have been hanging in keystone22:49
jeblairjogo: i meant the current revision of the patch to add the mysql reporter22:49
stevemaranteaya, you did forget :O we talked about how ford was a bum, there ya go!22:49
anteayastevemar: I didnt' connect the dots, sorry about that22:49
jeblairjogo: as in, if it doesn't include the necessary log data, we should add it22:49
anteayastevemar: yeah, you showed me your great backpack22:49
fungijeblair: i'm happy to approve a revert of that change as well. i'm more or less ambivalent on it as a design element but sdague was quite eager for that22:50
anteayastevemar: faces and nicks don't always match in my brain, sorry about that22:50
jogojeblair: but the schema isn't useful for continuous jobs22:50
jogoI think22:50
stevemaranteaya, haha, keystone is where i spend most of my days, i've been dabbling in infra lately, trying to not increase the work load for you all22:50
jeblairfungi: yeah, i was happy with what i discussed with sdague about it, i just thought that it would show only the most recent of each set (eg, most recent check and most recent experimental, with timestamps of each)22:51
jeblairjogo: what about the schema is not useful?22:51
anteayastevemar: and we are so grateful!!22:52
anteayastevemar: thank you22:52
fungijeblair: i think the roadmap he had included getting it to collapse all but the most recent result from each pipeline on the patchset with a click-on-header toggle to expose22:52
jeblairjogo: yes, you are right.  perhaps that should be -1'd with the comment that it should accomodate periodic jobs better22:52
*** groknix_ has joined #openstack-infra22:52
*** hdd has quit IRC22:52
jeblairfungi: i think i would have preferred a 'one step forward' approach rather than 'one step backward and one step forward'.  is anyone working on this while he's gone?22:52
*** JayJ has quit IRC22:53
*** JayJ has joined #openstack-infra22:54
fungijeblair: yeah, i think clarkb had the pipeline patch in progress...22:54
jeblairjogo: but yeah, the columns should be a superset of the different types of changes in the zuul model so it would work for 'ref' updates and plain old branch-tip testing too.  i don't think that will be hard.22:54
fungijeblair: aha, https://review.openstack.org/12524422:54
fungijeblair: i hadn't approved because i wasn't sure if he was ready for it to go in yet22:54
*** groknix has quit IRC22:55
jeblairhaha22:55
clarkbya pipeline names are up for review22:55
jeblairi read that change and immediately said "i think it would read better if we said 'Check build succeeded'".22:56
*** dmsimard is now known as dmsimard_away22:56
jeblairand then i went to read sean's comment that prompted the second patchset22:56
jeblairthough the point about it reading as an imperative is well taken :)22:57
jogojeblair: where can I find the list of types of zuul changes?22:57
fungiyeah, english--22:57
jeblairjogo: zuul/model.py22:57
jogosearching for 'branch-tip' in docs didn't work22:57
jeblairjogo: i think the timer may emit NullChange objects right now, though it should probably emit Ref changes with appropriate values.22:59
fungialso, worth noting, we triggered post jobs for all the branch deletion events today, with a commit hash of 0000000... (the jobs thankfully all failed to check out that commit, so no lasting effect)23:00
funginot sure if it's worth special-casing the zero-hash and making zuul ignore those23:01
fungii think it's done this on previous branch deletions as well23:01
fungiso probably a long-standing behavior at this point23:01
*** andreaf has quit IRC23:01
jeblairjogo: (right now, i think branch selection in periodic jobs happens in the job itself; if we made the timer trigger a little more sophisticated (eg, have it emit ref objects) we could have the branch selection in zuul which would give us nicer data for dashboard/reporting)23:01
*** ramashri has joined #openstack-infra23:02
*** baoli has quit IRC23:02
jogojeblair: nice23:02
jeblairfungi: very long standing, and yeah, would be easy to ignore (though it should be configurable; it's conceivable you would want to run a job on branch deletion)23:02
fungiagreed23:03
*** ramashri_ has joined #openstack-infra23:04
jogojeblair: so it sounds like with a few minor things we get all the data needed to report information about specific jobs23:05
jeblairjogo: yup!23:05
jogojeblair: what do you think is needed w.r.t graphite23:05
jogojeblair: as in what kinds of graphs23:05
jeblairjogo: and we can expose zuul's data with json23:06
jogojeblair: I was thinking a way to automatically generate success/failure rate graphs per job23:06
jeblairjogo: that should already be in graphite23:06
jogojeblair: you mean the data from mysql?23:06
jeblairjogo: yep23:06
jogojeblair: right, now what data we need  for graphite as I think we have it all, but what graphs would we want23:07
jeblairjogo: yeah, i think job success/failure rate over time is the main one23:07
*** HenryG has joined #openstack-infra23:07
*** ramashri has quit IRC23:08
jeblairjogo: (zuul's data will tell you what jobs to check in graphite, so you can automatically make a graph for each job)23:08
jeblairjogo: (kind of like the pipeline sparklines on the status page)23:08
jogojeblair: maybe graphite has that too23:08
jogobut pulling that from zuul makes more sense23:09
*** MaxV has joined #openstack-infra23:09
jeblairjogo: we keep data longer in graphite than we keep jobs in zuul23:09
jeblairjogo: so if you iterated over all the jobs in graphite, you'd have way more than we're actually interested in23:09
jogojeblair: exactly23:09
jogojeblair: renames and all23:09
jeblairjogo: yep, so getting the jobs from zuul and trends from graphite seems the best mix.23:10
jogois there a REST call to list active jobs today?23:10
jogoor would this come from the JSON output from the mysql thing23:10
jeblairjogo: only thing today is the status json endpoint; i'm imagining this comes from the mysql thing23:11
*** lttrl has joined #openstack-infra23:11
jogojeblair: right23:12
*** MaxV has quit IRC23:13
jogojeblair: so I am going to start playing around with what types of graphs we may want. I think there may be two23:13
jogolong and short term23:13
*** dimtruck is now known as zz_dimtruck23:14
jogolong = {3-6}.months, short = {2-14 days}23:14
*** bknudson has quit IRC23:17
jeblairjogo: ++23:17
*** hdd has joined #openstack-infra23:17
jogojeblair: cool, time to relocate. I didn't realize how close we were to getting this up23:18
*** chianingwang has quit IRC23:21
*** kgiusti has joined #openstack-infra23:24
*** kgiusti has left #openstack-infra23:24
*** flaper87 is now known as flaper87|afk23:25
openstackgerritA change was merged to openstack-dev/pbr: tests: factorize has_opt handling  https://review.openstack.org/12216723:27
openstackgerritA change was merged to openstack-dev/pbr: autodoc: allow to exclude modules from auto-generation  https://review.openstack.org/12216823:27
*** nkinder has joined #openstack-infra23:34
*** JayJ has quit IRC23:37
*** david-lyle has quit IRC23:40
*** hdd has quit IRC23:40
*** rainya has quit IRC23:41
*** zz_jgrimm is now known as jgrimm23:43
*** groknix has joined #openstack-infra23:45
*** groknix_ has quit IRC23:45
*** groknix_ has joined #openstack-infra23:47
*** TheJulia has quit IRC23:48
*** groknix has quit IRC23:50
*** TheJulia has joined #openstack-infra23:50
*** dmsimard_away is now known as dmsimard23:55
openstackgerritIan Wienand proposed a change to openstack-infra/config: Install latest diskimage-builder on nodepool  https://review.openstack.org/12737123:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!