2014-12-10T00:00:02 jogo: no longer blocked by me devstack-gate is your next port of call 2014-12-10T00:00:04 clarkb: yeah I think checking >= 1 is the only path forward 2014-12-10T00:00:17 sc68cal: ^^^ 2014-12-10T00:00:29 *** nelsnelson has quit IRC 2014-12-10T00:00:39 *** koolhead_ has joined #openstack-infra 2014-12-10T00:00:54 *** _nadya_ has joined #openstack-infra 2014-12-10T00:01:01 *** camunoz has quit IRC 2014-12-10T00:01:11 JayF: CPE equiment will get at least 2 IPv6 addrs when doing PD - a /128 and a /64 2014-12-10T00:01:29 CPE? 2014-12-10T00:01:43 customer premises equip 2014-12-10T00:01:56 actually better example, renumbering 2014-12-10T00:02:04 Merged openstack-infra/system-config: Add new git haproxy frontends to cacti https://review.openstack.org/140526 2014-12-10T00:02:19 a router with two prefixes - devices attached to router will get two prefixes and migrate over as renumbering 2014-12-10T00:02:22 anteaya: ? 2014-12-10T00:02:30 okay, back now 2014-12-10T00:02:36 mtreinish: yeah >=1 might be it 2014-12-10T00:02:38 anteaya: you mean the next patch in the series is blocked on devstack-gate? if so correct 2014-12-10T00:02:50 so much with the talking 2014-12-10T00:02:58 *** shakamunyi has joined #openstack-infra 2014-12-10T00:03:00 fungi: git.o.o round robin complete. jeblair has done more bisecting and narrowed it down to a couple packages 2014-12-10T00:03:27 *** shakamunyi has quit IRC 2014-12-10T00:04:18 *** ryanpetrello has quit IRC 2014-12-10T00:04:36 *** koolhead17 has quit IRC 2014-12-10T00:04:52 Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 2014-12-10T00:04:57 jogo: yes sorry that was my meaning 2014-12-10T00:05:24 *** sabeen1 has quit IRC 2014-12-10T00:05:34 *** ivar-lazzaro has joined #openstack-infra 2014-12-10T00:05:37 *** _nadya_ has quit IRC 2014-12-10T00:05:57 fungi: also https://review.openstack.org/#/c/140497/ will fix the hostfile things 2014-12-10T00:07:28 Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 2014-12-10T00:07:39 *** asettle is now known as asettle-errands 2014-12-10T00:07:47 clarkb, fungi: one line in fact: 2014-12-10T00:07:50 in paramiko/rsakey.py 2014-12-10T00:07:50 - rsa = RSA.generate(bits, rng.read, progress_func) 2014-12-10T00:07:50 + rsa = RSA.generate(bits, os.urandom, progress_func) 2014-12-10T00:08:02 this has a familiar ring to it somehow 2014-12-10T00:08:20 oh hey is that like what salt was doing? 2014-12-10T00:09:39 *** melwitt has quit IRC 2014-12-10T00:10:47 https://github.com/paramiko/paramiko/commit/6f211115f49edcea7d23b764d7cf3a84ff12f5f0 2014-12-10T00:11:32 4) it makes multithreaded python terrible 2014-12-10T00:11:34 *** david-lyle is now known as david-lyle_afk 2014-12-10T00:11:36 er 5) 2014-12-10T00:12:21 *** ZZelle_ has quit IRC 2014-12-10T00:12:52 *** andreykurilin_ has quit IRC 2014-12-10T00:13:19 *** andreykurilin_ has joined #openstack-infra 2014-12-10T00:13:20 now I am glad that I WIP'd yolanda's patch to update paramiko 2014-12-10T00:13:41 Merged openstack-infra/system-config: Use puppet inventory when running ansible. https://review.openstack.org/140497 2014-12-10T00:14:41 *** gokrokve has quit IRC 2014-12-10T00:15:04 *** packet has quit IRC 2014-12-10T00:15:41 *** gokrokve has joined #openstack-infra 2014-12-10T00:16:12 *** kumartin has quit IRC 2014-12-10T00:17:22 *** dims has quit IRC 2014-12-10T00:17:39 *** camunoz has joined #openstack-infra 2014-12-10T00:17:39 *** camunoz is now known as camunoz_mtg 2014-12-10T00:18:00 Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 2014-12-10T00:19:02 *** dims has joined #openstack-infra 2014-12-10T00:19:43 commit message needs rework 2014-12-10T00:19:44 *** Masahiro has joined #openstack-infra 2014-12-10T00:20:02 *** sabeen has joined #openstack-infra 2014-12-10T00:20:06 *** gokrokve has quit IRC 2014-12-10T00:20:13 *** jerryz has joined #openstack-infra 2014-12-10T00:23:04 *** Sukhdev has joined #openstack-infra 2014-12-10T00:23:30 *** hdd has quit IRC 2014-12-10T00:23:32 *** pc_m has quit IRC 2014-12-10T00:23:33 Merged openstack-infra/reviewstats: Update neutron core https://review.openstack.org/140159 2014-12-10T00:23:35 jeblair: ha! 2014-12-10T00:24:06 *** pc_m has joined #openstack-infra 2014-12-10T00:24:12 I need to run shortly for an early dinner. It would be asomeness if someone could make sure that cacti gets the new git-feXX nodes in it before tomorrow 2014-12-10T00:24:22 that way we get the precious datas with tomorrows nodepool image updates 2014-12-10T00:24:24 jeblair: so it really is contention over /dev/urandom during parallel key generation calls? 2014-12-10T00:24:35 *** Masahiro has quit IRC 2014-12-10T00:24:48 * fungi is finally done catching up on scrollback 2014-12-10T00:25:02 Sean M. Collins proposed openstack-infra/devstack-gate: Set IP_VERSION in DevStack to run dual stack https://review.openstack.org/140128 2014-12-10T00:25:05 *** pc_m_ has joined #openstack-infra 2014-12-10T00:25:31 clarkb: now that 140497 is in, i'll keep an eye on puppetboard and make sure things continue puppeting 2014-12-10T00:25:54 (and that things which weren't previously in the static hostfile start puppeting too) 2014-12-10T00:26:17 *** spzala has quit IRC 2014-12-10T00:27:05 clarkb: since the cacti change merged a while ago, what else needs to be done for that? or just keep an eye on cacti and make sure they show up? 2014-12-10T00:27:06 Michael Krotscheck proposed openstack-infra/storyboard: Added cron plugin to clean old access tokens. https://review.openstack.org/140536 2014-12-10T00:28:37 *** pc_m has quit IRC 2014-12-10T00:30:07 Michael Krotscheck proposed openstack-infra/storyboard: Added cron plugin to clean old access tokens. https://review.openstack.org/140536 2014-12-10T00:30:09 *** doug-fish has left #openstack-infra 2014-12-10T00:30:15 *** dims has quit IRC 2014-12-10T00:30:25 *** Sincler has quit IRC 2014-12-10T00:30:42 *** Sincler has joined #openstack-infra 2014-12-10T00:30:52 *** Sincler has quit IRC 2014-12-10T00:30:56 *** rkukura has quit IRC 2014-12-10T00:31:12 *** Sincler has joined #openstack-infra 2014-12-10T00:33:06 *** Sincler has quit IRC 2014-12-10T00:33:26 *** Sincler has joined #openstack-infra 2014-12-10T00:34:06 Because OMG my access token change showed me that I have 100’s of old access tokens. 2014-12-10T00:34:20 krotscheck: you're such a hoarder 2014-12-10T00:35:04 fungi: I bet you have a lot too. 2014-12-10T00:35:08 clarkb, fungi: os.urandom is faster for small values, and increasingly slower for large values of data read 2014-12-10T00:35:13 *** Sukhdev has quit IRC 2014-12-10T00:35:31 so that change either made things faster or slower for us, depending on how much data paramiko reads 2014-12-10T00:36:10 it also introduces two GIL release/acquire events each time os.urandom is read 2014-12-10T00:37:27 *** rkukura has joined #openstack-infra 2014-12-10T00:37:28 *** amitgandhinz has joined #openstack-infra 2014-12-10T00:38:02 ideally the thread would be accessing its own secure prng, and seed it once from /dev/urandom, rather than fighting over /dev/urandom as a substitute prng 2014-12-10T00:38:27 fungi: this isn't locked, so i don't think there's contention here 2014-12-10T00:38:35 unless the kernel does that 2014-12-10T00:39:13 i think there are patches to make it possible to have independent streams reading urandom 2014-12-10T00:39:30 fungi: what happens if two processes open it? 2014-12-10T00:39:32 researching whether that's common in current kernels 2014-12-10T00:40:05 at one point there was a rotating buffer and the kernel would take turns serving each caller 2014-12-10T00:40:57 https://gist.github.com/drsnyder/10909495 2014-12-10T00:40:59 huh look at that 2014-12-10T00:41:26 *** rmcall has quit IRC 2014-12-10T00:41:28 http://drsnyder.us/2014/04/16/linux-dev-urandom-and-concurrency.html 2014-12-10T00:42:21 so, yeah 2014-12-10T00:42:25 not good 2014-12-10T00:42:48 *** ryanpetrello has joined #openstack-infra 2014-12-10T00:43:31 *** dims has joined #openstack-infra 2014-12-10T00:44:13 and indeed, the urandom manpage says to use it to seed a prng 2014-12-10T00:44:36 but the paramiko commit removed just that 2014-12-10T00:44:51 win 2014-12-10T00:45:24 *** Sukhdev has joined #openstack-infra 2014-12-10T00:45:46 *** Masahiro has joined #openstack-infra 2014-12-10T00:46:09 pretty sure i had seen literature about that being a terribly efficient pattern. disappointed to see that's still the case though 2014-12-10T00:46:19 terribly INefficient i mean 2014-12-10T00:46:57 https://news.ycombinator.com/item?id=7610273 2014-12-10T00:47:09 et cetera 2014-12-10T00:48:23 *** otter768 has joined #openstack-infra 2014-12-10T00:48:32 seems like *bsd solved it with multi-stream prng generators in-kernel a while ago 2014-12-10T00:48:46 *** jamielennox is now known as jamielennox|away 2014-12-10T00:49:45 Sukhdev Kapur proposed openstack-infra/project-config: Add networking-arisa project to StackForge https://review.openstack.org/140473 2014-12-10T00:50:04 * mordred comes back into channel and sees very sad things about paramiko 2014-12-10T00:50:48 *** gyee has quit IRC 2014-12-10T00:51:05 *** ivar-lazzaro has quit IRC 2014-12-10T00:51:09 *** SumitNaiksatam has quit IRC 2014-12-10T00:51:12 it was either doing the wrong thing before and doing the right thing now, or the other way around 2014-12-10T00:51:15 jeblair: this is all in the post-boot-onfig stuff in nodepool via ssh? or are we using paramkio for something else? 2014-12-10T00:51:28 * mordred trying to tldr back in to context 2014-12-10T00:51:32 *** koolhead_ has quit IRC 2014-12-10T00:51:34 depending on which cryptographer on the internet you are asking 2014-12-10T00:52:10 mordred: i believe this is in creating keys for the nodes (for use in multi-node setups) 2014-12-10T00:52:16 cotcha 2014-12-10T00:52:21 gotcha, that is 2014-12-10T00:52:36 i think at this point we can say that new paramiko is far less efficient at generating 1000 rsa keys 2014-12-10T00:52:37 *** otter768 has quit IRC 2014-12-10T00:52:47 well, that's good to know 2014-12-10T00:53:15 we could probably defer the problem by not generating keys for single-host nodes 2014-12-10T00:53:41 we coudl also shell to ssh-keygen and not use paramkio 2014-12-10T00:53:53 which just moves the problem 2014-12-10T00:53:59 or reuse keys 2014-12-10T00:54:22 or short-circuit os.urandom by redefining it? 2014-12-10T00:54:24 fungi: i'd rather not worry about inter-node interference that way 2014-12-10T00:54:33 jeblair: true 2014-12-10T00:54:34 *** xyang1 has quit IRC 2014-12-10T00:55:08 or - offload to nova keypair extension 2014-12-10T00:55:18 which can create a key for you 2014-12-10T00:55:32 mordred: i'm pretty sure that would take many many orders of magnitude longer 2014-12-10T00:55:43 nod 2014-12-10T00:56:21 *** avozza is now known as zz_avozza 2014-12-10T00:57:25 perhaps paramiko would take a patch upstream to make "cheap but insecure" randomness for key generation as a foot-cannon named parameter 2014-12-10T00:58:29 *** MaxV has joined #openstack-infra 2014-12-10T00:59:45 *** Longgeek has joined #openstack-infra 2014-12-10T01:00:28 *** mikedillion has quit IRC 2014-12-10T01:01:20 i'm doing some more tests 2014-12-10T01:01:49 *** mikedillion has joined #openstack-infra 2014-12-10T01:03:07 *** MaxV has quit IRC 2014-12-10T01:03:44 *** salv-orlando has quit IRC 2014-12-10T01:04:05 *** StevenK has joined #openstack-infra 2014-12-10T01:04:44 *** mestery has quit IRC 2014-12-10T01:04:45 *** Longgeek has quit IRC 2014-12-10T01:05:18 *** armax has quit IRC 2014-12-10T01:07:21 *** armax has joined #openstack-infra 2014-12-10T01:07:28 *** signed8b_ is now known as signed8bit_ZZZzz 2014-12-10T01:09:42 Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split #2 https://review.openstack.org/140548 2014-12-10T01:11:06 *** dims has quit IRC 2014-12-10T01:11:13 *** CIBuilds has quit IRC 2014-12-10T01:11:58 *** mestery has joined #openstack-infra 2014-12-10T01:11:59 *** marun has quit IRC 2014-12-10T01:13:15 *** wenlock has quit IRC 2014-12-10T01:13:37 fungi, mordred: it seems like overall, key generation is faster with the new paramiko 2014-12-10T01:13:58 jeblair: so, generation is faste, but less concurrency friendly? 2014-12-10T01:14:03 because GIL? 2014-12-10T01:14:34 *** mikedillion has quit IRC 2014-12-10T01:14:40 it may actually be more concurrent because it may hold the gil less 2014-12-10T01:14:59 *** marun has joined #openstack-infra 2014-12-10T01:15:18 oh. neat 2014-12-10T01:15:42 *** xianghui has joined #openstack-infra 2014-12-10T01:16:01 *** adalbas has quit IRC 2014-12-10T01:16:39 *** yamamoto_ has joined #openstack-infra 2014-12-10T01:16:40 that might be giving us 500 threads all ready to run at much closer to the same time 2014-12-10T01:17:08 I'm still not sure what the recommended way is to take over someone else's changeset. Are there instructions somewhere? 2014-12-10T01:18:02 is it better to just pull from gerrit? or checkout is better? 2014-12-10T01:18:06 reed: you can't transfer ownership, you just push patches to it and remember to check 2014-12-10T01:18:16 *** gokrokve has joined #openstack-infra 2014-12-10T01:18:28 reed: I also tend to use "git review -d 12345", where 12345 is the change ID, that will check it out locally 2014-12-10T01:18:32 *** zhiwei has joined #openstack-infra 2014-12-10T01:18:34 jroll, that's what I meant 2014-12-10T01:18:34 asselin: were does the script to refresh split out modules run? I do not think it does properly update the seed repositories right now 2014-12-10T01:18:50 jroll, ah, great, I'll try that 2014-12-10T01:19:10 mmedvede, it runs on sweston's server 2014-12-10T01:19:37 mmedvede, do you have an example? I'd like to take a look? 2014-12-10T01:20:06 asselin: there were a few questions regarding the details today at the meeting. This is exactly the problem, we are relying on it to be running, without having any control. 2014-12-10T01:20:18 asselin: example - subunit2sql module 2014-12-10T01:20:28 Nikhil Manchanda proposed openstack-infra/project-config: Add link for Trove RSS feed https://review.openstack.org/140549 2014-12-10T01:20:34 asselin looking 2014-12-10T01:20:46 * sweston is looking 2014-12-10T01:22:08 *** pc_m_ has quit IRC 2014-12-10T01:23:18 mmedvede, yes, something is missing 2014-12-10T01:23:28 *** salv-orlando has joined #openstack-infra 2014-12-10T01:24:04 mmedvede, I think we can work out the issues. And we can delay the split until we know it's correct. 2014-12-10T01:24:34 mmedvede, another option is to have -infra run the script 2014-12-10T01:25:22 mmedvede, but it would be better not to in order to avoid tasking them with one more thing 2014-12-10T01:25:37 what is missing? I do not see it 2014-12-10T01:25:40 clarkb, fungi, mordred: i'll think about this some more, but we may want to just see how the trusty server behaves with the updated pycrypto and deal with things from there. my test may be too artificial to tell us what we'll see in production. 2014-12-10T01:25:54 i'll buy that 2014-12-10T01:25:55 *** sabari is now known as zz_sabari 2014-12-10T01:26:20 *** ryanpetrello has quit IRC 2014-12-10T01:26:33 sweston, https://github.com/openstack-infra/system-config/tree/master/modules/subunit2sql has a commit that is 6 days old 2014-12-10T01:26:41 i'm going to eod now; night 2014-12-10T01:26:43 *** rkukura has quit IRC 2014-12-10T01:26:49 sweston, your last commit is 21 days ago: https://github.com/Triniplex/puppet-subunit2sql 2014-12-10T01:27:33 *** ddieterly has joined #openstack-infra 2014-12-10T01:28:00 *** obondarev has quit IRC 2014-12-10T01:28:36 Merged openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 2014-12-10T01:28:47 mmedvede, another option is to have multiple ppl running the script. e.g. I can run it too. 2014-12-10T01:29:47 asselin: can you push to his github? 2014-12-10T01:30:33 mmedvede, probably not unless he adds me 2014-12-10T01:31:06 asselin: good call 2014-12-10T01:31:06 *** Masahiro has quit IRC 2014-12-10T01:31:09 *** amitgandhinz has quit IRC 2014-12-10T01:31:24 mmedvede, either way, i'd like to get the script working & validated. it's a huge time saver not to have to do this 2014-12-10T01:31:34 also we need the ability to trigger is manually as well 2014-12-10T01:31:38 *** dannywilson has quit IRC 2014-12-10T01:31:43 it 2014-12-10T01:31:50 ok I will add those features in 2014-12-10T01:32:06 *** Sukhdev has quit IRC 2014-12-10T01:32:11 *** xianghui has quit IRC 2014-12-10T01:32:17 *** yamamoto_ has quit IRC 2014-12-10T01:32:22 *** xianghui_ has joined #openstack-infra 2014-12-10T01:32:32 *** mestery has quit IRC 2014-12-10T01:32:33 *** armax has quit IRC 2014-12-10T01:32:35 sweston: thanks steve 2014-12-10T01:32:43 sweston, are you ok to add a few ppl with write permissions? I think this well help as a good backup. 2014-12-10T01:32:55 * anteaya heads out to the restaurant 2014-12-10T01:33:01 sweston, but hopefully we'll never need to 2014-12-10T01:33:06 asselin: agreed 2014-12-10T01:33:11 *** ddieterl_ has joined #openstack-infra 2014-12-10T01:33:25 *** xianghui_ is now known as xianghui 2014-12-10T01:33:54 *** ddieterly has quit IRC 2014-12-10T01:34:05 anteaya, bon appetite 2014-12-10T01:34:09 asselin: yup 2014-12-10T01:34:14 *** Masahiro has joined #openstack-infra 2014-12-10T01:34:17 *** markmcclain has quit IRC 2014-12-10T01:34:26 asselin, sweston: +1. I like the automation :) 2014-12-10T01:34:26 anteaya: have a good dinner 2014-12-10T01:35:09 asselin sweston thanks 2014-12-10T01:35:42 the automation is a good idea, we just need to ensure we can respin on short notice 2014-12-10T01:36:03 i'll look into the github api tomorrow 2014-12-10T01:36:07 sweston: regarding on what is missing in the subunit2sql module, see commit 5941f83 in system-config 2014-12-10T01:38:59 *** marun has quit IRC 2014-12-10T01:42:57 *** shayneburgess has quit IRC 2014-12-10T01:43:05 *** wuhg has joined #openstack-infra 2014-12-10T01:44:23 *** andreykurilin_ has quit IRC 2014-12-10T01:53:51 *** shakamunyi has joined #openstack-infra 2014-12-10T01:55:41 *** yaguang has joined #openstack-infra 2014-12-10T01:57:23 *** ivar-lazzaro has joined #openstack-infra 2014-12-10T01:57:31 *** oomichi_ has joined #openstack-infra 2014-12-10T01:59:03 mmedvede: yup, ok, found the error. will fix it in the morning 2014-12-10T02:00:07 *** shashankhegde has quit IRC 2014-12-10T02:00:26 *** ivar-lazzaro has quit IRC 2014-12-10T02:00:33 sweston: thanks. Your script is great, what was the issue? 2014-12-10T02:01:34 *** ivar-lazzaro has joined #openstack-infra 2014-12-10T02:01:52 mmedvede: thanks :-). when I built it, I didn't have the opportunity to test multiple module updates. the issue is with the parsing of the updated modules, it's a simple fix 2014-12-10T02:02:25 *** weshay has quit IRC 2014-12-10T02:02:42 *** baoli has joined #openstack-infra 2014-12-10T02:03:39 *** signed8bit_ZZZzz is now known as signed8b_ 2014-12-10T02:03:47 *** fandi has quit IRC 2014-12-10T02:06:22 *** asettle-errands is now known as asettle-doctor 2014-12-10T02:06:27 mmedvede: thanks for finding the issue. since some of the modules are still being updated, I didn't catch it 2014-12-10T02:08:45 sweston: glad to help :) 2014-12-10T02:10:12 *** harlowja has joined #openstack-infra 2014-12-10T02:11:56 *** signed8b_ has quit IRC 2014-12-10T02:13:52 *** tnovacik has quit IRC 2014-12-10T02:15:06 *** yamamoto_ has joined #openstack-infra 2014-12-10T02:15:24 *** r-daneel has quit IRC 2014-12-10T02:17:50 *** tnovacik has joined #openstack-infra 2014-12-10T02:18:40 *** dkranz has quit IRC 2014-12-10T02:18:42 *** ChuckC has quit IRC 2014-12-10T02:21:58 *** Masahiro has quit IRC 2014-12-10T02:27:03 *** Masahiro has joined #openstack-infra 2014-12-10T02:30:29 *** SumitNaiksatam has joined #openstack-infra 2014-12-10T02:30:52 *** xyang1 has joined #openstack-infra 2014-12-10T02:34:52 *** amitgandhinz has joined #openstack-infra 2014-12-10T02:37:01 *** shayneburgess has joined #openstack-infra 2014-12-10T02:40:07 *** tnovacik has quit IRC 2014-12-10T02:41:01 *** camunoz_mtg has quit IRC 2014-12-10T02:44:33 *** oomichi_ has quit IRC 2014-12-10T02:47:30 *** salv-orlando has quit IRC 2014-12-10T02:48:33 *** ryanpetrello has joined #openstack-infra 2014-12-10T02:48:33 *** Longgeek has joined #openstack-infra 2014-12-10T02:49:15 *** otter768 has joined #openstack-infra 2014-12-10T02:51:56 *** Sincler has quit IRC 2014-12-10T02:52:17 *** amitgandhinz has quit IRC 2014-12-10T02:53:07 *** ChuckC has joined #openstack-infra 2014-12-10T02:53:22 *** Longgeek has quit IRC 2014-12-10T02:54:03 *** otter768 has quit IRC 2014-12-10T02:54:23 *** zz_sabari is now known as sabari 2014-12-10T02:54:25 *** camunoz_mtg has joined #openstack-infra 2014-12-10T02:55:17 *** ryanpetrello has quit IRC 2014-12-10T02:56:01 *** r-daneel has joined #openstack-infra 2014-12-10T02:58:19 *** signed8bit has joined #openstack-infra 2014-12-10T03:00:38 *** r-daneel has quit IRC 2014-12-10T03:03:36 *** signed8b_ has joined #openstack-infra 2014-12-10T03:07:00 fungi still about? looks like we need to bounce snmpd on git-fe* 2014-12-10T03:07:01 *** signed8bit has quit IRC 2014-12-10T03:07:14 I can do that when I get home 2014-12-10T03:10:21 *** ryanpetrello has joined #openstack-infra 2014-12-10T03:12:53 *** harlowja is now known as harlowja_away 2014-12-10T03:14:49 *** ryanpetrello has quit IRC 2014-12-10T03:15:15 *** r-daneel has joined #openstack-infra 2014-12-10T03:19:21 *** patrickeast has quit IRC 2014-12-10T03:20:41 *** armax has joined #openstack-infra 2014-12-10T03:21:38 *** mestery has joined #openstack-infra 2014-12-10T03:23:02 *** salv-orlando has joined #openstack-infra 2014-12-10T03:23:28 *** zz_dimtruck is now known as dimtruck 2014-12-10T03:23:48 *** salv-orlando has quit IRC 2014-12-10T03:23:54 *** salv-orl_ has joined #openstack-infra 2014-12-10T03:24:58 *** fandi has joined #openstack-infra 2014-12-10T03:26:31 *** marun has joined #openstack-infra 2014-12-10T03:26:42 *** jamielennox|away is now known as jamielennox 2014-12-10T03:28:02 *** changbl has joined #openstack-infra 2014-12-10T03:28:30 *** amotoki has joined #openstack-infra 2014-12-10T03:31:53 *** signed8b_ is now known as signed8bit 2014-12-10T03:34:04 *** camunoz_mtg has quit IRC 2014-12-10T03:35:00 *** oomichi_ has joined #openstack-infra 2014-12-10T03:45:13 *** dimtruck is now known as zz_dimtruck 2014-12-10T03:50:11 *** camunoz_mtg has joined #openstack-infra 2014-12-10T03:50:29 *** r-daneel has quit IRC 2014-12-10T03:55:17 *** ivar-laz_ has joined #openstack-infra 2014-12-10T03:55:36 *** Sukhdev has joined #openstack-infra 2014-12-10T03:56:17 *** ddieterl_ has quit IRC 2014-12-10T03:57:00 *** _nadya_ has joined #openstack-infra 2014-12-10T03:58:43 *** ivar-lazzaro has quit IRC 2014-12-10T04:00:01 *** talluri has joined #openstack-infra 2014-12-10T04:00:12 *** ivar-laz_ has quit IRC 2014-12-10T04:00:12 *** rkukura has joined #openstack-infra 2014-12-10T04:02:14 *** markmcclain has joined #openstack-infra 2014-12-10T04:02:44 *** asettle-doctor is now known as asettle 2014-12-10T04:03:28 *** pc_m has joined #openstack-infra 2014-12-10T04:04:41 *** pc_m has quit IRC 2014-12-10T04:05:19 *** pc_m has joined #openstack-infra 2014-12-10T04:09:01 *** _nadya_ has quit IRC 2014-12-10T04:10:00 *** talluri has quit IRC 2014-12-10T04:11:30 *** talluri has joined #openstack-infra 2014-12-10T04:15:55 *** signed8bit has quit IRC 2014-12-10T04:16:22 *** signed8bit has joined #openstack-infra 2014-12-10T04:17:09 *** mrmartin has joined #openstack-infra 2014-12-10T04:17:45 *** amotoki has quit IRC 2014-12-10T04:24:04 Merged openstack-infra/publications: Tell people to clone template branch using git:// https://review.openstack.org/111366 2014-12-10T04:25:40 *** signed8bit has quit IRC 2014-12-10T04:29:00 *** ddieterly has joined #openstack-infra 2014-12-10T04:32:13 *** dannywilson has joined #openstack-infra 2014-12-10T04:33:12 *** ddieterly has quit IRC 2014-12-10T04:34:28 *** amotoki has joined #openstack-infra 2014-12-10T04:35:30 *** achanda has joined #openstack-infra 2014-12-10T04:36:35 *** dannywilson has quit IRC 2014-12-10T04:37:04 *** Ryan_Lane has quit IRC 2014-12-10T04:37:41 *** Longgeek has joined #openstack-infra 2014-12-10T04:42:21 *** Longgeek has quit IRC 2014-12-10T04:50:10 *** otter768 has joined #openstack-infra 2014-12-10T04:53:59 *** fifieldt has joined #openstack-infra 2014-12-10T04:54:52 *** otter768 has quit IRC 2014-12-10T04:56:42 *** nikil22_ has joined #openstack-infra 2014-12-10T04:59:02 *** Sukhdev has quit IRC 2014-12-10T04:59:23 *** achanda has quit IRC 2014-12-10T05:01:38 *** achanda has joined #openstack-infra 2014-12-10T05:05:05 *** achanda has quit IRC 2014-12-10T05:06:26 *** markmcclain has quit IRC 2014-12-10T05:06:38 *** mestery has quit IRC 2014-12-10T05:06:46 *** harlowja_at_home has joined #openstack-infra 2014-12-10T05:06:51 *** armax has quit IRC 2014-12-10T05:06:55 *** markmcclain has joined #openstack-infra 2014-12-10T05:07:06 *** yfried|afk is now known as yfried_ 2014-12-10T05:07:24 *** hdd has joined #openstack-infra 2014-12-10T05:07:31 *** wenlock has joined #openstack-infra 2014-12-10T05:08:46 *** ddieterly has joined #openstack-infra 2014-12-10T05:11:17 *** mrmartin has quit IRC 2014-12-10T05:11:31 *** markmcclain has quit IRC 2014-12-10T05:11:50 *** koolhead17 has joined #openstack-infra 2014-12-10T05:12:18 *** marun has quit IRC 2014-12-10T05:13:20 *** ddieterly has quit IRC 2014-12-10T05:13:25 *** marun has joined #openstack-infra 2014-12-10T05:15:00 *** radez is now known as radez_g0n3 2014-12-10T05:15:05 *** craigbr has joined #openstack-infra 2014-12-10T05:16:12 *** mmaglana has joined #openstack-infra 2014-12-10T05:18:23 *** craigbr has quit IRC 2014-12-10T05:19:44 *** achanda has joined #openstack-infra 2014-12-10T05:22:23 Joshua Harlow proposed openstack/requirements: Bump up oslo.utils to 1.1.0 https://review.openstack.org/140573 2014-12-10T05:25:17 *** camunoz_mtg has quit IRC 2014-12-10T05:26:26 *** achanda has quit IRC 2014-12-10T05:28:13 *** wenlock has quit IRC 2014-12-10T05:28:44 *** harlowja_away is now known as harlowja 2014-12-10T05:29:39 *** harlowja is now known as harlowja_away 2014-12-10T05:33:19 *** mrmartin has joined #openstack-infra 2014-12-10T05:35:41 *** sabeen has quit IRC 2014-12-10T05:38:42 *** Longgeek has joined #openstack-infra 2014-12-10T05:40:39 *** rushiagr_away is now known as rushiagr 2014-12-10T05:41:35 sweston: Thank you for your config file.It solved my problem.:) 2014-12-10T05:42:38 *** armax has joined #openstack-infra 2014-12-10T05:43:47 *** Longgeek has quit IRC 2014-12-10T05:46:01 *** Sukhdev has joined #openstack-infra 2014-12-10T05:46:45 *** KanagarajM has joined #openstack-infra 2014-12-10T05:47:22 *** yfried_ has quit IRC 2014-12-10T05:48:40 *** viglesias has quit IRC 2014-12-10T05:48:59 *** viglesias has joined #openstack-infra 2014-12-10T05:49:07 *** mrmartin has quit IRC 2014-12-10T05:50:11 *** talluri has quit IRC 2014-12-10T05:50:25 *** sarob has joined #openstack-infra 2014-12-10T05:50:28 *** talluri has joined #openstack-infra 2014-12-10T05:52:54 *** achanda has joined #openstack-infra 2014-12-10T05:52:59 *** wenlock has joined #openstack-infra 2014-12-10T05:53:41 *** gokrokve_ has joined #openstack-infra 2014-12-10T05:55:07 *** esker has joined #openstack-infra 2014-12-10T05:55:31 *** achanda has quit IRC 2014-12-10T05:56:06 *** achanda has joined #openstack-infra 2014-12-10T05:57:06 *** gokrokve has quit IRC 2014-12-10T05:57:41 *** ddieterly has joined #openstack-infra 2014-12-10T05:58:19 *** gokrokve_ has quit IRC 2014-12-10T06:00:48 *** achanda has quit IRC 2014-12-10T06:02:13 *** ddieterly has quit IRC 2014-12-10T06:02:15 *** hdd has quit IRC 2014-12-10T06:05:56 Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 2014-12-10T06:08:15 *** camunoz has joined #openstack-infra 2014-12-10T06:08:31 *** gyee has joined #openstack-infra 2014-12-10T06:16:19 *** koolhead17 has quit IRC 2014-12-10T06:23:57 *** gokrokve has joined #openstack-infra 2014-12-10T06:25:18 *** gokrokve has quit IRC 2014-12-10T06:25:40 *** sarob has quit IRC 2014-12-10T06:25:42 *** gokrokve has joined #openstack-infra 2014-12-10T06:27:49 *** ddieterly has joined #openstack-infra 2014-12-10T06:29:17 *** salv-orl_ has quit IRC 2014-12-10T06:30:16 *** gokrokve has quit IRC 2014-12-10T06:31:42 *** rlandy has joined #openstack-infra 2014-12-10T06:31:57 *** ddieterly has quit IRC 2014-12-10T06:32:07 *** gokrokve has joined #openstack-infra 2014-12-10T06:32:57 *** marun has quit IRC 2014-12-10T06:33:56 *** salv-orlando has joined #openstack-infra 2014-12-10T06:34:21 *** gokrokve_ has joined #openstack-infra 2014-12-10T06:36:51 *** krtaylor has quit IRC 2014-12-10T06:36:57 *** gokrokve has quit IRC 2014-12-10T06:37:42 *** harlowja_at_home has quit IRC 2014-12-10T06:38:03 *** krtaylor has joined #openstack-infra 2014-12-10T06:38:49 *** salv-orlando has quit IRC 2014-12-10T06:39:03 *** gokrokve_ has quit IRC 2014-12-10T06:39:04 *** yfried_ has joined #openstack-infra 2014-12-10T06:41:37 *** reed has quit IRC 2014-12-10T06:45:38 *** salv-orlando has joined #openstack-infra 2014-12-10T06:45:57 *** Longgeek has joined #openstack-infra 2014-12-10T06:46:02 *** teran has joined #openstack-infra 2014-12-10T06:46:22 *** oomichi_ has quit IRC 2014-12-10T06:46:57 *** armax has quit IRC 2014-12-10T06:49:09 *** teran_ has quit IRC 2014-12-10T06:51:00 *** otter768 has joined #openstack-infra 2014-12-10T06:51:48 *** mrunge has joined #openstack-infra 2014-12-10T06:55:52 *** belmoreira has joined #openstack-infra 2014-12-10T06:55:55 *** otter768 has quit IRC 2014-12-10T06:56:18 *** esker has quit IRC 2014-12-10T06:56:45 *** esker has joined #openstack-infra 2014-12-10T07:01:25 *** esker has quit IRC 2014-12-10T07:02:49 *** jgallard_ has joined #openstack-infra 2014-12-10T07:05:47 *** yfried_ is now known as yfried|afk 2014-12-10T07:06:50 *** yfried|afk is now known as yfried_ 2014-12-10T07:08:49 *** e0ne has joined #openstack-infra 2014-12-10T07:09:32 *** _nadya_ has joined #openstack-infra 2014-12-10T07:14:02 *** _nadya_ has quit IRC 2014-12-10T07:15:15 Merged openstack-infra/project-config: Add networking-arisa project to StackForge https://review.openstack.org/140473 2014-12-10T07:16:37 *** Sukhdev has quit IRC 2014-12-10T07:19:27 *** yfried_ is now known as yfried|afk 2014-12-10T07:24:51 *** zz_avozza is now known as avozza 2014-12-10T07:25:00 *** k4n0 has joined #openstack-infra 2014-12-10T07:27:49 *** ddieterly has joined #openstack-infra 2014-12-10T07:28:28 *** koolhead17 has joined #openstack-infra 2014-12-10T07:29:15 *** yfried|afk is now known as yfried_ 2014-12-10T07:31:35 *** salv-orlando has quit IRC 2014-12-10T07:32:15 *** ddieterly has quit IRC 2014-12-10T07:32:21 Andreas Jaeger proposed openstack-infra/system-config: Fix indention in gerrit.config.erb https://review.openstack.org/90031 2014-12-10T07:33:16 *** koolhead17 has quit IRC 2014-12-10T07:43:25 *** masayukig has quit IRC 2014-12-10T07:43:42 *** masayukig has joined #openstack-infra 2014-12-10T07:45:44 *** teran_ has joined #openstack-infra 2014-12-10T07:48:54 *** teran has quit IRC 2014-12-10T07:51:48 Sorry for nagging about this, but https://review.openstack.org/#/c/136811/ seems like it’s ready to land. Is there anything I need to do so it can get an extra +2? 2014-12-10T07:52:51 *** mmaglana has quit IRC 2014-12-10T07:55:25 *** dtantsur|afk is now known as dtantsur 2014-12-10T07:56:31 *** fifieldt has quit IRC 2014-12-10T07:57:00 *** ddieterly has joined #openstack-infra 2014-12-10T07:58:21 *** jerryz has quit IRC 2014-12-10T07:58:26 *** gyee has quit IRC 2014-12-10T07:59:32 *** tnovacik has joined #openstack-infra 2014-12-10T08:00:10 *** markus_z has joined #openstack-infra 2014-12-10T08:00:33 James Polley proposed openstack-infra/zuul: Remove "properly" from error message for clarity https://review.openstack.org/134122 2014-12-10T08:01:29 *** ddieterly has quit IRC 2014-12-10T08:02:09 *** luqas has joined #openstack-infra 2014-12-10T08:02:55 *** teran_ has quit IRC 2014-12-10T08:05:34 *** arxcruz has joined #openstack-infra 2014-12-10T08:05:38 *** jpich has joined #openstack-infra 2014-12-10T08:07:40 *** jerryz has joined #openstack-infra 2014-12-10T08:10:23 *** wenlock has quit IRC 2014-12-10T08:12:44 *** ala_ has joined #openstack-infra 2014-12-10T08:13:34 *** [HeOS] has quit IRC 2014-12-10T08:16:10 *** avozza is now known as zz_avozza 2014-12-10T08:17:42 *** jistr has joined #openstack-infra 2014-12-10T08:20:08 *** ociuhandu has joined #openstack-infra 2014-12-10T08:23:37 *** amuller has joined #openstack-infra 2014-12-10T08:24:58 *** jerryz_ has joined #openstack-infra 2014-12-10T08:25:55 *** stevemar has quit IRC 2014-12-10T08:26:57 *** oomichi has joined #openstack-infra 2014-12-10T08:31:58 *** salv-orlando has joined #openstack-infra 2014-12-10T08:32:37 *** gokrokve has joined #openstack-infra 2014-12-10T08:32:59 *** jcoufal has joined #openstack-infra 2014-12-10T08:36:41 *** e0ne has quit IRC 2014-12-10T08:37:12 *** salv-orlando has quit IRC 2014-12-10T08:37:19 *** koolhead17 has joined #openstack-infra 2014-12-10T08:37:33 *** gokrokve has quit IRC 2014-12-10T08:38:08 *** mpaolino has joined #openstack-infra 2014-12-10T08:39:10 *** jlibosva has joined #openstack-infra 2014-12-10T08:39:22 *** zz_avozza is now known as avozza 2014-12-10T08:40:21 *** nikil22_ has quit IRC 2014-12-10T08:40:26 *** pblaho has joined #openstack-infra 2014-12-10T08:40:51 *** oomichi has quit IRC 2014-12-10T08:41:34 *** MaxV has joined #openstack-infra 2014-12-10T08:44:30 *** ociuhandu has quit IRC 2014-12-10T08:47:07 *** unicell has joined #openstack-infra 2014-12-10T08:47:55 *** andreaf has quit IRC 2014-12-10T08:48:24 *** andreaf has joined #openstack-infra 2014-12-10T08:51:57 *** otter768 has joined #openstack-infra 2014-12-10T08:56:03 *** yfried_ is now known as yfried|afk 2014-12-10T08:56:34 ahmmm, is oslo.context not yet in requirements? 2014-12-10T08:56:57 *** otter768 has quit IRC 2014-12-10T08:57:22 ekarlso-, it's in as far as I can see 2014-12-10T08:57:30 kk, just gotta refresh then here :)= 2014-12-10T08:59:09 *** ociuhandu has joined #openstack-infra 2014-12-10T09:02:48 Devstack was broken due to services split..Is someone know what is the status? 2014-12-10T09:03:39 yolanda.robla proposed openstack-infra/infra-specs: Add nodepool disk image builder testing spec. https://review.openstack.org/139598 2014-12-10T09:03:40 *** nelsnelson has joined #openstack-infra 2014-12-10T09:09:01 *** yfried|afk is now known as yfried_ 2014-12-10T09:10:22 *** ociuhandu has joined #openstack-infra 2014-12-10T09:13:02 *** jedimike has joined #openstack-infra 2014-12-10T09:14:37 *** ociuhandu has quit IRC 2014-12-10T09:17:03 *** derekh has joined #openstack-infra 2014-12-10T09:20:48 *** yfried_ is now known as yfried|afk 2014-12-10T09:23:18 *** Hal_ has joined #openstack-infra 2014-12-10T09:24:35 *** mrunge has quit IRC 2014-12-10T09:25:10 *** [HeOS] has joined #openstack-infra 2014-12-10T09:26:12 *** sabari is now known as zz_sabari 2014-12-10T09:26:31 *** sarob has joined #openstack-infra 2014-12-10T09:28:09 *** mrunge has joined #openstack-infra 2014-12-10T09:31:02 *** sarob has quit IRC 2014-12-10T09:32:34 *** gokrokve has joined #openstack-infra 2014-12-10T09:33:30 *** berendt has joined #openstack-infra 2014-12-10T09:37:05 *** gokrokve has quit IRC 2014-12-10T09:39:57 *** mfink has quit IRC 2014-12-10T09:40:59 *** yfried|afk is now known as yfried_ 2014-12-10T09:41:38 *** e0ne has joined #openstack-infra 2014-12-10T09:45:55 *** salv-orlando has joined #openstack-infra 2014-12-10T09:47:38 *** koolhead17 has quit IRC 2014-12-10T09:47:51 *** teran has joined #openstack-infra 2014-12-10T09:50:43 *** salv-orlando has quit IRC 2014-12-10T09:50:59 *** mrunge has quit IRC 2014-12-10T09:51:28 Aaron Rosen proposed openstack-infra/nodepool: Update Readme config -> system-config repo https://review.openstack.org/134008 2014-12-10T09:51:53 *** ihrachyshka has joined #openstack-infra 2014-12-10T09:54:12 *** jerryz__ has joined #openstack-infra 2014-12-10T09:54:20 *** jerryz__ has quit IRC 2014-12-10T09:54:28 *** jerryz_ has quit IRC 2014-12-10T09:56:48 *** mrunge has joined #openstack-infra 2014-12-10T10:04:07 *** mrmartin has joined #openstack-infra 2014-12-10T10:07:43 *** pelix has joined #openstack-infra 2014-12-10T10:10:32 *** Masahiro has quit IRC 2014-12-10T10:11:16 *** berendt has quit IRC 2014-12-10T10:11:20 *** Masahiro has joined #openstack-infra 2014-12-10T10:12:22 Marton Kiss proposed openstack-infra/system-config: Fix puppet module dependency order https://review.openstack.org/140440 2014-12-10T10:14:18 *** hashar has joined #openstack-infra 2014-12-10T10:14:18 *** yfried_ is now known as yfried|afk 2014-12-10T10:15:18 *** nfedotov has joined #openstack-infra 2014-12-10T10:16:07 *** skolekonov has joined #openstack-infra 2014-12-10T10:17:11 *** dizquierdo has joined #openstack-infra 2014-12-10T10:18:40 *** jcoufal has quit IRC 2014-12-10T10:20:52 *** unicell1 has joined #openstack-infra 2014-12-10T10:22:13 *** unicell has quit IRC 2014-12-10T10:28:31 *** ociuhandu has joined #openstack-infra 2014-12-10T10:28:34 *** ihrachyshka_ has joined #openstack-infra 2014-12-10T10:30:29 *** ihrachyshka has quit IRC 2014-12-10T10:31:31 Derek Higgins proposed openstack-infra/system-config: Add hp1 back running tripleo ci https://review.openstack.org/126513 2014-12-10T10:32:34 *** gokrokve has joined #openstack-infra 2014-12-10T10:33:36 *** Masahiro has quit IRC 2014-12-10T10:34:28 *** yfried|afk is now known as yfried_ 2014-12-10T10:36:52 *** gokrokve has quit IRC 2014-12-10T10:37:44 *** _shaps_ has joined #openstack-infra 2014-12-10T10:40:31 *** jp_at_hp has joined #openstack-infra 2014-12-10T10:41:22 *** dizquierdo has quit IRC 2014-12-10T10:44:01 *** ociuhandu has quit IRC 2014-12-10T10:44:02 *** yaguang has quit IRC 2014-12-10T10:44:20 *** yaguang has joined #openstack-infra 2014-12-10T10:45:44 *** ldnunes has joined #openstack-infra 2014-12-10T10:48:06 *** pblaho has quit IRC 2014-12-10T10:49:58 *** ociuhandu has joined #openstack-infra 2014-12-10T10:51:44 *** amotoki has quit IRC 2014-12-10T10:52:52 *** otter768 has joined #openstack-infra 2014-12-10T10:53:42 Derek Higgins proposed openstack-infra/project-config: Add a tripleo juno overcloud jobs https://review.openstack.org/130540 2014-12-10T10:54:26 *** ociuhandu has quit IRC 2014-12-10T10:55:25 *** yfried_ is now known as yfried|afk 2014-12-10T10:55:51 *** dizquierdo has joined #openstack-infra 2014-12-10T10:56:02 *** jgallard_ has quit IRC 2014-12-10T10:57:09 *** otter768 has quit IRC 2014-12-10T10:57:21 *** ZZelle has quit IRC 2014-12-10T10:57:46 *** ZZelle has joined #openstack-infra 2014-12-10T10:58:31 Derek Higgins proposed openstack-infra/project-config: Add a tripleo juno overcloud jobs https://review.openstack.org/130540 2014-12-10T11:06:59 *** talluri has quit IRC 2014-12-10T11:07:39 *** jkraj has joined #openstack-infra 2014-12-10T11:08:56 *** talluri has joined #openstack-infra 2014-12-10T11:09:33 *** teran has quit IRC 2014-12-10T11:09:57 Marton Kiss proposed openstack-infra/system-config: Enable SSL for groups.openstack.org https://review.openstack.org/138011 2014-12-10T11:10:22 *** jule has quit IRC 2014-12-10T11:11:36 *** teran has joined #openstack-infra 2014-12-10T11:11:38 *** jule has joined #openstack-infra 2014-12-10T11:12:59 *** hashar has quit IRC 2014-12-10T11:13:58 *** cnesa has joined #openstack-infra 2014-12-10T11:15:35 *** yfried|afk is now known as yfried_ 2014-12-10T11:16:00 *** yamamoto_ has quit IRC 2014-12-10T11:17:15 *** jkraj has quit IRC 2014-12-10T11:17:15 *** mika has quit IRC 2014-12-10T11:17:37 *** jp_at_hp has quit IRC 2014-12-10T11:17:40 *** jp_at_hp1 has joined #openstack-infra 2014-12-10T11:17:42 *** jkraj has joined #openstack-infra 2014-12-10T11:19:07 *** mika has joined #openstack-infra 2014-12-10T11:20:43 *** cnesa has quit IRC 2014-12-10T11:21:40 *** jp_at_hp1 has quit IRC 2014-12-10T11:25:54 *** cnesa has joined #openstack-infra 2014-12-10T11:28:13 *** yfried_ is now known as yfried|afk 2014-12-10T11:29:20 *** yaguang has quit IRC 2014-12-10T11:32:07 *** salv-orlando has joined #openstack-infra 2014-12-10T11:32:34 *** gokrokve has joined #openstack-infra 2014-12-10T11:33:21 *** aysyd has joined #openstack-infra 2014-12-10T11:33:37 *** alexpilotti has joined #openstack-infra 2014-12-10T11:34:10 *** andreykurilin_ has joined #openstack-infra 2014-12-10T11:34:34 *** Masahiro has joined #openstack-infra 2014-12-10T11:34:54 *** cnesa2 has joined #openstack-infra 2014-12-10T11:35:04 *** cnesa has quit IRC 2014-12-10T11:36:37 *** salv-orlando has quit IRC 2014-12-10T11:36:52 *** berendt has joined #openstack-infra 2014-12-10T11:37:26 *** gokrokve has quit IRC 2014-12-10T11:37:39 *** kmartin has quit IRC 2014-12-10T11:38:14 *** jamielennox is now known as jamielennox|away 2014-12-10T11:38:55 *** Masahiro has quit IRC 2014-12-10T11:39:36 *** yfried|afk is now known as yfried_ 2014-12-10T11:43:04 *** asselin has quit IRC 2014-12-10T11:45:21 *** _nadya_ has joined #openstack-infra 2014-12-10T11:46:02 *** vigneshvar has joined #openstack-infra 2014-12-10T11:46:09 *** jcoufal has joined #openstack-infra 2014-12-10T11:47:27 *** cdent has joined #openstack-infra 2014-12-10T11:49:51 *** adalbas has joined #openstack-infra 2014-12-10T11:50:17 *** isviridov_away is now known as isviridov 2014-12-10T11:54:27 *** fandi has quit IRC 2014-12-10T11:54:45 *** doug-fish has joined #openstack-infra 2014-12-10T11:55:23 *** talluri has quit IRC 2014-12-10T11:59:22 *** achanda has joined #openstack-infra 2014-12-10T12:00:09 *** mpaolino has quit IRC 2014-12-10T12:00:24 *** e0ne has quit IRC 2014-12-10T12:02:51 *** ddieterly has joined #openstack-infra 2014-12-10T12:03:02 *** bradjones has joined #openstack-infra 2014-12-10T12:08:22 *** zhiwei has quit IRC 2014-12-10T12:09:02 *** david-lyle_afk is now known as david-lyle 2014-12-10T12:17:15 *** david-lyle is now known as david-lyle_afk 2014-12-10T12:17:20 hi i have installed the jenkins master with zuul . Now i see that as a zuul user i am not able to get the gerrit triggers . my gerrit_key file is in "/var/lib/jenkins/.ssh/id_rsa" . Any idea how to solve this 2014-12-10T12:17:39 *** david-lyle_afk is now known as david-lyle 2014-12-10T12:19:05 i have tried using the blog : http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/ 2014-12-10T12:20:58 *** jistr has quit IRC 2014-12-10T12:23:15 *** david-lyle is now known as david-lyle_afk 2014-12-10T12:23:31 *** david-lyle_afk is now known as david-lyle 2014-12-10T12:23:51 *** yamamoto has joined #openstack-infra 2014-12-10T12:24:35 *** nfedotov has left #openstack-infra 2014-12-10T12:26:40 could some one should me the proper docs for setting up the Third party CI system. The standard docs is not having much information 2014-12-10T12:27:31 *** jp_at_hp has joined #openstack-infra 2014-12-10T12:29:23 *** Murad has joined #openstack-infra 2014-12-10T12:29:31 *** amotoki has joined #openstack-infra 2014-12-10T12:31:02 *** mrunge is now known as mrunge_brb 2014-12-10T12:31:10 *** david-lyle is now known as david-lyle_afk 2014-12-10T12:31:22 *** david-lyle_afk is now known as david-lyle 2014-12-10T12:32:36 *** gokrokve has joined #openstack-infra 2014-12-10T12:36:31 *** ryanpetrello has joined #openstack-infra 2014-12-10T12:37:05 *** gokrokve has quit IRC 2014-12-10T12:37:17 *** ociuhandu has joined #openstack-infra 2014-12-10T12:37:46 *** teran has quit IRC 2014-12-10T12:38:18 *** ctlaugh has quit IRC 2014-12-10T12:38:31 *** ctlaugh has joined #openstack-infra 2014-12-10T12:40:34 *** jistr has joined #openstack-infra 2014-12-10T12:46:42 *** Masahiro has joined #openstack-infra 2014-12-10T12:48:29 *** ociuhandu_ has joined #openstack-infra 2014-12-10T12:48:40 *** ociuhandu has quit IRC 2014-12-10T12:48:41 *** ociuhandu_ is now known as ociuhandu 2014-12-10T12:51:22 *** Masahiro has quit IRC 2014-12-10T12:51:23 *** luqas has quit IRC 2014-12-10T12:52:13 *** e0ne has joined #openstack-infra 2014-12-10T12:52:24 *** ctlaugh has quit IRC 2014-12-10T12:52:44 *** Hal_ has quit IRC 2014-12-10T12:53:42 *** otter768 has joined #openstack-infra 2014-12-10T12:54:26 *** dprince has joined #openstack-infra 2014-12-10T12:56:09 *** ctlaugh has joined #openstack-infra 2014-12-10T12:56:14 *** talluri has joined #openstack-infra 2014-12-10T12:58:38 *** otter768 has quit IRC 2014-12-10T12:58:51 *** yfried_ is now known as yfried|afk 2014-12-10T12:58:59 *** ctlaugh has quit IRC 2014-12-10T13:00:18 *** david-lyle is now known as david-lyle_afk 2014-12-10T13:01:09 *** talluri has quit IRC 2014-12-10T13:02:22 *** talluri has joined #openstack-infra 2014-12-10T13:03:41 *** kgiusti has joined #openstack-infra 2014-12-10T13:03:55 *** wuhg has quit IRC 2014-12-10T13:06:16 *** yfried|afk is now known as yfried_ 2014-12-10T13:10:09 *** mwagner_lap has quit IRC 2014-12-10T13:11:13 *** ddieterly has quit IRC 2014-12-10T13:11:43 *** pblaho has joined #openstack-infra 2014-12-10T13:12:39 *** jpich has quit IRC 2014-12-10T13:13:30 *** dkranz has joined #openstack-infra 2014-12-10T13:16:21 *** garyk has joined #openstack-infra 2014-12-10T13:16:53 *** jpich has joined #openstack-infra 2014-12-10T13:16:55 AJaeger: hi, you have a sec for a quick question about https://review.openstack.org/#/c/140409/. 2014-12-10T13:17:11 *** achanda has quit IRC 2014-12-10T13:17:17 garyk, yes 2014-12-10T13:17:39 AJaeger: Do you know where I can read up on what to add to ensure that we get the file history (sorry I am really bad at this stuff) 2014-12-10T13:17:41 It's your call what you do - I just want you to be aware of the pros and cons of importing or not 2014-12-10T13:18:13 AJaeger: what you suggest i great. I would like to go down that path, just not exactly sure what to do to ensure that 2014-12-10T13:18:17 garyk, http://docs.openstack.org/infra/manual/creators.html explain all about setting up a repo. 2014-12-10T13:18:19 *** ctlaugh has joined #openstack-infra 2014-12-10T13:18:26 The importing is not yet good enough explained, see: 2014-12-10T13:18:28 AJaeger: brilliant! thank you 2014-12-10T13:19:22 https://review.openstack.org/#/c/138831/4/doc/source/creators.rst 2014-12-10T13:20:21 AJaeger: thanks! 2014-12-10T13:20:29 garyk, for "exporting", use git filter-branch on a copy of the neutron repo to filter out the history for only those files that are interesting for your new project 2014-12-10T13:20:40 *** bswartz has quit IRC 2014-12-10T13:20:45 And then create from that a new repo, make it available and use the upstream directive to import it. 2014-12-10T13:21:09 ok, thanks. i will check it out 2014-12-10T13:21:46 If you have questions, come back and ask the team. I'm AFK for an hour now... 2014-12-10T13:23:43 ok, thanks 2014-12-10T13:24:01 *** mpaolino has joined #openstack-infra 2014-12-10T13:26:24 *** dkliban_afk is now known as dkliban 2014-12-10T13:27:15 *** andreykurilin_ has quit IRC 2014-12-10T13:28:09 *** vigneshvar has quit IRC 2014-12-10T13:28:39 *** amotoki_ has joined #openstack-infra 2014-12-10T13:30:15 *** _nadya_ has quit IRC 2014-12-10T13:30:21 *** zul has quit IRC 2014-12-10T13:30:56 omrim: i believe there are changes landed in the past 24 hours which disable those in devstack-gate/tempest while the neutron advanced services developers get separate testing going for them 2014-12-10T13:32:03 *** teran has joined #openstack-infra 2014-12-10T13:32:22 *** mpaolino has quit IRC 2014-12-10T13:32:32 *** gokrokve has joined #openstack-infra 2014-12-10T13:33:28 nikil22: if you look in your zuul.conf it's probably trying to use /var/lib/zuul/ssh/id_rsa to authenticate to gerrit? 2014-12-10T13:34:02 *** amuller_ has joined #openstack-infra 2014-12-10T13:34:10 *** amuller has quit IRC 2014-12-10T13:34:49 *** zul has joined #openstack-infra 2014-12-10T13:36:10 *** _nadya_ has joined #openstack-infra 2014-12-10T13:37:01 *** gokrokve has quit IRC 2014-12-10T13:37:13 *** teran_ has joined #openstack-infra 2014-12-10T13:37:40 *** weshay has joined #openstack-infra 2014-12-10T13:39:53 *** yfried_ has quit IRC 2014-12-10T13:40:37 *** teran has quit IRC 2014-12-10T13:41:16 *** Sukhdev has joined #openstack-infra 2014-12-10T13:41:27 fungi: yes it tries to use /var/lib/zuul/ssh/id_rsa 2014-12-10T13:42:08 fungi: the script already copied in that location during instllation time. But the issue is zuul doesn't have permission i think 2014-12-10T13:42:11 nikil22: did you copy your /var/lib/jenkins/.ssh/id_rsa to there? 2014-12-10T13:42:12 zuul user 2014-12-10T13:42:44 nikil22: which permissions? are you talking about your local filesystem permissions? 2014-12-10T13:42:53 Merged openstack-dev/specs-cookiecutter: Add RSS feed https://review.openstack.org/120560 2014-12-10T13:43:11 *** garyk has quit IRC 2014-12-10T13:43:17 *** mrunge_brb has quit IRC 2014-12-10T13:43:18 yes local filesystem permission ; Because if i log in as different user and and use the same key with sudo then it works 2014-12-10T13:43:20 *** eharney has joined #openstack-infra 2014-12-10T13:43:52 fungi: works means like i am able to to ssh -i key_file user-ci@review.openstack.org to get gerrit stream 2014-12-10T13:44:37 nikil22: all the contents of /var/lib/zuul need to be owned by your local zuul user 2014-12-10T13:44:56 *** mpaolino has joined #openstack-infra 2014-12-10T13:45:23 including the /var/lib/zuul/ssh/id_rsa file 2014-12-10T13:45:46 fungi : ok i will take snapshoot and try now. 2014-12-10T13:45:51 *** jerryz has quit IRC 2014-12-10T13:48:44 *** garyk has joined #openstack-infra 2014-12-10T13:49:53 fungi: will chown -R zuul:zuul /var/lib/zull works? because still i get same permission error . 2014-12-10T13:50:56 *** _nadya_ has quit IRC 2014-12-10T13:51:19 *** amotoki has quit IRC 2014-12-10T13:51:25 *** amotoki_ is now known as amotoki 2014-12-10T13:51:35 *** mbacchi has joined #openstack-infra 2014-12-10T13:51:54 *** ddieterly has joined #openstack-infra 2014-12-10T13:52:25 *** MaxV has quit IRC 2014-12-10T13:52:31 *** xyang1 has quit IRC 2014-12-10T13:52:37 *** MaxV has joined #openstack-infra 2014-12-10T13:54:01 *** stevemar has joined #openstack-infra 2014-12-10T13:54:16 *** Longgeek has quit IRC 2014-12-10T13:54:42 nikil22: to help you troubleshoot this, i'll need to know the actual errors you're getting, not your interpretation of what they might mean 2014-12-10T13:56:07 *** pblaho has quit IRC 2014-12-10T13:56:08 *** mwagner_lap has joined #openstack-infra 2014-12-10T13:56:47 jroll: while I'm bugging you about certs ... boot.rackspace.com has a bogus cert 2014-12-10T13:57:10 jroll: http://paste.openstack.org/show/148672/ 2014-12-10T13:57:48 *** jp_at_hp has quit IRC 2014-12-10T13:57:49 jroll: also, I know your job is not ACTUALLY to be our personal support contact - so feel free to tell us to go away 2014-12-10T13:58:02 *** mestery has joined #openstack-infra 2014-12-10T13:59:09 *** jcoufal_ has joined #openstack-infra 2014-12-10T13:59:26 *** nfedotov has joined #openstack-infra 2014-12-10T14:00:08 *** oomichi has joined #openstack-infra 2014-12-10T14:00:44 *** sressot has quit IRC 2014-12-10T14:01:34 *** jp_at_hp has joined #openstack-infra 2014-12-10T14:01:42 *** Longgeek has joined #openstack-infra 2014-12-10T14:01:57 *** jcoufal has quit IRC 2014-12-10T14:03:42 *** sressot has joined #openstack-infra 2014-12-10T14:05:31 *** talluri has quit IRC 2014-12-10T14:06:51 *** doug-fish1 has joined #openstack-infra 2014-12-10T14:06:52 *** doug-fish has quit IRC 2014-12-10T14:07:22 *** bswartz has joined #openstack-infra 2014-12-10T14:08:08 *** luqas has joined #openstack-infra 2014-12-10T14:08:08 fungi: let me know when we can work on stable maint apocalypse 2014-12-10T14:08:49 *** berendt has quit IRC 2014-12-10T14:08:53 ttx: what apocalypsed? 2014-12-10T14:09:05 *** viktors has joined #openstack-infra 2014-12-10T14:09:10 *** eharney has quit IRC 2014-12-10T14:09:22 *** berendt has joined #openstack-infra 2014-12-10T14:09:23 *** berendt has quit IRC 2014-12-10T14:09:24 sdague: refactoring of openstack-stable-maint into $PROJECT-stable-maint and stable-maint-core. 2014-12-10T14:09:53 oh, process appocalypse pony 2014-12-10T14:09:59 http://lists.openstack.org/pipermail/openstack-dev/2014-November/050390.html 2014-12-10T14:10:23 *** kaeso has joined #openstack-infra 2014-12-10T14:11:29 https://www.youtube.com/watch?v=FIY41LrvMFQ 2014-12-10T14:11:35 *** rushiagr is now known as rushiagr_away 2014-12-10T14:12:06 sorry to disturb, who should I (privately) contact for a couple of inquiries regarding openstack.org infrastructure admin/security? 2014-12-10T14:12:42 Monty Taylor proposed openstack-infra/system-config: Add debootstrap to the needed packages for dib https://review.openstack.org/124077 2014-12-10T14:12:42 Monty Taylor proposed openstack-infra/system-config: Make apt skip grabbing translations https://review.openstack.org/136837 2014-12-10T14:12:43 Monty Taylor proposed openstack-infra/system-config: Add rinse to nodepool https://review.openstack.org/136598 2014-12-10T14:14:01 *** koolhead17 has joined #openstack-infra 2014-12-10T14:14:56 *** julim has joined #openstack-infra 2014-12-10T14:15:23 *** esker has joined #openstack-infra 2014-12-10T14:15:30 *** obondarev has joined #openstack-infra 2014-12-10T14:17:19 *** KanagarajM has quit IRC 2014-12-10T14:19:08 *** pc_m has quit IRC 2014-12-10T14:20:03 *** annegent_ has joined #openstack-infra 2014-12-10T14:21:56 *** hashar has joined #openstack-infra 2014-12-10T14:21:59 *** berendt has joined #openstack-infra 2014-12-10T14:22:28 kaeso: fungi seems like the right guy with the right intersection of skills. Contact details at http://www.openstack.org/projects/openstack-security/ 2014-12-10T14:22:45 (fungi being Jeremy Stanley in that list) 2014-12-10T14:23:09 but then, any of those addresses will do. 2014-12-10T14:23:17 *** amuller_ has quit IRC 2014-12-10T14:23:31 *** amuller_ has joined #openstack-infra 2014-12-10T14:23:38 *** bknudson has joined #openstack-infra 2014-12-10T14:23:52 *** mriedem has joined #openstack-infra 2014-12-10T14:23:58 *** mjturek has joined #openstack-infra 2014-12-10T14:24:31 ttx: thanks, mail in progress :) 2014-12-10T14:28:46 *** cpowell has joined #openstack-infra 2014-12-10T14:29:18 *** cpowell has quit IRC 2014-12-10T14:29:40 *** jaypipes has joined #openstack-infra 2014-12-10T14:29:52 *** cpowell has joined #openstack-infra 2014-12-10T14:30:55 fungi: http://paste.openstack.org/show/148693/ 2014-12-10T14:31:09 fungi: i get this error in zuul log 2014-12-10T14:31:13 *** ryanpetrello_ has joined #openstack-infra 2014-12-10T14:31:20 *** mika has quit IRC 2014-12-10T14:31:24 *** armax has joined #openstack-infra 2014-12-10T14:31:32 *** ryanpetrello has quit IRC 2014-12-10T14:31:34 *** mjturek has quit IRC 2014-12-10T14:31:36 *** ryanpetrello_ is now known as ryanpetrello 2014-12-10T14:31:53 *** mjturek has joined #openstack-infra 2014-12-10T14:32:01 *** signed8bit has joined #openstack-infra 2014-12-10T14:32:17 *** mika has joined #openstack-infra 2014-12-10T14:32:42 *** gokrokve has joined #openstack-infra 2014-12-10T14:33:15 *** signed8bit has quit IRC 2014-12-10T14:33:26 *** amitgandhinz has joined #openstack-infra 2014-12-10T14:34:46 *** signed8bit has joined #openstack-infra 2014-12-10T14:35:27 *** Masahiro has joined #openstack-infra 2014-12-10T14:36:28 kaeso: yep, e-mail me at that address, encrypted to my openpgp key if you like 2014-12-10T14:36:53 Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 2014-12-10T14:37:21 *** gokrokve has quit IRC 2014-12-10T14:38:30 *** mestery has quit IRC 2014-12-10T14:39:40 clarkb: since you reviewed the previous patchset and had reservations on it, would appreciate a new review of https://review.openstack.org/#/c/126719/ before I approve it 2014-12-10T14:39:42 *** Masahiro has quit IRC 2014-12-10T14:39:54 *** dims has joined #openstack-infra 2014-12-10T14:40:59 mordred: blah 2014-12-10T14:41:52 *** amuller_ has quit IRC 2014-12-10T14:41:58 *** amuller__ has joined #openstack-infra 2014-12-10T14:42:24 jroll: :) 2014-12-10T14:42:29 jroll: also, good morning 2014-12-10T14:42:42 *** zz_johnthetubagu is now known as johnthetubaguy 2014-12-10T14:42:54 Merged openstack-infra/release-tools: spec2bp v2 -- support in-review specs https://review.openstack.org/108041 2014-12-10T14:43:12 *** koolhead17 has quit IRC 2014-12-10T14:43:53 nikil22: the "connection refused" you see there is at the network layer. looks like zuul is receiving a tcp/rst or icmp rejection packet of some kind attempting to reach tcp port 29418 on review.openstack.org 2014-12-10T14:43:55 *** koolhead17 has joined #openstack-infra 2014-12-10T14:43:56 morning mordred :) 2014-12-10T14:44:06 * jroll needs more coffee for this 2014-12-10T14:44:52 *** berendt has quit IRC 2014-12-10T14:44:53 *** radez_g0n3 is now known as radez 2014-12-10T14:44:55 *** resker has joined #openstack-infra 2014-12-10T14:45:01 nikil22: or else the paramiko library is being very opaque/misleading with its error messages 2014-12-10T14:45:27 *** tonytan4ever has joined #openstack-infra 2014-12-10T14:46:07 fungi: may be this is due to i have used ubuntu 14.04? 2014-12-10T14:46:15 do i need to use ubuntu 12.04 2014-12-10T14:46:16 nikil22: can you su to the zuul user on that machine and run 'ssh -i /var/lib/zuul/ssh/id_rsa -p 29418 yourusername@review.openstack.org gerrit stream-events' 2014-12-10T14:46:34 fungi: let me check 2014-12-10T14:46:47 nikil22: replacing yourusername with the gerrit username listed in your zuul.conf obviously 2014-12-10T14:47:17 *** esker has quit IRC 2014-12-10T14:48:17 *** koolhead17 has quit IRC 2014-12-10T14:48:30 *** rushiagr_away is now known as rushiagr 2014-12-10T14:48:58 fungi: yes the events is successfull 2014-12-10T14:49:03 as zuul user 2014-12-10T14:49:18 nikil22: did it prompt you first to accept an unrecognized ssh host key? 2014-12-10T14:49:26 let me restart the zuul service once 2014-12-10T14:49:41 fungi: yes previously it asked 2014-12-10T14:50:03 fungi: this time it did not ask 2014-12-10T14:50:38 *** hdd has joined #openstack-infra 2014-12-10T14:50:43 oh, okay, so that wasn't it either (though usually when that's the problem it fails with a different error/exception) 2014-12-10T14:50:49 *** ociuhandu has quit IRC 2014-12-10T14:51:32 *** dmsimard_away is now known as dmsimard 2014-12-10T14:51:58 fungi: i have restarted the service still it gives me same error. But now as a zuul user i can confirm that it can communicate to stream-events as zuul user 2014-12-10T14:52:13 fungi: the command you gave works . 2014-12-10T14:52:15 nikil22: and the [gerrit] section of your zuul.conf has server=review.openstack.org and doesn't specify a port= 2014-12-10T14:52:26 *** talluri has joined #openstack-infra 2014-12-10T14:52:37 mordred: turns out boot.rackspace.com is a CNAME to a cloud files container, the ssl hostname for it is https://f97f271e9fde8f434e2a-fa73b8821af96cee574a861a54d04230.ssl.cf3.rackcdn.com 2014-12-10T14:52:49 mordred: though I'm told that ipxe doesn't play nice with https 2014-12-10T14:52:54 jroll: oh! that container. i'd know it on sight ;) 2014-12-10T14:53:03 lol 2014-12-10T14:53:05 it has a very attractive uuid 2014-12-10T14:53:24 *** ociuhandu has joined #openstack-infra 2014-12-10T14:53:42 ttx that script echos the command to run but switches source branch before you can run it. Then deletes the source branch. Is that ok for your workflow 2014-12-10T14:54:00 fungi: yes the server=review.openstack.org and doesn't specify any port. http://paste.openstack.org/show/148715/ 2014-12-10T14:54:04 jroll: anyway, that container's ssl cert ideally needs a serverAltName for any of its cnames (or a wildcard match or something) 2014-12-10T14:54:08 *** pblaho has joined #openstack-infra 2014-12-10T14:54:10 jroll: well, I care little about ipxe - I was more trying to build images that contain nova-agent securely 2014-12-10T14:54:25 jroll: is there another place to download nova-agent from that doesn't have an invalid cert? 2014-12-10T14:54:29 clarkb: hmm, let me think about that a bit 2014-12-10T14:54:37 *** otter768 has joined #openstack-infra 2014-12-10T14:54:38 *** arxcruz has quit IRC 2014-12-10T14:54:41 *** doug-fish1 has quit IRC 2014-12-10T14:54:41 * mordred grosk why boot.rackspace.com might be fine in this situation 2014-12-10T14:54:45 *** Murad has quit IRC 2014-12-10T14:55:00 *** oomichi has quit IRC 2014-12-10T14:55:15 *** doug-fish has joined #openstack-infra 2014-12-10T14:55:21 clarkb: I don't really use that script myself, so I have to try to understand how to use it. It should probably patch README anyway 2014-12-10T14:55:26 mordred: ah, you can just use whatever you were doing, just s/boot.rackspace.com/f97f271e9fde8f434e2a-fa73b8821af96cee574a861a54d04230.ssl.cf3.rackcdn.com 2014-12-10T14:55:47 jroll: https://review.openstack.org/#/c/137860/2/elements/nova-agent/source-repository-nova-agent and https://review.openstack.org/#/c/137860/2/elements/nova-agent/source-repository-xen-tools 2014-12-10T14:56:02 jroll: can I assume that that swift container will never change? 2014-12-10T14:56:05 ttx I think it should either run git review or not delete merge-branch but not sure yet 2014-12-10T14:56:17 clarkb: that echo line might be a debug leftover 2014-12-10T14:56:26 mordred: never is a fun word, I would think yes in general 2014-12-10T14:56:43 especially with the commented line just above 2014-12-10T14:56:56 jroll: :) 2014-12-10T14:56:59 jroll: thanks! 2014-12-10T14:57:00 *** arxcruz has joined #openstack-infra 2014-12-10T14:57:01 clarkb: I'll -1 2014-12-10T14:57:09 ttx ok 2014-12-10T14:57:27 *** yfried_ has joined #openstack-infra 2014-12-10T14:57:50 mordred: np, enjoy 2014-12-10T14:58:23 clarkb: thx! 2014-12-10T14:58:57 *** otter768 has quit IRC 2014-12-10T14:59:42 *** dkranz has quit IRC 2014-12-10T15:00:51 *** obondarev has quit IRC 2014-12-10T15:01:04 how do I determine merge rights on any given repo? jeblair or mordred or ttx will know 2014-12-10T15:01:12 mordred: btw, this would solve the problem: https://feedback.rackspace.com/forums/250746-cloud-hosting/suggestions/5977865-add-ssl-to-cloudfiles 2014-12-10T15:01:23 annegent_: you can look up the Gerrit ACL 2014-12-10T15:01:33 annegent_: you have to look at the acl for that project in gerrit and see what group has workflow +1 permirrion 2014-12-10T15:01:34 ttx: is that in a repo or in Settings? 2014-12-10T15:02:00 example: https://review.openstack.org/#/admin/projects/openstack/governance,access 2014-12-10T15:02:13 fungi: "in gerrit" means in a web browser 2014-12-10T15:02:21 *** resker has quit IRC 2014-12-10T15:02:28 annegent_: there are ways to determine it programmatically. i have a script 2014-12-10T15:02:39 annegent_: but yes, web browser will also work 2014-12-10T15:02:40 fungi: oh ttx's URL works 2014-12-10T15:02:44 *** amuller__ has quit IRC 2014-12-10T15:02:53 fungi: ok and yeah I'll also need to know how to propose changes to it? 2014-12-10T15:03:28 annegent_: gerrit/acls files in openstack-infra/project-config 2014-12-10T15:03:29 annegent_: you need to change the group in the acl, or the members of the group? 2014-12-10T15:03:39 jroll: nice 2014-12-10T15:04:25 annegent_: group membership can be edited in that webui, but to change the acl itself (for example to switch it to a different group) you need a change like ttx describes 2014-12-10T15:04:36 fungi: looks like I need to change members of the group, possibly 2014-12-10T15:04:46 fungi: got my ping from earlier re: stable-maint refactoring ? 2014-12-10T15:04:49 okay, thanks ttx and fungi! 2014-12-10T15:05:10 annegent_: just click on the hyperlinked group name you see and if you're a member of the group (as it's likely self-owned) you can add/remove members 2014-12-10T15:05:14 *** dims has quit IRC 2014-12-10T15:05:14 fungi: we can do it now before meeting, otherwise will have to wait until tomorrow 2014-12-10T15:05:46 nikil22: i'm not seeing any obvious errors, and i see successful ssh connections from your account in the gerrit logs 2014-12-10T15:05:48 *** dims has joined #openstack-infra 2014-12-10T15:05:58 *** zz_dimtruck is now known as dimtruck 2014-12-10T15:05:58 ttx: we can do it now. let me see where i missed the ping 2014-12-10T15:06:04 *** amuller has joined #openstack-infra 2014-12-10T15:06:10 oh, there it is 2014-12-10T15:06:15 heh 2014-12-10T15:06:22 *** oomichi has joined #openstack-infra 2014-12-10T15:06:35 ttx: okay, so do you have a list of the affected projects? 2014-12-10T15:06:44 *** xyang0 has joined #openstack-infra 2014-12-10T15:06:56 fungi: I think I should be able to propose the change if you give me an example (say for nova) 2014-12-10T15:07:04 ttx: ahh, right-o. just a sec 2014-12-10T15:07:12 *** achanda has joined #openstack-infra 2014-12-10T15:07:24 fungi: but no idea what triggers the creation of the groups themselves 2014-12-10T15:07:45 and how to specify who owns them 2014-12-10T15:07:45 ttx: it's automatic, but then i or someone has to seed the initial member(s) 2014-12-10T15:07:58 ttx: and ownership will be a manual change i'll have to make in gerrit for them 2014-12-10T15:08:36 ok, so let's do it this wey, you can give me an example, I can prepare the change to cover all projects we cover..., and then when approved you can add base members and I'll add the other ones. 2014-12-10T15:08:41 ttx: if you look at the openstack/manila acl, the [access "refs/heads/stable/*"] section is what you need 2014-12-10T15:08:55 ttx: but instead of manila-core it would be nova-stable or something 2014-12-10T15:09:07 *** bswartz has quit IRC 2014-12-10T15:09:14 fungi: could you tell me that the successfull connection is keep on coming. Because the successfull connection might be the one which i tried manually 2014-12-10T15:09:41 nikil22: yes, is zuul retrying to connect over and over? i'll check the log and see what the most recent connection was 2014-12-10T15:09:50 fungi: openstack-stable-maint generic control over stable branches must appear somewhere too, need to switch it to stable-maint-core and inherit it 2014-12-10T15:09:52 *** salv-orlando has joined #openstack-infra 2014-12-10T15:10:12 ttx: yep, i can add it as an inlcuded group in each of the project-specific groups 2014-12-10T15:10:27 Ah, that would work 2014-12-10T15:10:30 fungi: oh sorry, had to go afk, can I privmsg you a sec before writing a longer mail? 2014-12-10T15:10:31 *** Longgeek has quit IRC 2014-12-10T15:10:37 kaeso: sure 2014-12-10T15:10:41 *** dims has quit IRC 2014-12-10T15:10:44 fungi: ok, let me try this 2014-12-10T15:11:47 nikil22: last connection from ib-ipam-ci at 12.164.170.130 was 14:48:32 utc, about 23 minutes ago 2014-12-10T15:12:09 fungi: any idea where openstack-stable-maint is defined for, say, nova ? It's not in the nova acl 2014-12-10T15:12:12 *** Hal_ has joined #openstack-infra 2014-12-10T15:12:16 *** Hal_ has quit IRC 2014-12-10T15:12:32 fungi: or should I just overwrite it same style as in manila acl 2014-12-10T15:12:32 *** dkranz has joined #openstack-infra 2014-12-10T15:12:45 I think we inherit some default from somewhere here 2014-12-10T15:12:51 but can't find it 2014-12-10T15:13:18 fungi: then i guess that was the manuall one. Because i see that zuul is keep on trying to pull and i see these errors 2014-12-10T15:13:40 only designate seems to explicitely mention openstack-stable-maint. Default config somewhere ? 2014-12-10T15:13:43 *** yamamoto has quit IRC 2014-12-10T15:13:51 *** esker has joined #openstack-infra 2014-12-10T15:14:28 *** oomichi has quit IRC 2014-12-10T15:14:37 *** mestery has joined #openstack-infra 2014-12-10T15:14:44 *** Longgeek has joined #openstack-infra 2014-12-10T15:14:48 ttx in all-projects which isnot managed by puppet 2014-12-10T15:14:58 *** fandi has joined #openstack-infra 2014-12-10T15:15:00 *** armax has quit IRC 2014-12-10T15:15:01 you can see those acls in gerrit directly 2014-12-10T15:15:48 clarkb: hmm. maybe simpler to make stable-maint-core part of the explicitly-declared group then, rather than rely on inheritance 2014-12-10T15:15:55 will ensure transition 2014-12-10T15:16:09 *** eharney has joined #openstack-infra 2014-12-10T15:16:16 ok, let me see what I can come up with. 2014-12-10T15:19:44 *** lttrl has joined #openstack-infra 2014-12-10T15:20:24 *** sabeen has joined #openstack-infra 2014-12-10T15:20:53 *** salv-orlando has quit IRC 2014-12-10T15:21:53 *** rkukura_ has joined #openstack-infra 2014-12-10T15:22:00 *** fandi has quit IRC 2014-12-10T15:23:04 *** fandi has joined #openstack-infra 2014-12-10T15:23:32 ttx: sorry, too many conversations at once. openstack-stable-maint is handled in the all-projects global act inherited by every project right now. we would lift that once we get the per-project groups added with that group included in each of them 2014-12-10T15:23:41 s/act/acl/ 2014-12-10T15:23:54 oh, clarkb answered anyway 2014-12-10T15:24:37 *** r-daneel has joined #openstack-infra 2014-12-10T15:24:38 *** dustins has joined #openstack-infra 2014-12-10T15:24:49 *** rkukura has quit IRC 2014-12-10T15:24:49 *** rkukura_ is now known as rkukura 2014-12-10T15:25:06 *** vdo has joined #openstack-infra 2014-12-10T15:25:24 If anybody has a chance could I get some eyes on adding hp1 back running tripleo ci - https://review.openstack.org/#/c/126513/ 2014-12-10T15:25:37 *** _nadya_ has joined #openstack-infra 2014-12-10T15:26:04 *** _nadya_ has quit IRC 2014-12-10T15:26:07 *** talluri has quit IRC 2014-12-10T15:26:47 *** emagana has joined #openstack-infra 2014-12-10T15:27:03 *** mrmartin has quit IRC 2014-12-10T15:27:36 *** _nadya_ has joined #openstack-infra 2014-12-10T15:28:18 *** patrickeast has joined #openstack-infra 2014-12-10T15:28:20 nikil22: yeah, so something is blocking those egress connections presumably (or is your zuul maybe using a different zuul.conf than the one you think it is?) 2014-12-10T15:28:47 derekh: i don't think we explicitly removed it, but i'll check 2014-12-10T15:29:09 *** zz_jgrimm is now known as jgrimm 2014-12-10T15:30:01 fungi: thanks, we set the max-servers: at 0 so it wasn't being used, this increases to 90 2014-12-10T15:30:02 *** obondarev has joined #openstack-infra 2014-12-10T15:30:05 *** gokrokve has joined #openstack-infra 2014-12-10T15:30:07 *** esker has quit IRC 2014-12-10T15:30:15 *** pc_m has joined #openstack-infra 2014-12-10T15:30:59 fungi: note this is a new cloud 2014-12-10T15:31:27 derekh: max-servers isn't 0 it's 60 at the moment, but yes we seem to have removed it from the labels 2014-12-10T15:31:28 good morning folks 2014-12-10T15:31:55 *** esker has joined #openstack-infra 2014-12-10T15:31:56 derekh: aha, in hp1 2014-12-10T15:32:08 fungi, I just saw that switch to the self-controlled groups for 3rd party ci has not been applied to all projects, for example it's not applied for sahara :) 2014-12-10T15:32:08 *** teran_ has quit IRC 2014-12-10T15:32:09 derekh: sorry, i misread and thought you said rh1 2014-12-10T15:32:12 moar coffee 2014-12-10T15:32:32 fungi, should I try to re-run jjb on gerrit? 2014-12-10T15:32:37 fungi: no prob 2014-12-10T15:33:03 *** arxcruz has quit IRC 2014-12-10T15:33:07 dhellmann: hi, any chance you can please look at https://review.openstack.org/136614? 2014-12-10T15:33:16 SergeyLukjanov: i think clarkb queried gerrit to find which ci accounts were leaving verify votes and only added groups for those which had accounts voting on them 2014-12-10T15:33:22 SergeyLukjanov: it should be applied to sahara 2014-12-10T15:33:39 fungi, clarkb, oh, I think I've used bad wording 2014-12-10T15:33:51 garyk: +2a 2014-12-10T15:33:58 fungi, clarkb, in https://github.com/openstack-infra/project-config/blob/master/gerrit/acls/openstack/sahara.config there is a rule "label-Verified = -1..+1 group sahara-ci" 2014-12-10T15:34:06 fungi: i am sure my iptables is not blocking any ports. Let me debug more and confirm that zuul uses proper conf file 2014-12-10T15:34:09 oh right sahara didn't have anything vote on it 2014-12-10T15:34:30 dhellmann: thanks! 2014-12-10T15:34:31 SergeyLukjanov: oh I see now 2014-12-10T15:34:40 fungi, clarkb, but there is no corresponding permission in gerrit - https://review.openstack.org/#/admin/projects/openstack/sahara,access 2014-12-10T15:34:41 *** julim has quit IRC 2014-12-10T15:34:44 *** marcusvrn1 has joined #openstack-infra 2014-12-10T15:34:44 *** marcusvrn has quit IRC 2014-12-10T15:34:55 acl didn't get applied? or is that a stale acl file and sahara uses a different one overridden in projects.yaml? 2014-12-10T15:34:56 clarkb, looks like ACL file is just not applied 2014-12-10T15:35:00 fungi, yeah 2014-12-10T15:35:25 ya so I think you want to run `manage-projects -d openstack/sahara` 2014-12-10T15:35:25 *** rkukura has quit IRC 2014-12-10T15:35:30 *** hdd has quit IRC 2014-12-10T15:35:33 clarkb, on gerrit node? 2014-12-10T15:35:38 Thierry Carrez proposed openstack-infra/project-config: Introduce project-specific stable-maint teams https://review.openstack.org/140738 2014-12-10T15:35:42 fungi: ^ 2014-12-10T15:35:46 clarkb: how much have you played with the fixtures.MonkeyPatch? 2014-12-10T15:35:53 *** Sukhdev has quit IRC 2014-12-10T15:35:54 ttx, yay! 2014-12-10T15:35:55 SergeyLukjanov: yup, if you look in roots histor you should see similar commands 2014-12-10T15:36:00 sdague: I think so 2014-12-10T15:36:02 *** julim has joined #openstack-infra 2014-12-10T15:36:05 clarkb, thank you, will try 2014-12-10T15:36:05 because I found a case where it didn't seem to work at all like it was expected 2014-12-10T15:36:12 clarkb: SergeyLukjanov: yep, that does appear to be the correct acl file, so something must still be racy on m-p group creation sometimes? 2014-12-10T15:36:16 *** arxcruz has joined #openstack-infra 2014-12-10T15:36:24 SergeyLukjanov: Note that I aligned sahara, even if technically you own stable/icehouse. 2014-12-10T15:36:41 sdague: oh? 2014-12-10T15:36:47 SergeyLukjanov: we'll make sure sahara-stable-maint contains the right people for you to be able to continue doing that 2014-12-10T15:37:05 ttx: you're going to need the exlcusive line in those 2014-12-10T15:37:08 sdague: it basically monkey patches a name until the cleanup runs so you get sane monkey patching per test case 2014-12-10T15:37:09 *** wenlock has joined #openstack-infra 2014-12-10T15:37:18 ttx, I think it'll be the same list as for juno, so, it's ok, thank you 2014-12-10T15:37:27 yeh except, it does it through some magical imports, which might fail 2014-12-10T15:37:32 fungi: why ? It's not on the proposed/* ACL 2014-12-10T15:37:36 that it masks the failures 2014-12-10T15:37:54 sdague: is it importing to make sure that both things (dest and patch) are available? 2014-12-10T15:37:57 *** obondarev has quit IRC 2014-12-10T15:38:01 maybe if I show you my example, you can help me figure out why it doesn't work 2014-12-10T15:38:08 sdague: sure 2014-12-10T15:38:13 ttx: without that, it's still overridden from all-projects 2014-12-10T15:39:11 ttx: also, when we remove the entry from all-projects, it will be necessary to prevent inheritence from higher-level ref matches 2014-12-10T15:39:13 *** obondarev has joined #openstack-infra 2014-12-10T15:39:15 fungi: hmm, if the net effect is just that openstack-stable-maint still ahs rights during the transition, that sounds like a feature to me. Or is there more ? 2014-12-10T15:39:15 *** marcusvrn1 has quit IRC 2014-12-10T15:39:34 oh, hm 2014-12-10T15:39:47 *** marcusvrn has joined #openstack-infra 2014-12-10T15:40:27 ttx: the way gerrit's acls work by default is that permissions on refs/heads/* are cumulative with those on refs/heads/stable/* 2014-12-10T15:40:29 clarkb, "invalid project configuration" 2014-12-10T15:40:38 ttx: exclusiveGroupPermissions is the way around inheriting 2014-12-10T15:41:00 *** marcusvrn1 has joined #openstack-infra 2014-12-10T15:41:09 ok, that means we'll have to populate groups soon afetr we push the change 2014-12-10T15:41:18 SergeyLukjanov: is there more log involved? would be good to see where that happens 2014-12-10T15:41:28 * ttx adds exclusivity lines 2014-12-10T15:41:32 clarkb, it's on the push to config stage 2014-12-10T15:41:33 ttx: yep, i plan to do it immediately after that's merged and applied via manage-projects 2014-12-10T15:42:01 clarkb, " ! [remote rejected] HEAD -> refs/meta/config (invalid project configuration) 2014-12-10T15:42:45 sdague: http://bazaar.launchpad.net/~testing-cabal/python-fixtures/master/view/head:/fixtures/_fixtures/monkeypatch.py#L45 looking at the source that is what it appeas to be trying to do. It is making sure the thing to be monkey patched is already imported 2014-12-10T15:42:47 *** marcusvrn has quit IRC 2014-12-10T15:43:09 SergeyLukjanov: huh, there must be something wrong with the file then which is odd because saharaclient was fine 2014-12-10T15:43:32 clarkb, saharaclient uses another ACL file 2014-12-10T15:43:58 clarkb, I need to go to the PTL Webinar, will digg into it after the webinar 2014-12-10T15:44:02 *** achanda has quit IRC 2014-12-10T15:44:22 SergeyLukjanov: oh that may explain it then 2014-12-10T15:44:27 *** marcusvrn has joined #openstack-infra 2014-12-10T15:44:28 ya I will look quickly to see if I see anything 2014-12-10T15:44:28 *** xyang0 has quit IRC 2014-12-10T15:44:58 clarkb, thx 2014-12-10T15:45:02 *** teran has joined #openstack-infra 2014-12-10T15:45:14 *** teran has quit IRC 2014-12-10T15:45:17 *** dmsimard is now known as dmsimard_away 2014-12-10T15:45:20 *** teran has joined #openstack-infra 2014-12-10T15:45:26 Thierry Carrez proposed openstack-infra/project-config: Introduce project-specific stable-maint teams https://review.openstack.org/140738 2014-12-10T15:45:27 *** marcusvrn1 has quit IRC 2014-12-10T15:45:35 looks like it would've broken way back in august 2014-12-10T15:45:42 or at least that was the last time we successfully updated it 2014-12-10T15:45:43 fungi: ^should be better 2014-12-10T15:46:15 *** marun has joined #openstack-infra 2014-12-10T15:46:26 ttx: thanks--looking now 2014-12-10T15:46:35 derekh: i'll check your nodepool change after this 2014-12-10T15:47:19 fungi: cool, thanks 2014-12-10T15:48:21 *** dmsimard_away is now known as dmsimard 2014-12-10T15:48:27 *** _buzz_ has joined #openstack-infra 2014-12-10T15:48:37 *** obondarev has quit IRC 2014-12-10T15:49:15 *** marcusvrn has quit IRC 2014-12-10T15:49:54 clarkb: so - https://review.openstack.org/#/c/140741/ 2014-12-10T15:50:01 that doesn't do what you think it's going to do 2014-12-10T15:50:27 *** craigbr has joined #openstack-infra 2014-12-10T15:51:40 *** _buzz has quit IRC 2014-12-10T15:52:03 sdague: it should attempt to import that thing, fail, then import oslo.messaging if I read this correctly 2014-12-10T15:52:14 sdague: I think you just need to import the thing you want first? 2014-12-10T15:52:21 ttx: change lgtm, but what's the group configuration plan look like? we make openstack-stable-maint (optionally renamed) an included group in each of those and set the group owner to openstack-stable-maint as well? and let someone in openstack-stable-maint add per-project members as appropriate? 2014-12-10T15:52:52 clarkb: so... I have tried many invocations of this with various imports 2014-12-10T15:52:54 sdague: ya I think that if you just import oslo.messaging._drivers.impl_fake 2014-12-10T15:53:04 ttx: or will the groups be self-owned so that per-project stable teams can add/remove members themselves? 2014-12-10T15:53:07 then that will be imported so it can get monke patched 2014-12-10T15:53:17 ttx: oh, you outlined it in the commit message 2014-12-10T15:53:27 ttx: nevermind. works for me 2014-12-10T15:53:48 sdague: the problem here is monkeypatch says "I will try to import this thing for you but not scream if I can't because maybe you gave me a class method" which you did 2014-12-10T15:54:01 trying to think if monkey patch could scream about issues a bit better though 2014-12-10T15:54:05 ttx: if clarkb or another project-config core wants to give it a once-over, then i can make the group edits as soon as it's applied 2014-12-10T15:54:16 fungi: yes, we create a new group 2014-12-10T15:54:23 clarkb: so ... no one using this fixture understands that subtlety 2014-12-10T15:54:34 well maybe not no one 2014-12-10T15:54:49 sdague: its how monkey patching works 2014-12-10T15:54:53 but in my look on how it's used in the tree, I'm pretty sure lots of people are getting this wrong 2014-12-10T15:54:57 sdague: if the name isn't available then you monkey patch nothing 2014-12-10T15:55:01 *** salv-orlando has joined #openstack-infra 2014-12-10T15:55:04 under the assumption that the fixture did the right thing 2014-12-10T15:55:09 this is true regardless of fixture or other tool 2014-12-10T15:55:18 ttx: is the new stable-maint-core group a renamed openstack-stable-maint with the original members, or a separate/smaller group entirely? 2014-12-10T15:55:21 python lets you say x = y 2014-12-10T15:55:23 *** achanda has joined #openstack-infra 2014-12-10T15:55:23 fungi: you can add me as initial member/owner of stable-maint-core, then stable-maint-core as initial member/owner of $PROJECT-stable-maint groups 2014-12-10T15:55:26 that is how python works 2014-12-10T15:55:27 clarkb: yep 2014-12-10T15:55:40 ttx: okay, can do 2014-12-10T15:55:46 fungi: smaller group / new group. Not the same role, much smaller group 2014-12-10T15:56:03 the idea is to have that "core" group the guardians of the policy 2014-12-10T15:56:04 ttx: but also include the old openstack-stable-maint in all of the per-project stable groups? 2014-12-10T15:56:07 *** garyk has quit IRC 2014-12-10T15:56:13 fungi: no, we'll delete that one. 2014-12-10T15:56:24 ah.. for transition, I guess 2014-12-10T15:56:32 *** bswartz has joined #openstack-infra 2014-12-10T15:56:42 you can initially add it, I can remove it when i'm done editing the group 2014-12-10T15:56:44 ttx: okay, stable-maint-core can of course remove it as an included group at your discretion 2014-12-10T15:56:57 sdague: this is similar to how oslo.config breaks unittests because no one understands you have to import the thing that defines a config value before it is available to you 2014-12-10T15:57:05 that way it shouldn't break waiting for me to edit group 2014-12-10T15:57:07 ttx: also i can set stable-maint-core as the owner of openstack-stable-maint if desired 2014-12-10T15:57:08 sdague: if you try to use that thing before you have imported it sadness happens 2014-12-10T15:57:14 clarkb: sure 2014-12-10T15:57:18 fungi: works for me 2014-12-10T15:57:25 *** btran has quit IRC 2014-12-10T15:57:34 except the fixture half heartidly works some times 2014-12-10T15:57:44 ttx: right now it seems to be owned by the release managers group 2014-12-10T15:58:03 because if the thing is a top level function in a namespace, it manages the import 2014-12-10T15:58:09 *** armax has joined #openstack-infra 2014-12-10T15:58:10 ttx: do you then want release managers as the owner of stable-maint-core or make stable-maint-core self-owned? 2014-12-10T15:58:17 right just like oslo.config half heartidly works some times... 2014-12-10T15:58:28 fungi: self-owned with me as initial member 2014-12-10T15:58:32 both could do a better job at making it known when stuff is not imported 2014-12-10T15:58:40 *** belmoreira has quit IRC 2014-12-10T15:58:50 ttx: got it 2014-12-10T15:58:53 *** wznoinsk has quit IRC 2014-12-10T16:00:27 clarkb: yeh 2014-12-10T16:00:57 *** wznoinsk has joined #openstack-infra 2014-12-10T16:01:24 *** hashar has quit IRC 2014-12-10T16:01:29 *** Sukhdev has joined #openstack-infra 2014-12-10T16:01:38 *** hashar has joined #openstack-infra 2014-12-10T16:01:50 ttx: okay, the stable-maint-core group is set up self-owned with you as initial member and switched to be the owner of the openstack-stable-maint group. i'll make the per-project stable-maint groups owned by stable-maint-core with openstack-stable-maint as an included group as soon as 140738 lands 2014-12-10T16:02:19 fungi: ttx: the change looks good though the centos6 apply job failed due to haproxy not applying cleanly for some reason. I don't think that is related to this change 2014-12-10T16:02:30 *** achanda has quit IRC 2014-12-10T16:02:37 ack 2014-12-10T16:02:40 looks like puppet concat had a sad 2014-12-10T16:02:40 *** mfink has joined #openstack-infra 2014-12-10T16:02:46 *** hashar has quit IRC 2014-12-10T16:02:49 I am going to recheck to see if this is consistent 2014-12-10T16:02:50 ttx: after that, i'll remove the old refs/heads/stable/* sections from the all-projects acl and look for other acls which can be cleaned up now that they'll no longer need to override it 2014-12-10T16:03:05 fungi: sounds like a plan 2014-12-10T16:03:13 *** hashar has joined #openstack-infra 2014-12-10T16:03:44 * dhellmann wishes sdague and clarkb would file bugs instead of trash-talking other contributors in this channel 2014-12-10T16:04:25 *** emagana_ has joined #openstack-infra 2014-12-10T16:04:51 * dhellmann walks away for a while 2014-12-10T16:05:32 dhellmann: I tried 2014-12-10T16:05:48 dhellmann: was explicitly told by markmc ~1.5 years ago that this was a design feature/expected/wontfix 2014-12-10T16:06:02 *** asselin has joined #openstack-infra 2014-12-10T16:06:05 *** wenlock has quit IRC 2014-12-10T16:06:08 dhellmann: and to a degree it is. This is how python works. Unfortunately it is a thing that also trips people up constantly 2014-12-10T16:06:49 *** hashar has quit IRC 2014-12-10T16:07:17 sdague, clarkb: is fixtures not moved to git yet? 2014-12-10T16:07:24 mordred: not that I could see 2014-12-10T16:07:46 https://github.com/testing-cabal/fixtures 2014-12-10T16:08:01 *** emagana has quit IRC 2014-12-10T16:09:11 mordred: yes it is 2014-12-10T16:09:29 seems like it it should be possible to fix the import logic there to make sure it always manages the import 2014-12-10T16:09:30 I'm trying to develop a test case right now 2014-12-10T16:09:31 pypi still says launchpad which is where I got link to above code 2014-12-10T16:09:42 clarkb: yeh, they moved it to github 2014-12-10T16:09:43 *** jpich has quit IRC 2014-12-10T16:09:52 I put over a PR as soon as it landed to fix a log fixture 2014-12-10T16:10:15 *** dtantsur is now known as dtantsur|brb 2014-12-10T16:10:19 mordred: yeh, mostly I needed to understand what it was or was not doing correctly, hence poking clarkb 2014-12-10T16:10:27 *** jistr has quit IRC 2014-12-10T16:11:13 *** kmartin has joined #openstack-infra 2014-12-10T16:11:34 I think I would prefer it to throw an exception if the thing being monkey patched is not imported 2014-12-10T16:11:46 then you don't have to rely on it to always import properly, it pushes that off on you to do what you need 2014-12-10T16:12:05 clarkb: yeh, possibly 2014-12-10T16:12:42 I think this gets into the crazy logic that hacking has over finding symbols 2014-12-10T16:12:44 *** dangers_away is now known as dangers 2014-12-10T16:12:57 Ivan Udovichenko proposed openstack-infra/system-config: Remove hardcoded variables from openstack_project module (template) https://review.openstack.org/140758 2014-12-10T16:13:07 I actually just deleted a nova specific setup function that did exactly this... poorly 2014-12-10T16:13:10 *** achanda_ has joined #openstack-infra 2014-12-10T16:13:15 *** jkraj has quit IRC 2014-12-10T16:13:17 and turned out to not be working when it was used 2014-12-10T16:13:49 but it should be relatively simple to say "does this name exist" 2014-12-10T16:13:54 and throw an error if not 2014-12-10T16:13:59 *** shashankhegde has joined #openstack-infra 2014-12-10T16:14:12 ++ to throwing error 2014-12-10T16:14:14 *** yamamoto has joined #openstack-infra 2014-12-10T16:17:17 *** skolekonov has quit IRC 2014-12-10T16:18:15 *** e0ne_ has joined #openstack-infra 2014-12-10T16:18:30 *** rlandy has quit IRC 2014-12-10T16:19:05 *** yamamoto has quit IRC 2014-12-10T16:19:09 *** spzala has joined #openstack-infra 2014-12-10T16:19:15 *** e0ne has quit IRC 2014-12-10T16:19:15 yeh well the test case will be mostly the same either way 2014-12-10T16:19:25 hmmm... running tests in fixtures repo.... 2014-12-10T16:21:11 oh, it's got a makefile. I can get behind that 2014-12-10T16:23:17 *** dannywilson has joined #openstack-infra 2014-12-10T16:23:34 *** gokrokve has quit IRC 2014-12-10T16:23:37 *** _buzz_ has quit IRC 2014-12-10T16:23:46 *** dannywilson has quit IRC 2014-12-10T16:23:57 *** dannywilson has joined #openstack-infra 2014-12-10T16:24:11 *** Masahiro has joined #openstack-infra 2014-12-10T16:24:21 hmph 2014-12-10T16:24:36 so the test class that should fail, isn't 2014-12-10T16:25:05 *** shashankhegde has quit IRC 2014-12-10T16:25:28 *** resker has joined #openstack-infra 2014-12-10T16:26:35 *** resker has quit IRC 2014-12-10T16:26:40 clarkb: so - https://github.com/sdague/fixtures/commit/eeac75e6c414be75dc2bd875e62af8ec2937c971 should fail in the same way, right? 2014-12-10T16:27:08 *** resker has joined #openstack-infra 2014-12-10T16:27:19 *** ryanpetrello has quit IRC 2014-12-10T16:28:27 *** erikmwilson has quit IRC 2014-12-10T16:28:29 *** ryanpetrello has joined #openstack-infra 2014-12-10T16:28:33 *** Masahiro has quit IRC 2014-12-10T16:28:39 *** erikmwilson has joined #openstack-infra 2014-12-10T16:28:51 *** mpaolino has quit IRC 2014-12-10T16:29:04 *** obondarev has joined #openstack-infra 2014-12-10T16:29:14 *** esker has quit IRC 2014-12-10T16:29:21 *** annegent_ has quit IRC 2014-12-10T16:29:45 *** mikedillion has joined #openstack-infra 2014-12-10T16:30:08 *** e0ne_ is now known as e0ne 2014-12-10T16:30:33 *** gokrokve has joined #openstack-infra 2014-12-10T16:32:01 *** dims has joined #openstack-infra 2014-12-10T16:34:52 *** erikmwilson is now known as Guest30554 2014-12-10T16:34:59 Davanum Srinivas (dims) proposed openstack-infra/project-config: Check requirements for taskflow https://review.openstack.org/140764 2014-12-10T16:35:42 sdague: maybe the test suite imports all that stuff implicitly? but yes at first glance I would expect that to fail too 2014-12-10T16:35:56 *** yaguang has joined #openstack-infra 2014-12-10T16:36:09 *** erikmwilson has joined #openstack-infra 2014-12-10T16:36:44 *** dims has quit IRC 2014-12-10T16:36:55 *** dims has joined #openstack-infra 2014-12-10T16:37:12 testtools.run is all it's doing 2014-12-10T16:38:41 *** adalbas has quit IRC 2014-12-10T16:38:59 sdague: this one helps with running project-requirements-change.py locally esp with project that have not signed upto be in global req sync. can you please take a look when you get a chance? https://review.openstack.org/#/c/138710/ 2014-12-10T16:39:43 dims: I'm not sure I understand the --local really there? 2014-12-10T16:41:33 clarkb: yep, you are right 2014-12-10T16:41:44 the way load tests work it invalidates things 2014-12-10T16:41:59 *** vigneshvar has joined #openstack-infra 2014-12-10T16:42:02 *** erikmwilson is now known as Guest25434 2014-12-10T16:42:40 *** [BNC]erikmwilson has joined #openstack-infra 2014-12-10T16:44:19 *** ihrachyshka_ has quit IRC 2014-12-10T16:44:47 *** mikedillion has quit IRC 2014-12-10T16:45:14 *** julim has quit IRC 2014-12-10T16:45:41 *** shakamunyi has quit IRC 2014-12-10T16:45:58 *** simonmcc has quit IRC 2014-12-10T16:46:09 *** jlibosva has quit IRC 2014-12-10T16:46:21 *** ctracey has quit IRC 2014-12-10T16:46:27 *** markus_z has quit IRC 2014-12-10T16:46:44 *** zhiyan has quit IRC 2014-12-10T16:46:47 sdague: the current code looks at the last changeset, i want it to run against the full requirements.txt file 2014-12-10T16:47:07 *** serverascode___ has quit IRC 2014-12-10T16:47:31 *** ameade_ has quit IRC 2014-12-10T16:48:10 *** jraim has quit IRC 2014-12-10T16:49:42 dims: oh, gotcha 2014-12-10T16:49:56 clarkb: https://github.com/testing-cabal/fixtures/pull/3 - so that's a test case which does fail 2014-12-10T16:50:00 *** julim has joined #openstack-infra 2014-12-10T16:51:17 *** nikil22 has quit IRC 2014-12-10T16:52:01 *** armax has quit IRC 2014-12-10T16:53:33 *** zz_sabari is now known as sabari 2014-12-10T16:53:50 Merged openstack/requirements: Upgrade oslo.vmware>=0.7.0 https://review.openstack.org/136614 2014-12-10T16:55:30 *** otter768 has joined #openstack-infra 2014-12-10T16:56:09 *** yaguang has quit IRC 2014-12-10T16:56:41 *** emagana_ has quit IRC 2014-12-10T16:57:04 *** mpaolino has joined #openstack-infra 2014-12-10T16:58:17 *** arxcruz has quit IRC 2014-12-10T16:58:48 *** achanda_ has quit IRC 2014-12-10T17:00:01 *** amuller has quit IRC 2014-12-10T17:00:06 *** otter768 has quit IRC 2014-12-10T17:00:38 *** viktors is now known as viktors|afk 2014-12-10T17:02:15 *** amotoki has quit IRC 2014-12-10T17:02:22 *** achanda has joined #openstack-infra 2014-12-10T17:02:31 *** garyk has joined #openstack-infra 2014-12-10T17:03:12 *** julim has quit IRC 2014-12-10T17:03:19 *** doug-fish has quit IRC 2014-12-10T17:03:36 *** armax has joined #openstack-infra 2014-12-10T17:03:49 *** armax has quit IRC 2014-12-10T17:06:11 *** david-lyle_afk is now known as david-lyle 2014-12-10T17:06:37 *** julim has joined #openstack-infra 2014-12-10T17:07:05 *** asselin has quit IRC 2014-12-10T17:08:26 *** mpaolino has quit IRC 2014-12-10T17:08:30 *** emagana has joined #openstack-infra 2014-12-10T17:09:42 *** dmsimard is now known as dmsimard_away 2014-12-10T17:10:46 Dmitry Teselkin proposed openstack-infra/zuul: Whitelist for gerrit events https://review.openstack.org/137634 2014-12-10T17:10:48 sc68cal: mtreinish: wanted to catch up on ipv6. Is that tempest test counting IPs the only issue so far? (want to make sure I haven't just asked you guys to fix half a million bugs to get that d-g change in) 2014-12-10T17:11:31 *** shayneburgess has quit IRC 2014-12-10T17:11:33 clarkb: it's the first issue to crop up 2014-12-10T17:11:44 clarkb: no guarantee it won't be the last 2014-12-10T17:11:52 sc68cal: I think some of the scenario tests exploded too 2014-12-10T17:11:57 sc68cal: there is a way to run d-g with a specific tempest patch. Let me dig that up so that we can rerun the tests with your fix prior to it merging 2014-12-10T17:12:22 *** e0ne has quit IRC 2014-12-10T17:12:40 *** k4n0 has quit IRC 2014-12-10T17:12:45 *** berendt has joined #openstack-infra 2014-12-10T17:13:40 clarkb, fungi: i think we should try trusty nodepool again 2014-12-10T17:13:51 shall we do that now? 2014-12-10T17:13:51 *** mmaglana has joined #openstack-infra 2014-12-10T17:13:55 jeblair: you will find no disagreement from me 2014-12-10T17:14:06 jeblair: can you give me a few minutes to get caffeine and breakfast? 2014-12-10T17:14:18 yep 2014-12-10T17:14:37 jeblair: i'm in favor 2014-12-10T17:15:13 derekh: i think we should hold off adding that other tripleo region until we have worked out whether our nodepool migration is going to stick this time 2014-12-10T17:15:30 *** koolhead17 has joined #openstack-infra 2014-12-10T17:15:38 we may find that the world has changed around nodepool and we need to adapt. if so, i think clarb's change to gear may help (just because we have fewer cycles available to us), though it's not a long-term solution to the fundamental problem 2014-12-10T17:16:33 i do have some ideas about how we could be a bit more robust without drastic changes; i'll write up a spec while we're working on this in case we need it 2014-12-10T17:17:02 fungi: ok, any idea who long that will be? don't want to pop in asking about it prematurely. 2014-12-10T17:17:14 derekh: probably a couple hours 2014-12-10T17:18:38 gah I am out of yogurt. But I have caffeine so lets do this 2014-12-10T17:18:56 ok cool, I'll probably be gone by then but will check later to see if its merged and watch to make sure its going ok 2014-12-10T17:19:26 the images from last time should be new enough so we don't need to rebuild images on nodepool-dev again 2014-12-10T17:21:33 *** nfedotov has quit IRC 2014-12-10T17:21:58 jyuso: you're welcome :-). You should thank anteaya as well, she organized the meeting this week. We never would have converged on a solution without her. 2014-12-10T17:22:00 jeblair: any other prep type items we might have to do based on your debugging? 2014-12-10T17:22:04 *** mmaglana has quit IRC 2014-12-10T17:22:10 jeblair: you already rebuilt pycrypto? 2014-12-10T17:22:56 clarkb: yep, should be gtg 2014-12-10T17:22:59 *** mmaglana has joined #openstack-infra 2014-12-10T17:23:06 *** ZZelle is now known as zzelle_ 2014-12-10T17:23:11 *** zzelle_ is now known as ZZelle_ 2014-12-10T17:23:19 want me to stop nodepoold on precise and start deleting ready/building nodes? 2014-12-10T17:23:33 so stop old nodepool, delete ready/building, start new nodepool 2014-12-10T17:23:42 then delete remainder on old nodepool 2014-12-10T17:23:44 *** salv-orlando has quit IRC 2014-12-10T17:23:48 *** emagana_ has joined #openstack-infra 2014-12-10T17:23:50 *** johnthetubaguy is now known as zz_johnthetubagu 2014-12-10T17:23:57 fungi: I am ready when you are 2014-12-10T17:24:08 doing 2014-12-10T17:24:13 *** salv-orlando has joined #openstack-infra 2014-12-10T17:26:12 ~300 building+ready nodes deleting now 2014-12-10T17:26:36 *** salv-orlando has quit IRC 2014-12-10T17:26:41 *** jaypipes has quit IRC 2014-12-10T17:27:02 *** emagana has quit IRC 2014-12-10T17:27:29 Merged openstack/requirements: Bump the minimum required version of retrying https://review.openstack.org/140074 2014-12-10T17:27:32 Merged openstack/requirements: Update xstatic-font-awesome to 4.2.0 https://review.openstack.org/139207 2014-12-10T17:27:35 Merged openstack/requirements: Add nova-docker to tracked project list https://review.openstack.org/122221 2014-12-10T17:27:36 *** dtantsur|brb is now known as dtantsur 2014-12-10T17:28:51 *** koolhead17 has quit IRC 2014-12-10T17:29:07 sc68cal: https://review.openstack.org/#/c/131604/9/functions.sh the new block of code on line 317 there shows how you can test a specific tempest change within d-g 2014-12-10T17:29:17 *** armax has joined #openstack-infra 2014-12-10T17:29:31 * tchaypo continues song+dance routine extolling the virtues of the most wonderful and marvellously exciting https://review.openstack.org/#/c/136811/ 2014-12-10T17:29:31 sc68cal: changes to d-g like that should never be merged but the can help you ensure that the number of bugs is falling 2014-12-10T17:30:10 *** sabari is now known as zz_sabari 2014-12-10T17:31:10 tchaypo: ok :P 2014-12-10T17:32:29 clarkb: thanks 2014-12-10T17:32:32 * tchaypo cheers 2014-12-10T17:32:36 thank you :) 2014-12-10T17:32:56 now of course it’ll turn out to break everything, I’ll be sad, but you’ll be the person who approved it... 2014-12-10T17:33:14 sc68cal: and if I am way off base on how much of this should just work we can go back to thinking about the experimental job 2014-12-10T17:33:27 sc68cal: which is why I dind't want to abandon thechange to add the new job just yet 2014-12-10T17:33:36 tchaypo: yes that is how things go around here 2014-12-10T17:33:57 *** asselin has joined #openstack-infra 2014-12-10T17:34:24 tchaypo: we can fix it together when that happens :P 2014-12-10T17:34:53 every morning when i wake up, i put on my flame-retardant pants 2014-12-10T17:35:30 we're down to ~150 ready/building nodes on precise nodepool now 2014-12-10T17:35:31 *** salv-orlando has joined #openstack-infra 2014-12-10T17:36:10 *** vdo has quit IRC 2014-12-10T17:36:12 *** garyk has quit IRC 2014-12-10T17:36:31 *** avozza is now known as zz_avozza 2014-12-10T17:38:42 *** ihrachyshka has joined #openstack-infra 2014-12-10T17:39:35 morning 2014-12-10T17:40:35 *** gokrokve has quit IRC 2014-12-10T17:41:25 *** jraim has joined #openstack-infra 2014-12-10T17:42:17 *** ihrachyshka has quit IRC 2014-12-10T17:42:55 *** armax has quit IRC 2014-12-10T17:44:47 good morning 2014-12-10T17:45:06 fungi: we must be getting close to ready to start nodepool? 2014-12-10T17:45:57 Khai Do proposed openstack-infra/system-config: make gerrit commentlink case insensitive for bug and story https://review.openstack.org/140439 2014-12-10T17:46:06 *** tonytan4ever has quit IRC 2014-12-10T17:46:14 down to 30 remaining 2014-12-10T17:46:20 *** gyee has joined #openstack-infra 2014-12-10T17:46:23 so nearly there 2014-12-10T17:47:00 *** annegent_ has joined #openstack-infra 2014-12-10T17:47:05 20 2014-12-10T17:47:24 *** KurtMartin has joined #openstack-infra 2014-12-10T17:47:53 *** _nadya_ has quit IRC 2014-12-10T17:48:07 do you make crinkle noises when you walk? 2014-12-10T17:48:16 it's now down to 0. i'll start deleting all other nodes if you want to start nodepoold on nodepool-dev 2014-12-10T17:48:34 * anteaya reviews ttx's patch 2014-12-10T17:48:49 ok I am starting new nodepool now 2014-12-10T17:49:00 *** amotoki has joined #openstack-infra 2014-12-10T17:49:34 it is doing things 2014-12-10T17:49:59 remaining 550 nodes on precise nodepool are deleting now 2014-12-10T17:50:02 I really like doing this when we don't have to restart zuul 2014-12-10T17:50:04 so much easier :) 2014-12-10T17:50:04 *** amotoki_ has joined #openstack-infra 2014-12-10T17:50:07 indeed 2014-12-10T17:50:13 fungi: hold on 2014-12-10T17:50:13 *** stevemar has quit IRC 2014-12-10T17:50:20 fungi: don't delete used quite yet 2014-12-10T17:50:33 since those jobs may still be running 2014-12-10T17:50:51 yeah, realized that and didn't do it 2014-12-10T17:50:57 waiting one hour first ;) 2014-12-10T17:51:00 *** kmartin has quit IRC 2014-12-10T17:51:00 though 550 seems a bit high 2014-12-10T17:51:13 we were maxxed out on capacity when we started 2014-12-10T17:51:17 I guess we are currently running quite a bit of jobs 2014-12-10T17:51:18 ya 2014-12-10T17:51:28 if we wannted to be really clever, we could copy the database between the servers 2014-12-10T17:51:34 *** gokrokve has joined #openstack-infra 2014-12-10T17:51:36 nodepool-ha! 2014-12-10T17:51:53 *** doude has quit IRC 2014-12-10T17:52:04 *** armax has joined #openstack-infra 2014-12-10T17:52:24 jeblair: ya I thought about that. Ithink we haveto do it after deleting building nodes though 2014-12-10T17:52:38 otherwise we have to copy the ssh keys and other non DB state 2014-12-10T17:52:41 still doable though 2014-12-10T17:52:49 *** shakamunyi has joined #openstack-infra 2014-12-10T17:52:53 stick the db in trove and connect nodepoold to it, but only run one at a time? 2014-12-10T17:53:19 anybody have any idea why the `gate-pecan-tox-ceilometer-tip` is stuck in queued and doesn't show up in https://jenkins06.openstack.org/job/gate-pecan-python33/52/ ? 2014-12-10T17:53:25 ya 2014-12-10T17:53:31 *** dizquierdo has quit IRC 2014-12-10T17:53:38 looks like pecan reviews are wedged due to this, wondering if something changed related to nodes running ceilometer 2014-12-10T17:53:45 *** andreykurilin_ has joined #openstack-infra 2014-12-10T17:53:59 *** simonmcc has joined #openstack-infra 2014-12-10T17:54:08 *** amotoki_ has quit IRC 2014-12-10T17:54:14 *** amotoki has quit IRC 2014-12-10T17:54:23 ttx so ironic, tripleo, zaqar, manila, designate, barbican are not part of the -stable-maint grouping? 2014-12-10T17:54:27 ryanpetrello: why would gate-pecan-tox-ceilometer-tip show up in https://jenkins06.openstack.org/job/gate-pecan-python33/52/ 2014-12-10T17:54:29 ryanpetrello: we are changing the nodepool node that boots the test slaves 2014-12-10T17:54:44 fungi: gearman updates the jenkins job summary with other jobs that ran 2014-12-10T17:54:50 clarkb: oh... 2014-12-10T17:54:54 fungi, sorry, I meant the "All builds for this change set:" 2014-12-10T17:54:59 right 2014-12-10T17:55:08 *** [HeOS] has quit IRC 2014-12-10T17:55:13 right, that 2014-12-10T17:55:16 and if you look at Zuul, the ceilometer-tip job is there but just stuck 2014-12-10T17:55:23 ryanpetrello: I think this is lilely just due to us changing the host that is building nodes 2014-12-10T17:55:28 *** doug-fish has joined #openstack-infra 2014-12-10T17:55:31 okay 2014-12-10T17:55:33 so there will be a slight delay as we transition 2014-12-10T17:55:37 is there something I need to do other than just waiting? 2014-12-10T17:55:40 okay, that's fine :) 2014-12-10T17:55:50 *** ctracey has joined #openstack-infra 2014-12-10T17:55:55 just wanted to make sure it was a delay and not something I needed to change/retry 2014-12-10T17:55:55 *** shakamunyi has quit IRC 2014-12-10T17:56:05 ryanpetrello: which ceilometer change specifically? 2014-12-10T17:56:16 it's a pecan change that gates against ceilometer 2014-12-10T17:56:31 oh, right 2014-12-10T17:56:58 *** timcline_ has joined #openstack-infra 2014-12-10T17:57:06 i bet the jenkins slave that job originally ran on met with an unfortunate end and zuul requeued the job but hasn't gotten a new node to assign to it yet 2014-12-10T17:57:25 and we're currently node-starved while in the middle of swapping nodepool servers 2014-12-10T17:57:28 AJaeger: I would like some sort of indication that a job called project-config-gerrit is only evaluating stackforge acls: https://review.openstack.org/#/c/140470/7 2014-12-10T17:57:35 *** ivar-lazzaro has joined #openstack-infra 2014-12-10T17:57:56 fungi: I am going to check used nodes on old nodepool against each master and delete the ones that are safe to delete 2014-12-10T17:58:01 AJaeger: since the name does imply to me that it would apply to all incoming acl config files but the script is not doing that right now 2014-12-10T17:58:16 fungi: I do this by nodepool list | grep jenkinsXX > file. then just removing the handful of ndoes tha shouldn't be deleted 2014-12-10T17:58:29 fungi: it works well enough. though if I was smart I would figure out python-jenkins and completely script it 2014-12-10T17:59:40 *** sarob has joined #openstack-infra 2014-12-10T17:59:50 fungi: makes sense, if it doesn't complete I'll just give it another try sometime later this week when things calmd own 2014-12-10T17:59:51 *calm down 2014-12-10T18:00:28 clarkb: yeah. or maybe nodepool could grow a quiescent mode we can trigger similar to zuul's 2014-12-10T18:00:46 gordon chung proposed openstack/requirements: Up pymongo version to avoid memory leak https://review.openstack.org/123995 2014-12-10T18:01:16 clarkb: where it immediately starts deleting ready/building nodes and doesn't provision any new nodes, but continues to handle the used->delete transition and retry deletes as usual 2014-12-10T18:01:23 *** Sukhdev has quit IRC 2014-12-10T18:01:24 *** emagana_ has quit IRC 2014-12-10T18:01:51 *** dannywilson has quit IRC 2014-12-10T18:02:23 and disconnect from gearman too 2014-12-10T18:02:34 *** derekh has quit IRC 2014-12-10T18:02:40 *** MaxV has quit IRC 2014-12-10T18:02:53 *** serverascode___ has joined #openstack-infra 2014-12-10T18:03:02 *** cpowell has quit IRC 2014-12-10T18:03:32 *** annegent_ has quit IRC 2014-12-10T18:04:35 *** mmaglana has quit IRC 2014-12-10T18:04:35 *** patrickeast has quit IRC 2014-12-10T18:04:52 *** koolhead17 has joined #openstack-infra 2014-12-10T18:04:55 *** patrickeast has joined #openstack-infra 2014-12-10T18:04:57 *** ameade_ has joined #openstack-infra 2014-12-10T18:05:06 *** dannywilson has joined #openstack-infra 2014-12-10T18:05:40 *** SumitNaiksatam has quit IRC 2014-12-10T18:06:33 *** shakamunyi has joined #openstack-infra 2014-12-10T18:06:39 i have suspected a problem with the "All builds for this change set" data, but have not had a chance to actually diagnose 2014-12-10T18:06:48 just to say -- best not to rely on its accuracy 2014-12-10T18:07:14 *** marun has quit IRC 2014-12-10T18:07:17 *** wznoinsk has quit IRC 2014-12-10T18:07:18 fungi: clarkb: yep, it was just a delay, the job seems to be running now 2014-12-10T18:08:10 *** emagana has joined #openstack-infra 2014-12-10T18:08:27 *** jgallard_ has joined #openstack-infra 2014-12-10T18:09:25 ok I have deletions running for 04-07 2014-12-10T18:09:51 *** zhiyan has joined #openstack-infra 2014-12-10T18:10:24 yep, i show numbers dropping rapidly 2014-12-10T18:10:53 *** charz has quit IRC 2014-12-10T18:11:16 i don't see any red flags in the logs; either timeouterrors or exceptionally long times in the main loop 2014-12-10T18:11:26 *** emagana_ has joined #openstack-infra 2014-12-10T18:12:00 *** emagana has quit IRC 2014-12-10T18:12:12 *** resker has quit IRC 2014-12-10T18:12:49 *** jgallard_ has quit IRC 2014-12-10T18:13:00 *** Masahiro has joined #openstack-infra 2014-12-10T18:13:47 *** gokrokve has quit IRC 2014-12-10T18:15:55 *** amitgandhinz has quit IRC 2014-12-10T18:16:00 *** _nadya_ has joined #openstack-infra 2014-12-10T18:17:24 Merged openstack-infra/python-storyboardclient: Initial Cookiecutter Commit. https://review.openstack.org/138090 2014-12-10T18:17:37 *** Masahiro has quit IRC 2014-12-10T18:18:06 *** cnesa2 has quit IRC 2014-12-10T18:18:56 *** zz_sabari is now known as sabari 2014-12-10T18:20:31 *** charz has joined #openstack-infra 2014-12-10T18:23:36 Merged openstack-infra/storyboard-webclient: Eabled custom dev configuration. https://review.openstack.org/138087 2014-12-10T18:25:02 *** _nadya_ has quit IRC 2014-12-10T18:25:05 *** e0ne has joined #openstack-infra 2014-12-10T18:25:41 *** sabari is now known as zz_sabari 2014-12-10T18:26:36 *** armax has quit IRC 2014-12-10T18:27:18 *** sarob has quit IRC 2014-12-10T18:27:32 *** markmcclain has joined #openstack-infra 2014-12-10T18:28:02 jeblair: still no timeouts 2014-12-10T18:28:18 I have us down to ~150 nodes on the old host 2014-12-10T18:28:22 and that is still falling 2014-12-10T18:28:41 cool. the graph is really spiky, but i think that's because it still has incorrect data about usage 2014-12-10T18:28:51 dhellmann: thanks for the project creator's guide, I was just able to guide sukhdev to use it so hopefully he will guide others as well 2014-12-10T18:28:54 spiky's good though -- it means the loop is fast 2014-12-10T18:29:40 *** cdent has quit IRC 2014-12-10T18:30:32 *** armax has joined #openstack-infra 2014-12-10T18:30:37 *** SumitNaiksatam has joined #openstack-infra 2014-12-10T18:30:45 *** luqas has quit IRC 2014-12-10T18:30:49 *** cpowell_ has joined #openstack-infra 2014-12-10T18:31:12 *** luqas has joined #openstack-infra 2014-12-10T18:31:42 *** harlowja_away is now known as harlowja 2014-12-10T18:31:56 *** signed8bit is now known as signed8bit_ZZZzz 2014-12-10T18:33:13 *** cpowell_ has quit IRC 2014-12-10T18:33:50 *** cpowell has joined #openstack-infra 2014-12-10T18:34:22 *** annegent_ has joined #openstack-infra 2014-12-10T18:34:47 *** emagana has joined #openstack-infra 2014-12-10T18:35:03 what does it mean when fetching from a zuul merger says "error: Unable to get pack index"? 2014-12-10T18:35:13 *** marun has joined #openstack-infra 2014-12-10T18:35:28 is that a race condition of some sort? 2014-12-10T18:36:38 jesusaurus: hrm it shouldn't be. I think that git asked for an index of the pack files and that index operation failed. Could be a number of things. I would expect a race happening after you get the index and ask for a pack that is no longer there 2014-12-10T18:36:40 *** pradk has joined #openstack-infra 2014-12-10T18:37:07 jesusaurus: check apache on the zuul merger side for any errors in the error log? 2014-12-10T18:37:37 *** emagana_ has quit IRC 2014-12-10T18:38:45 krotscheck: https://storyboard.openstack.org/#!/story/2000075 2014-12-10T18:39:05 *** annegent_ has quit IRC 2014-12-10T18:40:07 Khai Do proposed stackforge/python-jenkins: Handle job and node names that contain spaces https://review.openstack.org/138886 2014-12-10T18:40:43 *** pelix has quit IRC 2014-12-10T18:40:48 speaking of "Unable to get pack index" i just discovered that cgit has the ability to turn off its default dumb http protocol endpoint support (enable-http-clone=off) 2014-12-10T18:40:54 patch on the way 2014-12-10T18:41:37 *** Sukhdev has joined #openstack-infra 2014-12-10T18:42:18 fungi, clarkb: Hi 2014-12-10T18:42:49 hello 2014-12-10T18:42:49 clarkb: thanks 2014-12-10T18:43:20 *** jedimike has quit IRC 2014-12-10T18:43:30 clarkb: I got my new project approved - see https://review.openstack.org/#/c/140473/ 2014-12-10T18:43:48 clarkb: need to add couple of members so that we can work on this project 2014-12-10T18:44:19 *** cnesa has joined #openstack-infra 2014-12-10T18:44:25 Sukhdev: who should be the initial member of the -core and -release groups 2014-12-10T18:44:34 Sukhdev: I can just add one and that person canfill out the remaining members 2014-12-10T18:44:40 *** teran has quit IRC 2014-12-10T18:45:25 clarkb: that will be myself - do you need my email ID ? 2014-12-10T18:45:37 *** teran has joined #openstack-infra 2014-12-10T18:45:41 no I can get it from the change 2014-12-10T18:45:50 *** pblaho has quit IRC 2014-12-10T18:45:56 Ah..cool 2014-12-10T18:46:07 *** Hefeweizen has joined #openstack-infra 2014-12-10T18:46:12 Sukhdev: done 2014-12-10T18:46:50 clarkb: cool - thanks 2014-12-10T18:47:16 clarkb: what is the easiest way to check/verify for me? 2014-12-10T18:47:32 jeblair: there was a timeout error ~2 minutes ago, but that was the first and only one 2014-12-10T18:47:56 Sukhdev: I am not sure I understand the question. You want to see that i added you to the groups? 2014-12-10T18:48:40 Sukhdev: to do that go to https://review.openstack.org/#/admin/groups/ which is under People -> List Groups 2014-12-10T18:49:00 Jeremy Stanley proposed openstack-infra/system-config: Disable cgit's dumb HTTP protocol endpoint support https://review.openstack.org/140805 2014-12-10T18:49:00 Sukhdev: then type into the filter box to searc hfor the group you are interested in. When it shows up click on it 2014-12-10T18:49:08 Sukhdev: and that takes you to the membership page 2014-12-10T18:49:34 *** melwitt has joined #openstack-infra 2014-12-10T18:49:50 *** tonytan4ever has joined #openstack-infra 2014-12-10T18:50:01 *** kmartin has joined #openstack-infra 2014-12-10T18:50:09 *** Ryan_Lane has joined #openstack-infra 2014-12-10T18:50:17 *** teran has quit IRC 2014-12-10T18:50:23 *** shashankhegde has joined #openstack-infra 2014-12-10T18:50:31 clarkb: hmmm... I'm about to just put this fixtures bit down. Because, here's the odd thing, I'm tracing inside the fixture code and it looks like it's rebinding the symbol fine 2014-12-10T18:50:44 except then it doesn't after the import 2014-12-10T18:51:38 *** berendt has quit IRC 2014-12-10T18:52:17 sdague: doesn't the import happen first though? 2014-12-10T18:52:26 before it rebinds 2014-12-10T18:52:50 *** AJaeger_ has joined #openstack-infra 2014-12-10T18:53:09 *** esker has joined #openstack-infra 2014-12-10T18:53:31 *** KurtMartin has quit IRC 2014-12-10T18:53:36 looks like all old nodepool nodes are vamoose now 2014-12-10T18:53:37 so, in MonkeyPatch setUp it actually seemed to find the symbols correctly, and looks like it set the attrs correctly 2014-12-10T18:53:48 anteaya: regarding https://review.openstack.org/#/c/140470/7 - I understand your concern but adding this as comment to the voting=false is not the right thing IMHO 2014-12-10T18:53:54 but then when I try to use the object, nope 2014-12-10T18:54:00 fungi: for the most part. and new nodepool marked all the things ready and now gear is catching up 2014-12-10T18:54:00 AJaeger_: fair enough 2014-12-10T18:54:10 AJaeger_: any way we can address my concern? 2014-12-10T18:54:12 *** MaxV has joined #openstack-infra 2014-12-10T18:54:14 I have the hackiest of print debug code if you are up for poking at this 2014-12-10T18:54:23 sdague: so by the time the test runs its no longer correct 2014-12-10T18:55:09 clarkb: do you know if we are having this problem at all? https://storyboard.openstack.org/#!/story/2000030 2014-12-10T18:55:10 sdague: I think that may be explained if you do properly import the patched module later 2014-12-10T18:55:18 sdague: as that import action should write over the existing name? 2014-12-10T18:55:39 https://github.com/sdague/fixtures/commit/d892eb060c4ed30f94bc9c709788d718b5c97a9e#diff-f987a3c91da9c5018dec6879afd4ba60R90 if i print debug inside of MonkeyPatch the attrs on C are changed 2014-12-10T18:55:51 AJaeger_: armax is sitting 10 feet away and is very amenable, we just have to agree on what to suggest to him 2014-12-10T18:55:52 anteaya: we could add a comment above the job in layout.yaml if that helps. 2014-12-10T18:56:00 I can live with that 2014-12-10T18:56:02 *** shayneburgess has joined #openstack-infra 2014-12-10T18:56:07 care to add the comment? 2014-12-10T18:56:11 zaro: I don't think we have seen that. It may be related to us having single use only nodes though 2014-12-10T18:56:11 clarkb: someone else reported what looks like the same thing: https://issues.jenkins-ci.org/browse/JENKINS-25867 2014-12-10T18:56:23 anteaya: physically 10 feet? 2014-12-10T18:56:24 *** otter768 has joined #openstack-infra 2014-12-10T18:56:24 AJaeger_: in the review, a review comment 2014-12-10T18:56:26 zaro: I wonder if wikimedia is using long lived nodes which increases the changes of deadlock 2014-12-10T18:56:32 AJaeger_: yes, neutron mid-cycle 2014-12-10T18:56:34 anteaya: understood, on my way... 2014-12-10T18:56:40 anteaya: Ah! Say hi to him! 2014-12-10T18:56:47 AJaeger_: will do 2014-12-10T18:56:54 clarkb: yeah they do. 2014-12-10T18:57:03 sdague: so in that case you setup before your import 2014-12-10T18:57:10 sdague: I think the followup import is what breaks you there 2014-12-10T18:57:19 clarkb: i was thinking it might also be the other plugins that they have installed. 2014-12-10T18:57:39 clarkb: right, clearly, but why 2014-12-10T18:58:18 sdague: when you construct the patch then run setup You are essentially saying x.that.does.not.exist.yet = thing. Then at import time you say x.that.does.not.exist.yet = the thing it really is 2014-12-10T18:58:28 anteaya: I haven't seen these kind of comments in layout.yaml and those also become quickly outdated. 2014-12-10T18:58:59 AJaeger_: right whereas I have seen them in the location where non-voting status is set 2014-12-10T18:59:05 which is why I picked there 2014-12-10T18:59:23 sdague: and python lets you get away with that whereas other lnaguages would complain about unknown scopes or symbols 2014-12-10T18:59:25 I just want to remember that right now this non-voting job only evaluates stackforge acls 2014-12-10T18:59:32 AJaeger_: I'm afraid I will forget 2014-12-10T19:00:01 brb... one handed with infant 2014-12-10T19:00:01 sdague, clarkb, fungi: Any suggestions on how to address anteaya's comment suggestion best? See https://review.openstack.org/#/c/140470/4/zuul/layout.yaml 2014-12-10T19:00:04 clarkb: what's the possibility that the repeat gate-infra-puppet-apply-centos6 failures are an issue in module dependency ordering introduced when i approved adding puppet-httpd to the modules array yesterday? 2014-12-10T19:00:05 *** sabeen3 has joined #openstack-infra 2014-12-10T19:00:27 fungi: I think that must be what it is. I noticed that mrmartin's fix for the module ordering didn't seem affected 2014-12-10T19:00:30 anteaya: The current comments in the voting section explain why something is not voting or set this way 2014-12-10T19:00:44 *** nfedotov has joined #openstack-infra 2014-12-10T19:00:49 *** wenlock has joined #openstack-infra 2014-12-10T19:01:00 AJaeger_: fair enough, but there are comments there 2014-12-10T19:01:14 anteaya: yes, there are comments. 2014-12-10T19:01:16 *** timcline_ has quit IRC 2014-12-10T19:01:16 *** otter768 has quit IRC 2014-12-10T19:01:22 I'm willing to branch out on content 2014-12-10T19:01:34 *** sabeen has quit IRC 2014-12-10T19:01:38 anteaya: AJaeger_ I think you can run that non voting, then add openstack in at some point still non voting and when you are happy with it make it voting? 2014-12-10T19:02:04 that is the plan yes 2014-12-10T19:02:07 *** annegent_ has joined #openstack-infra 2014-12-10T19:02:12 *** amitgandhinz has joined #openstack-infra 2014-12-10T19:02:22 just trying to capture that somehow so I don't forget when we make it non-voting 2014-12-10T19:02:34 or whoever approves the patch once it is offered 2014-12-10T19:02:35 *** nfedotov has quit IRC 2014-12-10T19:02:51 clarkb: patchset 6 introduced a comment saying "# Right now this is only evaluating acl files on stackforge projects. " 2014-12-10T19:02:51 *** nfedotov has joined #openstack-infra 2014-12-10T19:02:55 *** MaxV has quit IRC 2014-12-10T19:02:58 And that one didn't work for me at all ;( 2014-12-10T19:03:02 anteaya: AJaeger_: yeah, having it run tools/normalize_acl.py against the proposed acl and complain if the output differs from the input might be a good addition 2014-12-10T19:03:28 anteaya: please tell armax ;) 2014-12-10T19:03:43 still just the one timeout so this is much happier nodepool than before 2014-12-10T19:03:56 *** reed has joined #openstack-infra 2014-12-10T19:04:05 *** timcline has joined #openstack-infra 2014-12-10T19:04:15 anteaya, armax: let me make a proposal for the patch with specific wording. I hope that addresses both our concerns... 2014-12-10T19:04:41 I'm sorry if I am thick but I think I missed fungi's suggestion 2014-12-10T19:04:44 AJaeger_: standing by 2014-12-10T19:04:52 AJaeger_: thanks for bearing with me! 2014-12-10T19:05:06 armax: Thanks for bearing with my bikeshedding ;) 2014-12-10T19:05:06 *** arosen has joined #openstack-infra 2014-12-10T19:05:17 anteaya, clarkb, AJaeger_: btw do we have an ETA for https://review.openstack.org/#/c/140426/ ? 2014-12-10T19:05:19 *** reed has quit IRC 2014-12-10T19:05:24 AJaeger_: no worries 2014-12-10T19:05:29 *** jistr has joined #openstack-infra 2014-12-10T19:05:34 *** bitblt has joined #openstack-infra 2014-12-10T19:05:48 AJaeger_: you are the best person to bikeshed with 2014-12-10T19:06:18 AJaeger_: thanks for the heads up on reverify vs recheck! 2014-12-10T19:06:24 fungi: sorry I see what you are saying now 2014-12-10T19:06:39 *** mrmartin has joined #openstack-infra 2014-12-10T19:07:10 *** jaypipes has joined #openstack-infra 2014-12-10T19:07:19 anteaya: basically ensure acl normalization prior to allowing it to merge, similar to our alpha-order checks 2014-12-10T19:07:20 *** zz_sabari is now known as sabari 2014-12-10T19:07:22 *** ayoung is now known as shhh_im_busy 2014-12-10T19:07:54 makes way more sense that piecemeal tests 2014-12-10T19:08:04 dims: you're welcome 2014-12-10T19:08:06 thanks 2014-12-10T19:08:21 anteaya: armax: also, i think the future of this job, once it's proven as being non-annoying/problematic, is to absorb it into one of our existing syntax/format checking jobs for that project so that we don't waste spin-up/tear-down overhead and waste additional job worksers running it 2014-12-10T19:08:41 fungi: agreed 2014-12-10T19:08:49 also so that it is easier to remember to run it locally 2014-12-10T19:08:57 s/worksers/workers/ 2014-12-10T19:09:08 fungi: agreed 2014-12-10T19:09:20 *** sabari is now known as zz_sabari 2014-12-10T19:09:29 *** andreykurilin_ has quit IRC 2014-12-10T19:09:32 *** tsg has joined #openstack-infra 2014-12-10T19:10:14 armax, anteaya: Does my comment work for you? 2014-12-10T19:10:40 *** shhh_im_busy is now known as ayoung 2014-12-10T19:11:49 *** MaxV has joined #openstack-infra 2014-12-10T19:11:55 SergeyLukjanov: did you get a chance to retry applying that acl update to sahara? it doesn't seem to have changed in gerrit 2014-12-10T19:12:08 fungi: ya there is an error in that acl file 2014-12-10T19:12:14 *** emagana has quit IRC 2014-12-10T19:12:20 fungi: not sure what it is though but it appears to have nt updated since late august 2014-12-10T19:12:21 anteaya: I'll be happy to try to help keep that up to date, since I've rewritten our Oslo guide to point to it at the appropriate spot(s), so let me know if I can help answer questions or add detail 2014-12-10T19:12:23 *** wenlock has quit IRC 2014-12-10T19:12:47 *** zz_sabari is now known as sabari 2014-12-10T19:12:50 *** emagana has joined #openstack-infra 2014-12-10T19:13:31 *** _shaps_ has quit IRC 2014-12-10T19:14:45 *** ala_ has quit IRC 2014-12-10T19:14:47 dhellmann: could you review https://review.openstack.org/#/c/138831/ , please? Fungi mentioned that it's not linear with my change anymore. 2014-12-10T19:15:10 and I haven't found a good way to keep it in order, suggestions are welcome 2014-12-10T19:16:13 clarkb: i'll have a look then 2014-12-10T19:16:54 *** yamamoto has joined #openstack-infra 2014-12-10T19:16:54 *** emagana has quit IRC 2014-12-10T19:17:37 *** erikmwilson has joined #openstack-infra 2014-12-10T19:17:58 *** KurtMartin has joined #openstack-infra 2014-12-10T19:19:52 *** signed8bit_ZZZzz is now known as signed8bit 2014-12-10T19:20:13 speaking about extra checks, I added a check for the existance of descriptions in gerrit/projects.yaml with https://review.openstack.org/#/c/138749/ . Like anteaya prefers a comment that the gerrit acls checks is only partial, I like to see descriptions for projects. is this something we should do moving forward - or should i abandon it? 2014-12-10T19:20:39 *** kmartin has quit IRC 2014-12-10T19:20:48 *** baoli has quit IRC 2014-12-10T19:21:16 *** baoli has joined #openstack-infra 2014-12-10T19:21:55 *** yamamoto has quit IRC 2014-12-10T19:22:35 it seems reasonable that every project should have a description 2014-12-10T19:22:49 i am not opposed to making that a required field 2014-12-10T19:23:11 *** jp_at_hp has quit IRC 2014-12-10T19:23:31 *** reed has joined #openstack-infra 2014-12-10T19:23:36 Marton Kiss proposed openstack-infra/system-config: Initial commit of Ask website https://review.openstack.org/140043 2014-12-10T19:23:40 *** wenlock has joined #openstack-infra 2014-12-10T19:24:42 anteaya: Are you opposed completely to 138749 or do you have a suggestion on what to change? 2014-12-10T19:24:49 fungi, thanks 2014-12-10T19:25:40 James E. Blair proposed openstack-infra/infra-specs: Add nodepool-launcher spec https://review.openstack.org/140812 2014-12-10T19:26:07 *** [HeOS] has joined #openstack-infra 2014-12-10T19:26:35 clarkb, fungi, mordred: ^ addresses recent nodepool issues 2014-12-10T19:26:39 *** annegent_ has quit IRC 2014-12-10T19:26:58 *** emagana has joined #openstack-infra 2014-12-10T19:27:17 *** annegent_ has joined #openstack-infra 2014-12-10T19:28:08 jeblair: thank you! 2014-12-10T19:28:17 *** baoli has quit IRC 2014-12-10T19:28:19 2014-12-10 10:12:29,509 ERROR gear.Client.unknown: Connection timed out waiting for a response to a submit job request: x7feaf0043e50 handle: None name: set_description:jenkins06.openstack.org unique: 92cb9ce3549f44d283d4a3cb9230d8de> 2014-12-10T19:28:20 2014-12-10 10:12:29,510 INFO zuul.Gearman: Gearman job lost due to disconnect 2014-12-10T19:28:23 clarkb: ^ 2014-12-10T19:28:26 jeblair: thanks 2014-12-10T19:28:37 I greped for 'gear' and 'gearman' before quickly ^Cing :) 2014-12-10T19:28:51 clarkb: "isconnect" :) 2014-12-10T19:28:53 armax: you can enable openstack-dev as well https://review.openstack.org/#/c/140470/ 2014-12-10T19:29:18 clarkb: looks like 3 times today 2014-12-10T19:29:37 armax: could you remove the -x? That is too much debug for me right now 2014-12-10T19:30:27 *** jistr has quit IRC 2014-12-10T19:31:15 *** ZZelle has joined #openstack-infra 2014-12-10T19:31:23 AJaeger_: will do 2014-12-10T19:31:49 AJaeger_: with openstack-dev there are some projects that do not comply, as far as I recall 2014-12-10T19:31:54 I doublecheck 2014-12-10T19:32:22 *** KurtMartin is now known as kmartin 2014-12-10T19:32:28 clarkb: following merging https://review.openstack.org/140497 last night, did puppet need to get manually reapplied on puppetmaster.o.o for that to work? 2014-12-10T19:32:51 fungi: ya I did it 2014-12-10T19:33:06 *** wenlock has quit IRC 2014-12-10T19:33:20 huh 2014-12-10T19:33:25 AJaeger_: looking 2014-12-10T19:33:26 have u guys ever seen errors like '/opt/stack/new/devstack/functions-common:603 Cloning not allowed in this configuration' ? 2014-12-10T19:33:32 seen in http://logs.openstack.org/63/140263/3/check/gate-tempest-dsvm-neutron-src-tooz/3977db4/logs/devstacklog.txt.gz 2014-12-10T19:33:47 *** shakamunyi has quit IRC 2014-12-10T19:33:47 *** esker has quit IRC 2014-12-10T19:33:49 clarkb: doesn't seem to have taken effect then. we still have stuff listed in puppetboard which isn't updating 2014-12-10T19:34:07 jeblair: cool 2014-12-10T19:34:11 fungi: hrm let me double check I thought puppetmaster was puppeting it self at the very least 2014-12-10T19:34:14 *** shakamunyi has joined #openstack-infra 2014-12-10T19:34:18 AJaeger_: that looks like good info to add; I'll have to consider the order a bit. You seem to have found a reasonable place for it, though. 2014-12-10T19:34:23 *** esker has joined #openstack-infra 2014-12-10T19:34:48 *** signed8bit has quit IRC 2014-12-10T19:34:56 clarkb: there might be another reason. i'll check the hosts where this is failing. maybe agent is disabled (or for the new git-fe servers maybe puppetmaster needs to update ~root/.ssh/known_hosts) 2014-12-10T19:35:11 *** timcline has quit IRC 2014-12-10T19:35:14 *** bdpayne has joined #openstack-infra 2014-12-10T19:35:19 fungi: /etc/ansible/ansible.cfg looks right and running that script as root spits out json with a list of nodes 2014-12-10T19:35:34 armax: Only add it if it passes for openstack-dev ;) 2014-12-10T19:35:51 *** pc_m_ has joined #openstack-infra 2014-12-10T19:36:04 clarkb: okay, i'm going with puppet agent is still set --disable on the afs/kdc hosts, and git-fe hosts need ssh host keys accepted 2014-12-10T19:36:14 dhellmann: thanks, looking forward whether you have some great ordering idea ;) 2014-12-10T19:36:21 fungi: likely 2014-12-10T19:36:26 fungi: I can do git-feXX now 2014-12-10T19:36:41 AJaeger_: well, how about as a sub-section of the very next block? 2014-12-10T19:36:50 ok thats done 2014-12-10T19:37:00 AJaeger_: because step 1 in that section is to test "git review" 2014-12-10T19:37:12 *** sarob has joined #openstack-infra 2014-12-10T19:37:30 jeblair: should I be worried about it restarting 3 times today? 2014-12-10T19:37:58 *** esker has quit IRC 2014-12-10T19:38:00 *** sarob has quit IRC 2014-12-10T19:38:01 AJaeger_: we could replace each of those vague numbered steps with a little description of what to do (your git-review stuff; instructions to run tox; where to look in gerrit for acls; a link to instructions for tagging a release) 2014-12-10T19:38:16 clarkb: i guess if those go to reported in puppetboard then it's working for sure 2014-12-10T19:38:25 *** emagana has quit IRC 2014-12-10T19:38:26 clarkb: yep. i want to catch it in a tcpdump, and then i think we should probably increase the zuul timeout back to 3 minutes 2014-12-10T19:38:32 er 5 minutes 2014-12-10T19:38:35 *** salv-orlando has quit IRC 2014-12-10T19:38:36 *** sarob has joined #openstack-infra 2014-12-10T19:38:38 clarkb: tcpdump is running 2014-12-10T19:38:38 jeblair: in that spec we would handle rate limiting by not submitting jobs to launch/delete above the rate limits? or would we need some bus between workers to negotiate that? 2014-12-10T19:38:45 jeblair: rgr 2014-12-10T19:38:57 clarkb: what kind of rate limiting? openstack? 2014-12-10T19:39:03 jeblair: ya openstack api limits 2014-12-10T19:39:24 *** pc_m has quit IRC 2014-12-10T19:39:26 clarkb: the workers use the provider managers we have now, whose only purpose is to serialize and rate limit api calls from multiple threads 2014-12-10T19:39:43 *** sabari is now known as zz_sabari 2014-12-10T19:40:08 dhellmann: do you want to take over my patch? 2014-12-10T19:40:10 jeblair: but wouldn't they run in different processes without shared memory? 2014-12-10T19:40:31 *** dtantsur is now known as dtantsur|afk 2014-12-10T19:40:34 clarkb: one worker per provider, that worker still spawns lots of threads for each launch 2014-12-10T19:40:41 oh I see 2014-12-10T19:40:41 *** marun has quit IRC 2014-12-10T19:40:44 AJaeger_: "want" is a strong word :-) How about just moving what you have down below the list for now, and I'll work on the other details in a follow-up? 2014-12-10T19:41:35 dhellmann: so, just one section further down? I can do that. 2014-12-10T19:41:53 clarkb: so this moves the thread contention out of the main loop, makes it smaller because we could run 10 workers in our configuration (for our 10 providers), and finally if that's not enough, we can limit the contention by saying "no more than X threads at a time for this worker" 2014-12-10T19:41:54 AJaeger_: yeah, under "Verify That Gerrit and the Test Jobs are Working" 2014-12-10T19:42:07 *** emagana_ has joined #openstack-infra 2014-12-10T19:42:08 *** marun has joined #openstack-infra 2014-12-10T19:42:18 *** mbacchi has quit IRC 2014-12-10T19:42:48 jeblair: yup 2014-12-10T19:43:05 *** sarob has quit IRC 2014-12-10T19:43:18 *** timcline has joined #openstack-infra 2014-12-10T19:44:04 Andreas Jaeger proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 2014-12-10T19:44:06 *** timcline has quit IRC 2014-12-10T19:44:14 fungi: is the above what you had in mind? ^ 2014-12-10T19:44:28 *** zz_sabari is now known as sabari 2014-12-10T19:44:50 *** emagana has joined #openstack-infra 2014-12-10T19:45:10 Andreas Jaeger proposed openstack-infra/infra-manual: Add .gitreview content to Creator's Guide https://review.openstack.org/138831 2014-12-10T19:45:11 dhellmann: done, thanks! 2014-12-10T19:46:12 *** emagana_ has quit IRC 2014-12-10T19:46:44 *** cnesa2 has joined #openstack-infra 2014-12-10T19:46:51 Merged openstack-infra/project-config: Support running script against local changes https://review.openstack.org/138710 2014-12-10T19:46:56 AJaeger_, sorry, I meant to make your new section a *subsection* of that one, not just list it after 2014-12-10T19:47:22 *** cnesa has quit IRC 2014-12-10T19:47:26 *** nfedotov has quit IRC 2014-12-10T19:47:36 AJaeger_: "make sure git review works, if not, these are the steps to make it work" 2014-12-10T19:47:52 *** _nadya_ has joined #openstack-infra 2014-12-10T19:48:02 *** nfedotov has joined #openstack-infra 2014-12-10T19:48:42 dhellmann: so, then we should rename it. 2014-12-10T19:49:17 Hmm, probably. How about "Configuring ``git review``"? 2014-12-10T19:49:39 *** tsg has left #openstack-infra 2014-12-10T19:49:41 *** tsg has quit IRC 2014-12-10T19:49:48 dhellmann: and the first paragraph needs to be changed as well, let me review it again... 2014-12-10T19:49:57 *** jcoufal_ has quit IRC 2014-12-10T19:50:00 Andreas Jaeger proposed openstack-infra/project-config: Normalize Gerrit ACLs https://review.openstack.org/140822 2014-12-10T19:50:34 AJaeger_, oh, yeah, I missed the tests bit. I think you can leave that out because it is step 2 in the list right above 2014-12-10T19:51:16 *** bitblt has quit IRC 2014-12-10T19:53:26 *** mmaglana has joined #openstack-infra 2014-12-10T19:53:34 *** MaxV has quit IRC 2014-12-10T19:53:47 *** sabeen has joined #openstack-infra 2014-12-10T19:54:52 *** sabeen3 has quit IRC 2014-12-10T19:55:28 *** nfedotov1 has joined #openstack-infra 2014-12-10T19:55:29 *** nfedotov has quit IRC 2014-12-10T19:56:49 *** timcline has joined #openstack-infra 2014-12-10T19:56:57 dhellmann: what about adding them as subsection as well? Here comes a patch and I fear it needs some more fleshing out when I'm a bit less distracted 2014-12-10T19:57:07 Andreas Jaeger proposed openstack-infra/infra-manual: Add .gitreview content to Creator's Guide https://review.openstack.org/138831 2014-12-10T19:57:36 *** sabari is now known as zz_sabari 2014-12-10T19:57:46 AJaeger_: yes, that's exactly what I'm talking about -- I'll do the other sections as a follow-up to your patch 2014-12-10T19:57:56 *** zz_sabari is now known as sabari 2014-12-10T19:57:58 *** pblaho has joined #openstack-infra 2014-12-10T19:58:51 dhellmann: thanks! 2014-12-10T19:59:01 we are now down to a very small list of problem nodes on old nodepool 2014-12-10T19:59:52 Andreas Jaeger proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 2014-12-10T20:00:17 *** nfedotov has joined #openstack-infra 2014-12-10T20:00:28 I will dig into those after lunch 2014-12-10T20:00:42 still just the one timeout on new nodepool so things look much better there 2014-12-10T20:00:43 *** nfedotov has quit IRC 2014-12-10T20:01:14 *** nfedotov1 has quit IRC 2014-12-10T20:01:19 *** nfedotov has joined #openstack-infra 2014-12-10T20:01:30 *** erikmwilson has quit IRC 2014-12-10T20:01:36 fungi, addressed your comment and also normalized all current files, see https://review.openstack.org/140822 . 2014-12-10T20:01:44 *** Masahiro has joined #openstack-infra 2014-12-10T20:02:50 *** dims has quit IRC 2014-12-10T20:03:05 *** dannywilson has quit IRC 2014-12-10T20:04:14 since the OpenStack CI doesn't test py26 and 32 anymore, is there a way for me to set up other external CI for pecan myself? 2014-12-10T20:04:20 (that affects the vote on reviews?) 2014-12-10T20:04:30 ryanpetrello: we're still testing 26 for oslo libs, so you should be able to as well 2014-12-10T20:04:40 yea, though I assume it's eventually going away 2014-12-10T20:04:40 dhellmann: ya I offered but ryanpetrello said meh :) 2014-12-10T20:04:49 it will go away when we eol juno 2014-12-10T20:04:53 sure :) 2014-12-10T20:04:56 *** kgiusti has quit IRC 2014-12-10T20:04:57 ah, ok 2014-12-10T20:04:59 and I don't want you all to have to carry this 2014-12-10T20:05:03 it's not a major issue for me 2014-12-10T20:05:04 ryanpetrello: third-party testing 2014-12-10T20:05:05 ryanpetrello: there is a way for you to run those tests though let me get u a link 2014-12-10T20:05:07 *** aysyd has quit IRC 2014-12-10T20:05:10 I'm just wondering if there's some way for me to affect this myself 2014-12-10T20:05:13 okay, awesome 2014-12-10T20:05:17 I'd be glad to manage some separate CI myself 2014-12-10T20:05:30 yep, we do indeed have instructions 2014-12-10T20:05:32 *** dannywilson has joined #openstack-infra 2014-12-10T20:05:37 awesome, thanks! 2014-12-10T20:05:37 ryanpetrello: http://ci.openstack.org/third_party.html some of that won't strictly apply because you will just be voting against a stackforge project right? 2014-12-10T20:05:44 clarkb: yep 2014-12-10T20:05:49 ryanpetrello: but it has info on creating an account and reading the event stream and so on 2014-12-10T20:05:49 I'll have a read-through 2014-12-10T20:06:16 Doug Hellmann proposed openstack-infra/infra-manual: Expand more of the repo verification steps https://review.openstack.org/140828 2014-12-10T20:06:20 AJaeger_: ^^ 2014-12-10T20:06:21 *** Masahiro has quit IRC 2014-12-10T20:06:34 dhellmann: wow! Let me review ... 2014-12-10T20:06:35 *** kgiusti has joined #openstack-infra 2014-12-10T20:07:26 *** teran has joined #openstack-infra 2014-12-10T20:08:37 *** wenlock has joined #openstack-infra 2014-12-10T20:08:38 *** MaxV has joined #openstack-infra 2014-12-10T20:08:43 *** spzala has quit IRC 2014-12-10T20:09:01 *** annegent_ has quit IRC 2014-12-10T20:10:02 *** armax has quit IRC 2014-12-10T20:10:10 * AJaeger_ waves good bye for today! 2014-12-10T20:10:12 *** AJaeger_ has quit IRC 2014-12-10T20:10:12 clarkb: SergeyLukjanov: i checked the gerrit error_log and it does indeed dislike that acl file 2014-12-10T20:10:31 clarkb: SergeyLukjanov: though i'm not immediately spotting the cause 2014-12-10T20:10:35 *** timcline has quit IRC 2014-12-10T20:10:55 fungi, clarkb, sorry, folks, just returned home (11pm, heh) 2014-12-10T20:10:58 *** armax has joined #openstack-infra 2014-12-10T20:11:45 fungi, I'll try to understand the issue in ACL file, don't see any atm :( 2014-12-10T20:11:48 *** ryanpetrello has quit IRC 2014-12-10T20:11:49 *** _nadya_ has quit IRC 2014-12-10T20:11:50 *** timcline has joined #openstack-infra 2014-12-10T20:11:57 *** ryanpetrello_ has joined #openstack-infra 2014-12-10T20:12:03 *** ryanpetrello_ is now known as ryanpetrello 2014-12-10T20:12:04 *** marun has quit IRC 2014-12-10T20:12:28 *** marun has joined #openstack-infra 2014-12-10T20:12:38 *** pc_m_ has quit IRC 2014-12-10T20:13:25 *** _nadya_ has joined #openstack-infra 2014-12-10T20:13:37 *** pc_m has joined #openstack-infra 2014-12-10T20:14:03 *** ldnunes has quit IRC 2014-12-10T20:16:36 *** _nadya_ has quit IRC 2014-12-10T20:16:41 *** sabari is now known as zz_sabari 2014-12-10T20:17:28 *** markmcclain has quit IRC 2014-12-10T20:19:35 SergeyLukjanov: aha, found it 2014-12-10T20:19:43 fungi, ? 2014-12-10T20:19:50 fungi, /me still don't see :( 2014-12-10T20:20:22 *** salv-orlando has joined #openstack-infra 2014-12-10T20:20:28 SergeyLukjanov: just a sec 2014-12-10T20:23:24 *** jcoufal has joined #openstack-infra 2014-12-10T20:23:58 *** koolhead17 has quit IRC 2014-12-10T20:23:59 *** unicell1 has quit IRC 2014-12-10T20:24:35 *** koolhead17 has joined #openstack-infra 2014-12-10T20:24:36 Merged openstack-infra/devstack-gate: Add os-net-config to the list of packages we clone https://review.openstack.org/136811 2014-12-10T20:25:02 Jeremy Stanley proposed openstack-infra/project-config: Revert "Use more strict regex for sahara tags acl" https://review.openstack.org/140831 2014-12-10T20:25:03 SergeyLukjanov: ^ 2014-12-10T20:25:29 *** erikmwilson has joined #openstack-infra 2014-12-10T20:25:31 fungi, omg, I've been testing it manually on my gerrit installation 2014-12-10T20:25:56 *** signed8bit has joined #openstack-infra 2014-12-10T20:26:16 SergeyLukjanov: when i reverted that manually on review.o.o i was able to apply it with manage-projects just fine 2014-12-10T20:26:25 SergeyLukjanov: it's probably an escaping problem? 2014-12-10T20:26:38 *** luqas has quit IRC 2014-12-10T20:26:40 fungi, hm, yeah, I think it could be 2014-12-10T20:26:47 *** nfedotov1 has joined #openstack-infra 2014-12-10T20:27:00 fungi, thank you very much! 2014-12-10T20:27:04 *** luqas has joined #openstack-infra 2014-12-10T20:28:38 *** nfedotov has quit IRC 2014-12-10T20:29:04 *** koolhead17 has quit IRC 2014-12-10T20:31:01 *** [HeOS] is now known as HeOS 2014-12-10T20:31:32 SergeyLukjanov: yw 2014-12-10T20:32:23 *** tonytan4ever has quit IRC 2014-12-10T20:33:04 hi infra. what's the right way to redo a gate job? failed for a transient error, passed in the check queue. https://review.openstack.org/#/c/140515/ 2014-12-10T20:34:06 *** spzala has joined #openstack-infra 2014-12-10T20:36:06 Joshua Harlow proposed openstack/requirements: Bump up oslo.utils to 1.1.0 https://review.openstack.org/140573 2014-12-10T20:37:10 *** MaxV has quit IRC 2014-12-10T20:38:11 *** erikmwilson has quit IRC 2014-12-10T20:38:23 dougwig: recheck, assuming you know why it failed and that it's not related to the change 2014-12-10T20:38:36 *** lttrl has quit IRC 2014-12-10T20:38:55 was a network failure, unrelated to the change. thanks. 2014-12-10T20:39:35 *** timcline has quit IRC 2014-12-10T20:39:56 *** annegent_ has joined #openstack-infra 2014-12-10T20:40:45 Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 2014-12-10T20:41:31 *** Sukhdev has quit IRC 2014-12-10T20:41:43 Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 2014-12-10T20:42:32 AJaeger: I tweaked the check logic first, let me know if you’d like me to revise your patch that depends on it 2014-12-10T20:43:24 fungi, we're using sahara-ci to run jobs to verify it's own config located in stackforge/sahara-ci-config, is it ok if I'll add permissions for sahara-ci to vote on it? 2014-12-10T20:43:56 *** rushiagr is now known as rushiagr_away 2014-12-10T20:44:00 yup as the ptl that is entirely up to you 2014-12-10T20:44:06 SergeyLukjanov: yes, that's the intent of the new design model 2014-12-10T20:44:23 fungi, clarkb, ok, thx 2014-12-10T20:44:27 project ptls get to decide what accounts are allowed to vote on their projects now 2014-12-10T20:44:37 *** annegent_ has quit IRC 2014-12-10T20:45:55 Hello - what code backs this page? http://www.openstack.org/community/members/ - I want to feature request search-by-irc-nick there. 2014-12-10T20:46:16 (actually it is fungi's idea, I think) 2014-12-10T20:46:55 *** bdpayne_ has joined #openstack-infra 2014-12-10T20:47:12 openstack-org is the bugtracker used on launchpad. The source is on github somewhere though .I wonder if the are using github bug tracker now? 2014-12-10T20:47:14 fungi: ^ 2014-12-10T20:47:42 clarkb: I thought the source was in gerrit now 2014-12-10T20:47:43 *** nfedotov1 has quit IRC 2014-12-10T20:47:49 jeblair: jhesketh SergeyLukjanov fungi mordred http://www.cs.pdx.edu/~warren/Capstone/PAGES/CapstoneDescription.pdf fyi. I am going to try and send warren email today before the long break 2014-12-10T20:47:52 http://git.openstack.org/cgit/openstack-infra/openstackweb/ ? 2014-12-10T20:47:59 Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 2014-12-10T20:47:59 mordred: no, it has been imported into gerrit but that isn't the source 2014-12-10T20:48:06 clarkb: gilliard: right, the openstack-org project on launchpad for now. and while we have imported the source into gerrit as openstack-infra/openstackweb they've apparently gotten out of sync 2014-12-10T20:48:15 oh good 2014-12-10T20:48:16 *** nfedotov has joined #openstack-infra 2014-12-10T20:48:26 * mordred steps away from this conversation 2014-12-10T20:49:02 Alright I'll hit launchpad and raise something - I'm happy to code it if I know where it lives. 2014-12-10T20:49:14 * clarkb realized that the university basically shuts down for 3 weeks so I better hurry up and send mail if I want a response reasonbly soon 2014-12-10T20:49:16 Merged openstack-infra/project-config: Revert "Use more strict regex for sahara tags acl" https://review.openstack.org/140831 2014-12-10T20:49:18 we approved the project-config change to import that repo even though they apparently weren't done updating it in github yet, and before i'd had a chance to corner the tipit folks to discuss new workflow options 2014-12-10T20:49:20 *** bdpayne has quit IRC 2014-12-10T20:49:31 *** MaxV has joined #openstack-infra 2014-12-10T20:50:10 fungi: none of that makes any sense :( 2014-12-10T20:50:26 *** kmartin has quit IRC 2014-12-10T20:51:44 *** lttrl has joined #openstack-infra 2014-12-10T20:51:49 jeblair: well, they published that as a "preview" export of code they were developing for the next iteration of the site (which is now in production since late last week) 2014-12-10T20:52:07 fungi: that's not what their readme said :) 2014-12-10T20:52:41 i think they may have a little trouble navigating the space-time continuum 2014-12-10T20:53:04 indeed, it's been a long 2 years since we agreed the import was the next step. 2014-12-10T20:53:18 *** shakamunyi has quit IRC 2014-12-10T20:53:27 *** erikmwilson has joined #openstack-infra 2014-12-10T20:53:51 *** whoops has joined #openstack-infra 2014-12-10T20:54:05 *** lttrl has quit IRC 2014-12-10T20:54:15 anyway, nothing is stopping them from proposing a commit with "Code dump to bring repo up to date since our last code dump" 2014-12-10T20:54:44 agreed. i will pick that conversation back up again 2014-12-10T20:55:25 So I raised the ticket, but the short answer for where the code lives is "ask again later", right ;) 2014-12-10T20:55:48 i think they were waiting until that code was actually in production, so now it's a good time to get them using gerrit 2014-12-10T20:56:35 gilliard: yeah, disappointing to most of us, but that's the present situation 2014-12-10T20:56:48 No worries, thanks all! 2014-12-10T20:56:48 *** bdpayne_ has quit IRC 2014-12-10T20:56:50 *** shakamunyi has joined #openstack-infra 2014-12-10T20:57:20 *** teran_ has joined #openstack-infra 2014-12-10T20:57:22 *** otter768 has joined #openstack-infra 2014-12-10T20:58:37 *** Longgeek has quit IRC 2014-12-10T20:58:38 I hoped after a few years I'd stop saying "arrrgghhh puppet" 2014-12-10T20:59:44 *** teran has quit IRC 2014-12-10T20:59:44 *** nfedotov has quit IRC 2014-12-10T21:00:08 I think it's time for lunch :) 2014-12-10T21:00:51 *** mwagner_lap has quit IRC 2014-12-10T21:00:57 *** MaxV has quit IRC 2014-12-10T21:01:01 *** nfedotov has joined #openstack-infra 2014-12-10T21:01:30 *** erikwilson has joined #openstack-infra 2014-12-10T21:01:38 *** wenlock has quit IRC 2014-12-10T21:01:48 *** erikwilson has quit IRC 2014-12-10T21:02:27 *** otter768 has quit IRC 2014-12-10T21:02:56 *** tonytan4ever has joined #openstack-infra 2014-12-10T21:03:15 *** dims has joined #openstack-infra 2014-12-10T21:03:31 *** btran has joined #openstack-infra 2014-12-10T21:03:59 *** tonytan4ever has quit IRC 2014-12-10T21:04:13 *** tonytan4ever has joined #openstack-infra 2014-12-10T21:04:43 *** belmoreira has joined #openstack-infra 2014-12-10T21:05:49 *** annegent_ has joined #openstack-infra 2014-12-10T21:08:17 *** dims has quit IRC 2014-12-10T21:08:40 *** dkranz has quit IRC 2014-12-10T21:09:27 *** hashar has joined #openstack-infra 2014-12-10T21:09:33 *** erikmwilson has quit IRC 2014-12-10T21:10:01 *** [BNC]erikmwilson is now known as erikmwilson 2014-12-10T21:10:21 *** jp_at_hp has joined #openstack-infra 2014-12-10T21:10:22 *** mestery has quit IRC 2014-12-10T21:10:54 *** MaxV has joined #openstack-infra 2014-12-10T21:10:54 *** bdpayne has joined #openstack-infra 2014-12-10T21:11:57 *** ociuhandu has quit IRC 2014-12-10T21:12:09 morning 2014-12-10T21:12:15 *** armax has quit IRC 2014-12-10T21:13:02 morning mattoliverau 2014-12-10T21:13:05 *** esker has joined #openstack-infra 2014-12-10T21:13:08 *** weshay has quit IRC 2014-12-10T21:13:09 *** teran has joined #openstack-infra 2014-12-10T21:13:14 *** hdd has joined #openstack-infra 2014-12-10T21:13:53 *** zz_sabari is now known as sabari 2014-12-10T21:14:17 *** teran_ has quit IRC 2014-12-10T21:14:38 *** emagana has quit IRC 2014-12-10T21:15:07 *** achanda has quit IRC 2014-12-10T21:15:10 *** emagana has joined #openstack-infra 2014-12-10T21:16:11 *** dannywilson has quit IRC 2014-12-10T21:16:59 *** jp_at_hp has quit IRC 2014-12-10T21:17:32 *** dims has joined #openstack-infra 2014-12-10T21:17:51 *** esker has quit IRC 2014-12-10T21:17:58 *** dannywilson has joined #openstack-infra 2014-12-10T21:19:44 *** emagana has quit IRC 2014-12-10T21:21:04 *** mfink has quit IRC 2014-12-10T21:23:00 *** kgiusti has quit IRC 2014-12-10T21:23:16 AJaeger: 138749 I'm kind of concerned over how much oversite we are adding to a space that by definition is not overseen 2014-12-10T21:23:45 AJaeger: I am really not wanting to set ourselves up to have to make decisions or arbitrate on stackforge issues 2014-12-10T21:23:48 I just had a pep8 job fail in an interesting way; a traceback in pep8 itself. https://gist.github.com/jayofdoom/dc8df0c64a8f594fd5ae -- wanted to see if anyone here has seen it and/or if there's a known brokenness before rechecking 2014-12-10T21:24:04 *** esker has joined #openstack-infra 2014-12-10T21:24:39 AJaeger: feel free to move ahead without me, I am comfortable with the patch merging with my concern reflected in my vote and the comments 2014-12-10T21:25:55 *** teran_ has joined #openstack-infra 2014-12-10T21:26:01 dhellmann: awesome, thank you 2014-12-10T21:26:02 *** mfink has joined #openstack-infra 2014-12-10T21:26:20 AJaeger fungi sorry been talking in person, will get a moment with armax soon 2014-12-10T21:27:13 *** timcline has joined #openstack-infra 2014-12-10T21:27:15 Monty Taylor proposed openstack-infra/project-config: Add elements for Infra servers https://review.openstack.org/140840 2014-12-10T21:27:15 Monty Taylor proposed openstack-infra/project-config: Move to using package-installs.yaml https://review.openstack.org/140841 2014-12-10T21:27:51 jeblair, clarkb, fungi: ^^ latest state of the art - those build ubuntu and centos hosts - I have one more thing I need to do for nova-agent on centos 2014-12-10T21:27:56 *** timcline has quit IRC 2014-12-10T21:28:13 also, all of the upstream dib modifications I've done have landed already 2014-12-10T21:28:23 so a large part of taht patch will go away very soon 2014-12-10T21:28:29 *** teran has quit IRC 2014-12-10T21:28:34 *** tonytan4ever has quit IRC 2014-12-10T21:29:20 *** julim has quit IRC 2014-12-10T21:31:49 *** denis_makogon has quit IRC 2014-12-10T21:32:07 *** dmakogon_ has joined #openstack-infra 2014-12-10T21:32:13 *** markmcclain has joined #openstack-infra 2014-12-10T21:32:17 *** timcline has joined #openstack-infra 2014-12-10T21:32:44 *** teran has joined #openstack-infra 2014-12-10T21:32:50 *** timcline has quit IRC 2014-12-10T21:34:30 *** asettle is now known as asettle-bfast 2014-12-10T21:36:17 *** teran_ has quit IRC 2014-12-10T21:38:11 *** MaxV has quit IRC 2014-12-10T21:38:13 *** timcline has joined #openstack-infra 2014-12-10T21:39:09 *** baoli has joined #openstack-infra 2014-12-10T21:39:39 *** timcline has quit IRC 2014-12-10T21:40:29 Merged openstack-infra/infra-specs: Zuul could use different yaml files https://review.openstack.org/133249 2014-12-10T21:41:00 *** dizquierdo has joined #openstack-infra 2014-12-10T21:42:21 *** tonytan4ever has joined #openstack-infra 2014-12-10T21:42:54 *** shashankhegde has quit IRC 2014-12-10T21:43:13 *** jcoufal has quit IRC 2014-12-10T21:43:56 *** dannywilson has quit IRC 2014-12-10T21:45:01 wow, did i really approve that? oops. 2014-12-10T21:45:41 clarkb: you previously reviewed that; would you mind giving it a quick review and either +2ing it or reverting it? 2014-12-10T21:45:45 clarkb: i'm really sorry :( 2014-12-10T21:45:47 did you just mean to +2 it? 2014-12-10T21:45:51 yes 2014-12-10T21:45:56 must have slipped 2014-12-10T21:46:59 *** armax has joined #openstack-infra 2014-12-10T21:47:06 jeblair: sure 2014-12-10T21:47:15 yep, hit wrong button. 2014-12-10T21:47:30 *** weshay has joined #openstack-infra 2014-12-10T21:48:05 *** hashar has quit IRC 2014-12-10T21:49:06 *** armax has quit IRC 2014-12-10T21:49:23 *** nfedotov has quit IRC 2014-12-10T21:49:40 *** MaxV has joined #openstack-infra 2014-12-10T21:49:43 jeblair: ya Ithink yolanda addressed my concerns with newer patchsets 2014-12-10T21:49:54 so not necessary to revert 2014-12-10T21:49:59 *** Ryan_Lane has quit IRC 2014-12-10T21:50:02 cool, thanks (i thought so too -- i went back and checked) 2014-12-10T21:50:32 *** Masahiro has joined #openstack-infra 2014-12-10T21:51:21 in case anyone wonders if it is useful to have an infra person at mid-cycles the answer is yes 2014-12-10T21:51:30 *** dangers is now known as dangers_away 2014-12-10T21:51:50 anteaya: cool. we're going to need 500 infra people. ;) 2014-12-10T21:51:53 I get a lot of questions introduced wtih "I've been wanting to ask this for a while, but I didnt' want to bug anyone in -infra channel" 2014-12-10T21:51:58 ha ha ha 2014-12-10T21:52:43 jeblair: mordred: any opposition to me enabling puppet agent on the afs/afsdb/kdc servers? i've checked with --noop and the only things of significance being changed are not related to afs or kerberos 2014-12-10T21:52:54 *** shashankhegde has joined #openstack-infra 2014-12-10T21:53:04 oh heads up jeblair in case you ever see a spec about testing things as a group in the gate, where either all the patches merge or none of them 2014-12-10T21:53:41 fungi: wfm 2014-12-10T21:53:52 *** patrickeast has quit IRC 2014-12-10T21:53:56 jeblair: mordred: i can leave afstest untouched for now... though it looks like the only significant changes it would get are possible reversion of a few iptables rules you may have added 2014-12-10T21:54:00 *** Ryan_Lane has joined #openstack-infra 2014-12-10T21:54:04 fungi: nope. I think we should 2014-12-10T21:54:22 jeblair: mordred: great--doing now 2014-12-10T21:54:26 *** sabari is now known as zz_sabari 2014-12-10T21:54:35 fungi: yeah, i'd leave afstest out for now; it will be useful for a little longer, but not for long. 2014-12-10T21:55:02 *** markmcclain has quit IRC 2014-12-10T21:55:11 fungi: if you're poking at those sorts fo things, https://review.openstack.org/#/c/129722/ 2014-12-10T21:55:28 *** Masahiro has quit IRC 2014-12-10T21:55:37 *** zz_sabari is now known as sabari 2014-12-10T21:55:39 fungi: actually - let me go take another pass through that 2014-12-10T21:55:42 so nevermind 2014-12-10T21:55:51 anteaya: thanks. that's close, and related to "one-way cross-repo dependencies", but not the same thing. we'll have to get into the nitty gritty on that (some things in this area are desirable, some are actively not desired) 2014-12-10T21:56:03 right 2014-12-10T21:56:25 mordred: sure. i mostly wanted to get started playing with afs as a consistent backend for our git server farm, so that we can think about turning off ip persistence in haproxy for better load distribution 2014-12-10T21:56:38 fungi: ooh. I like that idea 2014-12-10T21:57:08 so since the short term fix is to make carl baldwin merge all the affected patches (it is easier than editing zuul for now) it might be a bit before he writes the spec but he said the would 2014-12-10T21:57:12 Morning 2014-12-10T21:57:21 so details can come out of that 2014-12-10T21:57:26 anteaya: I like carl baldwin being teh short term fix to things 2014-12-10T21:57:34 morning jhesketh 2014-12-10T21:57:40 * anteaya looks at one-way cross-repo dependencies spec 2014-12-10T21:57:54 mordred: he doesn't, fortunately his price is "be nice to me" 2014-12-10T21:57:57 *** baoli_ has joined #openstack-infra 2014-12-10T21:58:01 anteaya: :) 2014-12-10T21:58:05 so we are going to be extra nice to carl for a bit 2014-12-10T21:58:07 :D 2014-12-10T21:58:12 morning jhesketh 2014-12-10T21:58:33 the good news is being nice to carl is easy 2014-12-10T21:58:43 *** armax has joined #openstack-infra 2014-12-10T21:58:55 *** pblaho has quit IRC 2014-12-10T21:58:59 *** Longgeek has joined #openstack-infra 2014-12-10T21:59:34 mordred, you wanted to discuss something with me yesterday? 2014-12-10T21:59:39 so how are we marking specs implimented? because I do believe this one is completed: http://specs.openstack.org/openstack-infra/infra-specs/specs/config-repo-split.html 2014-12-10T21:59:39 asselin: I did? 2014-12-10T21:59:45 *** baoli has quit IRC 2014-12-10T21:59:50 mordred: you did 2014-12-10T21:59:52 asselin: that was a long time ago, I'm certain I've forgotten by now ... 2014-12-10T21:59:55 mordred: in the meeting yesterday 2014-12-10T21:59:57 *** patrickeast has joined #openstack-infra 2014-12-10T21:59:58 asselin: oh! right 2014-12-10T22:00:07 I remember 2014-12-10T22:00:16 *** wenlock has joined #openstack-infra 2014-12-10T22:00:23 I wanted to connect with you on my crazy plans to rework our launch-node script 2014-12-10T22:00:49 ok....I see. I was wondering what you were talking about. 2014-12-10T22:00:57 *** bswartz has quit IRC 2014-12-10T22:01:00 so this is the nodepool image-creating script? 2014-12-10T22:01:12 not quite, but it all winds up being related 2014-12-10T22:01:37 I'm currently working on using diskimage-builder to build our images in nodepool 2014-12-10T22:01:51 anteaya: we talked about it pre-specs. sdague was working on it at some point; i think there may be some wip changes in zuul's review queue 2014-12-10T22:01:54 *** marun has quit IRC 2014-12-10T22:02:25 ah, I will look there, thanks 2014-12-10T22:02:28 *** imcsk8 has quit IRC 2014-12-10T22:02:34 asselin: once that's all happy, I want to consolidate the code we use to create nodes, because we use different code to create long-lived servers than we do to create nodepool nodes - but most of the cloud logic needs to be very similar 2014-12-10T22:02:35 *** imcsk8 has joined #openstack-infra 2014-12-10T22:02:54 anteaya: also, i don't think we have marked any as implemented. i think there should be a new section/directory for it 2014-12-10T22:02:58 the only spec I was seeing that was close was the nodepool one 2014-12-10T22:03:14 jeblair: would you like me to offer a patch for a new dir? 2014-12-10T22:03:17 mordred, interesting 2014-12-10T22:03:17 *** doug-fish has quit IRC 2014-12-10T22:03:38 jeblair: I'm thinking implemented/ 2014-12-10T22:03:57 trying to gather context? 2014-12-10T22:04:07 I haven't looked into dib yet, but I guess I should start sooner than later 2014-12-10T22:04:23 *** emagana has joined #openstack-infra 2014-12-10T22:04:31 *** ryanpetrello has quit IRC 2014-12-10T22:04:42 sdague: being able merge one-way cross-repo dependencies 2014-12-10T22:04:47 oh 2014-12-10T22:04:49 *** Longgeek has quit IRC 2014-12-10T22:04:51 anteaya: sounds great 2014-12-10T22:04:57 *** dprince has quit IRC 2014-12-10T22:04:57 jeblair: thanks 2014-12-10T22:05:14 mordred, quick example of what's different to setup log-lived server and short one for nodepool? 2014-12-10T22:05:21 *** annegent_ has quit IRC 2014-12-10T22:05:23 yeh, I got a partial patch, but I ended up abandoning it. I can dig it up 2014-12-10T22:05:32 *** dustins has quit IRC 2014-12-10T22:05:41 asselin: it's just two differetn code bases 2014-12-10T22:06:02 https://review.openstack.org/#/c/94365/ 2014-12-10T22:06:03 *** bdpayne has quit IRC 2014-12-10T22:06:22 asselin: like, we have a script called "launch-node" that we run by hand to add new servers 2014-12-10T22:06:36 sdague: oh, can you explain your last comment there? 2014-12-10T22:06:40 asselin: and nodepool has similar but different logic inside of itself to spin up and tear down short-lived ones 2014-12-10T22:06:46 sdague: i think this is actually a really important feature 2014-12-10T22:06:58 i thought we all felt that 2014-12-10T22:07:18 mordred, I see. yeah, we're more primite then. we manually launch servers 2014-12-10T22:07:19 *** sabari is now known as zz_sabari 2014-12-10T22:07:27 asselin: for dib - https://review.openstack.org/#/c/140840/ - if you install latest dib and then grab that patch, the tools/build-base-image.sh will build a very small ubuntu image 2014-12-10T22:07:28 jeblair: maybe. It turns out you have to solve a lot of the things that git solves with parents 2014-12-10T22:07:53 multiply so, and worse, cycles 2014-12-10T22:08:06 asselin: yah. well, our long-lived servers are essentially manual - which is one of the things I want to fix 2014-12-10T22:08:12 yeah, we can't have cycles (just kick them out with an error if one is detected) 2014-12-10T22:08:14 so if someone else wants to run with it, that's a starting point 2014-12-10T22:08:21 *** jamielennox|away has quit IRC 2014-12-10T22:08:39 mordred, I start looking into dib and that patch. thanks! 2014-12-10T22:08:45 *** shakamunyi has quit IRC 2014-12-10T22:08:49 sdague: okay, well, "i have decided not to work on this anymore" and "i'm not convinced this is a good idea" are different. 2014-12-10T22:09:06 it's not really on my priority list any more though, because I think that in most cases the right option is to not have that tight commit wise coupling between projects 2014-12-10T22:09:08 asselin: cool. I've got to run - but I'll point you at the other work around node spin up when I get back onine 2014-12-10T22:09:10 online 2014-12-10T22:09:14 sdague: i do not think the former requires anything further, but i think the latter requires a conversation. 2014-12-10T22:09:30 *** charz has quit IRC 2014-12-10T22:09:47 woot. latest elements official do build both ubuntu and centos base images 2014-12-10T22:09:52 *** mattoliverau has quit IRC 2014-12-10T22:09:52 *** serverascode___ has quit IRC 2014-12-10T22:10:00 *** zz_sabari is now known as sabari 2014-12-10T22:10:01 sdague: this helps with "i'm adding a test of another project" or "i'm intending to use a new in-development feature in another project" 2014-12-10T22:10:01 I have a meeting to run to - when I get back, I will test taht those images work on both clouds 2014-12-10T22:10:07 mordred: and we are still running trusty nodepool so we can likely start pushing on dib nodepool images again 2014-12-10T22:10:09 jeblair: right 2014-12-10T22:10:16 *** jamielennox|away has joined #openstack-infra 2014-12-10T22:10:17 mordred: tl;dr much excite 2014-12-10T22:10:20 dhellmann: you handled rss for specs, any thoughts on this change when you have a moment? https://review.openstack.org/#/c/140041/ 2014-12-10T22:10:22 sdague: that's still a think we want to do, right? 2014-12-10T22:10:31 i do feel like the extra barrier we've added with testing against released dep versions has significantly diminished the majority of the need for cross-project review dependencies, but there are still cases where projects are tighthly-coupled and don't release or release in tandem 2014-12-10T22:10:34 *** jamielennox|away is now known as jamielennox 2014-12-10T22:10:35 *** cloudnull has quit IRC 2014-12-10T22:10:42 *** shakamunyi has joined #openstack-infra 2014-12-10T22:10:44 clarkb: well, don't get too excited yet 2014-12-10T22:10:50 well... I'm not convinced thing 2 is a thing we want to encourage 2014-12-10T22:10:58 clarkb: I will still need to write the patch to nodepool to properly upload these to both clouds 2014-12-10T22:10:59 because it actually makes upgrades quite hard 2014-12-10T22:10:59 *** mattoliverau has joined #openstack-infra 2014-12-10T22:10:59 fungi: yeah, i think no amount of wishing in the world is going to cause some of these things not to be tightly coupled 2014-12-10T22:11:02 *** zigo has quit IRC 2014-12-10T22:11:15 mordred: ya I have a half dozen nodepool patches that need to get in too 2014-12-10T22:11:17 clarkb: which I'm expecting to take a few days to get right 2014-12-10T22:11:25 sdague: for example, project-config and system-config repos 2014-12-10T22:11:34 *** cloudnull has joined #openstack-infra 2014-12-10T22:11:34 mordred: but at least they are not stalled based on where the server is 2014-12-10T22:11:34 we don't release those, and they're tightly coupled 2014-12-10T22:11:38 and thing one I'm actually working to get more of the the tests back owned by the project in question 2014-12-10T22:11:39 clarkb: yes 2014-12-10T22:11:40 at least sometimes 2014-12-10T22:11:41 clarkb: totally 2014-12-10T22:11:45 fungi: or any of our 50 puppet repos 2014-12-10T22:11:50 clarkb: do any of your patches affect the openstack api interactions? 2014-12-10T22:11:53 fungi: yeh, I'm not saying there aren't places where this would be useful 2014-12-10T22:11:59 *** serverascode___ has joined #openstack-infra 2014-12-10T22:12:01 but I also see some draw backs 2014-12-10T22:12:07 *** mrmartin has quit IRC 2014-12-10T22:12:10 *** zigo has joined #openstack-infra 2014-12-10T22:12:12 mordred: no, but one of them does interact with dib to do multi image output. you may want to coopt that one 2014-12-10T22:12:17 kk 2014-12-10T22:12:22 *** armax has quit IRC 2014-12-10T22:12:24 *** bdpayne has joined #openstack-infra 2014-12-10T22:12:26 which leaves me at, I'm fine if someone else wants to do it (like I won't argue against it) 2014-12-10T22:12:30 jeblair: i could get on board with saying we're going to make releases of puppet modules and do so before we consume new features from them, which is why i didn't go there with the example ;) 2014-12-10T22:12:31 I just wanted to make sure I don't step on you as I start looking at api operation changes 2014-12-10T22:12:43 sdague: okay, thank you for the work you have done so far 2014-12-10T22:12:48 *** axelddd has joined #openstack-infra 2014-12-10T22:12:49 *** charz has joined #openstack-infra 2014-12-10T22:13:12 what's there was about 95% of the base case IIRC 2014-12-10T22:13:25 with just 1 test that wouldn't pass 2014-12-10T22:13:33 so hopefully a starting point for someone 2014-12-10T22:15:17 hi infra, can I get another core to look at this devstack change to re-enable neutron with services? it has one +2 and has passed jenkins. https://review.openstack.org/#/c/140572/ thank you. 2014-12-10T22:16:00 *** r-daneel has quit IRC 2014-12-10T22:16:02 *** axelddd has quit IRC 2014-12-10T22:16:36 chmouel: dtroyer: ianw: ^ 2014-12-10T22:16:50 mtreinish also has +2 now 2014-12-10T22:17:17 *** andreaf has quit IRC 2014-12-10T22:17:43 fungi: our testing of that would have to be fanstastic; and that's a long ways off 2014-12-10T22:17:44 *** andreaf has joined #openstack-infra 2014-12-10T22:17:51 (puppet) 2014-12-10T22:17:52 jeblair: true 2014-12-10T22:18:03 but yeah, in principle :) 2014-12-10T22:19:21 *** yamamoto has joined #openstack-infra 2014-12-10T22:19:28 clarkb, fungi: whichever one of you feels more affinity with subunit2sql, can you review 106584? 2014-12-10T22:20:10 lookin 2014-12-10T22:20:13 clarkb: you able to address https://review.openstack.org/#/c/140426/ ? 2014-12-10T22:20:37 anteaya: ya now that nodepool is mostly done I should do that 2014-12-10T22:21:18 I am going to disable puppet on review.o.o now, rename that group, then merge the change and reenable puppet 2014-12-10T22:21:25 fungi: jeblair ^ fyi 2014-12-10T22:21:40 clarkb: thanks 2014-12-10T22:21:58 *** emagana has quit IRC 2014-12-10T22:22:19 clarkb: k 2014-12-10T22:22:34 *** emagana has joined #openstack-infra 2014-12-10T22:22:41 jeblair, clarkb, fungi, mordred, are you folks ok with setting up storyboard-dev instance to run drafts on top of it? 2014-12-10T22:22:48 https://review.openstack.org/#/c/140469/1 ^^ 2014-12-10T22:23:00 if yes, I'd like to mode forward and setup it tomorrow 2014-12-10T22:23:07 mordred: yeah, i've been working with krotscheck on that front 2014-12-10T22:23:13 er, SergeyLukjanov ^ 2014-12-10T22:23:18 sorry mordred 2014-12-10T22:23:23 SergeyLukjanov: you mean to have docs-draft use storyboard-dev... 2014-12-10T22:23:29 jeblair, yeah 2014-12-10T22:23:40 dougwig, fungi, et.al: +A on 140572 2014-12-10T22:23:40 bad wording again, heh 2014-12-10T22:23:41 yeah, makes sense 2014-12-10T22:23:55 sdague: I need to blindly +A something? 2014-12-10T22:24:02 *** yamamoto has quit IRC 2014-12-10T22:24:07 SergeyLukjanov: We’re waiting on recheck for https://review.openstack.org/#/c/140466/ 2014-12-10T22:24:23 mtreinish: not today, I beat you to it… 2014-12-10T22:24:30 fungi: what's the fungi-proxy IRC syntax? I've got a query for jogo: http://paste.openstack.org/show/148986/ 2014-12-10T22:24:45 SergeyLukjanov: it helps mitigate a potential security leak where, with some social engineering, you could convince a storyboard admin to test out a malicious front-end which made api calls using their credentials 2014-12-10T22:24:57 anteaya: its renamed and I have approved the change. will reenable puppet once that merges 2014-12-10T22:24:57 krotscheck, fungi, so, no need in assistance? 2014-12-10T22:25:07 fungi, exactly, that's why I'd like to move it forward 2014-12-10T22:25:09 mtreinish: i accept a very loosely-defined human language grammar 2014-12-10T22:25:15 clarkb: thanks armax is happy 2014-12-10T22:25:34 SergeyLukjanov: assistance is always welcome 2014-12-10T22:25:39 *** armax has joined #openstack-infra 2014-12-10T22:25:51 *** andreykurilin_ has joined #openstack-infra 2014-12-10T22:26:17 fungi, okay, so, I'd like to try setting up the node for it tomorrow if it'll have +2 from someone else :) 2014-12-10T22:26:31 dtroyer: thank you! 2014-12-10T22:26:40 *** teran_ has joined #openstack-infra 2014-12-10T22:26:45 *** emagana has quit IRC 2014-12-10T22:26:47 *** mestery has joined #openstack-infra 2014-12-10T22:26:50 SergeyLukjanov: sure. i'm good with that if krotscheck is 2014-12-10T22:26:57 fungi, I've been already doing it on our internal infra with launch_node, so, I think that I know how to do it :) 2014-12-10T22:27:04 Works for me. 2014-12-10T22:27:23 SergeyLukjanov: i'll look over that review here in a few minutes then 2014-12-10T22:27:53 fungi: oops actuall I made a mistake in that link, one sec 2014-12-10T22:27:53 *** wenlock has quit IRC 2014-12-10T22:27:56 *** teran has quit IRC 2014-12-10T22:28:11 *** ddieterly has quit IRC 2014-12-10T22:28:25 mtreinish: okay, i'm connected to the db now so can run whatever query you need once you finalize it 2014-12-10T22:28:49 fungi, thx 2014-12-10T22:29:13 fungi, oh, the only question I don't know answer for - is how to issue the ssl cert for it? 2014-12-10T22:29:19 *** dkliban is now known as dkliban_afk 2014-12-10T22:29:20 https://review.openstack.org/#/c/138685/ 2014-12-10T22:29:23 is a patch to stable 2014-12-10T22:29:38 *** emagana has joined #openstack-infra 2014-12-10T22:29:39 but the test names being run don't have juno in the names 2014-12-10T22:29:56 SergeyLukjanov: we'd want to use a self-signed cert. easiest to just point it at the snakeoil cert already on the server like we do with review-dev, et al 2014-12-10T22:30:12 jogo: correct 2014-12-10T22:30:27 fungi, ack 2014-12-10T22:31:01 fungi: ok, give this a try: http://paste.openstack.org/show/148987/ 2014-12-10T22:31:22 *** mfisch has quit IRC 2014-12-10T22:31:28 *** obondarev has quit IRC 2014-12-10T22:31:32 mtreinish: it's running now 2014-12-10T22:31:34 jogo: d-g by default sets up devstack to deploy whatever ZUUL_BRANCH version is of things 2014-12-10T22:31:49 ahhh 2014-12-10T22:32:02 jogo: when we put juno/icehouse in a job name that implies we are overriding d-g defaults and saying install ZUUL_BRANCH of everything but the current change 2014-12-10T22:32:09 that makes it a little harder to detect when stable branches are broken though 2014-12-10T22:32:13 but makes sense 2014-12-10T22:32:14 *** yjiang5_away is now known as yjiang5 2014-12-10T22:32:17 Merged openstack-infra/project-config: Fix ACL groups for networking L2GW https://review.openstack.org/140426 2014-12-10T22:32:24 jogo: so you see that with branchless tempest beacuse tempest only has master but needs to test against juno 2014-12-10T22:32:25 fungi: fwiw, if the test is working it should have 0 hits and jogo will close the bug :) 2014-12-10T22:32:27 jogo: how so? 2014-12-10T22:32:48 clarkb: in graphite 2014-12-10T22:32:49 jogo: the branch info should still be available. gerrit knows it. zuul provides it to jenkins whihc provides it to logstash 2014-12-10T22:32:54 *** Guest76485 has joined #openstack-infra 2014-12-10T22:33:11 jogo: hrm ya graphite job name based 2014-12-10T22:33:19 jogo: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-stable-maint 2014-12-10T22:33:28 jogo: http://lists.openstack.org/pipermail/openstack-stable-maint/2014-December/thread.html 2014-12-10T22:33:33 clarkb: right, its not that big of a deal though 2014-12-10T22:33:38 *** Guest76485 is now known as mfisch 2014-12-10T22:33:45 jogo: though zuul knows it and reports the graphite data. it may actually split by branch 2014-12-10T22:33:56 mtreinish: jogo: Empty set (2 min 20.11 sec) 2014-12-10T22:33:59 congrats! 2014-12-10T22:34:08 *** tnovacik has quit IRC 2014-12-10T22:34:39 jeblair: good point, the periodic-stable queue 2014-12-10T22:34:39 did mordred ever review the mysql proxy change? we should feed him pizza and beer until he does that 2014-12-10T22:34:48 fungi: awesome thanks 2014-12-10T22:35:00 clarkb: no, mordred hasn't done that yet 2014-12-10T22:35:03 *** nelsnelson has quit IRC 2014-12-10T22:35:25 fungi: woot, thanks 2014-12-10T22:35:46 clarkb: I also want to start working on my LCA talk on it, but I'm kinda blocked because I can't get to the data... 2014-12-10T22:36:08 fungi: 2min seems kinda slow, while you still have things open, how big are things now? 2014-12-10T22:36:11 jeblair: fungi jhesketh SergeyLukjanov any opposition to making mordred do post merge review? 2014-12-10T22:37:41 *** baoli_ has quit IRC 2014-12-10T22:38:12 *** baoli has joined #openstack-infra 2014-12-10T22:38:36 *** dannywilson has joined #openstack-infra 2014-12-10T22:38:41 clarkb: fyi i negated some of your early comments on 129255 :( 2014-12-10T22:38:57 *** dannywilson has quit IRC 2014-12-10T22:39:14 *** jedimike has joined #openstack-infra 2014-12-10T22:39:26 *** cnesa2 has quit IRC 2014-12-10T22:39:35 *** dannywilson has joined #openstack-infra 2014-12-10T22:39:49 *** tonytan4ever has quit IRC 2014-12-10T22:40:11 *** marun has joined #openstack-infra 2014-12-10T22:40:11 clarkb: i feel like mordred is mostly back from his being very afk recently though is at a meeting right now.... could we give him a couple more hours? 2014-12-10T22:40:13 mtreinish: specific count queries you want me to run? 2014-12-10T22:40:25 jeblair: sure 2014-12-10T22:40:53 jeblair, hi, thanks for your review of the fail-fast spec, with your feedback I'm not sure if it's something I should pursue, although clarkb and sdague were keen on it and it would help us in gozer with our limited resources. What do you think? 2014-12-10T22:40:58 jeblair: and re 129255 thats fine. I don't know that I was super happy with what I had come with either, but wanted to drive the discussion to keeping the yaml as a datastructure that made sense structurally 2014-12-10T22:41:03 fungi: yeah if you don't mind running a count on the runs, test_runs, and run_metadata tables 2014-12-10T22:41:51 jeblair: oh good point on making it a job attribute 2014-12-10T22:42:12 and yes in geneal I agree. Fail fast is a thing we attempted and it never really panned out so not entirely convinced it will help 2014-12-10T22:42:18 Anita Kuno proposed openstack-infra/infra-specs: Adds an implemented directory https://review.openstack.org/140853 2014-12-10T22:42:22 jedimike: i had meant to say that i think it is something that you should pursue; i may not have communicated it that well.... let me try again :) 2014-12-10T22:42:45 *** groknix has joined #openstack-infra 2014-12-10T22:42:53 *** emagana has quit IRC 2014-12-10T22:43:00 but I also don't think zuul should refuse to add the feature 2014-12-10T22:43:04 maybe that is what jeblair meant 2014-12-10T22:43:29 *** emagana has joined #openstack-infra 2014-12-10T22:43:32 jedimike: i think it is a fine feature to have in zuul. people keep asking for it, and it shouldn't be too hard to do, relatively speaking. i think many of the times people think that it would be totally awsome they haven't thought through all the issues, so it's not a silver bullet for some of the problems people want to apply it to. 2014-12-10T22:43:51 *** hdd has quit IRC 2014-12-10T22:44:05 *** armax has quit IRC 2014-12-10T22:44:08 jedimike: for that reason, it's probably not going to be our highest priority review item -- so you should expect slower than normal review turnaround times 2014-12-10T22:44:31 jedimike: but i'd be very happy to have the feature, and if you want to proceed, addressing the specific comments i marked with (-1) is the way to go, i think 2014-12-10T22:44:35 *** mriedem has quit IRC 2014-12-10T22:44:41 Anita Kuno proposed openstack-infra/infra-specs: Adds an implemented directory https://review.openstack.org/140853 2014-12-10T22:44:48 *** craigbr has quit IRC 2014-12-10T22:44:52 mtreinish: 27421 runs, 24074155 test_runs, 329052 run_metadata 2014-12-10T22:45:15 mtreinish: count on test_runs took the longest, at 1 min 39.44 sec 2014-12-10T22:45:15 jeblair, ah ok :) I was mainly thinking about our situation in gozer where resources are quite limited, it would certainly help there, and I'd be happy to start the development myself, seems like a good project to cut my zuul teeth on 2014-12-10T22:45:37 i'll work on a new patch with your suggestions 2014-12-10T22:45:48 jedimike: absolutely! and thanks. :) 2014-12-10T22:45:56 fungi: well at 24 million tests it is kinda big :) 2014-12-10T22:45:57 Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 2014-12-10T22:46:03 I would have expected it to be a bit bigger though 2014-12-10T22:46:17 once it exists, mordred, sdague, clarkb, and i can then all argue about where we should and should not use it in openstack. which will be lots of fun for us. ;) 2014-12-10T22:46:18 ya 27k runs seems low 2014-12-10T22:46:29 *** bdpayne has quit IRC 2014-12-10T22:46:34 27m 2014-12-10T22:46:41 fungi: no the first number 2014-12-10T22:46:44 oh, that 2014-12-10T22:46:47 which is 27k tempest jobs aiui 2014-12-10T22:46:48 yes 2014-12-10T22:47:13 might want to check that against something in graphite i guess 2014-12-10T22:47:20 clarkb: yeah 27k tempest jobs in the gate since we started this, back around summit seems kinda low 2014-12-10T22:47:31 oh its just gate? that may actually be accurate then 2014-12-10T22:47:39 but ya we can check against graphite 2014-12-10T22:47:42 *** jedimike has quit IRC 2014-12-10T22:47:47 *** emagana has quit IRC 2014-12-10T22:48:35 clarkb: well it was gate with poor filtering until: https://review.openstack.org/135493 landed 2014-12-10T22:48:37 *** cnesa has joined #openstack-infra 2014-12-10T22:49:14 mtreinish: also, it's not even january and you want to work on your lca talk already? ;) 2014-12-10T22:49:16 fungi: one more thing can checkthe most recent run in the runs table 2014-12-10T22:49:37 jeblair: I believe we should have that conversation in a closed room with a few bottles of whiskey 2014-12-10T22:49:41 *** wenlock has joined #openstack-infra 2014-12-10T22:49:50 sdague: i was thinking the same thing :) 2014-12-10T22:49:51 and whoever comes out standing declares victory 2014-12-10T22:50:09 *** esker has quit IRC 2014-12-10T22:50:17 i will start practicing now 2014-12-10T22:50:20 To Whiskey! 2014-12-10T22:50:43 well I'm about to go to a brewery 2014-12-10T22:51:03 To Beer! 2014-12-10T22:52:39 *** Sukhdev has joined #openstack-infra 2014-12-10T22:52:59 jeblair: yeah, it's unusual for me. I'm sure I'll put most of it off until the plane :) 2014-12-10T22:53:07 *** mattoliverau has quit IRC 2014-12-10T22:53:23 *** mattoliverau has joined #openstack-infra 2014-12-10T22:53:33 mtreinish: that is what 29 hours in a plane is good for 2014-12-10T22:53:34 I just want to make sure I have enough time to do something with the data 2014-12-10T22:55:01 clarkb: heh, I'm normally sufficiently uncomfortable squeezed into my seat on a plane using a laptop can be difficult sometimes. 2014-12-10T22:55:04 mtreinish: 2014-12-10 22:53:03 2014-12-10T22:55:09 *** mmaglana has quit IRC 2014-12-10T22:55:10 utc 2014-12-10T22:56:10 *** markmcclain has joined #openstack-infra 2014-12-10T22:56:27 fungi: thanks, it looks like it's keeping up 2014-12-10T22:56:50 yup 2014-12-10T22:57:18 running the query a few times, seems to be ~3min behind present 2014-12-10T22:57:29 *** cpowell has quit IRC 2014-12-10T22:58:07 Ian Wienand proposed openstack-infra/system-config: Bring up Fedora 21 nodes on rackspace https://review.openstack.org/140857 2014-12-10T22:58:16 *** otter768 has joined #openstack-infra 2014-12-10T22:58:34 oh, heads up i'm going to be absent the first half of tomorrow for some appointments 2014-12-10T22:58:35 *** pc_m has quit IRC 2014-12-10T22:58:47 Joe Gordon proposed openstack-infra/elastic-recheck: Remove queries for closed bugs https://review.openstack.org/140858 2014-12-10T22:58:58 fungi: yeah, I'm still surprised it's keeping up. The test_run inserts got slow in my local testing after a while 2014-12-10T22:59:00 I will be around. Though I am likely out for much of friday and monday 2014-12-10T22:59:08 *** pc_m has joined #openstack-infra 2014-12-10T22:59:17 *** vigneshvar has quit IRC 2014-12-10T23:00:07 *** dimtruck is now known as zz_dimtruck 2014-12-10T23:00:24 Merged openstack-infra/infra-specs: Remove Modulefile from puppet-module spec https://review.openstack.org/134812 2014-12-10T23:01:01 yes the view of poor mtreinish squished into economy is a sight 2014-12-10T23:01:24 fungi: happy appointments 2014-12-10T23:01:34 Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 2014-12-10T23:01:38 *** tnovacik has joined #openstack-infra 2014-12-10T23:01:38 anteaya: starting puppet on review.o.o now 2014-12-10T23:01:40 *** SumitNaiksatam has quit IRC 2014-12-10T23:01:41 or enabling it 2014-12-10T23:01:42 I'll be offline all tomorrow with travel expecting to be online Friday 2014-12-10T23:01:45 clarkb: kk 2014-12-10T23:01:57 so next puppet run will add the release group 2014-12-10T23:02:00 cll 2014-12-10T23:02:07 cool too 2014-12-10T23:02:21 so 20 minutes ish 2014-12-10T23:02:25 ya 2014-12-10T23:02:37 *** otter768 has quit IRC 2014-12-10T23:02:40 k great thank you 2014-12-10T23:02:57 btw anyone who hasn't yet had the pleasure of working with armax, I recommend it 2014-12-10T23:04:27 *** craigbr has joined #openstack-infra 2014-12-10T23:04:29 Merged openstack-infra/infra-specs: Workflow documentation is now in infra-manual https://review.openstack.org/139423 2014-12-10T23:04:44 Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 2014-12-10T23:05:50 *** wenlock has quit IRC 2014-12-10T23:06:08 *** dkliban_afk is now known as dkliban 2014-12-10T23:06:20 *** ianw has quit IRC 2014-12-10T23:06:46 *** ianw has joined #openstack-infra 2014-12-10T23:07:01 *** Rockyg has joined #openstack-infra 2014-12-10T23:07:09 *** tnovacik has quit IRC 2014-12-10T23:08:16 *** zz_avozza is now known as avozza 2014-12-10T23:10:08 clarkb, fungi: also, heads up, we are forecast to get a severe rainstorm tomorrow, so i might have power outages, flooding, etc to deal with 2014-12-10T23:10:20 jeblair: noted--thanks 2014-12-10T23:10:22 we lose power here in storms that would be considered "a gentle spring rain" in NC. 2014-12-10T23:10:51 *** bdpayne has joined #openstack-infra 2014-12-10T23:11:02 but 3-4 inches in not insignificant anywhere 2014-12-10T23:11:16 well, you are just a little ways north of a partially-reclaimed desert 2014-12-10T23:11:32 *** wenlock has joined #openstack-infra 2014-12-10T23:11:36 *** annegent_ has joined #openstack-infra 2014-12-10T23:11:36 *** esker has joined #openstack-infra 2014-12-10T23:11:47 *** emagana has joined #openstack-infra 2014-12-10T23:12:05 jeblair: stay dry 2014-12-10T23:12:10 fungi: oddly enough, desert communities are usually better equipped to deal with torrential rain than we are... 2014-12-10T23:12:11 jeblair: any risk to property? 2014-12-10T23:12:24 heh 2014-12-10T23:12:28 something about having hundreds of square miles of catch basin funneling it all toward you... 2014-12-10T23:12:37 good point, when they get rain they get _hard_ rain 2014-12-10T23:12:39 *** resker has joined #openstack-infra 2014-12-10T23:12:57 and major flash flooding 2014-12-10T23:12:58 *** asettle-bfast is now known as asettle 2014-12-10T23:13:09 anteaya: yeah, but probably less than the riots and looting that's been going on the last few days 2014-12-10T23:13:24 :( 2014-12-10T23:13:36 stay safe from the riots 2014-12-10T23:13:43 are you in a high risk area? 2014-12-10T23:14:20 I avoided an event on monday in berkeley because of it :\ probably for the best, bart was expressing through some downtown stations anyway, not sure I would have made it anyway 2014-12-10T23:14:22 they've generally been focusing on downtown business districts and highways 2014-12-10T23:14:34 *** thedodd has joined #openstack-infra 2014-12-10T23:14:34 *** groknix has quit IRC 2014-12-10T23:14:49 *** belmoreira has quit IRC 2014-12-10T23:14:53 glad that means you are lower risk, but still :( 2014-12-10T23:15:23 pleia2: yeah, would have been tricky. i think you have to have up to the minute info to plan trips like that now 2014-12-10T23:15:33 yeah 2014-12-10T23:15:58 and yay neutron is now unfrozen http://lists.openstack.org/pipermail/openstack-dev/2014-December/052713.html 2014-12-10T23:16:12 mestery and dougwig are very grateful for the help 2014-12-10T23:16:14 "avoid areas with helicopters overhead" is a good rule of thumb once you're over here; doesn't help planning a bart trip tho 2014-12-10T23:16:16 thanks so much 2014-12-10T23:16:17 *** esker has quit IRC 2014-12-10T23:16:27 Indeed, thank you to all in infra for their awesome help this week! 2014-12-10T23:16:36 heh, no, there were helicopters here too and our protests stopped mostly 2014-12-10T23:16:37 I feel like we had great team work this week, it was really awesome! 2014-12-10T23:16:39 mestery: yay 2014-12-10T23:17:21 yay people who worked on this! :) 2014-12-10T23:17:31 :) 2014-12-10T23:17:41 It was truly epic to be a part of jeblair. :) 2014-12-10T23:17:56 I find it epic to be a part of jeblair 2014-12-10T23:18:03 lol 2014-12-10T23:18:04 spoken like my right hand 2014-12-10T23:18:17 OK, I've got to run and catch my flight soon. I'll be back online tomorrow, thanks again folks! 2014-12-10T23:18:18 ha ha ha 2014-12-10T23:18:25 mestery: happy trails 2014-12-10T23:18:31 *** amitgandhinz has quit IRC 2014-12-10T23:18:33 You too anteaya! 2014-12-10T23:18:37 *** mestery has quit IRC 2014-12-10T23:20:25 *** wenlock has quit IRC 2014-12-10T23:20:35 *** thedodd has quit IRC 2014-12-10T23:21:11 does the CI use MyISAM MySQL engine? 2014-12-10T23:21:29 wondering about this commit message: https://review.openstack.org/#/c/138712/6//COMMIT_MSG 2014-12-10T23:22:26 bknudson: we explicitly set the default to myisam because it's the wrong choice for openstack... 2014-12-10T23:22:47 bknudson: that way, programs that assume that the default is innodb but do explicitly set it break 2014-12-10T23:23:05 *** marun has quit IRC 2014-12-10T23:23:05 *** groknix has joined #openstack-infra 2014-12-10T23:23:07 jeblair: ohhh... guess we need better testing. 2014-12-10T23:23:19 I think better testing is coming. 2014-12-10T23:23:25 *** groknix has quit IRC 2014-12-10T23:23:26 *** craigbr has quit IRC 2014-12-10T23:23:41 bknudson: yeah, i guess if you haven't noticed it till now, you're probably not exercising it... 2014-12-10T23:23:45 it was a big problem in nova early on 2014-12-10T23:24:06 thus the counter-intuitive default setting 2014-12-10T23:24:28 *** kumartin has joined #openstack-infra 2014-12-10T23:24:28 it hit us in keystone too... but then new tables get added and we forgot, and didn't test well on real system. 2014-12-10T23:24:36 at any rate, it should definitely not be taken as an endorsement of myisam -- it's just there so that our test systems imitate a "lazy sysadmin" 2014-12-10T23:25:59 it's the default in older RHEL... I was just surprised to see that CI was forcing it. 2014-12-10T23:26:17 *** ayoung is now known as ayoung_dad_mode 2014-12-10T23:26:19 i'll leave a comment in that change letting people know why 2014-12-10T23:26:53 Matthew Treinish proposed openstack-infra/devstack-gate: Revert "Temporarily disable testing lbaas, fwaas, and vpnaas" https://review.openstack.org/140864 2014-12-10T23:27:20 *** signed8bit is now known as signed8bit_ZZZzz 2014-12-10T23:27:46 *** kmartin has joined #openstack-infra 2014-12-10T23:28:34 *** ChuckC has quit IRC 2014-12-10T23:28:50 *** dizquierdo has quit IRC 2014-12-10T23:29:25 *** ryanpetrello has joined #openstack-infra 2014-12-10T23:29:39 *** whoops has quit IRC 2014-12-10T23:29:55 *** pradk has quit IRC 2014-12-10T23:33:18 *** r-daneel has joined #openstack-infra 2014-12-10T23:37:56 jeblair: thanks. 2014-12-10T23:38:02 *** r-daneel has quit IRC 2014-12-10T23:38:38 anteaya: arg we missed one... oh well 2014-12-10T23:39:17 thats on me. cleaning it up now 2014-12-10T23:39:58 *** Masahiro has joined #openstack-infra 2014-12-10T23:40:22 dougwig: I'm assuming we should be able to do: https://review.openstack.org/#/c/140864/ now 2014-12-10T23:40:24 Clark Boylan proposed openstack-infra/project-config: Stop using networking-l2gw group https://review.openstack.org/140867 2014-12-10T23:40:28 anteaya: ^ 2014-12-10T23:40:28 what did I msiss? 2014-12-10T23:41:20 +2 2014-12-10T23:41:23 sorry about that 2014-12-10T23:43:48 *** doug-fish has joined #openstack-infra 2014-12-10T23:43:57 *** Masahiro has quit IRC 2014-12-10T23:44:46 Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 2014-12-10T23:44:47 Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 2014-12-10T23:44:48 Joe Gordon proposed openstack-infra/devstack-gate: Setup /etc/hosts for aiopcpu https://review.openstack.org/136158 2014-12-10T23:44:49 *** doug-fish has left #openstack-infra 2014-12-10T23:44:49 Joe Gordon proposed openstack-infra/devstack-gate: Allow root user to ssh in as stack https://review.openstack.org/137176 2014-12-10T23:44:50 Joe Gordon proposed openstack-infra/devstack-gate: Enable live block migration https://review.openstack.org/135768 2014-12-10T23:45:19 anteaya: no problem. I "deactivated" that group and that change should make everything go 2014-12-10T23:45:30 also seeded release group membership 2014-12-10T23:45:56 *** ildikov_afk has quit IRC 2014-12-10T23:46:23 *** craigbr has joined #openstack-infra 2014-12-10T23:46:28 *** ildikov_afk has joined #openstack-infra 2014-12-10T23:47:26 *** resker has quit IRC 2014-12-10T23:49:06 jeblair: my lights just flickered. we are getting bad weather too 2014-12-10T23:49:40 Khai Do proposed openstack-infra/jenkins-job-builder: deprecate postbuildscript onsuccess and onfailure parameter names https://review.openstack.org/139257 2014-12-10T23:50:15 *** r-daneel has joined #openstack-infra 2014-12-10T23:50:19 *** ryanpetrello has quit IRC 2014-12-10T23:51:09 *** dannywilson has quit IRC 2014-12-10T23:51:19 *** sabari is now known as zz_sabari 2014-12-10T23:51:39 *** zz_sabari is now known as sabari 2014-12-10T23:51:40 *** sabeen has quit IRC 2014-12-10T23:51:48 *** annegent_ has quit IRC 2014-12-10T23:52:55 *** esker has joined #openstack-infra 2014-12-10T23:54:14 *** dannywil_ has joined #openstack-infra 2014-12-10T23:55:07 mtreinish: driving back to Boise right now. let me sanity test before we revert. 2014-12-10T23:55:56 *** dannywil_ has quit IRC 2014-12-10T23:56:07 *** esker has quit IRC 2014-12-10T23:56:18 dougwig: ok sure, but won't it self test. (ie the gate will kick it out if we missed something) 2014-12-10T23:56:25 anyway we can pick it up tomorrow 2014-12-10T23:56:56 *** SumitNaiksatam has joined #openstack-infra 2014-12-10T23:57:09 *** esker has joined #openstack-infra 2014-12-10T23:57:35 *** cnesa has quit IRC 2014-12-10T23:58:19 clarkb: kk, thanks 2014-12-10T23:58:24 *** SumitNaiksatam has quit IRC 2014-12-10T23:58:30 Steve Baker proposed openstack-infra/project-config: Make check-heat-dsvm-functional-mysql voting https://review.openstack.org/138940 2014-12-10T23:58:47 *** straycat has left #openstack-infra 2014-12-10T23:59:56 *** esker has quit IRC