| *** gyee has quit IRC | 00:00 | |
| *** agentle has joined #openstack-infra | 00:01 | |
| *** bhuvan has joined #openstack-infra | 00:03 | |
| *** imcsk8 has quit IRC | 00:03 | |
| fungi | ianw: i guess we need to pester the centos kernel team to incorporate that? | 00:03 |
|---|---|---|
| *** imcsk8 has joined #openstack-infra | 00:03 | |
| *** gmann_ has joined #openstack-infra | 00:03 | |
| fungi | ianw: or do they still import from rhel directly? | 00:03 |
| *** RichardRaseley has quit IRC | 00:04 | |
| *** esmute has joined #openstack-infra | 00:04 | |
| *** Swami_ has joined #openstack-infra | 00:04 | |
| davideagnello | thank you | 00:04 |
| openstackgerrit | Sean Roberts proposed openstack-infra/irc-meetings: update openstack-product-team https://review.openstack.org/190419 | 00:05 |
| *** agentle has quit IRC | 00:05 | |
| *** Sukhdev has quit IRC | 00:07 | |
| *** Sukhdev has joined #openstack-infra | 00:07 | |
| *** gmann_ has quit IRC | 00:07 | |
| *** Swami has quit IRC | 00:08 | |
| *** sputnik13 has quit IRC | 00:09 | |
| *** gmann has joined #openstack-infra | 00:10 | |
| *** hdd has joined #openstack-infra | 00:10 | |
| asselin | fungi, pleia2 looks good to me, right? http://puppetboard.openstack.org/reports/zuul.openstack.org | 00:11 |
| *** gmann has joined #openstack-infra | 00:11 | |
| *** puranamr has quit IRC | 00:15 | |
| *** bhuvan has quit IRC | 00:15 | |
| ianw | fungi: yeah, figuring out how to fix it is my next task :) | 00:16 |
| *** tongl has quit IRC | 00:18 | |
| *** sarob has quit IRC | 00:20 | |
| fungi | asselin: it may not get applied until the next run. that report doesn't seem to have any new changes which don't appear in every report for zuul | 00:21 |
| asselin | fungi, ok...I have to go...will take a look later | 00:21 |
| fungi | asselin: or, i suppose it could just be that the patch we landed doesn't effectively change anything, which is probably the case | 00:21 |
| asselin | fungi, actually, that's the way it should be :) | 00:22 |
| fungi | since we were striving for a 0-delta in the refactor | 00:22 |
| asselin | fungi, +1 | 00:22 |
| fungi | i'll keep an eye out for oddness and will try to remember to check that zuul's logging is still sane tomorrow | 00:22 |
| asselin | fungi, this dependent change (which has it's own dependency) are next in the line of 0 delta refactors: https://review.openstack.org/#/c/183429/ | 00:23 |
| *** rfolco has quit IRC | 00:24 | |
| fungi | asselin: cool, i don't want to press my luck by merging anything else this evening though since it's getting late and i can't guarantee i'll be around to keep tabs on it | 00:24 |
| asselin | fungi, no problem...can be done later... | 00:25 |
| asselin | fungi, thanks for your support in getting these done. very exciting to see progress :) | 00:26 |
| fungi | asselin: yep, sorry i'm on the side of the continent where things shut down early for you ;) | 00:27 |
| fungi | or else i'd try to knock out a few more of them now | 00:27 |
| openstackgerrit | Thai Tran proposed openstack/requirements: Adding django-babel plugin to Horizon https://review.openstack.org/189507 | 00:27 |
| *** dannywil_ has joined #openstack-infra | 00:30 | |
| *** amotoki has joined #openstack-infra | 00:33 | |
| *** dannywilson has quit IRC | 00:33 | |
| *** dannywil_ has quit IRC | 00:35 | |
| *** alexpilotti has quit IRC | 00:36 | |
| *** amotoki has quit IRC | 00:38 | |
| openstackgerrit | Merged openstack/requirements: Raise min version of stevedore to 1.5.0 https://review.openstack.org/187957 | 00:40 |
| *** mwagner_afk has joined #openstack-infra | 00:44 | |
| *** mtanino has quit IRC | 00:44 | |
| *** zz_dimtruck is now known as dimtruck | 00:45 | |
| *** EricGonczer_ has joined #openstack-infra | 00:47 | |
| *** agentle has joined #openstack-infra | 00:48 | |
| *** agentle has quit IRC | 00:50 | |
| *** EricGonczer_ has quit IRC | 00:51 | |
| *** yamamoto has joined #openstack-infra | 00:52 | |
| *** amitgandhinz has joined #openstack-infra | 00:55 | |
| *** amitgandhinz has quit IRC | 00:56 | |
| *** amitgandhinz has joined #openstack-infra | 00:57 | |
| *** amitgandhinz has quit IRC | 00:59 | |
| *** bknudson has joined #openstack-infra | 01:04 | |
| mordred | morganfainberg: fyi - I've moved from raging about glance to raging about keystone | 01:06 |
| mordred | morganfainberg: so, I hope that's ok with you | 01:06 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone domains https://review.openstack.org/190396 | 01:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Disable user before deleting https://review.openstack.org/190397 | 01:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support project/tenant and domain vs. None https://review.openstack.org/190442 | 01:07 |
| *** EricGonczer_ has joined #openstack-infra | 01:07 | |
| mordred | morganfainberg: largely because of https://review.openstack.org/190442 which just really should make everyone unhappy | 01:08 |
| *** abitha has quit IRC | 01:09 | |
| Shrews | mordred: i am afraid to look | 01:09 |
| mordred | Shrews: you're going to enjoy it | 01:09 |
| mordred | Shrews: no - I haven't added tests yet - Im doing a pass through to get the stuff in, will do a different pass when I'm not transatlantic and can get to a devstack | 01:10 |
| Shrews | mordred: ack. i know how you work when in transit :-P | 01:10 |
| mordred | :) | 01:10 |
| *** chlong has quit IRC | 01:11 | |
| *** Swami_ has quit IRC | 01:12 | |
| Shrews | that review hurts my head. /me returns to his glass of scotch | 01:12 |
| mordred | Shrews: sorry :) | 01:12 |
| *** EricGonczer_ has quit IRC | 01:15 | |
| *** eantyshev has quit IRC | 01:15 | |
| *** timrc has quit IRC | 01:17 | |
| *** timrc has joined #openstack-infra | 01:18 | |
| crinkle | mordred: :D | 01:18 |
| *** dims_ has joined #openstack-infra | 01:18 | |
| *** gordc has joined #openstack-infra | 01:18 | |
| *** tiswanso has joined #openstack-infra | 01:19 | |
| *** otter768 has joined #openstack-infra | 01:20 | |
| *** dims has quit IRC | 01:21 | |
| *** tiswanso has quit IRC | 01:22 | |
| *** tiswanso has joined #openstack-infra | 01:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Add experimental cue-dsvm-rally job https://review.openstack.org/187620 | 01:23 |
| openstackgerrit | Kurt Taylor proposed openstack-infra/irc-meetings: Propose new Third Party CI Working Group meeting time https://review.openstack.org/190221 | 01:24 |
| *** otter768 has quit IRC | 01:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone domains https://review.openstack.org/190396 | 01:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone roles https://review.openstack.org/190449 | 01:33 |
| *** hdd has quit IRC | 01:43 | |
| *** xnox has quit IRC | 01:44 | |
| *** xnox has joined #openstack-infra | 01:47 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-dashboard: Deprecate Module https://review.openstack.org/189591 | 01:47 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Dont fail if were missing setfiles https://review.openstack.org/190453 | 01:50 |
| greghaynes | mordred: ^ I think our -minimal is broken right now | 01:51 |
| greghaynes | well, centos-minimal and maybe fedora-minimal | 01:51 |
| *** gordc has quit IRC | 01:52 | |
| greghaynes | SpamapS: if we merge ^ I can recheck https://review.openstack.org/#/c/181162/ and hopefully merge it then so we can prevent this from happening | 01:52 |
| *** gordc has joined #openstack-infra | 01:52 | |
| *** rkukura has quit IRC | 01:53 | |
| *** rkukura_ has joined #openstack-infra | 01:53 | |
| *** stevemar has quit IRC | 01:53 | |
| mordred | greghaynes: uhoh | 01:54 |
| greghaynes | yea, :( for us not gating on them yet but :) that were super close to doing it | 01:57 |
| *** marcusvrn has joined #openstack-infra | 02:01 | |
| *** marun has joined #openstack-infra | 02:01 | |
| *** Sukhdev has quit IRC | 02:07 | |
| *** fallenpegasus has joined #openstack-infra | 02:07 | |
| openstackgerrit | Eric Brown proposed openstack-infra/project-config: oslo.vmware non-voting bandit job https://review.openstack.org/190457 | 02:09 |
| *** Swami has joined #openstack-infra | 02:10 | |
| *** koolhead17 has joined #openstack-infra | 02:12 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Subscribe new oslo projects to g-r process https://review.openstack.org/187566 | 02:14 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Switch on requirements check for nova-docker https://review.openstack.org/183713 | 02:15 |
| *** darvon has quit IRC | 02:18 | |
| *** unicell has quit IRC | 02:18 | |
| *** amotoki has joined #openstack-infra | 02:21 | |
| *** claudiub has quit IRC | 02:30 | |
| *** baoli has joined #openstack-infra | 02:30 | |
| *** juggler has quit IRC | 02:33 | |
| *** dims_ has quit IRC | 02:33 | |
| *** juggler has joined #openstack-infra | 02:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone domains https://review.openstack.org/190396 | 02:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support project/tenant and domain vs. None https://review.openstack.org/190442 | 02:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone roles https://review.openstack.org/190449 | 02:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support keystone v3 in endpoint creation https://review.openstack.org/190465 | 02:38 |
| *** amotoki has quit IRC | 02:40 | |
| *** stevemar has joined #openstack-infra | 02:41 | |
| *** BharatK has quit IRC | 02:48 | |
| *** bknudson has left #openstack-infra | 02:49 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support keystone v3 in endpoint creation https://review.openstack.org/190465 | 02:51 |
| *** baoli has quit IRC | 02:52 | |
| *** bhuvan has joined #openstack-infra | 02:59 | |
| *** stevemar has quit IRC | 02:59 | |
| *** yamahata has quit IRC | 03:00 | |
| *** Swami_ has joined #openstack-infra | 03:02 | |
| *** david-lyle has joined #openstack-infra | 03:04 | |
| *** Swami has quit IRC | 03:05 | |
| *** nikeshm has joined #openstack-infra | 03:12 | |
| *** otter768 has joined #openstack-infra | 03:21 | |
| *** otter768 has quit IRC | 03:26 | |
| *** marun has quit IRC | 03:28 | |
| *** jerryz has quit IRC | 03:28 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Propose new Third Party CI Working Group meeting time https://review.openstack.org/190221 | 03:29 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add senlin project meeting https://review.openstack.org/190197 | 03:33 |
| *** dims has joined #openstack-infra | 03:33 | |
| *** bhunter71 has quit IRC | 03:34 | |
| *** cody-somerville has quit IRC | 03:34 | |
| *** arxcruz has joined #openstack-infra | 03:36 | |
| nikeshm | hi | 03:38 |
| nikeshm | i was wondering that in check pipeline we can filter the gerrit events having +1 from jenkins so trying http://paste.openstack.org/show/282719/ in zuul.yaml | 03:39 |
| *** tiswanso has quit IRC | 03:39 | |
| nikeshm | but its not working | 03:39 |
| *** ashleighfarnham has quit IRC | 03:40 | |
| nikeshm | taking reference of http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/ | 03:40 |
| nikeshm | am i missing any thing | 03:40 |
| nikeshm | ? | 03:40 |
| *** arxcruz has quit IRC | 03:41 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add senlin project meeting https://review.openstack.org/190197 | 03:42 |
| nikeshm | sorry layout.yaml | 03:42 |
| *** Swami_ has quit IRC | 03:44 | |
| *** cody-somerville has joined #openstack-infra | 03:47 | |
| *** amotoki has joined #openstack-infra | 03:49 | |
| *** ihrachyshka has quit IRC | 03:49 | |
| *** fifieldt has joined #openstack-infra | 03:58 | |
| *** rossella_s has quit IRC | 03:58 | |
| *** rossella_s has joined #openstack-infra | 03:58 | |
| *** jeax is now known as whitenoise | 03:59 | |
| *** hichihara has joined #openstack-infra | 04:03 | |
| *** xnox has quit IRC | 04:05 | |
| *** hichihara has left #openstack-infra | 04:05 | |
| *** yamada-h has joined #openstack-infra | 04:05 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-ofagent: move from stackforge/ to openstack/ https://review.openstack.org/187859 | 04:07 |
| *** yamada-h has quit IRC | 04:08 | |
| *** ayoung has quit IRC | 04:09 | |
| *** yamada-h has joined #openstack-infra | 04:10 | |
| *** hichihara has joined #openstack-infra | 04:11 | |
| *** xnox has joined #openstack-infra | 04:11 | |
| *** nijaba has quit IRC | 04:20 | |
| *** hdd has joined #openstack-infra | 04:23 | |
| *** marcusvrn has quit IRC | 04:24 | |
| *** harlowja_at_home has joined #openstack-infra | 04:25 | |
| *** markvoelker has quit IRC | 04:26 | |
| *** jerryz has joined #openstack-infra | 04:27 | |
| *** yamada-h has joined #openstack-infra | 04:31 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone domains https://review.openstack.org/190396 | 04:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support project/tenant and domain vs. None https://review.openstack.org/190442 | 04:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support keystone v3 in endpoint creation https://review.openstack.org/190465 | 04:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add CRUD methods for Keystone roles https://review.openstack.org/190449 | 04:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add role grant/revoke methods https://review.openstack.org/190478 | 04:31 |
| mtreinish | fungi, jhesketh: so I think the subunit2sql worker is hung it doesn't seem to be adding new tests to the db | 04:35 |
| mtreinish | and the logstash queue graph on status.o.o is stuck at a high number (which I am assuming means it hasn't been pulling jobs off the gearman queue) | 04:35 |
| *** Kennan2 has joined #openstack-infra | 04:36 | |
| *** Kennan has quit IRC | 04:37 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: make Puppet 4 unit test jobs voting https://review.openstack.org/190479 | 04:37 |
| jhesketh | mtreinish: hmm :-( | 04:37 |
| jhesketh | mtreinish: unfortunately I don't have keys to any of the servers to poke | 04:37 |
| jhesketh | mtreinish: logstash's CPU usage seems to be maxed out | 04:38 |
| jhesketh | on a core anywya | 04:38 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: make Puppet 4 unit test jobs voting https://review.openstack.org/190479 | 04:38 |
| mtreinish | jhesketh: hmm, yeah that's bizarre. But the worker is a separate box subunit-worker01.o.o | 04:40 |
| mtreinish | logstash.o.o is only used as a tcp proxy to pass through mysql to the trove node | 04:40 |
| mtreinish | oh and I guess the gearman server is there too | 04:40 |
| *** changbl has joined #openstack-infra | 04:42 | |
| jhesketh | yeah, I suspect it needs a kick, but I can't do much more :-( | 04:42 |
| *** Swami has joined #openstack-infra | 04:42 | |
| *** ivar-laz_ has joined #openstack-infra | 04:44 | |
| *** abregman has joined #openstack-infra | 04:46 | |
| *** maishsk_afk has quit IRC | 04:48 | |
| *** ivar-lazzaro has quit IRC | 04:48 | |
| *** ivar-laz_ has quit IRC | 04:49 | |
| *** harlowja_at_home has quit IRC | 04:51 | |
| mtreinish | jhesketh: :( ok, I guess I'll have to wait for someone with the magic keys to wake up. (although I probably won't be online then) | 04:52 |
| jhesketh | sorry I can't help more :-( | 04:52 |
| mtreinish | no worries | 04:52 |
| *** yfried has quit IRC | 04:53 | |
| *** sdake has joined #openstack-infra | 04:56 | |
| lifeless | fungi: huh | 04:58 |
| *** puranamr has joined #openstack-infra | 04:58 | |
| *** achanda has joined #openstack-infra | 04:59 | |
| *** ajmiller_ has quit IRC | 05:05 | |
| *** ajmiller has joined #openstack-infra | 05:06 | |
| *** puranamr has quit IRC | 05:07 | |
| *** patrickeast has quit IRC | 05:11 | |
| nikeshm | fungi : hi | 05:12 |
| *** deepakcs has joined #openstack-infra | 05:12 | |
| nikeshm | fungi : i am trying to gerrit events having +1 from jenkins for job pipelines so trying http://paste.openstack.org/show/282719/ in zuul.yaml | 05:13 |
| *** rkukura_ has quit IRC | 05:13 | |
| nikeshm | but its not working | 05:13 |
| nikeshm | any idea | 05:13 |
| nikeshm | following this doc http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/ | 05:14 |
| *** rkukura has joined #openstack-infra | 05:14 | |
| *** yamada-h has quit IRC | 05:16 | |
| *** yamada-h has joined #openstack-infra | 05:18 | |
| *** otter768 has joined #openstack-infra | 05:22 | |
| *** achanda has quit IRC | 05:22 | |
| *** yamada-h has quit IRC | 05:22 | |
| *** unicell has joined #openstack-infra | 05:24 | |
| *** bhunter71 has joined #openstack-infra | 05:25 | |
| *** otter768 has quit IRC | 05:27 | |
| *** markvoelker has joined #openstack-infra | 05:27 | |
| *** esmute has quit IRC | 05:28 | |
| *** esmute_ has joined #openstack-infra | 05:32 | |
| *** markvoelker has quit IRC | 05:32 | |
| *** aswadr has joined #openstack-infra | 05:34 | |
| *** ildikov_ has quit IRC | 05:35 | |
| *** esmute_ has quit IRC | 05:35 | |
| *** unicell1 has joined #openstack-infra | 05:35 | |
| *** unicell has quit IRC | 05:36 | |
| *** esmute has joined #openstack-infra | 05:36 | |
| *** esmute has quit IRC | 05:38 | |
| *** esmute has joined #openstack-infra | 05:40 | |
| *** stevemar has joined #openstack-infra | 05:42 | |
| *** dannywilson has joined #openstack-infra | 05:48 | |
| *** dannywilson has quit IRC | 05:48 | |
| *** tjones1 has joined #openstack-infra | 05:48 | |
| *** ildikov_ has joined #openstack-infra | 05:48 | |
| *** dannywilson has joined #openstack-infra | 05:48 | |
| *** coolsvap|afk is now known as coolsvap | 05:50 | |
| *** esmute has quit IRC | 05:54 | |
| *** esmute has joined #openstack-infra | 05:55 | |
| *** armax has quit IRC | 05:59 | |
| *** achanda has joined #openstack-infra | 05:59 | |
| *** esmute has quit IRC | 06:00 | |
| *** johnthetubaguy has quit IRC | 06:00 | |
| *** BharatK has joined #openstack-infra | 06:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/190490 | 06:00 |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: networking-ofagent: move from stackforge/ to openstack/ https://review.openstack.org/187859 | 06:00 |
| *** johnthetubaguy has joined #openstack-infra | 06:02 | |
| *** stevemar2 has joined #openstack-infra | 06:04 | |
| *** esmute has joined #openstack-infra | 06:05 | |
| *** tjones1 has quit IRC | 06:05 | |
| *** abitha has joined #openstack-infra | 06:05 | |
| *** BharatK has quit IRC | 06:05 | |
| *** heyongli has quit IRC | 06:06 | |
| *** heyongli- is now known as heyongli | 06:06 | |
| *** stevemar has quit IRC | 06:06 | |
| *** esmute has quit IRC | 06:06 | |
| *** yonglihe has joined #openstack-infra | 06:07 | |
| *** mrunge has joined #openstack-infra | 06:07 | |
| *** sdake has quit IRC | 06:08 | |
| *** asettle has quit IRC | 06:09 | |
| *** esmute has joined #openstack-infra | 06:10 | |
| *** woodster_ has quit IRC | 06:11 | |
| *** ildikov_ has quit IRC | 06:12 | |
| *** abitha has quit IRC | 06:12 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: [WIP] Import rdo packaging into openstack namespace https://review.openstack.org/189497 | 06:14 |
| *** Swami has quit IRC | 06:15 | |
| *** yamada-h has joined #openstack-infra | 06:15 | |
| *** yamada-h has quit IRC | 06:15 | |
| *** yfried has joined #openstack-infra | 06:16 | |
| *** BharatK has joined #openstack-infra | 06:17 | |
| *** maishsk_afk has joined #openstack-infra | 06:18 | |
| *** koolhead17 has quit IRC | 06:18 | |
| *** dtantsur|afk is now known as dtantsur | 06:22 | |
| *** jtomasek has joined #openstack-infra | 06:27 | |
| *** esmute has quit IRC | 06:27 | |
| *** markvoelker has joined #openstack-infra | 06:28 | |
| *** maishsk_afk is now known as maishsk | 06:30 | |
| *** esmute has joined #openstack-infra | 06:30 | |
| *** Hal has joined #openstack-infra | 06:31 | |
| *** Hal is now known as Guest44108 | 06:31 | |
| *** scheuran has joined #openstack-infra | 06:31 | |
| *** achanda has quit IRC | 06:32 | |
| *** markvoelker has quit IRC | 06:32 | |
| *** aswadr has quit IRC | 06:35 | |
| *** esmute has quit IRC | 06:36 | |
| *** mpaolino has joined #openstack-infra | 06:37 | |
| *** esmute has joined #openstack-infra | 06:38 | |
| *** soren has joined #openstack-infra | 06:39 | |
| *** esmute has quit IRC | 06:40 | |
| *** koolhead17 has joined #openstack-infra | 06:40 | |
| *** ashleighfarnham has joined #openstack-infra | 06:40 | |
| *** achanda has joined #openstack-infra | 06:41 | |
| *** mpaolino has quit IRC | 06:42 | |
| *** ashleighfarnham has quit IRC | 06:44 | |
| *** ZZelle_ has joined #openstack-infra | 06:45 | |
| *** jcoufal has joined #openstack-infra | 06:49 | |
| *** jith_ has joined #openstack-infra | 06:53 | |
| openstackgerrit | Jerome Hourquebie proposed openstack-infra/jenkins-job-builder: Add cloudbees folder creation support https://review.openstack.org/189697 | 07:03 |
| *** che-arne has quit IRC | 07:06 | |
| *** e0ne has joined #openstack-infra | 07:08 | |
| *** hdd has quit IRC | 07:09 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/puppet-zanata: Correctly determine the server id https://review.openstack.org/190516 | 07:12 |
| *** markus_z has joined #openstack-infra | 07:12 | |
| *** e0ne has quit IRC | 07:12 | |
| *** deepakcs has quit IRC | 07:13 | |
| *** yamada-h has joined #openstack-infra | 07:13 | |
| *** gordc has quit IRC | 07:14 | |
| *** matbu has joined #openstack-infra | 07:14 | |
| *** shardy has joined #openstack-infra | 07:14 | |
| *** matbu has left #openstack-infra | 07:15 | |
| *** esmute has joined #openstack-infra | 07:16 | |
| *** juggler has quit IRC | 07:17 | |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 07:18 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 07:18 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 07:18 |
| openstackgerrit | lifeless proposed openstack/requirements: Formatting nits in update.py. https://review.openstack.org/190522 | 07:18 |
| openstackgerrit | lifeless proposed openstack/requirements: Move update.py into the python package. https://review.openstack.org/190523 | 07:18 |
| *** fawadkhaliq has joined #openstack-infra | 07:19 | |
| *** yamada-h has quit IRC | 07:19 | |
| StevenK | lifeless: "Mark as Python2.7 only the dependencies that are." reads like Yoda wrote it | 07:20 |
| *** koolhead17 has quit IRC | 07:22 | |
| *** otter768 has joined #openstack-infra | 07:23 | |
| *** ZZelle_ has quit IRC | 07:23 | |
| *** bradjones has quit IRC | 07:27 | |
| *** otter768 has quit IRC | 07:27 | |
| *** e0ne has joined #openstack-infra | 07:28 | |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/nodepool: Make config more tolerant of errors https://review.openstack.org/190526 | 07:28 |
| *** eantyshev has joined #openstack-infra | 07:28 | |
| *** esmute has quit IRC | 07:28 | |
| *** bradjones has joined #openstack-infra | 07:29 | |
| *** bradjones has quit IRC | 07:29 | |
| *** bradjones has joined #openstack-infra | 07:29 | |
| *** e0ne has quit IRC | 07:29 | |
| *** juggler_ has joined #openstack-infra | 07:29 | |
| *** imcsk8 has quit IRC | 07:30 | |
| StevenK | cinerama, pleia2: Well, that was fun. https://review.openstack.org/#/c/190516/1 | 07:32 |
| *** yamada-h has joined #openstack-infra | 07:32 | |
| *** achanda has quit IRC | 07:33 | |
| *** jistr has joined #openstack-infra | 07:33 | |
| *** samuelBartel has joined #openstack-infra | 07:34 | |
| *** yamada-h has joined #openstack-infra | 07:36 | |
| *** yamada-h has quit IRC | 07:36 | |
| *** jlanoux has joined #openstack-infra | 07:37 | |
| *** dannywilson has quit IRC | 07:38 | |
| jith_ | hi all, what is the prerequisite to have a own CI setup ? | 07:39 |
| *** claudiub has joined #openstack-infra | 07:39 | |
| *** HeOS has quit IRC | 07:41 | |
| *** dannywilson has joined #openstack-infra | 07:46 | |
| *** ildikov_ has joined #openstack-infra | 07:47 | |
| *** imcsk8 has joined #openstack-infra | 07:48 | |
| *** arxcruz has joined #openstack-infra | 07:49 | |
| *** dannywilson has quit IRC | 07:51 | |
| *** dannywilson has joined #openstack-infra | 07:51 | |
| *** Ala has joined #openstack-infra | 07:54 | |
| *** abregman is now known as abregman|brb | 07:56 | |
| *** dannywilson has quit IRC | 07:56 | |
| *** achanda has joined #openstack-infra | 07:57 | |
| *** hashar has joined #openstack-infra | 07:58 | |
| *** isviridov_away is now known as isviridov | 07:59 | |
| *** ZZelle has quit IRC | 08:01 | |
| *** rkukura_ has joined #openstack-infra | 08:02 | |
| *** ZZelle has joined #openstack-infra | 08:02 | |
| *** jamespage_ has joined #openstack-infra | 08:02 | |
| *** rkukura has quit IRC | 08:04 | |
| *** rkukura_ is now known as rkukura | 08:04 | |
| *** koolhead17 has joined #openstack-infra | 08:06 | |
| *** achanda_ has joined #openstack-infra | 08:08 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/project-config: Move dogtag ca tests from experimental to standard checks https://review.openstack.org/190534 | 08:08 |
| *** fhubik has joined #openstack-infra | 08:09 | |
| *** scheuran has quit IRC | 08:09 | |
| *** abregman|brb is now known as abregman | 08:09 | |
| *** stevemar2 has quit IRC | 08:09 | |
| *** achanda has quit IRC | 08:11 | |
| *** yamada-h has joined #openstack-infra | 08:11 | |
| *** yamada-h has quit IRC | 08:11 | |
| *** yamada-h has joined #openstack-infra | 08:13 | |
| *** achanda_ has quit IRC | 08:13 | |
| GheRivero | morning all | 08:14 |
| *** mfmcdonagh has quit IRC | 08:14 | |
| *** mcdonagm has quit IRC | 08:14 | |
| *** yamada-h has joined #openstack-infra | 08:14 | |
| *** markvoelker has joined #openstack-infra | 08:16 | |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/nodepool: Make diskimage example config work https://review.openstack.org/190538 | 08:17 |
| *** scheuran has joined #openstack-infra | 08:17 | |
| *** yamada-h has joined #openstack-infra | 08:18 | |
| *** bhuvan has quit IRC | 08:19 | |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/project-config: Add dependency on nodepool-base to node-devstack https://review.openstack.org/190539 | 08:21 |
| *** markvoelker has quit IRC | 08:21 | |
| *** Nikkau has joined #openstack-infra | 08:22 | |
| *** yamada-h has joined #openstack-infra | 08:25 | |
| *** jistr has quit IRC | 08:27 | |
| *** yamada-h has joined #openstack-infra | 08:29 | |
| *** yamada-h has quit IRC | 08:29 | |
| *** yamada-h has joined #openstack-infra | 08:31 | |
| *** yamada-h has joined #openstack-infra | 08:31 | |
| *** yamada-h has joined #openstack-infra | 08:33 | |
| *** oomichi has joined #openstack-infra | 08:33 | |
| *** yamada-h has quit IRC | 08:33 | |
| *** yamada-h has joined #openstack-infra | 08:34 | |
| *** fawadkhaliq has quit IRC | 08:35 | |
| *** fawadkhaliq has joined #openstack-infra | 08:35 | |
| *** yamada-h has joined #openstack-infra | 08:35 | |
| *** dizquierdo has joined #openstack-infra | 08:35 | |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: networking-bgpvpn: move from stackforge/ to openstack/ https://review.openstack.org/188822 | 08:36 |
| *** yamada-h has joined #openstack-infra | 08:36 | |
| *** yamada-h has quit IRC | 08:36 | |
| *** yamada-h has joined #openstack-infra | 08:38 | |
| *** yamada-h has joined #openstack-infra | 08:39 | |
| *** cdent has joined #openstack-infra | 08:40 | |
| *** yamada-h has joined #openstack-infra | 08:41 | |
| *** yamada-h has quit IRC | 08:41 | |
| *** afazekas has joined #openstack-infra | 08:41 | |
| *** claudiub has quit IRC | 08:41 | |
| *** claudiub has joined #openstack-infra | 08:42 | |
| *** yamada-h has joined #openstack-infra | 08:43 | |
| *** jistr has joined #openstack-infra | 08:43 | |
| *** yamada-h has joined #openstack-infra | 08:45 | |
| *** yamada-h has quit IRC | 08:45 | |
| *** koolhead17 has quit IRC | 08:47 | |
| *** yamada-h has joined #openstack-infra | 08:47 | |
| *** yamada-h has quit IRC | 08:47 | |
| *** k4n0 has joined #openstack-infra | 08:48 | |
| *** _nadya_ has joined #openstack-infra | 08:53 | |
| *** shardy_ has joined #openstack-infra | 08:54 | |
| *** shardy has quit IRC | 08:54 | |
| *** HeOS has joined #openstack-infra | 08:55 | |
| *** katyafervent_awa is now known as katyafervent | 08:58 | |
| *** shardy_ has quit IRC | 08:59 | |
| *** shardy has joined #openstack-infra | 08:59 | |
| *** shardy has quit IRC | 09:00 | |
| *** shardy has joined #openstack-infra | 09:00 | |
| *** che-arne has joined #openstack-infra | 09:02 | |
| *** yamahata has joined #openstack-infra | 09:06 | |
| *** enikanorov_ has quit IRC | 09:06 | |
| *** enikanorov has joined #openstack-infra | 09:06 | |
| *** jd__ has quit IRC | 09:08 | |
| *** maishsk is now known as maishsk_afk | 09:08 | |
| *** dguerri` is now known as dguerri | 09:08 | |
| *** jd__ has joined #openstack-infra | 09:09 | |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 09:10 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 09:10 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 09:10 |
| openstackgerrit | lifeless proposed openstack/requirements: Group pure and IO functions in update.py. https://review.openstack.org/190554 | 09:10 |
| openstackgerrit | lifeless proposed openstack/requirements: Remove VERBOSE global state. https://review.openstack.org/190555 | 09:10 |
| *** abitha has joined #openstack-infra | 09:13 | |
| Daviey | lifeless: why is upper-constraints being handled outside of requirements.txt? | 09:13 |
| Daviey | is there a SPEC on this or something i can follow? | 09:13 |
| *** dimtruck is now known as zz_dimtruck | 09:14 | |
| lifeless | Daviey: yes, the requirements-management spec in openstack/openstack-specs | 09:14 |
| lifeless | Daviey: also see the README in the repo | 09:14 |
| *** abitha has quit IRC | 09:17 | |
| *** gordc has joined #openstack-infra | 09:22 | |
| *** otter768 has joined #openstack-infra | 09:23 | |
| *** pelix has joined #openstack-infra | 09:24 | |
| *** dizquierdo has quit IRC | 09:26 | |
| *** jerryz has quit IRC | 09:26 | |
| *** otter768 has quit IRC | 09:28 | |
| *** dguitarbite has joined #openstack-infra | 09:28 | |
| *** _nadya_ has quit IRC | 09:30 | |
| *** deepakcs has joined #openstack-infra | 09:32 | |
| *** pelix has quit IRC | 09:32 | |
| *** teran_ has quit IRC | 09:32 | |
| *** yfried is now known as yfried|afk | 09:35 | |
| *** yamahata has quit IRC | 09:35 | |
| *** oomichi has quit IRC | 09:39 | |
| Daviey | lifeless: Thanks, added some questions to the spec review | 09:39 |
| *** achanda has joined #openstack-infra | 09:44 | |
| *** dims_ has joined #openstack-infra | 09:44 | |
| *** gordc has quit IRC | 09:45 | |
| *** dizquierdo has joined #openstack-infra | 09:46 | |
| *** dims has quit IRC | 09:47 | |
| *** e0ne has joined #openstack-infra | 09:47 | |
| *** yamada-h has joined #openstack-infra | 09:48 | |
| *** dizquierdo_ has joined #openstack-infra | 09:51 | |
| *** e0ne is now known as e0ne_ | 09:54 | |
| *** dizquierdo has quit IRC | 09:55 | |
| *** yfried|afk is now known as yfried | 09:55 | |
| *** mpaolino has joined #openstack-infra | 09:55 | |
| *** Daviey has quit IRC | 09:55 | |
| *** Daviey has joined #openstack-infra | 09:55 | |
| *** fawadkhaliq has quit IRC | 09:55 | |
| *** e0ne_ has quit IRC | 10:00 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 10:00 |
| lifeless | Daviey: replied | 10:01 |
| lifeless | Daviey: feel free to do bknudson's edits and roll my answers into the prose. Collaborative editing FTW. | 10:01 |
| *** e0ne has joined #openstack-infra | 10:01 | |
| *** HeOS_ has joined #openstack-infra | 10:03 | |
| *** achanda has quit IRC | 10:04 | |
| *** markvoelker has joined #openstack-infra | 10:05 | |
| *** pelix has joined #openstack-infra | 10:06 | |
| *** markvoelker has quit IRC | 10:10 | |
| *** achanda has joined #openstack-infra | 10:10 | |
| *** fawadkhaliq has joined #openstack-infra | 10:10 | |
| openstackgerrit | lifeless proposed openstack/requirements: Remove VERBOSE global state. https://review.openstack.org/190555 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Group pure and IO functions in update.py. https://review.openstack.org/190554 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Move update.py into the python package. https://review.openstack.org/190523 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 10:11 |
| openstackgerrit | lifeless proposed openstack/requirements: Make _write_setup_py pure. https://review.openstack.org/190565 | 10:11 |
| *** achanda has quit IRC | 10:15 | |
| frickler | nodepool.openstack.org looks strange, no build results available for yesterday, and every puppet run seems to reinstall libxslt-dev | 10:16 |
| *** yfried is now known as yfried|afk | 10:18 | |
| *** yfried|afk is now known as yfried | 10:19 | |
| *** asselin has quit IRC | 10:20 | |
| *** kmartin has quit IRC | 10:21 | |
| *** achanda has joined #openstack-infra | 10:21 | |
| *** achanda has quit IRC | 10:22 | |
| *** yamada-h has quit IRC | 10:25 | |
| *** koolhead17 has joined #openstack-infra | 10:27 | |
| *** fawadkhaliq has quit IRC | 10:27 | |
| *** teran has joined #openstack-infra | 10:30 | |
| *** ociuhandu has joined #openstack-infra | 10:30 | |
| *** yfried is now known as yfried|afk | 10:31 | |
| *** e0ne is now known as e0ne_ | 10:33 | |
| *** teran_ has joined #openstack-infra | 10:33 | |
| *** e0ne_ is now known as e0ne | 10:34 | |
| *** teran has quit IRC | 10:34 | |
| *** ociuhandu has quit IRC | 10:35 | |
| *** yfried|afk is now known as yfried | 10:36 | |
| *** pc_m has joined #openstack-infra | 10:39 | |
| *** shardy_ has joined #openstack-infra | 10:39 | |
| *** fawadkhaliq has joined #openstack-infra | 10:40 | |
| sdague | russellb: once you get up, I looked at the patch. Conceptually +2, but a naming question that I at least wanted to run past you before approving. | 10:40 |
| *** shardy has quit IRC | 10:41 | |
| *** ildikov_ has quit IRC | 10:43 | |
| *** dizquierdo_ has quit IRC | 10:44 | |
| *** shardy_ has quit IRC | 10:45 | |
| *** jschwarz_ has joined #openstack-infra | 10:45 | |
| jschwarz_ | hichihara, hi - re https://review.openstack.org/#/c/189293/ | 10:45 |
| *** shardy has joined #openstack-infra | 10:45 | |
| jschwarz_ | do you have a minute? :) | 10:45 |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/nodepool: Add hostname templates to config validator https://review.openstack.org/190575 | 10:48 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Revert "Revert "only force off KEYSTONE_USE_WSGI up until kilo"" https://review.openstack.org/190576 | 10:49 |
| * frickler is really astonished that no one ever validated their nodepool.conf for almost a year ^^ | 10:49 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Support anonymous credentials for Jenkins plugin info query https://review.openstack.org/179455 | 10:50 |
| *** yfried is now known as yfried|afk | 10:53 | |
| *** ildikov_ has joined #openstack-infra | 10:53 | |
| *** yamada-h has joined #openstack-infra | 10:56 | |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Revert "Revert "only force off KEYSTONE_USE_WSGI up until kilo"" https://review.openstack.org/190576 | 10:56 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Revert "Revert "only force off KEYSTONE_USE_WSGI up until kilo"" https://review.openstack.org/190576 | 10:57 |
| *** jtomasek has quit IRC | 10:58 | |
| openstackgerrit | Merged openstack-infra/project-config: Import mox3 library https://review.openstack.org/190330 | 10:59 |
| *** yamada-h has quit IRC | 11:01 | |
| openstackgerrit | lifeless proposed openstack/requirements: Remove VERBOSE global state. https://review.openstack.org/190555 | 11:02 |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 11:02 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 11:02 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 11:02 |
| openstackgerrit | lifeless proposed openstack/requirements: Make _write_setup_py pure. https://review.openstack.org/190565 | 11:02 |
| openstackgerrit | lifeless proposed openstack/requirements: Don't write partial requirements files. https://review.openstack.org/190582 | 11:02 |
| *** fhubik is now known as fhubik_afk | 11:06 | |
| *** achanda has joined #openstack-infra | 11:07 | |
| *** yfried|afk is now known as yfried | 11:07 | |
| *** jtomasek has joined #openstack-infra | 11:08 | |
| *** openstackgerrit has quit IRC | 11:13 | |
| *** openstackgerrit has joined #openstack-infra | 11:14 | |
| *** nijaba has joined #openstack-infra | 11:14 | |
| *** jmccarthy has joined #openstack-infra | 11:14 | |
| *** _nadya_ has joined #openstack-infra | 11:15 | |
| *** baoli has joined #openstack-infra | 11:18 | |
| jmccarthy | Hello, anyone else run into an issue like this here ? https://code.google.com/p/gerrit/issues/detail?id=3377 | 11:20 |
| jmccarthy | It is about trying to update contact details, but bounces back with server error each time .. | 11:20 |
| *** e0ne is now known as e0ne_ | 11:21 | |
| *** markvoelker has joined #openstack-infra | 11:21 | |
| *** otter768 has joined #openstack-infra | 11:24 | |
| *** achanda has quit IRC | 11:25 | |
| fungi | jmccarthy: see https://ask.openstack.org/question/56720 | 11:25 |
| *** markvoelker has quit IRC | 11:25 | |
| openstackgerrit | Merged openstack-infra/project-config: Add libjerasure dev packages on workers https://review.openstack.org/189471 | 11:26 |
| *** otter768 has quit IRC | 11:29 | |
| frickler | fungi: good morning, are you already awake enough to look at nodepool? ;) | 11:29 |
| *** ldnunes has joined #openstack-infra | 11:31 | |
| *** e0ne_ has quit IRC | 11:32 | |
| *** e0ne has joined #openstack-infra | 11:36 | |
| fungi | frickler: probably. i saw you mentioned that it didn't... complete image updates? | 11:37 |
| fungi | you were a little vague | 11:37 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/puppet-openstackci: Add generic zuul manifests https://review.openstack.org/175970 | 11:37 |
| frickler | fungi: well, I see no logs at all from yesterdays builds on the webpage. also the puppet jobs may be strange, but as I can only see the last 10, I'm not sure about that | 11:40 |
| *** radez_g0n3 is now known as radez | 11:40 | |
| frickler | fungi: see e.g. http://puppetboard.openstack.org/report/nodepool.openstack.org/7514a70532af69c1a9748358f2933a53e835990f that seems to repeat on every run | 11:41 |
| fungi | i'm trying a manual image update now to see if it completes, though yes it looks like we have no images from yesterday. it's likely we broke them by merging new project creation changes, which creates a bit of a race condition in our image updates if they try to clone all the repos while a new one is listed in the gerrit/projects.yaml but hasn't been built out to the git servers yet | 11:41 |
| frickler | fungi: but with just the error from cloning I would expect to see logs with error messages pretty fast, like I did here when doing image builds locally | 11:43 |
| fungi | yep, i would expect that too. we're also in the process of merging changes to refactor the puppet modules which set up our nodepool server, among others, and that includes some overrides to log handling so it's possible we've broken that as well | 11:45 |
| *** julim has joined #openstack-infra | 11:45 | |
| *** baoli has quit IRC | 11:45 | |
| frickler | fungi: maybe unrelated there is also a pretty high number of "Console logs not available" messages over in #qa, as well as logstash having a bit of load | 11:46 |
| *** baoli has joined #openstack-infra | 11:46 | |
| *** ldnunes_ has joined #openstack-infra | 11:47 | |
| fungi | yeah, unrelated. there may be issues with the elasticsearch cluster. i haven't had time to give it a good checkup | 11:47 |
| fungi | but our nodepool logs have nothing to do with logstash.openstack.org, it's entirely a log search system for test log data | 11:49 |
| *** derekh has joined #openstack-infra | 11:49 | |
| *** ldnunes_ has quit IRC | 11:50 | |
| fungi | looks like the image builds from the 8th are the last time we got logs for them | 11:50 |
| fungi | so we're missing the last two days of logs. we did actually get images on the 9th, so this points to an issue with log generation | 11:51 |
| *** _nadya_ has quit IRC | 11:51 | |
| fungi | the logging config in the system-config repo looks up to date with the nodepool.yaml template (i just reran the generation script for it, empty diff) | 11:52 |
| frickler | es2 seems to be pretty tight on disk space compared to the other nodes. (except es1 which has no data in cacti for almost a year | 11:52 |
| frickler | fungi: the latest logs are also from the 9th, so that matches, doesn't it? | 11:52 |
| *** yfried is now known as yfried|afk | 11:53 | |
| *** yamamoto has quit IRC | 11:53 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/devstack-gate: Add Rally to projects list https://review.openstack.org/190601 | 11:54 |
| fungi | oh, you're right. the latest _rotated_ logs are from the 8th | 11:55 |
| *** deepakcs has quit IRC | 11:55 | |
| sdague | fungi et al: https://review.openstack.org/#/c/187725 is the project config changes needed to do the heat grenade testing without my hackamazoo d-g change | 11:55 |
| fungi | see, too early for me still. haven't grabbed coffee or showered yet | 11:55 |
| *** markvoelker has joined #openstack-infra | 11:56 | |
| *** marcusvrn has joined #openstack-infra | 11:57 | |
| openstackgerrit | Mathieu Rohon proposed openstack-infra/project-config: networking-bgpvpn: move from stackforge/ to openstack/ https://review.openstack.org/188822 | 11:57 |
| frickler | fungi: don't blame me, that's what I asked you about initially ;) | 11:58 |
| *** rossella_s has quit IRC | 11:58 | |
| fungi | indeed | 11:58 |
| *** rossella_s has joined #openstack-infra | 11:58 | |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 11:59 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 11:59 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 11:59 |
| openstackgerrit | lifeless proposed openstack/requirements: Make _copy_requires pure. https://review.openstack.org/190604 | 11:59 |
| openstackgerrit | lifeless proposed openstack/requirements: Split main out a little for testing. https://review.openstack.org/190605 | 11:59 |
| openstackgerrit | lifeless proposed openstack/requirements: Reduce dataloss window through interrupted writes. https://review.openstack.org/190606 | 11:59 |
| *** hashar has quit IRC | 12:00 | |
| lifeless | fungi: I'm queuing up a lovely storm for you | 12:00 |
| *** alexpilotti has joined #openstack-infra | 12:01 | |
| fungi | frickler: found it | 12:02 |
| fungi | frickler: looks like it may be a shade (or perhaps swiftclient?) issue, or might be a problem with our clouds.yaml i guess http://paste.openstack.org/show/283789 | 12:02 |
| fungi | frickler: i'll start seeing if i can unwind that once i'm better caffeinated | 12:03 |
| fungi | mordred: Shrews: that ^ paste may interest you too | 12:03 |
| fungi | lifeless: thanks, i started going back through those when i first woke up. will dig deeper if today doesn't go completely off the rails | 12:04 |
| frickler | fungi: I had a pretty similar looking issue recently, now if I only could remember how I fixed that ... | 12:04 |
| *** BharatK has quit IRC | 12:05 | |
| *** claudiub has quit IRC | 12:05 | |
| fungi | frickler: my guess is it's something we either released in the past 48 hours, or something we merged to nodepool or the nodepool configs | 12:05 |
| *** yfried|afk is now known as yfried | 12:05 | |
| *** dizquierdo has joined #openstack-infra | 12:06 | |
| *** alexpilotti has quit IRC | 12:09 | |
| *** rfolco has joined #openstack-infra | 12:10 | |
| *** ociuhandu has joined #openstack-infra | 12:10 | |
| *** fhubik_afk is now known as fhubik | 12:13 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Update tox environment list https://review.openstack.org/190609 | 12:14 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Cleanup web code https://review.openstack.org/190610 | 12:14 |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Hide jobs with no failures https://review.openstack.org/190611 | 12:14 |
| *** ociuhandu has quit IRC | 12:18 | |
| sdague | fungi: so I'd like to fast revert / revert - https://review.openstack.org/#/c/190576/ - because the fix was done in the wrong place for that bug, which makes us not test keystone in an expected way | 12:18 |
| sdague | the real fix is here - https://review.openstack.org/#/c/190597 | 12:18 |
| sdague | you were the approver on the original revert | 12:19 |
| *** dkranz has joined #openstack-infra | 12:19 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev https://review.openstack.org/176010 | 12:22 |
| openstackgerrit | Merged openstack-infra/project-config: oslo.vmware non-voting bandit job https://review.openstack.org/190457 | 12:22 |
| *** Ala has quit IRC | 12:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds rtfd post-hooks to all akanda projects https://review.openstack.org/188909 | 12:24 |
| frickler | fungi: from what I can see, modules/openstack_project/templates/nodepool/clouds.yaml.erb does need to be updated with region-name instead of r_n (was I95273b1f28d313b9ae799f1a90ccd9693e60e18e), but that should have shown much earlier | 12:30 |
| *** ajmiller has quit IRC | 12:31 | |
| openstackgerrit | Merged openstack/requirements: Formatting nits in update.py. https://review.openstack.org/190522 | 12:31 |
| frickler | ah, maybe that only took effect when nodepoold was restarted somewhat later | 12:31 |
| *** yamamoto has joined #openstack-infra | 12:32 | |
| *** ihrachyshka has joined #openstack-infra | 12:33 | |
| *** aysyanne has joined #openstack-infra | 12:33 | |
| openstackgerrit | Merged openstack-infra/project-config: Adding #openstack-searchlight IRC channel https://review.openstack.org/190235 | 12:33 |
| *** yamamoto has quit IRC | 12:33 | |
| *** ociuhandu has joined #openstack-infra | 12:33 | |
| *** sdake has joined #openstack-infra | 12:33 | |
| *** yamamoto has joined #openstack-infra | 12:34 | |
| *** shardy_ has joined #openstack-infra | 12:34 | |
| frickler | jeblair: you reverted 40a9cef1fcea4bb5aae90baa4eafb5289b86254c, but I think the change to region-name is needed, see above | 12:34 |
| *** yamamoto_ has joined #openstack-infra | 12:34 | |
| *** Ala has joined #openstack-infra | 12:35 | |
| *** shardy has quit IRC | 12:35 | |
| openstackgerrit | lifeless proposed openstack/requirements: Reduce dataloss window through interrupted writes. https://review.openstack.org/190606 | 12:35 |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 12:35 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 12:35 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 12:35 |
| openstackgerrit | lifeless proposed openstack/requirements: Add basic testing of options -> parameters. https://review.openstack.org/190616 | 12:35 |
| openstackgerrit | lifeless proposed openstack/requirements: Convert test_update_suffix to unit tests. https://review.openstack.org/190617 | 12:35 |
| lifeless | fungi: there, that should keep you busy. | 12:35 |
| lifeless | night all, I hope | 12:37 |
| *** yamamoto has quit IRC | 12:38 | |
| *** shardy_ has quit IRC | 12:39 | |
| *** fhubik is now known as fhubik_afk | 12:39 | |
| *** dprince has joined #openstack-infra | 12:39 | |
| *** shardy has joined #openstack-infra | 12:40 | |
| *** marun has joined #openstack-infra | 12:40 | |
| *** derekh has quit IRC | 12:40 | |
| *** fhubik_afk is now known as fhubik | 12:40 | |
| *** derekh has joined #openstack-infra | 12:42 | |
| *** mrunge has quit IRC | 12:43 | |
| *** marun has quit IRC | 12:45 | |
| *** yfried is now known as yfried|afk | 12:48 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Adding support for Beaker Builder Plugin https://review.openstack.org/179756 | 12:50 |
| *** hashar has joined #openstack-infra | 12:50 | |
| *** amotoki has quit IRC | 12:50 | |
| *** hichihara has quit IRC | 12:50 | |
| *** woodster_ has joined #openstack-infra | 12:51 | |
| *** jcoufal has quit IRC | 12:51 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Fix enabling of rally project in ci job https://review.openstack.org/190624 | 12:52 |
| *** fifieldt has quit IRC | 12:53 | |
| *** yfried|afk is now known as yfried | 12:54 | |
| *** bknudson has joined #openstack-infra | 12:57 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Fix enabling of rally project in ci jobs https://review.openstack.org/190624 | 12:58 |
| *** gordc has joined #openstack-infra | 12:58 | |
| *** mika has quit IRC | 12:58 | |
| *** mika has joined #openstack-infra | 12:58 | |
| *** bhunter71 has quit IRC | 12:58 | |
| *** fhubik is now known as fhubik_afk | 13:00 | |
| Shrews | fungi: umm, ewww? | 13:00 |
| *** rlandy has joined #openstack-infra | 13:00 | |
| *** isviridov is now known as isviridov_away | 13:00 | |
| *** fhubik_afk is now known as fhubik | 13:01 | |
| *** xyang1 has joined #openstack-infra | 13:02 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Revert nova swap and ephemeral BDMs patch fix https://review.openstack.org/190629 | 13:03 |
| *** Longgeek_ has quit IRC | 13:06 | |
| *** alivigni has joined #openstack-infra | 13:06 | |
| *** dizquierdo has quit IRC | 13:06 | |
| openstackgerrit | Flavio Percoco proposed openstack/requirements: Require pymongo>=3.0.2 https://review.openstack.org/190630 | 13:07 |
| openstackgerrit | Marek Denis proposed openstack-infra/project-config: Rename keystoneclient-saml2 to keystoneauth-saml2 https://review.openstack.org/190631 | 13:08 |
| marcusvrn | asselin_: krtaylor hi | 13:08 |
| asselin_ | hi | 13:08 |
| *** bhunter71 has joined #openstack-infra | 13:08 | |
| *** yfried has quit IRC | 13:09 | |
| *** kgiusti has joined #openstack-infra | 13:09 | |
| marcusvrn | there's some page with improvements in scoreboard that's desired? | 13:09 |
| asselin_ | ?? | 13:10 |
| marcusvrn | patrickaest said that there are tons of improvements to be done in the scoreboard | 13:10 |
| marcusvrn | is there a list of those improvements? | 13:11 |
| *** k4n0 has quit IRC | 13:11 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Revert "Revert "only force off KEYSTONE_USE_WSGI up until kilo"" https://review.openstack.org/190576 | 13:11 |
| *** EricGonczer_ has joined #openstack-infra | 13:11 | |
| asselin_ | marcusvrn, I don't think there's a list created | 13:11 |
| asselin_ | marcusvrn, I think he implied that by using it, you won't have difficulty finding something that can be improved :) | 13:12 |
| *** HeOS has quit IRC | 13:13 | |
| marcusvrn | asselin_: yep, I have already found :) | 13:13 |
| *** spzala has joined #openstack-infra | 13:13 | |
| jmccarthy | re: fungi: jmccarthy: see https://ask.openstack.org/question/56720 - Thanks ! That sorted it | 13:15 |
| marcusvrn | asselin_: I was thinking about create a summary, that will show how many fails/success/not run for each CI | 13:15 |
| *** dkranz has quit IRC | 13:15 | |
| marcusvrn | what do you think about this? | 13:15 |
| asselin_ | sure | 13:16 |
| *** EricGonczer_ has quit IRC | 13:17 | |
| marcusvrn | asselin_: and I was implementing the search by period instead of not timeframe....I think it can be more useful | 13:17 |
| *** tiswanso has joined #openstack-infra | 13:18 | |
| *** salv-orlando has quit IRC | 13:18 | |
| asselin_ | marcusvrn, what's the difference? | 13:18 |
| fungi | frickler: i'm starting to wonder is whether what we _need_ is a nodepoold restart. it's been running since june 4, so right at a week. we may have landed nodepool code updates to accommodate newer shade and haven't restarted since | 13:18 |
| fungi | i'm looking into that theory now | 13:19 |
| *** salv-orlando has joined #openstack-infra | 13:19 | |
| fungi | nope, nevermind. most recent nodepoold commits are older than that | 13:19 |
| marcusvrn | asselin_: If I want to see how my CI was going on last week, I don't need to start de search from today, I can select "start date" and "end date" | 13:20 |
| fungi | frickler: all changes to our nodepool configs are older than that as well | 13:21 |
| openstackgerrit | Russell Bryant proposed openstack-infra/devstack-gate: Add support for DEVSTACK_GATE_SETTINGS https://review.openstack.org/190321 | 13:21 |
| asselin_ | marcusvrn, ok...so a date filter | 13:21 |
| marcusvrn | asselin_: yes | 13:21 |
| *** leifmadsen_ is now known as leifmadsen | 13:21 | |
| Shrews | fungi: what version of shade? | 13:21 |
| fungi | frickler: shade 0.7.0 release is right in the suspected timeframe though | 13:21 |
| *** HeOS has joined #openstack-infra | 13:21 | |
| fungi | Shrews: that one | 13:22 |
| fungi | Shrews: nope, i lied | 13:22 |
| fungi | Shrews: still 0.6.5 on the server | 13:22 |
| openstackgerrit | Russell Bryant proposed openstack-infra/project-config: Use DEVSTACK_GATE_SETTINGS in networking-ovn https://review.openstack.org/190325 | 13:23 |
| fungi | swiftclient definitely hasn't released in a long time | 13:23 |
| *** jmccarthy has left #openstack-infra | 13:23 | |
| *** fhubik is now known as fhubik_afk | 13:23 | |
| fungi | nor os-cloud-config | 13:23 |
| *** salv-orl_ has joined #openstack-infra | 13:24 | |
| russellb | sdague: suggestions sounded good to me, updated :) | 13:25 |
| *** salv-orlando has quit IRC | 13:25 | |
| russellb | sdague: thanks for looking! | 13:25 |
| *** marun has joined #openstack-infra | 13:25 | |
| sdague | russellb: no prob | 13:25 |
| *** otter768 has joined #openstack-infra | 13:25 | |
| Shrews | fungi: That traceback confuses me as it seems to indicate some sort of issue with the auth URL | 13:27 |
| fungi | Shrews: yeah, it does | 13:27 |
| *** dizquierdo has joined #openstack-infra | 13:28 | |
| Shrews | fungi: is this problem intermittent? | 13:28 |
| * Shrews hasn't read all of scrollback yet | 13:28 | |
| fungi | Shrews: no, it seemed to happen for all images nodepoold tried to update yesterday | 13:28 |
| openstackgerrit | Chris Dent proposed openstack-infra/devstack-gate: Disable mod wsgi for ceilometer in grenade https://review.openstack.org/187151 | 13:28 |
| Shrews | poo | 13:28 |
| *** nelsnelson has joined #openstack-infra | 13:28 | |
| *** unicell has joined #openstack-infra | 13:30 | |
| *** unicell1 has quit IRC | 13:30 | |
| *** otter768 has quit IRC | 13:30 | |
| fungi | Shrews: oh, i wonder if this is a wild goose chase. ubuntu-trusty is an anomaly, we're not using that yet | 13:30 |
| fungi | the exception we last got for bare-trusty in rax-iad by comparison was on june 8 | 13:31 |
| *** radez is now known as radez_g0n3 | 13:31 | |
| *** unicell1 has joined #openstack-infra | 13:31 | |
| *** ociuhandu has quit IRC | 13:32 | |
| fungi | i didn't realize when i first started looking at these tracebacks that they're ubuntu-trusty over and over because it's never successfully built | 13:33 |
| fungi | so nodepool is looping trying to build them continually. but that's been going on for long enough that i don't think it's related to why we didn't build any other images yesterday | 13:33 |
| vponomaryov | guys, from infra-team, I am looking for help in review/merging of following one-line commit - https://review.openstack.org/#/c/190624 to fix couple of CI jobs | 13:34 |
| fungi | back to looking for other possible causes | 13:34 |
| zigo | Is python-gear Python3 ready? | 13:34 |
| zigo | fungi: Do you know? | 13:34 |
| zigo | (hi, by the way! :) | 13:34 |
| *** unicell has quit IRC | 13:34 | |
| Shrews | fungi: seems odd that neither shade nor o-c-c has been updated and yet it just stopped working. it does seem to point to something else. | 13:34 |
| fungi | zigo: hi! yes, looks like we test it against python 3.4, so i expect so | 13:34 |
| zigo | Cool. | 13:35 |
| zigo | fungi: I've been looking at the packages for gear and zuul this afternoon, and I'll try to push them to Debian. | 13:35 |
| zigo | I'll add Python3 support for the gear package. | 13:35 |
| fungi | zigo: neat, thanks | 13:35 |
| openstackgerrit | Chris Dent proposed openstack-infra/devstack-gate: Disable mod wsgi for ceilometer in grenade https://review.openstack.org/187151 | 13:35 |
| fungi | Shrews: frickler: i'm going to take this opportunity to restart nodepoold right now since we're keeping up with demand for the moment. and maybe image updates will magically fix themselves so they start as expected in ~45 minutes | 13:37 |
| fungi | and in the meantime i'll keep seeing if i can find any explanation in the debug log | 13:37 |
| *** eharney has quit IRC | 13:38 | |
| *** mriedem_away is now known as mriedem | 13:38 | |
| Shrews | fungi: please let me know if do find an explanation, b/c this is obviously something that shade should handle better, even if it isn't the root cause | 13:38 |
| frickler | fungi: did your manual image-build run successfully? can you try just uploading an image manually, too? | 13:39 |
| Shrews | fungi: or, maybe the problem is just "computers" | 13:39 |
| *** dustins has joined #openstack-infra | 13:39 | |
| fungi | frickler: yeah, the manual image update ran without issue | 13:39 |
| * Shrews should get a job out of computers and tending to olaph's cow and chickens | 13:39 | |
| fungi | Shrews: computers are merely a symptom. the problem is not enough drinking | 13:40 |
| *** tvanderwiel has joined #openstack-infra | 13:40 | |
| *** nelsnelson has quit IRC | 13:41 | |
| Shrews | fungi: ah, so wise | 13:41 |
| *** soren has quit IRC | 13:42 | |
| * olaph only pays in beef and eggs | 13:42 | |
| Shrews | olaph: throw in beer and you have a deal! | 13:43 |
| fungi | it's possible to live on beef and eggs, but without beer why would anyone want to? | 13:43 |
| StevenK | How do you get beer from beef and eggs? | 13:43 |
| fungi | alchemy | 13:43 |
| Shrews | magic | 13:43 |
| *** ddieterly has joined #openstack-infra | 13:44 | |
| *** fawadkhaliq has quit IRC | 13:45 | |
| *** alexpilotti has joined #openstack-infra | 13:46 | |
| *** claudiub has joined #openstack-infra | 13:47 | |
| *** hdd has joined #openstack-infra | 13:47 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for ec2 test race fail with shared storage backend https://review.openstack.org/190644 | 13:48 |
| *** ociuhandu has joined #openstack-infra | 13:49 | |
| *** ddieterly has quit IRC | 13:50 | |
| *** ParsectiX has joined #openstack-infra | 13:51 | |
| *** _nadya_ has joined #openstack-infra | 13:51 | |
| *** peristeri has joined #openstack-infra | 13:51 | |
| *** ddieterly has joined #openstack-infra | 13:52 | |
| *** dpaterson has joined #openstack-infra | 13:52 | |
| *** yamamoto_ has quit IRC | 13:54 | |
| *** asselin_ has quit IRC | 13:54 | |
| *** ociuhandu has quit IRC | 13:56 | |
| *** ociuhandu has joined #openstack-infra | 13:57 | |
| *** arxcruz has quit IRC | 13:57 | |
| *** RichardRaseley has joined #openstack-infra | 13:58 | |
| *** zz_dimtruck is now known as dimtruck | 13:58 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/system-config: Use openstackci module for zuul_merger zuul_prod and zuul_dev https://review.openstack.org/176010 | 13:58 |
| *** asselin has joined #openstack-infra | 13:59 | |
| *** achanda has joined #openstack-infra | 14:03 | |
| *** fallenpegasus has quit IRC | 14:03 | |
| *** abregman has quit IRC | 14:05 | |
| *** Liu has joined #openstack-infra | 14:05 | |
| *** ParsectiX has quit IRC | 14:06 | |
| Liu | Is the port to review.openstack.ort still 29418? | 14:06 |
| *** achanda has quit IRC | 14:07 | |
| fungi | Liu: yes | 14:07 |
| *** yamamoto has joined #openstack-infra | 14:07 | |
| *** tjones1 has joined #openstack-infra | 14:08 | |
| *** RichardRaseley has quit IRC | 14:08 | |
| *** gordc has quit IRC | 14:08 | |
| Liu | fungi: I can not cennect to review.openstack.org var port 29418 recently | 14:08 |
| Liu | Maybe it is a network problem | 14:09 |
| fungi | Liu: there was a thread on the openstack-dev mailing list suggesting that the great firewall started blocking that outbound, if you're on a mainland chinese network that could explain it | 14:09 |
| fungi | Liu: we have some tips on using https with git-review, if you need it http://docs.openstack.org/infra/manual/developers.html#accessing-gerrit-over-https | 14:10 |
| *** tiswanso has quit IRC | 14:10 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:10 | |
| *** dkranz has joined #openstack-infra | 14:10 | |
| *** tiswanso has joined #openstack-infra | 14:10 | |
| *** ihrachyshka has quit IRC | 14:10 | |
| Liu | Thanks fungi, I think it is the problme | 14:10 |
| *** dboik has joined #openstack-infra | 14:11 | |
| *** gordc has joined #openstack-infra | 14:11 | |
| Liu | fungi: So have you have solution about the great firewall blocking? | 14:11 |
| *** eharney has joined #openstack-infra | 14:11 | |
| *** achanda has joined #openstack-infra | 14:11 | |
| fungi | Liu: from what i know, people are either forwarding 29418 over vpns and ssh tunnels to virtual machines in networks outside china, or using https like in the documentation i linked just now | 14:12 |
| *** gordc has quit IRC | 14:13 | |
| Liu | fungi: I maitain a CI for openstack cinder, I have seen the link you suggested rightrow, but that is just for git review | 14:14 |
| Liu | fungi: That maybe can not handle my CI problem | 14:15 |
| fungi | Liu: oh, right you need to be able to access gerrit stream-events which is only going to work over the ssh api | 14:15 |
| *** gordc_ has joined #openstack-infra | 14:15 | |
| fungi | Liu: you're right, it won't help | 14:15 |
| *** _nadya_ has quit IRC | 14:15 | |
| fungi | Liu: so the only alternatives are probably to bounce those connections off proxies through tunnels | 14:16 |
| *** achanda has quit IRC | 14:17 | |
| *** gordc_ has quit IRC | 14:17 | |
| *** achanda has joined #openstack-infra | 14:17 | |
| anteaya | fungi: when you have a moment could you kindly re-enable gerrit account 9751, please? | 14:17 |
| fungi | Liu: from older mailing list discussions, solutions like http://lists.openstack.org/pipermail/openstack-dev/2014-September/045407.html seem to be how people have gotten around it in the past | 14:17 |
| fungi | anteaya: done | 14:18 |
| anteaya | fungi: thank you | 14:18 |
| *** BharatK has joined #openstack-infra | 14:18 | |
| *** wenlock has joined #openstack-infra | 14:18 | |
| Liu | fungi: Thanks fungi, I will check it | 14:18 |
| *** gordc_ has joined #openstack-infra | 14:19 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for ceph snapshot delete race fail bug 1464259 https://review.openstack.org/190644 | 14:19 |
| openstack | bug 1464259 in Cinder "EC2VolumesTest fails with rbd backend" [Low,Triaged] https://launchpad.net/bugs/1464259 | 14:20 |
| openstackgerrit | Merged stackforge/gertty: Ignore EPERM when pruning refs https://review.openstack.org/190398 | 14:21 |
| *** hdd has quit IRC | 14:21 | |
| *** koolhead17 has quit IRC | 14:21 | |
| jeblair | Tagged gertty 1.2.1 | 14:21 |
| *** fhubik_afk is now known as fhubik | 14:21 | |
| * fungi must upgrade | 14:21 | |
| jeblair | well, the release machinery is still moving | 14:22 |
| *** achanda has quit IRC | 14:22 | |
| *** yamamoto has quit IRC | 14:22 | |
| *** tiswanso_ has joined #openstack-infra | 14:24 | |
| *** koolhead17 has joined #openstack-infra | 14:24 | |
| kragniz | oops, I accidentally got the centos project to use yaml2ical | 14:24 |
| *** doug-fish has joined #openstack-infra | 14:24 | |
| jeblair | tonyb, ttx: ^ | 14:24 |
| fungi | kragniz: hah, oops indeed! | 14:25 |
| jeblair | kragniz: drat! we hate it when people use our stuff! ;) | 14:25 |
| kragniz | hehe | 14:25 |
| fungi | frickler: Shrews: so, after some careful log analysis, the nodepool debug log does not have an "updating all images" entry from 14:14 utc yesterday, but it does for all previous days and also does for today (yay more mystery, but perhaps working again at least?) | 14:26 |
| *** tiswanso has quit IRC | 14:26 | |
| *** jaypipes has quit IRC | 14:26 | |
| jeblair | fungi: if we were still running that instance, next step would be sigusr2 to thread dump and see if the image update thread is running/stuck | 14:28 |
| *** zz_jgrimm is now known as jgrimm | 14:28 | |
| kragniz | does anyone know what's causing this in a project-config change? | 14:28 |
| kragniz | http://logs.openstack.org/78/190278/2/check/gate-project-config-layout/d2fc9bb/console.html#_2015-06-11_05_30_58_149 | 14:28 |
| * kragniz is probably missing something | 14:28 | |
| fungi | jeblair: well, it was definitely still constantly retrying to build the ubuntu-trusty diskimage. is the on-demand image building to satisfy missing images a separate thread from the one which starts via the timer? | 14:29 |
| jeblair | fungi: yes, iirc | 14:29 |
| *** eharney_ has joined #openstack-infra | 14:30 | |
| *** bnemec has joined #openstack-infra | 14:30 | |
| *** timcline has joined #openstack-infra | 14:31 | |
| fungi | okay, so yeah it sounds like it probably was a stuck thread. i'll make sure to grab a threaddump before restarting the daemon next time i see this | 14:31 |
| *** wenlock has quit IRC | 14:31 | |
| jeblair | fungi: it's probably possible to go through the logs and see which of the nightlies completed, and if one of them was stuck. not sure how curious we are about this instance. | 14:31 |
| *** bexelbie has joined #openstack-infra | 14:31 | |
| *** eharney has quit IRC | 14:32 | |
| bexelbie | kragniz, where does yaml2ical store its issues? They don't appear to be on github | 14:32 |
| jeblair | fungi: process is basicaly: background-update all snapshot image updates (so they are unlikely to cause this); build disk images one at a time, wait until all are built; upload diskimages one at a time | 14:33 |
| jeblair | fungi: so any dib related process getting stuck would cause the whole thread to get stuck | 14:33 |
| jeblair | bexelbie, kragniz: https://storyboard.openstack.org/#!/project/716 | 14:34 |
| *** kushal has joined #openstack-infra | 14:34 | |
| * mordred waves to everyone, isn't really here | 14:34 | |
| jeblair | kragniz: i'm still looking at the zuul thing, i'm not seeing it either yet | 14:34 |
| *** fhubik is now known as fhubik_afk | 14:34 | |
| *** e0ne is now known as e0ne_ | 14:34 | |
| kragniz | jeblair: should I go for a recheck? | 14:35 |
| kragniz | jeblair: it failed twice in a row, though | 14:35 |
| bexelbie | kragniz, looking | 14:35 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: revert to eventlet based keystone upgrade for juno -> kilo https://review.openstack.org/190664 | 14:36 |
| *** ayoung has joined #openstack-infra | 14:36 | |
| sdague | fungi: ok, I jumped the gun on that last revert / revert - https://review.openstack.org/190664 | 14:37 |
| sdague | I didn't realize that keystone was doing some very odd things in their devstack config stage | 14:37 |
| sdague | mriedem: https://review.openstack.org/190664 | 14:37 |
| fungi | sdague: lgtm | 14:38 |
| *** eharney_ is now known as eharney | 14:38 | |
| fungi | sdague: is that blocking master (because grenade) or just kilo right now? | 14:38 |
| *** MarkAtwood has joined #openstack-infra | 14:39 | |
| sdague | it's just blocking kilo | 14:39 |
| sdague | base branch == target branch IIRC | 14:39 |
| *** EricGonczer_ has joined #openstack-infra | 14:39 | |
| fungi | oh, right | 14:39 |
| sdague | oh, wait, no this is too confusing | 14:39 |
| jeblair | kragniz: reproduced locally; debugging | 14:40 |
| *** achanda has joined #openstack-infra | 14:40 | |
| kragniz | jeblair: awesome | 14:40 |
| kragniz | jeblair: thanks | 14:40 |
| openstackgerrit | Tim Hinrichs proposed openstack/requirements: Add congress-pythonclient https://review.openstack.org/190669 | 14:40 |
| *** bexelbie is now known as bexelbie|away-le | 14:40 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Move _utils unit testing to separate file https://review.openstack.org/190670 | 14:41 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Coalesce port values in secgroup rules https://review.openstack.org/190671 | 14:41 |
| *** mpaolino has quit IRC | 14:43 | |
| *** achanda has quit IRC | 14:45 | |
| *** e0ne_ has quit IRC | 14:45 | |
| *** fallenpegasus has joined #openstack-infra | 14:46 | |
| *** tjones1 has quit IRC | 14:47 | |
| *** tiswanso_ has quit IRC | 14:48 | |
| *** yamamoto has joined #openstack-infra | 14:49 | |
| *** devvesa has joined #openstack-infra | 14:50 | |
| *** jcoufal has joined #openstack-infra | 14:50 | |
| *** juggler_ has quit IRC | 14:51 | |
| *** gordc_ is now known as gordc | 14:51 | |
| ttx | kragniz: heh, oops | 14:51 |
| *** sabeen has joined #openstack-infra | 14:52 | |
| ttx | does that mean we can't break backward compat anymore ? | 14:52 |
| *** mtanino has joined #openstack-infra | 14:52 | |
| fungi | ttx: 1.0!!! | 14:52 |
| *** fhubik_afk is now known as fhubik | 14:53 | |
| *** gordc has left #openstack-infra | 14:54 | |
| *** _nadya_ has joined #openstack-infra | 14:55 | |
| jeblair | kragniz: okay, found the proximal cause and left a message in the review; it's a bug though that zuul either didn't allow that or didn't say why it was wrong, so i'm still working on that. but you should be able to proceed now. | 14:55 |
| *** mpaolino has joined #openstack-infra | 14:55 | |
| kragniz | ttx: ! | 14:56 |
| kragniz | jeblair: great, thanks a lot for looking at that | 14:56 |
| *** maishsk_afk has quit IRC | 14:57 | |
| *** mmedvede has quit IRC | 14:58 | |
| *** hdd has joined #openstack-infra | 14:59 | |
| openstackgerrit | Louis Taylor proposed openstack-infra/project-config: Add the searchlight project https://review.openstack.org/190278 | 14:59 |
| *** wenlock has joined #openstack-infra | 15:00 | |
| *** ildikov_ has quit IRC | 15:00 | |
| *** ildikov_ has joined #openstack-infra | 15:00 | |
| *** Zhongjun has joined #openstack-infra | 15:01 | |
| *** tiswanso has joined #openstack-infra | 15:01 | |
| *** dims_ has quit IRC | 15:02 | |
| *** fawadkhaliq has joined #openstack-infra | 15:02 | |
| *** dims has joined #openstack-infra | 15:02 | |
| *** yamahata has joined #openstack-infra | 15:02 | |
| *** miqui has joined #openstack-infra | 15:03 | |
| *** geoffarnold has quit IRC | 15:03 | |
| *** dizquierdo has quit IRC | 15:03 | |
| *** dkranz has quit IRC | 15:03 | |
| *** thedodd has joined #openstack-infra | 15:04 | |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 15:04 |
| *** jschwarz__ has joined #openstack-infra | 15:05 | |
| pabelanger | odd, missed the release announcement for zuul 2.1.0 | 15:05 |
| j^2 | anteaya: i think i got it again, lets see what jenkins says | 15:05 |
| *** sabeen3 has joined #openstack-infra | 15:05 | |
| pabelanger | either way, cool! | 15:05 |
| *** bhuvan has joined #openstack-infra | 15:05 | |
| *** fawadkhaliq has quit IRC | 15:05 | |
| *** sabeen has quit IRC | 15:05 | |
| anteaya | j^2: well done, yes, let us await the decision of jenkins | 15:06 |
| anteaya | j^2: hopefully after I source some food, it will tell us | 15:06 |
| j^2 | anteaya: bbiab myself, got a meeting to get to | 15:06 |
| anteaya | j^2: meet you back here in a bit | 15:06 |
| *** bnemec has quit IRC | 15:07 | |
| openstackgerrit | Louis Taylor proposed openstack-infra/project-config: Add the searchlight project https://review.openstack.org/190278 | 15:07 |
| *** fhubik is now known as fhubik_afk | 15:07 | |
| *** jschwarz_ has quit IRC | 15:08 | |
| *** isviridov_away is now known as isviridov | 15:08 | |
| openstackgerrit | Paul Belanger proposed openstack-dev/pbr: Add build_sphinx test coverage https://review.openstack.org/189884 | 15:11 |
| pabelanger | mordred, ^I'd be interested in your feedback | 15:11 |
| *** bexelbie|away-le has quit IRC | 15:12 | |
| *** dguerri is now known as dguerri` | 15:13 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert nova swap and ephemeral BDMs patch fix https://review.openstack.org/190629 | 15:15 |
| *** kmartin has joined #openstack-infra | 15:15 | |
| *** dkranz has joined #openstack-infra | 15:16 | |
| *** jistr is now known as jistr|mtg | 15:17 | |
| *** fdegir has joined #openstack-infra | 15:18 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Merge duplicate jobs with different children https://review.openstack.org/190686 | 15:20 |
| jeblair | kragniz: there's the bugfix ^ | 15:20 |
| kragniz | jeblair: cool beans | 15:20 |
| *** markus_z has quit IRC | 15:21 | |
| *** sdake has quit IRC | 15:21 | |
| ttx | https://review.openstack.org/#/admin/groups/953,members is completely empty so it will be difficult to get your project-team-guide changes through :) | 15:23 |
| ttx | jeblair: ^ | 15:23 |
| *** dannywilson has joined #openstack-infra | 15:23 | |
| jeblair | oh good it merged! | 15:23 |
| fungi | easily solved | 15:24 |
| *** dustins has quit IRC | 15:24 | |
| *** dannywilson has quit IRC | 15:24 | |
| fungi | rather, already solved! | 15:24 |
| *** dannywilson has joined #openstack-infra | 15:24 | |
| *** fhubik_afk is now known as fhubik | 15:24 | |
| lil_cain | u5 | 15:25 |
| ttx | jeblair, fungi: maybe we should seed with the intersection of the names in https://etherpad.openstack.org/p/project-team-guide and TC members | 15:25 |
| jeblair | ttx: already done | 15:25 |
| ttx | ok | 15:25 |
| ttx | ack, good enough. We'll refine as we go | 15:26 |
| *** otter768 has joined #openstack-infra | 15:26 | |
| ttx | jeblair: do we have some official stance on the === header length ? | 15:27 |
| fungi | my opinion is that it should be at least as long as it needs to be | 15:27 |
| ttx | (see comment in https://review.openstack.org/#/c/190319/1/doc/source/documentation.rst -- happy to bypass the comment if it's not the first doc to do that) | 15:27 |
| * ttx reads rst spec | 15:28 | |
| ttx | spec makes titles like jeblair does, so objection overruled | 15:28 |
| fungi | i have a preference for the padding style like that, but others like it exactly the text length. honestly i don't care as long as it's basically consistent within a given document | 15:28 |
| *** arxcruz has joined #openstack-infra | 15:29 | |
| jeblair | i used ctrl-= in emacs; it's fairly adaptive, so if you prefer something else it will use what's already there, but that's what you get if you start with nothing. | 15:29 |
| fungi | people who -1 based on cosmetic whitespace preferences are annoying | 15:29 |
| ttx | http://docutils.sourceforge.net/docs/ref/rst/restructuredtext.html#sections matches your style | 15:29 |
| jeblair | i'm guessing they configured the defaults based on that or a similar doc | 15:30 |
| fungi | if it's valid rst and it's self-consistent, i don't think it ought to matter | 15:30 |
| ttx | right, already too much of our time spent discussing the nit :) | 15:30 |
| fungi | plenty of other bikesheds we could be chopping down and lighting on fire instead | 15:31 |
| *** mmedvede has joined #openstack-infra | 15:31 | |
| *** coolsvap is now known as coolsvap|afk | 15:31 | |
| *** otter768 has quit IRC | 15:31 | |
| *** Guest44108 has quit IRC | 15:31 | |
| sdague | fungi: so ... are we sure that devstack-gate changes are now actually testing themselves? | 15:32 |
| *** ajmiller has joined #openstack-infra | 15:33 | |
| fungi | sdague: we're still doing the reexec at the moment | 15:33 |
| sdague | because I'm really confused that https://review.openstack.org/#/c/190597/ doesn't have the WSGI lines in the localrc devstack | 15:33 |
| *** salv-orlando has joined #openstack-infra | 15:34 | |
| *** salv-orl_ has quit IRC | 15:34 | |
| fungi | i wonder if the zuul-cloner implementation has broken that and we're not reexec'ing the copy that's checked out now | 15:34 |
| *** unicell has joined #openstack-infra | 15:34 | |
| fungi | jeblair: any chance the stop-reexecing patch is more urgent than we considered? | 15:35 |
| *** jistr|mtg is now known as jistr | 15:35 | |
| jeblair | fungi: i don't think so; i think each of the steps are safe | 15:35 |
| jeblair | looking at http://logs.openstack.org/97/190597/2/check/check-grenade-dsvm/62ffa60/console.html | 15:35 |
| *** unicell1 has quit IRC | 15:36 | |
| jeblair | 2015-06-11 14:44:30.480 | HEAD is now at 7b3bafb revert to eventlet based keystone upgrade for juno -> kilo | 15:36 |
| jeblair | 2015-06-11 14:44:30.481 | This build includes a change to devstack-gate; re-execing this script. | 15:36 |
| jeblair | those look right | 15:36 |
| sdague | yeh, I'm trying to understand why the conditional which should apply here isn't | 15:36 |
| sdague | because when I put a Depends-On for a grenade change | 15:37 |
| sdague | it's not getting the localrc lines in the devstacks that it should be | 15:37 |
| *** fedexo has joined #openstack-infra | 15:37 | |
| fungi | i'm not seeing GRENADE_BASE_BRANCH checked anywhere in the logs so far | 15:38 |
| *** hemnafk is now known as hemna | 15:40 | |
| sdague | are we still under xtrace at that point? | 15:41 |
| jeblair | i'm not sure we run that with bash -x though | 15:41 |
| openstackgerrit | Louis Taylor proposed openstack-infra/system-config: Add #openstack-searchlight to eavesdrop https://review.openstack.org/190691 | 15:41 |
| jeblair | right, i don't think so | 15:41 |
| fungi | yeah, it's not | 15:41 |
| openstackgerrit | lifeless proposed openstack/requirements: Reduce dataloss window through interrupted writes. https://review.openstack.org/190606 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Convert test_update_suffix to unit tests. https://review.openstack.org/190617 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Convert test_pbr to unit tests. https://review.openstack.org/190692 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Move test_update to be unit tests. https://review.openstack.org/190693 | 15:42 |
| openstackgerrit | lifeless proposed openstack/requirements: Ignore the dist directory. https://review.openstack.org/190694 | 15:42 |
| *** coolsvap|afk is now known as coolsvap | 15:42 | |
| anteaya | jklare: this patch is abandoned: https://review.openstack.org/#/c/178298/ could you remove the entry for it from the infra rename list please? https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames | 15:43 |
| *** yamahata has quit IRC | 15:43 | |
| openstackgerrit | Douglas Mendizábal proposed openstack-infra/project-config: Move dogtag ca tests from experimental to standard checks https://review.openstack.org/190534 | 15:43 |
| sdague | I guess I can stick an xtrace in there temporarily to figure out what's going on | 15:43 |
| jeblair | sdague: yeah, that's about where my thinking is too | 15:44 |
| fungi | i was about to upload a separate dnm one to do that, on the assumption that we didn't want it? | 15:44 |
| jeblair | 2015-06-11 14:56:35.128 | This takes a good 30 minutes or more | 15:44 |
| sdague | yeh, let me do this, restack my patch, figure out what's going on | 15:44 |
| fungi | i guess just making a dependent patch to add the -x would keep you from having to respin that patch multiple times | 15:44 |
| openstackgerrit | Richard Pijnenburg proposed openstack-infra/jenkins-job-builder: Adding support for Hipchat plugin 0.1.9 as publisher https://review.openstack.org/174036 | 15:44 |
| jeblair | "A good hour" | 15:45 |
| *** afazekas has quit IRC | 15:45 | |
| fungi | any hour you spend waiting for test results is a bad hour | 15:45 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: tracing addition to debug grenade issue https://review.openstack.org/190697 | 15:45 |
| anteaya | jeblair: for new puppet modules my sense is you would like them to start in the openstack namespace not the stackforge namespace, since puppet is now (as of the friday rename) in the openstack namespace | 15:46 |
| jeblair | The chocolate coating makes it go down easier. But you have to wait fifteen minutes for full potency. And you shouldn’t go in swimming after, for at least, what? An hour. A good hour. | 15:46 |
| anteaya | ha ha ha | 15:46 |
| jeblair | do not go swimming after grenade for at least a good 30 minutes | 15:46 |
| fungi | anteaya: are they puppet modules being maintained by the puppet team, or by some other team? | 15:47 |
| *** armax has joined #openstack-infra | 15:47 | |
| anteaya | my question is prompted by the puppet zaqar ml thread | 15:47 |
| anteaya | EmilienM offered to help zaqar, the maintenance responsiblity is unclear to me as of yet | 15:47 |
| * anteaya doesn't feel to like putting responsibility on others who haven't cleared offered to take it | 15:48 | |
| sdague | fungi: can you figure out anything with that patch that would prevent that from working? I'm super curious now | 15:48 |
| jeblair | anteaya: i'll respond to the ml thread | 15:48 |
| anteaya | jeblair: thank you | 15:48 |
| *** jschwarz__ has quit IRC | 15:49 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-bgpvpn: move from stackforge/ to openstack/ https://review.openstack.org/188822 | 15:50 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: networking-ofagent: move from stackforge/ to openstack/ https://review.openstack.org/187859 | 15:50 |
| fungi | sdague: so far no, which is why i want to see some xtrace the devstack-vm-gate.sh | 15:50 |
| flaper87 | fungi: are the images still building? It seems that some are done (based on the nodepool link) but others are still dated 2015-06-09 so I'm wondering if they failed to build | 15:50 |
| *** _nadya_ has quit IRC | 15:51 | |
| fungi | flaper87: it takes a while since we build snapshot images in parallel but dib images serially due to cache contention issues | 15:51 |
| fungi | flaper87: i'll check | 15:51 |
| fungi | flaper87: yeah, it's working on dib images currently | 15:51 |
| *** fhubik has quit IRC | 15:52 | |
| openstackgerrit | greghaynes proposed openstack/requirements: Fix typo of upper-constraints.txt in README https://review.openstack.org/190699 | 15:52 |
| flaper87 | fungi: ah ok, sorry for the false alarm. | 15:52 |
| * flaper87 goes back to his cave | 15:52 | |
| *** mmedvede has quit IRC | 15:53 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-kibana: Add kibana3 support https://review.openstack.org/188907 | 15:53 |
| *** scheuran has quit IRC | 15:54 | |
| jeblair | sdague: http://logs.openstack.org/97/190597/2/check/check-grenade-dsvm/62ffa60/logs/old/localrc.txt.gz why does RENADE_PHASE=target | 15:54 |
| jeblair | sdague: er, GRENADE_PHASE=target | 15:54 |
| jeblair | sdague: on the old side | 15:55 |
| sdague | really good question | 15:55 |
| *** peristeri_ has joined #openstack-infra | 15:55 | |
| openstackgerrit | Victor Stinner proposed openstack-infra/project-config: Add a non-voting py34 check job to Swift https://review.openstack.org/190700 | 15:55 |
| sdague | oh, because that variable test is wrong | 15:55 |
| *** geoffarnold has joined #openstack-infra | 15:57 | |
| sdague | because patch 560e85 was wrong | 15:57 |
| sdague | and it never got fixed right | 15:57 |
| *** patrickeast has joined #openstack-infra | 15:57 | |
| EmilienM | anteaya: zaqar module (cc flaper87) would be developed and maintained by both zaqar & puppet groups. Though for now it won't be a compliant module (under openstack namespace) because it does not work (it even does not exist!) | 15:57 |
| sdague | it should be $localrc_oldnew in the conditional it looks like | 15:57 |
| *** coolsvap is now known as coolsvap|afk | 15:58 | |
| jeblair | sdague: also, i think GRENADE_BASE_BRANCH is never exported from -wrap.sh | 15:58 |
| sdague | I can fix that after | 15:58 |
| *** peristeri has quit IRC | 15:58 | |
| flaper87 | EmilienM: o/ | 15:58 |
| *** rossella_s has quit IRC | 15:58 | |
| sdague | jeblair: that's confusing, because we get it in juno tests | 15:58 |
| *** achanda has joined #openstack-infra | 15:58 | |
| anteaya | EmilienM: I ask because my understanding is that we are trying to reduce the stack of renames | 15:58 |
| *** rossella_s has joined #openstack-infra | 15:59 | |
| *** jschwarz__ has joined #openstack-infra | 15:59 | |
| *** devvesa has quit IRC | 15:59 | |
| anteaya | EmilienM: so an overarching theme I am feeling is if something is destined for a namespace it is encouraged to start there, avoiding the need for a future rename | 15:59 |
| *** dangers_away is now known as dangers | 15:59 | |
| sdague | stable/juno grenade tests from this morning - http://logs.openstack.org/62/188362/2/check/check-grenade-dsvm/6abccca/logs/new/localrc.txt.gz | 15:59 |
| *** rkukura has quit IRC | 16:00 | |
| EmilienM | anteaya: like a new namespace for puppet modules, like infra does have ? | 16:00 |
| *** rkukura has joined #openstack-infra | 16:00 | |
| jeblair | EmilienM: yeah, 'working' is not a requirement for something to be in the openstack namespace. just that it's a repo maintained by a tc approved project. | 16:00 |
| sdague | the KEYSTONE_USE_MOD_WSGI is set in there | 16:00 |
| EmilienM | jeblair: oh, ok. We (puppet) decided to keep on Stackforge the modules not 'compliant' (working ATM on compliant meaning BP) | 16:00 |
| sdague | and I've found no other avenue for it | 16:01 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Temporarily switch some mox3 jobs to non-voting https://review.openstack.org/190702 | 16:01 |
| jeblair | EmilienM: renaming projects (as i'm sure you've noticed ;) is a huge amount of work for us as well as developers and users. i don't think that we should treat repo names as part of the software development lifecycle. there are other ways of communicating to users whether something is ready or working. | 16:02 |
| *** RichardRaseley has joined #openstack-infra | 16:03 | |
| *** alexsyip has joined #openstack-infra | 16:03 | |
| EmilienM | jeblair: ok, so do you suggest to have an openstack-puppet namespace (like infra?) | 16:03 |
| EmilienM | jeblair: this is a question ^ | 16:03 |
| jeblair | EmilienM: no, just put it in openstack/ | 16:03 |
| EmilienM | jeblair: everything? | 16:04 |
| EmilienM | jeblair: all our puppet- ? (for deploying openstack I mean) | 16:04 |
| *** jlanoux has quit IRC | 16:04 | |
| jeblair | EmilienM: yes, all of the modules that are part of your project. your entire project has been approved by the tc, so everything it works on should be in openstack/, and even when you create new modules, they should be in there too. | 16:04 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: fix grenade phase check https://review.openstack.org/190703 | 16:05 |
| openstackgerrit | Justin Shepherd proposed openstack-infra/project-config: Adding doc gate job for openstack/defcore https://review.openstack.org/189956 | 16:05 |
| EmilienM | jeblair: well, ok. We have some modules like puppet-vswitch that are not 'openstack', we might want to keep them in stackforge. Is it ok for you? | 16:05 |
| jeblair | EmilienM: i would not object to that being part of puppetopenstack. it seems related enough. | 16:08 |
| EmilienM | crinkle: that change a bit our plans ^ | 16:08 |
| *** esmute has joined #openstack-infra | 16:09 | |
| *** asselin_ has joined #openstack-infra | 16:09 | |
| crinkle | EmilienM: that's fine with me | 16:09 |
| jeblair | in my view, the community and development methodology are the important things. so if it makes sense for this community to develop it here (and i think being on stackforge indicates the answer to that is yes), then it makes sense to be part of the openstack project. | 16:09 |
| *** koolhead17 has quit IRC | 16:09 | |
| *** Nikkau has quit IRC | 16:10 | |
| *** radez_g0n3 is now known as radez | 16:10 | |
| *** unicell has quit IRC | 16:10 | |
| jeblair | that's easier than trying to draw lines about "well, this module configures an openstack thing so it's in, but this module configures something that's only _used_ by an openstack thing, so it has to be out over there" | 16:10 |
| jeblair | that will just make everyone confused about what color the bikeshed is | 16:11 |
| *** dtantsur is now known as dtantsur|afk | 16:11 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: Add .gitreview https://review.openstack.org/190705 | 16:11 |
| *** tonytan4ever has joined #openstack-infra | 16:12 | |
| *** asahlin_away is now known as asahlin | 16:13 | |
| *** timrc_ has joined #openstack-infra | 16:13 | |
| *** abregman has joined #openstack-infra | 16:13 | |
| *** samuelBartel has quit IRC | 16:13 | |
| *** maishsk_afk has joined #openstack-infra | 16:14 | |
| *** yamahata has joined #openstack-infra | 16:15 | |
| fungi | as an example, we have puppet modules which configure all sorts of non-openstack software and they're all covered in an official openstack namespace (for the sake of argument the openstack-infra and openstack namespaces are equivalent... if we could easily rename all of openstack-infra into openstack at this point i'm pretty sure we would) | 16:15 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-log_processor: Add the ability to filter on project https://review.openstack.org/190707 | 16:16 |
| *** achanda has quit IRC | 16:17 | |
| fungi | we treat our puppet-gerrit module (which configures software we do not maintain, gerrit) no less official than our puppet-zuul module (which configures software we maintain, zuul) | 16:17 |
| zaro | morning | 16:18 |
| anteaya | morning zaro | 16:19 |
| anteaya | AJaeger: are you about? | 16:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: Initial commit for puppet-stackalytics https://review.openstack.org/190708 | 16:20 |
| EmilienM | jeblair: sounds good to me, so I don't see any blocker | 16:20 |
| anteaya | AJaeger: I'm looking at https://review.openstack.org/#/c/186532/18 | 16:20 |
| *** yamahata has quit IRC | 16:20 | |
| anteaya | AJaeger: the config test claims there is a duplicate entry for bare-metal but I can't see it | 16:20 |
| anteaya | AJaeger: I see it removed on the left and added on the right, once each | 16:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: WIP: Initial commit for puppet-stackalytics https://review.openstack.org/190708 | 16:21 |
| *** BharatK has quit IRC | 16:22 | |
| *** krtaylor has quit IRC | 16:22 | |
| asselin_ | good morning fungi, shall we merge those other 2 puppet-zuul patches today? https://review.openstack.org/#/c/183422/ https://review.openstack.org/#/c/183429/ | 16:23 |
| *** Hal has joined #openstack-infra | 16:23 | |
| *** Hal is now known as Guest35270 | 16:24 | |
| *** krtaylor has joined #openstack-infra | 16:25 | |
| *** krtaylor has quit IRC | 16:25 | |
| *** fedexo has quit IRC | 16:26 | |
| *** e0ne has joined #openstack-infra | 16:27 | |
| *** r-daneel has joined #openstack-infra | 16:27 | |
| *** sputnik13 has joined #openstack-infra | 16:27 | |
| anteaya | does anyone have an irc nickname for Gal Sagle? | 16:28 |
| anteaya | this patch needs to be rebased: https://review.openstack.org/#/c/187471/ | 16:28 |
| anteaya | russellb: do you know Gal Sagle? | 16:28 |
| pabelanger | could somebody explain to me the purpose of the ./tools/apply-test in system-config? | 16:32 |
| derekh | If anybody has time, can I get a review to tweak nodpool/tripleo config https://review.openstack.org/#/c/187675/1 https://review.openstack.org/#/c/187675/1 | 16:33 |
| *** esmute has quit IRC | 16:34 | |
| anteaya | pabelanger: there are some tests on some infra repos called puppet-apply | 16:34 |
| *** BharatK has joined #openstack-infra | 16:34 | |
| flaper87 | fungi: are the images used for py26 the same we use for py27? I've the impression they are not because py26 keeps failing with the missing uuid-devel error | 16:34 |
| anteaya | pabelanger: I'm leaning toward the belief that this script has a role in executing those tests | 16:34 |
| jeblair | pabelanger: never run that script on your workstation :) | 16:34 |
| samueldmq | hi, in the case someone wants to propose a new meeting in #openstack-meeting, I saw that a change must be submitted to http://git.openstack.org/cgit/openstack-infra/irc-meetings/tree/meetings | 16:35 |
| *** jaypipes has joined #openstack-infra | 16:35 | |
| samueldmq | but probably there is someone to talk before ... | 16:35 |
| *** achanda has joined #openstack-infra | 16:35 | |
| *** samueldmq has left #openstack-infra | 16:36 | |
| greghaynes | ianw: Hey, left some comments on https://review.openstack.org/#/c/185843/ | 16:36 |
| *** samueldmq has joined #openstack-infra | 16:36 | |
| greghaynes | ianw: kind of want to get that whole stack merged :) | 16:36 |
| flip214 | Hi. Is there some way to get an interactive shell on a VM when it runs a CI job? I've got a unexplained lvcreate error that I can't reproduce locally. | 16:36 |
| *** jcoufal has quit IRC | 16:36 | |
| anteaya | samueldmq: not required, look at some of the other patches to the repo, offer a patch, tony or ttx will offer guidance in their reviews if you need more | 16:37 |
| *** unicell has joined #openstack-infra | 16:38 | |
| *** Ala has quit IRC | 16:38 | |
| samueldmq | anteaya, great, I am planning to have a separate meeting to the dynamic policies stuff .. but we are still proposing that | 16:38 |
| samueldmq | anteaya, I am just learning how to do if it is the case, thanks | 16:38 |
| anteaya | samueldmq: sounds good, if you are uncertain of the final times, mark the patch wip so it doesn't get merged before you are ready | 16:38 |
| anteaya | samueldmq: and you are welcome | 16:39 |
| samueldmq | anteaya, ++ :) | 16:39 |
| anteaya | :) | 16:39 |
| *** esmute has joined #openstack-infra | 16:40 | |
| pabelanger | jeblair, Ya, I can see that. Doing it in VM now | 16:40 |
| *** kushal has quit IRC | 16:41 | |
| pabelanger | anteaya, Ya, not sure the purpose, it looks to be failing at running puppet but job passes | 16:41 |
| pabelanger | basically trying to understand what a pass means | 16:41 |
| anteaya | pabelanger: I'm interested in what you learn | 16:41 |
| anteaya | pabelanger: I have never run it myself | 16:41 |
| *** wenlock has quit IRC | 16:41 | |
| jeblair | pabelanger: it can fail; however, success often looks like failure due to the way it's constructed. eventually real functional testing will replace this. | 16:42 |
| jeblair | pabelanger: it runs puppet in noop mode, so there's lots of things it can't actually do. | 16:42 |
| *** wenlock has joined #openstack-infra | 16:42 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add explicit f21 test https://review.openstack.org/190715 | 16:42 |
| *** Swami has joined #openstack-infra | 16:42 | |
| pabelanger | jeblair, okay, so I shouldn't try to trap warning or errors on the puppet-apply stuff? | 16:42 |
| jeblair | pabelanger: nope, we won't be able to fix them | 16:43 |
| pabelanger | okay | 16:43 |
| pabelanger | moving on then | 16:43 |
| jeblair | pabelanger: it's basically a syntax check, because in many cases, you can't actually get puppet to check syntax without running it. | 16:44 |
| jeblair | pabelanger: it is, however, _extremely_ valuable as such :) | 16:44 |
| jeblair | we used to break our puppet all the time without it | 16:44 |
| *** ashleighfarnham has joined #openstack-infra | 16:45 | |
| anteaya | ansible has a lovely syntax check | 16:45 |
| sdague | jeblair: so... it looks like your suspicion about BASE_BRANCH not being exported seems correct | 16:46 |
| pabelanger | jeblair, ya, was mostly thinking of checking results of --noop log files and doing a simple grep on Error syntax | 16:46 |
| sdague | how this works on juno, I have no idea | 16:46 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: revert to eventlet based keystone upgrade for juno -> kilo https://review.openstack.org/190664 | 16:46 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: tracing addition to debug grenade issue https://review.openstack.org/190697 | 16:46 |
| pabelanger | since --detailed-exit-codes doesn't work with noop, IIRC | 16:46 |
| jeblair | sdague: bash is my favorite | 16:46 |
| fungi | flaper87: the images used for py26 are not the same. those run on bare-centos6 rather than bare-trusty | 16:47 |
| sdague | let me say, this whole problem is not my favorite, as I'm into hour 8 of doing a simple undo of a revert | 16:47 |
| fungi | flip214: if you can get a job triggered and let me know the worker hostname mentioned at the top of the jenkins console log (linked from the zuul status page), then i can mark it as held so nodepool won't automatically delete it, and then i can authorize your ssh key so you can log in and poke around for a while | 16:49 |
| flaper87 | fungi: ooohh, mmmh. what do I need to do to get it working on centos? I guess I can skip py26 | 16:49 |
| flaper87 | fungi: modify the same files ? or is there a different place to add these packages to centos ? | 16:50 |
| jeblair | jhesketh: http://lists.openstack.org/pipermail/openstack-dev/2015-June/066628.html | 16:50 |
| *** abregman has quit IRC | 16:50 | |
| openstackgerrit | Alvaro del Castillo proposed openstack-infra/activity-board: Added search field feature. https://review.openstack.org/190717 | 16:51 |
| *** derekh has quit IRC | 16:51 | |
| *** salv-orl_ has joined #openstack-infra | 16:52 | |
| *** jerryz has joined #openstack-infra | 16:52 | |
| flaper87 | fungi: what about the devstack nodes? I guess packages there are fully managed by devstack, right ? | 16:52 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add docker output support https://review.openstack.org/189158 | 16:52 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Fail functests if no qemu-img is found https://review.openstack.org/177002 | 16:52 |
| *** kushal has joined #openstack-infra | 16:52 | |
| *** sarob has joined #openstack-infra | 16:53 | |
| *** maishsk_afk has quit IRC | 16:53 | |
| russellb | anteaya: yes, i do. i'll pass on the message | 16:54 |
| *** ayoung has quit IRC | 16:54 | |
| *** yamahata has joined #openstack-infra | 16:54 | |
| *** stevemar has joined #openstack-infra | 16:54 | |
| *** salv-orlando has quit IRC | 16:54 | |
| fungi | flaper87: same files, but maybe the uuid-devel package is not actually available via epel? | 16:55 |
| fungi | flaper87: i'll look into it in a sec | 16:55 |
| *** esmute has quit IRC | 16:55 | |
| *** maishsk_afk has joined #openstack-infra | 16:55 | |
| flaper87 | fungi: awesome, thanks. Mind checking swig as well? (brb dinner) | 16:55 |
| *** dprince has quit IRC | 16:56 | |
| flaper87 | thanks | 16:56 |
| *** achanda has quit IRC | 16:56 | |
| fungi | flaper87: should be "libuuid-devel" on centos, still just "swig" there though | 16:56 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack https://review.openstack.org/176326 | 16:56 |
| *** abitha has joined #openstack-infra | 16:57 | |
| openstackgerrit | Justin Shepherd proposed openstack-infra/project-config: Adding doc gate jobs for openstack/defcore https://review.openstack.org/189956 | 16:57 |
| EmilienM | jeblair: this is I think a final patchset, where I move the modules that will be in openstack namespace. The ones that remain in stackforge will not move IMHO. ^ | 16:57 |
| pleia2 | anteaya: re: https://review.openstack.org/#/c/187859 it looks like it has been rebased since the etherpad comment? | 16:57 |
| pleia2 | EmilienM: can you update the topic so it shows up in the queue? | 16:58 |
| EmilienM | yeah my bad, I don't know why it goes away | 16:58 |
| fungi | btw, on the assumption that we'll shortly freeze the list of projects being renamed tomorrow, i'm clearing my afternoon to put together the maintenance plan | 16:58 |
| pleia2 | EmilienM: you have to submit with -t project-rename if you already have it in another local branch | 16:58 |
| EmilienM | pleia2: done | 16:58 |
| pleia2 | thanks | 16:59 |
| anteaya | russellb: thank you, does that person have an irc nick? | 16:59 |
| *** stpierre has joined #openstack-infra | 16:59 | |
| jeblair | fungi: sounds good. we should probably rebase+stack the changes tomorrow morning-ish. | 16:59 |
| anteaya | pleia2: yes, thank you | 16:59 |
| *** mriedem is now known as mriedem_afk | 17:00 | |
| *** esmute has joined #openstack-infra | 17:00 | |
| fungi | jeblair: agreed, i was planning to give them a little more time to get reviewed/corrected before rebasing the lot | 17:00 |
| pleia2 | I'm reviewing now, so you'll have my $.02 in there somewhere, even if rebases happen later | 17:01 |
| fungi | jeblair: but my goal is to have the rebase work completed in plenty of time to have test results and final reviews before we start | 17:01 |
| anteaya | yes pleia2 and I are trying to get the stack in shape | 17:01 |
| EmilienM | pleia2: wiki updated also for the list of modules | 17:01 |
| fungi | anteaya: pleia2: that's awesome, thanks! | 17:01 |
| *** tiswanso has quit IRC | 17:01 | |
| pleia2 | EmilienM: great, thanks | 17:01 |
| dougwig | jeblair: just fyi, the latest gertty on the mac has been stable since your fix. | 17:01 |
| fungi | dougwig: i think that's also present in the latest release on pypi now | 17:02 |
| anteaya | fungi: welcome | 17:02 |
| *** tiswanso_ has joined #openstack-infra | 17:02 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: trap errors https://review.openstack.org/190719 | 17:02 |
| *** hashar has quit IRC | 17:03 | |
| *** rlandy has quit IRC | 17:03 | |
| *** annegentle has joined #openstack-infra | 17:03 | |
| anteaya | pleia2: I was going to try to get a walk in, will be back in a while | 17:03 |
| pleia2 | anteaya: enjoy! | 17:03 |
| anteaya | pleia2: thanks | 17:04 |
| anteaya | pleia2: the chef patch is failing on a config layout error but I can't see the error | 17:04 |
| pleia2 | anteaya: ok, I'll have a look | 17:04 |
| anteaya | it says a dup of bare-metal but I don't see the dup in the patch | 17:04 |
| anteaya | thanks | 17:04 |
| *** tonytan4ever has quit IRC | 17:05 | |
| anteaya | I rechecked it to see if the centos error would go away | 17:05 |
| fungi | jeblair: just to confirm the intent of your e-mail, are you really nominating him (in which case you're looking for public replies of assent) or appointing him (i which case i can just as happily not reply)? | 17:05 |
| russellb | anteaya: gsagie | 17:05 |
| russellb | anteaya: in #openstack-neutron at least | 17:05 |
| *** rkukura has quit IRC | 17:06 | |
| *** angela-s is now known as angela-s|afk | 17:06 | |
| *** bnemec has joined #openstack-infra | 17:06 | |
| *** che-arne has quit IRC | 17:06 | |
| *** puranamr has joined #openstack-infra | 17:06 | |
| *** rkukura has joined #openstack-infra | 17:06 | |
| *** yamamoto has quit IRC | 17:07 | |
| *** jamespage_ has joined #openstack-infra | 17:07 | |
| *** yamamoto has joined #openstack-infra | 17:07 | |
| *** Guest35270 has quit IRC | 17:08 | |
| *** fitoduarte has joined #openstack-infra | 17:08 | |
| *** e0ne has quit IRC | 17:09 | |
| jeblair | fungi: oh, heh. i figured we'd all go on the record in gerrit, but feel free to reply; i don't think it will hurt. | 17:10 |
| *** yamamoto has quit IRC | 17:10 | |
| russellb | jeblair: this is something you +2'd yesterday, I just renamed the variable based on feedback from sdague. https://review.openstack.org/190321 https://review.openstack.org/#/c/190325/ | 17:10 |
| russellb | if you have a few minutes to look again :) | 17:10 |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 17:10 |
| *** jerryz has quit IRC | 17:10 | |
| *** mpaolino has quit IRC | 17:11 | |
| *** jamespage_ has quit IRC | 17:11 | |
| *** yamamoto has joined #openstack-infra | 17:11 | |
| fungi | jeblair: gerrit it is! | 17:11 |
| *** dizquierdo has joined #openstack-infra | 17:12 | |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 17:12 |
| fungi | for some reason i didn't consider that :/ | 17:12 |
| *** jerryz has joined #openstack-infra | 17:12 | |
| pelix | waynr: query on https://review.openstack.org/#/c/175049 -> about the triggered parameterized job parameters ordering think we can achieve the same and ensure better behaviour for V2 in a slightly different way | 17:13 |
| pleia2 | hm, guess I'll hold off on reviewing this chef change if it's still being updated a bunch | 17:13 |
| pleia2 | j^2: can you let us know when this is ready for review? | 17:14 |
| *** yamamoto has quit IRC | 17:14 | |
| j^2 | pleia2: yeah it’s the rebase that has been challanging | 17:14 |
| jeblair | russellb: as soon as https://review.openstack.org/#/c/190325/ lands you can Depends-On https://review.openstack.org/190321 to start using it. (probably.) | 17:14 |
| j^2 | i’d like to see if it passes jenkins, then i’ll ping you | 17:15 |
| pleia2 | j^2: ok, thanks for trying, we'll likely rebase it tomorrow anyway, so if you want to freeze it now that's ok | 17:15 |
| fungi | j^2: haven't looked at them yet, but i'm sort of wondering why not just squash those into a single change | 17:15 |
| j^2 | i dunno, anteaya just asked me to rebase | 17:15 |
| fungi | j^2: written by different prople? | 17:15 |
| fungi | people | 17:15 |
| j^2 | nope, just me | 17:15 |
| fungi | now i want prople to be a word | 17:15 |
| russellb | jeblair: yeah I think I have the usage set with Depends-On already. I also had it depend on this little revert, sorry ... https://review.openstack.org/#/c/190315/1 | 17:16 |
| russellb | jeblair: thanks for the reviews! | 17:16 |
| *** marcusvrn1 has joined #openstack-infra | 17:16 | |
| *** timrc_ has quit IRC | 17:16 | |
| vponomaryov | Hello, asking for review of one-liner - https://review.openstack.org/#/c/190624 | 17:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: trap errors https://review.openstack.org/190719 | 17:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Adjust recorded nova metadata https://review.openstack.org/190726 | 17:17 |
| fungi | fun day for cloud infosec... a couple of xen denial of service vulnerabilities and also an openssl release with some low-to-moderate severity fixes | 17:17 |
| jeblair | russellb: +3 | 17:18 |
| russellb | <3 | 17:18 |
| jeblair | fungi: ooh, do we get to reboot the world? | 17:18 |
| *** bhuvan has quit IRC | 17:18 | |
| *** _cjones_ has joined #openstack-infra | 17:19 | |
| fungi | i'm not seeing anything in http://openssl.org/news/secadv_20150611.txt which directly impacts us | 17:19 |
| jeblair | fungi: (also, https://review.openstack.org/190726 is making progress toward auto-alien cleanup; i think that's all the pre-reqs, now i can actually get to writing the cleanup bit) | 17:19 |
| fungi | though i sort of wonder if the past few days rackspace interruptions were due to them patching not-so-quietly behind the scenes | 17:19 |
| fungi | jeblair: thanks! | 17:19 |
| *** ayoung has joined #openstack-infra | 17:19 | |
| *** jschwarz__ has quit IRC | 17:20 | |
| flip214 | fungi: thanks a lot. walking the dog I got another idea that I'll try to confirm first... perhaps I can solve that some other way. Thanks a lot, though! | 17:24 |
| flaper87 | fungi: ah crap, ok, I'll fix that | 17:24 |
| fungi | flip214: you bet--just let me know if i can help | 17:24 |
| flaper87 | I wonder if it's the same for fedora. I know there's uuid-devel but it's entirely possible that it's not the one I thought it was | 17:24 |
| *** mpaolino has joined #openstack-infra | 17:26 | |
| *** otter768 has joined #openstack-infra | 17:27 | |
| *** tonytan4ever has joined #openstack-infra | 17:28 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Rename uuid-devel rpm to libuuid-devel https://review.openstack.org/190730 | 17:30 |
| *** HeOS has quit IRC | 17:31 | |
| sdague | fungi / jeblair: ok https://review.openstack.org/#/c/190664/ seems to fix it for real, so landing that will unblock stable/kilo again | 17:31 |
| fungi | really for reals | 17:31 |
| sdague | the tests on https://review.openstack.org/#/c/190597/ prove it out | 17:31 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/system-config: Rename uuid-devel rpm to libuuid-devel https://review.openstack.org/190731 | 17:32 |
| flaper87 | fungi: both patches submitted ^ | 17:32 |
| sdague | http://logs.openstack.org/97/190597/3/check/check-grenade-dsvm/322706e//logs/old/localrc.txt.gz is correct this time | 17:32 |
| dansmith | I keep getting "merge conflict" when rebasing this: https://review.openstack.org/#/c/189480/ | 17:32 |
| flaper87 | thanks for helping :) | 17:32 |
| dansmith | is it real, imagined, or related to my depends-on/ | 17:32 |
| *** otter768 has quit IRC | 17:32 | |
| *** tvanderwiel has quit IRC | 17:32 | |
| sdague | dansmith: depends-on | 17:32 |
| sdague | dansmith: yeh, you depends on a jenkins -1 patch that is abandoned | 17:33 |
| sdague | so... that will always show as merge conflict | 17:33 |
| dansmith | sdague: so, any way around that? | 17:33 |
| sdague | nope | 17:33 |
| sdague | remove the depends on | 17:33 |
| sdague | https://review.openstack.org/#/q/I7a2f3ee9c74b34fdf003f65f4936074a236784c2,n,z | 17:33 |
| dansmith | sdague: but there is a non-abandoned change in that set too, shouldn't zuul ignore the abanoned one? | 17:33 |
| sdague | it does not | 17:33 |
| dansmith | it clearly doesn't.. should it? | 17:34 |
| sdague | whether or not it should is up for debate, but it currently doesn't | 17:34 |
| fungi | right, zuul assumes that it should not merge anything depending on an abandoned change | 17:34 |
| *** BharatK has quit IRC | 17:35 | |
| *** jistr has quit IRC | 17:35 | |
| fungi | i've come around to thinking that's the safest behavior for it anyway | 17:35 |
| dansmith | sdague: so then can we merge this so I can drop that? https://review.openstack.org/#/c/190289/ | 17:35 |
| fungi | anything else makes it too easy to suddenly prematurely merge a change which actually depended on a change that got overzealously abandoned, and cause breakage | 17:36 |
| pleia2 | EmilienM: a couple comments inline re: 176326 | 17:36 |
| dansmith | fungi: this is an odd situation because there is one good and one bad change with the same id, but it's probably obscure enough to ignore I guess | 17:36 |
| sdague | fungi / jeblair - so before I just scrub out the tracing change in devstack-gate, we don't want it there, right? | 17:36 |
| sdague | dansmith: sure, +A on the base change | 17:37 |
| dansmith | sdague: thanks | 17:37 |
| sdague | dansmith: yeh, it's the backport issue | 17:37 |
| fungi | especially since one of the intended uses of depends-on is "don't merge this until these other things merge" | 17:37 |
| sdague | right, people have used it as procedural block, so the abandon behavior is fuzzy | 17:37 |
| dansmith | fungi: yeah, if I couldn't get sdague to approve that change, I'd have to create a bunch of new things and abandon others to get out of this mess, but.. anyway | 17:38 |
| *** bhuvan has joined #openstack-infra | 17:38 | |
| fungi | but yeah, depends-on'ing a change with backports is a bit of a gray area. not easy to untangle the solution | 17:38 |
| openstackgerrit | Merged openstack-infra/nodepool: Record interesting info into nova metadata https://review.openstack.org/126621 | 17:38 |
| *** jtomasek has quit IRC | 17:38 | |
| sdague | right, and actually cross branch depends on has saved me a ton of time with grenade stuff, so I don't want to branch constrain it | 17:38 |
| fungi | jeblair: do we want to restart nodepool with 126621 in place and then confirm it's doing what we want before approving others in that stack? | 17:38 |
| openstackgerrit | lifeless proposed openstack/requirements: Ignore the dist directory. https://review.openstack.org/190694 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Move test_update to be unit tests. https://review.openstack.org/190693 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Convert test_pbr to unit tests. https://review.openstack.org/190692 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Split main out a little for testing. https://review.openstack.org/190605 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Make _copy_requires pure. https://review.openstack.org/190604 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Reduce dataloss window through interrupted writes. https://review.openstack.org/190606 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Mark as Python2.7 only the dependencies that are. https://review.openstack.org/189250 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Add basic testing of options -> parameters. https://review.openstack.org/190616 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt. https://review.openstack.org/189251 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Convert test_update_suffix to unit tests. https://review.openstack.org/190617 | 17:40 |
| openstackgerrit | lifeless proposed openstack/requirements: Add upper-constraints.txt generator. https://review.openstack.org/189249 | 17:40 |
| *** amitgandhinz has joined #openstack-infra | 17:40 | |
| *** dprince has joined #openstack-infra | 17:41 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: remove lib-forward-testing jobs from mox3 https://review.openstack.org/190735 | 17:42 |
| *** pcrews has quit IRC | 17:42 | |
| *** jlanoux has joined #openstack-infra | 17:43 | |
| fungi | sdague: aren't you expecting to find KEYSTONE_USE_MOD_WSGI=False in http://logs.openstack.org/97/190597/3/check/check-grenade-dsvm/322706e/logs/grenade_localrc.txt.gz ? | 17:44 |
| sdague | fungi: no | 17:44 |
| sdague | it's in the devstack localrc files | 17:44 |
| sdague | http://logs.openstack.org/97/190597/3/check/check-grenade-dsvm/322706e/logs/old/localrc.txt.gz | 17:45 |
| sdague | http://logs.openstack.org/97/190597/3/check/check-grenade-dsvm/322706e/logs/new/localrc.txt.gz | 17:45 |
| fungi | d'oh! i was confusing the localrcs | 17:45 |
| jeblair | sdague: why NEW branch instead of OLD? | 17:45 |
| sdague | jeblair: because... BASE == NEW | 17:45 |
| sdague | confusingly enough | 17:45 |
| *** sdake has joined #openstack-infra | 17:45 | |
| sdague | otherwise we'd have to change all the branch names as well | 17:46 |
| fungi | sdague: yep, i can confirm it's in the devstack localrcs for old and new. lgtm | 17:46 |
| sdague | honestly, I have no idea why we used the BASE var the first time around anyway | 17:47 |
| jeblair | sdague: right, base=new for pullup; base=old for forward | 17:47 |
| sdague | oh, that's why we maybe used base | 17:47 |
| jeblair | sdague: does that logic hold? or should we export base? | 17:47 |
| sdague | so... I think new is right | 17:47 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "networking-ovn: Allow setting devstack-gate env vars" https://review.openstack.org/190315 | 17:47 |
| sdague | and forward isn't really used anywhere anyway | 17:48 |
| sdague | which is the only time it might be different | 17:48 |
| jeblair | we don't do forward testing anymore? | 17:48 |
| sdague | we've never had a forward testing voting job | 17:48 |
| sdague | it was aspirational | 17:48 |
| sdague | we have a non voting job on master grenade | 17:48 |
| sdague | but no where else iirc | 17:48 |
| fungi | in theory it's a hole in stable branch support. in practice it's not a very frequently trafficked hole | 17:49 |
| sdague | right | 17:49 |
| sdague | it's never reached the point of being a top 20 hole in our testing | 17:49 |
| fungi | because what gets backported to stable is generally extremely low risk of causing upgradeability issues to the next release | 17:50 |
| sdague | right | 17:50 |
| fungi | particularly since things like behavior changes, new config options and db migrations are mostly taboo | 17:50 |
| sdague | if that policy changes, the importance of the test job might change, but as long as stable is conservative, it's pretty low risk | 17:50 |
| jeblair | sdague: so logic with your change means: icehouse->juno wsgi=false; juno->kilo wsgi=false; kilo->master wsgi=true. | 17:51 |
| sdague | correct | 17:51 |
| *** jtomasek has joined #openstack-infra | 17:51 | |
| sdague | which is what we want | 17:51 |
| jeblair | and a potential later improvement to support juno->kilo wsgi=true. | 17:51 |
| sdague | because while juno & kilo can run under wsgi, there are manual steps to make that transition | 17:51 |
| jeblair | sdague: i agree, i think using OLD/NEW here is the right way to think about it. | 17:51 |
| sdague | jeblair: correct, morganfainberg said he'd look at it | 17:52 |
| jeblair | base is useful in -wrap to help decide what old/new should be, but once we determine that, we should stop thinking in terms of which 'job' is running and instead in terms of what things we're testing. | 17:52 |
| *** bhuvan has quit IRC | 17:52 | |
| j^2 | anteaya: i’m at a loss here: http://logs.openstack.org/32/186532/20/check/gate-project-config-layout/e1f8acb/console.html | 17:52 |
| j^2 | not sure what that means | 17:52 |
| jeblair | sdague: +3 | 17:53 |
| j^2 | pleia2: ^^ | 17:53 |
| *** dannywil_ has joined #openstack-infra | 17:53 | |
| sdague | yeh, and honestly, it's confusing in devstack-vm-gate.sh. I confused myself many times thinking BASE meant OLD, when it meant NEW. Because in grenade code base == old | 17:53 |
| sdague | jeblair: awesome, thanks | 17:54 |
| jeblair | sdague: back to your other Q, i think in general we don't want the xtrace, unless we want to send it to a log. i lean toward just abandoning it for now. | 17:54 |
| *** sdake_ has joined #openstack-infra | 17:54 | |
| *** bhuvan has joined #openstack-infra | 17:55 | |
| sdague | ok, I'm fine with that. I pulled the grenade patches off of that change, and am just depending on the base d-g fix now | 17:55 |
| sdague | I'll let it complete test results for posterity, then abandon | 17:55 |
| ams__ | Can I have generic macros? Just variables | 17:55 |
| ams__ | (in jjb) | 17:55 |
| sdague | also, a couple of quick d-g fixes | 17:56 |
| sdague | https://review.openstack.org/#/c/190703/ | 17:56 |
| jeblair | fungi: i'm testing the nodepool changes on live hpcloud, so i'm _fairly_ confident in them, modulo rax bahavior difference. however, if you do want to restart nodepool to check, i'd do it with https://review.openstack.org/190726, as it is less likely to cause the auto-alien-delete stuff i'm about to write to be wrong. | 17:56 |
| sdague | and https://review.openstack.org/#/c/190166/ | 17:56 |
| sdague | both very straight forward | 17:56 |
| sdague | and now... food | 17:56 |
| fungi | jeblair: yeah, i'm i think okay with the second change. mostly just trying to reconcile the commit message with my understanding of the somewhat trivial code changes | 17:57 |
| *** dannywilson has quit IRC | 17:57 | |
| *** mmedvede has joined #openstack-infra | 17:57 | |
| *** achanda has joined #openstack-infra | 17:57 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:57 | |
| fungi | i think i was probably just being thrown off by a typo making me question my reading of the rest of the commit message | 17:57 |
| jeblair | oops | 17:57 |
| *** sdake has quit IRC | 17:58 | |
| EmilienM | pleia2: thx for your review, I missed some things indeed | 17:58 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Adjust recorded nova metadata https://review.openstack.org/190726 | 17:59 |
| jeblair | fungi: lemme know if that's better or not ^ ? | 17:59 |
| pleia2 | EmilienM: just little things, it's a big patch and mostly looks great :) | 17:59 |
| *** alazarev has left #openstack-infra | 18:00 | |
| fungi | jeblair: yep, not i'm certain my understanding of the change matches your intent ;) | 18:00 |
| fungi | er, now i'm | 18:00 |
| jeblair | fungi: nice typo yourself there! :) | 18:00 |
| *** Hal has joined #openstack-infra | 18:00 | |
| fungi | typos for everybody! | 18:00 |
| fungi | i have more in my pocket if you want them | 18:01 |
| *** Hal is now known as Guest98714 | 18:01 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Puppet: move from Stackforge to OpenStack https://review.openstack.org/176326 | 18:01 |
| *** hemna is now known as hemnafk | 18:01 | |
| j^2 | pleia2: any suggestion on https://review.openstack.org/#/c/186532/ | 18:01 |
| openstackgerrit | Sean Roberts proposed openstack-infra/irc-meetings: update openstack-product-team https://review.openstack.org/190419 | 18:01 |
| pleia2 | j^2: been looking at it, not sure yet | 18:02 |
| j^2 | thanks, yeah i’m at a loss | 18:02 |
| pabelanger | j^2, https://review.openstack.org/#/c/186532/20/jenkins/jobs/projects.yaml | 18:02 |
| pabelanger | look at my comment | 18:02 |
| pabelanger | pleia2, ^ | 18:02 |
| pleia2 | thanks pabelanger \o/ | 18:02 |
| j^2 | Wow | 18:03 |
| j^2 | ha! | 18:03 |
| j^2 | thanks | 18:03 |
| *** marun has quit IRC | 18:03 | |
| pabelanger | honestly the gate job should trap that exception better | 18:03 |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 18:03 |
| pabelanger | at least list the line number of the problem | 18:03 |
| *** ivar-lazzaro has joined #openstack-infra | 18:04 | |
| pleia2 | pabelanger: that's a wonderful thing for your todo list :D | 18:04 |
| pabelanger | pleia2, actually looking at it now, see what would be needed | 18:04 |
| pleia2 | nice | 18:05 |
| *** tvanderwiel has joined #openstack-infra | 18:05 | |
| *** ociuhandu has quit IRC | 18:06 | |
| pleia2 | reviewing both the puppet and chef changes for tomorrow isn't confusing me at all D: | 18:07 |
| pleia2 | poor brain | 18:07 |
| j^2 | pleia2: i thank you for taking the time to keep it straight :) | 18:08 |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: sync requirements to mox3 https://review.openstack.org/190741 | 18:08 |
| pleia2 | j^2: hehe, sure | 18:08 |
| *** hdd has quit IRC | 18:10 | |
| *** hdd has joined #openstack-infra | 18:10 | |
| *** pelix has quit IRC | 18:11 | |
| *** maishsk_afk has quit IRC | 18:11 | |
| waynr | pelix: i saw your comment, but i'm fairly certain that all the copying & munging in the YamlParser causes the OrderedDict type to become lost at some point, because the first thing I tried before implementing that explicit parameter ordering feature was to simply reorder the dict in my yaml file | 18:12 |
| *** jlanoux has quit IRC | 18:12 | |
| openstackgerrit | Merged openstack-infra/nodepool: Adjust recorded nova metadata https://review.openstack.org/190726 | 18:12 |
| waynr | shoot he left | 18:12 |
| jeblair | fungi: ^ should be safe to restart nodepool with that change in place if you want to test that that much is working in prod; i'm still working on the cleanup side | 18:13 |
| *** annegentle has quit IRC | 18:14 | |
| *** yamamoto has joined #openstack-infra | 18:15 | |
| *** dizquierdo has quit IRC | 18:15 | |
| fungi | jeblair: yep, sounds good. i'll give that a go as soon as the server updates. we seem to be doing a good job of keeping pace with the node demand today | 18:15 |
| *** annegentle has joined #openstack-infra | 18:17 | |
| *** krtaylor has joined #openstack-infra | 18:18 | |
| mestery | Howdy infra folks! Question: We have a feature branch in neutron where we want to run an existing job on. We know it will break so we want to make it non-voting on that feature branch. | 18:18 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 18:19 | |
| mestery | Is the best way to do this to make it non-voting on just the feature branch? Or temporarily create a new job and make that only run on the feature branch and make it non voting. | 18:19 |
| mestery | Guidance appreciated! | 18:19 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-log_processor: Create subunit proccessor subclass https://review.openstack.org/190744 | 18:19 |
| mestery | The idea is to run it and fix things but have it non-voting so we can merge as we address the issues. | 18:19 |
| *** yamamoto has quit IRC | 18:19 | |
| *** pcrews has joined #openstack-infra | 18:20 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Move akanda functional tests out of experimental https://review.openstack.org/190745 | 18:20 |
| *** cdent has quit IRC | 18:20 | |
| *** salv-orl_ has quit IRC | 18:20 | |
| fungi | mestery: a job can run or not on a given set of branches, and it can be voting or not voting, but there's no matrixing of voting on some branches and not others. for that you'll need additional job names (like using a {branch-designator} suffix of -nv on the non-voting version of the job) | 18:20 |
| mestery | fungi: Great! That's what I was thinking. I'll propose a patch with a new job with the suffix and make it non-voting and only run on the feature branch. Thanks! | 18:21 |
| fungi | mestery: then you can use the branch limiting to say run the normal job name on the usual branches and not on the feature branch, then run thos other nonvoting job name on just the feature branch | 18:21 |
| *** salv-orlando has joined #openstack-infra | 18:21 | |
| mestery | fungi: Cool! I'll propose the patch and add you as a reviewer so you can make sure it looks right. Thanks again! | 18:22 |
| SpamapS | greghaynes: Hey, we need to start pounding on the infra-cloud hardware. I'm kind of thinking we might want to start a trello board or an etherpad to track the micro tasks. | 18:22 |
| SpamapS | jeblair: ^ | 18:22 |
| SpamapS | mordred: ^ | 18:23 |
| greghaynes | SpamapS: Yep, I did a bunc of fixups to the inventory stuff yesterday | 18:23 |
| *** sabeen3 has left #openstack-infra | 18:23 | |
| * fungi recommends an etherpad so that people who don't want trello accounts can still participate beyond read-only access | 18:23 | |
| greghaynes | It really just needs crossing off the missing hosts we cant talk to for w/e reason now | 18:23 |
| SpamapS | greghaynes: yeah, see I'm just now circling back around and I don't really know where we are in the 'homogenize the hardware' step, but I feel like we should be able to work on the "get the hardware cloud nodes setup" step in parallel with that. | 18:24 |
| *** sabeen1 has joined #openstack-infra | 18:24 | |
| SpamapS | fungi: The organizational capabilities of Trello should outweigh your resistance to being assimilated into their universe. ;) | 18:24 |
| greghaynes | SpamapS: There was an etherpad with a list of todos | 18:24 |
| greghaynes | any idea where that is? | 18:24 |
| fungi | SpamapS: itym the draggedy-droppedyness of trello? | 18:25 |
| SpamapS | Could also deploy one of these: https://github.com/libreboard/libreboard | 18:25 |
| *** linuxmaniac has left #openstack-infra | 18:25 | |
| fungi | yep, or use the one in maniphest (i need to go vote on that spec!) | 18:25 |
| SpamapS | fungi: think "today" | 18:25 |
| SpamapS | not "soon" | 18:25 |
| fungi | yep | 18:26 |
| fungi | i get it | 18:26 |
| greghaynes | My plan was to finish filling out the inventory of all the hosts so we have all their macs, serials, etc in one place, then request the NIC changes so afterwards well have some data we can re-correlate with | 18:26 |
| SpamapS | if I use the one in maniphest.. I have to wait for maniphest to... manifest | 18:26 |
| fungi | just being a luddite over here | 18:26 |
| *** salv-orlando has quit IRC | 18:26 | |
| greghaynes | and for that we need to be able to talk to all the hosts | 18:26 |
| SpamapS | greghaynes: got that etherpad? | 18:27 |
| SpamapS | seems like despite my fear that it might be hard to organize things on, it might be the most consumable immediately | 18:27 |
| greghaynes | hrm, no, lemme search history | 18:27 |
| greghaynes | https://etherpad.openstack.org/p/YVR-infra-cloud | 18:27 |
| greghaynes | if you go on the bastion host for hp1 now, youll see a directory called inventory, and theres also a dir called playbooks which generates that | 18:28 |
| *** juggler has joined #openstack-infra | 18:29 | |
| greghaynes | I should rename that from get_macs.yaml to take_inventory.yaml or somesuch | 18:30 |
| jeblair | yes, let's either use storyboard or an etherpad | 18:31 |
| *** achanda has quit IRC | 18:31 | |
| *** baoli has quit IRC | 18:32 | |
| *** operator99 has quit IRC | 18:32 | |
| jeblair | we do have https://storyboard.openstack.org/#!/story/2000175 | 18:32 |
| jeblair | SpamapS, greghaynes: ^ | 18:33 |
| greghaynes | yea, so it seems we have todo lists in two places already | 18:34 |
| greghaynes | that have different ideas of reality | 18:34 |
| jeblair | i propose we update the story with changes from the etherpad | 18:34 |
| *** dprince has quit IRC | 18:34 | |
| jeblair | the story will be migrated into maniphest when we get it, so there's no reason not to use it | 18:35 |
| greghaynes | SpamapS: ^ thoughts? Im pretty ambivilent on location, we should make sure theres just one though | 18:35 |
| greghaynes | The first todo item on https://etherpad.openstack.org/p/YVR-infra-cloud is what ive been poking at though, and I dont think its on the story | 18:36 |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Add oslo automaton library to g-r https://review.openstack.org/190752 | 18:36 |
| * greghaynes adds | 18:36 | |
| *** achanda has joined #openstack-infra | 18:37 | |
| SpamapS | jeblair: I like all the reasons you're giving. My gut is saying that people will be less active in updating storyboard than an etherpad because thats what I've seen in the past. But I think that's not enough of a reason to avoid it. | 18:37 |
| *** Kiall has quit IRC | 18:37 | |
| jeblair | SpamapS: i agree with your gut | 18:37 |
| jeblair | lack of task odering might be a reason to avoid it | 18:38 |
| SpamapS | Perhaps we can use the priority for that? | 18:38 |
| SpamapS | at least get a coarse grained "now" and "later" ? | 18:38 |
| jeblair | SpamapS: works for me | 18:39 |
| pleia2 | j^2: noted a few fixes needed in your change | 18:39 |
| jeblair | high=now, low=later | 18:39 |
| * SpamapS orders them | 18:39 | |
| j^2 | pleia2: awesome thanks | 18:39 |
| SpamapS | jeblair: right | 18:39 |
| j^2 | i was just about to ask | 18:39 |
| pleia2 | j^2: ah, also just noticed that the config change failed again, so I'll poke at that now too | 18:40 |
| j^2 | :D | 18:40 |
| j^2 | thanks again | 18:40 |
| SpamapS | jeblair: can you remind me what "nodepool quiescing" is ? | 18:41 |
| *** maishsk_afk has joined #openstack-infra | 18:41 | |
| *** gyee has joined #openstack-infra | 18:41 | |
| jeblair | SpamapS: oh, i think we wanted to be able to tell nodepool to stop using a cloud so we could re-boot infra-cloud | 18:41 |
| SpamapS | jeblair: ah right, because right now that requires a restart? | 18:41 |
| fungi | that would be an awesome addition, yes | 18:41 |
| fungi | SpamapS: well, not a restart, but it does require config changes | 18:42 |
| jeblair | SpamapS: not actually a restart, but a config file change that goes through code review; i think we wanted a way to automate it | 18:42 |
| jeblair | so we could put it in a playbook or something perhaps | 18:42 |
| SpamapS | Ok, I added that qualification. | 18:42 |
| fungi | yeah, something we can do to easily suspend use of a particular provider | 18:42 |
| jeblair | but for starters, 'nodepool stop <cloud>' would be cool :) | 18:42 |
| *** hemnafk is now known as hemna | 18:43 | |
| fungi | also would be a great addition to display in the status api once it exists | 18:43 |
| jeblair | SpamapS: i have to run to lunch, can pitch in when i return | 18:43 |
| SpamapS | jeblair: great, thanks. | 18:43 |
| *** kdas_ has joined #openstack-infra | 18:44 | |
| *** kushal has quit IRC | 18:45 | |
| openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add a non-voting check-tempest-dsvm-neutron job https://review.openstack.org/190756 | 18:45 |
| *** prad_ has joined #openstack-infra | 18:45 | |
| *** annegentle has quit IRC | 18:45 | |
| *** kdas_ has quit IRC | 18:46 | |
| *** bhunter71 has quit IRC | 18:48 | |
| *** ayoung has quit IRC | 18:49 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/infra-manual: Discourage the use of six.iteritems https://review.openstack.org/190757 | 18:49 |
| *** abitha has quit IRC | 18:50 | |
| *** achanda has quit IRC | 18:50 | |
| *** e0ne has joined #openstack-infra | 18:51 | |
| *** e0ne is now known as e0ne_ | 18:51 | |
| pleia2 | heading to lunch | 18:51 |
| *** achanda has joined #openstack-infra | 18:52 | |
| *** mrmartin has joined #openstack-infra | 18:52 | |
| *** jaypipes has quit IRC | 18:52 | |
| *** e0ne_ is now known as e0ne | 18:53 | |
| *** mrmartin has quit IRC | 18:55 | |
| *** tiswanso_ has quit IRC | 18:55 | |
| *** dannywil_ has quit IRC | 18:59 | |
| *** claudiub has quit IRC | 18:59 | |
| stpierre | rally is seeing an issue with our gate jobs that appears to be a devstack or neutron failure, but the devstack logs aren't actually being saved. can anyone here help me figure out why those logs are missing and/or help me get them back? e.g., http://logs.openstack.org/85/182685/33/check/gate-rally-dsvm-neutron-rally/8925927/ | 18:59 |
| *** e0ne is now known as e0ne_ | 19:00 | |
| *** achanda has quit IRC | 19:00 | |
| *** marun has joined #openstack-infra | 19:00 | |
| *** dannywilson has joined #openstack-infra | 19:01 | |
| *** shardy has quit IRC | 19:01 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs: Fix formatting in Puppet Module Functional Testing https://review.openstack.org/190762 | 19:02 |
| *** achanda has joined #openstack-infra | 19:02 | |
| *** hdd has quit IRC | 19:02 | |
| *** abitha has joined #openstack-infra | 19:03 | |
| *** bkero has quit IRC | 19:04 | |
| *** abitha has quit IRC | 19:05 | |
| *** greghaynes has quit IRC | 19:05 | |
| *** bkero has joined #openstack-infra | 19:05 | |
| *** greghaynes has joined #openstack-infra | 19:05 | |
| *** marun has quit IRC | 19:05 | |
| *** hdd has joined #openstack-infra | 19:06 | |
| *** mriedem_afk is now known as mriedem | 19:08 | |
| *** abitha has joined #openstack-infra | 19:09 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add create method for secgroup rule https://review.openstack.org/190763 | 19:09 |
| *** abitha has quit IRC | 19:09 | |
| *** abitha has joined #openstack-infra | 19:09 | |
| *** stevemar has quit IRC | 19:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Create stackalytics.o.o under -infra https://review.openstack.org/190765 | 19:12 |
| fungi | stpierre: looks like that job reached the 125 minute jenkins build-timeout without reaching the 120 minute DEVSTACK_GATE_TIMEOUT | 19:13 |
| fungi | stpierre: you may want to increase the gap between those to allow for more time to perform cleanup and relocate the logs. the 5 minute difference was tuned for devstack/tempest jobs so rally's cleanup needs may differ | 19:13 |
| stpierre | ah, interesting | 19:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Create stackalytics.o.o under -infra https://review.openstack.org/190765 | 19:14 |
| *** mpaolino has quit IRC | 19:14 | |
| stpierre | this is my first time really trying to troubleshoot something in gate; where is DEVSTACK_GATE_TIMEOUT set? | 19:15 |
| fungi | stpierre: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/rally.yaml#n59 | 19:15 |
| *** annegentle has joined #openstack-infra | 19:16 | |
| *** ildikov_ has quit IRC | 19:17 | |
| *** Zhongjun has quit IRC | 19:18 | |
| openstackgerrit | Chris St. Pierre proposed openstack-infra/project-config: Reduce DEVSTACK_GATE_TIMEOUT for Rally https://review.openstack.org/190767 | 19:20 |
| *** alexsyip has quit IRC | 19:22 | |
| *** marcusvrn has quit IRC | 19:24 | |
| *** salv-orlando has joined #openstack-infra | 19:26 | |
| *** ildikov_ has joined #openstack-infra | 19:27 | |
| stpierre | fungi: boris-42 had another suggestion for getting the logs that will hopefully be quicker than waiting 2 hours for the jenkins timeout again, so i'm following that path first. | 19:27 |
| *** otter768 has joined #openstack-infra | 19:28 | |
| *** puranamr has quit IRC | 19:29 | |
| fungi | sounds good | 19:29 |
| boris-42 | fungi: ya if we remove all benchmarks except one it will be almost clear dsvm job ~15-20 min | 19:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Set proper permissions on login.def https://review.openstack.org/190777 | 19:31 |
| fungi | boris-42: makes sense. if nothing else you can also calculate a sensible difference for build-timeout vs DEVSTACK_GATE_TIMEOUT from that too | 19:31 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: make vote beaker jobs https://review.openstack.org/190778 | 19:31 |
| EmilienM | crinkle, nibalizer ^ | 19:31 |
| *** otter768 has quit IRC | 19:33 | |
| crinkle | nibalizer: does that affect infra's beaker jobs? ^ | 19:33 |
| nibalizer | crinkle: i think so | 19:35 |
| nibalizer | my head is kindof pluged into something else right now | 19:35 |
| *** e0ne_ is now known as e0ne | 19:35 | |
| nibalizer | but i would fix it by explictly looking for openstack/ and stackforge/ and not openstack-infra/ | 19:35 |
| flaper87 | fungi: can I ask 2 more mins from you to take a look at those patches? I'm hoping they'll be part of tomorrow's image build | 19:35 |
| flaper87 | fungi: https://review.openstack.org/#/c/190730/ https://review.openstack.org/#/c/190731/ | 19:36 |
| EmilienM | nibalizer: I don't want to break your CI though | 19:36 |
| flaper87 | jeblair: you too, if you have a couple of mins ^^^ | 19:36 |
| flaper87 | thank you in advance :) | 19:37 |
| *** soren has joined #openstack-infra | 19:38 | |
| fungi | flaper87: i went ahead and approved 190731 since it's an obvious fix and didn't want it to fall through the cracks. 190730 isn't a hurry because it's future-proofing | 19:38 |
| flaper87 | fungi: awesome, thank you! | 19:38 |
| *** mwagner_afk has quit IRC | 19:39 | |
| *** stevemar has joined #openstack-infra | 19:40 | |
| *** baoli has joined #openstack-infra | 19:41 | |
| *** achanda has quit IRC | 19:41 | |
| *** bhuvan has quit IRC | 19:41 | |
| thingee | anteaya: I have a series of CI's (https://etherpad.openstack.org/p/cinder-thirdpartyCI-issues) that need some issues corrected. is it fine for me to send these to third-party-announce list and cc the maintainer? just so the discussion is in the open? | 19:44 |
| *** hemna is now known as hemnafood | 19:44 | |
| *** ZZelle_ has joined #openstack-infra | 19:44 | |
| *** dguerri` is now known as dguerri | 19:44 | |
| thingee | anteaya: I also don't want to be spamming the list, but we are trying to be active on removing things that don't work | 19:44 |
| nibalizer | EmilienM: crinkle i think its ok because we explicitly dont vote by repo name right now | 19:46 |
| *** pcrews has quit IRC | 19:47 | |
| anteaya | thingee: I support you posting to -announce | 19:47 |
| anteaya | anyone object? | 19:47 |
| *** tiswanso has joined #openstack-infra | 19:48 | |
| anteaya | russellb: thank you | 19:48 |
| thingee | anteaya: thank you... I'll head to lunch and give people a chance to object :) | 19:49 |
| anteaya | thingee: I hear no objections | 19:49 |
| thingee | oh ok | 19:49 |
| anteaya | okay enjoy lunch | 19:49 |
| *** dguerri is now known as dguerri` | 19:49 | |
| anteaya | either way | 19:49 |
| thingee | anteaya: thank you | 19:50 |
| anteaya | thanks for doing this | 19:50 |
| anteaya | nice to have some clean up | 19:50 |
| nibalizer | speaking of beaker tests, this is ready if any infra/puppet-* cores are aorund https://review.openstack.org/#/c/184924/ | 19:50 |
| thingee | anteaya: yeah, well other folks like jgriffith and asselin_ are going to be helping along too :) | 19:50 |
| *** _nadya_ has joined #openstack-infra | 19:50 | |
| *** tiswanso_ has joined #openstack-infra | 19:51 | |
| anteaya | thank you, jgriffith and asselin_ and other folks who are helping | 19:51 |
| * anteaya also feels it is time for some more food | 19:52 | |
| nikeshm | hi i am trying to use gerrit events having +1 from jenkins for check pipelines so trying http://paste.openstack.org/show/282719/ in layout.yaml | 19:53 |
| *** sdake_ has quit IRC | 19:53 | |
| *** tiswanso has quit IRC | 19:53 | |
| *** ildikov_ has quit IRC | 19:54 | |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 19:55 |
| *** sdake has joined #openstack-infra | 19:55 | |
| j^2 | pleia2: i think i answered your questions etc ^^ | 19:55 |
| j^2 | AAAAHH | 19:56 |
| j^2 | my commit message reverted | 19:56 |
| fungi | j^2: i always pull from gerrit before updating | 19:57 |
| j^2 | i’m learning this the hard way it seems | 19:57 |
| fungi | i never trust my local branch to be as up to date as what's in gerrit any more ;_ | 19:57 |
| fungi | especially because i encourage other people to update my changes | 19:57 |
| *** rossella_s has quit IRC | 19:58 | |
| *** rossella_s has joined #openstack-infra | 19:58 | |
| nikeshm | but its not taking those events | 19:59 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/infra-manual: Discourage the use of six.iteritems https://review.openstack.org/190757 | 19:59 |
| nikeshm | is any thing missing http://paste.openstack.org/show/282719/ in layout.yaml | 19:59 |
| *** _nadya_ has quit IRC | 19:59 | |
| openstackgerrit | JJ Asghar proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 20:00 |
| *** bhuvan has joined #openstack-infra | 20:03 | |
| openstackgerrit | Merged openstack-infra/system-config: Rename uuid-devel rpm to libuuid-devel https://review.openstack.org/190731 | 20:04 |
| EmilienM | nibalizer: in https://review.openstack.org/190778 - I did not add the job in gate section, should I ? | 20:05 |
| *** samuelBartel has joined #openstack-infra | 20:10 | |
| *** bhuvan has quit IRC | 20:12 | |
| asselin_ | nikeshm, try something like this: http://paste.openstack.org/show/284472/ | 20:12 |
| asselin_ | fungi, don't want to bug too much, but is now a good time to merge 183429 and 183422? | 20:13 |
| asselin_ | or pleia2? ^^ | 20:14 |
| dhellmann | fungi, jeblair, clarkb : can one of you add me or oslo-core to the new mox3-core team, please? https://review.openstack.org/#/admin/groups/959,members | 20:15 |
| jeblair | SpamapS, greghaynes: back | 20:16 |
| fungi | dhellmann: done | 20:17 |
| fungi | asselin_: i can in just a bit | 20:17 |
| dhellmann | fungi: thanks! | 20:17 |
| jeblair | greghaynes: you're working on "Collect and correct MAC addresses, IPMI IPs, IPMI Usernames, IPMI Passwords, System serial numbers, for each machine" right? | 20:18 |
| jeblair | tchaypo has "Machine hardware details added to a place" | 20:18 |
| jeblair | those sound similar | 20:18 |
| dhellmann | fungi: thanks! | 20:18 |
| jeblair | that also sounds similar to "Work with HP NOC to fill in any missing data, and add rack number and rack slot information" | 20:19 |
| *** fdegir has left #openstack-infra | 20:19 | |
| jeblair | greghaynes: so can you catch up with tchaypo, find out what's been done on that front, and update the story? probably should leave comments with the outcome. | 20:20 |
| *** Sukhdev has joined #openstack-infra | 20:25 | |
| jeblair | greghaynes, SpamapS: i think i finished mapping the etherpad to storyboard; i think we still need to catch up status on some things and capture it there. | 20:27 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: Fix abandon permissions for mox3 repo https://review.openstack.org/190803 | 20:27 |
| *** Guest98714 has quit IRC | 20:27 | |
| *** kgiusti has left #openstack-infra | 20:27 | |
| *** wenlock has quit IRC | 20:28 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet-openstack: make vote beaker jobs https://review.openstack.org/190778 | 20:30 |
| *** pcrews has joined #openstack-infra | 20:30 | |
| *** soren has quit IRC | 20:30 | |
| *** ildikov_ has joined #openstack-infra | 20:30 | |
| *** stevemar has quit IRC | 20:30 | |
| *** achanda has joined #openstack-infra | 20:31 | |
| fungi | okay, new problem i'm stumped on... i can't figure out why oslo-core are unable to +2/approve https://review.openstack.org/190718 | 20:31 |
| *** alexpilotti has quit IRC | 20:31 | |
| fungi | the acl looks right (modulo dhellmann's 190803 above) and group membership is correct afaict | 20:31 |
| fungi | i've gone so far as to add myself to project bootstrappers, flushed caches, and even _i_ still can only -1..+1 code review on it | 20:32 |
| pabelanger | q: where do the stackforge/stackalytics people idle? | 20:32 |
| dhellmann | mox3, the lib that won't be fixed | 20:32 |
| pabelanger | /faceplam | 20:32 |
| russellb | pabelanger: #stackalytics iirc | 20:32 |
| pabelanger | I guess I should read the README | 20:32 |
| russellb | pabelanger: trololo | 20:32 |
| pabelanger | russellb, thanks | 20:33 |
| dougwig | dhellmann: lol | 20:33 |
| fungi | dhellmann: it resists us at every turn | 20:33 |
| dhellmann | fungi: indeed | 20:33 |
| *** jtomasek has quit IRC | 20:33 | |
| *** amuller has joined #openstack-infra | 20:33 | |
| pleia2 | j^2: thanks, trying to figure out why all those undefined job errors exist now | 20:34 |
| russellb | looks like a CI bot is freaking out: https://review.openstack.org/#/c/188221/ | 20:34 |
| russellb | needs to be rage disabled | 20:34 |
| openstackgerrit | Merged openstack-infra/project-config: Rename uuid-devel rpm to libuuid-devel https://review.openstack.org/190730 | 20:34 |
| j^2 | pleia2: kk, thanks! | 20:34 |
| russellb | "cisco ml2 ci" | 20:34 |
| pabelanger | EXCEPTION | 20:34 |
| anteaya | j^2: pleia2 and I will be taking over your patch | 20:34 |
| j^2 | ok | 20:35 |
| russellb | anteaya: do you have access to do the above? | 20:35 |
| anteaya | j^2: be available if we have questions but please don't push anymore patchsets | 20:35 |
| j^2 | anteaya: i’m around if you need anything | 20:35 |
| anteaya | russellb: I can get it shut off, if that is the question | 20:35 |
| pleia2 | thanks j^2 | 20:35 |
| j^2 | thanks guys! | 20:35 |
| * dougwig clicks in fear | 20:35 | |
| anteaya | j^2: thanks | 20:35 |
| russellb | anteaya: yes :) | 20:35 |
| dougwig | phew | 20:35 |
| russellb | dougwig: you're safe :) | 20:35 |
| anteaya | https://wiki.openstack.org/wiki/ThirdPartySystems/Cisco_ml2_CI | 20:36 |
| russellb | nice, amuller ^^^ that has who you should email | 20:37 |
| fungi | anteaya: russellb: i've just switched the ml2.ci@cisco.com account to inactive | 20:37 |
| russellb | fungi: thank you! | 20:37 |
| amuller | fungi: You just rescued my email box :) | 20:37 |
| anteaya | 14208 | 20:37 |
| fungi | and just flushed the gerrit caches too | 20:37 |
| tchaypo | greghaynes: I have some wiki pages for you | 20:37 |
| anteaya | fungi: you got them already, thanks fungi | 20:37 |
| anteaya | fungi: I'll send the email | 20:37 |
| fungi | hopefully that will put an end to their crazylooping | 20:37 |
| anteaya | russellb: thanks for letting us know | 20:38 |
| fungi | thanks anteaya | 20:38 |
| russellb | thanks for jumping on it :) | 20:38 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-stackalytics: WIP: Initial commit for puppet-stackalytics https://review.openstack.org/190708 | 20:38 |
| jeblair | fungi: ping me if you want me on the mox thing | 20:38 |
| *** radez is now known as radez_g0n3 | 20:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: WIP: Create stackalytics.o.o under -infra https://review.openstack.org/190765 | 20:38 |
| *** dguerri` is now known as dguerri | 20:39 | |
| fungi | jeblair: not sure what else to check. i don't see any errors in the logs | 20:40 |
| *** wenlock has joined #openstack-infra | 20:41 | |
| anteaya | russellb: http://lists.openstack.org/pipermail/third-party-announce/2015-June/000188.html | 20:41 |
| * anteaya goes to make tea in prep for unwinding the chef rename patch | 20:41 | |
| jeblair | fungi: if i add myself to mox3-core, i can +2 changes | 20:42 |
| jeblair | at least according to gertty | 20:42 |
| greghaynes | tchaypo: hey, yea, so all the stuff from the hpcs wiki is on the box were doing inventory on, and theres just some ansible on there that goes to all the hosts we can talk to, merges data about each host with the wiki data, and adds it to an inventory dir | 20:42 |
| *** dkranz has quit IRC | 20:42 | |
| greghaynes | its just a matter of being able to hit all the hosts we need to be able to at this point | 20:42 |
| jeblair | dhellmann: you are unable to +2 https://review.openstack.org/190718 ? | 20:42 |
| dhellmann | jeblair: let me try again | 20:42 |
| *** achanda has quit IRC | 20:43 | |
| dhellmann | jeblair: yes, I still have +/-1 but not 2 | 20:43 |
| jeblair | dhellmann: gertty or gerrit web ui? | 20:43 |
| dhellmann | jeblair: web | 20:43 |
| jeblair | dhellmann: i can reproduce that in the webui. | 20:44 |
| *** amuller has left #openstack-infra | 20:44 | |
| greghaynes | jeblair: yes, im working on the collect info task... I dont see a task in SB for that though | 20:44 |
| fungi | this is really strange | 20:44 |
| dhellmann | jeblair: if this is a webui thing, I could self-approve that change in gertty. Aren't you planning a restart for renames in the next few days anyway? | 20:44 |
| fungi | dhellmann: tomorrow | 20:44 |
| dhellmann | dims: would you be ok with me doing that? ^^ | 20:44 |
| jeblair | dhellmann: okay, click on 'add comment', and then after that (when you're on the page to leave a review) hit shift-reload | 20:44 |
| fungi | oh... | 20:45 |
| fungi | _that_'s cached? | 20:45 |
| *** bknudson has quit IRC | 20:45 | |
| dhellmann | jeblair: I'm using the new-style ui, so that doesn't take me to a separate page | 20:45 |
| *** dboik has quit IRC | 20:45 | |
| fungi | yep, that seems to solve it for me in the old review screen | 20:45 |
| *** annegentle has quit IRC | 20:45 | |
| jeblair | fungi: weirdly, shift-reload on the change page itself did not fix it for me, only on the review page itself | 20:45 |
| jeblair | dhellmann: hah, there was a third option for which ui you are using... | 20:46 |
| dougwig | anteaya, russellb: i can already tell you what happened, because i've made the mistake myself. their recheck text is in their gerrit comment. | 20:46 |
| anteaya | dougwig: awesome | 20:46 |
| jeblair | dhellmann: erm, i guess try shift-reloading the new change screen then? | 20:46 |
| fungi | jeblair: yep, that's what i had been trying, to no avail. not sure why my browser decided to cache the form page | 20:46 |
| anteaya | dougwig: you want to offer a reply to -announce to help them out? | 20:46 |
| jeblair | dhellmann: maybe logout/login? quit browser? | 20:46 |
| dougwig | anteaya: sure | 20:46 |
| dhellmann | jeblair: ok, using a different browser gives it to me | 20:46 |
| anteaya | dougwig: thank you | 20:46 |
| dhellmann | yeah, I'll try restarting the browser now | 20:46 |
| jeblair | reload all the things | 20:47 |
| dhellmann | wow, that's a very aggressive cache, restarting the browser didn't clear it | 20:47 |
| dims | dhellmann: ++ go for ir | 20:47 |
| jeblair | i don't even | 20:47 |
| dhellmann | dims: it looks like a browser cache issue | 20:48 |
| jeblair | dhellmann: new computer? | 20:48 |
| dhellmann | jeblair: if mordred's buying | 20:48 |
| *** baoli_ has joined #openstack-infra | 20:48 | |
| jeblair | dhellmann: i don't hear any objection | 20:48 |
| dhellmann | jeblair: ordered! | 20:48 |
| dhellmann | jeblair: restarting the browser, logging out, then logging back in fixed it | 20:49 |
| *** marcusvrn1 has quit IRC | 20:49 | |
| fungi | dhellmann: i would love to see the requisition order... "new more docile computer. old one's browser cache was too aggressive" | 20:49 |
| dhellmann | jeblair, fungi : thanks for working through that with me | 20:49 |
| anteaya | dougwig: thank you | 20:50 |
| dhellmann | fungi: I might just try that... | 20:50 |
| *** baoli has quit IRC | 20:51 | |
| anteaya | they are still posting :( | 20:53 |
| * anteaya is really looking forward to close connection | 20:54 | |
| *** bhuvan has joined #openstack-infra | 20:54 | |
| tchaypo | greghaynes: cool | 20:54 |
| *** e0ne has quit IRC | 20:54 | |
| *** puranamr has joined #openstack-infra | 20:54 | |
| jeblair | anteaya: should we restart gerrit? | 20:55 |
| anteaya | jeblair: it will kill the connection | 20:55 |
| anteaya | seems extreme but this could go on for hours | 20:56 |
| pabelanger | sounds like that new interface for 3rd party operator is coming sooner then later ;) | 20:56 |
| jeblair | it's like a 10 secound outage. | 20:56 |
| anteaya | making that patch unable to be opened in a browser | 20:56 |
| fungi | i take it there's no command to terminate an established connection in gerrit's api | 20:56 |
| jeblair | fungi: that's what anteaya wants, it's in 2.9. | 20:56 |
| anteaya | yes then let's do it | 20:56 |
| anteaya | sorry everyone | 20:56 |
| fungi | should i be able to drop its session in conntrack? | 20:56 |
| jeblair | fungi: oh, probably. | 20:57 |
| anteaya | it is actually in 2.11 but zaro was able to successfully backport to 2.9 so we can get it when we get to at least 2.9 | 20:57 |
| zxiiro | In JJB how do I configure post-build steps to only run on success? I can't seem to find documentation on how to set that postbuild step | 20:57 |
| jeblair | fungi: you want to do it that way? | 20:57 |
| anteaya | he couldn't backport to 2.8 though | 20:57 |
| jeblair | i think it's actually respondible for a large amount of current gerrit load | 20:58 |
| asselin_ | zxiiro, I remember reading it in the docs. Also in the jenkins ui there's help for that | 20:58 |
| jeblair | 100mbit inbound traffic | 20:58 |
| zxiiro | asselin_: yes i know you can set it in the UI. but I want to be able to configure it using JJB that's hte issue | 20:58 |
| fungi | 40c039c9 18:58:24 00:00:00 a/14208 128.107.233.10 | 20:59 |
| fungi | 22d0bee5 17:56:50 00:00:00 a/14208 128.107.233.10 | 20:59 |
| *** rfolco has quit IRC | 20:59 | |
| *** dannywil_ has joined #openstack-infra | 20:59 | |
| *** aysyanne has quit IRC | 20:59 | |
| *** bexelbie has joined #openstack-infra | 21:00 | |
| asselin_ | zxiiro, http://docs.openstack.org/infra/jenkins-job-builder/publishers.html#publishers.postbuildscript | 21:00 |
| asselin_ | The script-only-if-succeeded and bool script-only-if-failed options are confusing. If you want the post build to always run regardless of the build status, you should set them both to false. | 21:00 |
| jeblair | fungi: this is all yours; conntrack or restart at will. i do think that the current traffic/load make this fairly urgent. | 21:00 |
| bexelbie | I suspect I just did something silly. I submitted some pull requests in github against yaml2ical — I didn’t think about the fact that it was OpenStack code. Do I need to close them and redo them via gerrit? | 21:00 |
| jeblair | http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=9 | 21:01 |
| *** patrickeast_ has joined #openstack-infra | 21:01 | |
| jeblair | bexelbie: a bot should auto-close them soon, but yes, you should resubmit via gerrit. thanks | 21:01 |
| fungi | i've deleted the two open connection flow entries | 21:01 |
| bexelbie | jeblair, thanks - I normally don’t contribute to this code-base and just didn’t think about your pcoess which I saw mentioned one in a preso | 21:01 |
| *** alexsyip has joined #openstack-infra | 21:02 | |
| *** baoli_ has quit IRC | 21:02 | |
| *** dannywilson has quit IRC | 21:02 | |
| jeblair | bexelbie: hope you enjoy it :) the getting started docs are here: http://docs.openstack.org/infra/manual/developers.html#getting-started | 21:02 |
| *** patrickeast has quit IRC | 21:02 | |
| *** patrickeast_ is now known as patrickeast | 21:02 | |
| jeblair | and it looks like the pull-request closer bot might be broken? :( | 21:03 |
| zxiiro | asselin_: thanks but i think this is configured for a different thing than what i'm using. What i'm using isn't a publisher but a "post-build" step | 21:03 |
| jeblair | not sure how often it's supposed to run | 21:03 |
| anteaya | fungi: they are still posting | 21:03 |
| bexelbie | I have some changes I need in yaml2ical for a project that is now using it .. hopefully it will help you guys. The PRs just closed (or at least one did) | 21:03 |
| zxiiro | asselin_: if it helps this is the buttons i want to click http://imagebin.ca/v/24uJijXlTyD4 | 21:04 |
| jeblair | bexelbie: ah that was good timing :) | 21:04 |
| anteaya | comments posted marked 5:04 my current time | 21:04 |
| *** bhuvan has quit IRC | 21:04 | |
| fungi | yeah, conntrack was able to delete one of the two flows it looks like but the other is sticking around. not sure why. i guess we can restart gerrit and figure this out later | 21:04 |
| zxiiro | asselin_: right after a Maven build there's a "post Steps" | 21:04 |
| fungi | restarting gerrit now | 21:05 |
| anteaya | thanks | 21:05 |
| asselin_ | zxiiro, you should be able to find it in the docs | 21:05 |
| jeblair | bexelbie: your changes look cool, i look forward to reviewing them for real, thanks! | 21:05 |
| fungi | #status notice Gerrit has been restarted to terminate a persistent looping third-party CI bot | 21:05 |
| openstackstatus | fungi: sending notice | 21:05 |
| *** angela-s|afk is now known as angela-s | 21:06 | |
| fungi | okay, gerrit's on its way back up now | 21:06 |
| Clint | looks back | 21:06 |
| -openstackstatus- NOTICE: Gerrit has been restarted to terminate a persistent looping third-party CI bot | 21:06 | |
| bexelbie | jeblair, walking through the setup to get them in .. I’d like to get them in before bed | 21:06 |
| anteaya | they have stopped posting | 21:07 |
| anteaya | do we have any ability to clear the comments off of https://review.openstack.org/#/c/188221/ | 21:08 |
| openstackstatus | fungi: finished sending notice | 21:08 |
| *** thedodd has quit IRC | 21:08 | |
| *** ayoung has joined #openstack-infra | 21:09 | |
| fungi | probably with careful database surgery | 21:09 |
| jeblair | yeah, i think we did it once before, on like 2.4 | 21:09 |
| fungi | but we'd need to stop gerrit and rebuild the lucene search indexes i expect | 21:09 |
| *** tvanderwiel has quit IRC | 21:10 | |
| fungi | not sure whether it would be safe to modify the comments table behind its back | 21:10 |
| jeblair | i would also expect that. we could probably go ahead and delete the comments now and let the lucene index catch up tomorrow. | 21:10 |
| jeblair | that's just a guess | 21:10 |
| openstackgerrit | Kevin L. Mitchell proposed openstack-dev/pbr: Support build metadata https://review.openstack.org/190818 | 21:10 |
| fungi | was that the only change they were looping on? | 21:10 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/irc-meetings: Add TC and cross-project meeting agenda urls https://review.openstack.org/190819 | 21:10 |
| *** RichardRaseley has quit IRC | 21:11 | |
| *** timcline has quit IRC | 21:12 | |
| *** EricGonczer_ has quit IRC | 21:13 | |
| *** annegentle has joined #openstack-infra | 21:13 | |
| *** rlandy has joined #openstack-infra | 21:14 | |
| pleia2 | crinkle: I changed my mind, I don't like Augeas :) | 21:15 |
| fungi | mysql> delete from change_messages where author_id=14208 and change_id=188221; | 21:15 |
| fungi | Query OK, 1407 rows affected (0.03 sec) | 21:15 |
| *** ldnunes has quit IRC | 21:16 | |
| jeblair | fungi: change lgtm | 21:16 |
| anteaya | fungi: the only one I have seen so far | 21:16 |
| * anteaya goes hunting | 21:16 | |
| *** hdd has quit IRC | 21:17 | |
| crinkle | pleia2: :( | 21:17 |
| fungi | interesting, now that i can read that change... Cisco APIC CI, Cisco N1kv CI, Cisco Tail-f CI and Cisco vpnaas CI all reported "EXCEPTION" at the same time the other account went into a loop | 21:18 |
| bexelbie | jeblair, any ideas why I am not allowed to accept the Individual agreement - error cannot store contact information | 21:18 |
| pleia2 | crinkle: this xml file is 470 lines long, and brain-hurt on normal days, I kind of worry about the maintenance burden of managing it through augeas in the long term, since the file changes with every release | 21:18 |
| anteaya | the changed their comment text today | 21:18 |
| fungi | bexelbie: were you following http://docs.openstack.org/infra/manual/developers.html#account-setup ? | 21:19 |
| bexelbie | fungi, yes | 21:19 |
| anteaya | prior comments don't have the recheck syntax and didn't loop | 21:19 |
| fungi | bexelbie: see https://ask.openstack.org/question/56720 for some possible troubleshooting for that | 21:19 |
| jeblair | did they send themselves into a loop with "recheck cisco" in their own comment text? | 21:20 |
| *** peristeri_ has quit IRC | 21:20 | |
| fungi | jeblair: looks entirely possible anyway | 21:20 |
| crinkle | pleia2: hmm | 21:20 |
| jeblair | what ci system are they running? (what leaves "EXCEPTION"?) | 21:20 |
| anteaya | I've checked their top 10 or so patches, that seems to be the only one | 21:20 |
| bexelbie | fungi, hmm, I didn’t really want to be a foundation member … | 21:20 |
| *** dpaterson has quit IRC | 21:20 | |
| jeblair | zuul will do that if it can't talk to gearman... | 21:20 |
| fungi | bexelbie: the steps in there are unfortunately non-optional, otherwise they wouldn't be in there | 21:20 |
| anteaya | jeblair: I don't know, we can ask them to tell us | 21:21 |
| *** hemnafood is now known as hemna | 21:21 | |
| bexelbie | fungi, agreed. However it doesn’t say you have to be “Foundation Member” so I had selected “Community Member" | 21:21 |
| bexelbie | regardless it is done | 21:21 |
| *** dguerri is now known as dguerri` | 21:21 | |
| * bexelbie will have to query my OS friends when it is voting time to make sure I am informed | 21:21 | |
| *** kutija_ has joined #openstack-infra | 21:22 | |
| fungi | bexelbie: great point. i think the "community member" setting is more recent than the prose we used to describe how to add an account into the foundation's member system | 21:22 |
| *** geoffarnold has quit IRC | 21:22 | |
| jeblair | bexelbie: we are working very hard to make the foundation membership part optional. unfortunately the foundation lawyers have had a hard time believing anyone would not want to join a trade association to submit a patch. i think we're making progress though and should be able to implement substantial change soon. | 21:22 |
| bexelbie | sounds like a docs patch is needed | 21:23 |
| jeblair | bexelbie: (we are also trying to remove the need to sign the CLA) | 21:23 |
| fungi | bexelbie: yep, i'll update that now | 21:23 |
| * anteaya tries to get back to fixing the chef rename patch | 21:23 | |
| crinkle | pleia2: wouldn't we have that burden anyway? if the file changes every release then the whole template needs to be updated | 21:23 |
| crinkle | pleia2: with augeas then only the parts we care about need to be updated, and those parts might not change every release | 21:23 |
| *** HeOS has joined #openstack-infra | 21:23 | |
| *** isviridov is now known as isviridov_away | 21:25 | |
| bexelbie | jeblair, the CLA is a fair request imho | 21:25 |
| *** kutija has quit IRC | 21:25 | |
| pleia2 | crinkle: it would, but we'd need to dig up the augeas-specific reference to each section, it has a standalone.xml/server/profile/subsystem[1] ...up to 23 | 21:25 |
| pleia2 | crinkle: right now we don't need any augeas knowledge to just hack on the .erb template | 21:26 |
| *** puranamr has quit IRC | 21:26 | |
| jeblair | bexelbie: i'm not sure what it gives us over the apache license (which itself contains a cla). i think understanding and agreeing upon contribution terms is important, but the CLA seems like needless lawyering. so we're trying to move to using the DCO for casual contributors, while corporate contributions will still be covered by the CCLA. | 21:27 |
| bexelbie | that makes even better sense jeblair - I was speaking more of cla’s as a concept | 21:28 |
| pleia2 | crinkle: maybe I'll just finish hacking my way through this to replace the right things this time around, and see how bad it'll be (and what the rest of -infra things) | 21:28 |
| pleia2 | thinks too | 21:28 |
| *** otter768 has joined #openstack-infra | 21:29 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-manual: Update account setup to specify foundation member https://review.openstack.org/190825 | 21:29 |
| fungi | bexelbie: https://review.openstack.org/190825 has an attempted clarification | 21:29 |
| bexelbie | fungi, LGTM | 21:30 |
| jeblair | fungi: we lose gerritbot? | 21:31 |
| *** wenlock has quit IRC | 21:31 | |
| fungi | jeblair: i don't think so | 21:31 |
| jeblair | fungi: oh, sorry. i seem to have developed gerritbot-blindness. | 21:32 |
| fungi | jeblair: it still seems to be in-channel and reported on my new change 2 minutes ago | 21:32 |
| *** dpaterson has joined #openstack-infra | 21:32 | |
| fungi | hah | 21:32 |
| fungi | long patch series are starting to leave me gerritbot-blind as well | 21:32 |
| *** ociuhandu has joined #openstack-infra | 21:32 | |
| *** ayoung has quit IRC | 21:33 | |
| jeblair | fungi: did you restart nodepool? | 21:33 |
| fungi | jeblair: no, i keep getting sidetracked by new and still more exciting emergencies, but can give it a shot now | 21:34 |
| *** otter768 has quit IRC | 21:34 | |
| jeblair | fungi: ok, or i can. let me know if you want me to. | 21:34 |
| fungi | when i went to do it earlier it had just started a very large spike of node builds, so i didn't want to throw those away | 21:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Delete leaked instances https://review.openstack.org/190827 | 21:34 |
| *** tonytan4ever has quit IRC | 21:35 | |
| *** puranamr has joined #openstack-infra | 21:35 | |
| fungi | nodepool is restarted | 21:35 |
| jeblair | fungi: that works in the _normal_ cases ^ ; i haven't exhaustively tested everything that can go wrong yet; i'm going to see what i can accomplish in nodepool's test framework | 21:35 |
| fungi | i'll clean up any remaining alien stragglers shortly, and then any new ones should have metadata (if we're lucky) | 21:35 |
| *** eharney has quit IRC | 21:35 | |
| fungi | asselin_: i still haven't gotten around to approving those next puppet refactor changes, sorry | 21:36 |
| fungi | i should to switch to writing the maintenance plan etherpad i was going to put together earlier, but first need to take a break to cook dinner | 21:36 |
| fungi | back in a bit | 21:36 |
| jeblair | | metadata | {"groups": "[\"rax-dfw\", \"bare-centos6\"]", "nodepool": "{\"provider_name\": \"rax-dfw\", \"node_id\": 3013495, \"image_name\": \"bare-centos6\"}"} | | 21:38 |
| jeblair | fungi: ^ that's from rax, so i think we're good | 21:38 |
| *** puranamr has quit IRC | 21:38 | |
| *** annegentle has quit IRC | 21:38 | |
| *** wenlock has joined #openstack-infra | 21:39 | |
| *** dangers is now known as dangers_away | 21:41 | |
| *** amitgandhinz has quit IRC | 21:42 | |
| *** amitgandhinz has joined #openstack-infra | 21:43 | |
| *** dkranz has joined #openstack-infra | 21:43 | |
| *** dims_ has joined #openstack-infra | 21:44 | |
| anteaya | fungi: food is a good choice | 21:44 |
| *** dims has quit IRC | 21:46 | |
| *** baoli has joined #openstack-infra | 21:46 | |
| *** bhuvan has joined #openstack-infra | 21:46 | |
| *** puranamr has joined #openstack-infra | 21:47 | |
| *** bknudson has joined #openstack-infra | 21:47 | |
| *** amitgandhinz has quit IRC | 21:47 | |
| *** pc_m has quit IRC | 21:48 | |
| *** mpopow has joined #openstack-infra | 21:49 | |
| *** mpopow has quit IRC | 21:50 | |
| thingee | anteaya: I sent an email to the third-party-announce list and got a bounce back for moderation approval. I did check my subscription list from the list's page and it shows me subscribed. | 21:53 |
| pleia2 | thingee: all mails are moderated | 21:54 |
| anteaya | I'll let it in | 21:54 |
| anteaya | thanks | 21:54 |
| thingee | pleia2: ah got it didn't realize, thanks | 21:54 |
| *** puranamr has quit IRC | 21:54 | |
| thingee | I won't bug further then :) | 21:54 |
| *** dannywil_ has quit IRC | 21:54 | |
| anteaya | thanks | 21:55 |
| whitenoise | jeblair: that looks like you are spinning up a RackSpace server in Dallas, is that accurate? | 21:56 |
| whitenoise | or is that "rax" something else | 21:56 |
| timrc | fungi, A break to cook dinner? What are these breaks and dinners you speak of? | 21:56 |
| fungi | whitenoise: yes | 21:56 |
| *** dannywilson has joined #openstack-infra | 21:56 | |
| whitenoise | fungi: I'm trying to learn more about openstack-infra. I'm just curious as to why RackSpace is the place of choice to spin up the testing infrastructure? | 21:56 |
| fungi | whitenoise: specifically we're starting to stash tracking metadata into nova for all our ephemeral worker instances | 21:56 |
| whitenoise | ah, i see | 21:57 |
| fungi | whitenoise: rackspace and hpcloud donate very large quotas to us for that purpose | 21:57 |
| whitenoise | i didn't know RackSpace was in the mix, that's good to know | 21:57 |
| *** bhuvan has quit IRC | 21:57 | |
| fungi | timrc: it's the solid form of hackerfuel | 21:57 |
| fungi | jeblair: okay, all alien nodes have been deleted except for a handful in hpcloud which fail nova delete with a 409 error ("Instance ... is locked") | 21:59 |
| *** hichihara has joined #openstack-infra | 21:59 | |
| *** mriedem is now known as mriedem_away | 21:59 | |
| *** hichihara has quit IRC | 21:59 | |
| *** hichihara has joined #openstack-infra | 22:00 | |
| *** annegentle has joined #openstack-infra | 22:00 | |
| fungi | jeblair: these are the offending four instance uuids, for reference http://paste.openstack.org/show/284579/ | 22:00 |
| *** mpopow has joined #openstack-infra | 22:00 | |
| *** puranamr has joined #openstack-infra | 22:00 | |
| *** doug-fish has left #openstack-infra | 22:01 | |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Update usage and options explanation in the README https://review.openstack.org/190837 | 22:02 |
| bexelbie | fungi, jeblair does the above look right in terms of being submitted correctly - I am not expecting a “review” | 22:03 |
| bexelbie | I just don’t want to do it twice more and not have done it right to begin with :D | 22:03 |
| *** baoli has quit IRC | 22:03 | |
| *** baoli has joined #openstack-infra | 22:03 | |
| bexelbie | kragniz, ^^ | 22:03 |
| fungi | bexelbie: yes, looks like a change for review to me | 22:04 |
| bexelbie | fungi, ty | 22:04 |
| fungi | bexelbie: also thanks for bearing with our horribly convoluted contribution workflow | 22:04 |
| fungi | it's remarkably convenient for high-volume contribution management, but not so convenient for casual contributors | 22:04 |
| bexelbie | fungi, I’d say I’ve seen worse — but mostly it has been things that are even with it | 22:04 |
| *** mpopow has quit IRC | 22:04 | |
| bexelbie | also a bit of it is personal issues as I am on a less than stellar machine at the moment - so I had a local git-review install problme | 22:05 |
| bexelbie | :D | 22:05 |
| *** bhunter71 has joined #openstack-infra | 22:05 | |
| jeblair | cool, not at the bottom, but room to improve :) | 22:05 |
| bexelbie | jeblair, ? | 22:05 |
| jeblair | heh, sorry, just meant i'm glad we didn't scare you off :) | 22:06 |
| openstackgerrit | Anita Kuno proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 22:06 |
| whitenoise | is this contribution process documented anywhere? | 22:06 |
| jeblair | whitenoise: http://docs.openstack.org/infra/manual/ | 22:06 |
| whitenoise | jeblair: gracias | 22:07 |
| jeblair | whitenoise: along with a whole host of other things: http://docs.openstack.org/infra/ | 22:07 |
| fungi | whitenoise: there's also some more general (not necessarily development workflow specific) contributor tips at https://wiki.openstack.org/wiki/How_To_Contribute | 22:07 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/" | 22:08 | |
| * whitenoise should have looked at the topic | 22:08 | |
| jeblair | speaking of which, that ^ got shorter! yay! | 22:08 |
| whitenoise | but thanks, i'll file these things away and read up this weekend | 22:08 |
| whitenoise | i hope to be doing some contributions soon! | 22:08 |
| *** baoli has quit IRC | 22:09 | |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Adding optional duration key for meetings https://review.openstack.org/190838 | 22:09 |
| bexelbie | jeblair, I am motivated .. for tonight :P | 22:09 |
| jeblair | whitenoise: me too! let us know what you're interested in once you get your bearings | 22:09 |
| fungi | bexelbie: it's addictive! | 22:09 |
| bexelbie | this isn’t my first rodeo :P | 22:10 |
| *** ivar-lazzaro has quit IRC | 22:11 | |
| fungi | nor mine, but i have to keep my rodeo clown license active | 22:12 |
| *** ivar-lazzaro has joined #openstack-infra | 22:13 | |
| asselin_ | fungi, hi...yeah busy day....no problem. We can try tomorrow if you like. | 22:13 |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Add project and agenda URLs to the bottom of calendar descriptions https://review.openstack.org/190841 | 22:15 |
| *** samuelBartel has quit IRC | 22:17 | |
| timrc | Quick question. I brought up a second Jenkins master with only one job and a static node attached to it with a custom node label. I added the master's fqdn to the zuul puppet config gearman_servers list and it seems to have gone as far as open the firewall because when I test the connection from the gearman Jenkins plugin, I get a success. But when I try to build the job I get back a "NOT_REGISTERED" so something is not quite right. Any ideas? | 22:18 |
| timrc | Is it possible to query geard to ask for what it thinks its workers are? | 22:19 |
| fungi | timrc: get the status output on zuul's gearman socket and look at what's registered? | 22:19 |
| timrc | fungi, Ah. | 22:19 |
| *** RichardRaseley has joined #openstack-infra | 22:20 | |
| *** hdd has joined #openstack-infra | 22:20 | |
| fungi | timrc: echo status|nc -q 3 localhost 4730 | 22:21 |
| fungi | or something like that | 22:21 |
| SpamapS | yep | 22:21 |
| *** dkehn_ has joined #openstack-infra | 22:21 | |
| *** EricGonczer_ has joined #openstack-infra | 22:22 | |
| timrc | Nice netcat to the rescue. That is a very handy command. | 22:22 |
| *** dkehn_ is now known as dkehnx | 22:22 | |
| *** ayoung has joined #openstack-infra | 22:22 | |
| *** annegentle has quit IRC | 22:23 | |
| *** jerryz has quit IRC | 22:24 | |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Adding optional duration key for meetings https://review.openstack.org/190838 | 22:24 |
| *** Sukhdev has quit IRC | 22:25 | |
| bexelbie | jeblair, have a second to talk about https://review.openstack.org/#/c/190841/1/yaml2ical/ical.py ? | 22:28 |
| jeblair | bexelbie: ya | 22:28 |
| bexelbie | jeblair, I am not normally a python programmer, so I am open to an alternative structure | 22:28 |
| jeblair | bexelbie: it looks like the line got cut off in a copy paste error or something? | 22:28 |
| bexelbie | oh ..well there is that too :P | 22:29 |
| jeblair | just sort of ends after "meeting.extras['a .... | 22:29 |
| * bexelbie really should have gone to bed an 2 hours ago :P | 22:29 | |
| bexelbie | fixing with an embarrassed grin | 22:29 |
| fungi | i am _totally_ up for switching to any programming language which can guess what i was going to type and finish my programs for me though | 22:29 |
| *** ddieterly has quit IRC | 22:30 | |
| *** ddieterly has joined #openstack-infra | 22:30 | |
| *** RichardRaseley has quit IRC | 22:32 | |
| timrc | My programming language of choice would be parsed on expletives. | 22:32 |
| fungi | timrc: have you seen python? | 22:32 |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Add project and agenda URLs to the bottom of calendar descriptions https://review.openstack.org/190841 | 22:33 |
| timrc | fungi, Oh yeah. I think they're implied there. :) | 22:33 |
| SpamapS | Shrews: https://storyboard.openstack.org/#!/story/2000228 <-- would you say that's done? | 22:33 |
| *** bnemec has quit IRC | 22:34 | |
| *** salv-orlando has quit IRC | 22:34 | |
| *** ddieterly has quit IRC | 22:35 | |
| *** EricGonczer_ has quit IRC | 22:36 | |
| *** teran_ has quit IRC | 22:36 | |
| *** jerryz has joined #openstack-infra | 22:36 | |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Adding optional duration key for meetings https://review.openstack.org/190838 | 22:36 |
| greghaynes | SpamapS: so on an pretty old tripleo, I nova boot something, ironic seems to be just hanging out with the associated node in power state OFF... im not missing something right? ironic is supposed to eventually kick it on and just go | 22:40 |
| greghaynes | SpamapS: (the tripleo is the hp1 tripleo) | 22:40 |
| *** puranamr has quit IRC | 22:40 | |
| SpamapS | greghaynes: yes definitely | 22:41 |
| greghaynes | hrm | 22:41 |
| SpamapS | greghaynes: check nova-compute and ironic-conductor logs | 22:41 |
| SpamapS | greghaynes: no ERROR state tho? | 22:41 |
| greghaynes | Yea, last thing ironic said was getting glance image metadata | 22:41 |
| greghaynes | SpamapS: no error... yet | 22:41 |
| SpamapS | greghaynes: it does that right before writing out PXE info and then twiddling hardware | 22:42 |
| SpamapS | greghaynes: do you have PXE bits in tftpboot for that port? | 22:42 |
| greghaynes | hrmm, actually, it just un-associated? | 22:43 |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Add project and agenda URLs to the bottom of calendar descriptions https://review.openstack.org/190841 | 22:44 |
| *** marun has joined #openstack-infra | 22:45 | |
| greghaynes | :/ | 22:45 |
| openstackgerrit | Brian Exelbierd proposed openstack-infra/yaml2ical: Update usage and options explanation in the README https://review.openstack.org/190837 | 22:46 |
| SpamapS | greghaynes: as in, the machine in ironic isn't attached to the instance anymore? | 22:47 |
| SpamapS | greghaynes: that might indicate that the power command timed out. | 22:47 |
| bexelbie | ok, enough channel spam from me - it is bed time .. anything else found tonight will be the result of lack of sleep .. bye | 22:47 |
| greghaynes | SpamapS: Yes, it had an instance uuid for a while, now it doesnt | 22:48 |
| greghaynes | I may also be doing some manual db editing to trick ironic into really deleting these nodes | 22:49 |
| *** geoffarnold has joined #openstack-infra | 22:49 | |
| *** bexelbie has quit IRC | 22:49 | |
| SpamapS | greghaynes: EVIL | 22:49 |
| SpamapS | greghaynes: I assume you're trying to get them all powered down so you can enroll them elsewhere? | 22:50 |
| greghaynes | oh hey, now it gives me the no valid host found | 22:50 |
| *** ams__ has quit IRC | 22:50 | |
| *** dimtruck is now known as zz_dimtruck | 22:50 | |
| greghaynes | SpamapS: just the ones that are stuck in wierd error deleting states and such, im deleting them, trying to make sure I can it ipmi, renrolling and trying to boot | 22:51 |
| SpamapS | greghaynes: because really what I'd like to do is focus on selecting our single-node-ironic and getting that bootstrapped rather than monkeying with all those other boxes. :) | 22:51 |
| greghaynes | SpamapS: sure, we could do that | 22:51 |
| *** jgrimm is now known as zz_jgrimm | 22:51 | |
| SpamapS | greghaynes: we can just run with a private hiera until we're ready to cede root to the greater infra team. :) | 22:51 |
| greghaynes | SpamapS: oh, well I am trying to do least effort possible to talk to all boxes | 22:52 |
| *** rlandy has quit IRC | 22:52 | |
| SpamapS | greghaynes: oh, ok, keep doing that, but perhaps pick one that you are comfortable with us taking over as the new hardware cloud box and then record that somewhere so we can work in parallel. | 22:52 |
| SpamapS | I want to start doing that like, tomorrow. | 22:53 |
| greghaynes | well, it might be less effort to setup a new ironic and enroll the hosts which arent currently up in it | 22:53 |
| jhesketh | Morning | 22:53 |
| *** hichihara has quit IRC | 22:53 | |
| greghaynes | rather than banging head against this very old setup and reverse engineering how its set up | 22:53 |
| SpamapS | greghaynes: yeah, thats kind of what I was thinking.. old ironic is kind of dusty.. ;) | 22:53 |
| nikeshm | asselin : thanks | 22:53 |
| * SpamapS must disappear for a little bit | 22:54 | |
| *** _cjones_ has quit IRC | 22:54 | |
| *** geoffarnold has quit IRC | 22:57 | |
| *** geoffarnold has joined #openstack-infra | 22:59 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: update openstack-product-team https://review.openstack.org/190419 | 23:00 |
| *** puranamr has joined #openstack-infra | 23:01 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add TC and cross-project meeting agenda urls https://review.openstack.org/190819 | 23:01 |
| openstackgerrit | Anita Kuno proposed openstack-infra/project-config: Rename stackforge/cookbook* to openstack/cookbook* https://review.openstack.org/186532 | 23:03 |
| anteaya | morning jhesketh | 23:03 |
| anteaya | jhesketh: congratulations | 23:03 |
| timrc | fungi, I don't see where the gearman status gives me information about the workers... I do see my job label and it looks correct, ie: build:my-job:my-node-label but the jenkins master which has a node defined with that label is not taking the job :( | 23:03 |
| *** krtaylor has quit IRC | 23:04 | |
| jeblair | timrc: what are the numbers after build:my-job:my-node-label ? | 23:05 |
| timrc | fungi, I do see connections to the gearman server from the second master, so it seems to be connecting just fine. My understanding is that there will be a worker per-node? I have a master node and this other node with the 'my-node-label' label and lsof -i shows me two connections back to the gearman server. | 23:05 |
| timrc | jeblair, 0 0 1 | 23:05 |
| *** teran has joined #openstack-infra | 23:05 | |
| *** puranamr has quit IRC | 23:06 | |
| jeblair | timrc: then i would go to zuul's debug log to see why it thought it was not registered. it's possible it was trying to run "build:my-job:different-node-label" or something. | 23:06 |
| *** ZZelle_ has quit IRC | 23:06 | |
| *** ayoung has quit IRC | 23:07 | |
| timrc | jeblair, Cool. I'll take a look. | 23:08 |
| timrc | jeblair, fungi Thanks, much. | 23:08 |
| *** fallenpegasus has quit IRC | 23:09 | |
| *** mkj_wk has quit IRC | 23:09 | |
| *** MarkAtwood has quit IRC | 23:10 | |
| *** mkj_wk has joined #openstack-infra | 23:10 | |
| *** sabeen1 has quit IRC | 23:11 | |
| *** puranamr has joined #openstack-infra | 23:11 | |
| *** markvoelker has quit IRC | 23:11 | |
| *** geoffarnold has quit IRC | 23:14 | |
| *** geoffarnold has joined #openstack-infra | 23:14 | |
| openstackgerrit | Clint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for weekly infra team meeting. https://review.openstack.org/190862 | 23:18 |
| *** Sukhdev has joined #openstack-infra | 23:19 | |
| jhesketh | anteaya: thanks :-) | 23:21 |
| *** marun has quit IRC | 23:21 | |
| anteaya | :) | 23:23 |
| anteaya | j^2: okay look at the difference between patchset 23 and 25: https://review.openstack.org/#/c/186532/24 | 23:23 |
| *** annegentle has joined #openstack-infra | 23:24 | |
| anteaya | j^2: do you understand what I did? | 23:24 |
| jhesketh | jeblair: and thanks to you and the rest of infra too, I'll post some keys shortly | 23:24 |
| j^2 | anteaya: looking | 23:24 |
| anteaya | j^2: thank you | 23:24 |
| j^2 | anteaya: ah! Perfect thank you! | 23:27 |
| j^2 | Makes perfect sense | 23:28 |
| pleia2 | great | 23:28 |
| *** ashleighfarnham has quit IRC | 23:28 | |
| pleia2 | anteaya: nice detective work on that one | 23:29 |
| *** annegentle has quit IRC | 23:29 | |
| jeblair | jhesketh: thank you :) | 23:29 |
| *** otter768 has joined #openstack-infra | 23:30 | |
| anteaya | j^2: oh good | 23:30 |
| anteaya | pleia2: thank you, thanks for your help on these | 23:30 |
| ianw | fungi / jeblair: so i got to the bottom of the centos7 panic issue; it is all queued up to be fixed in 7.2 . my plan is to put up the fixed kernel at people.redhat.com and install from there ... it would be nice to get some testing. sound ok? | 23:31 |
| pleia2 | sure thing | 23:31 |
| anteaya | j^2: now later, not now, you might consider creating a jenkins template for your unit style rake rake-integration jobs | 23:31 |
| anteaya | j^2: specs-jobs for example | 23:31 |
| j^2 | anteaya: awesome I'll take a note on it. | 23:31 |
| j^2 | Thanks for everyone's help | 23:32 |
| anteaya | j^2: thank you, just don't touch anything until after the rename is complete | 23:32 |
| j^2 | Noted | 23:32 |
| anteaya | thank you | 23:32 |
| *** EricGonczer_ has joined #openstack-infra | 23:33 | |
| *** wenlock has quit IRC | 23:33 | |
| anteaya | j^2: now that the jenkins jobs are passing, why do you have direct-release in the gerrit/projects.yaml file? | 23:33 |
| *** EricGonczer_ has quit IRC | 23:33 | |
| j^2 | I'm not sure. | 23:34 |
| j^2 | I thought it was all independent | 23:34 |
| *** otter768 has quit IRC | 23:34 | |
| *** chlong has joined #openstack-infra | 23:35 | |
| anteaya | I can never remember what direct-release is for in that file | 23:36 |
| anteaya | but I am fairly sure you don't need it | 23:36 |
| j^2 | I'll take a look when I'm back on my laptop | 23:36 |
| anteaya | j^2: do you have any objection to me taking it out? | 23:36 |
| j^2 | Ok. Thanks for the heads up | 23:36 |
| j^2 | None | 23:36 |
| anteaya | thank you | 23:36 |
| anteaya | can anyone think of any reason why the chef repos should have the direct-release option set in gerrit/projects.yaml? | 23:37 |
| anteaya | https://review.openstack.org/#/c/186532/25/gerrit/projects.yaml | 23:37 |
| jhesketh | jeblair: heh, I haven't broken it yet ;-) | 23:38 |
| anteaya | jhesketh: the day is young | 23:39 |
| crinkle | could I ask someone to review https://review.openstack.org/#/c/190839/ and tell me whether that's a sane approach to the beaker + depends-on problem? | 23:39 |
| * jhesketh promises to be careful but as a result will be slow to start | 23:39 | |
| crinkle | related to Fabien's question on https://review.openstack.org/#/c/184905/ | 23:39 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 23:39 | |
| *** EricGonczer_ has joined #openstack-infra | 23:39 | |
| jeblair | crinkle: we should use zuul-cloner | 23:41 |
| *** yamamoto has joined #openstack-infra | 23:41 | |
| jeblair | crinkle: the logic is really hard to get right (and be reliable) so we should just always use zuul-cloner to set up repos | 23:42 |
| crinkle | jeblair: does zuul-cloner automagically know what dependencies to clone if i give it --zuul-ref $ZUUL_REF ? | 23:44 |
| *** hemna is now known as hemnafk | 23:45 | |
| crinkle | jeblair: should this be done within spec_helper_acceptance.rb or somewhere at the infra layer? | 23:45 |
| jeblair | crinkle: no, it needs a list of repos | 23:45 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/system-config: Clarify requied log files and environment conf https://review.openstack.org/190866 | 23:45 |
| crinkle | jeblair: but then it can figure out which refs to fetch? | 23:45 |
| jeblair | crinkle: it looks like the current infra-puppet spec helper uses metadata.json to get them | 23:46 |
| jeblair | crinkle: correct, it takes care of the rest after that | 23:46 |
| crinkle | jeblair: okay, thank you | 23:46 |
| *** yamamoto has quit IRC | 23:47 | |
| *** EricGonczer_ has quit IRC | 23:47 | |
| openstackgerrit | Clint Adams proposed openstack-infra/irc-meetings: Add meeting_id and agenda_url for QA meetings https://review.openstack.org/190867 | 23:47 |
| jeblair | crinkle: i think we are expecting to run zuul-cloner on all the repos before running beaker; however, if the spec helper knows the list of modules it needs, it could be done there instead. | 23:48 |
| jeblair | crinkle: in general, i think infra-puppet and openstack-puppet can share a solution here; i think it's the same problem. | 23:49 |
| *** salv-orlando has joined #openstack-infra | 23:49 | |
| nibalizer | it is | 23:49 |
| crinkle | jeblair: where should that happen? in the jjb job? | 23:52 |
| *** salv-orlando has quit IRC | 23:53 | |
| nibalizer | I was looking at this earlier and I think either I don't understand the infra-beaker stuff or it isn't done yet | 23:54 |
| *** angela-s has quit IRC | 23:54 | |
| nibalizer | the spec_helper_acceptance is written as if it expects zuul-cloner to have ran, then moved those repos into /etc/puppet/modules with the right name | 23:55 |
| waynr | oh boy zuul did what i wanted it to do | 23:55 |
| nibalizer | but afaict that isn't being done | 23:55 |
| nibalizer | also we need to remove everything from /etc/puppet/modules before we start | 23:55 |
| jeblair | crinkle: yeah, i would expect it to run before starting beager, like in the puppet-apply job | 23:55 |
| jeblair | nibalizer: yeah, it's not done | 23:56 |
| *** hichihara has joined #openstack-infra | 23:56 | |
| anteaya | jeblair: what is the direct-release option for in project-config/gerrit/projects.yaml | 23:56 |
| *** shuoy has joined #openstack-infra | 23:56 | |
| nibalizer | jeblair: okay sweet so im not crazy | 23:57 |
| *** Swami has quit IRC | 23:57 | |
| nibalizer | i'd like to see a zuul-cloner-modules job maybe | 23:57 |
| nibalizer | to run after gerrit-git prep | 23:57 |
| *** camunoz is now known as camunoz_mtg | 23:58 | |
| jeblair | nibalizer: s/job/builder/ ? | 23:58 |
| *** rossella_s has quit IRC | 23:58 | |
| *** rossella_s has joined #openstack-infra | 23:58 | |
| nibalizer | ah yes builder | 23:59 |
| nibalizer | so infra has modules.env which provides a nice list in one place of every module to 'consider' | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!