| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: use six.moves.configparser https://review.openstack.org/323020 | 00:00 |
|---|---|---|
| Shrews | notmorgan: perhaps i've missed something, but that's not how i read the cStringIO docs at all | 00:00 |
| lakshmis | Need help with layout error: <type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'now' 2016-06-06 23:57:40.828 | ERROR: InvocationError: '/home/jenkins/workspace/gate-project-config-layout/.test/zuul/.tox/venv/bin/zuul-server -c etc/zuul.conf-sample -l ../../zuul/layout.yaml -t ../job-list.txt' | 00:00 |
| lakshmis | on https://review.openstack.org/#/c/326081 | 00:00 |
| lakshmis | how can i check where the error is in local testing? | 00:01 |
| notmorgan | Shrews: cStringIO.StringIO does not return the original encoded text, but the "representation of the Unicode string", which may differ from machine to machine: | 00:01 |
| notmorgan | Shrews: which is classically the difference between bytes and str in python 3, basically stringIO would be non-encoded (unicode) forms | 00:02 |
| notmorgan | Shrews: e.g. http://tuxpool.blogspot.com/2010/01/python-cstringio-vs-stringio.html | 00:02 |
| *** matrohon has joined #openstack-infra | 00:02 | |
| notmorgan | Shrews: i'm happy to use stirngIO but iirc when i tried that it was a lot more encode/decode needed | 00:03 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Replace missing builtins https://review.openstack.org/324205 | 00:03 |
| openstackgerrit | Dan Prince proposed openstack-infra/project-config: Revert "Migrate tripleo to centos-7" https://review.openstack.org/326182 | 00:03 |
| Shrews | notmorgan: ok. i'll withhold a vote then since i'm obviously not as familiar with those as you. just that the cStringIO docs doesn't make any of that clear | 00:04 |
| openstackgerrit | Merged openstack-infra/system-config: Update SSH key for pabelanger https://review.openstack.org/326169 | 00:04 |
| *** salv-orlando has quit IRC | 00:04 | |
| masayukig | It looks like https://etherpad.openstack.org doesn't work now. | 00:04 |
| *** thorst has quit IRC | 00:04 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: dict().iteritems no longer exists https://review.openstack.org/325620 | 00:04 |
| ianw | lakshmis: your error is above that "Job gate-python-searchlightclient-python27-searchlight-es2 not defined" | 00:04 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Bundled Fixes https://review.openstack.org/325661 | 00:04 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Update gear requirement https://review.openstack.org/326173 | 00:04 |
| *** ddieterly has joined #openstack-infra | 00:04 | |
| *** salv-orlando has joined #openstack-infra | 00:05 | |
| masayukig | Ah, it's ok now > etherpad | 00:05 |
| *** sdake_ has quit IRC | 00:05 | |
| *** _sarob has quit IRC | 00:05 | |
| lakshmis | thanks ianw | 00:05 |
| Shrews | notmorgan: did you read the bug at the end of that blog post? http://bugs.python.org/issue2387 | 00:05 |
| notmorgan | Shrews: yeah | 00:05 |
| fungi | masayukig: nightly (midnight utc) database backups | 00:05 |
| notmorgan | Shrews: everything i saw (barring that bug) showed cStringIO -> BytesIO as the right path | 00:06 |
| masayukig | fungi: oh, I see. I'm a lucky man :) | 00:06 |
| fungi | masayukig: we're planning to look into whether we can leverage trove replication to do our off-site database backups without impacting production, but we haven't had time yet | 00:06 |
| Shrews | notmorgan: it basically encapsulates my confusion. <3 interwebs | 00:06 |
| notmorgan | Shrews: the issue is that python (still) sucks horribly at string vs byte_string :( | 00:06 |
| notmorgan | Shrews: and python 3 didn't really make it any better. | 00:06 |
| notmorgan | just made it a bit more consistently bad. | 00:07 |
| notmorgan | vs wildly inconsistently bad. | 00:07 |
| fungi | well, python 3 _does_ make it possible not to have to care about unicode vs string representation and encoding/decoding in some cases where you had to care in 2.x | 00:08 |
| masayukig | wow, the no-down-time sounds nice. | 00:08 |
| notmorgan | fungi: yeah, like i said, consistently bad ;) | 00:09 |
| fungi | but there are still plenty of places even with python 3 where you still have to care | 00:09 |
| notmorgan | fungi: and unfortunately a ton of the infra stuff is "where we need to care" | 00:09 |
| fungi | notmorgan: right. for example, they did little to improve the situation for people writing or interacting with low-level protocols (especially network protocols) | 00:10 |
| fungi | if anything, they made that somewhat more complicated | 00:10 |
| notmorgan | fungi: yup. | 00:10 |
| notmorgan | fungi: i really would have been happy if they had addressed that. | 00:10 |
| fungi | but also set somewhat clearer expectations with it | 00:11 |
| fungi | (stringio documentation shortcomings aside) | 00:11 |
| notmorgan | fungi: python is one of the few languages that i work with that makes this exceptionally trying. | 00:11 |
| fungi | yep, in ways which c made not particularly complicated as long as you _didn't_ care about text encoding | 00:13 |
| notmorgan | fungi: at least we can set a barrier in most cases and handle the encode/decode at the edge of the librar(ies) protocols more easily now. | 00:13 |
| notmorgan | fungi: do you want to do bindep as "py3 fix", "non-vote py3 job", "py3 classifiers", "py3 vote job"? | 00:14 |
| anteaya | pabelanger: so you see that tripleo wants to revert the move to centos-7? | 00:14 |
| *** gildub has joined #openstack-infra | 00:14 | |
| notmorgan | fungi: or is it reasonable to do fixes then py3 vote directly as I have it? | 00:14 |
| fungi | notmorgan: i'd even be fine merging the job to turn on voting py3 job, then merge your fixes as the next change | 00:16 |
| pabelanger | anteaya: I have not. I'd prefer not to revert if possible. I know they were having some issues with their local gearman server | 00:16 |
| fungi | notmorgan: it's a low-churn repo and that makes for less work | 00:17 |
| pabelanger | anteaya: I'll look at the review shortly and see if we can get logs to see what the actual issue is | 00:17 |
| anteaya | pabelanger: awesome, do you want to reply to the mailing list to that effect? | 00:17 |
| notmorgan | fungi: i can remove the dep-on if you'd like or just let it sit | 00:17 |
| notmorgan | fungi: happy either way | 00:17 |
| anteaya | pabelanger: awesome, thank you | 00:17 |
| dims | fungi : clarkb : when you get a chance..need some stuff for pykerberos to build in CI https://review.openstack.org/#/c/325658/ - please take a look | 00:17 |
| notmorgan | bindep was not bad as a conversion fwiw. | 00:17 |
| pabelanger | anteaya: I have to step away for a bit, but will try to do so tonight | 00:17 |
| anteaya | pabelanger: awesome, enjoy your next | 00:18 |
| *** amotoki has joined #openstack-infra | 00:18 | |
| fungi | notmorgan: yeah, i assumed it was pretty close, just the mox to mock conversion was giving me fits and i got sidetracked by other things before i got particularly far | 00:18 |
| fungi | notmorgan: i'll just review what you have already and then we'll assess what's still needed, if anything | 00:19 |
| notmorgan | sounds good to me, :) | 00:19 |
| *** markvoelker has joined #openstack-infra | 00:20 | |
| *** EricGonczer_ has joined #openstack-infra | 00:22 | |
| *** gildub has quit IRC | 00:23 | |
| *** markvoelker has quit IRC | 00:25 | |
| lakshmis | ianw: don't look into it if it's not obivious, but i have the job defined in https://review.openstack.org/#/c/326081/1/jenkins/jobs/searchlight.yaml Still the error complains about it. anything silly i am missing? | 00:25 |
| ianw | lakshmis: so it looks like you've made the template, but not instantiated that to a job. you want to add it to jenkins/jobs/projects.yaml | 00:27 |
| *** sputnik13 has quit IRC | 00:27 | |
| lakshmis | thanks | 00:28 |
| *** gouthamr_ has joined #openstack-infra | 00:28 | |
| *** pvaneck has quit IRC | 00:30 | |
| *** gouthamr has quit IRC | 00:32 | |
| *** mtanino has quit IRC | 00:34 | |
| *** sdake has joined #openstack-infra | 00:38 | |
| *** sdake has quit IRC | 00:38 | |
| *** sdake has joined #openstack-infra | 00:38 | |
| *** r-daneel has quit IRC | 00:39 | |
| *** SumitNaiksatam has left #openstack-infra | 00:41 | |
| *** Sukhdev has quit IRC | 00:42 | |
| *** amitgandhinz has joined #openstack-infra | 00:42 | |
| *** jerryz has quit IRC | 00:43 | |
| *** amitgandhinz has quit IRC | 00:47 | |
| *** EricGonczer_ has quit IRC | 00:50 | |
| *** horusdev has joined #openstack-infra | 00:51 | |
| *** salv-orlando has quit IRC | 00:53 | |
| *** salv-orlando has joined #openstack-infra | 00:54 | |
| *** xarses has joined #openstack-infra | 00:54 | |
| *** thorst has joined #openstack-infra | 00:56 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Release notes for 1.17.0 https://review.openstack.org/326191 | 00:57 |
| *** thorst has quit IRC | 00:58 | |
| *** thorst has joined #openstack-infra | 00:58 | |
| openstackgerrit | Merged openstack/diskimage-builder: Cleanup source-repositories output https://review.openstack.org/321961 | 00:59 |
| openstackgerrit | Merged openstack/diskimage-builder: Refactor: rename temporary directories https://review.openstack.org/325053 | 00:59 |
| *** Daisy has joined #openstack-infra | 01:00 | |
| openstackgerrit | Merged openstack/diskimage-builder: Export die() function https://review.openstack.org/321892 | 01:00 |
| openstackgerrit | Merged openstack/diskimage-builder: Handle file magic type varying order matching https://review.openstack.org/321126 | 01:00 |
| openstackgerrit | Merged openstack/diskimage-builder: Export FS_TYPE and remove hardcoded ext4 values https://review.openstack.org/318400 | 01:01 |
| openstackgerrit | Merged openstack/diskimage-builder: Add release to pkg-map https://review.openstack.org/319049 | 01:01 |
| openstackgerrit | Merged openstack/diskimage-builder: Refactor: remove unused functions https://review.openstack.org/324792 | 01:01 |
| *** banix has quit IRC | 01:02 | |
| *** zhurong has joined #openstack-infra | 01:03 | |
| *** Sukhdev has joined #openstack-infra | 01:03 | |
| *** Sukhdev has quit IRC | 01:04 | |
| *** shashank_hegde has quit IRC | 01:04 | |
| *** thorst has quit IRC | 01:07 | |
| *** lakshmis has quit IRC | 01:07 | |
| *** horusdev has left #openstack-infra | 01:07 | |
| *** harlowja has joined #openstack-infra | 01:08 | |
| *** amotoki has quit IRC | 01:08 | |
| *** pahuang has quit IRC | 01:10 | |
| *** anteaya has quit IRC | 01:10 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add PS4 to show file/function/line in debug output https://review.openstack.org/317260 | 01:14 |
| openstackgerrit | Merged openstack/diskimage-builder: Add cloud-initramfs-growroot for Precise https://review.openstack.org/318461 | 01:14 |
| *** Goneri has joined #openstack-infra | 01:14 | |
| *** piet has quit IRC | 01:15 | |
| *** gildub has joined #openstack-infra | 01:15 | |
| *** yanyanhu has joined #openstack-infra | 01:17 | |
| *** jasondotstar has quit IRC | 01:18 | |
| *** tqtran has quit IRC | 01:19 | |
| *** sflanigan has quit IRC | 01:19 | |
| *** Goneri has quit IRC | 01:20 | |
| *** kzaitsev_mb has quit IRC | 01:26 | |
| *** pahuang has joined #openstack-infra | 01:26 | |
| *** Apoorva_ has joined #openstack-infra | 01:29 | |
| *** hongbin has joined #openstack-infra | 01:30 | |
| *** Apoorva has quit IRC | 01:32 | |
| *** sflanigan has joined #openstack-infra | 01:32 | |
| *** Apoorva_ has quit IRC | 01:33 | |
| *** ddieterly has quit IRC | 01:34 | |
| *** Qiming_ has joined #openstack-infra | 01:34 | |
| *** amotoki has joined #openstack-infra | 01:35 | |
| *** fitoduarte has quit IRC | 01:37 | |
| *** fitoduarte has joined #openstack-infra | 01:38 | |
| *** EricGonczer_ has joined #openstack-infra | 01:38 | |
| *** r-mibu has quit IRC | 01:42 | |
| *** SumitNaiksatam has joined #openstack-infra | 01:42 | |
| *** amitgandhinz has joined #openstack-infra | 01:43 | |
| *** tphummel has quit IRC | 01:44 | |
| *** zz_dimtruck is now known as dimtruck | 01:45 | |
| *** Qiming_ has quit IRC | 01:46 | |
| *** amitgandhinz has quit IRC | 01:47 | |
| *** sdake has quit IRC | 01:50 | |
| *** yamahata has quit IRC | 01:51 | |
| *** hongbin has quit IRC | 01:52 | |
| *** rockyg has joined #openstack-infra | 01:55 | |
| *** r-mibu has joined #openstack-infra | 01:57 | |
| *** banix has joined #openstack-infra | 01:59 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Remove dib-buildimage-debian-ironic post job https://review.openstack.org/326203 | 01:59 |
| *** PollyZ has joined #openstack-infra | 01:59 | |
| *** amotoki has quit IRC | 02:00 | |
| openstackgerrit | Goutham Pacha Ravi proposed openstack-infra/project-config: Add releasenotes job for manila-ui https://review.openstack.org/320718 | 02:03 |
| *** banix has quit IRC | 02:03 | |
| *** thorst has joined #openstack-infra | 02:05 | |
| *** banix has joined #openstack-infra | 02:05 | |
| *** sdake has joined #openstack-infra | 02:11 | |
| *** thorst has quit IRC | 02:12 | |
| *** EricGonczer_ has quit IRC | 02:12 | |
| *** amotoki has joined #openstack-infra | 02:12 | |
| *** rm_work has quit IRC | 02:16 | |
| *** sdake_ has joined #openstack-infra | 02:18 | |
| *** sdake has quit IRC | 02:20 | |
| *** PollyZ has quit IRC | 02:20 | |
| *** markvoelker has joined #openstack-infra | 02:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:21 | |
| *** markvoelker has quit IRC | 02:26 | |
| *** jamielennox is now known as jamielennox|away | 02:27 | |
| *** rockyg has quit IRC | 02:29 | |
| *** hongbin has joined #openstack-infra | 02:31 | |
| *** binbincong has quit IRC | 02:34 | |
| *** banix has quit IRC | 02:34 | |
| *** jamielennox|away is now known as jamielennox | 02:35 | |
| openstackgerrit | Merged openstack/diskimage-builder: Release notes for 1.17.0 https://review.openstack.org/326191 | 02:36 |
| notmorgan | jeblair: working on the six.reraise patchset, i think if we fix it to use the exc_info as you outlined, it will save the need to special case later in the patch-chain. | 02:38 |
| *** sflanigan has quit IRC | 02:38 | |
| *** amitgandhinz has joined #openstack-infra | 02:44 | |
| *** vsaienko has joined #openstack-infra | 02:45 | |
| *** amitgandhinz has quit IRC | 02:48 | |
| *** binbincong has joined #openstack-infra | 02:50 | |
| *** david-lyle has quit IRC | 02:50 | |
| *** david-lyle has joined #openstack-infra | 02:50 | |
| *** yuanying_ has joined #openstack-infra | 02:51 | |
| *** yuanying has quit IRC | 02:51 | |
| *** sflanigan has joined #openstack-infra | 02:51 | |
| *** sflanigan has joined #openstack-infra | 02:51 | |
| *** matrohon has quit IRC | 02:51 | |
| *** yamamoto_ has quit IRC | 02:51 | |
| *** flepied has joined #openstack-infra | 02:52 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use six.reraise https://review.openstack.org/323015 | 02:53 |
| *** flepied has quit IRC | 02:53 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use bytesIO instead of cStringIO https://review.openstack.org/323016 | 02:54 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use proper octal notation https://review.openstack.org/323017 | 02:54 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: Absolute Imports https://review.openstack.org/323018 | 02:54 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: use six.moves.configparser https://review.openstack.org/323020 | 02:54 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Allow to set Ironic provision timeout from the job https://review.openstack.org/315496 | 02:55 |
| *** rm_work has joined #openstack-infra | 02:56 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Higgins: enable voting for dsvm job https://review.openstack.org/326214 | 02:59 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Replace missing builtins https://review.openstack.org/324205 | 03:01 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: dict().iteritems no longer exists https://review.openstack.org/325620 | 03:02 |
| *** amrith is now known as _amrith_ | 03:06 | |
| *** rm_work has quit IRC | 03:07 | |
| *** pahuang has quit IRC | 03:09 | |
| vsaienko | hello infra team, please review https://review.openstack.org/#/c/315545 The patch increase provision/unprovision tempest timeouts for ironic grenade jobs. | 03:09 |
| *** thorst has joined #openstack-infra | 03:10 | |
| *** rm_work has joined #openstack-infra | 03:11 | |
| *** kzaitsev_mb has quit IRC | 03:12 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Bundled Fixes https://review.openstack.org/325661 | 03:16 |
| *** Daisy has quit IRC | 03:16 | |
| *** Daisy has joined #openstack-infra | 03:17 | |
| *** thorst has quit IRC | 03:17 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 fix: Use six.reraise https://review.openstack.org/321926 | 03:17 |
| *** tlian has quit IRC | 03:17 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fixes: Use of bytes as appropriate https://review.openstack.org/322356 | 03:18 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fix: round() behaves differently in py3 https://review.openstack.org/322530 | 03:18 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Update gear requirement https://review.openstack.org/326172 | 03:18 |
| *** pahuang has joined #openstack-infra | 03:21 | |
| *** Daisy_ has joined #openstack-infra | 03:24 | |
| *** Daisy has quit IRC | 03:28 | |
| *** Daisy_ has quit IRC | 03:28 | |
| *** sarob has joined #openstack-infra | 03:28 | |
| *** Daisy has joined #openstack-infra | 03:29 | |
| *** Daisy_ has joined #openstack-infra | 03:30 | |
| *** Daisy has quit IRC | 03:34 | |
| *** Daisy_ has quit IRC | 03:35 | |
| *** sdake_ has quit IRC | 03:38 | |
| *** yamamoto_ has joined #openstack-infra | 03:39 | |
| *** jamielennox is now known as jamielennox|away | 03:44 | |
| *** amitgandhinz has joined #openstack-infra | 03:44 | |
| *** yamada-h has joined #openstack-infra | 03:48 | |
| *** amitgandhinz has quit IRC | 03:49 | |
| *** shashank_hegde has joined #openstack-infra | 03:52 | |
| *** links has joined #openstack-infra | 03:56 | |
| *** flepied has joined #openstack-infra | 03:59 | |
| *** jamielennox|away is now known as jamielennox | 03:59 | |
| *** sshnaidm|afk has quit IRC | 03:59 | |
| *** hongbin has quit IRC | 04:01 | |
| *** yamada-h has quit IRC | 04:02 | |
| *** yamada-h has joined #openstack-infra | 04:04 | |
| *** yamahata has joined #openstack-infra | 04:04 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:08 | |
| *** woodster_ has quit IRC | 04:08 | |
| *** fitoduarte has quit IRC | 04:09 | |
| *** pcaruana has joined #openstack-infra | 04:11 | |
| *** pahuang has quit IRC | 04:11 | |
| *** shashank_hegde has quit IRC | 04:12 | |
| *** kzaitsev_mb has quit IRC | 04:13 | |
| *** shashank_hegde has joined #openstack-infra | 04:13 | |
| *** thorst has joined #openstack-infra | 04:15 | |
| *** gouthamr_ has quit IRC | 04:16 | |
| *** dimtruck is now known as zz_dimtruck | 04:18 | |
| *** Daisy has joined #openstack-infra | 04:18 | |
| *** yuanying_ has quit IRC | 04:18 | |
| *** yuanying has joined #openstack-infra | 04:21 | |
| *** psilvad has quit IRC | 04:21 | |
| *** markvoelker has joined #openstack-infra | 04:22 | |
| *** thorst has quit IRC | 04:22 | |
| *** pahuang has joined #openstack-infra | 04:24 | |
| *** pcaruana has quit IRC | 04:24 | |
| *** salv-orl_ has joined #openstack-infra | 04:25 | |
| *** markvoelker has quit IRC | 04:26 | |
| *** salv-orlando has quit IRC | 04:27 | |
| *** shashank_hegde has quit IRC | 04:29 | |
| *** shashank_hegde has joined #openstack-infra | 04:29 | |
| *** _sarob has joined #openstack-infra | 04:30 | |
| *** psachin has joined #openstack-infra | 04:31 | |
| *** sarob_ has joined #openstack-infra | 04:32 | |
| *** mdrabe has joined #openstack-infra | 04:33 | |
| *** sarob has quit IRC | 04:33 | |
| *** pcaruana has joined #openstack-infra | 04:34 | |
| *** _sarob has quit IRC | 04:35 | |
| *** sarob has joined #openstack-infra | 04:35 | |
| *** flepied has quit IRC | 04:36 | |
| *** sarob_ has quit IRC | 04:38 | |
| *** pcaruana has quit IRC | 04:40 | |
| *** mixos has joined #openstack-infra | 04:40 | |
| *** sflanigan has quit IRC | 04:43 | |
| *** aeng has quit IRC | 04:43 | |
| *** _sarob has joined #openstack-infra | 04:45 | |
| *** amitgandhinz has joined #openstack-infra | 04:45 | |
| *** sarob_ has joined #openstack-infra | 04:48 | |
| *** sarob has quit IRC | 04:48 | |
| *** _sarob has quit IRC | 04:49 | |
| *** amitgandhinz has quit IRC | 04:50 | |
| *** Daisy has quit IRC | 04:52 | |
| *** mdrabe has quit IRC | 04:52 | |
| *** yamada-h has quit IRC | 04:53 | |
| *** yamada-h has joined #openstack-infra | 04:54 | |
| *** sflanigan has joined #openstack-infra | 04:59 | |
| *** sflanigan has joined #openstack-infra | 04:59 | |
| *** flwang1 has quit IRC | 05:00 | |
| *** aeng has joined #openstack-infra | 05:00 | |
| *** shashank_hegde has quit IRC | 05:00 | |
| *** shashank_hegde has joined #openstack-infra | 05:01 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move pkg-map to dib-python https://review.openstack.org/326228 | 05:02 |
| *** jaosorior has joined #openstack-infra | 05:05 | |
| *** oanson has joined #openstack-infra | 05:09 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:09 | |
| *** vsaienko has quit IRC | 05:11 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fix: round() behaves differently in py3 https://review.openstack.org/322530 | 05:11 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Update gear requirement https://review.openstack.org/326172 | 05:11 |
| *** Daisy has joined #openstack-infra | 05:13 | |
| *** kzaitsev_mb has quit IRC | 05:14 | |
| openstackgerrit | Jeff Grafton proposed openstack-infra/jenkins-job-builder: Add flaky test report and allow empty options to JUnit publisher https://review.openstack.org/321305 | 05:14 |
| *** Daisy has quit IRC | 05:14 | |
| *** Daisy has joined #openstack-infra | 05:15 | |
| *** yamada-h has quit IRC | 05:17 | |
| *** abregman has joined #openstack-infra | 05:19 | |
| *** Sukhdev has joined #openstack-infra | 05:21 | |
| *** thorst has joined #openstack-infra | 05:22 | |
| *** markvoelker has joined #openstack-infra | 05:23 | |
| *** sarob_ has quit IRC | 05:25 | |
| *** pt_15 has quit IRC | 05:26 | |
| *** markvoelker has quit IRC | 05:27 | |
| *** thorst has quit IRC | 05:28 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fix: round() behaves differently in py3 https://review.openstack.org/322530 | 05:29 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Update gear requirement https://review.openstack.org/326172 | 05:29 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 fix: Use six.reraise https://review.openstack.org/321926 | 05:29 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 Fix: Use six.StringIO https://review.openstack.org/326230 | 05:29 |
| *** yamada-h has joined #openstack-infra | 05:30 | |
| *** itisha has quit IRC | 05:30 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Introduce `exit` phase https://review.openstack.org/324811 | 05:31 |
| *** hdaniel has joined #openstack-infra | 05:31 | |
| *** isaacb has joined #openstack-infra | 05:33 | |
| *** Daisy_ has joined #openstack-infra | 05:33 | |
| *** kaisers1 has left #openstack-infra | 05:33 | |
| *** shashank_hegde has quit IRC | 05:33 | |
| *** savihou has joined #openstack-infra | 05:36 | |
| *** rcernin has joined #openstack-infra | 05:36 | |
| *** yamahata has quit IRC | 05:36 | |
| *** Daisy has quit IRC | 05:36 | |
| *** yamahata has joined #openstack-infra | 05:37 | |
| *** sree has joined #openstack-infra | 05:39 | |
| *** salv-orl_ has quit IRC | 05:40 | |
| *** salv-orlando has joined #openstack-infra | 05:40 | |
| *** Sukhdev has quit IRC | 05:41 | |
| *** Sukhdev has joined #openstack-infra | 05:41 | |
| *** amitgandhinz has joined #openstack-infra | 05:46 | |
| *** Daisy_ has quit IRC | 05:48 | |
| *** Daisy has joined #openstack-infra | 05:48 | |
| *** amitgandhinz has quit IRC | 05:50 | |
| *** jaosorior has quit IRC | 05:52 | |
| *** Daisy has quit IRC | 05:53 | |
| *** jaosorior has joined #openstack-infra | 05:53 | |
| *** gildub has quit IRC | 05:55 | |
| *** roxanaghe has joined #openstack-infra | 05:57 | |
| *** roxanaghe has quit IRC | 05:58 | |
| *** gildub has joined #openstack-infra | 06:00 | |
| *** oanson has quit IRC | 06:03 | |
| *** vsaienko1 has left #openstack-infra | 06:03 | |
| *** vsaienko1 has joined #openstack-infra | 06:03 | |
| *** sflanigan_ has joined #openstack-infra | 06:05 | |
| *** sflanigan_ has joined #openstack-infra | 06:05 | |
| *** sflanigan has quit IRC | 06:05 | |
| *** aeng has quit IRC | 06:05 | |
| *** gyee has quit IRC | 06:05 | |
| *** bhavik has joined #openstack-infra | 06:06 | |
| *** sflanigan_ is now known as sflanigan | 06:06 | |
| *** jaosorior has quit IRC | 06:06 | |
| *** larainema has quit IRC | 06:07 | |
| *** jaosorior has joined #openstack-infra | 06:07 | |
| *** larainema has joined #openstack-infra | 06:08 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:09 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Add python logger configuration https://review.openstack.org/325409 | 06:10 |
| *** jaosorior has quit IRC | 06:11 | |
| *** jaosorior has joined #openstack-infra | 06:12 | |
| *** kzaitsev_mb has quit IRC | 06:14 | |
| openstackgerrit | Madhuri Kumari proposed openstack-infra/project-config: Add new project Zunclient to openstack repo https://review.openstack.org/317699 | 06:15 |
| *** isaacb has quit IRC | 06:18 | |
| *** Daisy has joined #openstack-infra | 06:18 | |
| *** gongysh has joined #openstack-infra | 06:18 | |
| *** aeng has joined #openstack-infra | 06:18 | |
| *** jaosorior has quit IRC | 06:21 | |
| *** nadya has joined #openstack-infra | 06:21 | |
| *** jaosorior has joined #openstack-infra | 06:24 | |
| *** thorst has joined #openstack-infra | 06:25 | |
| *** ramishra has quit IRC | 06:27 | |
| *** ramishra has joined #openstack-infra | 06:28 | |
| *** liusheng has quit IRC | 06:28 | |
| *** hdaniel has quit IRC | 06:28 | |
| *** vsaienko1 has quit IRC | 06:29 | |
| *** thorst has quit IRC | 06:32 | |
| *** ramishra has quit IRC | 06:35 | |
| *** ramishra has joined #openstack-infra | 06:36 | |
| *** gildub has quit IRC | 06:37 | |
| *** nadya has quit IRC | 06:40 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Higgins: enable voting for dsvm job https://review.openstack.org/326214 | 06:42 |
| *** ccamacho|afk has quit IRC | 06:42 | |
| *** shashank_hegde has joined #openstack-infra | 06:42 | |
| *** amitgandhinz has joined #openstack-infra | 06:47 | |
| *** jtomasek has joined #openstack-infra | 06:48 | |
| jaosorior | AJaeger: if you have time could you take a look at https://review.openstack.org/#/c/326182/ ? TripleO's CI is looking quite red at the moment :/ | 06:50 |
| AJaeger | jaosorior: why didn't we notice that earlier in testing? | 06:51 |
| *** ccamacho has joined #openstack-infra | 06:51 | |
| *** amitgandhinz has quit IRC | 06:51 | |
| AJaeger | jaosorior: +2A to unblock tripleo... | 06:52 |
| jaosorior | AJaeger: I have no idea. I remember the tests that paul was doing were looking quite OK. So it came as quite a surprise | 06:52 |
| AJaeger | jaosorior: please discuss with pabelanger on to move forward on this once pabelanger is awake | 06:52 |
| *** andreas_s has joined #openstack-infra | 06:52 | |
| *** Daisy has quit IRC | 06:52 | |
| jaosorior | AJaeger: will do. Thanks for the quick response and for helping out | 06:53 |
| *** Daisy has joined #openstack-infra | 06:53 | |
| AJaeger | jaosorior: you're welcome! | 06:53 |
| AJaeger | ianw: do you know why the dib gate now fails for project-config? See https://review.openstack.org/315545 | 06:58 |
| *** roxanaghe has joined #openstack-infra | 06:58 | |
| *** nadya has joined #openstack-infra | 06:59 | |
| *** jaosorior has quit IRC | 07:00 | |
| *** jaosorior has joined #openstack-infra | 07:00 | |
| *** jaosorior has quit IRC | 07:01 | |
| AJaeger | jaosorior: the tripleo reversal will not merge ;( We currently have a failing gate in project-config. Hope a dib experts can help fix it... | 07:02 |
| *** roxanaghe has quit IRC | 07:03 | |
| *** salv-orlando has quit IRC | 07:04 | |
| *** salv-orlando has joined #openstack-infra | 07:05 | |
| *** Sukhdev has quit IRC | 07:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:10 | |
| AJaeger | #status log All project-config jobs fail - the dib gate is broken. | 07:12 |
| openstackstatus | AJaeger: finished logging | 07:12 |
| *** zeih has joined #openstack-infra | 07:14 | |
| *** kzaitsev_mb has quit IRC | 07:16 | |
| *** vsaienko has joined #openstack-infra | 07:16 | |
| vsaienko | hello infra-team, AJaeger! | 07:16 |
| vsaienko | can you help, I don't understand why project-config-dib is failing http://logs.openstack.org/45/315545/6/check/gate-project-config-dib/95b1cbf/console.html#_2016-06-07_07_11_00_417947 | 07:17 |
| AJaeger | vsaienko: I don't know either - we need help from diskimage-builder experts ;( | 07:18 |
| AJaeger | vsaienko: Please wait until this is solved, nothing for you to do right now | 07:18 |
| *** shardy has joined #openstack-infra | 07:21 | |
| vsaienko | AJeager: thank you, it looks the following commit break the job https://github.com/openstack/diskimage-builder/commit/5f4cac330320d7470463370a4b54fae285753b74 | 07:23 |
| *** matrohon has joined #openstack-infra | 07:23 | |
| *** vincentll has joined #openstack-infra | 07:23 | |
| *** markvoelker has joined #openstack-infra | 07:23 | |
| frickler | vsaienko: AJaeger: yeah, either revert https://review.openstack.org/303227 or add some more dib-lint tags | 07:24 |
| *** e0ne has joined #openstack-infra | 07:24 | |
| *** jaosorior has joined #openstack-infra | 07:24 | |
| vsaienko | frickler, AJeager I think we need to have the same voting job project-config-dib for disk-image-builder commits to avoid such cases. For now we only can exclude 1.17.0 release (( | 07:25 |
| vsaienko | since dib is installed from pypi | 07:26 |
| *** nadya has quit IRC | 07:26 | |
| *** Daisy_ has joined #openstack-infra | 07:27 | |
| frickler | vsaienko: I'm trying to put up a patch that should fix the errors, I see only two warnings in the log above | 07:27 |
| *** markvoelker has quit IRC | 07:28 | |
| *** dtantsur|afk is now known as dtantsur | 07:28 | |
| openstackgerrit | lvdongbing proposed openstack-infra/irc-meetings: Add the Biling team meeting https://review.openstack.org/326271 | 07:28 |
| *** zqfan has joined #openstack-infra | 07:28 | |
| *** mikelk has joined #openstack-infra | 07:29 | |
| *** abregman_ has joined #openstack-infra | 07:29 | |
| dtantsur | yeah, I think fixing the warning is a way to go actually (morning everyone) | 07:29 |
| *** abregman_ has quit IRC | 07:29 | |
| *** thorst has joined #openstack-infra | 07:30 | |
| *** abregman_ has joined #openstack-infra | 07:30 | |
| *** hdaniel has joined #openstack-infra | 07:30 | |
| *** arxcruz has joined #openstack-infra | 07:31 | |
| *** Daisy has quit IRC | 07:31 | |
| *** abregman has quit IRC | 07:32 | |
| openstackgerrit | Jens Rosenboom proposed openstack-infra/project-config: Add dib-lint tags to sudo calls https://review.openstack.org/326273 | 07:32 |
| frickler | ^^ lets see what the check says about this one | 07:33 |
| *** amoralej|off is now known as amoralej | 07:33 | |
| AJaeger | thanks, frickler | 07:33 |
| AJaeger | ianw: could you check 326273, please? | 07:33 |
| *** jlanoux has joined #openstack-infra | 07:34 | |
| *** jed56 has joined #openstack-infra | 07:34 | |
| *** ramishra has quit IRC | 07:36 | |
| *** thorst has quit IRC | 07:37 | |
| *** sarob has joined #openstack-infra | 07:37 | |
| frickler | http://logs.openstack.org/73/326273/1/check/gate-project-config-dib/b52d2bd/console.html says it is fine. the change is the logical extension of https://review.openstack.org/#/c/303227/2/elements/source-repositories/extra-data.d/98-source-repositories I would think | 07:37 |
| openstackgerrit | lvdongbing proposed openstack-infra/irc-meetings: Add the Bilean team meeting https://review.openstack.org/326271 | 07:38 |
| *** rossella_s has joined #openstack-infra | 07:38 | |
| *** ramishra has joined #openstack-infra | 07:38 | |
| *** liusheng has joined #openstack-infra | 07:40 | |
| *** nmagnezi has joined #openstack-infra | 07:41 | |
| *** sarob has quit IRC | 07:42 | |
| acabot | AJaeger : hi, I'm looking for a doc to host my project documentation on docs.openstack.org | 07:42 |
| *** ihrachys has joined #openstack-infra | 07:42 | |
| AJaeger | acabot: which project? | 07:42 |
| acabot | AJaeger : Watcher | 07:43 |
| acabot | AJaeger : today we use our own hosting solution but I'd like to move to docs.openstack.org as we are now an official project | 07:43 |
| AJaeger | acabot: sure. Use openstack-server-publish-jobs in zuul/layout.yaml and openstack-publish-jobs together with "doc-publisher-site: docs.openstack.org" in jenkins/job/projects.yaml | 07:44 |
| acabot | AJaeger : great thx, I will do it | 07:45 |
| AJaeger | Check as an example how anchor does it. | 07:45 |
| acabot | ok | 07:45 |
| AJaeger | The ifnra jobs will use the "venv" tox environment for publishing. | 07:45 |
| AJaeger | But that should work since you build the docs already as part of python-jobs | 07:45 |
| acabot | yes we do | 07:46 |
| AJaeger | acabot: once you have content on docs.openstack.org/developer/watcher, read http://docs.openstack.org/infra/manual/creators.html#add-link-to-your-developer-documentation | 07:46 |
| acabot | AJaeger : thx | 07:47 |
| *** ramishra has quit IRC | 07:47 | |
| AJaeger | acabot: you're welcome! | 07:47 |
| *** gildub has joined #openstack-infra | 07:47 | |
| *** ifarkas has joined #openstack-infra | 07:47 | |
| *** amitgandhinz has joined #openstack-infra | 07:48 | |
| *** ramishra has joined #openstack-infra | 07:48 | |
| *** e0ne has quit IRC | 07:48 | |
| *** rossella_s has quit IRC | 07:48 | |
| *** abregman_ has quit IRC | 07:49 | |
| *** amitgandhinz has quit IRC | 07:52 | |
| *** yolanda has joined #openstack-infra | 07:52 | |
| yolanda | good morning | 07:52 |
| *** abregman has joined #openstack-infra | 07:54 | |
| AJaeger | morning, yolanda ! the project-config dib-gate is always failing, a fix is https://review.openstack.org/326273 . What do you think? | 07:55 |
| *** salv-orlando has quit IRC | 07:56 | |
| *** salv-orlando has joined #openstack-infra | 07:56 | |
| ianw | AJaeger: sorry about that. i think i will make a project-config test for diskimage-builder so we don't regress on this again | 07:58 |
| AJaeger | ianw: please do! | 07:59 |
| AJaeger | ianw: thanks for +2A. | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| *** roxanaghe has joined #openstack-infra | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** rossella_s has joined #openstack-infra | 08:01 | |
| *** Hal has joined #openstack-infra | 08:02 | |
| *** rwsu has quit IRC | 08:02 | |
| *** e0ne has joined #openstack-infra | 08:02 | |
| *** e0ne has quit IRC | 08:02 | |
| *** Hal is now known as Guest76293 | 08:02 | |
| *** roxanaghe has quit IRC | 08:04 | |
| *** binbincong has quit IRC | 08:07 | |
| *** flip214 has quit IRC | 08:08 | |
| *** flip214 has joined #openstack-infra | 08:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Add dib-lint tags to sudo calls https://review.openstack.org/326273 | 08:10 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: translations: Always setup venv https://review.openstack.org/326284 | 08:11 |
| AJaeger | ianw, yolanda: could you review the change above, please? ^ | 08:11 |
| yolanda | hi AJaeger , sure. Starting a bit later today, dealing with laptop installation | 08:11 |
| AJaeger | yolanda: no problem - thanks | 08:13 |
| *** kzaitsev_mb has joined #openstack-infra | 08:13 | |
| *** dizquierdo has joined #openstack-infra | 08:13 | |
| AJaeger | #status log dig gate for project-config is fixed again with https://review.openstack.org/326273 merged. | 08:13 |
| openstackstatus | AJaeger: finished logging | 08:13 |
| *** _shaps_ has joined #openstack-infra | 08:14 | |
| *** kzaitsev_mb has quit IRC | 08:17 | |
| mordred | jhesketh: merged | 08:21 |
| mordred | jhesketh: sorry for the wait | 08:22 |
| *** jaosorior has quit IRC | 08:23 | |
| *** jaosorior has joined #openstack-infra | 08:24 | |
| *** hashar has joined #openstack-infra | 08:29 | |
| jhesketh | mordred: thanks! | 08:29 |
| jhesketh | no worries | 08:29 |
| jhesketh | mordred: surely it's some ridiculous hour for you now? | 08:30 |
| mordred | jhesketh: nope - it's 10:30am ... I'm in Vienna | 08:32 |
| acabot | AJaeger : regarding the specs folder, should I add something to have our specs on specs.openstack.org or it is done for all projects in governance ? thx | 08:32 |
| *** zul has quit IRC | 08:32 | |
| jhesketh | mordred: oh cool | 08:32 |
| *** Julien-zte has joined #openstack-infra | 08:32 | |
| AJaeger | acabot: use openstack-specs-jobs in zuul/layout | 08:33 |
| acabot | ok | 08:33 |
| AJaeger | and once you have content published, update the index in specs/ dir of project-config | 08:34 |
| *** tosky has joined #openstack-infra | 08:34 | |
| *** sorantis has joined #openstack-infra | 08:34 | |
| *** gildub has quit IRC | 08:34 | |
| *** dingyichen has quit IRC | 08:35 | |
| *** thorst has joined #openstack-infra | 08:35 | |
| acabot | AJaeger : ok | 08:35 |
| *** Daisy_ has quit IRC | 08:36 | |
| *** Daisy has joined #openstack-infra | 08:37 | |
| openstackgerrit | Antoine Cabot proposed openstack-infra/project-config: Add Watcher docs and specs on openstack.org https://review.openstack.org/326293 | 08:39 |
| yolanda | mordred, can you review https://review.openstack.org/325948 and https://review.openstack.org/325959 ? | 08:39 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Migrate tripleo to centos-7" https://review.openstack.org/326182 | 08:41 |
| *** Daisy has quit IRC | 08:41 | |
| AJaeger | acabot: LGTM | 08:42 |
| *** thorst has quit IRC | 08:42 | |
| jhesketh | yolanda: they lgtm | 08:42 |
| acabot | AJaeger : good to know ;-) | 08:42 |
| yolanda | jhesketh, thx. Are you in EMEA timezone as well? | 08:42 |
| jhesketh | yolanda: nope, it's not too late here though (approaching 7pm) | 08:43 |
| openstackgerrit | Merged openstack-infra/project-config: Higgins: enable voting for dsvm job https://review.openstack.org/326214 | 08:43 |
| yolanda | jhesketh, thx for review | 08:43 |
| *** _shaps_ has quit IRC | 08:43 | |
| *** Julien-zte has quit IRC | 08:44 | |
| *** Daisy has joined #openstack-infra | 08:45 | |
| *** wanghua has quit IRC | 08:45 | |
| *** zul has joined #openstack-infra | 08:46 | |
| *** derekh has joined #openstack-infra | 08:46 | |
| openstackgerrit | Merged openstack-infra/project-config: Import os-http into openstack infrastructure https://review.openstack.org/325719 | 08:46 |
| andreaf | yolanda: good morning - do you have a sec for a really quick d-g review? https://review.openstack.org/#/c/322417/ | 08:47 |
| *** liusheng has quit IRC | 08:48 | |
| yolanda | hi andreaf , good morning | 08:48 |
| *** shashank_hegde has quit IRC | 08:48 | |
| *** liusheng has joined #openstack-infra | 08:48 | |
| *** amitgandhinz has joined #openstack-infra | 08:48 | |
| openstackgerrit | Gal Sagie proposed openstack-infra/project-config: Add networking-l2gw fullstack job https://review.openstack.org/326300 | 08:50 |
| *** tesseract has joined #openstack-infra | 08:50 | |
| openstackgerrit | Merged openstack-infra/project-config: Increase tempest baremetal deploy/unprovision timeouts https://review.openstack.org/315545 | 08:51 |
| *** kzaitsev_mb has joined #openstack-infra | 08:53 | |
| *** amitgandhinz has quit IRC | 08:53 | |
| *** markusry has joined #openstack-infra | 08:54 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Revert "Update cireport for centos-7 nodes" https://review.openstack.org/326301 | 08:55 |
| *** flepied has joined #openstack-infra | 08:55 | |
| openstackgerrit | Merged openstack-infra/infra-ansible: Fix sudo/become deprecation warnings https://review.openstack.org/325946 | 08:56 |
| *** Daisy_ has joined #openstack-infra | 08:56 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: configure zuul with a non-default layout file https://review.openstack.org/316693 | 08:56 |
| openstackgerrit | Merged openstack-infra/system-config: Remove warnings from gerrit projects template https://review.openstack.org/325948 | 08:56 |
| openstackgerrit | Merged openstack-infra/puppet-jeepyb: Add missing packages to jeepyb install https://review.openstack.org/325959 | 08:56 |
| *** Jeffrey4l has joined #openstack-infra | 08:57 | |
| openstackgerrit | Merged openstack-infra/shade: Add network quotas support https://review.openstack.org/319144 | 08:57 |
| *** mixos has quit IRC | 08:57 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert "Update cireport for centos-7 nodes" https://review.openstack.org/326301 | 08:58 |
| *** Daisy has quit IRC | 08:58 | |
| *** jyuso1 has quit IRC | 08:59 | |
| *** ramishra has quit IRC | 09:00 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Stop allowing duplicate users to be added to private stories https://review.openstack.org/320895 | 09:01 |
| openstackgerrit | Merged openstack-infra/project-config: translations: Always setup venv https://review.openstack.org/326284 | 09:01 |
| *** ramishra has joined #openstack-infra | 09:01 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: WIP: Zun: rename higgins to zun https://review.openstack.org/326306 | 09:03 |
| *** aviau has quit IRC | 09:03 | |
| *** electrofelix has joined #openstack-infra | 09:03 | |
| *** pcrews_ has joined #openstack-infra | 09:04 | |
| openstackgerrit | Gal Sagie proposed openstack-infra/project-config: Add networking-l2gw fullstack job https://review.openstack.org/326300 | 09:04 |
| *** dmk0202 has joined #openstack-infra | 09:05 | |
| *** gongysh has quit IRC | 09:05 | |
| *** BobBall_AWOL has quit IRC | 09:06 | |
| *** aviau has joined #openstack-infra | 09:06 | |
| *** pcrews has quit IRC | 09:06 | |
| *** Daisy_ has quit IRC | 09:07 | |
| *** Daisy has joined #openstack-infra | 09:08 | |
| acabot | yolanda : hi, if you have a sec to W+1 https://review.openstack.org/#/c/326293/ I plan to check any dead link in doc today, thx | 09:10 |
| *** dtantsur is now known as dtantsur|bbl | 09:10 | |
| *** Daisy has quit IRC | 09:11 | |
| *** Daisy_ has joined #openstack-infra | 09:11 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Update Team resource to add the Users subcontroller https://review.openstack.org/320516 | 09:12 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a modal to create Teams https://review.openstack.org/320517 | 09:12 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Implement UI for managing team membership https://review.openstack.org/320037 | 09:12 |
| *** sorantis has quit IRC | 09:12 | |
| *** gildub has joined #openstack-infra | 09:14 | |
| openstackgerrit | Merged openstack-infra/project-config: remove hdp jobs for sahara-image-elements https://review.openstack.org/326087 | 09:15 |
| *** nikeshm has quit IRC | 09:15 | |
| acabot | yolanda : thx | 09:16 |
| *** flepied1 has joined #openstack-infra | 09:17 | |
| openstackgerrit | Thomas Desvenain proposed openstack-infra/jenkins-job-builder: Added amazon web services to credentials bindings https://review.openstack.org/326106 | 09:17 |
| *** flepied has quit IRC | 09:19 | |
| openstackgerrit | Eli Qiao proposed openstack-infra/project-config: Zun: rename higgins to zun https://review.openstack.org/326306 | 09:22 |
| *** sambetts|afk is now known as sambetts | 09:23 | |
| *** flepied1 is now known as flepied | 09:24 | |
| *** markvoelker has joined #openstack-infra | 09:24 | |
| *** flepied1 has joined #openstack-infra | 09:25 | |
| *** flepied has quit IRC | 09:25 | |
| *** flepied1 has quit IRC | 09:26 | |
| *** tzn has joined #openstack-infra | 09:26 | |
| *** flepied has joined #openstack-infra | 09:26 | |
| eliqiao | hi yolanda, higgins team decide to rename to zun, I proposed a patch, can you help to take a look? thanks in advance :) | 09:26 |
| openstackgerrit | Merged openstack-infra/infra-ansible: Fix the set_hostnames role when using default inventory behaviour https://review.openstack.org/325944 | 09:26 |
| *** Daisy_ has quit IRC | 09:28 | |
| *** e0ne has joined #openstack-infra | 09:28 | |
| *** Daisy has joined #openstack-infra | 09:28 | |
| *** vdrok has joined #openstack-infra | 09:28 | |
| *** markvoelker has quit IRC | 09:29 | |
| vdrok | morning ironic | 09:29 |
| *** yamahata has quit IRC | 09:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Ironic Inspector discovery tempest job https://review.openstack.org/325891 | 09:30 |
| openstackgerrit | Merged openstack-infra/project-config: Add Watcher docs and specs on openstack.org https://review.openstack.org/326293 | 09:31 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Import Panko https://review.openstack.org/318677 | 09:33 |
| *** sorantis has joined #openstack-infra | 09:37 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Add ansible.cfg file on repo to disable host key checking https://review.openstack.org/326329 | 09:38 |
| *** flepied1 has joined #openstack-infra | 09:39 | |
| *** thorst has joined #openstack-infra | 09:39 | |
| *** flepied has quit IRC | 09:42 | |
| *** Daisy has quit IRC | 09:42 | |
| *** Daisy has joined #openstack-infra | 09:42 | |
| *** kzaitsev_mb has quit IRC | 09:44 | |
| openstackgerrit | Masayuki Igawa proposed openstack/os-testr: [DNM] Add tablesorter to html report https://review.openstack.org/326339 | 09:45 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Add generate infra dynamic inventory playbook/role https://review.openstack.org/325858 | 09:45 |
| openstackgerrit | lvdongbing proposed openstack-infra/irc-meetings: Add the Bilean team meeting https://review.openstack.org/326271 | 09:47 |
| *** Daisy has quit IRC | 09:47 | |
| *** thorst has quit IRC | 09:47 | |
| *** amitgandhinz has joined #openstack-infra | 09:49 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Save tempest accounts.yaml in logs https://review.openstack.org/322417 | 09:52 |
| *** gildub has quit IRC | 09:53 | |
| *** amitgandhinz has quit IRC | 09:54 | |
| *** _degorenko|afk is now known as degorenko | 09:55 | |
| *** sree has quit IRC | 09:56 | |
| *** permalac has joined #openstack-infra | 09:57 | |
| *** vdrok has left #openstack-infra | 09:57 | |
| *** oanson has joined #openstack-infra | 10:05 | |
| *** sorantis has quit IRC | 10:08 | |
| *** yanyanhu has quit IRC | 10:10 | |
| *** zhurong has quit IRC | 10:10 | |
| *** yanyanhu has joined #openstack-infra | 10:10 | |
| *** yanyanhu has quit IRC | 10:11 | |
| *** rwsu has joined #openstack-infra | 10:15 | |
| *** rwsu has quit IRC | 10:20 | |
| *** rwsu has joined #openstack-infra | 10:21 | |
| openstackgerrit | Merged openstack-infra/infra-ansible: Add ansible.cfg file on repo to disable host key checking https://review.openstack.org/326329 | 10:23 |
| vsaienko | infra-team, please review https://review.openstack.org/#/c/316662/ the 1 line patch to devstack-gate that allows to pass TEMPEST_TEST_TIMEOUT for ironic grenade job. It is the last patch to openstack-infra related to ironic and grenade :) | 10:23 |
| *** _amrith_ is now known as amrith | 10:24 | |
| *** sdague has joined #openstack-infra | 10:24 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Switch the provisioning step to the cloud launcher role https://review.openstack.org/325780 | 10:24 |
| *** jed56 has quit IRC | 10:25 | |
| *** salv-orl_ has joined #openstack-infra | 10:25 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Add generate infra dynamic inventory playbook/role https://review.openstack.org/325858 | 10:25 |
| *** yamamoto_ has quit IRC | 10:26 | |
| *** tzn has quit IRC | 10:26 | |
| clarkb | vsaienko: does grenade support that new localrc var? | 10:26 |
| *** jlanoux_ has joined #openstack-infra | 10:27 | |
| clarkb | we can set it but if grenade doesnt support it then it is a noop | 10:28 |
| *** salv-orlando has quit IRC | 10:28 | |
| *** ccamacho is now known as ccamacho|lunch | 10:28 | |
| *** jlanoux has quit IRC | 10:30 | |
| *** rwsu has quit IRC | 10:31 | |
| *** nadya has joined #openstack-infra | 10:31 | |
| *** hparekh has quit IRC | 10:31 | |
| *** rwsu has joined #openstack-infra | 10:31 | |
| *** dtantsur|bbl is now known as dtantsur | 10:32 | |
| *** nadya has quit IRC | 10:36 | |
| *** yuval has joined #openstack-infra | 10:37 | |
| *** rhallisey has joined #openstack-infra | 10:37 | |
| *** rhallisey has quit IRC | 10:38 | |
| *** rhallisey has joined #openstack-infra | 10:38 | |
| *** sarob has joined #openstack-infra | 10:38 | |
| yuval | Hey, I am having trouble logging into the OpenStack wiki. Guys on #openstack-dev said it might be because my account is relatively new (3~ months). Anyone has the permission to allow my wiki login? | 10:39 |
| *** kzaitsev_mb has joined #openstack-infra | 10:40 | |
| *** julim has joined #openstack-infra | 10:40 | |
| *** yamada-h has quit IRC | 10:41 | |
| eliqiao | hi, I would like to start a new IRC channel, any guide I can find? | 10:41 |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Repair ironic-inspector ability to run its own tempest job https://review.openstack.org/325825 | 10:41 |
| eliqiao | seen from https://wiki.openstack.org/wiki/IRC , I need to consult here. | 10:41 |
| *** kaisers has quit IRC | 10:42 | |
| *** jlanoux has joined #openstack-infra | 10:42 | |
| rcarrillocruz | eliqiao: http://docs.openstack.org/infra/system-config/irc.html | 10:42 |
| eliqiao | rcarrillocruz: thx. | 10:42 |
| *** sarob has quit IRC | 10:43 | |
| *** hparekh has joined #openstack-infra | 10:44 | |
| *** kaisers has joined #openstack-infra | 10:44 | |
| *** jlanoux_ has quit IRC | 10:45 | |
| *** thorst has joined #openstack-infra | 10:47 | |
| *** oanson has quit IRC | 10:48 | |
| *** GnomeKing has joined #openstack-infra | 10:49 | |
| *** amitgandhinz has joined #openstack-infra | 10:50 | |
| *** thorst has quit IRC | 10:53 | |
| *** nadya has joined #openstack-infra | 10:54 | |
| *** amitgandhinz has quit IRC | 10:54 | |
| *** hashar has quit IRC | 10:56 | |
| *** rwsu has quit IRC | 10:56 | |
| *** hashar has joined #openstack-infra | 10:56 | |
| *** rhallisey has quit IRC | 10:57 | |
| *** weshay has joined #openstack-infra | 10:57 | |
| *** nadya has quit IRC | 10:59 | |
| *** amotoki has quit IRC | 11:00 | |
| *** GnomeKing is now known as BobBall | 11:02 | |
| *** salv-orl_ has quit IRC | 11:04 | |
| *** salv-orlando has joined #openstack-infra | 11:05 | |
| *** dizquierdo has quit IRC | 11:08 | |
| *** sorantis has joined #openstack-infra | 11:14 | |
| openstackgerrit | Mathieu Mitchell proposed openstack-infra/system-config: Introduce TinyCoreLinux mirror https://review.openstack.org/325981 | 11:16 |
| *** salv-orl_ has joined #openstack-infra | 11:18 | |
| *** lezbar has quit IRC | 11:19 | |
| *** lezbar has joined #openstack-infra | 11:20 | |
| *** amotoki has joined #openstack-infra | 11:20 | |
| *** salv-orlando has quit IRC | 11:23 | |
| *** markvoelker has joined #openstack-infra | 11:25 | |
| *** yolanda has quit IRC | 11:28 | |
| *** markvoelker has quit IRC | 11:29 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta puppetmaster group to the expected 'puppetmaster' group https://review.openstack.org/326389 | 11:29 |
| *** yolanda has joined #openstack-infra | 11:31 | |
| *** nadya has joined #openstack-infra | 11:31 | |
| *** ccamacho|lunch is now known as ccamacho | 11:31 | |
| *** tzn has joined #openstack-infra | 11:32 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Remove bare variable from with_items https://review.openstack.org/326391 | 11:32 |
| crinkle | is there someone awake who can do some moderating in #openstack-meeting? | 11:36 |
| *** rhallisey has joined #openstack-infra | 11:37 | |
| *** ldnunes has joined #openstack-infra | 11:40 | |
| *** lucasagomes is now known as lucas-hungry | 11:40 | |
| *** _shaps_ has joined #openstack-infra | 11:43 | |
| *** oanson has joined #openstack-infra | 11:43 | |
| *** vgridnev has joined #openstack-infra | 11:45 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/zuul: highlight the error condition when reporting a config issue https://review.openstack.org/272262 | 11:45 |
| *** moravec has quit IRC | 11:46 | |
| *** thorst_ has joined #openstack-infra | 11:46 | |
| *** coolsvap has joined #openstack-infra | 11:49 | |
| coolsvap | can anyone help to kick out Guest_84757 in openstack-meeting ? | 11:49 |
| *** amitgandhinz has joined #openstack-infra | 11:51 | |
| *** salv-orl_ has quit IRC | 11:51 | |
| rcarrillocruz | yolanda: ^ | 11:52 |
| *** salv-orlando has joined #openstack-infra | 11:52 | |
| *** moravec has joined #openstack-infra | 11:52 | |
| yolanda | mm, i don't have operator power | 11:54 |
| *** amitgandhinz has quit IRC | 11:55 | |
| *** psilvad has joined #openstack-infra | 11:57 | |
| *** salv-orlando has quit IRC | 11:58 | |
| *** salv-orlando has joined #openstack-infra | 11:58 | |
| *** Jeffrey4l has quit IRC | 11:58 | |
| *** Jeffrey4l has joined #openstack-infra | 11:59 | |
| *** oanson has quit IRC | 11:59 | |
| *** dprince has joined #openstack-infra | 11:59 | |
| *** _ari_ has joined #openstack-infra | 12:00 | |
| *** amotoki has quit IRC | 12:00 | |
| *** baoli has joined #openstack-infra | 12:01 | |
| *** baoli_ has joined #openstack-infra | 12:02 | |
| *** bdemers_ has quit IRC | 12:03 | |
| *** psilvad has quit IRC | 12:03 | |
| *** psilvad has joined #openstack-infra | 12:05 | |
| *** armax has joined #openstack-infra | 12:05 | |
| *** baoli has quit IRC | 12:05 | |
| *** markvoelker has joined #openstack-infra | 12:06 | |
| *** armax has quit IRC | 12:06 | |
| *** coolsvap has quit IRC | 12:07 | |
| *** amotoki has joined #openstack-infra | 12:09 | |
| openstackgerrit | Merged openstack-infra/infra-ansible: Remove bare variable from with_items https://review.openstack.org/326391 | 12:09 |
| *** rodrigods has quit IRC | 12:09 | |
| *** rodrigods has joined #openstack-infra | 12:09 | |
| *** psilvad has quit IRC | 12:10 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Allow to pass OS_TEST_TIMEOUT for grenade job https://review.openstack.org/316662 | 12:12 |
| *** zqfan has quit IRC | 12:13 | |
| openstackgerrit | Erno Kuvaja proposed openstack/diskimage-builder: Add cinder-backup mappings https://review.openstack.org/326411 | 12:15 |
| *** nadya has quit IRC | 12:17 | |
| jaosorior | AJaeger: Hey, do you know more or less when should this change get reflected https://review.openstack.org/#/c/326182/1 for some reason it seems we are still running those centos jobs :/ | 12:17 |
| *** trown|outtypewww is now known as trown | 12:22 | |
| *** piet has joined #openstack-infra | 12:22 | |
| *** aysyd has joined #openstack-infra | 12:23 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Remove extraneous <tbody> elements from the dashboard https://review.openstack.org/321017 | 12:25 |
| *** piet has quit IRC | 12:26 | |
| *** kgiusti has joined #openstack-infra | 12:27 | |
| *** rlandy has quit IRC | 12:28 | |
| *** rlandy has joined #openstack-infra | 12:28 | |
| *** jcoufal has joined #openstack-infra | 12:30 | |
| *** thorst_ is now known as thorst | 12:31 | |
| *** EricGonczer_ has joined #openstack-infra | 12:31 | |
| *** kushal has joined #openstack-infra | 12:33 | |
| *** zeih has quit IRC | 12:33 | |
| *** zeih has joined #openstack-infra | 12:33 | |
| AJaeger | jaosorior: it should be active - since it's not, we need some infra-root help. | 12:34 |
| *** flip214_ has joined #openstack-infra | 12:34 | |
| AJaeger | jaosorior: I can't help further, I don't have time now | 12:34 |
| *** amrith is now known as _amrith_ | 12:35 | |
| *** flip214 has quit IRC | 12:35 | |
| *** flip214_ is now known as flip214 | 12:35 | |
| *** flip214 has quit IRC | 12:35 | |
| *** flip214 has joined #openstack-infra | 12:35 | |
| *** oanson has joined #openstack-infra | 12:35 | |
| *** gouthamr has joined #openstack-infra | 12:36 | |
| *** amoralej is now known as amoralej|lunch | 12:36 | |
| *** gordc has joined #openstack-infra | 12:36 | |
| *** tzn has quit IRC | 12:37 | |
| *** lucas-hungry is now known as lucasagomes | 12:40 | |
| *** kushal has quit IRC | 12:42 | |
| *** kushal has joined #openstack-infra | 12:42 | |
| *** eharney has quit IRC | 12:42 | |
| *** salv-orlando has quit IRC | 12:42 | |
| *** salv-orlando has joined #openstack-infra | 12:43 | |
| jaosorior | AJaeger: Any hints who I could ping from infra-root? | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit https://review.openstack.org/292377 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 12:44 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 12:44 |
| *** gildub has joined #openstack-infra | 12:44 | |
| therve | Can someone explain with https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L949 doesn't skip properly doc-only changes for heat? | 12:45 |
| therve | https://review.openstack.org/#/c/326379 for reference | 12:45 |
| therve | s/with/why | 12:47 |
| jaosorior | anybody from infra-root around? | 12:47 |
| tristanC | therve: perhaps because of https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1144 ? | 12:50 |
| *** matt-borland has joined #openstack-infra | 12:50 | |
| dirk | whats the recommended procedure for changing the owner in https://review.openstack.org/#/admin/groups/uuid-ca033ee2dd2d63109cf7827ebb5658419c1005c9,info to rpm-packaging-core ? | 12:50 |
| AJaeger | dirk, that needs an admin - so infra-root | 12:51 |
| *** links has quit IRC | 12:51 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Add generate infra dynamic inventory playbook/role https://review.openstack.org/325858 | 12:51 |
| *** amitgandhinz has joined #openstack-infra | 12:51 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta puppetmaster group to the expected 'puppetmaster' group https://review.openstack.org/326389 | 12:51 |
| *** links has joined #openstack-infra | 12:52 | |
| jhesketh | jaosorior: taking a look for you | 12:52 |
| *** EricGonczer_ has quit IRC | 12:52 | |
| AJaeger | therve: best to check the log file for the project-config layout run on what's actually there | 12:52 |
| fungi | jaosorior: jhesketh: looks like zuul hasn't had a reconfiguration event for almost 24 hours | 12:53 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Do not fail ansible if one cloud is down https://review.openstack.org/326441 | 12:53 |
| therve | tristanC, It's not cumulative? | 12:53 |
| AJaeger | therve: http://logs.openstack.org/59/311459/6/check/gate-project-config-layout/0b14655/console.html.gz#_2016-06-03_16_18_36_854 | 12:53 |
| *** thiagop has joined #openstack-infra | 12:53 | |
| jhesketh | fungi: right, was just about to look there.. has the config on the host updated? | 12:53 |
| tristanC | therve: I wonder if the skip-if doesn't replace the first one | 12:53 |
| AJaeger | therve: tristanC is right. last one wins, see the log file I quoted | 12:53 |
| therve | AJaeger, OK :). I don't understand what that files means, but that makes sense I think | 12:54 |
| jaosorior | jhesketh, thanks | 12:54 |
| *** Ravikiran_K has joined #openstack-infra | 12:54 | |
| *** tzn has joined #openstack-infra | 12:55 | |
| fungi | jhesketh: nope... -rwxr-xr-x 1 root root 350260 Jun 6 13:27 /etc/zuul/layout/layout.yaml | 12:55 |
| fungi | puppet doesn't appear to be disabled though | 12:56 |
| *** amitgandhinz has quit IRC | 12:56 | |
| *** Jeffrey4l has quit IRC | 12:56 | |
| AJaeger | therve: "<Job gate-heat-docs> {MatchAny:{MatchAll:{ProjectMatcher:^openstack/heat$},{MatchAllFiles:{FileMatcher:^heat/locale/.*$},{FileMatcher:^releasenotes/.*$}}}} " - this the result of the skip-ifs. The MatchAllFiles/FileMatcher is what you look at | 12:57 |
| fungi | Error fetching server list on openstackci-bluebox:RegionOne: | 12:57 |
| fungi | i suspect the bluebox outage has broken our ansible loop | 12:57 |
| *** yujunz has joined #openstack-infra | 12:57 | |
| jhesketh | fungi: heh, I just pushed a fix for that | 12:57 |
| jhesketh | https://review.openstack.org/326441 | 12:57 |
| *** markusry has quit IRC | 12:57 | |
| fungi | hah | 12:58 |
| jhesketh | jaosorior: it looks like the problem is our ansible/puppet is a little stuck... once we get it unstuck those changes should apply and afterwards you can issue a recheck on any relevant changes | 12:58 |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Improve skip for Heat some more https://review.openstack.org/326444 | 12:59 |
| jaosorior | jhesketh: Thanks for taking a look; appreciate it | 12:59 |
| therve | AJaeger, tristanC: Thanks, ^^^ an attempt at fixing it | 12:59 |
| dulek | Hi. Even though there are pep8 errors, they doesn't get listed in logs: http://logs.openstack.org/77/326377/1/check/gate-cinder-pep8/3f0c9dd/console.html#_2016-06-07_11_24_43_984 | 12:59 |
| dulek | I however see them when running tox locally. | 13:00 |
| tristanC | therve: you're welcome, glad this mystery is solved :) | 13:00 |
| *** edmondsw has joined #openstack-infra | 13:01 | |
| *** mriedem_away is now known as mriedem | 13:01 | |
| fungi | jhesketh: i manually applied that config change and it seems to possibly still be running after logging "Error fetching server list on openstackci-bluebox:RegionOne:" | 13:02 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Make vertical alignment of task table cells consistent https://review.openstack.org/325293 | 13:02 |
| *** xyang1 has joined #openstack-infra | 13:02 | |
| fungi | jhesketh: so far so good | 13:02 |
| AJaeger | therve: wait for the build to finish and check the log file for the layout gate whether the lines look fine | 13:02 |
| jhesketh | fungi: hmm I wouldn't have expected anything to be logged | 13:03 |
| therve | AJaeger, OK will try :) | 13:03 |
| fungi | hrm, we also got "Error fetching server list on openstackci-ovh:BHS1:" | 13:03 |
| *** oanson has quit IRC | 13:03 | |
| *** rwsu has joined #openstack-infra | 13:03 | |
| *** _ari_ has quit IRC | 13:03 | |
| *** setuid has left #openstack-infra | 13:03 | |
| AJaeger | therve: these skip-ifs are very fragile, it's not always worth to have them... | 13:04 |
| therve | AJaeger, Well, it's almost world environment day! So I'd say they can worth it :) | 13:05 |
| therve | Also it's be nice to land a doc fix in less than 4h | 13:05 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix spelling mistake on profile page https://review.openstack.org/325321 | 13:05 |
| *** sarob has joined #openstack-infra | 13:05 | |
| *** zhurong has joined #openstack-infra | 13:07 | |
| *** Goneri has joined #openstack-infra | 13:08 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix the profile submenu https://review.openstack.org/325350 | 13:08 |
| *** sarob has quit IRC | 13:10 | |
| *** r-daneel has joined #openstack-infra | 13:11 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Temporarily disable bluebox in ansible https://review.openstack.org/326453 | 13:12 |
| fungi | jhesketh: no such luck. see my review comment. in the meantime we need ^ | 13:12 |
| *** amotoki has quit IRC | 13:13 | |
| *** inc0 has joined #openstack-infra | 13:13 | |
| jhesketh | oh we're pinned... I thought we fixed that | 13:13 |
| fungi | oh, i just realized i edited the wrong clouds.yaml. new patchset otw | 13:14 |
| *** Julien-zte has joined #openstack-infra | 13:14 | |
| jhesketh | woops, I didn't notice either... /me removes his +w | 13:14 |
| *** jaosorior has quit IRC | 13:15 | |
| jhesketh | fungi: where do we pin ansible.. this looks like it's latest: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/puppetmaster.pp#n215 | 13:15 |
| *** amotoki has joined #openstack-infra | 13:15 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Temporarily disable bluebox in ansible https://review.openstack.org/326453 | 13:15 |
| fungi | jhesketh: here we go ^ | 13:15 |
| *** jaosorior has joined #openstack-infra | 13:16 | |
| jhesketh | fungi: +w (checked the file this time too :p) | 13:16 |
| *** akshai has joined #openstack-infra | 13:17 | |
| *** gildub has quit IRC | 13:17 | |
| *** zeih has quit IRC | 13:18 | |
| fungi | jhesketh: http://git.openstack.org/cgit/openstack-infra/puppet-ansible/tree/manifests/init.pp#n12 | 13:18 |
| fungi | jhesketh: via https://review.openstack.org/321772 | 13:19 |
| *** markusry has joined #openstack-infra | 13:19 | |
| jhesketh | fungi: right okay... it looks like line 218 might be redundant as I don't immediately see it being installed, just clone to /opt/ansible | 13:20 |
| jhesketh | (and the puppet-ansible class is instantiated earlier) | 13:20 |
| *** mdrabe has joined #openstack-infra | 13:21 | |
| fungi | i removed the bluebox stanza from /etc/openstack/clouds.yaml on puppetmaster.o.o, but /var/log/puppet_run_all.log is still saying "Error fetching server list on openstackci-bluebox:RegionOne:" | 13:23 |
| fungi | i wonder if i need to clear the inventory cache as well | 13:23 |
| *** nmagnezi has quit IRC | 13:23 | |
| fungi | okay, ansible inventory cache cleared now | 13:24 |
| *** r-daneel has quit IRC | 13:24 | |
| *** doug-fish has joined #openstack-infra | 13:25 | |
| jhesketh | fungi: working now? | 13:26 |
| *** asselin_ has joined #openstack-infra | 13:26 | |
| fungi | cron should fire it in about 3 more minutes | 13:26 |
| *** sdake has joined #openstack-infra | 13:27 | |
| *** zeih has joined #openstack-infra | 13:28 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Tidy up ansible directories https://review.openstack.org/326464 | 13:29 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Rename expand-groups to ansible-expand-groups https://review.openstack.org/326465 | 13:29 |
| *** PollyZ has joined #openstack-infra | 13:29 | |
| jhesketh | fungi: a few tidy ups in the mean time ^ | 13:30 |
| *** abregman has quit IRC | 13:31 | |
| *** hdaniel has quit IRC | 13:32 | |
| *** dkehn has quit IRC | 13:32 | |
| *** banix has joined #openstack-infra | 13:33 | |
| *** eharney has joined #openstack-infra | 13:33 | |
| openstackgerrit | Merged openstack-infra/storyboard: Filter non-public fields in users when updating https://review.openstack.org/324717 | 13:33 |
| *** dkehn has joined #openstack-infra | 13:34 | |
| *** sdake_ has joined #openstack-infra | 13:34 | |
| *** sdake has quit IRC | 13:36 | |
| *** r-daneel has joined #openstack-infra | 13:36 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Add generate infra dynamic inventory playbook/role https://review.openstack.org/325858 | 13:36 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Switch the provisioning step to the cloud launcher role https://review.openstack.org/325780 | 13:36 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack-infra/project-config: Don't run puppet tests on rst/unit test changes https://review.openstack.org/324158 | 13:37 |
| *** amitgandhinz has joined #openstack-infra | 13:39 | |
| *** amitgandhinz has quit IRC | 13:39 | |
| *** amitgandhinz has joined #openstack-infra | 13:39 | |
| *** bdemers has joined #openstack-infra | 13:40 | |
| jhesketh | fungi: looks like ansible is running okay | 13:41 |
| fungi | jhesketh: yep, log shows things working again | 13:41 |
| fungi | i'm going to take a break and do normal morning things for a bit | 13:42 |
| fungi | ECOFFEE | 13:42 |
| rcarrillocruz | yeah, me too, although afternoon for me | 13:42 |
| rcarrillocruz | brb | 13:42 |
| *** rkukura_ has joined #openstack-infra | 13:43 | |
| *** rkukura has quit IRC | 13:43 | |
| *** rkukura_ is now known as rkukura | 13:43 | |
| *** Guest76293 has quit IRC | 13:43 | |
| *** Hal has joined #openstack-infra | 13:44 | |
| *** Hal is now known as Guest29471 | 13:44 | |
| *** regXboi has joined #openstack-infra | 13:45 | |
| regXboi | morning all - quick question on the archive publisher of jjb - what is the root of the artifacts path and can I specify a full path there? | 13:47 |
| openstackgerrit | Merged openstack-infra/system-config: Temporarily disable bluebox in ansible https://review.openstack.org/326453 | 13:47 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add a note mentioning markdown is supported under the comment box https://review.openstack.org/325360 | 13:48 |
| *** amoralej|lunch is now known as amoralej | 13:48 | |
| *** amotoki has quit IRC | 13:48 | |
| *** dizquierdo has joined #openstack-infra | 13:49 | |
| *** xavvior has joined #openstack-infra | 13:49 | |
| *** hichihara has joined #openstack-infra | 13:49 | |
| *** nadya has joined #openstack-infra | 13:51 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: make all sahara-dashboard jobs voting https://review.openstack.org/326474 | 13:52 |
| *** zeih has quit IRC | 13:52 | |
| *** rbrndt has joined #openstack-infra | 13:53 | |
| *** _ari_ has joined #openstack-infra | 13:53 | |
| *** nadya has quit IRC | 13:53 | |
| *** sree has joined #openstack-infra | 13:53 | |
| *** tlian has joined #openstack-infra | 13:54 | |
| *** hferenc has joined #openstack-infra | 13:54 | |
| xavvior | Hello Infra Members. We found a problem in review.openstack.org while we want change in account settings the Contant Information: No save the filled fields and the new members can't push to gerrit, because can't fill or update the user information in gerrit. | 13:55 |
| zxiiro | electrofelix: What's the status on JJB 1.6.0? are we still stuck on releasing? | 13:56 |
| AJaeger | xavvior: If you already followed the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup and still get that, see https://ask.openstack.org/question/56720 for additional troubleshooting tips. | 13:57 |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Improve skip for Heat some more https://review.openstack.org/326444 | 13:58 |
| *** claudiub has joined #openstack-infra | 13:59 | |
| pabelanger | morning | 14:00 |
| *** xarses has quit IRC | 14:00 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta puppetmaster group to the expected 'puppetmaster' group https://review.openstack.org/326389 | 14:00 |
| *** Goneri has quit IRC | 14:01 | |
| *** _amrith_ is now known as amrith | 14:02 | |
| *** yamahata has joined #openstack-infra | 14:02 | |
| AJaeger | morning, pabelanger ! The tripleo folks had to revert your change for centos7/fedora ;( | 14:03 |
| pabelanger | AJaeger: yes, I am following up with it now. | 14:03 |
| *** yujunz has quit IRC | 14:03 | |
| AJaeger | pabelanger: ok | 14:04 |
| openstackgerrit | Merged openstack-infra/infra-ansible: Switch the provisioning step to the cloud launcher role https://review.openstack.org/325780 | 14:04 |
| electrofelix | zxiiro: was away yesterday, I believe the one change I wanted to see included was merged, so I guess we just ask fungi to tag for a 1.6.0 release and that's it? | 14:04 |
| *** zeih has joined #openstack-infra | 14:05 | |
| hferenc | AJaeger: thx! seems like our colleague has some issues with his mail addresses | 14:08 |
| *** xavvior has quit IRC | 14:08 | |
| fungi | electrofelix: zxiiro: let me know when you're ready and i'm happy to tag 1.6.0 | 14:09 |
| *** bdemers has quit IRC | 14:09 | |
| fungi | i'm assuming there are no backward-incompatible changes | 14:09 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add TripleO blogs from Marios to planet TripleO https://review.openstack.org/326493 | 14:10 |
| zxiiro | fungi: It's good to go from my perspective, electrofelix ? | 14:11 |
| *** banix has quit IRC | 14:11 | |
| *** jed56 has joined #openstack-infra | 14:11 | |
| odyssey4me | Hi everyone - can I please ask for someone to add me to these recently created gerrit groups? https://review.openstack.org/#/q/status:merged+project:openstack-infra/project-config+branch:master+topic:osa-additional-core-teams | 14:13 |
| *** bdemers has joined #openstack-infra | 14:13 | |
| *** bdemers has quit IRC | 14:13 | |
| electrofelix | zxiiro: can you confirm it's ac18e63b0633bd9702f7ff175c29850cedf93819 we want to tag? or HEAD? | 14:13 |
| electrofelix | just reviewing the changes to see if anything concerning went in (don't think so) | 14:14 |
| *** bdemers has joined #openstack-infra | 14:15 | |
| zxiiro | electrofelix: I want HEAD tagged | 14:15 |
| zxiiro | electrofelix: 7e94d575cc92a963cbd147acab6f04c9985b5499 | 14:15 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: make all sahara-dashboard jobs voting https://review.openstack.org/326474 | 14:16 |
| zxiiro | electrofelix: there's an "incompatible change" that went in for the Sonatype CLM plugin but as I mentioned in my code review I don't think it's concerning since the nature of that plugin is that it's a proprietary service provided by Sonatype | 14:16 |
| *** nwkarsten has joined #openstack-infra | 14:16 | |
| *** chlong has quit IRC | 14:16 | |
| zxiiro | electrofelix: they recommend staying on the latest plugin anyway so keeping backwards comparability might not be worth the effort | 14:17 |
| Julien-zte | questions about stackalytics project is in infra team? | 14:17 |
| *** Goneri has joined #openstack-infra | 14:17 | |
| *** tonytan4ever has joined #openstack-infra | 14:17 | |
| Julien-zte | I have some issues when run stackalytics project | 14:17 |
| fungi | Julien-zte: stackalytics.com is not run by us, no | 14:18 |
| *** ramishra has quit IRC | 14:18 | |
| fungi | it's run by engineers at mirantis | 14:18 |
| openstackgerrit | benny@us.ibm.com proposed openstack-infra/project-config: New project request for SwiftOnHPSS https://review.openstack.org/316098 | 14:18 |
| Julien-zte | thanks fungi. is there irc channel or who i can contact? | 14:19 |
| *** banix has joined #openstack-infra | 14:19 | |
| *** ramishra has joined #openstack-infra | 14:19 | |
| *** psilvad has joined #openstack-infra | 14:19 | |
| fungi | Julien-zte: the only contacts i know about for stackalytics are their core review team https://review.openstack.org/#/admin/groups/183,members | 14:19 |
| fungi | Julien-zte: though i've also seen them occasionally answer questions on openstack-dev@lists.openstack.org | 14:19 |
| Julien-zte | OK! good | 14:20 |
| Julien-zte | thanks | 14:20 |
| fungi | you're welcome | 14:20 |
| Julien-zte | hi fungi, another question | 14:22 |
| Julien-zte | I remember that you will have a discussion about the usage of git-review topic? | 14:22 |
| Julien-zte | I submit a git-review modification and you mentioned that the topic will be depreciated. | 14:23 |
| *** sshnaidm|afk has joined #openstack-infra | 14:23 | |
| *** EricGonczer_ has joined #openstack-infra | 14:23 | |
| Julien-zte | what about the result now | 14:23 |
| *** Goneri has quit IRC | 14:23 | |
| electrofelix | zxiiro: does that mean that people can't run their own instance of the server side? I don't really know enough about this service to grasp likelyhood of impact | 14:24 |
| *** esikachev has joined #openstack-infra | 14:26 | |
| *** tkelsey has joined #openstack-infra | 14:27 | |
| *** mriedem is now known as mriedem_afk | 14:27 | |
| zxiiro | electrofelix: they can but you have to buy it from Sonatype (we at LF do) but the code doesn't affect the server side as far as I'm aware the communication between the 2 sides are the same. Sonatype just changed the XML configuration in the Jenkins plugin side so the patch updates to use that and Sonatype recommends you use the latest plugin with their CLM | 14:27 |
| zxiiro | server. | 14:27 |
| *** zeih has quit IRC | 14:27 | |
| electrofelix | ok, but someone who is running it, may not necessarily be running the latest plugin? | 14:28 |
| electrofelix | because they might not have rolled out to the latest | 14:28 |
| zxiiro | electrofelix: it's possible but as I mentioned sonatype recommends you upgrade to the latest plugin version | 14:29 |
| electrofelix | or do they have to update the plugin because it uses a web service? | 14:29 |
| mnaser | hi -infra, does groups.openstack.org sit under the openstack infra team control or the foundation? | 14:29 |
| zxiiro | electrofelix: yeah it's a web service on the other end | 14:29 |
| mnaser | i'm having some troubels with the website | 14:29 |
| *** woodster_ has joined #openstack-infra | 14:30 | |
| *** sree has quit IRC | 14:30 | |
| *** zz_dimtruck is now known as dimtruck | 14:31 | |
| electrofelix | zxiiro: I'm also sure that most Jenkin plugin writers recommend that you upgrade to their latest release, but we deliberately don't break plugin XML for existing installations, so if someones installation was working yesterday it stays working today after a new release of JJB. I'm wary about doing this for what we're hoping is the latest 1.x release | 14:31 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta gerrit group to the expected 'gerrit' group https://review.openstack.org/326515 | 14:31 |
| *** jlanoux has quit IRC | 14:32 | |
| *** chlong has joined #openstack-infra | 14:32 | |
| *** tonytan4ever has quit IRC | 14:33 | |
| dmsimard | Hey, just curious, is there any monitoring to verify that replication between review.o.o, git.o.o and github are all in sync ? | 14:34 |
| zxiiro | electrofelix: The problem is the CLM plugin is not something that's available in Jenkins / Maven Central. you have to go and download it manually from sonatype's website and they don't even provide the possibility of downloading an old version of the plugin | 14:34 |
| zxiiro | https://support.sonatype.com/hc/en-us/articles/213463638-How-do-I-download-and-install-the-Nexus-IQ-Server- | 14:34 |
| tkelsey | hey infra folks, anyone here able to point me at some info on backporting patches? I have a change already in head that I would like to add to mitaka? | 14:35 |
| *** sdake_ has quit IRC | 14:36 | |
| zxiiro | electrofelix: I think risk is low here. FWIW we use this plugin and it actually hasn't worked for us for the past few months. The patch fixes the plugin for us. | 14:36 |
| *** rossella_s has quit IRC | 14:36 | |
| pabelanger | dmsimard: no, we usually wait for somebody to complain then we check it out | 14:36 |
| *** hferenc has quit IRC | 14:37 | |
| *** yuval has quit IRC | 14:37 | |
| *** Goneri has joined #openstack-infra | 14:37 | |
| *** xarses has joined #openstack-infra | 14:37 | |
| dmsimard | pabelanger: okay, was hoping the monitoring wasn't human but thanks :) | 14:38 |
| pabelanger | dmsimard: it doesn't happen to often for us. Is there a repo out of sync? | 14:39 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta zuul group to the expected 'zuul' group https://review.openstack.org/326518 | 14:39 |
| pabelanger | dmsimard: All of our monitoring today is human | 14:39 |
| *** dtardivel has joined #openstack-infra | 14:39 | |
| pabelanger | dmsimard: someday I'll revive my nagios patch | 14:39 |
| dmsimard | pabelanger: no, one of our RDO repositories (using review.rdoproject.org) went out of sync and I was looking if there was a way to be warned about it by something else than a human | 14:40 |
| pabelanger | dmsimard: where are you syncing too, github? | 14:40 |
| dmsimard | yeah | 14:40 |
| *** nmagnezi has joined #openstack-infra | 14:41 | |
| mnaser | tkelsey: this is my reference - http://docs.openstack.org/project-team-guide/stable-branches.html | 14:41 |
| mnaser | i've successfully gotten backported patches by just using that doc as a reference | 14:42 |
| *** otherwiseguy has quit IRC | 14:42 | |
| tkelsey | mnaser: thank you :) will give it a read | 14:42 |
| mtreinish | AJaeger: did you see: http://status.openstack.org/openstack-health/#/g/build_queue/post?groupKey=build_queue&resolutionKey=hour&end=2016-06-07T14:41:34.139Z | 14:42 |
| *** dizquierdo has quit IRC | 14:43 | |
| krotscheck | Is there a way to manually check the status of the dib slave images? | 14:44 |
| * krotscheck would like to know if the xenial image has been rebuilt in the last 18 hours | 14:44 | |
| *** asselin_ has quit IRC | 14:44 | |
| *** bryan_att has quit IRC | 14:44 | |
| *** zeih has joined #openstack-infra | 14:48 | |
| *** yujunz has joined #openstack-infra | 14:48 | |
| *** tzn has quit IRC | 14:49 | |
| *** otherwiseguy has joined #openstack-infra | 14:49 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta puppetmaster group to the expected 'puppetmaster' group https://review.openstack.org/326389 | 14:51 |
| *** hichihara has quit IRC | 14:51 | |
| jeblair | notmorgan: re reraise -- okay, i hadn't gotten farther in the patch chain to know it was going to be special. so yay! :) | 14:52 |
| *** hongbin has joined #openstack-infra | 14:52 | |
| *** zeih has quit IRC | 14:52 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta gerrit group to the expected 'gerrit' group https://review.openstack.org/326515 | 14:53 |
| *** amotoki has joined #openstack-infra | 14:53 | |
| *** tzn has joined #openstack-infra | 14:54 | |
| zxiiro | electrofelix: what do we need to do to make you feel safe with releasing the plugin? Since Sonatype does not provide archives of older releases we're not able to track down which version of the plugin changed the XML so if we were to add backwards comparability we'd be guessing at which version had the older XML (Unfortunately we LF already upgraded our | 14:54 |
| zxiiro | systems months ago before we noticed all of our CLM builds were failing so don't have access to the old plugin anymore). On the other hand we need this patch as our CLM builds are all failing at the moment. | 14:54 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/git-review: Use consistent formatting for deprecations https://review.openstack.org/326538 | 14:55 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/git-review: Deprecate topic mangling for bugs and blueprints https://review.openstack.org/326539 | 14:55 |
| fungi | Julien-zte: thanks for the reminder--it got buried too far down my to do list, but there ^ are a couple simple changes to add the messaging around it now | 14:55 |
| zxiiro | electrofelix: I'm 100% willing to fix backwards comparability if someone comes along with an older version of the plugin and absolutely needs it fixed | 14:55 |
| *** weshay has quit IRC | 14:56 | |
| zxiiro | electrofelix: as far as I'm aware though, we (LF) are the only ones using the CLM plugin since we were the ones who added support for it and no one else has noticed the plugin was completely broken. | 14:56 |
| *** bryan_att has joined #openstack-infra | 14:57 | |
| fungi | mnaser: if nobody's followed up with you yet, what issues are you experiencing? mrmartin is the primary caretaker for its source code, but members of the infra team take care of the server it's running on and have some rudimentary understanding and control over the service itself | 14:58 |
| *** jlanoux has joined #openstack-infra | 14:59 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta zuul group to the expected 'zuul' group https://review.openstack.org/326518 | 14:59 |
| *** mdrabe has quit IRC | 15:00 | |
| fungi | dmsimard: i'm trying to imagine a way to check git repo synchronization without it being too racy and prone to false positives. probably could only trust the git notes gerrit adds to have useful enough timing data to be able to tell the difference between out of sync for days and out of sync because a change merged a few seconds ago | 15:00 |
| *** sree has joined #openstack-infra | 15:01 | |
| fungi | dmsimard: also we have at least one git repo we know is out of sync because github has a lower max object size than gerrit and someone approved a change to their project exceeding it | 15:01 |
| *** vhosakot has joined #openstack-infra | 15:02 | |
| *** regXboi has quit IRC | 15:03 | |
| *** zhurong has quit IRC | 15:03 | |
| electrofelix | zxiiro: ah, good to know. I guess I'm just worried we'll cause a surprise for someone, if they were currently running an older version and hadn't upgraded either their server or plugin installed | 15:04 |
| *** bdemers has quit IRC | 15:05 | |
| fungi | krotscheck: rcarrillocruz has a change proposed to add a status api to nodepool, but until that happens you can look at the image build logs at http://nodepool.openstack.org/ to get some idea of whether the image update worked | 15:05 |
| zxiiro | electrofelix: this change is not server side affecting, it's purely cosmetics on the plugin side. I guess the plugin developer felt a strong need to change the name of an XML parameter from "billofmaterials" to "application-name". So the simple answer for someone using JJB is to tell them to upgrade the plugin as they can still use the same server version | 15:06 |
| zxiiro | with the latest plugin. | 15:06 |
| krotscheck | fungi: Excellent, thanks | 15:06 |
| Julien-zte | thanks fungi, if it is acceptable, I'm glad that you can take some time to have a review. link https://review.openstack.org/#/c/310092/ | 15:06 |
| *** banix has quit IRC | 15:07 | |
| zxiiro | electrofelix: but yeah if someone is surprised by the change, I'm willing to accept all support related contacts for this plugin since we use it. | 15:07 |
| fungi | krotscheck: also i can take a look at the non-public command-line nodepool api in a moment to find out | 15:07 |
| jeblair | clarkb: can you look at https://review.openstack.org/323016 ? | 15:08 |
| fungi | zxiiro: electrofelix: given the nature of the "backward incompatibility" in that change, i think a minor version bump is probably still reasonable, so 1.6.0 seems appropriate | 15:08 |
| zxiiro | fungi: +1 | 15:08 |
| *** aarefiev_ has joined #openstack-infra | 15:08 | |
| *** inc0 has quit IRC | 15:09 | |
| *** e0ne_ has joined #openstack-infra | 15:09 | |
| *** vponomaryov has joined #openstack-infra | 15:09 | |
| fungi | you can only do so much to solve backward incompatibility in plugin support if the plugins themselves don't maintain backward compatible implementations | 15:09 |
| openstackgerrit | Saggi Mizrahi proposed openstack-infra/irc-meetings: Modify Smaug meeting time https://review.openstack.org/322713 | 15:09 |
| *** eeiden has joined #openstack-infra | 15:09 | |
| *** inc0 has joined #openstack-infra | 15:09 | |
| *** vsaienko1 has joined #openstack-infra | 15:10 | |
| *** dizquierdo has joined #openstack-infra | 15:10 | |
| fungi | and if we did a major version bump every time that happened (this is far from the first to run into this scenario) then people would get desensitized to major version bumps and not notice actual significant behavior changing jjb releases | 15:10 |
| *** andreykurilin has joined #openstack-infra | 15:11 | |
| *** andreykurilin1 has quit IRC | 15:11 | |
| electrofelix | zxiiro: guess that clears up all, I'm ok with it if it's not considered breaking :) | 15:11 |
| openstackgerrit | Saggi Mizrahi proposed openstack-infra/irc-meetings: Modify Smaug meeting time https://review.openstack.org/322713 | 15:11 |
| *** aarefiev has quit IRC | 15:12 | |
| mordred | jeblair: your comment on the reraise patch confused me in gertty at first | 15:12 |
| *** e0ne has quit IRC | 15:12 | |
| *** vsaienko has quit IRC | 15:12 | |
| *** vponomaryov1 has quit IRC | 15:12 | |
| mordred | jeblair: since the comment deeper in the patch than the diff caused the diff view to be WAY longer than I was expecting | 15:12 |
| mordred | jeblair: but cool | 15:12 |
| electrofelix | fungi: based on the above I'm happy for 7e94d575cc92a963cbd147acab6f04c9985b5499 to be declared 1.6.0 | 15:12 |
| *** anteaya has joined #openstack-infra | 15:13 | |
| *** rossella_s has joined #openstack-infra | 15:13 | |
| mordred | jeblair: what's the concern with 323016? (so that I can follow along at home) | 15:13 |
| *** tonytan4ever has joined #openstack-infra | 15:14 | |
| *** mdrabe has joined #openstack-infra | 15:14 | |
| mnaser | fungi: sorry i was busy in a small meeting. we're working with a company to create a canada user group and they have asked me to join the group, however, it seems like i'm getting an access denied when logging in to join it - https://groups.openstack.org/groups/canadian-user-group | 15:14 |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-ansible: Change the old meta jenkins group to the expected 'jenkins' group https://review.openstack.org/326569 | 15:15 |
| fungi | mnaser: i wonder, did you apply to create a user group but your application hasn't been approved yet? | 15:16 |
| mnaser | that could be possible. I can check with the person who applied to do that process | 15:16 |
| *** vdrok-afk is now known as vdrok | 15:16 | |
| *** Jeffrey4l has joined #openstack-infra | 15:16 | |
| mnaser | fungi: if that is part of how the process works, then i'll certainly follow up about that | 15:16 |
| fungi | mnaser: i'm not 100% clear on the process, but i think the user groups ambassador for your region has to review the application for a new group and then approve it | 15:16 |
| fungi | looking up the process documentation now | 15:16 |
| *** rcernin has quit IRC | 15:17 | |
| *** e0ne_ has quit IRC | 15:18 | |
| jeblair | mordred: oh, i just wanted clarkb to double check the type assertions there (he added the yappi stuff) | 15:18 |
| *** tphummel has joined #openstack-infra | 15:18 | |
| *** e0ne has joined #openstack-infra | 15:18 | |
| *** psachin has quit IRC | 15:19 | |
| jeblair | mordred: yeah -- i used interactive search inside of gertty to find that place where i put the deep comment! | 15:20 |
| mordred | jeblair: neat! | 15:20 |
| fungi | mnaser: you probably need to check with sean roberts or kenneth hui, based on my interpretation of https://groups.openstack.org/ambassador-program | 15:20 |
| *** itisha has joined #openstack-infra | 15:20 | |
| pabelanger | jeblair: fungi: mind helping 325659 land. Fixes our epel mirror scripts (path error after switching to kernel.org) | 15:20 |
| mnaser | fungi gotcha, ill try to follow up! thank you | 15:21 |
| jeblair | pabelanger: +3 | 15:21 |
| *** sneti has joined #openstack-infra | 15:21 | |
| *** cloudtrainme has joined #openstack-infra | 15:22 | |
| pabelanger | jeblair: danke | 15:22 |
| *** sorantis has quit IRC | 15:24 | |
| sneti | Hi all, I'm facing issues logging into https://wiki.openstack.org/wiki/Main_Page. Getting HTTP Error 500. Can anyone help me with this. | 15:25 |
| clarkb | jeblair: lgtm but I am semi distraced by czech beer | 15:25 |
| *** links has quit IRC | 15:26 | |
| *** weshay has joined #openstack-infra | 15:27 | |
| fungi | sneti: are you trying to edit something or add a new page? | 15:27 |
| pabelanger | jeblair: Here is 1 of 4 timeouts that happened over night: http://paste.openstack.org/raw/508697/ | 15:27 |
| *** _shaps_ has quit IRC | 15:27 | |
| fungi | sneti: we've semi-temporarily disabled new account creation on wiki.openstack.org because spammers have been a serious problem | 15:27 |
| openstackgerrit | Merged openstack-infra/zuul: Python 3 Fix: use six.moves.urillib https://review.openstack.org/323014 | 15:28 |
| *** arxcruz has quit IRC | 15:28 | |
| pabelanger | jeblair: the good news is watchdog worked and logs were uploaded. | 15:28 |
| *** sdake has joined #openstack-infra | 15:28 | |
| openstackgerrit | Merged openstack-infra/infra-ansible: Add generate infra dynamic inventory playbook/role https://review.openstack.org/325858 | 15:29 |
| jeblair | pabelanger: yay! :( | 15:29 |
| anteaya | speaking of was there any headway made into upgrading the wiki server? I didn't hear of any progress there, just wondering if I missed anything | 15:30 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add TripleO blogs from Marios to planet TripleO https://review.openstack.org/326493 | 15:32 |
| *** sarob has joined #openstack-infra | 15:33 | |
| *** mikelk has quit IRC | 15:33 | |
| fungi | none that i've heard. i'm tempted to try standing up a fresh wiki-dev.o.o and look into how to migrate our data and configuration to it. unfortunately the modules on the puppetforge all look pretty stale (the most recently active one of the three at https://forge.puppet.com/tags/mediawiki still hasn't had any new commits for two years) | 15:34 |
| openstackgerrit | Merged openstack-infra/system-config: Fix epel-mirror path error https://review.openstack.org/325659 | 15:34 |
| *** Swami has joined #openstack-infra | 15:34 | |
| *** Swami_ has joined #openstack-infra | 15:34 | |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: experimenting with local.conf https://review.openstack.org/326585 | 15:34 |
| *** tpsilva has joined #openstack-infra | 15:35 | |
| *** tzn has quit IRC | 15:35 | |
| fungi | also it looks like using distro packages (at least in debian derivatives like ubuntu) is no longer a sane option... https://bugs.debian.org/783503 | 15:37 |
| openstack | Debian bug 783503 in mediawiki "mediawiki: not suitable for Stretch" [Serious,Fixed] | 15:37 |
| *** sarob has quit IRC | 15:37 | |
| *** lifeless has quit IRC | 15:37 | |
| fungi | the package was dropped from ubuntu before xenial | 15:37 |
| *** vhosakot has quit IRC | 15:38 | |
| anteaya | fungi: :( | 15:38 |
| pabelanger | jeblair: in the case of 1469004: http://paste.openstack.org/show/508701/ it looks like watchdog simply killed the job mind run: http://logs.openstack.org/81/326181/1/check/gate-kolla-dsvm-build-oraclelinux-binary/f46e165/console.html. Which to me suggests the job timeout didn't fire and watchdog recovered it | 15:38 |
| anteaya | fungi: should we discuss it at today's meeting? | 15:38 |
| pabelanger | jeblair: checking another failure | 15:38 |
| fungi | anteaya: i'm planning to propose adding it to the priority efforts list, but need to write up a spec | 15:39 |
| anteaya | fungi: would you like me to take an initial run at the spec and you can fill in the gaps? | 15:40 |
| fungi | which means 1. figuring out if our volunteers from the summit discussion are still planning to work on getting it upgraded, or 2. figuring out myself how it should happen | 15:40 |
| *** sree has quit IRC | 15:40 | |
| sneti | fungi, I was trying to create a new page | 15:40 |
| anteaya | fungi: I can start in an etherpad and fill in the obvious bits | 15:40 |
| anteaya | fungi: well it would be a good evaluation of who actually wants to keep it around | 15:41 |
| fungi | anteaya: well, if our volunteers for working through the upgrade are still on board, i'd prefer they did the research on what the best course of action to do that is | 15:41 |
| anteaya | fungi: okay fair enough | 15:41 |
| fungi | (whether there are rpms suitable for centos 7 or if we should still be installing from source or what) | 15:41 |
| *** hashar is now known as hasharAway | 15:41 | |
| fungi | sneti: have you ever created/edited any pages on wiki.openstack.org before? what new page were you trying to create? | 15:42 |
| nibalizer | i think that was pabelanger with some support from me | 15:42 |
| anteaya | I guess I'm saying I'm willing to help get attention on it, and welcome direction as to what to do, to do that, I'm not interested in upgrading the server myself | 15:42 |
| *** yujunz has quit IRC | 15:42 | |
| anteaya | I already have commited to storyboard | 15:42 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: remove duplicate jobs for aodh and gnocchi https://review.openstack.org/326589 | 15:42 |
| anteaya | hey nibalizer | 15:42 |
| nibalizer | hi anteaya | 15:42 |
| fungi | yeah, and the important parts of the wiki upgrade spec will be figuring out the most sane way of deploying a newer release of it on a new distro version | 15:43 |
| fungi | so without someone determining that, the spec would be at most a placeholder | 15:43 |
| sneti | fungi, I'm working on Openstack-nova project. I had to create a wiki page on config options consistency. Since I was not able to login, took friends help and created it. Didn't know who to contact yesterday. | 15:44 |
| *** mtanino has joined #openstack-infra | 15:44 | |
| fungi | most of the centos 7 walkthroughs i'm finding are also for installation from source... so i get the impression there's just no interest in the mediawiki ecosystem for having actual distro packages of it maintained | 15:44 |
| AJaeger | mtreinish: thanks! Do you also have a good link for the periodic translations jobs? | 15:44 |
| fungi | sneti: try logging in again now | 15:45 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: disable voting on puppet-ceph beaker jobs https://review.openstack.org/326591 | 15:45 |
| fungi | sneti: i've temporarily reenabled new account creation for a few minutes | 15:45 |
| *** tphummel has quit IRC | 15:45 | |
| sneti | fungi, thank you so much..I'm able to login | 15:46 |
| fungi | sneti: great--thanks for confirming. i've turned new account creation back off again for now | 15:46 |
| *** abregman has joined #openstack-infra | 15:47 | |
| pleia2 | good morning | 15:47 |
| sneti | fungi, ok.. | 15:47 |
| mtreinish | AJaeger: http://status.openstack.org/openstack-health/#/g/build_queue/periodic?groupKey=build_queue&searchJob=translation | 15:47 |
| anteaya | morning pleia2 | 15:48 |
| *** lifeless has joined #openstack-infra | 15:49 | |
| *** bdemers has joined #openstack-infra | 15:49 | |
| *** ihrachys has quit IRC | 15:51 | |
| jeblair | fungi: maybe account creation should have office hours? alternate tuesdays between 15:40 and 15:55, every wednesday from 17:13 to 17:23 and the first thursday of the month from 00:36 to 00:47. | 15:51 |
| AJaeger | mtreinish: thanks, that's usefull - now I'm understanding better how to select | 15:52 |
| fungi | jeblair: heh. make it confusing enough the spammers can't figure it out even from the documentation? ;) | 15:52 |
| *** vhosakot has joined #openstack-infra | 15:52 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use six.reraise https://review.openstack.org/323015 | 15:52 |
| *** harlowja_at_home has joined #openstack-infra | 15:52 | |
| notmorgan | jeblair, mordred: ^ fixed and keeping the similar pattern as we had before. | 15:52 |
| *** andreas_s has quit IRC | 15:53 | |
| notmorgan | jeblair: and good call on fixing the args :) | 15:54 |
| *** Swami_ has quit IRC | 15:54 | |
| mtreinish | AJaeger: one thing I just notice on that 2nd link I pasted, it looks like there is a bug and the graphs don't update with the filter (we do that on other pages) | 15:54 |
| *** Swami has quit IRC | 15:54 | |
| *** harlowja_at_home has quit IRC | 15:54 | |
| * AJaeger started wondering already where the failures come from... | 15:55 | |
| *** EricGonczer_ has quit IRC | 15:57 | |
| *** vincentll has quit IRC | 15:57 | |
| *** armax has joined #openstack-infra | 15:58 | |
| *** rossella_s has quit IRC | 15:59 | |
| mtreinish | AJaeger: https://bugs.launchpad.net/openstack-health/+bug/1590059 | 16:00 |
| openstack | Launchpad bug 1590059 in OpenStack Health "Per group page graphs don't update with regex filter" [Undecided,New] | 16:00 |
| *** dizquierdo has quit IRC | 16:01 | |
| *** gokrokve has joined #openstack-infra | 16:02 | |
| *** EricGonczer_ has joined #openstack-infra | 16:02 | |
| *** inc0 has quit IRC | 16:06 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-nodepool: Fix duplicated package for build-essential https://review.openstack.org/326605 | 16:06 |
| *** yamahata has quit IRC | 16:11 | |
| *** armax has quit IRC | 16:12 | |
| *** tesseract has quit IRC | 16:13 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 fix: Use six.reraise https://review.openstack.org/321926 | 16:14 |
| *** Apoorva has joined #openstack-infra | 16:14 | |
| *** matrohon has quit IRC | 16:14 | |
| *** Apoorva has quit IRC | 16:15 | |
| *** armax has joined #openstack-infra | 16:16 | |
| *** Apoorva has joined #openstack-infra | 16:16 | |
| *** vgridnev has quit IRC | 16:16 | |
| *** dprince has quit IRC | 16:17 | |
| *** r-daneel has quit IRC | 16:17 | |
| fungi | heading out to vote and get some lunch, should be back in plenty of time to finish prepping for our weekly meeting | 16:19 |
| rcarrillocruz | fungi , nibalizer : i don't think i will be able to attend the meeting , if you chat about specs cleanup i'm more than happy to take on ansible-puppet if nibalizer writes down a list of issues | 16:19 |
| *** asettle has quit IRC | 16:19 | |
| rcarrillocruz | responded to thread on mailing list as well | 16:19 |
| *** ajmiller_ has joined #openstack-infra | 16:19 | |
| *** abregman is now known as abregman|nb | 16:20 | |
| anteaya | fungi: happy voting, enjoy lunch | 16:21 |
| *** ajmiller has quit IRC | 16:23 | |
| nibalizer | rcarrillocruz: sure thing | 16:23 |
| nibalizer | I think I will also be out for the meeting so yep | 16:23 |
| *** dizquierdo has joined #openstack-infra | 16:24 | |
| *** amotoki has quit IRC | 16:24 | |
| jeblair | mordred: a +3 on https://review.openstack.org/323015 sends the whole branch in | 16:24 |
| *** jaosorior has quit IRC | 16:24 | |
| *** jaosorior has joined #openstack-infra | 16:24 | |
| *** ifarkas has quit IRC | 16:25 | |
| *** armax has quit IRC | 16:25 | |
| *** salv-orl_ has joined #openstack-infra | 16:25 | |
| *** jaosorior has quit IRC | 16:26 | |
| *** r-daneel has joined #openstack-infra | 16:26 | |
| *** salv-orlando has quit IRC | 16:27 | |
| mordred | jeblair, notmorgan: BOOM | 16:28 |
| *** LaT0rtue has joined #openstack-infra | 16:29 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add text option to tripleo-jobs-gerrit.py https://review.openstack.org/326632 | 16:29 |
| notmorgan | mordred: woo | 16:29 |
| notmorgan | jeblair, mordred: need to keep chasing some handling of queue differences in py2/py3 but it's getting close. I think i've chased down the nodepool bytes issue too, turns out i might have another fix needed for gear :( | 16:29 |
| *** dmk0202 has quit IRC | 16:30 | |
| jeblair | notmorgan: i like it when gear gets better | 16:30 |
| notmorgan | jeblair: yeah so do i, but i feel bad that we just released a few fixes and there might be more ;) | 16:31 |
| mordred | notmorgan: is that why the py3 unit tests still aren't green? | 16:31 |
| jeblair | fungi, mordred, pabelanger: i could use some help knowing what to do after a launch-node failure... | 16:31 |
| notmorgan | mordred: in nodepool, i am working on bytes conversion (vs. string) and running into some oddities. likely zuul will be in the same boat. | 16:31 |
| jeblair | fungi, mordred, pabelanger: http://paste.openstack.org/show/508718/ | 16:31 |
| mordred | jeblair: looking | 16:32 |
| notmorgan | mordred: basically, yes. it is why py3 tests aren't green yet. | 16:32 |
| mordred | notmorgan: nod | 16:32 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Add timeout to deploy.sh https://review.openstack.org/326634 | 16:32 |
| mordred | jeblair: uhm | 16:32 |
| *** dtantsur is now known as dtantsur|afk | 16:33 | |
| mordred | jeblair, pabelanger: it feels like there is some output missing somewhere | 16:33 |
| mordred | is it going into the logs? | 16:33 |
| pabelanger | mordred: jeblair: looks like puppet failes to run. I would add --keep and check syslog on the new server | 16:34 |
| pabelanger | that's what I did for the precise migration | 16:34 |
| jeblair | pabelanger: i did have --keep, i'll check the server | 16:34 |
| mordred | ah. yah. syslog on the server in question | 16:34 |
| pabelanger | jeblair: great | 16:34 |
| jeblair | did we come up with a plan to improve this at the summit? | 16:34 |
| mordred | I think we have a todo list item to do logging in both places, don't we? | 16:34 |
| mordred | yah | 16:34 |
| mordred | I tink we did | 16:34 |
| jeblair | i have some kind of vague recollection about that | 16:34 |
| mordred | I do not think it has been implemented yet | 16:34 |
| *** EricGonczer_ has quit IRC | 16:34 | |
| jeblair | i think i might even have volunteered to do it | 16:34 |
| mordred | idea was "have it syslog on the server but ALSO have it log on the master" | 16:35 |
| jeblair | but i can not for the life of me remember what the plan was | 16:35 |
| mordred | because logs in both places are useful | 16:35 |
| *** e0ne has quit IRC | 16:35 | |
| *** yamahata has joined #openstack-infra | 16:35 | |
| mordred | at different times | 16:35 |
| jeblair | how do we have it log on the master...? | 16:35 |
| * mordred waves hands and runs away | 16:35 | |
| *** anteaya has quit IRC | 16:35 | |
| mordred | jeblair: I remember that we had an impl idea for that | 16:35 |
| *** e0ne has joined #openstack-infra | 16:35 | |
| mordred | but I do not remember what it is | 16:35 |
| pabelanger | I think we talked about 1): copy syslog off remote server. 2) stream to syslog server | 16:35 |
| mordred | I _think_ we can set up puppet to log to both syslog and to stdout | 16:35 |
| jeblair | mordred: yes, we can do that | 16:36 |
| mordred | so that the command on the master has access to the stdout/stderr and can log it locally on error or whatnot | 16:36 |
| jeblair | but when we go to stdout, it ends up in a giant one line json blob | 16:36 |
| *** mriedem_afk is now known as mriedem | 16:36 | |
| mordred | yah. I think there was something we were going to do with it master-side | 16:36 |
| mordred | to make that unsuck | 16:36 |
| jeblair | could a callback plugin do that? | 16:36 |
| mordred | yah | 16:36 |
| mordred | jeblair: ever written one of those? | 16:37 |
| *** savihou has quit IRC | 16:37 | |
| jeblair | so maybe i was going to write a callback plugin that took the ansible-puppet-role log output and plopped it on the master | 16:37 |
| pabelanger | that sounds familiar | 16:37 |
| *** jlanoux has quit IRC | 16:37 | |
| mordred | yah | 16:37 |
| jeblair | yay! this was helpful! | 16:37 |
| *** anteaya has joined #openstack-infra | 16:37 | |
| jeblair | i will probably not do that right this moment, but soon. | 16:37 |
| *** jerryz has joined #openstack-infra | 16:38 | |
| mordred | it's possible that the one you've already written for zuul might be useful and/or the same | 16:38 |
| mordred | it's also possible that they're different enough to need to be two different things | 16:38 |
| *** nadya has joined #openstack-infra | 16:38 | |
| openstackgerrit | Brian Stajkowski proposed openstack-infra/project-config: New Project Quark Plugin https://review.openstack.org/319368 | 16:40 |
| jeblair | mordred: yeah, the zuul callback plugin is about timeouts -- the other stuff is all modules | 16:40 |
| jeblair | so probably different | 16:40 |
| *** nadya_ has joined #openstack-infra | 16:40 | |
| *** e0ne has quit IRC | 16:40 | |
| *** derekh has quit IRC | 16:40 | |
| jeblair | corvus@23.253.92.197's password: | 16:41 |
| jeblair | oh | 16:41 |
| jeblair | so that's not going to work. | 16:41 |
| jeblair | pabelanger, mordred: i don't think it got far enough to install my ssh key. | 16:41 |
| *** tonytan4ever has quit IRC | 16:41 | |
| *** e0ne has joined #openstack-infra | 16:41 | |
| *** nadya has quit IRC | 16:42 | |
| jeblair | but hey, that private key in tmp still exists! | 16:42 |
| *** sorantis has joined #openstack-infra | 16:42 | |
| jeblair | Jun 6 23:43:27 zlstatic01 puppet-user[19632]: Could not find data item gerrit_ssh_rsa_pubkey_contents in any Hiera data file and no default supplied at /opt/system-config/production/manifests/site.pp:911 on node zlstatic01.openstack.org | 16:42 |
| *** SumitNaiksatam has quit IRC | 16:43 | |
| jeblair | there is 0 hieradata on the host | 16:43 |
| pabelanger | jeblair: so, I've had this issue. Two things to check. 1) are you running playbook as root? (non-root cannot access hieradata on puppetmaster.o.o) 2) are you using group hieradata files? (because I think there is a bug in our ansible playbooks) | 16:44 |
| *** cloudtrainme has quit IRC | 16:45 | |
| jeblair | pabelanger: i am not running as root | 16:45 |
| kzaitsev_mb | are jenkins/zuul feeling good? I have a patch, that with all the jobs green and finished, but it's hanging in that state 20 mins approx | 16:46 |
| jeblair | i will re-run as root | 16:46 |
| kzaitsev_mb | http://status.openstack.org/zuul/ patch no 326178 | 16:46 |
| kzaitsev_mb | and it's gone ) | 16:46 |
| kzaitsev_mb | sorry for bothering | 16:46 |
| jeblair | kzaitsev_mb: glad to help! :) | 16:46 |
| pabelanger | jeblair: so that is the issue. My suggestion was to add puppet:puppet to /etc/puppet/hieradata to allow non-root to access the data to use launch-node.py | 16:46 |
| kzaitsev_mb | (= | 16:46 |
| jeblair | pabelanger: yeah, i'd be okay with that | 16:47 |
| pabelanger | jeblair: okay, let me see if that directory is controlled by puppet | 16:47 |
| *** Kiall has quit IRC | 16:47 | |
| *** Swami has joined #openstack-infra | 16:47 | |
| *** Swami has quit IRC | 16:48 | |
| *** nadya_ has quit IRC | 16:48 | |
| *** Swami has joined #openstack-infra | 16:48 | |
| *** e0ne has quit IRC | 16:49 | |
| cinerama | hey hey SpamapS | 16:49 |
| *** nadya has joined #openstack-infra | 16:49 | |
| *** Kiall has joined #openstack-infra | 16:50 | |
| *** lucasagomes is now known as lucas-dinner | 16:52 | |
| *** dprince has joined #openstack-infra | 16:53 | |
| *** psilvad has quit IRC | 16:54 | |
| SpamapS | cinerama: o/ | 16:54 |
| *** sarob has joined #openstack-infra | 16:54 | |
| *** psilvad has joined #openstack-infra | 16:55 | |
| *** nwkarsten has quit IRC | 16:55 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add root:puppet permissions to hieradata https://review.openstack.org/326649 | 16:56 |
| pabelanger | jeblair: that should work ^ | 16:56 |
| cinerama | SpamapS, was wondering how we can get a release of glean. we'd like to land https://review.openstack.org/#/c/315862/ | 16:56 |
| notmorgan | jeblair, mordred: fixing pep8 and such for six.reraise | 16:57 |
| notmorgan | jeblair, mordred: doh! | 16:57 |
| JayF | should I expect things like stats.zuul.pipeline.gate.job.gate-tempest-dsvm-ironic-pxe_ipa.wait_time to be populated? | 16:57 |
| notmorgan | jeblair: also - http://logs.openstack.org/15/323015/7/check/gate-zuul-python27-db/8ec60e9/console.html this is an example of the weird error i was seeing in py2 | 16:58 |
| JayF | Trying to prove that the irnoic job changes made things faster and I can't find the metric in graphite :/ | 16:58 |
| notmorgan | jeblair: no clear error, but a test failure. | 16:58 |
| *** sarob has quit IRC | 16:58 | |
| *** flwang1 has joined #openstack-infra | 16:58 | |
| pabelanger | AJaeger: mind helping 326122 land? | 16:58 |
| AJaeger | pabelanger: let me check... | 16:59 |
| pabelanger | AJaeger: great, thanks | 17:00 |
| *** sarob has joined #openstack-infra | 17:01 | |
| *** sarob has quit IRC | 17:01 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use six.reraise https://review.openstack.org/323015 | 17:01 |
| notmorgan | jeblair, mordred: fixed the pep8 failure. | 17:01 |
| jeblair | notmorgan: yeah, that is the testtools hard timeout fixture striking | 17:02 |
| *** sarob has joined #openstack-infra | 17:02 | |
| *** bdemers_ has joined #openstack-infra | 17:02 | |
| jeblair | notmorgan: with logs, i could address the underlying problem, but we don't get it with that fixture | 17:02 |
| *** r-daneel has quit IRC | 17:02 | |
| *** dizquierdo has quit IRC | 17:02 | |
| notmorgan | jeblair: yep. exactly what i've been running into - and it seems to coinside with the socket oddities. | 17:02 |
| *** trown is now known as trown|lunch | 17:02 | |
| *** sputnik13 has joined #openstack-infra | 17:03 | |
| *** banix has joined #openstack-infra | 17:03 | |
| *** nadya_ has joined #openstack-infra | 17:03 | |
| AJaeger | jroll, TheJulia : Could you review https://review.openstack.org/#/c/326203/ , please? | 17:03 |
| notmorgan | jeblair: but that aside, i'll keep trying to look for logs on it when i see it here locally. | 17:03 |
| SpamapS | cinerama: Oh I think we should probably just look at releasing if we have the fixed network_data.json reading landed. | 17:03 |
| jeblair | notmorgan: that would be swell! | 17:04 |
| *** nadya has quit IRC | 17:04 | |
| notmorgan | jeblair: but it's infrequent. | 17:04 |
| openstackgerrit | Eric Peterson proposed openstack-infra/jenkins-job-builder: Add git tag parameter support https://review.openstack.org/326656 | 17:05 |
| *** ducttape_ has joined #openstack-infra | 17:05 | |
| jeblair | pabelanger, mordred: running as root, i got common.yaml installed. but it's also supposed to get group/zuul-merger.yaml | 17:05 |
| jeblair | and that didn't show up | 17:05 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/nodepool: Python 3 fix: Use six.reraise https://review.openstack.org/321926 | 17:05 |
| *** bdemers has quit IRC | 17:05 | |
| *** Apoorva_ has joined #openstack-infra | 17:06 | |
| mordred | SpamapS, cinerama: ++ | 17:06 |
| AJaeger | mordred: is https://review.openstack.org/315632 still needed? | 17:06 |
| mordred | AJaeger: looking | 17:07 |
| *** eharney has quit IRC | 17:07 | |
| *** timothyb89 has quit IRC | 17:07 | |
| *** nadya has joined #openstack-infra | 17:08 | |
| *** nadya_ has quit IRC | 17:08 | |
| jeblair | pabelanger, mordred: this looks correct: zuul-merger ~z[lm](static)?\d+\.openstack\.org | 17:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add zuul-worker public key to nodepool.o.o https://review.openstack.org/323539 | 17:08 |
| *** vgridnev has joined #openstack-infra | 17:08 | |
| *** sarob has quit IRC | 17:08 | |
| *** Apoorva has quit IRC | 17:08 | |
| *** sarob has joined #openstack-infra | 17:09 | |
| *** timothyb89 has joined #openstack-infra | 17:09 | |
| *** EricGonczer_ has joined #openstack-infra | 17:09 | |
| *** nadya_ has joined #openstack-infra | 17:12 | |
| *** nadya has quit IRC | 17:13 | |
| cinerama | SpamapS, mordred: +1 releasing the things | 17:13 |
| *** tonytan4ever has joined #openstack-infra | 17:13 | |
| *** nadya_ has quit IRC | 17:14 | |
| jeblair | pabelanger, mordred: oh, something about generated-groups | 17:14 |
| jeblair | how does that get created? | 17:14 |
| pabelanger | jeblair: so, that was the other bug. I believe our ansible playbook doesn't setup our inventory file correctly. I think we need to update launch-node.py to generate the following inventory: http://paste.openstack.org/show/508724/ | 17:15 |
| pabelanger | mordred: ^ | 17:15 |
| pabelanger | today we are missing the section header | 17:15 |
| pabelanger | which then our ansible-puppet playbook fails to copy over our group inventory | 17:15 |
| *** r-daneel has joined #openstack-infra | 17:15 | |
| jeblair | ah yeah, we will run expand-groups in the launch script *after* the host is set up -- to create update the system generated-groups file | 17:16 |
| pabelanger | s/ansible playbook/launch-node.py | 17:16 |
| *** shashank_hegde has joined #openstack-infra | 17:16 | |
| *** johnny has joined #openstack-infra | 17:16 | |
| *** jordanP has joined #openstack-infra | 17:16 | |
| SpamapS | I don't think I have release powers for glean though | 17:16 |
| *** nwkarsten has joined #openstack-infra | 17:16 | |
| *** nwkarsten has quit IRC | 17:17 | |
| *** johnny is now known as Guest48552 | 17:17 | |
| jeblair | pabelanger: but can launch-node use generated-groups? | 17:17 |
| *** shashank_hegde has quit IRC | 17:17 | |
| jeblair | pabelanger: maybe if we had launch-node run expand-groups after server creation but before running ansible.... | 17:17 |
| pabelanger | jeblair: I don't think so. What I ended up doing was write a simple patch to hardcode my group value. But, I'm having trouble locating the patch atm | 17:17 |
| jeblair | pabelanger: i'm going to run expand-groups now to add that to the file, then re-run to test. | 17:17 |
| pabelanger | jeblair: the issue I had, I didn't know a clean way to get the $group var from puppet into launch-node.py, without passing it via the CLI | 17:18 |
| pabelanger | jeblair: okay | 17:18 |
| jeblair | pabelanger: technically in this case we want the ansible groups, not the puppet group | 17:18 |
| mordred | jeblair, pabelanger: you need the group because the secrets are in group vars? | 17:19 |
| jeblair | pabelanger: (which is done by applying regexes from group.txt) | 17:19 |
| jeblair | mordred: i need the group so that the group hiera file is copied | 17:19 |
| mordred | yah | 17:19 |
| mordred | k. so it's not really an expand groups thing, since this is a temporary inventory that's written out for the purposes of this run (since hte server may not become fully live) | 17:20 |
| mordred | however, it's possible that the reasoning of doing that is bong | 17:20 |
| mordred | and perhaps doing what jeblair just said is a better approach | 17:20 |
| jeblair | i'm testing it now | 17:20 |
| mordred | cool | 17:20 |
| mordred | sorry, I was mostly talking out loud as I was considering your words | 17:20 |
| *** PollyZ has quit IRC | 17:20 | |
| jeblair | mordred: i understand the reasoning/hesitation there | 17:20 |
| anteaya | fungi: the work items got kind of jammed together in the final version, I'm going to offer a patch that spreads them out a bit: http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html#work-items | 17:20 |
| pabelanger | Ya, I didn't know a better way to access: {{ hostvars[inventory_hostname].group_names }} aside from using the inventory file | 17:21 |
| mordred | jeblair: I think we really do need either a delete-node script, a "re-run all the things after any deleted nodes" script - or ricky's thing too ... not urgently/right now - but I think we want to make sure to delete the cache and re-run expand-hosts after deletes as well | 17:22 |
| pabelanger | cloudnull: did you see my question yesterday about OSIC and public IPs? Was just following up to see if you see the issue | 17:22 |
| mordred | pabelanger: we don't need 315632 as it currently exists - we might still need it for bluebox | 17:23 |
| jeblair | mordred, pabelanger: that didn't work. zlstatic01 was in the generated-groups file, but the zuul-merger hiera did not get copied | 17:23 |
| *** TravT has joined #openstack-infra | 17:24 | |
| pabelanger | mordred: odd, I thought we landed that already. Checking history | 17:24 |
| *** amotoki has joined #openstack-infra | 17:24 | |
| mordred | jeblair: oh. yeah. so - generated-groups is in /etc/ansible/hosts - but that is not in the temporary inventory path | 17:24 |
| TravT | so, what's the trick to sign in to gerrit now? | 17:24 |
| jeblair | mordred: i sort of thought it would still be falling back on the system inventory directory for groups, but i guess when you say "-i" that excludes all of that. | 17:24 |
| mordred | jeblair: yes. inventories are completely exclusive | 17:25 |
| *** jordanP has quit IRC | 17:25 | |
| mordred | jeblair: what if we just make this much simpler | 17:25 |
| jeblair | mordred: then i think we need to do what pabelanger was saying and put the header at the top of the tmp inventory file, but we have to figure out what groups it is a member of | 17:25 |
| jeblair | mordred: i like simpler | 17:26 |
| mordred | jeblair: well, as I was writing I may have changed my mind - let me offer two different suggestions | 17:26 |
| *** nwkarsten has joined #openstack-infra | 17:26 | |
| openstackgerrit | Eric Peterson proposed openstack-infra/jenkins-job-builder: Add git tag parameter support https://review.openstack.org/326656 | 17:26 |
| openstackgerrit | Merged openstack-infra/project-config: Add stats for zuul launchers https://review.openstack.org/326122 | 17:27 |
| mordred | suggestion a) more rube, but quicker to do: make the temporary inventory a directory, not a file. write a file to it that's like the one we're writing now. then run expand-groups. then symlink the generated groups file into the temporary inventory directory | 17:27 |
| *** mriedem has quit IRC | 17:27 | |
| *** mriedem has joined #openstack-infra | 17:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Add nova-lxd to openstack https://review.openstack.org/324667 | 17:27 |
| jeblair | mordred: i agree that should work | 17:28 |
| mordred | suggestion b) simpler but has one possible race condition: stop doing temp inventory writing altogether. run expand-groups as you just did, but leave off -i and use the system inventory | 17:28 |
| mordred | (after having removed the inventory cache) | 17:28 |
| anteaya | I'm getting an ubuntu one delay trying to log into storyboard and launchpad, I'm already logged into gerrit | 17:28 |
| *** denisra has joined #openstack-infra | 17:28 | |
| *** sjmc7 has joined #openstack-infra | 17:28 | |
| mordred | the race condition being that system cron could attempt to run puppet on the host while launch node is running puppet on the host - but that's probably ok in more cases than the current system breaks | 17:28 |
| *** amotoki has quit IRC | 17:29 | |
| jeblair | mordred: i think we have that race condition once every 24 hours now. i do think it's highly likely to happen if we go with suggestion b though. | 17:29 |
| jeblair | so i think we should do (a) and defer (b) until we have some kind of solution to the race | 17:30 |
| *** tphummel has joined #openstack-infra | 17:32 | |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: experimenting with local.conf https://review.openstack.org/326585 | 17:32 |
| *** cloudtrainme has joined #openstack-infra | 17:32 | |
| jeblair | mordred, pabelanger: shall i hack option (a) up real quick? | 17:35 |
| sambetts | Hey, is the gerrit sign in broken? Im seeing a "Provider is not supported, or was incorrectly entered." error | 17:37 |
| pabelanger | jeblair: mordred: I haven't fully grasped (a) at the moment. | 17:37 |
| *** PollyZ has joined #openstack-infra | 17:37 | |
| anteaya | sambetts: yes I too have encountered a problem with ubuntuone our sso provider | 17:38 |
| anteaya | in that the sso provider is hanging | 17:38 |
| sambetts | \o/ not just me then | 17:38 |
| anteaya | no, not just you | 17:39 |
| anteaya | thus far noone able to address the problem has addressed it that I know of though | 17:39 |
| sjmc7 | https://login.ubuntu.com/ is down | 17:39 |
| *** salv-orl_ has quit IRC | 17:41 | |
| *** shardy has quit IRC | 17:41 | |
| anteaya | sjmc7: yes are you reporting it for our benefit or have you any ability to address the issue? | 17:41 |
| *** salv-orlando has joined #openstack-infra | 17:41 | |
| sjmc7 | i don’t have any ability to address it | 17:41 |
| anteaya | sjmc7: thank you for reporting | 17:41 |
| mat128 | sambetts: getting it too :P | 17:41 |
| mat128 | sambetts: and getting 401s on https://review.openstack.org/login/static/title.png | 17:41 |
| *** PollyZ has quit IRC | 17:42 | |
| * sambetts can't find any status page for the service, and the last message on the ubuntuone twitter account was from 2014 | 17:43 | |
| *** HeOS has quit IRC | 17:43 | |
| bkero | I just came here to report the same thing. http://staff.osuosl.org/~bkero/login.png | 17:43 |
| sjmc7 | anyone know anyone at canonical? | 17:44 |
| bkero | lol | 17:44 |
| *** sambetts is now known as sambetts|afk | 17:44 | |
| *** tonytan4ever has quit IRC | 17:44 | |
| anteaya | is there anyone aware of the issue with ubuntuone that can take any beneficial action? | 17:44 |
| *** tkelsey has quit IRC | 17:44 | |
| anteaya | and can perhaps report back to this channel? | 17:44 |
| bkero | I asked in #ubuntu-one | 17:45 |
| bkero | err, #ubuntuone | 17:45 |
| *** signed8bit has joined #openstack-infra | 17:45 | |
| *** Sukhdev has joined #openstack-infra | 17:46 | |
| anteaya | bkero: thanks very much | 17:47 |
| *** ducttape_ has quit IRC | 17:47 | |
| *** Sukhdev has quit IRC | 17:48 | |
| *** asettle has joined #openstack-infra | 17:49 | |
| *** asettle has quit IRC | 17:49 | |
| *** asettle has joined #openstack-infra | 17:49 | |
| *** PollyZ has joined #openstack-infra | 17:51 | |
| *** shashank_hegde has joined #openstack-infra | 17:52 | |
| *** flepied1 has quit IRC | 17:52 | |
| *** cloudtrainme has quit IRC | 17:53 | |
| fungi | jeblair: what pabelanger describes is what i've had to end up doing for launch-node failure troubleshooting | 17:53 |
| bkero | anteaya: I'll post here if I get a reply | 17:53 |
| jeblair | pabelanger: the idea behind option (a) is to use generate-groups to create the group mapping, and then incorporate that into the temporary inventory (via symlink) | 17:54 |
| jeblair | pabelanger: that way we don't need to do anything special to figure out the group membership | 17:54 |
| fungi | jeblair: improving launch-node logging is one of the fallout bugs from the ansible migration which rcarrillocruz is volunteering to help tackle as nibalizer is strapped for free time | 17:54 |
| jeblair | oh, so i'm not on the hook for that? | 17:54 |
| anteaya | bkero: thank you, I was just looking in #ubuntuone to see if I could find out where they post their logs, so far I can't see it in the topic | 17:54 |
| bkero | anteaya: neither can I | 17:55 |
| anteaya | bkero: okay thanks, the topic says the channel is logged so I just clicked all the links in the topic but some aren't resoving for me yet | 17:55 |
| *** PollyZ has quit IRC | 17:55 | |
| bkero | anteaya: It's back up | 17:56 |
| bkero | sjmc7, mat128: service restored | 17:56 |
| bkero | sambetts|afk: ^ | 17:56 |
| fungi | anteaya: formatting issue? just propose it and if the draft version looks correct i'm happy to approve. no formal council vote required | 17:56 |
| anteaya | bkero: thank you | 17:56 |
| sjmc7 | yay! thanks bkero | 17:56 |
| anteaya | fungi: thanks, will do | 17:56 |
| *** oanson has joined #openstack-infra | 17:57 | |
| fungi | i just sort of skimmed scrollback and mostly only paid attention to my nick highlights. if anybody still needs help with stuff let me know, otherwise i'm prepping for our meeting in an hour | 17:57 |
| *** sjmc7 has left #openstack-infra | 17:58 | |
| *** eharney has joined #openstack-infra | 17:58 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use bytesIO instead of cStringIO https://review.openstack.org/323016 | 17:58 |
| *** rwsu has quit IRC | 17:58 | |
| anteaya | fungi: ack and Zara has some agenda items to add | 17:58 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: use proper octal notation https://review.openstack.org/323017 | 17:58 |
| anteaya | fungi: should she edit herself or tell you at this point? | 17:58 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: Absolute Imports https://review.openstack.org/323018 | 17:58 |
| *** vgridnev has quit IRC | 17:59 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: use six.moves.configparser https://review.openstack.org/323020 | 17:59 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Replace missing builtins https://review.openstack.org/324205 | 17:59 |
| pleia2 | I found a change from a while back from mrmartin re: upgrading groups-dev.o.o and I see it's still on precise in site.pp, so I went to log into it (and groups) to confirm but ssh is timing out, and cacti has no data for them, does anyone know the story with these? | 17:59 |
| *** e0ne has joined #openstack-infra | 17:59 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fix: dict().iteritems no longer exists https://review.openstack.org/325620 | 17:59 |
| flwang1 | hi can you guys login gerrit? | 17:59 |
| pleia2 | https://review.openstack.org/#/c/299238/ is the one from mrmartin, pabelanger created a duplicate the other week at https://review.openstack.org/#/c/301680/ | 17:59 |
| anteaya | pleia2: well ubuntuone was just down but is back up again | 17:59 |
| anteaya | flwang1: try now | 17:59 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Bundled Fixes https://review.openstack.org/325661 | 17:59 |
| anteaya | flwang1: and I'm not a guy | 17:59 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Update gear requirement https://review.openstack.org/326173 | 17:59 |
| pleia2 | anteaya ? | 18:00 |
| pleia2 | ah, I assume that was meant for flwang1 :) | 18:00 |
| anteaya | pleia2: would an ubuntuone outage have affected your ability to login to groups? | 18:00 |
| fungi | anteaya: Zara: edit away. i try to account for late addition race conditions in the agenda | 18:01 |
| anteaya | fungi: thank you | 18:01 |
| pleia2 | anteaya: no, I'm sshing into the server, we use ssh keys for that | 18:01 |
| *** otherwiseguy has quit IRC | 18:02 | |
| anteaya | sorry was over enthusiastic with sharing the ubuntuone outage info | 18:02 |
| pleia2 | hehe | 18:02 |
| *** electrofelix has quit IRC | 18:02 | |
| *** gouthamr_ has joined #openstack-infra | 18:02 | |
| *** e0ne has quit IRC | 18:02 | |
| *** gouthamr has quit IRC | 18:03 | |
| *** oanson has quit IRC | 18:03 | |
| fungi | pleia2: mnaser: if ubuntuone was a problem, maybe that accounts for the earlier groups.o.o webui login issues too? worth retrying now? | 18:03 |
| pleia2 | aha, I finally logged into -dev, but it was very slow | 18:04 |
| fungi | yeah, my ssh into groups.o.o is pretty slow too | 18:04 |
| flwang1 | anteaya: sorry :) | 18:04 |
| *** EricGonczer_ has quit IRC | 18:04 | |
| pleia2 | so, were these servers discussed during our sprint end? anyone following up with mrmartin? | 18:05 |
| pleia2 | I can if not | 18:05 |
| *** EricGonczer_ has joined #openstack-infra | 18:05 | |
| anteaya | pleia2: I do not recall them being discussed | 18:05 |
| *** TravT has left #openstack-infra | 18:05 | |
| fungi | pleia2: huh, yeah strange... snmp responses for groups and groups-dev went dead a couple weeks ago | 18:06 |
| pleia2 | ok, I'll mail mrmartin and Cc: the infra list in a few hours if no one else did this already | 18:06 |
| *** pvaneck has joined #openstack-infra | 18:06 | |
| fungi | pleia2: also my cached ssh host key for groups.o.o has changed, so i'm guess it it was upgraded | 18:06 |
| pleia2 | DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS" | 18:07 |
| fungi | guessING | 18:07 |
| pleia2 | that's -dev | 18:07 |
| flwang1 | it's fixed, thanks | 18:07 |
| fungi | looks like maybe they were upgraded to trusty and snmp stopped working around the same time? | 18:07 |
| openstackgerrit | Anita Kuno proposed openstack-infra/infra-specs: Enumerate steps and options https://review.openstack.org/326680 | 18:08 |
| pleia2 | I think maybe we should +A https://review.openstack.org/#/c/299238/ | 18:08 |
| fungi | i'm waiting for groups.o.o to get around to logging me in now that i've cleared the old known hosts entry | 18:08 |
| pleia2 | fungi: could be, I'll dig around logs and see if they go back far enough to learn about timing | 18:08 |
| pleia2 | fungi: heh, same | 18:08 |
| pleia2 | huzzah, in | 18:09 |
| pleia2 | DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS" | 18:09 |
| pleia2 | alright, that one was upgraded too | 18:09 |
| fungi | groups.o.o is running trusty and uptime says 68 days | 18:09 |
| anteaya | turns out #. in rst will enumerate but 1. in the published form is just 1. regardless of how many you have | 18:09 |
| fungi | so i'm guessing it has been running trusty for a long while | 18:10 |
| *** mixos has joined #openstack-infra | 18:10 | |
| *** trown|lunch is now known as trown | 18:10 | |
| fungi | load average on groups.o.o is 99.9-100.0% idle, so slow logins don't seem to be cpu related | 18:10 |
| pleia2 | yeah, that was the first thing I checked | 18:10 |
| pleia2 | I'll ssh with -vvv to see where it's getting hung up | 18:11 |
| pleia2 | oh, I'm also connecting over ipv6 | 18:11 |
| *** gyee has joined #openstack-infra | 18:11 | |
| fungi | ahh, yep. me too. icmp6 echo packet loss is... extreme | 18:12 |
| fungi | also, you're _not_ connected to it over ipv6 | 18:12 |
| fungi | and neither am i | 18:12 |
| *** oanson has joined #openstack-infra | 18:12 | |
| fungi | which i think means we're seeing v6 timeouts | 18:12 |
| pleia2 | indeed! my verbose session just confirmed as soon as v6 times out I'm in fast with v4 | 18:13 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Add timeout to deploy.sh https://review.openstack.org/326634 | 18:13 |
| pleia2 | debug1: Connecting to groups-dev.openstack.org [2001:4800:7813:516:3bc3:d7f6:ff05:391d] port 22. | 18:14 |
| pleia2 | debug1: connect to address 2001:4800:7813:516:3bc3:d7f6:ff05:391d port 22: Connection timed out | 18:14 |
| pleia2 | debug1: Connecting to groups-dev.openstack.org [198.101.242.197] port 22. | 18:14 |
| fungi | pleia2: ipv6 address reported by `ip -6 address show dev eth0` does _not_ match dns | 18:14 |
| pleia2 | cool | 18:14 |
| pleia2 | I'll confirm again in nova, then update dns | 18:14 |
| fungi | thanks! | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support GitHub PR webhooks https://review.openstack.org/163117 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Make the string representation of change transparent https://review.openstack.org/238948 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Lower the log level in tests https://review.openstack.org/263364 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Merge pull requests from github reporter https://review.openstack.org/243250 | 18:14 |
| fungi | i wonder if it got upgraded a couple months ago and whoever did it only updated ipv4 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Encapsulate determining the event purpose https://review.openstack.org/247487 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Fix job hierarchy bug. https://review.openstack.org/192457 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: support github pull reqeust labels https://review.openstack.org/247421 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Better merge message for GitHub pull reqeusts https://review.openstack.org/280667 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Support for dependent pipelines with github https://review.openstack.org/247500 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Configurable SSH access to GitHub https://review.openstack.org/239138 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: GitHub file matching support https://review.openstack.org/292376 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow github trigger to match on branches/refs https://review.openstack.org/258448 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Log GitHub API rate limit https://review.openstack.org/292377 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow using webapp from connections https://review.openstack.org/215642 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Allow list values in template parameters. https://review.openstack.org/191208 | 18:14 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 18:14 |
| fungi | in dns | 18:14 |
| pleia2 | fungi: seems like a reasonable assumption | 18:15 |
| fungi | thanks! | 18:15 |
| fungi | that's my occam's razor explanation anyway | 18:15 |
| *** doug-fis_ has joined #openstack-infra | 18:15 | |
| *** piet_ has joined #openstack-infra | 18:17 | |
| fungi | pleia2: supported by that... we upgraded cacti to trusty a couple weeks ago and it grew ipv6 support at the same time. which roughly coincides with when we ceased getting snmp responses from groups{,-dev}.o.o | 18:17 |
| fungi | s/supported by/supporting/ | 18:17 |
| *** doug-fish has quit IRC | 18:18 | |
| fungi | but there's also a gap in the cacti graphs on groups.o.o a couple months ago, after which the disk size for / ~doubled | 18:18 |
| fungi | which coincides with the uptime | 18:18 |
| pleia2 | groups.o.o ttl was at 5 minutes, so that'll propagate quickly, groups-dev is 60, is it our policy to bump back to 60 after maintenance? | 18:19 |
| pleia2 | anyway, AAAA records sorted | 18:19 |
| fungi | i'd just leave it at 5 | 18:19 |
| pleia2 | ok | 18:19 |
| fungi | we could stand to go through and audit all our dns records and normalize their ttls, but low priority | 18:19 |
| pleia2 | heh, indeed | 18:20 |
| fungi | would be much easier if we maintained the zones in git | 18:20 |
| pleia2 | anything but this UI | 18:20 |
| fungi | srsly | 18:20 |
| pleia2 | I don't entirely blame the person who missed the AAAA records, the inability to search through this list without scroll, wait, scroll, wait is maddening | 18:20 |
| pleia2 | have to know to look for them | 18:21 |
| ayoung | fungi, we have a boty in #openstack-meeting but no one with moderators | 18:21 |
| *** dolphm has joined #openstack-infra | 18:21 | |
| dolphm | possible abusive / spam use in #openstack-meeting named BroNeed | 18:21 |
| dolphm | user* | 18:21 |
| dolphm | spouting nonsense periodically | 18:21 |
| nwkarsten | i'm trying to understand the puppet modules for subunit2sql. how do the subunit-worker and subunit-server interact with the subunit2sql database and with the gearman server respectively? | 18:22 |
| fungi | ayoung: dolphm: on it | 18:22 |
| notmorgan | fungi: thanks. | 18:22 |
| notmorgan | yep BroNeed i think is the name. | 18:23 |
| notmorgan | in -meeting | 18:23 |
| samueldmq | notmorgan: dolphm: fungi: thanks | 18:23 |
| *** pvaneck has quit IRC | 18:24 | |
| samueldmq | fungi: perfect, thanks! | 18:24 |
| notmorgan | fungi: appreciate it. | 18:24 |
| openstackgerrit | Kirill Bespalov proposed openstack-infra/project-config: Fix branch for releasenotes job of oslo.messaging https://review.openstack.org/326687 | 18:24 |
| fungi | gone now | 18:24 |
| fungi | i always have to recheck chanserv help to figure out akick syntax | 18:25 |
| *** amotoki has joined #openstack-infra | 18:26 | |
| pleia2 | fwiw, I prefer /remove :) | 18:26 |
| pleia2 | in irssi /quote remove #channel nickname :the reason here | 18:26 |
| jeblair | fungi, pleia2: would love it if our docs just said what to do | 18:26 |
| pleia2 | I can add it | 18:26 |
| jeblair | pleia2: our docs *do* say remove, but then it says abusive users should be banned | 18:26 |
| jeblair | so i assume that's what should happen | 18:26 |
| pleia2 | actually, I already did :) | 18:26 |
| fungi | i've been doing /msg chanserv akick #openstack-meeting add somenick spamming is off-topic | 18:26 |
| jeblair | pleia2: yeah, but when i read those instructions, i invariably come to the conclusion i should not use remove | 18:27 |
| *** amoralej is now known as amoralej|off | 18:27 | |
| jeblair | so they could use some tweaking :) | 18:27 |
| pleia2 | jeblair: ah, ok | 18:27 |
| jeblair | which is better, akick or remove? | 18:27 |
| pleia2 | I'll adjust ban syntax to say it can be used in combination | 18:27 |
| fungi | the upside to going through chanserv is that it doesn't give them an adversary to target with private /msg afterward | 18:27 |
| jeblair | i like that | 18:28 |
| pleia2 | my rationale for recommending /remove is that it sends a /part signal to the client, so they won't autorejoin (as many clients offer upon kick), and I use ban later if they really don't stay away | 18:28 |
| fungi | ahh | 18:28 |
| fungi | yeah, i've just been going with the big hammer | 18:29 |
| fungi | for abusive people in any channel, but also obnoxious people in meeting channels | 18:29 |
| * pleia2 nods | 18:29 | |
| pleia2 | your point about not identifying yourself as the one who banned does make sense too | 18:30 |
| *** amotoki has quit IRC | 18:30 | |
| fungi | the odds that someone wandering into a meeting channel as their first interaction with the community will end up being a useful contributor later and actually need to use that channel? statistically insignificant | 18:30 |
| *** gouthamr_ has quit IRC | 18:30 | |
| pleia2 | heh, I come from the land of massive Ubuntu channels where we hit the ban list limits (turns out they exist!) | 18:31 |
| fungi | and if as their first act they badger people trying to conduct a meeting, then really i'm not worried a permanent channel ban is appropriate | 18:31 |
| sdague | zuul is chugging pretty hard on processing merges right now, eh? | 18:31 |
| pleia2 | but it's less of a problem for us | 18:31 |
| *** gouthamr has joined #openstack-infra | 18:31 | |
| *** e0ne has joined #openstack-infra | 18:32 | |
| *** PollyZ has joined #openstack-infra | 18:32 | |
| fungi | pleia2: oh! yeah i can imagine it's a different story if you end up banning so many lusers that you hit freenode's ban list max | 18:32 |
| *** gokrokve has quit IRC | 18:32 | |
| *** baoli_ has quit IRC | 18:32 | |
| fungi | the frequency for us is thankfully low enough for now we can just wield the +2 lart of banning | 18:33 |
| *** kzaitsev_mb has quit IRC | 18:33 | |
| anteaya | yes that is the second spammer in less than 24 hours | 18:33 |
| * fungi doesn't get an opportunity to say "lart" that much these days | 18:34 | |
| anteaya | I lean on the side of send a strong message this isn't an effective vector | 18:34 |
| *** Ravikiran_K has quit IRC | 18:34 | |
| *** Apoorva_ has quit IRC | 18:34 | |
| anteaya | I thought it was a typo, I had to look it up | 18:35 |
| *** Apoorva has joined #openstack-infra | 18:35 | |
| anteaya | so glad that word is new to me | 18:35 |
| *** pvaneck has joined #openstack-infra | 18:35 | |
| * fungi recommends the jargon file for beefing up your classic hacker vocabulary | 18:36 | |
| bkero | (jargon file)++ | 18:36 |
| *** dtardivel has quit IRC | 18:37 | |
| *** PollyZ has quit IRC | 18:37 | |
| *** oanson has quit IRC | 18:38 | |
| sdague | so is 5 minutes per patch merge for top of the gate an expected flow rate? That seems kind of slow once test results are in | 18:39 |
| sdague | the top 17 patches are all passed and just chilling trying to merge | 18:39 |
| fungi | sdague: if something's causing zuul reporting into gerrit to slow down, then possibly | 18:39 |
| sdague | fungi: ok, gerrit is definitely on the slow side | 18:40 |
| sdague | in the last 9 minutes 1 patch has merged, the top of the queue shows merged in gerrit, but not in zuul | 18:40 |
| fungi | i'll let another infra-root dig into zuul+gerrit performance problems. trying to get meeting prep done | 18:40 |
| sdague | it reported to gerrit 3 minutes ago | 18:40 |
| samueldmq | fungi: please again | 18:41 |
| samueldmq | fungi: -meeting, we gotta need a kick | 18:41 |
| dolphm | fungi: blatantly abusive language from Wundrlnd in #openstack-meeting | 18:41 |
| anteaya | this looks odd on gerrit, after -meeting is cleared: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4588&rra_id=all | 18:42 |
| fungi | samueldmq: dolphm: looks like they /part'ed the channel already, but i've added a ban for them anyway | 18:42 |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/puppet-logstash: Include archive class before using archive define https://review.openstack.org/326693 | 18:42 |
| fungi | sdague: the zuul event and result queue is very long. coinciding with this behavior last week, we saw a 40+ patch series show up for some project | 18:42 |
| sdague | yeh, nothing that long | 18:43 |
| sdague | zuul has a 9 deep and trove a 10 deep | 18:43 |
| fungi | sdague: well, not yet. last time it showe up immediately _after_ zuul got the outstanding events processed | 18:43 |
| fungi | er, showed | 18:43 |
| sdague | gotcha | 18:43 |
| sdague | yeh, well it's in event grind now, so I guess it won't really do any of that until those are processed | 18:44 |
| samueldmq | fungi: thanks | 18:44 |
| *** Sukhdev has joined #openstack-infra | 18:47 | |
| *** PollyZ has joined #openstack-infra | 18:47 | |
| *** tzn has joined #openstack-infra | 18:48 | |
| *** bhavik has quit IRC | 18:49 | |
| jeblair | sdague, fungi: it's taking about 1 minute each to process nova merges, probably due to the open change query it does for the merge-check pipeline | 18:51 |
| fungi | event queue is approaching 15k | 18:52 |
| fungi | fun stuff | 18:52 |
| jeblair | most of those are ref-replicated events; they're noops | 18:52 |
| jeblair | and of course the internal events used to trigger merge-check | 18:52 |
| jeblair | there was also a reconfiguration an hour ago, so it's been building up its cache | 18:53 |
| *** tzn has quit IRC | 18:54 | |
| *** regXboi has joined #openstack-infra | 18:54 | |
| mgagne | how can someone update this line in an automated manner when installing Zuul? https://github.com/openstack-infra/zuul/blob/master/etc/status/public_html/zuul.app.js#L59 | 18:57 |
| sdague | jeblair: ok, cool, it definitely did speed up after the nova merges started going in it looks like. That neutron merge took forever when I first asked about it | 18:57 |
| *** esikachev has quit IRC | 18:58 | |
| *** hasharAway is now known as hashar | 18:59 | |
| *** mriedem1 has joined #openstack-infra | 18:59 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Use global generated groups in launch-node https://review.openstack.org/326699 | 18:59 |
| *** ihrachys has joined #openstack-infra | 18:59 | |
| jeblair | sdague: yeah, that may have been taking the brunt of the cache misses | 18:59 |
| sdague | gotcha | 19:00 |
| mgagne | how can one make it so it's easily customizable? | 19:00 |
| fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:00 |
| *** doug-fis_ has quit IRC | 19:00 | |
| jeblair | pabelanger, mordred: suggestion (a): https://review.openstack.org/326699 | 19:00 |
| prometheanfire | ianw: what's left to do with the cleanup, just wait on reviews? | 19:00 |
| *** mriedem has quit IRC | 19:01 | |
| *** doug-fish has joined #openstack-infra | 19:01 | |
| *** doug-fish has quit IRC | 19:01 | |
| *** Rockyg has joined #openstack-infra | 19:01 | |
| *** doug-fish has joined #openstack-infra | 19:01 | |
| *** piet_ has quit IRC | 19:02 | |
| mordred | mgagne: I've thought about a fetchable config for that before - but haven't done any work on it | 19:02 |
| mgagne | mordred: fetchable from Zuul? | 19:03 |
| mordred | mgagne: or somewhere. a json file on a URL would be fine - but GET locahost/webapp.json or something would likely be an easyish way? I don't know - I just know i've know the thing you're talking about a dI don't have a GREAT answer right now | 19:04 |
| *** EricGonczer_ has quit IRC | 19:04 | |
| *** EricGonczer_ has joined #openstack-infra | 19:04 | |
| ianw | prometheanfire: well, i did get things working without having to have openstack-repos cloned, although looking at the change, i wondered about it. it's certainly good for testing & abstraction purposes | 19:05 |
| *** amrith is now known as _amrith_ | 19:06 | |
| *** h00pz has joined #openstack-infra | 19:07 | |
| h00pz | folks wondering if someone can help me, I have been trying to sign my ICLA and every time I get Code Review - Error Server Error Cannot store contact information | 19:07 |
| *** sarob has quit IRC | 19:08 | |
| AJaeger | h00pz: If you already followed the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup and still get that, see https://ask.openstack.org/question/56720 for additional troubleshooting tips. | 19:08 |
| h00pz | I had done everything except click that I am a foundation member. That did it | 19:14 |
| *** bdemers_ has quit IRC | 19:14 | |
| *** zeih has joined #openstack-infra | 19:14 | |
| *** timello has quit IRC | 19:15 | |
| *** Kennan has quit IRC | 19:15 | |
| *** Kennan has joined #openstack-infra | 19:16 | |
| *** ihrachys has quit IRC | 19:18 | |
| pleia2 | yay, groups.o.o data is getting to cacti again :) | 19:18 |
| *** ihrachys has joined #openstack-infra | 19:18 | |
| anteaya | pleia2: yay, back into the fold | 19:20 |
| *** timello has joined #openstack-infra | 19:20 | |
| anteaya | thanks for noticing they were missing | 19:20 |
| *** zeih has quit IRC | 19:20 | |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/grafyaml: Add support for multiple config paths https://review.openstack.org/326708 | 19:21 |
| *** ramishra has quit IRC | 19:21 | |
| *** liusheng has quit IRC | 19:22 | |
| *** liusheng has joined #openstack-infra | 19:22 | |
| *** markusry has quit IRC | 19:23 | |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: experimenting with local.conf https://review.openstack.org/326585 | 19:24 |
| *** mriedem has joined #openstack-infra | 19:24 | |
| *** mriedem1 has quit IRC | 19:25 | |
| anteaya | mordred: very nicely and well thought out email | 19:25 |
| anteaya | it isn't often I complement you on those characteristics | 19:26 |
| anteaya | but you brought them to the fore very well in this instance | 19:27 |
| mordred | anteaya: thank you. there was nothing about writing that that I enjoyed | 19:28 |
| anteaya | I get that | 19:28 |
| *** ihrachys has quit IRC | 19:28 | |
| anteaya | and you chose good words to say your bit | 19:28 |
| anteaya | I commend you for that | 19:28 |
| *** baoli has joined #openstack-infra | 19:28 | |
| *** bdemers has joined #openstack-infra | 19:28 | |
| *** ihrachys has joined #openstack-infra | 19:29 | |
| openstackgerrit | Kirill Bespalov proposed openstack-infra/project-config: Fix branch for releasenotes job of oslo.messaging https://review.openstack.org/326687 | 19:29 |
| *** bdemers_ has joined #openstack-infra | 19:31 | |
| *** bdemers has quit IRC | 19:34 | |
| *** nadya has joined #openstack-infra | 19:34 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix branch for releasenotes job of oslo.messaging https://review.openstack.org/326687 | 19:34 |
| *** ams__ has joined #openstack-infra | 19:35 | |
| *** permalac has quit IRC | 19:36 | |
| openstackgerrit | Dan Radez proposed openstack-infra/project-config: Adding puppet congress https://review.openstack.org/326713 | 19:37 |
| *** tkelsey has joined #openstack-infra | 19:40 | |
| *** e0ne has quit IRC | 19:40 | |
| *** zeih has joined #openstack-infra | 19:42 | |
| *** asettle has quit IRC | 19:42 | |
| craige | o/ | 19:42 |
| *** tkelsey has quit IRC | 19:44 | |
| *** esikachev has joined #openstack-infra | 19:44 | |
| *** bdemers has joined #openstack-infra | 19:45 | |
| *** netsin has quit IRC | 19:45 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Update translation check site spec https://review.openstack.org/325689 | 19:46 |
| *** zeih has quit IRC | 19:46 | |
| mtreinish | fungi: random question, what is the infra-specs way for marking something as implemented? | 19:47 |
| mtreinish | in other specs repos there's normally an implemented subdir and you can move things into there | 19:47 |
| *** bdemers_ has quit IRC | 19:48 | |
| anteaya | mtreinish: http://specs.openstack.org/openstack-infra/infra-specs/#implemented-design-specifications | 19:48 |
| anteaya | mtreinish: make a change on the index page | 19:48 |
| openstackgerrit | Merged openstack-infra/zuul: Python 3 Fix: use six.reraise https://review.openstack.org/323015 | 19:48 |
| *** esikachev has quit IRC | 19:49 | |
| mtreinish | ah, ok | 19:49 |
| mtreinish | thanks | 19:49 |
| anteaya | welcome | 19:49 |
| *** nadya has quit IRC | 19:49 | |
| fungi | mtreinish: yeah, we don't arbitrarily move files around when there's a perfectly suitable index ;) | 19:49 |
| mtreinish | fungi: well it's editing a file vs a git mv | 19:50 |
| mtreinish | fungi: like on qa-specs the index is: http://git.openstack.org/cgit/openstack/qa-specs/tree/doc/source/index.rst#n34 | 19:51 |
| *** tqtran has joined #openstack-infra | 19:51 | |
| *** stajkowski has joined #openstack-infra | 19:51 | |
| mtreinish | then it also indicates to people in the dir tree which specs are still open vs not | 19:52 |
| *** morgabra_ is now known as morgabra | 19:52 | |
| *** morgabra has joined #openstack-infra | 19:52 | |
| stajkowski | hey all, trying to get a project added, should be good to go https://review.openstack.org/#/c/319368 | 19:52 |
| AJaeger | mtreinish: If I bookmark a file, it will still be available after the move. And then you update the implemented spec/edit it... | 19:52 |
| openstackgerrit | Merged openstack-infra/infra-specs: Enumerate steps and options https://review.openstack.org/326680 | 19:55 |
| *** trown is now known as trown|brb | 19:55 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Add timeout to deploy.sh https://review.openstack.org/326634 | 19:56 |
| *** Goneri has quit IRC | 19:56 | |
| *** tzn has joined #openstack-infra | 19:57 | |
| *** nadya has joined #openstack-infra | 19:57 | |
| openstackgerrit | Brian Stajkowski proposed openstack-infra/project-config: New Project Quark Plugin https://review.openstack.org/319368 | 19:59 |
| *** kgiusti has left #openstack-infra | 19:59 | |
| *** asettle has joined #openstack-infra | 19:59 | |
| *** trown|brb is now known as trown | 19:59 | |
| Zara | yeah, sorry, it was bad that that point was right at the end | 20:00 |
| Zara | I was planning to ask around to see who was interested more generally | 20:00 |
| anteaya | Zara: yep no worries | 20:00 |
| anteaya | sorry to step on your topic there | 20:00 |
| Zara | to see if we could break it down between people... but yeahhh. :/ | 20:01 |
| anteaya | but wanted folks to know about the bug sprint | 20:01 |
| anteaya | maybe the bug sprint can help focus some effort here | 20:01 |
| anteaya | Zara: shall you and I compose an email about the bug sprint tomorrow? | 20:01 |
| anteaya | Zara: I know it is late for you now | 20:01 |
| zaro | Zara: you should probably hold off on the gerrit storyboard plugin ayways. i'm not actaully sure that it works. i might have implemented it on an older version of gerrit | 20:01 |
| Zara | zaro: xD brilliant! Okay, will do | 20:02 |
| Zara | I'm drowing in review atm anyway, so that wfm | 20:02 |
| * Zara never takes holiday again | 20:02 | |
| *** nadya has quit IRC | 20:02 | |
| *** Sukhdev has quit IRC | 20:02 | |
| anteaya | zaro: oh I didn't know that, thanks for sharing | 20:02 |
| ianw | pabelanger: builds -> fatal: remote error: access denied or repository not exported: /openstack-dev/os-http.git | 20:03 |
| Zara | anteaya: I suggest you do it or I do it; I think it'll take longer than it needs to otherwise | 20:03 |
| ianw | also, not sure if that's running dib 1.17.0 as released yesterday | 20:03 |
| *** sarob has joined #openstack-infra | 20:04 | |
| ianw | is puppet not updating it? | 20:04 |
| *** rwsu has joined #openstack-infra | 20:04 | |
| Zara | anteaya: I prefer to write first and check details with others after, rather than composing words with others. | 20:04 |
| anteaya | Zara: very good, would you like to do it? | 20:04 |
| Zara | anteaya: sure | 20:04 |
| anteaya | Zara: thank you, I always admire your writing | 20:05 |
| zaro | Zara: i'm assuming gerrit storyboard integration is low priority. i mean is anybody knocking on our doors for it atm? | 20:05 |
| SotK | Zara: sorry :) | 20:05 |
| rcarrillocruz | jeblair , fungi : yep, so, happy to help on ansible-puppet | 20:05 |
| rcarrillocruz | i need to know what are the issues so I can start poking | 20:06 |
| rcarrillocruz | nibalizer: ^ | 20:06 |
| pabelanger | ianw: not sure what that repo is | 20:06 |
| pabelanger | ianw: will have to dig into it | 20:06 |
| anteaya | zaro: it is a high priority | 20:06 |
| ianw | pableanger: something jamielennox got added i think | 20:06 |
| Zara | zaro: so, mtreinish was interested and I myself am interested. I can't be sure that I'll be resourced to it. so, low priority from our employer, higher priority from openstack people, which means I don't want to sit on it. | 20:06 |
| anteaya | zaro: mtreinish is knocking on doors with it | 20:06 |
| anteaya | zaro: I would argue that gerrit storyboard integration is a critical priority actually | 20:07 |
| zaro | anteaya: more critcial than gerrit memory leak? | 20:07 |
| rcarrillocruz | fungi: re helping with an infra cloud on other provider. I don't care what provider is, i just care about helping the project :-) . Having said that, I believe we should not just dump the HPE infra cloud, we have been given a bunch of HW and the heavy lifting of fixing glean/bifrost + all the puppet involved is done | 20:07 |
| anteaya | zaro: but I understand that everything on your plate is high or critical | 20:07 |
| anteaya | zaro: I'm not saying that | 20:08 |
| rcarrillocruz | and should be transferable to whatever provider comes to help | 20:08 |
| rcarrillocruz | i don't think we should just choose one | 20:08 |
| anteaya | zaro: I'm saying it is critical for storyboard, I'm not saying it is more critical than other things on your plate | 20:08 |
| rcarrillocruz | we have people in HPE that can deal with the bullshit of jiras and logistics | 20:08 |
| ianw | pabelanger: https://review.openstack.org/#/c/325719/ | 20:08 |
| rcarrillocruz | if we have other people from other companies that can deal with that, they can help out | 20:08 |
| anteaya | rcarrillocruz: can you do me a favour and not curse | 20:08 |
| rcarrillocruz | i've seen people in the meeting willing to help | 20:08 |
| anteaya | rcarrillocruz: I really find it exhausting to be around | 20:08 |
| anteaya | zaro: it is really difficult with only having you as the gerrit person | 20:09 |
| rcarrillocruz | pleia2: i think the updates are good, tho those have been done by people in the US timezone | 20:09 |
| rcarrillocruz | so i cannot do that i'm afraid | 20:09 |
| anteaya | it tires me out that our prior requests for gerrit help from the community have gone unanswered | 20:09 |
| rcarrillocruz | when i upadte a ticket, they update during my night, i see it on my morning, then they update at my night, so on and so forth | 20:09 |
| pabelanger | ianw: okay, manually running manage-projects to pick it up again | 20:10 |
| rcarrillocruz | if you want to help on that i can give you the jiras and you provide the updates | 20:10 |
| anteaya | zaro: but enough of that, if you have any time for supporting storyboard gerrit integration, I'm grateful | 20:10 |
| Zara | (ftr, I haven't had time to look at the plugin properly yet, and right now I don't know that I'll have time this week. things should be clearer by friday.) | 20:10 |
| openstackgerrit | Merged openstack-infra/project-config: move watcher tagging acls to the release team https://review.openstack.org/325934 | 20:11 |
| *** baoli has quit IRC | 20:12 | |
| *** _amrith_ is now known as amrith | 20:12 | |
| Zara | anteaya: (and thank you for the compliment, missed it earlier!) | 20:12 |
| anteaya | Zara: :) | 20:12 |
| openstackgerrit | Brian Stajkowski proposed openstack-infra/project-config: New Project Quark Plugin https://review.openstack.org/319368 | 20:12 |
| *** baoli has joined #openstack-infra | 20:12 | |
| anteaya | Zara: understood, thanks for your hard work | 20:12 |
| *** kzaitsev_mb has joined #openstack-infra | 20:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Add timeout to deploy.sh https://review.openstack.org/326634 | 20:14 |
| *** timello has quit IRC | 20:14 | |
| nibalizer | rcarrillocruz: awesome | 20:15 |
| fungi | rcarrillocruz: i don't think anyone is suggesting we should dump hpe, just asking whether given the repeated delays outside our control whether we should shift gears and prioritize one of the other providers who has offered similar hardware and colocation where we might be able to make faster progress | 20:17 |
| *** ihrachys has quit IRC | 20:17 | |
| fungi | rcarrillocruz: instead we've been telling them to go away and come back once we get the hardware in hpe into produciton | 20:17 |
| fungi | but at this point we might be a lot further along if we didn't have hardware relocation/renumbering to contend with, and now we're facing another round of the same | 20:18 |
| *** ihrachys has joined #openstack-infra | 20:19 | |
| nibalizer | can we just ship the hpe gear to a friendly host? | 20:19 |
| * nibalizer beats dead horse | 20:19 | |
| *** timello has joined #openstack-infra | 20:20 | |
| pabelanger | rcarrillocruz: So, I'm happy to have use start dogfooding the hardware today to test if upgrading the cloud works. Even if we iterate on that, I would be happy | 20:21 |
| rajinir | dsvm-tempest-full , looking at the job template, it is cloning the devstack. Do the slave ds vm's need external access? | 20:23 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Move puppet-congress to OpenStack https://review.openstack.org/326720 | 20:23 |
| rcarrillocruz | fungi: right, devil is in the details. when we say we would prioritize other provider not sure what that entails. Would that mean I with other HPE folks would stay with HPE infra cloud while the others with the other provider ? | 20:23 |
| pabelanger | fungi: pleia2: jeblair: clarkb: if you have time, do you mind reviewing: https://review.openstack.org/#/c/303047/ I tested that locally with xenial a while back, was was able to still build wheels. I wouldn't mind landing that before we start using static workers for zuulv25 | 20:23 |
| rcarrillocruz | i honestly think the heavylifting has been done | 20:23 |
| rcarrillocruz | i expect other infra cloud would follow the same architecture as the hpe infracloud, etc | 20:24 |
| fungi | rcarrillocruz: yeah, no idea what it would mean either. i hope it would mean that people who are contributing and have a choice in what they work on might decide that focusing on hardware from/at another donor is a solution for making faster progress, if that's the case | 20:25 |
| rcarrillocruz | ok, so , let's do this. I'll bring up whatever nodes we have online | 20:25 |
| rcarrillocruz | make them available so other roots can login | 20:25 |
| fungi | rather than feeling compelled to wait for hpe to finish relocating hardware however many times they feel is required | 20:25 |
| rcarrillocruz | we fix up the inventory (changed IPs, put serial numbers, etc) | 20:26 |
| rcarrillocruz | we try the upgrade | 20:26 |
| rcarrillocruz | and see how far we get | 20:26 |
| pabelanger | ++ | 20:26 |
| fungi | mainly just don't want hosting logistics at one donor to hamstring progress on the project as a whole if there are offers from multiple prospective donors | 20:26 |
| rcarrillocruz | at least i have pabelanger , crinkle and yolanda showing intereset on that? | 20:26 |
| fungi | but if there is progress we can make in hpe right now in the short term, i can't argue | 20:26 |
| rcarrillocruz | fungi: agreed, i se the infra cloud as 'project' than can be used with whatever provider | 20:27 |
| rcarrillocruz | ok, let's do that | 20:27 |
| fungi | rcarrillocruz: excellent. sounds like we're on the same page there. i just want you to have the freedom to make progress on what you want to work on, and not necessarily be blocked on hardware logistics in one location | 20:28 |
| *** Apoorva has quit IRC | 20:28 | |
| clarkb | I personally have little interest in deploying a cloud that Ibknow will disappear soon with no warning and no indication of when it will be back | 20:29 |
| clarkb | we did that once under the assumption it was a onw time deal | 20:29 |
| clarkb | fool me twice and all that | 20:29 |
| fungi | on the other hand, "testing" deployment seems seems like it's something that can be done even if the end result doesn't stick around | 20:29 |
| *** EricGonczer_ has quit IRC | 20:29 | |
| openstackgerrit | Dan Radez proposed openstack-infra/project-config: Adding puppet congress https://review.openstack.org/326713 | 20:30 |
| *** kzaitsev_mb has quit IRC | 20:30 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Allow update command to specify plugin_info_path https://review.openstack.org/326722 | 20:31 |
| *** cody-somerville has joined #openstack-infra | 20:33 | |
| *** eharney has quit IRC | 20:33 | |
| *** gouthamr has quit IRC | 20:34 | |
| rajinir | Need help. dsvm-tempest-full , looking at the job template, it is cloning the devstack. Do the slave ds vm's need external access? | 20:34 |
| *** kzaitsev_mb has joined #openstack-infra | 20:35 | |
| *** EricGonczer_ has joined #openstack-infra | 20:35 | |
| *** xyang1 has quit IRC | 20:36 | |
| *** asettle has quit IRC | 20:36 | |
| ianw | rajinir: devstack runs are going to need internet access for various things | 20:37 |
| *** tpsilva has quit IRC | 20:37 | |
| *** claudiub has quit IRC | 20:37 | |
| anteaya | clarkb: so glad you are here | 20:40 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: DNM: experimenting with local.conf https://review.openstack.org/326585 | 20:41 |
| *** xyang1 has joined #openstack-infra | 20:41 | |
| clarkb | anteaya: "here" :) | 20:42 |
| anteaya | :) | 20:42 |
| rajinir | ianw: thank you | 20:43 |
| openstackgerrit | Mathieu Gagné proposed openstack-infra/grafyaml: Add support for multiple config paths https://review.openstack.org/326708 | 20:44 |
| *** ayoung has quit IRC | 20:44 | |
| pabelanger | infra-root: has somebody disabled review.o.o on puppetmaster.o.o? Ansible hasn't connected to it since: 2016-06-07 00:17:57,094 p=18038 u=root | review.openstack.org : ok=13 changed=6 unreachable=0 failed=0 And I fail to understand why it is no longer working | 20:45 |
| *** kzaitsev_mb has quit IRC | 20:45 | |
| clarkb | not me | 20:45 |
| anteaya | fungi: was that you on Friday? | 20:45 |
| anteaya | sorry that timestamp is from today | 20:46 |
| fungi | pretty sure i reenabled it on friday. checking | 20:46 |
| fungi | it's not in the emergency list, which is where i had it during friday's maintenance | 20:47 |
| fungi | pabelanger: though in watching the run_all log i noticed we're failing to puppet the git servers, and i think we don't puppet gerrit until we successfully puppet those?> | 20:47 |
| *** banix has quit IRC | 20:47 | |
| *** ihrachys has quit IRC | 20:48 | |
| pabelanger | fungi: Oh, I think you are right | 20:48 |
| fungi | i started trying to figure out what's breaking, but didn't manage to spot it in /var/log/messages | 20:48 |
| fungi | on an arbitrarily chosen git server | 20:48 |
| pabelanger | okay, that explains it | 20:48 |
| *** esberglu has joined #openstack-infra | 20:48 | |
| *** Apoorva has joined #openstack-infra | 20:48 | |
| pabelanger | I was starting to go crazy | 20:48 |
| anteaya | that's all it takes? | 20:49 |
| *** rhallisey has quit IRC | 20:49 | |
| *** eeiden has quit IRC | 20:52 | |
| *** baoli has quit IRC | 20:52 | |
| *** baoli has joined #openstack-infra | 20:52 | |
| *** kushal has quit IRC | 20:52 | |
| *** cody-somerville has quit IRC | 20:54 | |
| *** dprince has quit IRC | 20:55 | |
| *** baoli has quit IRC | 20:56 | |
| *** baoli has joined #openstack-infra | 20:56 | |
| *** aysyd has quit IRC | 20:59 | |
| *** asettle has joined #openstack-infra | 20:59 | |
| *** ihrachys has joined #openstack-infra | 21:00 | |
| *** baoli has quit IRC | 21:01 | |
| *** baoli has joined #openstack-infra | 21:01 | |
| *** esikachev has joined #openstack-infra | 21:01 | |
| *** tzn has quit IRC | 21:02 | |
| *** bdemers has quit IRC | 21:03 | |
| *** doug-fish has quit IRC | 21:03 | |
| *** doug-fish has joined #openstack-infra | 21:04 | |
| *** hashar has quit IRC | 21:04 | |
| *** ayoung has joined #openstack-infra | 21:04 | |
| *** doug-fish has quit IRC | 21:05 | |
| *** doug-fish has joined #openstack-infra | 21:05 | |
| *** trown is now known as trown|outtypewww | 21:05 | |
| *** Goneri has joined #openstack-infra | 21:07 | |
| *** psilvad has quit IRC | 21:09 | |
| *** r-daneel has quit IRC | 21:09 | |
| *** ccamacho has quit IRC | 21:11 | |
| *** h00pz has quit IRC | 21:11 | |
| *** esikachev has quit IRC | 21:11 | |
| *** thorst has quit IRC | 21:12 | |
| *** ffrank has joined #openstack-infra | 21:13 | |
| *** yamahata has quit IRC | 21:13 | |
| *** thorst has joined #openstack-infra | 21:13 | |
| *** yamahata has joined #openstack-infra | 21:15 | |
| *** EricGonczer_ has quit IRC | 21:16 | |
| dmsimard | fungi, AJaeger, mordred and friends, I've re-opened https://review.openstack.org/#/c/321226 . | 21:16 |
| *** thorst has quit IRC | 21:17 | |
| *** rossella_s has joined #openstack-infra | 21:17 | |
| *** claudiub has joined #openstack-infra | 21:17 | |
| *** HeOS has joined #openstack-infra | 21:18 | |
| *** ihrachys has quit IRC | 21:18 | |
| *** ihrachys has joined #openstack-infra | 21:20 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-jeepyb: Revert "Add missing packages to jeepyb install" https://review.openstack.org/326731 | 21:20 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Use global generated groups in launch-node https://review.openstack.org/326699 | 21:20 |
| pabelanger | fungi: that is the issue with git.o.o ^ | 21:20 |
| pabelanger | fungi: libssl-devel is not found | 21:21 |
| pabelanger | Jun 07 21:17:13 git06.openstack.org puppet-user[16076]: (/Stage[main]/Jeepyb/Package[libssl-devel]/ensure) change from absent to present failed: Execution of '/usr/bin/yum -d 0 -e 0 -y list libssl-devel' returned 1: Error: No matching Packages to list | 21:21 |
| *** cody-somerville has joined #openstack-infra | 21:21 | |
| *** ldnunes has quit IRC | 21:23 | |
| jeblair | fatal: [zlstatic01.openstack.org]: FAILED! => {"changed": false, "failed": true, "msg": "/usr/bin/timeout -s 9 30m /usr/bin/puppet apply --detailed-exitcodes --logdest syslog --no-noop /opt/system-config/production/manifests/site.pp failed with return code: 6", "rc": 6, "stderr": "", "stdout": "", "stdout_lines": []} | 21:23 |
| *** xarses has quit IRC | 21:23 | |
| jeblair | pabelanger, mordred: exit code 6 means "6: The run succeeded, and included both changes and failures." | 21:23 |
| jeblair | i'm trying to understand what that means and what the 'failures' may have been | 21:24 |
| jeblair | oh, found it | 21:24 |
| jeblair | Jun 7 18:40:43 zlstatic01 puppet-user[19981]: (/Stage[main]/Zuul::Launcher/Exec[zuul-launcher-reload]) Dependency File[/etc/jenkins_jobs/config] has failures: true | 21:24 |
| *** matt-borland has quit IRC | 21:25 | |
| rcarrillocruz | yeah, puppet have funky return codes | 21:25 |
| jeblair | apparently that's correctly a failure | 21:26 |
| jeblair | just very confusing | 21:26 |
| rcarrillocruz | it's a pain , i ended up putting ignore_errors on all puppet runs on infra-ansible , because it would return non-zero even though the puppet run was ok, yet ansible would say 'omg, non-zero, let's fail that task' | 21:27 |
| *** amotoki has joined #openstack-infra | 21:27 | |
| *** amitgandhinz has quit IRC | 21:27 | |
| jeblair | well, that's what the ansible-puppet role does for us -- translate those error codes | 21:27 |
| *** nmagnezi has quit IRC | 21:28 | |
| *** flepied has joined #openstack-infra | 21:28 | |
| pabelanger | jeblair: Ya, 6 is not the best error code. | 21:29 |
| fungi | pabelanger: 3, i guess that was supposed to be openssl-devel not libssl-devel? | 21:29 |
| fungi | er, +3 | 21:29 |
| *** zeih has joined #openstack-infra | 21:30 | |
| pabelanger | fungi: Going to look at the patch and see why beaker didn't catch it | 21:30 |
| *** r-daneel has joined #openstack-infra | 21:30 | |
| pabelanger | fungi: but don't have the time today to do that | 21:30 |
| *** ihrachys has quit IRC | 21:31 | |
| fungi | pabelanger: fair enough. maybe yolanda can look into it since https://review.openstack.org/#/c/325959/https://review.openstack.org/325959 (the reverted change) was hers | 21:31 |
| *** ihrachys has joined #openstack-infra | 21:31 | |
| fungi | er, https://review.openstack.org/325959 | 21:31 |
| fungi | my paste button is bouncing again | 21:32 |
| notmorgan | jeblair: somehow self.window is sneaking into a float format, chasing down how. (re your -1 on the int cast) | 21:32 |
| notmorgan | jeblair: but you're right that is the wrong place to cast to int() | 21:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Fix zuul-launcher JJB puppet dependency https://review.openstack.org/326733 | 21:32 |
| *** amotoki has quit IRC | 21:33 | |
| jeblair | notmorgan: oh, huh. well, it's updated after each merge according to a formula; we may have missed a cast there. thanks! | 21:33 |
| notmorgan | jeblair: yeah but it only happens in py3.. so likely another math "edge" case. | 21:33 |
| *** thiagop has quit IRC | 21:33 | |
| notmorgan | jeblair: i'll find it :) | 21:33 |
| jeblair | aha | 21:34 |
| jeblair | mordred: it may well use round | 21:34 |
| jeblair | notmorgan: ^ | 21:34 |
| pabelanger | fungi: Yup, I plan to follow up on it in the morning | 21:34 |
| *** doug-fish has quit IRC | 21:34 | |
| *** jcoufal has quit IRC | 21:34 | |
| notmorgan | jeblair: haha you fell into mor<tab> and i'm not even prefixed with mor in my nick! woo :) | 21:34 |
| jeblair | notmorgan: [apparently your nick change doesn't help me with the tab problem!] | 21:34 |
| notmorgan | jeblair: ++ | 21:34 |
| *** r-daneel has quit IRC | 21:35 | |
| *** tzn has joined #openstack-infra | 21:35 | |
| jeblair | notmorgan: "I thought the 'not' was silent." | 21:35 |
| notmorgan | jeblair: i'm totally going to look for a round, but a round issue shouldn't net us a float. it seems like maybe a min() might do something weird. | 21:35 |
| *** zeih has quit IRC | 21:35 | |
| notmorgan | jeblair: or a floor() :P | 21:35 |
| *** mriedem has quit IRC | 21:36 | |
| *** rhallisey has joined #openstack-infra | 21:37 | |
| *** flepied has quit IRC | 21:37 | |
| *** thorst has joined #openstack-infra | 21:38 | |
| *** cody-somerville has quit IRC | 21:39 | |
| stajkowski | AJaeger: updated, deleted stale branches, seems we are ready to go | 21:40 |
| *** doug-fish has joined #openstack-infra | 21:40 | |
| *** tzn has quit IRC | 21:41 | |
| jeblair | pabelanger, fungi: https://review.openstack.org/326733 would help with launching more launchers | 21:42 |
| *** thorst has quit IRC | 21:42 | |
| jeblair | meanwhile, i manually salvaged zlstatic01 | 21:42 |
| jeblair | i think that was the only problem | 21:42 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add zlstatic01 https://review.openstack.org/326736 | 21:46 |
| *** doug-fis_ has joined #openstack-infra | 21:46 | |
| jeblair | pabelanger, fungi: ^ and that's needed before we can start it up ^ | 21:46 |
| openstackgerrit | Lakshmi N Sampath proposed openstack-infra/project-config: Add experimental searchlight ES 2.x https://review.openstack.org/326081 | 21:47 |
| *** ihrachys has quit IRC | 21:48 | |
| fungi | jeblair: i'm about to add another static node this week (signing.slave.openstack.org). anything special i need to do for that? i assume there's some sort of migration coming to move the existing ones off jenkins.o.o | 21:48 |
| *** r-daneel has joined #openstack-infra | 21:48 | |
| jeblair | fungi: heh, the migration will be simply "stop jenkins on jenkins.o.o" :) | 21:48 |
| *** xarses has joined #openstack-infra | 21:49 | |
| jeblair | fungi: make sure you add it to the hiera thingy... lemme link | 21:49 |
| jeblair | fungi: http://git.openstack.org/cgit/openstack-infra/system-config/tree/hiera/group/zuul-merger.yaml | 21:49 |
| fungi | cool--that's the bit i was looking for. thanks!!! | 21:49 |
| *** doug-fish has quit IRC | 21:50 | |
| jeblair | wow um. | 21:50 |
| jeblair | that section looks a little bit worse for wear, doesn't it? | 21:50 |
| *** doug-fis_ has quit IRC | 21:51 | |
| fungi | heh, wrong label and host on the ubuntu wheel mirror | 21:51 |
| fungi | is that what you mean? | 21:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Fix typos in zuul node definition https://review.openstack.org/326737 | 21:52 |
| jeblair | fungi: yep. | 21:52 |
| fungi | jeblair: minor typo in patchset 1, see inline | 21:53 |
| jeblair | this is apparently very difficult for me to get correct | 21:53 |
| *** flepied has joined #openstack-infra | 21:54 | |
| *** ayoung has quit IRC | 21:54 | |
| *** Sukhdev has joined #openstack-infra | 21:54 | |
| fungi | is it beer-thirty yet? maybe it should be | 21:54 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Fix typos in zuul node definition https://review.openstack.org/326737 | 21:54 |
| jeblair | fungi: i am with you in spirit | 21:54 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: rename PUPPET_VERSION to PUPPET_MAJ_VERSION https://review.openstack.org/326738 | 21:54 |
| jeblair | spirits? | 21:54 |
| fungi | in spirits | 21:54 |
| fungi | bwahahaha | 21:54 |
| openstackgerrit | Merged openstack-infra/system-config: Fix zuul-launcher JJB puppet dependency https://review.openstack.org/326733 | 21:55 |
| fungi | ps2 lgtm | 21:55 |
| *** esberglu has quit IRC | 21:55 | |
| *** cloudtrainme has joined #openstack-infra | 21:56 | |
| *** _ari_ has quit IRC | 21:56 | |
| jeblair | infra-root: i'm going to permanently stop jenkins01.openstack.org since zl01 has been running a while without incident. the plan is to continue to ramp up zl while ramping down jenkins. | 21:57 |
| jamielennox | ianw, pabelanger: what did it break? | 21:57 |
| *** Sukhdev has quit IRC | 21:57 | |
| *** gordc has quit IRC | 21:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:57 | |
| mordred | jeblair: I fully agree with and support your plan | 21:57 |
| jamielennox | i see the os-http review got merged, but the http://git.openstack.org/cgit/openstack-dev/os-http is empty | 21:58 |
| *** regXboi has quit IRC | 21:58 | |
| openstackgerrit | Jay Faulkner proposed openstack-infra/elastic-recheck: Add e-r query for 1282876 https://review.openstack.org/326739 | 21:58 |
| *** cody-somerville has joined #openstack-infra | 21:59 | |
| *** cody-somerville has joined #openstack-infra | 21:59 | |
| JayF | Would appreciate a review on the elastic-recheck query ^ looks like a failure that's super frequent in the pipeline right now | 21:59 |
| *** ihrachys has joined #openstack-infra | 21:59 | |
| fungi | jeblair: agree is not a strong enough sentiment for me; i am thrilled by the prospect of what you describe | 21:59 |
| ianw | jamielennox: not your fault, seems puppet wasn't running to get the new project fully deployed | 22:01 |
| crinkle | rcarrillocruz: yes i think fixing up the inventory and testing the redeploy is a good move while we have the servers for now (we do have them right?) | 22:01 |
| *** Rockyg has quit IRC | 22:02 | |
| *** kzaitsev_mb has quit IRC | 22:03 | |
| *** asettle has quit IRC | 22:03 | |
| *** sdake_ has joined #openstack-infra | 22:03 | |
| jamielennox | ianw: ok, cool - no rush from my perspective | 22:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-zuul: Use zuul-launcher stop for service stop https://review.openstack.org/326741 | 22:03 |
| *** timello has quit IRC | 22:03 | |
| *** cody-somerville has quit IRC | 22:03 | |
| openstackgerrit | Merged openstack-infra/system-config: Add zlstatic01 https://review.openstack.org/326736 | 22:04 |
| openstackgerrit | Jay Faulkner proposed openstack-infra/elastic-recheck: Add e-r query for 1282876 https://review.openstack.org/326739 | 22:04 |
| *** doug-fish has joined #openstack-infra | 22:04 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Remove jenkins01 target from nodepool https://review.openstack.org/326742 | 22:05 |
| *** Sukhdev has joined #openstack-infra | 22:05 | |
| *** sdake has quit IRC | 22:06 | |
| openstackgerrit | Jay Faulkner proposed openstack-infra/elastic-recheck: Add e-r query for 1282876 https://review.openstack.org/326739 | 22:06 |
| anteaya | fungi: it is beer thirty here | 22:06 |
| anteaya | jeblair: congratulations | 22:06 |
| *** sdake has joined #openstack-infra | 22:06 | |
| *** weshay has quit IRC | 22:08 | |
| *** ayoung has joined #openstack-infra | 22:08 | |
| *** doug-fish has quit IRC | 22:09 | |
| anteaya | so looking at item one in the task tracker spec: Facilitator identifies feature stakeholders from the OpenStack community http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html#work-items | 22:09 |
| anteaya | do folks want to have one identified stakeholder from infra? | 22:09 |
| *** sdake_ has quit IRC | 22:10 | |
| anteaya | if yes, is anyone volunteering to be the identified stake holder? | 22:10 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Decommission jenkins01 https://review.openstack.org/326749 | 22:11 |
| *** kzaitsev_mb has joined #openstack-infra | 22:11 | |
| *** Sukhdev has quit IRC | 22:12 | |
| pabelanger | ianw: jamielennox: should be coming back online shortly | 22:12 |
| *** Sukhdev has joined #openstack-infra | 22:12 | |
| pabelanger | ianw: jamielennox: stepping away for food, but will follow up | 22:12 |
| fungi | anteaya: i'd love to see pleia2 take on that task since she's run our bug sprints in the past and has already provided some feedback to the storyboard team, but it's up to her whether she has time/interest | 22:13 |
| pabelanger | jeblair: Excellent. I'll help out once back from food | 22:13 |
| anteaya | fungi: good suggestion, I'll see if she is interested in taking on being the infra stakeholder | 22:13 |
| fungi | anteaya: i'm the de facto stakeholder, as ptl, if i can't find someone to whom i can delegate | 22:13 |
| anteaya | thank you | 22:13 |
| fungi | so consider me a fallback of last resort | 22:13 |
| anteaya | fungi: good delegating attempt | 22:14 |
| anteaya | fungi: so considered, thank you | 22:14 |
| *** Sukhdev has quit IRC | 22:16 | |
| *** Sukhdev has joined #openstack-infra | 22:16 | |
| *** IlyaG has joined #openstack-infra | 22:16 | |
| *** gouthamr has joined #openstack-infra | 22:17 | |
| *** r-daneel has quit IRC | 22:17 | |
| *** ihrachys has quit IRC | 22:19 | |
| *** PollyZ has quit IRC | 22:20 | |
| *** ihrachys has joined #openstack-infra | 22:20 | |
| *** Apoorva_ has joined #openstack-infra | 22:21 | |
| notmorgan | jeblair: argh... | 22:21 |
| notmorgan | jeblair: python3: >>> max(3, 20 / 2) | 22:22 |
| notmorgan | jeblair: 10.0 | 22:22 |
| notmorgan | jeblair: python2, same thing is 10 | 22:22 |
| *** IlyaG has quit IRC | 22:22 | |
| jeblair | heh. at least it's not *wrong* like round | 22:22 |
| notmorgan | well.. i'd argue it is horribly wrong. | 22:22 |
| *** vhosakot has quit IRC | 22:22 | |
| *** Julien has joined #openstack-infra | 22:23 | |
| notmorgan | but not broken wrong | 22:23 |
| *** IlyaG has joined #openstack-infra | 22:23 | |
| *** Julien is now known as Guest5756 | 22:23 | |
| notmorgan | more important | 22:23 |
| jeblair | notmorgan: yeah, i guess '/' is an implicit float in py3 | 22:23 |
| notmorgan | jeblair: >>> 20 / 2 -> 10.0 | 22:23 |
| *** kzaitsev_mb has quit IRC | 22:23 | |
| notmorgan | this is another .... WHY WOULD YOU CHANGE hOW MATH WORKS .... | 22:23 |
| * notmorgan grumbles. | 22:23 | |
| jeblair | so basically, instead of needing to do "float(a)/b" half the time, we now need to do do "int(a/b)" half the time. | 22:24 |
| notmorgan | jeblair: these types of changes are the worst. | 22:24 |
| *** salv-orl_ has joined #openstack-infra | 22:24 | |
| jeblair | yeah, there's no good answer, it's just flip-floping | 22:24 |
| *** Apoorva has quit IRC | 22:25 | |
| *** IlyaG has quit IRC | 22:25 | |
| notmorgan | jeblair: i preferred "if one is a float, result is a float" | 22:25 |
| notmorgan | rather than "it's always a float" | 22:25 |
| notmorgan | more consistent but... frustrating | 22:25 |
| *** nwkarsten has quit IRC | 22:25 | |
| mordred | yeah. I think the reasoning was something like "def __div__(self, other) -> float" made sense | 22:26 |
| *** PollyZ has joined #openstack-infra | 22:26 | |
| notmorgan | mordred: sure. but it still makes me angry when converting to py3 :P | 22:26 |
| mordred | TOTALLY | 22:26 |
| openstackgerrit | Jay Faulkner proposed openstack-infra/elastic-recheck: Add e-r query for 1590139 https://review.openstack.org/326739 | 22:26 |
| *** Apoorva_ has quit IRC | 22:26 | |
| mordred | I'm not advocating for it | 22:26 |
| *** flepied has quit IRC | 22:27 | |
| notmorgan | mordred: i had to add sys.exit() to debug it... pdb doesn';t play nice with threads :( | 22:27 |
| *** salv-orlando has quit IRC | 22:27 | |
| hongbin | Hi infra team. A question. For project renaming, what exactly the infra team will rename (e.g. gerrit, git repo, launchpad, irc)? | 22:27 |
| hongbin | I wonder which parts are done by infra team, which parts are done by us | 22:28 |
| zaro | hongbin: gerrit projects | 22:28 |
| *** amitgandhinz has joined #openstack-infra | 22:28 | |
| *** fawadkhaliq has joined #openstack-infra | 22:28 | |
| *** Apoorva has joined #openstack-infra | 22:29 | |
| zaro | which includes the git repo | 22:29 |
| hongbin | Then, irc and launchpad are done by ourselvies? | 22:29 |
| hongbin | Just to confirm | 22:29 |
| *** mriedem has joined #openstack-infra | 22:29 | |
| *** amotoki has joined #openstack-infra | 22:30 | |
| *** itisha has quit IRC | 22:30 | |
| *** Julien-zte has quit IRC | 22:30 | |
| *** Julien-zte has joined #openstack-infra | 22:30 | |
| zaro | yeah, i don't believe there are any changes to LP or irc when infra does gerrit project renames | 22:30 |
| *** PollyZ has quit IRC | 22:31 | |
| hongbin | ack. thx | 22:31 |
| JayF | In a case of recursive irony, it appears the gate for elastic-recheck is broken: http://logs.openstack.org/39/326739/4/check/gate-elastic-recheck-python27/21b963b/console.html#_2016-06-07_22_30_01_251 | 22:32 |
| JayF | seeing that failure on this added query: https://review.openstack.org/#/c/326739/ | 22:32 |
| jeblair | notmorgan: oh, did you have some changes so that our manual rysnc command wouldn't bomb on ssh key fingerprint changes? | 22:32 |
| *** ihrachys has quit IRC | 22:32 | |
| jeblair | JayF: i did have a zuul bug recently where we reported false-success; it could have slipped through then :( | 22:33 |
| jeblair | notmorgan: i'm suddenly reminded, looking at the logs, that is a thing | 22:33 |
| JayF | jeblair: well, I'd really like to get this e-r query in because it's an increasingly common failure, and I'm starting to wonder if it only fails at the intersection of horizon and ironic, and not for everyone else | 22:34 |
| anteaya | zaro: hongbin correct, however renaming now takes a 5+ hour gerrit downtime and we just did one last week | 22:34 |
| anteaya | zaro: hongbin we are not in a hurry to schedule another | 22:34 |
| *** amotoki has quit IRC | 22:34 | |
| hongbin | anteaya: Get that. That is fine. We can wait for a couple weeks | 22:34 |
| anteaya | hongbin: months | 22:35 |
| hongbin | sure. months .... | 22:35 |
| anteaya | hongbin: okay if this is important enough for you to wait months for, you won't be surprised by the wait | 22:36 |
| notmorgan | jeblair: no it looks like you covered them. | 22:36 |
| anteaya | hongbin: the rename prior to June's was Feb | 22:36 |
| notmorgan | jeblair: ohhh | 22:36 |
| notmorgan | jeblair: hold on | 22:36 |
| anteaya | hongbin: for context | 22:36 |
| notmorgan | jeblair: i re-read that question | 22:36 |
| hongbin | anteaya: get that | 22:37 |
| hongbin | thx | 22:37 |
| anteaya | hongbin: great, then you have appropriate expectations | 22:37 |
| anteaya | hongbin: welcome, thanks for listening | 22:37 |
| notmorgan | jeblair: https://review.openstack.org/#/c/319706/ but see crinkle's comment about the public saz/puppet-ssh (which i'm happy to convert to) | 22:37 |
| notmorgan | jeblair: and https://review.openstack.org/#/c/320712/1 | 22:37 |
| *** netsin has joined #openstack-infra | 22:37 | |
| notmorgan | jeblair: then we just need to use it. Alternative would be to use saz/puppet-ssh which would also cover our needs, but requires mostly use of highly flexible key-value pairs | 22:38 |
| *** ihrachys has joined #openstack-infra | 22:38 | |
| jeblair | notmorgan: i don't have a strong preferenc on which to use, though, if we go with 706, we probably shouldn't encode openstack.org policy in there | 22:38 |
| notmorgan | jeblair: i was asked to make that the default in a previous patchset | 22:39 |
| JayF | jeblair: looking at history, I think this is a case of e-r being broken by a dep vs by a commit, doesn't look like it's had any code edits in a while | 22:39 |
| *** PollyZ has joined #openstack-infra | 22:40 | |
| notmorgan | jeblair: it might make more sense to just use saz/puppet-ssh which just means i need to look into how we consume that and propose a bunch of hiera keys. | 22:40 |
| JayF | unit test errors in functions named "monkeypatch" seem like the best kind to fix, haha | 22:41 |
| jeblair | notmorgan: oh, at least it's just a default. still, i would prefer we avoid that when possible. we're trying to get openstack *out* of our modules, not in them :) | 22:41 |
| *** mdrabe has quit IRC | 22:41 | |
| *** xarses_ has joined #openstack-infra | 22:41 | |
| *** nwkarsten has joined #openstack-infra | 22:41 | |
| *** amitgandhinz has quit IRC | 22:41 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/zuul: Python 3 Fixes: Bundled Fixes https://review.openstack.org/325661 | 22:41 |
| notmorgan | jeblair: ^ down to 38 py3 failures and almost all of them are fixing the queues up to track the right number of things. | 22:42 |
| *** sarob has quit IRC | 22:42 | |
| *** cloudtrainme has quit IRC | 22:43 | |
| *** cloudtrainme has joined #openstack-infra | 22:43 | |
| *** cloudtrainme has quit IRC | 22:43 | |
| *** sdake has quit IRC | 22:43 | |
| jeblair | notmorgan: i think i need to fix this known host thing right quick, so i want to push a change to write a ssh config file for zuul and have you look at it | 22:43 |
| notmorgan | jeblair: i think moving to saz/puppet-ssh is probably more correct if you don't mind generally a bunhc of keys/values being added | 22:43 |
| jeblair | notmorgan: we can back it out and do the proper module thing later | 22:43 |
| notmorgan | jeblair: ok wfm. | 22:44 |
| notmorgan | jeblair: once that lands we will need to update our site.pp to use it. | 22:44 |
| *** xarses has quit IRC | 22:44 | |
| notmorgan | jeblair: and i have one other fix to make it so we don't have divergent manifests that need to be maintained for server (i just haven't had a chance to figure it out) | 22:44 |
| *** PollyZ has quit IRC | 22:45 | |
| *** nwkarsten has quit IRC | 22:46 | |
| *** edmondsw has quit IRC | 22:47 | |
| *** aviau has quit IRC | 22:49 | |
| *** aviau has joined #openstack-infra | 22:49 | |
| *** rbrndt has quit IRC | 22:50 | |
| *** tzn has joined #openstack-infra | 22:51 | |
| *** PollyZ has joined #openstack-infra | 22:53 | |
| *** signed8bit is now known as signed8bit_Zzz | 22:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add zuul-launcher ssh config file https://review.openstack.org/326758 | 22:55 |
| jeblair | notmorgan, fungi, mordred: i will manually install that config file and remove known_hosts from zl01 | 22:56 |
| mordred | jeblair: ++ | 22:56 |
| mordred | jeblair: I will go to sleep, but I am actively supportive of all of te things you want to do | 22:57 |
| *** tzn has quit IRC | 22:57 | |
| jeblair | mordred: i support your decision as well. | 22:57 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Don't skip errors in postci https://review.openstack.org/326759 | 22:57 |
| *** PollyZ has quit IRC | 22:58 | |
| *** dimtruck is now known as zz_dimtruck | 22:59 | |
| jeblair | notmorgan, fungi, mordred: i see a typo :) | 22:59 |
| anteaya | mordred: sleep well | 22:59 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add zuul-launcher ssh config file https://review.openstack.org/326758 | 23:00 |
| notmorgan | jeblair: ooh there is a typo? | 23:00 |
| *** kzaitsev_mb has joined #openstack-infra | 23:00 | |
| notmorgan | jeblair: /me looks. | 23:00 |
| jeblair | it's kind of funny | 23:01 |
| jeblair | zl01 seems happy now | 23:01 |
| jeblair | seems to be doing what we expec | 23:01 |
| notmorgan | jeblair: whats the typo? | 23:01 |
| * notmorgan is clearly blind. | 23:01 | |
| *** Goneri has quit IRC | 23:02 | |
| notmorgan | oh | 23:02 |
| notmorgan | HAH | 23:02 |
| notmorgan | wow | 23:02 |
| notmorgan | i see it now | 23:03 |
| notmorgan | *facepalm* | 23:03 |
| notmorgan | jeblair: thats an AWESOME typo | 23:03 |
| *** psilvad has joined #openstack-infra | 23:03 | |
| jeblair | i feel vindicated that at least it took you a minute :) | 23:03 |
| pabelanger | jeblair: okay, so I think I finally understand now zlstatic01 works. Have to look at the code quickly | 23:03 |
| pabelanger | jeblair: neat little hack | 23:04 |
| *** ihrachys has quit IRC | 23:05 | |
| *** Sukhdev has quit IRC | 23:05 | |
| *** Sukhdev has joined #openstack-infra | 23:05 | |
| notmorgan | jeblair: hehe +1 | 23:06 |
| *** Guest48552 has quit IRC | 23:06 | |
| *** baoli has quit IRC | 23:07 | |
| openstackgerrit | Merged openstack/gertty: Treat HTTP 503 responses as offline https://review.openstack.org/325522 | 23:07 |
| notmorgan | jeblair: so i think i found the issue with zuul to py3, and it's going to be a gear fix, when pulling things off gear, we are getting an awesome mangled thing (or some weird json issue): http://paste.openstack.org/raw/508779/ | 23:07 |
| notmorgan | b"b'<name>'\t\n.... | 23:07 |
| notmorgan | is so broken... | 23:07 |
| *** kzaitsev_mb has quit IRC | 23:08 | |
| notmorgan | and... i *think* once that is fixed we'll be within striking distance of py3 easily | 23:08 |
| *** mescanef has quit IRC | 23:08 | |
| *** Sukhdev has quit IRC | 23:09 | |
| notmorgan | (or the test suite is doing something weird( | 23:09 |
| *** signed8bit_Zzz is now known as signed8bit | 23:09 | |
| pabelanger | jeblair: mordred: fungi: We should also land https://review.openstack.org/#/c/326114/ for nodepool too. Since we are rolling forward with v25 | 23:09 |
| pabelanger | will give us new statsd for http://grafana.openstack.org/dashboard/db/nodepool | 23:10 |
| jeblair | notmorgan: check handleStatus() in gear; i think it may be putting a bytestring into a string | 23:10 |
| *** sorantis has quit IRC | 23:11 | |
| *** sdake has joined #openstack-infra | 23:12 | |
| jeblair | pabelanger: yep, and i suspect we may have some nodepool restarts ahead of us soon | 23:12 |
| openstackgerrit | Merged openstack-infra/system-config: Fix typos in zuul node definition https://review.openstack.org/326737 | 23:13 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix span for jenkins / zuul launcher to a single row https://review.openstack.org/326761 | 23:13 |
| pabelanger | jeblair: indeed | 23:13 |
| *** markvoelker has quit IRC | 23:13 | |
| notmorgan | jeblair: yeah thats is where i am now | 23:14 |
| notmorgan | jeblair: yep | 23:15 |
| pabelanger | jeblair: so 7 jobs killed by watchdog today. I was looking into zuul_runner.py and wondering if we should replace proc.wait() with proc.communicate(). Reading up on wait() it is possible to deadlock on the child process: https://docs.python.org/2/library/subprocess.html#subprocess.Popen.wait | 23:15 |
| jeblair | pabelanger, crinkle: i've noticed that all the gate-openstackci-beaker-ubuntu-trusty jobs which run on zuul-launcher are unable to run the post-job playbook because they get ssh authentication errors | 23:16 |
| pabelanger | maybe we are hitting that | 23:16 |
| notmorgan | jeblair: look at that, it needs to decode the name explicitly because it's doing b'<name>' into %s | 23:16 |
| *** sdague has quit IRC | 23:16 | |
| notmorgan | jeblair: >>> '%s' % b'test' | 23:16 |
| notmorgan | jeblair: "b'test'" | 23:16 |
| notmorgan | jeblair: so an explicit utf-8 decode might be the right answer. | 23:17 |
| pabelanger | jeblair: I think we ssh to loopback for beaker | 23:17 |
| *** hongbin has quit IRC | 23:17 | |
| jeblair | pabelanger: that's not the issue. zuul_runner can legitimately run *forever*. it is ansible's job to kill it when we configure the async process to do so after a timeout. | 23:17 |
| jeblair | pabelanger: those 7 watchdog events are very likely to be the jobs simply running long. | 23:18 |
| *** ihrachys has joined #openstack-infra | 23:18 | |
| *** Sukhdev has joined #openstack-infra | 23:19 | |
| *** xyang1 has quit IRC | 23:19 | |
| notmorgan | jeblair: trying that now. if it works... woo :) | 23:19 |
| jeblair | pabelanger: do we do anything in those jobs that might cause ssh on the host to stop working? | 23:19 |
| pabelanger | jeblair: okay, let me check logs for async attempts. Might need to bump logging to see that | 23:19 |
| *** IlyaG has joined #openstack-infra | 23:20 | |
| pabelanger | jeblair: good question | 23:20 |
| pabelanger | jeblair: For example, we do restart sshd in some of our jobs | 23:20 |
| jhesketh | Morning | 23:20 |
| *** PollyZ has joined #openstack-infra | 23:20 | |
| pabelanger | jeblair: infact, we do that in our beaker jobs. local-local-ssh-root macro, but honestly we shouldn't need that. I need to see if beaker can leverage sudo after it SSH's | 23:21 |
| crinkle | jeblair: could you share an example log for that? i've been in conference mode and don't have enough context | 23:22 |
| jeblair | pabelanger: hrm, none of that *seems* like it should affect ssh.... | 23:22 |
| jeblair | crinkle: sadly, no... the issue is that we are unable to copy the logs off of the host after the run | 23:23 |
| crinkle | oh | 23:23 |
| pabelanger | jeblair: is it possible we are hitting networking blips? | 23:23 |
| jeblair | crinkle, pabelanger: i think the next step might be to trigger a job, watch for it to run on zl01, and then hold the node and poke at it | 23:23 |
| anteaya | morning jhesketh | 23:23 |
| jeblair | i have to run now, so i'll have to pick that up tomorrow | 23:24 |
| crinkle | jeblair: sounds good to me | 23:24 |
| * crinkle -> sleep | 23:24 | |
| *** PollyZ has quit IRC | 23:25 | |
| jeblair | #status log jenkins01 is in prepare-for-shutdown mode in preparation for decommissioning. | 23:25 |
| openstackstatus | jeblair: finished logging | 23:25 |
| *** tosky has quit IRC | 23:27 | |
| *** signed8bit is now known as signed8bit_Zzz | 23:28 | |
| *** IlyaG has quit IRC | 23:28 | |
| *** Guest5756 has quit IRC | 23:29 | |
| *** Sukhdev has quit IRC | 23:30 | |
| *** amotoki has joined #openstack-infra | 23:30 | |
| *** Sukhdev has joined #openstack-infra | 23:32 | |
| *** IlyaG has joined #openstack-infra | 23:33 | |
| *** PollyZ has joined #openstack-infra | 23:34 | |
| openstackgerrit | Augustina Ragwitz proposed openstack-infra/project-config: WIP: Add grenade test for Nova simple-cells-setup migration https://review.openstack.org/326105 | 23:34 |
| *** amotoki has quit IRC | 23:35 | |
| *** IlyaG has quit IRC | 23:35 | |
| *** IlyaG has joined #openstack-infra | 23:35 | |
| *** Julien-zte has quit IRC | 23:36 | |
| *** ihrachys has quit IRC | 23:36 | |
| *** fawadkhaliq has quit IRC | 23:37 | |
| *** IlyaG has quit IRC | 23:37 | |
| *** ihrachys has joined #openstack-infra | 23:38 | |
| *** PollyZ has quit IRC | 23:38 | |
| *** amitgandhinz has joined #openstack-infra | 23:39 | |
| openstackgerrit | Augustina Ragwitz proposed openstack-infra/project-config: WIP: Add grenade test for Nova simple-cells-setup migration https://review.openstack.org/326105 | 23:39 |
| *** Sukhdev has quit IRC | 23:40 | |
| *** Sukhdev has joined #openstack-infra | 23:40 | |
| *** salv-orl_ has quit IRC | 23:43 | |
| *** salv-orlando has joined #openstack-infra | 23:43 | |
| *** amitgandhinz has quit IRC | 23:44 | |
| openstackgerrit | Merged openstack-infra/nodepool: Add nodepool.launch.manager.* for nodes assigned via Gearman https://review.openstack.org/326114 | 23:44 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: disable voting on puppet-ceph beaker jobs https://review.openstack.org/326591 | 23:46 |
| *** sdake has quit IRC | 23:46 | |
| *** PollyZ has joined #openstack-infra | 23:48 | |
| *** fawadkhaliq has joined #openstack-infra | 23:52 | |
| *** PollyZ has quit IRC | 23:52 | |
| pabelanger | jeblair: crinkle: The issue with the beaker jobs failing on zl01, is in allow-local-ssh-root we are regenerating the SSH keys, for the jenkins user. Which then prevents zuul-launcher from SSHing to get logs: http://paste.openstack.org/show/508782/ | 23:54 |
| pabelanger | jeblair: crinkle: the fix is to stop replacing the SSH keys of the jenkins user in allow-local-ssh-root | 23:54 |
| *** thorst has joined #openstack-infra | 23:56 | |
| *** fawadkhaliq has quit IRC | 23:56 | |
| *** thorst has quit IRC | 23:56 | |
| *** thorst has joined #openstack-infra | 23:57 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Don't override jenkins user SSH keys https://review.openstack.org/326766 | 23:58 |
| pabelanger | jeblair: crinkle: ^ | 23:58 |
| pabelanger | I need to confirm beaker will still work | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
