| melwitt | well, that's not entirely true. when new tests are added in a patch I look there to look at them | 00:00 |
|---|---|---|
| mtreinish | melwitt: I think it'll be a change in this function: https://github.com/openstack/os-testr/blob/master/os_testr/subunit2html.py#L614-L629 | 00:00 |
| mtreinish | but I'm not sure what n, t, o, and e are there | 00:01 |
| *** baoli has joined #openstack-infra | 00:01 | |
| melwitt | mtreinish: thanks, that's a big help | 00:01 |
| *** mylu has quit IRC | 00:02 | |
| *** sdake_ has quit IRC | 00:02 | |
| *** mylu has joined #openstack-infra | 00:03 | |
| *** gyee has joined #openstack-infra | 00:04 | |
| *** mylu has quit IRC | 00:05 | |
| *** xarses has joined #openstack-infra | 00:05 | |
| mtreinish | melwitt: once this project config patch lands: https://review.openstack.org/#/c/279317/ we'll also be able to add another visualization for the results to log output | 00:05 |
| mtreinish | melwitt: it will look something like: https://stackviz.timothyb89.org/s/5e0008d0-bdd4-498e-af63-40b5af066970/#/testrepository.subunit.gz | 00:05 |
| mtreinish | it's still kinda rough though | 00:06 |
| *** Swami has quit IRC | 00:06 | |
| melwitt | whoa, pretty cool | 00:06 |
| *** mylu has joined #openstack-infra | 00:07 | |
| *** xarses_ has joined #openstack-infra | 00:08 | |
| *** mylu has quit IRC | 00:09 | |
| *** Qiming has quit IRC | 00:09 | |
| *** xarses has quit IRC | 00:10 | |
| *** asettle has quit IRC | 00:11 | |
| *** sdake__ has quit IRC | 00:13 | |
| *** MarkAtwood has quit IRC | 00:14 | |
| *** gyee has quit IRC | 00:14 | |
| *** asettle has joined #openstack-infra | 00:16 | |
| dmsimard | Is there an ongoing gate issue relative to puppetlabs-release ? | 00:20 |
| dmsimard | http://logs.openstack.org/72/308572/1/check/gate-openstackci-beaker-centos-7/2258bb5/console.html#_2016-04-20_23_54_21_196 | 00:20 |
| dmsimard | pabelanger, EmilienM ^ ? | 00:20 |
| *** kengo_sakai has joined #openstack-infra | 00:21 | |
| crinkle | dmsimard: yes there is a fix in progress for infra https://review.openstack.org/#/c/308426/ and EmilienM has a workaround https://review.openstack.org/#/c/308580/ | 00:21 |
| *** ybathia has quit IRC | 00:21 | |
| crinkle | dmsimard: so try recheck | 00:21 |
| dmsimard | crinkle: hmm, I did a recheck after that merged I think, I guess it hasn't propagated yet ? https://review.openstack.org/#/c/308572/ | 00:22 |
| *** xarses_ has quit IRC | 00:23 | |
| crinkle | hmm... | 00:23 |
| dmsimard | ah, Jeremy said in the comments it requires a new image to be spun out | 00:23 |
| dmsimard | At what frequency are the images rebuilt ? I can try later tonight .. | 00:24 |
| crinkle | dmsimard: oh that change is for system-config, EmilienM's change was only for puppet-openstack | 00:24 |
| * crinkle not sure about image build frequency | 00:24 | |
| mgagne | https://github.com/openstack-infra/project-config/blob/master/nodepool/nodepool.yaml#L5-L8 | 00:24 |
| *** ddieterly[away] is now known as ddieterly | 00:25 | |
| *** kengo_sakai has quit IRC | 00:25 | |
| *** doug-fish has joined #openstack-infra | 00:25 | |
| *** salv-orlando has joined #openstack-infra | 00:26 | |
| *** jamielennox|away is now known as jamielennox | 00:28 | |
| dmsimard | oh, so, tomorrow then T_T | 00:29 |
| dmsimard | unless they forcefully updated it or something | 00:29 |
| dmsimard | thanks mgagne :D | 00:29 |
| mgagne | yw | 00:29 |
| *** ddieterly is now known as ddieterly[away] | 00:30 | |
| *** ddieterly[away] is now known as ddieterly | 00:30 | |
| *** salv-orlando has quit IRC | 00:33 | |
| *** asettle has quit IRC | 00:35 | |
| *** avarner__ has joined #openstack-infra | 00:37 | |
| *** julim_ has joined #openstack-infra | 00:37 | |
| *** tphummel has quit IRC | 00:37 | |
| *** kjorgens_ has joined #openstack-infra | 00:37 | |
| *** lakshmiS_ has joined #openstack-infra | 00:37 | |
| *** ajmiller_ has joined #openstack-infra | 00:37 | |
| *** jklare has quit IRC | 00:38 | |
| *** wznoinsk_ has joined #openstack-infra | 00:38 | |
| *** taron2 has joined #openstack-infra | 00:38 | |
| *** kjorgensen has quit IRC | 00:38 | |
| *** taron1 has quit IRC | 00:38 | |
| *** andymccr has quit IRC | 00:38 | |
| *** lakshmiS has quit IRC | 00:39 | |
| *** ajmiller has quit IRC | 00:39 | |
| *** wznoinsk has quit IRC | 00:39 | |
| *** eliqiao_ has quit IRC | 00:39 | |
| *** trey has quit IRC | 00:39 | |
| *** adreznec has quit IRC | 00:39 | |
| *** julim has quit IRC | 00:39 | |
| *** jesusaur has quit IRC | 00:39 | |
| *** thingee has quit IRC | 00:39 | |
| *** tqtran has quit IRC | 00:39 | |
| *** Na3iL has quit IRC | 00:39 | |
| *** avarner_ has quit IRC | 00:39 | |
| *** amrith has quit IRC | 00:39 | |
| *** eliqiao has joined #openstack-infra | 00:41 | |
| *** esker has joined #openstack-infra | 00:43 | |
| *** amrith has joined #openstack-infra | 00:44 | |
| *** jklare has joined #openstack-infra | 00:44 | |
| *** andymccr has joined #openstack-infra | 00:44 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/publications: Update slide deck for 2016 Newton Summit https://review.openstack.org/308700 | 00:46 |
| *** trey has joined #openstack-infra | 00:46 | |
| *** stewie925_ has quit IRC | 00:46 | |
| *** adreznec has joined #openstack-infra | 00:47 | |
| *** jamielennox is now known as jamielennox|away | 00:49 | |
| *** jamielennox|away is now known as jamielennox | 00:51 | |
| pleia2 | pabelanger & docaedo ^^ | 00:51 |
| *** jesusaur has joined #openstack-infra | 00:52 | |
| *** kjorgens_ has quit IRC | 00:53 | |
| *** madhu_ak has quit IRC | 00:55 | |
| *** apoorvad has quit IRC | 00:55 | |
| clarkb | pleia2: re your comments on the doc, while great because they point out real issues I juts don't know if I have the steam to address them. Those directions are copy pasta'd from the readme due to jeblair's earlier -1 | 00:56 |
| clarkb | unfortunately this change has gone around in circles when it started with a very simple direct goal and got pulled in several different other directions and just never seemed to be good enough :( | 00:57 |
| clarkb | I might repropose it as "run nodepool devstack plugin" and only do that | 00:57 |
| *** tlian2 has joined #openstack-infra | 00:58 | |
| *** mtanino has quit IRC | 00:58 | |
| clarkb | what do people think about just having a "run nodepool devstack plugin" doc? | 00:59 |
| clarkb | oh thta reminds me nibalizer wanted to get his talk reviewed | 01:00 |
| * clarkb does this before he forgets | 01:00 | |
| clarkb | pleia2: should I be reviewing 308700 yet? or do you expect to make more revision? | 01:01 |
| *** Na3iL has joined #openstack-infra | 01:01 | |
| *** tlian has quit IRC | 01:01 | |
| nibalizer | clarkb: i ike docs | 01:01 |
| clarkb | nibalizer: for your talk, how do I render it | 01:03 |
| *** rossella_s has quit IRC | 01:03 | |
| clarkb | sphinx based on requirements.txt | 01:04 |
| *** rossella_s has joined #openstack-infra | 01:04 | |
| *** bpokorny_ has joined #openstack-infra | 01:05 | |
| clarkb | that seems to have sort of worked with make html | 01:06 |
| nibalizer | ya make slides | 01:07 |
| *** kjorgensen has joined #openstack-infra | 01:07 | |
| pleia2 | clarkb: it does present a framework that people can nudge into working so I think it's valuable, maybe we just land this and fix it up? | 01:08 |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Fix CFP configuration for >=2.10.0 https://review.openstack.org/308705 | 01:09 |
| pleia2 | clarkb: 308700 is only WIP because I know I need to update screenshots, feel free go to town on it :) | 01:09 |
| *** zhurong has joined #openstack-infra | 01:09 | |
| pleia2 | it likely needs other updates I didn't catch in my first pass too | 01:09 |
| *** bpokorny has quit IRC | 01:10 | |
| *** bpokorny_ has quit IRC | 01:10 | |
| clarkb | ok, mostly figured I would offer since I was reviewing. I should pour a beer and review it | 01:12 |
| *** kjorgensen has quit IRC | 01:12 | |
| *** chuck__ is now known as zul | 01:15 | |
| *** pvaneck has quit IRC | 01:16 | |
| *** nwkarsten has joined #openstack-infra | 01:17 | |
| clarkb | pleia2: I would maybe drop the what is openstack slide? perhaps we can assume attendees know what it is at the summit? maybe that is a bad assumption | 01:17 |
| *** gongysh has joined #openstack-infra | 01:18 | |
| clarkb | slides 2 and 3 maybe go away because summit? | 01:18 |
| *** Qiming has joined #openstack-infra | 01:19 | |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Support multi backends for Zaqar tempest job https://review.openstack.org/308698 | 01:20 |
| pleia2 | clarkb: heh, the way we maintain this repo gets a bit in the way here, it's still a generic slide deck but we tag it for a presentation, I guess after the next person could restore those files if they want them back in their next presentation? | 01:21 |
| *** mylu has joined #openstack-infra | 01:21 | |
| clarkb | pleia2: ya, maybe pull them out in a separate commit so a revert is easy? | 01:21 |
| clarkb | or just comment them out day of talk locally | 01:22 |
| pleia2 | clarkb: I was going to swap out names as well on day-of | 01:22 |
| *** nwkarsten has quit IRC | 01:22 | |
| pleia2 | but I never quite new what was appropriate to do with that every growing list of names | 01:22 |
| pleia2 | er, s/new/sure | 01:22 |
| pleia2 | multi-tasking \o/ | 01:22 |
| clarkb | I think just do whatever is easy | 01:23 |
| *** doug-fish has quit IRC | 01:24 | |
| openstackgerrit | Dan Prince proposed openstack-infra/project-config: Create an os-net-config ACL https://review.openstack.org/307975 | 01:25 |
| clarkb | pleia2: otherwise looks good | 01:27 |
| pleia2 | clarkb: great, thanks :) | 01:27 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Switch website to use tripleo-jobs-gerrit.py https://review.openstack.org/307872 | 01:30 |
| *** mylu has quit IRC | 01:30 | |
| *** Na3iL has quit IRC | 01:32 | |
| *** ddieterly has quit IRC | 01:32 | |
| *** mylu has joined #openstack-infra | 01:33 | |
| *** adreznec has quit IRC | 01:39 | |
| *** gildub has joined #openstack-infra | 01:39 | |
| *** adreznec has joined #openstack-infra | 01:41 | |
| *** sridhar_ram has quit IRC | 01:41 | |
| *** ddieterly has joined #openstack-infra | 01:42 | |
| *** thingee has joined #openstack-infra | 01:42 | |
| *** mylu has quit IRC | 01:43 | |
| *** mylu has joined #openstack-infra | 01:43 | |
| *** gongysh has quit IRC | 01:46 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Fix comment on requirements job https://review.openstack.org/308708 | 01:48 |
| ianw_ | jeblair: ^ so, yeah | 01:48 |
| *** salv-orlando has joined #openstack-infra | 01:49 | |
| EmilienM | nibalizer: can you look https://review.openstack.org/#/c/308424/ please? to make sure we're doing well | 01:50 |
| *** zz_dimtruck is now known as dimtruck | 01:52 | |
| *** esker has quit IRC | 01:52 | |
| *** amrith is now known as _amrith_ | 01:55 | |
| *** yamamot__ has joined #openstack-infra | 01:56 | |
| *** elo has quit IRC | 01:57 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Fix comment on requirements job https://review.openstack.org/308708 | 01:58 |
| *** kengo_sakai has joined #openstack-infra | 01:58 | |
| *** esker has joined #openstack-infra | 02:01 | |
| *** salv-orlando has quit IRC | 02:05 | |
| jhesketh | infra-root: the ovh images appear to be outdated. Is there currently an issue uploading? | 02:06 |
| clarkb | jhesketh: no the issue is mordred restarts image builds often enough that we don't really get images updated | 02:07 |
| *** julim_ has quit IRC | 02:07 | |
| clarkb | (well that and ovh upload success rate is not always great) | 02:07 |
| jhesketh | ovh-bhs1 is 7 days old | 02:07 |
| jhesketh | clarkb: should I kick off an upload? | 02:07 |
| clarkb | jhesketh: how old are the images? | 02:07 |
| clarkb | mordred has restarted the image builds almost every day the last week I think | 02:08 |
| clarkb | s/restarted/killed/ | 02:08 |
| jhesketh | 9 hours | 02:08 |
| clarkb | oh cool we got images built today | 02:08 |
| * jhesketh is just looking at trusty | 02:08 | |
| clarkb | then ya either there was a restart during uploads after build or we just failed to ovh | 02:08 |
| clarkb | uplaods to ovh do seem to fail relatively frequently, I would try a new upload to get that updated | 02:08 |
| jhesketh | although looks like most if not all got built today | 02:09 |
| jhesketh | clarkb: okay, I'll kick that off in a screen | 02:09 |
| *** EricGonc_ has quit IRC | 02:10 | |
| lifeless | mordred: fungi: your thoughts on https://review.openstack.org/#/c/295530/1 | 02:14 |
| *** jrmyjohn has joined #openstack-infra | 02:15 | |
| *** vikram has joined #openstack-infra | 02:15 | |
| vikram | Need one more +2 for https://review.openstack.org/#/c/268726/. Can someone plz help ;) | 02:16 |
| jhesketh | clarkb: ERROR shade.exc: Image creation failed: Error finding address for https://image.compute.bhs1.cloud.ovh.net/v2/images/..../file: Unable to establish connection to https://image.compute.bhs1.cloud.ovh.net/v2/images/..../file | 02:17 |
| *** thorst has joined #openstack-infra | 02:18 | |
| *** cody-somerville has quit IRC | 02:19 | |
| *** nwkarsten has joined #openstack-infra | 02:19 | |
| jhesketh | clarkb: is that a transient thing we've seen before, or should we ping somebody at ovh? | 02:19 |
| *** gongysh has joined #openstack-infra | 02:19 | |
| *** jrmyjohn has quit IRC | 02:19 | |
| *** lakshmiS_ has quit IRC | 02:21 | |
| clarkb | ya thats transient | 02:21 |
| clarkb | it seems to affect bhs1 more than gra1 | 02:21 |
| clarkb | lifeless: +2 | 02:21 |
| clarkb | TIL that Fuel in addition to everyone else has reimplemented everything | 02:22 |
| clarkb | but on top of that are -1'ing our changes because we don't do things the way they hav edone them | 02:22 |
| *** Goneri has joined #openstack-infra | 02:22 | |
| clarkb | (also gerrits comment quoting is broken) | 02:23 |
| *** asettle has joined #openstack-infra | 02:23 | |
| *** nwkarsten has quit IRC | 02:24 | |
| *** tlian2 has quit IRC | 02:24 | |
| jhesketh | clarkb: so... keep retrying until success? | 02:26 |
| clarkb | jhesketh: ya it seems to succeed eventually | 02:26 |
| *** esker has quit IRC | 02:26 | |
| jhesketh | not ideal, but okay | 02:26 |
| mordred | clarkb: like, what changes? | 02:27 |
| clarkb | mordred: lifeless' from above | 02:27 |
| clarkb | mordred: https://review.openstack.org/#/c/295530/1 | 02:27 |
| mordred | clarkb: am I going to be happy about this? | 02:27 |
| *** ddieterly is now known as ddieterly[away] | 02:28 | |
| *** r-mibu has quit IRC | 02:29 | |
| lifeless | mordred: you're goint to +2A it for us all :) | 02:31 |
| *** tlian has joined #openstack-infra | 02:32 | |
| *** baoli has quit IRC | 02:32 | |
| mordred | lifeless: I have done so | 02:33 |
| mordred | lifeless: I have also left a not very nice comment | 02:33 |
| mordred | just for the record | 02:33 |
| *** doug-fish has joined #openstack-infra | 02:34 | |
| lifeless | mordred: thans :) | 02:34 |
| *** r-mibu has joined #openstack-infra | 02:40 | |
| *** esker has joined #openstack-infra | 02:40 | |
| *** asettle has quit IRC | 02:40 | |
| *** brad_behle has quit IRC | 02:42 | |
| *** kengo_sa_ has joined #openstack-infra | 02:42 | |
| *** vikram has quit IRC | 02:42 | |
| *** yamahata has joined #openstack-infra | 02:43 | |
| *** baoli has joined #openstack-infra | 02:44 | |
| *** asettle has joined #openstack-infra | 02:44 | |
| *** kengo_sakai has quit IRC | 02:45 | |
| *** resker has joined #openstack-infra | 02:46 | |
| *** esker has quit IRC | 02:48 | |
| *** Goneri has quit IRC | 02:49 | |
| *** baoli has quit IRC | 02:50 | |
| *** EricGonczer_ has joined #openstack-infra | 02:57 | |
| *** resker has quit IRC | 02:58 | |
| *** yamahata has quit IRC | 03:00 | |
| *** EricGonczer_ has quit IRC | 03:02 | |
| *** salv-orlando has joined #openstack-infra | 03:06 | |
| *** sridhar_ram has joined #openstack-infra | 03:09 | |
| *** sridhar_ram has quit IRC | 03:09 | |
| *** salv-orlando has quit IRC | 03:10 | |
| *** esker has joined #openstack-infra | 03:11 | |
| *** thorst has quit IRC | 03:14 | |
| *** thorst has joined #openstack-infra | 03:14 | |
| *** yamamot__ has quit IRC | 03:15 | |
| *** esker has quit IRC | 03:15 | |
| *** asettle has quit IRC | 03:16 | |
| *** Nikolay_St has joined #openstack-infra | 03:16 | |
| *** asettle has joined #openstack-infra | 03:16 | |
| openstackgerrit | Tony Breeds proposed openstack/requirements: Blacklist broken Babel releases https://review.openstack.org/308727 | 03:17 |
| *** Rockyg has quit IRC | 03:18 | |
| tonyb | AJaeger: when you're back https://review.openstack.org/#/q/Ia61e96963c0c81814d89c247c82fd75c6ab86a81,n,z | 03:18 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 03:20 |
| *** jamielennox is now known as jamielennox|away | 03:21 | |
| *** thorst has quit IRC | 03:23 | |
| *** sdake has joined #openstack-infra | 03:23 | |
| *** gongysh has quit IRC | 03:23 | |
| *** salv-orlando has joined #openstack-infra | 03:23 | |
| *** sdake_ has joined #openstack-infra | 03:24 | |
| *** gongysh has joined #openstack-infra | 03:25 | |
| *** doug-fish has quit IRC | 03:25 | |
| *** mylu has quit IRC | 03:27 | |
| *** sdake has quit IRC | 03:27 | |
| *** xarses_ has joined #openstack-infra | 03:27 | |
| *** doug-fish has joined #openstack-infra | 03:27 | |
| *** esker has joined #openstack-infra | 03:28 | |
| *** ddieterly[away] has quit IRC | 03:28 | |
| *** salv-orlando has quit IRC | 03:29 | |
| *** links has joined #openstack-infra | 03:30 | |
| *** sridhar_ram has joined #openstack-infra | 03:32 | |
| *** sridhar_ram1 has joined #openstack-infra | 03:34 | |
| *** zaro has joined #openstack-infra | 03:34 | |
| *** andreww has joined #openstack-infra | 03:36 | |
| *** sridhar_ram has quit IRC | 03:36 | |
| *** cody-somerville has joined #openstack-infra | 03:39 | |
| *** xarses_ has quit IRC | 03:39 | |
| *** tlian has quit IRC | 03:41 | |
| *** amotoki has joined #openstack-infra | 03:42 | |
| *** mylu has joined #openstack-infra | 03:43 | |
| *** esker has quit IRC | 03:45 | |
| *** asettle has quit IRC | 03:48 | |
| *** asettle has joined #openstack-infra | 03:48 | |
| *** esker has joined #openstack-infra | 03:55 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Fix URL detection in testresult match https://review.openstack.org/308731 | 03:56 |
| *** keedya has quit IRC | 03:56 | |
| *** harlowja_at_home has joined #openstack-infra | 03:57 | |
| *** yamamot__ has joined #openstack-infra | 03:59 | |
| *** nwkarsten has joined #openstack-infra | 03:59 | |
| *** Nikolay_St has quit IRC | 04:00 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Fix comment on requirements job https://review.openstack.org/308708 | 04:01 |
| *** amotoki has quit IRC | 04:01 | |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Adding support for Jenkins OpenStack Cloud Plugin https://review.openstack.org/306948 | 04:03 |
| *** nwkarsten has quit IRC | 04:04 | |
| *** esker has quit IRC | 04:04 | |
| *** maishsk has quit IRC | 04:05 | |
| *** bapalm has quit IRC | 04:10 | |
| *** esker has joined #openstack-infra | 04:10 | |
| *** amotoki has joined #openstack-infra | 04:11 | |
| *** bapalm has joined #openstack-infra | 04:12 | |
| *** sdake_ has quit IRC | 04:13 | |
| *** esker has quit IRC | 04:15 | |
| *** esker has joined #openstack-infra | 04:17 | |
| *** fedexo has joined #openstack-infra | 04:20 | |
| *** thorst has joined #openstack-infra | 04:20 | |
| *** maishsk has joined #openstack-infra | 04:22 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:24 | |
| *** esker has quit IRC | 04:25 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Cross test constraints and project unittests. https://review.openstack.org/308739 | 04:26 |
| *** doug-fish has quit IRC | 04:26 | |
| *** asettle has quit IRC | 04:27 | |
| *** maishsk has quit IRC | 04:27 | |
| *** asettle has joined #openstack-infra | 04:27 | |
| *** salv-orlando has joined #openstack-infra | 04:28 | |
| *** thorst has quit IRC | 04:28 | |
| *** kzaitsev_mb has quit IRC | 04:30 | |
| openstackgerrit | Merged openstack/diskimage-builder: Move selinux restore to end of finalise https://review.openstack.org/308128 | 04:30 |
| *** vhosakot has quit IRC | 04:30 | |
| *** mylu has quit IRC | 04:32 | |
| *** rkukura has joined #openstack-infra | 04:32 | |
| *** dahoo has quit IRC | 04:32 | |
| *** mylu has joined #openstack-infra | 04:33 | |
| *** maishsk has joined #openstack-infra | 04:33 | |
| *** sdake has joined #openstack-infra | 04:36 | |
| tonyb | clarkb: Thanks for https://review.openstack.org/308739 that's awesome! | 04:37 |
| *** salv-orlando has quit IRC | 04:37 | |
| *** rlandy has quit IRC | 04:37 | |
| *** harlowja_at_home has quit IRC | 04:38 | |
| *** maishsk has quit IRC | 04:38 | |
| *** esker has joined #openstack-infra | 04:40 | |
| *** hdd has quit IRC | 04:40 | |
| *** zhenguo__ has joined #openstack-infra | 04:40 | |
| *** zhenguo_ has quit IRC | 04:43 | |
| *** zhenguo__ is now known as zhenguo_ | 04:43 | |
| *** psachin has joined #openstack-infra | 04:44 | |
| prometheanfire | ianw_: when https://review.openstack.org/#/c/296626 merges I'll rebase my gentoo patch for that element | 04:48 |
| prometheanfire | ianw_: also, did you just +2 your own patch? :P | 04:48 |
| *** rcernin has quit IRC | 04:48 | |
| prometheanfire | ianw_: not that it seems there are enough cores to get +2 on stuff in DIB | 04:48 |
| prometheanfire | or active ones at lest | 04:48 |
| prometheanfire | least | 04:48 |
| *** doug-fish has joined #openstack-infra | 04:50 | |
| *** sridhar_ram1 has quit IRC | 04:52 | |
| *** doug-fish has quit IRC | 04:54 | |
| ianw_ | clarkb: if around; did you test with the fix to the EPEL element (https://review.openstack.org/#/c/306213/2) or just manually fix up your wrongly installed epel6 issue? | 04:55 |
| *** maestro1 has joined #openstack-infra | 04:57 | |
| *** salv-orlando has joined #openstack-infra | 04:58 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: yum-minimal: strip locale archive https://review.openstack.org/304399 | 05:01 |
| *** sdake_ has joined #openstack-infra | 05:01 | |
| *** salv-orlando has quit IRC | 05:02 | |
| *** kengo_sakai has joined #openstack-infra | 05:03 | |
| *** sdake has quit IRC | 05:03 | |
| *** rossella_s has quit IRC | 05:03 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add releasenotes https://review.openstack.org/292193 | 05:04 |
| *** rossella_s has joined #openstack-infra | 05:04 | |
| *** maestro1 has quit IRC | 05:05 | |
| openstackgerrit | vinay kumar muddu proposed openstack/diskimage-builder: Included "sudo" for devuser element https://review.openstack.org/308747 | 05:05 |
| *** maestro1 has joined #openstack-infra | 05:06 | |
| *** salv-orlando has joined #openstack-infra | 05:07 | |
| *** jaosorior has joined #openstack-infra | 05:07 | |
| *** mylu has quit IRC | 05:09 | |
| *** ayoung has quit IRC | 05:10 | |
| *** maestro1 has quit IRC | 05:11 | |
| *** cody-somerville has quit IRC | 05:13 | |
| *** rcernin has joined #openstack-infra | 05:17 | |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Adding support for Jenkins OpenStack Cloud Plugin https://review.openstack.org/306948 | 05:17 |
| *** psachin has quit IRC | 05:21 | |
| *** oanson has joined #openstack-infra | 05:22 | |
| ianw_ | pabelanger: when around, gate-openstackci-beaker-centos-7 failing -> file /etc/pki/rpm-gpg/RPM-GPG-KEY-puppetlabs from install of puppetlabs-release-7-12.noarch conflicts with file from package puppetlabs-release-7-10.noarch | 05:23 |
| *** e0ne has joined #openstack-infra | 05:23 | |
| ianw_ | guess new packages are broken or something? | 05:23 |
| openstackgerrit | Merged openstack/diskimage-builder: Really remove all interfaces in dhcp-all-ifaces https://review.openstack.org/296186 | 05:23 |
| openstackgerrit | Merged openstack/diskimage-builder: Handle unconfigured interfaces for dhcp-all-ifaces https://review.openstack.org/296187 | 05:23 |
| openstackgerrit | Matthew Thode proposed openstack-infra/bindep: Add Gentoo support to bindep https://review.openstack.org/307493 | 05:25 |
| prometheanfire | fungi: now with more tests https://review.openstack.org/307493 | 05:26 |
| *** thorst has joined #openstack-infra | 05:26 | |
| *** ianw_ has quit IRC | 05:28 | |
| *** ramishra has quit IRC | 05:28 | |
| *** ianw_ has joined #openstack-infra | 05:29 | |
| *** ianw_ has quit IRC | 05:30 | |
| *** ramishra has joined #openstack-infra | 05:31 | |
| *** ianw has quit IRC | 05:31 | |
| *** asettle has quit IRC | 05:31 | |
| *** ianw has joined #openstack-infra | 05:31 | |
| *** psachin has joined #openstack-infra | 05:33 | |
| *** thorst has quit IRC | 05:33 | |
| *** ianw has quit IRC | 05:34 | |
| *** ianw has joined #openstack-infra | 05:34 | |
| *** esker has quit IRC | 05:35 | |
| *** sridhar_ram has joined #openstack-infra | 05:36 | |
| *** sridhar_ram has quit IRC | 05:37 | |
| ianw | greghaynes: i've cleared out a bunch of stuff in dib; it would be great if you could get a release out tomorrow your time before the build. i don't want to do it now because i'm about to disappear | 05:40 |
| *** esker has joined #openstack-infra | 05:40 | |
| *** asettle has joined #openstack-infra | 05:41 | |
| *** sridhar_ram has joined #openstack-infra | 05:44 | |
| *** sridhar_ram1 has joined #openstack-infra | 05:50 | |
| *** roxanagh_ has joined #openstack-infra | 05:50 | |
| *** sridhar_ram has quit IRC | 05:50 | |
| *** tphummel has joined #openstack-infra | 05:51 | |
| *** roxanagh_ has quit IRC | 05:52 | |
| *** andymaier has joined #openstack-infra | 05:52 | |
| *** roxanagh_ has joined #openstack-infra | 05:53 | |
| *** kengo_sakai has quit IRC | 05:53 | |
| *** esker has quit IRC | 05:55 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/release-tools: Hide the zuul-cloner output unless there is an error https://review.openstack.org/308758 | 05:56 |
| *** esker has joined #openstack-infra | 05:56 | |
| prometheanfire | ianw: thanks, are you and greghaynes the only active cores in DIB? | 05:57 |
| *** roxanagh_ has quit IRC | 05:58 | |
| *** maishsk has joined #openstack-infra | 05:59 | |
| *** maishsk has quit IRC | 06:01 | |
| *** maishsk has joined #openstack-infra | 06:05 | |
| AJaeger | ianw: that puppetlabs change is fixed already (we hope) but needs new images... | 06:08 |
| AJaeger | ianw: see change Idc9f40cdc8a9e47bdf9baa141c09e97f7884d3cf for system-config | 06:08 |
| *** fitoduarte has joined #openstack-infra | 06:09 | |
| *** Yarboa has joined #openstack-infra | 06:09 | |
| *** aeng has quit IRC | 06:11 | |
| *** kushal has quit IRC | 06:12 | |
| *** dimtruck is now known as zz_dimtruck | 06:14 | |
| *** esker has quit IRC | 06:15 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config: Skip networking-nec python34 job for liberty and kilo https://review.openstack.org/308767 | 06:15 |
| *** yamahata has joined #openstack-infra | 06:16 | |
| *** andreykurilin has quit IRC | 06:17 | |
| *** esker has joined #openstack-infra | 06:17 | |
| *** asselin__ has joined #openstack-infra | 06:18 | |
| *** asselin_ has quit IRC | 06:20 | |
| *** andymaier_ has joined #openstack-infra | 06:21 | |
| *** mrmartin has joined #openstack-infra | 06:23 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: Add grenade jobs https://review.openstack.org/306363 | 06:23 |
| *** scheuran has joined #openstack-infra | 06:24 | |
| *** andymaier has quit IRC | 06:25 | |
| *** ihrachys has joined #openstack-infra | 06:26 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/308772 | 06:27 |
| *** mikelk has joined #openstack-infra | 06:27 | |
| *** asettle has quit IRC | 06:29 | |
| *** asettle has joined #openstack-infra | 06:29 | |
| *** elo has joined #openstack-infra | 06:31 | |
| *** angdraug has joined #openstack-infra | 06:32 | |
| *** Nikolay_St has joined #openstack-infra | 06:33 | |
| *** jrmyjohn has joined #openstack-infra | 06:34 | |
| *** aarefiev has quit IRC | 06:35 | |
| *** yolanda has quit IRC | 06:37 | |
| *** armax has quit IRC | 06:37 | |
| masayukig | mtreinish: timothyb89: there's something wrong about http://status.openstack.org/openstack-health/ : "The last data in the subunit2sql database, from "2016-04-18T19:38:09.000Z", is >1 day old. There might be an issue with result collection." | 06:38 |
| *** peterlisak has quit IRC | 06:38 | |
| *** jtomasek has quit IRC | 06:38 | |
| *** jrmyjohn has quit IRC | 06:39 | |
| *** peterlisak has joined #openstack-infra | 06:39 | |
| *** angdraug has quit IRC | 06:39 | |
| *** nadya has joined #openstack-infra | 06:40 | |
| *** ihrachys has quit IRC | 06:40 | |
| *** nadya has quit IRC | 06:41 | |
| *** mylu has joined #openstack-infra | 06:43 | |
| *** asettle has quit IRC | 06:43 | |
| *** asettle has joined #openstack-infra | 06:47 | |
| *** yolanda has joined #openstack-infra | 06:47 | |
| *** mylu has quit IRC | 06:48 | |
| *** fitoduarte has quit IRC | 06:48 | |
| *** kushal has joined #openstack-infra | 06:50 | |
| *** nadya has joined #openstack-infra | 06:50 | |
| *** roxanagh_ has joined #openstack-infra | 06:54 | |
| *** thorst has joined #openstack-infra | 06:54 | |
| *** tphummel has quit IRC | 06:55 | |
| *** gildub_ has joined #openstack-infra | 06:56 | |
| *** roxanagh_ has quit IRC | 06:58 | |
| *** thorst has quit IRC | 06:59 | |
| *** aarefiev has joined #openstack-infra | 07:00 | |
| *** e0ne has quit IRC | 07:01 | |
| *** nadya has quit IRC | 07:02 | |
| *** HeOS has joined #openstack-infra | 07:03 | |
| *** mrmartin has quit IRC | 07:03 | |
| *** tesseract has joined #openstack-infra | 07:03 | |
| *** gildub has quit IRC | 07:03 | |
| *** gildub_ has quit IRC | 07:04 | |
| *** tesseract is now known as Guest14509 | 07:04 | |
| *** gildub has joined #openstack-infra | 07:04 | |
| *** e0ne has joined #openstack-infra | 07:07 | |
| *** arxcruz has joined #openstack-infra | 07:09 | |
| *** matrohon has joined #openstack-infra | 07:13 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: taas: Skip unit tests for doc-only changes https://review.openstack.org/308804 | 07:14 |
| *** ekonsdo_ has joined #openstack-infra | 07:15 | |
| *** fedexo has quit IRC | 07:18 | |
| *** woodster_ has quit IRC | 07:18 | |
| *** permalac has quit IRC | 07:19 | |
| *** flepied1 has quit IRC | 07:21 | |
| *** vincentll has joined #openstack-infra | 07:21 | |
| *** zeih has joined #openstack-infra | 07:21 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 07:22 |
| *** schipiga has joined #openstack-infra | 07:23 | |
| *** nmagnezi has joined #openstack-infra | 07:23 | |
| *** cathy__ has joined #openstack-infra | 07:24 | |
| schipiga | Hi guys! I have a very helpful patch to horizon config https://review.openstack.org/#/c/308261/. Whom may I request to review that to be sure it will be merged as quick as possible? | 07:25 |
| cathy__ | hi, i want to delete branches that no longer in use. Who can help me? | 07:25 |
| *** Aegil_ is now known as Aegil | 07:26 | |
| Aegil | cathy__: do you mean local git branches? for that you can use git branch -d mybranchname | 07:27 |
| cathy__ | not in local, branches have been committed and merged | 07:28 |
| cathy__ | http://git.openstack.org/cgit/openstack/fuel-plugin-onos/ | 07:30 |
| cathy__ | i need to delete branches named 6.1, 7.0 and kilo( not Kilo ) | 07:31 |
| *** shardy has joined #openstack-infra | 07:32 | |
| *** e0ne has quit IRC | 07:32 | |
| *** infra-red has joined #openstack-infra | 07:33 | |
| *** asettle has quit IRC | 07:33 | |
| *** dizquierdo has joined #openstack-infra | 07:33 | |
| *** infra-re_ has joined #openstack-infra | 07:34 | |
| *** ekonsdo_ has quit IRC | 07:34 | |
| *** ihrachys has joined #openstack-infra | 07:34 | |
| *** ihrachys has quit IRC | 07:35 | |
| *** infra-red has quit IRC | 07:37 | |
| AJaeger | schipiga: there're not only guys in this channel, we value our female team members as well | 07:39 |
| AJaeger | cathy__: any infra root can - but it's a manual step. Best to send an email to openstack-infra mailing list asking for it. | 07:39 |
| schipiga | oh my appoligies, I didn't want to offend nobody | 07:40 |
| vincentll | is there a way to see the status of the CI runners? like how many are there, which one is currently running my review, etc. | 07:41 |
| AJaeger | schipiga: I commented on your review. | 07:42 |
| cathy__ | AJaeger, thanks. | 07:43 |
| AJaeger | vincentll: status.openstack.org/zuul gives some stats as well as grafana.openstack.org | 07:43 |
| vincentll | thanks AJaeger | 07:43 |
| AJaeger | vincentll: we start a new node for each job, so no need to know the status of them ;) | 07:44 |
| *** jlanoux has joined #openstack-infra | 07:46 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Fix REPO_PREFIX for stable releases in tripleo.sh https://review.openstack.org/307644 | 07:47 |
| *** asettle has joined #openstack-infra | 07:48 | |
| *** cathy__ has quit IRC | 07:50 | |
| *** hashar has joined #openstack-infra | 07:50 | |
| *** andymaier_ has quit IRC | 07:50 | |
| *** mrmartin has joined #openstack-infra | 07:52 | |
| *** flepied has joined #openstack-infra | 07:52 | |
| *** hogepodge has quit IRC | 07:52 | |
| *** ifarkas has joined #openstack-infra | 07:54 | |
| *** hogepodge has joined #openstack-infra | 07:54 | |
| *** abregman has joined #openstack-infra | 07:56 | |
| schipiga | AJaeger: I attached a link about separated logs https://review.openstack.org/#/c/307880/ to requested patch | 07:56 |
| *** esker has quit IRC | 07:56 | |
| *** thorst has joined #openstack-infra | 07:56 | |
| *** esikachev has joined #openstack-infra | 07:57 | |
| *** vikram_ has joined #openstack-infra | 07:57 | |
| vikram_ | Need one more +2 for https://review.openstack.org/#/c/268726/. Can someone plz help ;) | 07:58 |
| openstackgerrit | Michele Paolino proposed openstack-infra/project-config: New project devstack-plugin-tar-installer https://review.openstack.org/308156 | 07:58 |
| openstackgerrit | Sergei Chipiga proposed openstack-infra/project-config: Publish test_reports dir https://review.openstack.org/308261 | 07:58 |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| AJaeger | vikram_: what kind of change is it? Please explain, I don't want to open a review for one of the 70+ infra repos that I don't review... | 08:00 |
| *** Na3iL has joined #openstack-infra | 08:01 | |
| vikram_ | AJaeger: This change already has your approval | 08:01 |
| vikram_ | AJaeger: It's about creating "neutron-dynamic-routing" project | 08:01 |
| *** jed56 has joined #openstack-infra | 08:02 | |
| vikram_ | AJaeger: Sorry for not mentioning | 08:02 |
| *** asettle has quit IRC | 08:02 | |
| AJaeger | vikram_: Ah, that one. Finally ready ;) | 08:02 |
| vikram_ | AJaeger: Yes, after a long tidy wait :) | 08:02 |
| *** thorst has quit IRC | 08:03 | |
| *** HeOS has quit IRC | 08:04 | |
| *** esker has joined #openstack-infra | 08:04 | |
| *** ramishra has quit IRC | 08:08 | |
| *** ramishra has joined #openstack-infra | 08:09 | |
| *** esker has quit IRC | 08:10 | |
| schipiga | AJaeger, should I ask to review my config patch https://review.openstack.org/#/c/308261 somebody from horizon core team, for ex. robcresswell, to be sure that horizon infra needs it ? | 08:10 |
| *** Na3iL has quit IRC | 08:12 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 08:12 |
| *** jistr has joined #openstack-infra | 08:13 | |
| *** ociuhandu has quit IRC | 08:14 | |
| *** jlanoux has quit IRC | 08:16 | |
| *** jlanoux has joined #openstack-infra | 08:17 | |
| *** esker has joined #openstack-infra | 08:20 | |
| *** abregman is now known as abregman|pto | 08:21 | |
| *** jaosorior has quit IRC | 08:22 | |
| *** nadya has joined #openstack-infra | 08:25 | |
| *** esker has quit IRC | 08:25 | |
| vikram_ | ajo: ping | 08:26 |
| vikram_ | sorry pinged on wrong window | 08:26 |
| *** markvoelker has quit IRC | 08:27 | |
| *** jordanP has joined #openstack-infra | 08:30 | |
| mattt | is it no longer possible to view jenkins log as a job is running ? | 08:30 |
| *** jaosorior has joined #openstack-infra | 08:30 | |
| *** jrmyjohn has joined #openstack-infra | 08:30 | |
| *** jtomasek has joined #openstack-infra | 08:31 | |
| *** infra-red has joined #openstack-infra | 08:33 | |
| *** infra-re_ has quit IRC | 08:34 | |
| *** derekh has joined #openstack-infra | 08:34 | |
| *** dtardivel has joined #openstack-infra | 08:35 | |
| *** jrmyjohn has quit IRC | 08:35 | |
| *** dtantsur|afk is now known as dtantsur | 08:36 | |
| *** esker has joined #openstack-infra | 08:40 | |
| *** mylu has joined #openstack-infra | 08:44 | |
| *** electrofelix has joined #openstack-infra | 08:44 | |
| *** dingyichen has quit IRC | 08:44 | |
| *** infra-red has quit IRC | 08:45 | |
| jamespage | yolanda, sorry - mean't to ping here not in -dev... | 08:47 |
| *** infra-red has joined #openstack-infra | 08:47 | |
| *** mrmartin has quit IRC | 08:48 | |
| *** infra-red has quit IRC | 08:48 | |
| lifeless | mattt: not at the moment - security issue | 08:49 |
| lifeless | mattt: see the mail to openstack-dev | 08:49 |
| *** mylu has quit IRC | 08:49 | |
| *** infra-red has joined #openstack-infra | 08:50 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 08:50 |
| jamespage | yolanda, so I'm trying to push new stable branchs across the charm-* repositories | 08:50 |
| jamespage | yolanda, failed on my first | 08:50 |
| jamespage | ! [remote rejected] stable/16.04 -> stable/16.04 (failed to lock) | 08:50 |
| openstack | jamespage: Error: "remote" is not a valid command. | 08:50 |
| jamespage | thats for charm-ceilometer... | 08:50 |
| jamespage | any ideas? (or anyone else for that matter) | 08:50 |
| *** schipiga_ has joined #openstack-infra | 08:51 | |
| *** infra-red has quit IRC | 08:53 | |
| AJaeger | schipiga: yes, please get some feedback from other horizon cores on that - I don't want that to merge and the other never having a chance to go in. | 08:54 |
| AJaeger | jamespage: what command did you push? | 08:54 |
| AJaeger | did you use, I mean | 08:54 |
| schipiga | ok | 08:55 |
| *** esker has quit IRC | 08:55 | |
| *** ihrachys has joined #openstack-infra | 08:55 | |
| *** maishsk_ has joined #openstack-infra | 08:56 | |
| *** maishsk has quit IRC | 08:56 | |
| *** maishsk_ is now known as maishsk | 08:56 | |
| *** asettle has joined #openstack-infra | 08:57 | |
| jamespage | AJaeger, git push gerrit stable/16.04 | 08:57 |
| AJaeger | jamespage: that should work in general | 08:57 |
| *** infra-red has joined #openstack-infra | 08:58 | |
| jamespage | AJaeger, the repositories do have an existing 'stable' branch - might that be impacting things? | 08:58 |
| AJaeger | jamespage: I assume you're in charm-release group and you signed your commit? | 08:58 |
| jamespage | AJaeger, ah wait... | 08:58 |
| *** niska has quit IRC | 08:58 | |
| yolanda | hi, am back... i got internet problems this morning again | 08:59 |
| *** imcsk8 is now known as imcsk8|zZz | 08:59 | |
| jamespage | AJaeger, so I am in the charm-release group; there is no commit to sign - this is just a branch - I've not tagged yet... | 08:59 |
| AJaeger | jamespage: http://docs.openstack.org/infra/manual/drivers.html#tagging-a-release is reference for steps | 08:59 |
| *** infra-red has quit IRC | 09:00 | |
| *** infra-re_ has joined #openstack-infra | 09:00 | |
| AJaeger | jamespage: http://docs.openstack.org/infra/manual/drivers.html#create-stable-branch explains how to create a branch - use the webui | 09:00 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with periodic jobs https://review.openstack.org/297038 | 09:00 |
| jamespage | AJaeger, I was hoping not to have to use the webui for all 23 repositors | 09:00 |
| jamespage | AJaeger, tried with charm-ceilometer | 09:01 |
| AJaeger | jamespage: I'm not aware of any alternative ;( | 09:01 |
| jamespage | Cannot create branch "refs/heads/stable/16.04" since it conflicts with branch "refs/heads/stable". | 09:01 |
| *** thorst has joined #openstack-infra | 09:01 | |
| *** esker has joined #openstack-infra | 09:01 | |
| jamespage | AJaeger, pushing a branch from the CLI is in that document | 09:01 |
| *** asettle has quit IRC | 09:01 | |
| jamespage | AJaeger, so it is the existing stable branch that is causing the problem... | 09:01 |
| AJaeger | jamespage: you might want to talk with the release team (channel #openstack-release) whether they have a way to create branches for several projects | 09:02 |
| *** amotoki has quit IRC | 09:02 | |
| AJaeger | jamespage: Ah, see now. Didn't know about the push there as well... | 09:02 |
| AJaeger | jamespage: Then I can't help further - best ask one of our infra-roots later (US time) | 09:02 |
| *** infra-re_ has quit IRC | 09:03 | |
| *** rossella_s has quit IRC | 09:03 | |
| *** esker has quit IRC | 09:06 | |
| *** vikram_ has quit IRC | 09:06 | |
| *** rossella_s has joined #openstack-infra | 09:06 | |
| *** zeih has quit IRC | 09:06 | |
| *** niska has joined #openstack-infra | 09:06 | |
| *** esker has joined #openstack-infra | 09:07 | |
| *** mpaolino has joined #openstack-infra | 09:07 | |
| *** thorst has quit IRC | 09:09 | |
| *** zeih has joined #openstack-infra | 09:13 | |
| yolanda | so beaker tests still not passing. My change was merged, but we'll need to refresh images | 09:15 |
| yolanda | going to check | 09:15 |
| mattt | lifeless: will do, thanks | 09:15 |
| *** sridhar_ram has joined #openstack-infra | 09:15 | |
| *** esker has quit IRC | 09:16 | |
| aarefiev | hi! could you guys help | 09:17 |
| aarefiev | Experimental job doesn't triggered anymore: https://review.openstack.org/#/c/293926/ | 09:17 |
| *** mpaolino has quit IRC | 09:17 | |
| *** gildub has quit IRC | 09:17 | |
| aarefiev | What goes wrong? | 09:17 |
| AJaeger | aarefiev: did you check status.openstack/zuul already? | 09:17 |
| aarefiev | AJaeger: yep, nothing | 09:18 |
| *** sridhar_ram has quit IRC | 09:18 | |
| *** sridhar_ram1 has quit IRC | 09:19 | |
| *** HeOS has joined #openstack-infra | 09:19 | |
| AJaeger | no idea - everything else looks fine | 09:20 |
| *** ociuhandu has joined #openstack-infra | 09:20 | |
| jamespage | AJaeger, yolanda: do either of you guys have the ability to delete branches in gerrit? | 09:20 |
| yolanda | jamespage, i can | 09:20 |
| yolanda | aarefiev, let me take a look at logs | 09:21 |
| * jamespage thinks up a plan | 09:21 | |
| jamespage | yolanda, ok - so how does this sound | 09:22 |
| yolanda | aarefiev, i sent a check experimental to one of my jobs, and worked | 09:22 |
| openstackgerrit | Sergei Chipiga proposed openstack-infra/project-config: Publish test_reports dir https://review.openstack.org/308261 | 09:22 |
| jamespage | the current stable branch in the charm-* repositories is blocking creation of any stable/XXX branches for new stables... | 09:22 |
| jamespage | I'll tag the latest commit on the existing stable branches; we can then delete them and I'll re-create as stable/16.01 allows us to create stable/16.04 as well | 09:23 |
| jamespage | yolanda, does that sound reasonable? | 09:23 |
| *** zeih has quit IRC | 09:23 | |
| aarefiev | yolanda: hmm, it for sure worked for me on last week on another patch, what I can do here? | 09:23 |
| *** wznoinsk_ has quit IRC | 09:24 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Switch website to use tripleo-jobs-gerrit.py https://review.openstack.org/307872 | 09:24 |
| yolanda | jamespage, i think so | 09:24 |
| *** wznoinsk_ has joined #openstack-infra | 09:24 | |
| yolanda | jamespage, so let me know if you are ready, and let me know the list of projects affected, so i can delete stable branch | 09:25 |
| yolanda | aarefiev, going to take a look at zuul logs, to see if that's ignoring for some reason | 09:25 |
| aarefiev | yolanda: thanks | 09:26 |
| *** markvoelker has joined #openstack-infra | 09:27 | |
| yolanda | aarefiev, No jobs for change <Change 0x7fd25109e510 293926,4> | 09:27 |
| *** wznoinsk_ is now known as wznoinsk | 09:28 | |
| yolanda | for some reason it's just ignoring the experimental jobs there. Is something that may have changed in terms of your job config in last week? | 09:28 |
| frickler | aarefiev: yolanda: I think this is skipped due to https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L950 | 09:29 |
| yolanda | frickler, ah, you are right | 09:29 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Add temporary script to collect the status of periodic jobs https://review.openstack.org/308865 | 09:29 |
| aarefiev | hmm, how does this work before | 09:30 |
| yolanda | tests folder is totally ignored on this job | 09:30 |
| yolanda | aarefiev, is there something that may have changed in that config? | 09:30 |
| *** tosky_ has joined #openstack-infra | 09:30 | |
| aarefiev | yolanda: we changed only tempest regex | 09:31 |
| *** mpaolino has joined #openstack-infra | 09:31 | |
| AJaeger | aarefiev: Add a file *outside* of your tests directory to your change so that the conditions there do not match anymore and then run check experimental again | 09:31 |
| *** doug-fish has joined #openstack-infra | 09:31 | |
| AJaeger | frickler: great find, thanks! | 09:31 |
| aarefiev | AJaeger: already doing | 09:32 |
| *** esker has joined #openstack-infra | 09:32 | |
| aarefiev | thanks frickler | 09:32 |
| dtantsur | good find, yeah | 09:32 |
| AJaeger | aarefiev: just touching "do-not-merge" would be enough ;) | 09:32 |
| dtantsur | aarefiev, seems like we should change this "skip-if" regex | 09:32 |
| *** markvoelker has quit IRC | 09:32 | |
| jamespage | yolanda, ok tags created and pushed - this is the list of repos I need the stable branch deleted from - http://paste.ubuntu.com/15961740/ | 09:32 |
| AJaeger | dtantsur: regex or exclusion list | 09:32 |
| dtantsur | we should ignore ironic_inspector/test/unit, not just ironic_inspector/test | 09:33 |
| *** sambetts|afk is now known as sambetts | 09:33 | |
| yolanda | jamespage, ack. Going to delete them | 09:33 |
| jamespage | yolanda, thankyou :-) | 09:34 |
| *** zeih has joined #openstack-infra | 09:35 | |
| aarefiev | dtantsur: yep, looks like I didn't run this job after moved tempest plugin ( | 09:35 |
| aarefiev | my fail | 09:35 |
| aarefiev | yolanda, AJaeger, frickler: thanks for help | 09:36 |
| *** doug-fish has quit IRC | 09:36 | |
| *** yamahata has quit IRC | 09:37 | |
| *** Guest15985 has quit IRC | 09:37 | |
| *** tosky_ is now known as tosky | 09:38 | |
| yolanda | jamespage, done | 09:40 |
| jamespage | yolanda, thanks! | 09:41 |
| yolanda | jamespage, aarefiev , glad to help | 09:42 |
| *** hashar has quit IRC | 09:43 | |
| electrofelix | anyone around to review a chance for git-review? I've hit an issue with running the tests where high pids are allowed, which is also fixed by https://review.openstack.org/285620 | 09:44 |
| *** zeih has quit IRC | 09:45 | |
| *** esker has quit IRC | 09:45 | |
| AJaeger | yolanda, jamespage, infra-root: Will that deletion of stable cause any problems for our infra systems? | 09:46 |
| AJaeger | I get now an error updating the charm repos like http://paste.openstack.org/show/494953/ | 09:47 |
| yolanda | AJaeger, i didn't think about that, let me double check | 09:48 |
| yolanda | i've had quite problems in the past with non-existing master branches, but i wasn't expecting stable to give problems | 09:48 |
| AJaeger | git remote prune origin helps with that... | 09:49 |
| openstackgerrit | Merged openstack-infra/project-config: New project devstack-plugin-tar-installer https://review.openstack.org/308156 | 09:49 |
| *** zhurong has quit IRC | 09:49 | |
| *** _degorenko|afk is now known as degorenko | 09:49 | |
| *** vgridnev has quit IRC | 09:49 | |
| yolanda | AJaeger, so when i clone that now, stable is not existing anymore. Maybe you had an old copy of that repo where stable still existed? | 09:50 |
| AJaeger | yolanda: yes, that was an old copy. | 09:50 |
| AJaeger | So, might not hit us - let's see... | 09:50 |
| *** zhurong has joined #openstack-infra | 09:51 | |
| yolanda | replication correctly removed stable branch, as far as i can see | 09:51 |
| jamespage | yolanda, openstack.org -> github.com ? | 09:51 |
| AJaeger | but might hit community members - so jamespage best sends out an email | 09:51 |
| jamespage | yeah I see that as well.. | 09:51 |
| jamespage | AJaeger, will do... | 09:51 |
| yolanda | jamespage, it should be replicated to github as well | 09:51 |
| *** zhurong has quit IRC | 09:51 | |
| jamespage | yolanda, yah it is | 09:52 |
| jamespage | ditto the new stable branch I just created... | 09:52 |
| *** maishsk has quit IRC | 09:52 | |
| *** vgridnev has joined #openstack-infra | 09:53 | |
| *** vgridnev has quit IRC | 09:54 | |
| openstackgerrit | Merged openstack-infra/project-config: taas: Skip unit tests for doc-only changes https://review.openstack.org/308804 | 09:54 |
| openstackgerrit | Merged openstack-infra/project-config: Fix comment on requirements job https://review.openstack.org/308708 | 09:56 |
| openstackgerrit | Merged openstack-infra/project-config: Correct function name to run the right script https://review.openstack.org/308023 | 09:58 |
| *** amotoki has joined #openstack-infra | 09:59 | |
| *** vgridnev has joined #openstack-infra | 10:00 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 10:00 |
| *** avarner_ has joined #openstack-infra | 10:02 | |
| *** avarner__ has quit IRC | 10:02 | |
| *** esker has joined #openstack-infra | 10:05 | |
| *** thorst has joined #openstack-infra | 10:06 | |
| *** zeih has joined #openstack-infra | 10:08 | |
| *** _amrith_ is now known as amrith | 10:10 | |
| *** e0ne has joined #openstack-infra | 10:12 | |
| *** yamamot__ has quit IRC | 10:12 | |
| *** asselin__ has quit IRC | 10:12 | |
| *** asselin__ has joined #openstack-infra | 10:13 | |
| *** thorst has quit IRC | 10:13 | |
| *** nikhil has quit IRC | 10:14 | |
| *** nikhil has joined #openstack-infra | 10:14 | |
| *** esikachev has quit IRC | 10:14 | |
| *** esker has quit IRC | 10:15 | |
| *** asselin_ has joined #openstack-infra | 10:15 | |
| *** esker has joined #openstack-infra | 10:17 | |
| *** salv-orl_ has joined #openstack-infra | 10:19 | |
| *** asselin__ has quit IRC | 10:19 | |
| penguinolog | Hi/ I see job fails on zuul: Unable to connect to mirror.bhs1.ovh.openstack.org:http: -> Some index files failed to download. They have been ignored, or old ones used instead. -> package install fails | 10:21 |
| *** Guest14509 has quit IRC | 10:22 | |
| *** salv-orlando has quit IRC | 10:22 | |
| *** sdague has joined #openstack-infra | 10:24 | |
| rcarrillocruz | i wonder if the docs job on my change failed due to ^ | 10:24 |
| rcarrillocruz | can't see the reason (yet) | 10:24 |
| openstackgerrit | Anton Arefiev proposed openstack-infra/project-config: Don't skip expensive jobs for Inspector tempest tests https://review.openstack.org/308886 | 10:24 |
| rcarrillocruz | till other jobs bail out | 10:24 |
| *** Guest14509 has joined #openstack-infra | 10:24 | |
| *** zeih has quit IRC | 10:25 | |
| *** esker has quit IRC | 10:25 | |
| yolanda | mirrors failing again? | 10:25 |
| penguinolog | yolanda, looks like yes :( , as I see in logs | 10:26 |
| yolanda | penguinolog, ok, let me check mirror status | 10:27 |
| yolanda | yep, mirror not responsive again | 10:28 |
| rcarrillocruz | sigh | 10:28 |
| *** esker has joined #openstack-infra | 10:31 | |
| yolanda | so our openstackci account is failing again. I'm going to remove ovh servers from nodepool until we fix it | 10:32 |
| *** asselin__ has joined #openstack-infra | 10:33 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:34 | |
| yolanda | #status notice OVH servers are down, we are working to solve it. This will cause that jobs queue is processed slowly, please have patience. | 10:35 |
| *** maishsk has joined #openstack-infra | 10:35 | |
| yolanda | #status notice OVH servers are down, we are working to solve it. This will cause that jobs queue is processed slowly, please have patience. | 10:35 |
| openstackstatus | yolanda: sending notice | 10:35 |
| *** asselin_ has quit IRC | 10:36 | |
| -openstackstatus- NOTICE: OVH servers are down, we are working to solve it. This will cause that jobs queue is processed slowly, please have patience. | 10:37 | |
| rcarrillocruz | regardless of ovh, my func tests are still wrong :/ | 10:38 |
| *** ociuhandu has quit IRC | 10:38 | |
| yolanda | same problem with ovh, i'm checking with Jean-Daniel | 10:38 |
| openstackstatus | yolanda: finished sending notice | 10:38 |
| schipiga | AJaeger: could you please review again https://review.openstack.org/#/c/308261/. I had got approve of two core developers | 10:39 |
| *** baoli has joined #openstack-infra | 10:41 | |
| *** Qiming has quit IRC | 10:41 | |
| *** baoli_ has joined #openstack-infra | 10:44 | |
| *** mylu has joined #openstack-infra | 10:45 | |
| *** esker has quit IRC | 10:46 | |
| *** yamamoto_ has joined #openstack-infra | 10:46 | |
| *** baoli has quit IRC | 10:47 | |
| *** esker has joined #openstack-infra | 10:48 | |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: ACL: allow to create branches for gce-api project https://review.openstack.org/308895 | 10:48 |
| *** e0ne has quit IRC | 10:49 | |
| *** asselin_ has joined #openstack-infra | 10:49 | |
| *** esikachev has joined #openstack-infra | 10:49 | |
| *** mylu has quit IRC | 10:50 | |
| *** yamamoto_ has quit IRC | 10:51 | |
| *** asselin__ has quit IRC | 10:51 | |
| *** jaosorior has quit IRC | 10:52 | |
| *** jaosorior has joined #openstack-infra | 10:53 | |
| *** yamamoto_ has joined #openstack-infra | 10:54 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 10:54 |
| *** imcsk8|z1z has joined #openstack-infra | 10:55 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Revert "Revert "Temporarily disable OVH GRA, as we are seeing failures"" https://review.openstack.org/308901 | 10:55 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Revert "Revert "Temporarily disable ovh-bhs provider"" https://review.openstack.org/308902 | 10:56 |
| *** imcsk8|zZz has quit IRC | 10:56 | |
| yolanda | AJaeger ^ | 10:56 |
| *** ociuhandu has joined #openstack-infra | 10:57 | |
| *** kushal has quit IRC | 10:58 | |
| *** asettle has joined #openstack-infra | 10:59 | |
| *** asettle has quit IRC | 10:59 | |
| *** mpaolino has quit IRC | 11:01 | |
| *** esikachev has quit IRC | 11:01 | |
| *** esikachev has joined #openstack-infra | 11:02 | |
| sdague | I'm trying to figure out why some of the nova post jobs didn't seem to work | 11:02 |
| *** zeih has joined #openstack-infra | 11:02 | |
| sdague | is there a good place to look for logs there? this is nova-api-ref | 11:03 |
| *** lucasagomes is now known as lucas-hungry | 11:05 | |
| *** icey_ has joined #openstack-infra | 11:05 | |
| *** amotoki has quit IRC | 11:07 | |
| *** icey has quit IRC | 11:08 | |
| *** sdake_ has quit IRC | 11:08 | |
| *** kzaitsev_mb has quit IRC | 11:08 | |
| *** sdake has joined #openstack-infra | 11:08 | |
| dims_ | sdague do you have a specific review? we'll need the change-id to go hunt for the logs | 11:09 |
| sdague | dims_: yeh, though it's the post job | 11:09 |
| sdague | https://review.openstack.org/#/c/307164/7 | 11:10 |
| *** thorst has joined #openstack-infra | 11:11 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:11 | |
| dims_ | sdague : this one? http://logs.openstack.org/64/307164/7/gate/gate-nova-api-ref/36e6a79/ | 11:11 |
| dims_ | sdague : we use the last 2 digits "64" and then "/" then the review number to formulate the url | 11:12 |
| *** yamamoto_ has quit IRC | 11:12 | |
| *** Hal has joined #openstack-infra | 11:16 | |
| *** yamamoto_ has joined #openstack-infra | 11:16 | |
| *** Hal is now known as Guest64781 | 11:16 | |
| *** doug-fish has joined #openstack-infra | 11:17 | |
| *** mpaolino has joined #openstack-infra | 11:17 | |
| *** thorst has quit IRC | 11:19 | |
| *** Guest64781 has quit IRC | 11:20 | |
| sdague | dims_: I think so | 11:21 |
| sdague | that should have also uploaded content | 11:21 |
| dims_ | sdague : job thinks it did | 11:22 |
| dims_ | dims_ : [SCP] uploading file: '/srv/static/docs-draft/64/307164/7/gate/gate-nova-api-ref/36e6a79/api-ref/build/html/searchindex.js' | 11:22 |
| sdague | yeh, the content on the target site is definitely not right though | 11:22 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Don't try to update tasks if they don't have an ID https://review.openstack.org/308926 | 11:23 |
| *** schipiga_ has quit IRC | 11:23 | |
| *** schipiga_ has joined #openstack-infra | 11:23 | |
| *** asettle has joined #openstack-infra | 11:24 | |
| AJaeger | yolanda: thanks, approved | 11:24 |
| sdague | AJaeger: any ideas on this content publish issue | 11:25 |
| *** esker has quit IRC | 11:26 | |
| *** esker has joined #openstack-infra | 11:27 | |
| *** kzaitsev_mb has quit IRC | 11:27 | |
| schipiga | yolanda: I suppose, may I ask you to set workflow to https://review.openstack.org/#/c/308261 ? :) | 11:27 |
| yolanda | schipiga, I can review, yes | 11:28 |
| schipiga | please, would be very grateful | 11:29 |
| yolanda | +w | 11:29 |
| AJaeger | sdague: let me read backscroll... | 11:29 |
| schipiga | thank you | 11:29 |
| AJaeger | sdague: post job: | 11:29 |
| sdague | AJaeger: the issue is http://developer.openstack.org/api-ref/compute/ is definitely not up to date with the content | 11:29 |
| AJaeger | logs.openstack.org/first2sha1/full-sha1 | 11:29 |
| AJaeger | Let me check 307164 | 11:30 |
| sdague | oh, wait a second | 11:30 |
| sdague | maybe I'm wrong, | 11:30 |
| *** e0ne has joined #openstack-infra | 11:30 | |
| sdague | I guess it just took forever to flush all the post jobs yesterday | 11:30 |
| *** zhurong has joined #openstack-infra | 11:30 | |
| AJaeger | sdague: yes, that took ages | 11:30 |
| *** yamamoto_ has quit IRC | 11:30 | |
| AJaeger | sdague: http://logs.openstack.org/7b/7b783196abad49dec7d08c8b3317cc18f88790b4/post/nova-api-ref/5f49698/console.html ? | 11:31 |
| *** Qiming has joined #openstack-infra | 11:32 | |
| AJaeger | sdague: http://developer.openstack.org/api-ref/compute/ has as footer: | 11:32 |
| *** Goneri has joined #openstack-infra | 11:32 | |
| AJaeger | " Last updated on 'Wed Apr 22 09:17:25 2015, commit 73d5d1f'." - *2015* | 11:32 |
| *** kzaitsev_mb has joined #openstack-infra | 11:32 | |
| *** yamamoto_ has joined #openstack-infra | 11:33 | |
| *** salv-orl_ has quit IRC | 11:33 | |
| AJaeger | sdague: so, publishing looks fine in the post job IMHO | 11:33 |
| sdague | ok, great, thanks | 11:34 |
| *** rhallisey has joined #openstack-infra | 11:34 | |
| openstackgerrit | Merged openstack-infra/project-config: Skip networking-nec python34 job for liberty and kilo https://review.openstack.org/308767 | 11:37 |
| *** Goneri has quit IRC | 11:38 | |
| *** MarkAtwood has joined #openstack-infra | 11:38 | |
| *** resker has joined #openstack-infra | 11:38 | |
| *** gordc has joined #openstack-infra | 11:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Publish test_reports dir https://review.openstack.org/308261 | 11:39 |
| *** nadya has quit IRC | 11:39 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config: Replace the packstack-dev channel by rdo https://review.openstack.org/308576 | 11:39 |
| dmsimard | yolanda: ^ they were sorted, in my heart :P | 11:40 |
| yolanda | dmsimard, cool. It was just a nit | 11:41 |
| *** esker has quit IRC | 11:41 | |
| yolanda | +2 | 11:41 |
| dmsimard | yolanda: no worries, my brain went top (most recent) to bottom (oldest) so that's why I said they were sorted in my heart :p | 11:42 |
| openstackgerrit | Merged openstack-infra/release-tools: add validate_tarballs.sh https://review.openstack.org/307230 | 11:43 |
| *** kzaitsev_mb has quit IRC | 11:43 | |
| openstackgerrit | Merged openstack-infra/release-tools: make compare_tarball_diff.sh quieter https://review.openstack.org/307390 | 11:45 |
| *** schipiga_ has quit IRC | 11:46 | |
| *** yamamoto_ has quit IRC | 11:46 | |
| *** asettle has quit IRC | 11:47 | |
| *** MarkAtwood has quit IRC | 11:48 | |
| *** kengo_sa_ has quit IRC | 11:48 | |
| *** thorst has joined #openstack-infra | 11:49 | |
| *** lucas-hungry is now known as lucasagomes | 11:49 | |
| *** yamamoto_ has joined #openstack-infra | 11:50 | |
| *** nadya has joined #openstack-infra | 11:54 | |
| *** resker has quit IRC | 11:55 | |
| *** icey_ is now known as icey | 11:55 | |
| *** amotoki has joined #openstack-infra | 11:58 | |
| *** yamamoto_ has quit IRC | 11:58 | |
| *** kushal has joined #openstack-infra | 11:59 | |
| *** Qiming has quit IRC | 12:00 | |
| *** mylu has joined #openstack-infra | 12:00 | |
| *** dtantsur is now known as dtantsur|brb | 12:05 | |
| *** mylu has quit IRC | 12:06 | |
| openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: ACL: allow to create branches for gce-api project https://review.openstack.org/308895 | 12:06 |
| *** sdague has quit IRC | 12:06 | |
| *** esker has joined #openstack-infra | 12:07 | |
| *** amotoki_ has joined #openstack-infra | 12:09 | |
| *** zul has quit IRC | 12:11 | |
| *** amotoki has quit IRC | 12:11 | |
| *** chuck__ has joined #openstack-infra | 12:11 | |
| *** amotoki_ has quit IRC | 12:11 | |
| *** chuck__ is now known as zul | 12:12 | |
| EmilienM | fungi, pabelanger, AJaeger: just an update about our Puppet OpenStack periodic jobs -> they work fine now. Thanks again for your help this week | 12:13 |
| *** EricGonczer_ has joined #openstack-infra | 12:15 | |
| krotscheck_dcm | crinkle: OMG yes I need that. In fact, I think I have one! | 12:15 |
| *** krotscheck_dcm is now known as krotscheck | 12:15 | |
| *** jlanoux has quit IRC | 12:17 | |
| *** markvoelker has joined #openstack-infra | 12:17 | |
| *** Yarboa has quit IRC | 12:18 | |
| AJaeger | EmilienM: woot! | 12:18 |
| EmilienM | AJaeger: the tarballs are fine also http://tarballs.openstack.org/puppet-neutron | 12:18 |
| EmilienM | AJaeger: though I haven't tested the tarballs for stable branches | 12:19 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added clean exit hooks to npm registry script https://review.openstack.org/308669 | 12:19 |
| yolanda | oh, beaker finally passing! i launched the image rebuilds and updates this morning | 12:19 |
| krotscheck | wooo! | 12:20 |
| EmilienM | yolanda: images are uploaded to all clouds? | 12:20 |
| yolanda | yes, they finished 30 minutes ago | 12:20 |
| EmilienM | excellent news | 12:20 |
| yolanda | and i saw my failing test passing now | 12:21 |
| *** amotoki has joined #openstack-infra | 12:21 | |
| EmilienM | yolanda: FYI we had a workaround https://review.openstack.org/#/c/308580/ | 12:21 |
| EmilienM | maybe infra could also have a openstack-infra/puppet-infra_spec_helper | 12:21 |
| EmilienM | it's a lot of work to put in place, but afterward everything is centralized | 12:22 |
| AJaeger | great, yolanda ! I'll recheck https://review.openstack.org/#/c/308367/ now - reviews are welcome (puppet-reviewday logging) | 12:23 |
| *** salv-orlando has joined #openstack-infra | 12:28 | |
| *** xwizard___ has quit IRC | 12:28 | |
| yolanda | i'll do | 12:28 |
| *** asettle has joined #openstack-infra | 12:29 | |
| *** esikachev has quit IRC | 12:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Update deprecated commands in tripleo.sh (Old heat * calls) https://review.openstack.org/301087 | 12:31 |
| *** obondarev has quit IRC | 12:31 | |
| *** jordanP has quit IRC | 12:32 | |
| *** sdague has joined #openstack-infra | 12:32 | |
| *** Yarboa has joined #openstack-infra | 12:32 | |
| *** obondarev has joined #openstack-infra | 12:33 | |
| *** dtantsur|brb is now known as dtantsur | 12:33 | |
| *** EricGonczer_ has quit IRC | 12:34 | |
| *** hughhalf has quit IRC | 12:34 | |
| *** burgerk has joined #openstack-infra | 12:35 | |
| *** annegentle has joined #openstack-infra | 12:36 | |
| AJaeger | thanks, yolanda | 12:37 |
| *** rfolco has joined #openstack-infra | 12:37 | |
| rcarrillocruz | any news from OVH folks? | 12:37 |
| *** Hal has joined #openstack-infra | 12:37 | |
| yolanda | i just got updates from Jean-Daniel, i'm restarting the suspended mirrors now | 12:37 |
| yolanda | things are going back to life | 12:38 |
| rcarrillocruz | \o/ | 12:38 |
| rcarrillocruz | thx | 12:38 |
| *** Hal is now known as Guest83836 | 12:38 | |
| amrith | I asked this earlier on openstack-dev, maybe someone here knows the answer .. does anyone know of a simple way to export your summit schedule into ICS or calendaring software or are you stuck having to use the app? | 12:38 |
| AJaeger | yolanda: plesae abandon your changes to take these down... | 12:38 |
| AJaeger | yolanda: Great, thanks! | 12:38 |
| *** sdague has quit IRC | 12:38 | |
| AJaeger | amrith: there were some emails on openstack-dev mailing list for this ... | 12:39 |
| *** sdague has joined #openstack-infra | 12:39 | |
| yolanda | abandoned | 12:39 |
| *** sdague has quit IRC | 12:39 | |
| *** yamamoto_ has joined #openstack-infra | 12:39 | |
| *** gongysh has quit IRC | 12:39 | |
| AJaeger | thanks | 12:39 |
| *** e0ne has quit IRC | 12:39 | |
| amrith | AJaeger, hmmm. didn't see any, let me go look. was there a solution or discussion? I recall something about futures for cheddar, nothing about the final schedule. | 12:40 |
| *** Yarboa has quit IRC | 12:40 | |
| *** asettle has quit IRC | 12:40 | |
| *** hughhalf has joined #openstack-infra | 12:40 | |
| yolanda | mirrors are alive again, going to restore manually in nodepool | 12:40 |
| *** gongysh has joined #openstack-infra | 12:42 | |
| *** e0ne has joined #openstack-infra | 12:42 | |
| AJaeger | amrith: subject "summit tools" - the mail from dstanek | 12:42 |
| * amrith looks for the mail | 12:43 | |
| amrith | one second | 12:43 |
| annegentle | amrith: Oh I was looking for that myself. Post the link when / if you find it | 12:43 |
| annegentle | (though I already made my calendar ha) | 12:43 |
| amrith | thx, got it. http://lists.openstack.org/pipermail/openstack-dev/2016-April/092932.html | 12:43 |
| *** jlanoux has joined #openstack-infra | 12:43 | |
| amrith | annegentle, https://gist.github.com/dstanek/83d536af9461eb26d7a19ff73a7391c2 | 12:44 |
| *** jaypipes has joined #openstack-infra | 12:44 | |
| annegentle | amrith hehe well if Tony (who made all the ical files automation for meetings) doesn't need it then... | 12:44 |
| annegentle | amrith ah there we go! | 12:44 |
| annegentle | amrith thanks! | 12:45 |
| amrith | annegentle, just QA'ing the tool. Will give it a +1 if it works :) | 12:45 |
| *** zeih has quit IRC | 12:45 | |
| * mordred hands dstanek a giant box of kittens | 12:46 | |
| mordred | annegentle, amrith: you may also be interested in http://dstanek.com/newton-sched-fixed.html | 12:46 |
| annegentle | I gave dstanek a star, is that enough? Seems less than kittens. | 12:47 |
| yolanda | #status notice OVH provider is enabled again, please wait for the job queue to be processed | 12:47 |
| openstackstatus | yolanda: sending notice | 12:47 |
| *** sdague has joined #openstack-infra | 12:47 | |
| *** sdague has quit IRC | 12:47 | |
| *** sdague has joined #openstack-infra | 12:48 | |
| mordred | pabelanger: any chance you know how we're doing on image uploads? | 12:48 |
| -openstackstatus- NOTICE: OVH provider is enabled again, please wait for the job queue to be processed | 12:48 | |
| AJaeger | mordred: yolanda regenerated images this European morning, all updated aFAIU | 12:48 |
| mordred | woot! | 12:48 |
| mordred | yolanda: so I should be safe to restart nodepool again? | 12:49 |
| yolanda | mordred, no image builds at the moment from my side | 12:49 |
| *** weshay has joined #openstack-infra | 12:49 | |
| openstackstatus | yolanda: finished sending notice | 12:49 |
| *** rlandy has joined #openstack-infra | 12:50 | |
| *** rlandy has quit IRC | 12:50 | |
| *** rlandy has joined #openstack-infra | 12:52 | |
| *** amotoki has quit IRC | 12:52 | |
| annegentle | amrith works for me, sweet! Thanks dstanek | 12:52 |
| *** Yarboa has joined #openstack-infra | 12:53 | |
| *** zeih has joined #openstack-infra | 12:53 | |
| dstanek | annegentle: i sent you an email with the link :-( | 12:53 |
| *** asettle has joined #openstack-infra | 12:53 | |
| *** degorenko is now known as _degorenko|afk | 12:53 | |
| annegentle | dstanek aww I missed that! looking | 12:53 |
| *** kushal has quit IRC | 12:54 | |
| *** keedya has joined #openstack-infra | 12:54 | |
| *** gongysh has quit IRC | 12:56 | |
| amrith | annegentle, didn't work for me. something about _strptime() ValueError: 'z' is a bad directive in format '%Y-%m-%d %I:%M%p %z'. Which reminds me, I have to send an email to the ML about the dreaded isotime() thing :( | 12:56 |
| annegentle | amrith anything special about the sessions you chose? :) | 12:57 |
| amrith | annegentle, not that I can tell | 12:57 |
| *** claudiub has joined #openstack-infra | 12:58 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Improve 'Tasks Assigned to Me' https://review.openstack.org/292509 | 12:58 |
| *** esker has quit IRC | 12:58 | |
| *** esker has joined #openstack-infra | 12:58 | |
| amrith | annegentle, how did you save your schedule as mine.html? I tried to do it with wget but couldn't figure out how to give it my username/password. so I opened it in firefox and saved as html-only. | 12:59 |
| *** links has quit IRC | 12:59 | |
| amrith | which, as it turns out stuck a bunch of javascript and stuff in there | 12:59 |
| annegentle | I was in Chrome and did html-only (though my first mistake was saving it as "web page complete" or some such | 12:59 |
| annegentle | wonder if the html is different from chrome | 12:59 |
| *** e0ne has quit IRC | 13:01 | |
| dstanek | amrith: the site is pretty terrible from a data point of view. i have to parse javascript to build the calendar. | 13:01 |
| dstanek | amrith: did you same the print view of your calendar? | 13:02 |
| dstanek | s/same/save/ | 13:02 |
| annegentle | dstanek dannng I'm glad I didn't try to tackle this then | 13:02 |
| amrith | dstanek, hi ... I navigated to https://www.openstack.org/summit/austin-2016/summit-schedule/mine/?goback=1 in firefox | 13:02 |
| amrith | did a 'save-as' | 13:02 |
| amrith | web page html only | 13:02 |
| amrith | it has a crap load of javascript in there | 13:02 |
| amrith | but all the start and end times | 13:02 |
| amrith | have no 'z' | 13:02 |
| dstanek | amrith: there shouldn't be a z in the times | 13:03 |
| *** kgiusti has joined #openstack-infra | 13:03 | |
| dstanek | they should be something like 12:25pm | 13:03 |
| *** maishsk has quit IRC | 13:03 | |
| amrith | let me just strip the javascript out and try | 13:03 |
| dstanek | amrith: that's the only part i need :-) | 13:03 |
| dstanek | i'm actually parsing the javascript | 13:04 |
| amrith | ok, let me not do that then :) | 13:04 |
| *** matt-borland has joined #openstack-infra | 13:04 | |
| amrith | start and end times are like | 13:05 |
| amrith | start_time: "12:05pm", | 13:05 |
| amrith | end_time: "12:45pm", | 13:05 |
| *** maishsk has joined #openstack-infra | 13:05 | |
| dstanek | amrith: can you paste your file somewhere so i can take a look? | 13:05 |
| amrith | sure, one second | 13:05 |
| *** nwkarsten has joined #openstack-infra | 13:06 | |
| *** dizquierdo has quit IRC | 13:06 | |
| *** esker has quit IRC | 13:07 | |
| Kiall | Hey infra folks.. I've noticed some projects putting optional / feature requirements into setup.cfg.. My Q is, is that supported by things like the requirements tooling etc? | 13:07 |
| *** mylu has joined #openstack-infra | 13:07 | |
| *** esker has joined #openstack-infra | 13:07 | |
| *** esker has quit IRC | 13:07 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Add job validation and latest link to magnum image upload https://review.openstack.org/308323 | 13:08 |
| *** jrmyjohn has joined #openstack-infra | 13:08 | |
| Kiall | e.g. https://github.com/openstack/keystone/blob/master/setup.cfg#L24-33 | 13:08 |
| amrith | dstanek, sent you the link in PM | 13:09 |
| *** esikachev has joined #openstack-infra | 13:09 | |
| *** jrmyjohn has quit IRC | 13:09 | |
| *** jrmyjohn has joined #openstack-infra | 13:09 | |
| *** mtanino has joined #openstack-infra | 13:09 | |
| amrith | so, get_dt wants to parse 2016-04-25 9:00am -0500 with the format %Y-%m-%d %I:%M%p %z | 13:10 |
| amrith | hmm | 13:10 |
| amrith | is this a python3/python2.7 thing? | 13:11 |
| dstanek | amrith: oh, it could be. i'm using py3 | 13:12 |
| amrith | trying that | 13:12 |
| amrith | one second | 13:12 |
| *** andymaier_ has joined #openstack-infra | 13:12 | |
| *** doug-fish has quit IRC | 13:13 | |
| *** asettle has quit IRC | 13:13 | |
| *** thiagop has joined #openstack-infra | 13:13 | |
| *** doug-fish has joined #openstack-infra | 13:13 | |
| *** asettle has joined #openstack-infra | 13:13 | |
| *** amotoki has joined #openstack-infra | 13:16 | |
| *** hughhalf has quit IRC | 13:16 | |
| *** doug-fish has quit IRC | 13:17 | |
| *** annegentle has quit IRC | 13:20 | |
| *** mtanino has quit IRC | 13:20 | |
| *** nmagnezi has quit IRC | 13:21 | |
| *** Goneri has joined #openstack-infra | 13:23 | |
| *** mriedem has joined #openstack-infra | 13:23 | |
| *** hughhalf has joined #openstack-infra | 13:23 | |
| *** _ari_ has joined #openstack-infra | 13:25 | |
| *** doug-fish has joined #openstack-infra | 13:27 | |
| * dims_ peeks to see if we are past the ovh network problems | 13:28 | |
| *** ddieterly has joined #openstack-infra | 13:28 | |
| amrith | thanks much dstanek ... I knew I wouldn't have had these problems with Verizon :) | 13:28 |
| AJaeger | dims_: yes, we are - still some backlog to go through... | 13:28 |
| dims_ | thanks AJaeger ! | 13:28 |
| amrith | it was only that one session | 13:29 |
| *** trown|outtypewww is now known as trown | 13:29 | |
| *** doug-fis_ has joined #openstack-infra | 13:29 | |
| dstanek | amrith: :-) | 13:30 |
| *** sdake_ has joined #openstack-infra | 13:30 | |
| *** mylu has quit IRC | 13:30 | |
| *** mpaolino has quit IRC | 13:31 | |
| EmilienM | infra-root: can someone remove files in http://tarballs.openstack.org/puppet-aodh/ ? we did some cleanup in scripts that generate the tarballs, and those ones have wrong name. Thanks | 13:31 |
| *** vhosakot has joined #openstack-infra | 13:32 | |
| *** sdake has quit IRC | 13:32 | |
| *** aimeeU has joined #openstack-infra | 13:33 | |
| *** doug-fish has quit IRC | 13:33 | |
| *** AJaeger has quit IRC | 13:33 | |
| *** AJaeger has joined #openstack-infra | 13:36 | |
| *** jheroux has joined #openstack-infra | 13:36 | |
| *** nwkarsten has quit IRC | 13:37 | |
| *** nwkarsten has joined #openstack-infra | 13:38 | |
| *** HeOS_ has quit IRC | 13:38 | |
| *** xyang1 has joined #openstack-infra | 13:39 | |
| *** nwkarsten has quit IRC | 13:42 | |
| *** AJaeger has quit IRC | 13:42 | |
| *** AJaeger has joined #openstack-infra | 13:43 | |
| *** mpaolino has joined #openstack-infra | 13:43 | |
| fungi | yolanda: so what was the deal with ovh? did they take our openstackci tenant offline again already? | 13:44 |
| yolanda | again yes | 13:44 |
| fungi | i skimmed scrollback but didn't spot much detail about it | 13:44 |
| fungi | that's unfortunate | 13:44 |
| yolanda | our account was still showing a billing due with them, so the account was blocked | 13:45 |
| yolanda | it is fixed now | 13:45 |
| openstackgerrit | Ken Dreyer proposed openstack/python-jenkins: add get_whoami() https://review.openstack.org/307896 | 13:45 |
| *** inc0 has joined #openstack-infra | 13:45 | |
| fungi | looks like it only lasted from 08:40 to 12:40 utc this time, so not as painful as before | 13:46 |
| AJaeger | yolanda: have they fixed things so that it won't break again next time? | 13:46 |
| fungi | er, 9:40 to 12:40 | 13:46 |
| AJaeger | fungi: this time yolanda knew whom to reach I think ;) | 13:46 |
| fungi | so 3 hours | 13:46 |
| fungi | indeed | 13:46 |
| yolanda | fungi, as soon as I saw it, i contacted Jean-Daniel and he fixed | 13:46 |
| fungi | thanks yolanda!!! | 13:46 |
| yolanda | he confirmed the account problems are solved now | 13:46 |
| AJaeger | thanks, yolanda ! | 13:46 |
| yolanda | :) | 13:46 |
| *** nwkarsten has joined #openstack-infra | 13:47 | |
| *** nwkarsten has quit IRC | 13:47 | |
| *** nwkarsten has joined #openstack-infra | 13:47 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Enable magnum plugin on shade and use our atomic generated images https://review.openstack.org/305122 | 13:48 |
| *** EricGonczer_ has joined #openstack-infra | 13:49 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Enable magnum plugin on shade and use our atomic generated images https://review.openstack.org/305122 | 13:52 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-openstack_health: Add packages needed to build lxml https://review.openstack.org/308628 | 13:53 |
| *** yamamoto_ has quit IRC | 13:54 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 13:55 |
| openstackgerrit | Merged openstack-infra/project-config: Add new virtualbmc project under ironic's umbrella https://review.openstack.org/307323 | 13:56 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Enable magnum plugin on shade and use our atomic generated images https://review.openstack.org/305122 | 13:57 |
| *** mylu has joined #openstack-infra | 13:57 | |
| *** EricGonczer_ has quit IRC | 13:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Add ServerGet task to nodepool graphs https://review.openstack.org/308483 | 13:59 |
| openstackgerrit | Merged openstack-infra/project-config: Adding a new project called "neutron-dynamic-routing" https://review.openstack.org/268726 | 13:59 |
| *** EricGonczer_ has joined #openstack-infra | 13:59 | |
| *** sdake_ has quit IRC | 14:00 | |
| *** sdake has joined #openstack-infra | 14:02 | |
| *** BigWillie has joined #openstack-infra | 14:02 | |
| *** yamamoto has joined #openstack-infra | 14:04 | |
| *** zhurong has quit IRC | 14:05 | |
| prometheanfire | can someone re-workflow this dib job? https://review.openstack.org/#/c/300256 | 14:05 |
| *** _degorenko|afk is now known as degorenko | 14:06 | |
| fungi | prometheanfire: how will that help? | 14:07 |
| *** burgerk has quit IRC | 14:07 | |
| fungi | it depends on a change that depends on a change that isn't approved (and is marked wip) | 14:07 |
| prometheanfire | oh? | 14:07 |
| *** zz_dimtruck is now known as dimtruck | 14:08 | |
| *** mtanino has joined #openstack-infra | 14:08 | |
| prometheanfire | whwhich change? | 14:08 |
| fungi | prometheanfire: 300256 depends on 296626, which depends on 299694 which is wip | 14:08 |
| AJaeger | prometheanfire: in the web ui, see "Related changes" in the upper right corner | 14:09 |
| fungi | that's why the other two aren't enqueying | 14:09 |
| fungi | er, enqueuing | 14:09 |
| prometheanfire | AJaeger: ya, it's never obvious whether related is related or dependant | 14:09 |
| *** lezbar__ has quit IRC | 14:10 | |
| prometheanfire | I don't know why those are dependant on mine :| | 14:10 |
| fungi | i agree, the order in that list in the new change screen is confusing. gertty displays it more like the old change screen does where you get a "depends on" list and a "needed by" list | 14:10 |
| *** lezbar has joined #openstack-infra | 14:11 | |
| prometheanfire | I thought mine was waiting on those | 14:11 |
| fungi | prometheanfire: they were pushed to gerrit as a dependent change series (the git parent of a change, if also an open change, is seen by gerrit as a dependency) | 14:11 |
| prometheanfire | right | 14:11 |
| fungi | if you don't want 296626 to depend on 299694 or don't want 300256 to depend on 296626 then you should rebase them directly onto the tip of master and push new patchsets | 14:12 |
| *** e0ne has joined #openstack-infra | 14:12 | |
| prometheanfire | fungi: 300256 and 296626 seem to do a bunch of work that I was also doing in 299694 | 14:13 |
| *** gongysh has joined #openstack-infra | 14:13 | |
| prometheanfire | fungi: at this point it'd probably be better to just have them vote on 299694 | 14:14 |
| fungi | prometheanfire: yeah, coordinate with greghaynes and ianw on that | 14:14 |
| prometheanfire | greghaynes: ianw: both of your DIB changes depend on mine as the root, mind voting? :P https://review.openstack.org/#/c/299694 | 14:14 |
| fungi | i'm not a regular reviewer on dib (much less a core reviewer for it) so lack insight into what their intent was there | 14:14 |
| prometheanfire | fungi: done, you had a chance to look at the bindep changes? | 14:15 |
| prometheanfire | fungi: fair enough | 14:15 |
| mtreinish | fungi, yolanda: is there a reason tests didn't run against: https://review.openstack.org/#/c/237268/ | 14:15 |
| prometheanfire | fungi: I honestly think dib needs at least one more core, atm it only seems to be them reviewing | 14:15 |
| *** daemontool has joined #openstack-infra | 14:15 | |
| mtreinish | I would have expected at least a docs job to get triggered | 14:15 |
| AJaeger | why do we set up repositories if nobody ever submits code to them? https://review.openstack.org/#/admin/groups/1328,members is still empty - the repo was created a month ago ;( | 14:15 |
| fungi | prometheanfire: no, not yet. still caffeinating for the morning and trying to get through overnight e-mail | 14:16 |
| prometheanfire | fungi: sure, I'm still catching up too :D | 14:16 |
| *** hashar has joined #openstack-infra | 14:16 | |
| *** lezbar__ has joined #openstack-infra | 14:17 | |
| prometheanfire | fungi: so, which view do you use to see the dependant chanes more clearly? | 14:17 |
| bdemers | Are there any restrictions (other then no TC voting) for unofficial (i.e. recent neutron stadium) projects ? | 14:17 |
| *** lezbar has quit IRC | 14:18 | |
| AJaeger | bdemers: translators will only look at official projects, docs.openstack.org is only for official projects | 14:18 |
| openstackgerrit | Ian Cordasco proposed openstack-dev/hacking: Add reno and release notes tracking https://review.openstack.org/308472 | 14:19 |
| yolanda | mtreinish, i triggered a recheck and worked now | 14:20 |
| fungi | prometheanfire: i actually use https://pypi.python.org/pypi/gertty and eschew the gerrit webui for anything besides group management et cetera | 14:20 |
| prometheanfire | ah | 14:20 |
| mtreinish | yolanda: cool, thanks | 14:20 |
| fungi | but i'm not a big gui fan to start with | 14:21 |
| *** claudiub has quit IRC | 14:21 | |
| mtreinish | yolanda: although looking at it now it looks like there weren't any results on the previous rev either | 14:21 |
| mtreinish | I wonder what caused that | 14:21 |
| fungi | anything i can do in a terminal i can usually do faster and more effectively than stuff which requires me to touch a mouse | 14:21 |
| jeblair | fungi: we are running *without* the connections revert since yolanda restarted zuul | 14:21 |
| mordred | mice suck | 14:21 |
| fungi | jeblair: okay, that makes sense on the leak behavior then | 14:21 |
| fungi | so it probably still is the connections work which is leaking | 14:22 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Revert "Fix comment on requirements job" https://review.openstack.org/309018 | 14:22 |
| *** rbrndt has joined #openstack-infra | 14:22 | |
| jeblair | ianw: ^ i'm sorry, i thought i explained that the problem was in the javascript+regex, *not* in the message itself | 14:23 |
| jeblair | yolanda, AJaeger: ^ please see this revert -- i do not believe the original patch should have been approved | 14:23 |
| AJaeger | jeblair: reading... | 14:23 |
| jeblair | fungi, mordred: would you please instapprove 309018? | 14:23 |
| fungi | done and done | 14:24 |
| fungi | interesting that the removal also included removing the error message from the job script | 14:24 |
| jeblair | fungi: it's a straight revert | 14:24 |
| *** Goneri has quit IRC | 14:24 | |
| jeblair | it was added in the "fix" | 14:24 |
| fungi | er, right, i was looking at the revert backwards on that file | 14:25 |
| AJaeger | fungi: it's indeed a straight revert. The error message could be added in IMHO. | 14:25 |
| yolanda | jeblair, checking | 14:25 |
| *** maishsk has quit IRC | 14:25 | |
| bdemers | AJaeger docs.o.o completely or just the translation bit? if if completely what happens/should happen to current pages on docs.o.o ? | 14:26 |
| fungi | yeah, i'd gladly approve a change which just added the error message to the job script, but also i agree the hideci-js needs proper fixing for that | 14:26 |
| AJaeger | bdemers: completely | 14:26 |
| bdemers | say for example: http://docs.openstack.org/developer/networking-cisco/ | 14:27 |
| *** dizquierdo has joined #openstack-infra | 14:27 | |
| bdemers | will a redirect be setup? or i'm unclear how dead links or out dated doc would be handled | 14:27 |
| jamespage | yolanda, hey - I think this might be side effect of the branch dance we did this morning: | 14:28 |
| jamespage | https://review.openstack.org/#/q/topic:16.04-updates | 14:28 |
| AJaeger | bdemers: we could add a redirect | 14:28 |
| jamespage | yolanda, what do you think? | 14:28 |
| bdemers | AJaeger ok, is there an unofficial docs / wiki space we should be using ? | 14:28 |
| AJaeger | bdemers: rtfm is used for unofficial docs - but wiki.openstack.org is fine | 14:29 |
| *** roxanagh_ has joined #openstack-infra | 14:29 | |
| *** asettle has quit IRC | 14:29 | |
| yolanda | jamespage, nice... looking, i tried a rebase from ui and didn't work | 14:29 |
| bdemers | AJaeger ok, cool, that works | 14:29 |
| AJaeger | bdemers: for a redirect, send patch to openstack-manuals/www/static/.htaccess | 14:30 |
| bdemers | ok, thanks! | 14:30 |
| *** sputnik13 has quit IRC | 14:30 | |
| fungi | ianw: probably somewhere in ci_parse_comments() or a new function called from it http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/gerrit/hideci.js#n177 | 14:31 |
| *** ayoung has joined #openstack-infra | 14:31 | |
| jamespage | yolanda, yeah - ditto in the ui - if I rebase locally, there is no change to rebase on... | 14:32 |
| jamespage | which is kinda what I expected... | 14:32 |
| yolanda | yep, same here, i cannot send any update because rebase is doing nothing | 14:32 |
| fungi | ianw: or like jeblair suggested, the regular expressions at the top may be sufficiently tweakable to match on it | 14:32 |
| AJaeger | fungi: ianw sent https://review.openstack.org/#/c/308731/ - I think that should fix the issue as well | 14:32 |
| AJaeger | fungi: but I didn't dig further | 14:33 |
| *** roxanagh_ has quit IRC | 14:33 | |
| *** vikram has joined #openstack-infra | 14:34 | |
| yolanda | jamespage, i tried to send just a small change on the commit message, and it failed | 14:34 |
| fungi | ahh, yep, that looks sane though would want to locally test out that patch with a javascript console | 14:34 |
| yolanda | let me dig deeper | 14:34 |
| vikram | fungi: Can you please help modifying the ACL for the newly created project @ https://review.openstack.org/#/c/268726/ | 14:34 |
| jamespage | yolanda, I would suspect that whatever git repo is being used to check merges, it needs a prune... | 14:35 |
| yolanda | i was checking now zuul git repos, yes | 14:35 |
| jamespage | yolanda, thanks for your help today - much appreciated... | 14:35 |
| yolanda | jamespage, anytime | 14:35 |
| fungi | jamespage: yolanda: the jgit library (java-based git implementation) used by gerrit can be sort of obtuse when it comes to merge conflict resolution. cgit has a lot more effective resolution methods it tries so can make it seem like there is no conflict when there actually is for the methods jgit is limited to. no idea if that's the situation here, just something to keep in mind when troubleshooting | 14:37 |
| yolanda | fungi, the problem is that i removed a bunch of stable branches today from that charms repos. I think zuul-mergers may be confused | 14:38 |
| yolanda | i'm checking one of the zuul mergers repo now | 14:38 |
| yolanda | so that's it... stable branch already exists on the zuul-mergers repo | 14:39 |
| yolanda | fungi, what shall be the best way to clean up those? | 14:39 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Finish: Update deprecated commands in tripleo.sh (Old heat stack-* calls) https://review.openstack.org/309039 | 14:39 |
| fungi | yolanda: oh, yes replacing branches with non-ff-able content will do that | 14:39 |
| yolanda | on downstream, i normally just removed the repo | 14:39 |
| fungi | yolanda: that's one of the reasons we heavily discourage it | 14:39 |
| fungi | it's also pretty user-hostile since anyone who cloned that branch will now need to manually delete or reset it | 14:40 |
| yolanda | yes, problem is that those stable branches were blocking the creation of 16.04 ones | 14:40 |
| jeblair | i'm not sure we've ever done this. | 14:41 |
| *** Goneri has joined #openstack-infra | 14:41 | |
| fungi | wait, what was the name of the branch you deleted? | 14:41 |
| *** oanson has quit IRC | 14:42 | |
| yolanda | stable | 14:43 |
| fungi | i see. for example zm01 thinks there is a remotes/origin/stable and it has a local tracking branch called stable | 14:43 |
| *** Nikolay_St has quit IRC | 14:43 | |
| fungi | in /var/lib/zuul/git/openstack/charm-swift-proxy | 14:43 |
| yolanda | i've done that branches deletion in downstream several times, and hitting similar problems.. what we did normally is to just remove the repos from the mergers, so zm recreated again | 14:43 |
| openstackgerrit | Chris Denneen proposed openstack-infra/jenkins-job-builder: Add BuildNameUpdater to Builders https://review.openstack.org/308457 | 14:43 |
| fungi | as far as i know that's safe, but it's a lot of added manual effort | 14:44 |
| *** roxanagh_ has joined #openstack-infra | 14:44 | |
| yolanda | i know, but i'm happy to take the responsability as I did the branch deletion | 14:44 |
| yolanda | i cannot thing on a better way | 14:44 |
| jeblair | the branches should not have been imported in the first place | 14:45 |
| yolanda | in zuul mergers? | 14:45 |
| fungi | in new project creation | 14:45 |
| fungi | i suspect nobody expected having a branch named "stable" would prevent later creation of branches named like "stable/foo" and didn't question it | 14:46 |
| *** Goneri has quit IRC | 14:46 | |
| AJaeger | fungi: in https://review.openstack.org/#/c/232705/ I asked whether *all* branches should be imported - but didn't notice the relevance of "stable" | 14:46 |
| prometheanfire | fungi: I found that out the hard way by having a branch named bug and not be able to make one named bug/foo/bar :( | 14:46 |
| yolanda | i'm just learning about that naming problem as i see | 14:47 |
| jamespage | jeblair, apologies - that was my action - I was unaware that having a stable branch would block having a stable/XXX branch later... | 14:47 |
| AJaeger | should we blacklist such a branch? we can add a check for the future... | 14:47 |
| fungi | "stable" might be a special case we'd look out for since projects commonly use it as a branch namespace | 14:47 |
| mordred | ++ | 14:47 |
| fungi | i'm on the fence about introducing ever-growing blacklists which might occasionally prevent legitimate use though | 14:48 |
| jeblair | stable, feature | 14:48 |
| jamespage | agreed - would have used a namespaced stable/XXX if I'd have known... | 14:48 |
| mordred | jeblair: proposed is another one, right? (is that where we're putting pre-release stuff now?) | 14:48 |
| yolanda | so i can purge that repos from the zuul mergers as a workaround | 14:48 |
| jeblair | fungi: blacklisting only the ones that have meaning in infra might be reasonable though? | 14:49 |
| jeblair | mordred: ya; so stable, feature, proposed | 14:49 |
| jeblair | hopefully no one uses 'feature' as a branch name -- it's a pretty terrible one :) | 14:50 |
| jeblair | "oh, yeah, that's where we added that feature" | 14:50 |
| fungi | yeah, if we can keep it limited that seems fine | 14:50 |
| jeblair | "which one?" "the one that wasn't a bug" | 14:50 |
| *** sdague_ has joined #openstack-infra | 14:50 | |
| fungi | we fixed the bug in that other branch. the one named "bug" | 14:51 |
| openstackgerrit | Merged openstack-infra/puppet-reviewday: Create logs for update_review https://review.openstack.org/308367 | 14:51 |
| AJaeger | mordred: proposed is not used anymore | 14:51 |
| fungi | right, we dropped proposed/ and switched to just creating stable/ during rc instead | 14:52 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Block "stable" branches for new project imports https://review.openstack.org/309044 | 14:52 |
| AJaeger | team, here's a suggested change just blacklisting "stable" - I can abandon or enhance to check for "feature" as well. ^ | 14:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Don't check for proposed branches in propose_update https://review.openstack.org/309045 | 14:53 |
| jeblair | fungi, AJaeger: in that case ... ^ :) | 14:53 |
| mordred | cool | 14:53 |
| *** sdague_ has quit IRC | 14:53 | |
| *** sdague has quit IRC | 14:53 | |
| nibalizer | EmilienM: yea that change looks fine | 14:54 |
| *** mrmartin has joined #openstack-infra | 14:54 | |
| fungi | AJaeger: let's add feature too, yeah | 14:54 |
| *** sdague has joined #openstack-infra | 14:54 | |
| AJaeger | will do, fungi | 14:55 |
| dansmith | pabelanger: clarkb: fungi: by the way, there are not hammer xenial packages yet, but the next build will generate them, which will be in about a week, reportedly, so we should be good I think | 14:55 |
| pabelanger | dansmith: great! | 14:55 |
| dansmith | pabelanger: it also sounds like jewel will be a thing we'll want to migrate to (from hammer) at some point just to stay current | 14:56 |
| pabelanger | mordred: sorry, out for a walk. Looks like yolanda helped! | 14:56 |
| *** jaosorior has quit IRC | 14:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Block stable/feature branch for new project imports https://review.openstack.org/309044 | 14:57 |
| AJaeger | fungi, jeblair ^ | 14:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Remove proposed/ acls https://review.openstack.org/309049 | 14:57 |
| pabelanger | dansmith: Ya, clarkb and I were talking about that yesterday. It shouldn't be hard to get the next mirror up now | 14:57 |
| jeblair | AJaeger, fungi: ^ and some more proposed proposed cleanup | 14:57 |
| dansmith | pabelanger: cool | 14:57 |
| yolanda | jamespage, i cleaned repos. Seems better now | 14:57 |
| *** tlian has joined #openstack-infra | 14:57 | |
| jamespage | yolanda, thankyou! | 14:57 |
| AJaeger | jeblair: does the infra manual still mention "proposed/"? That's one more place that might include it. | 14:58 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Revert "Test with latest master heat" https://review.openstack.org/309051 | 14:58 |
| AJaeger | jeblair: thanks for the cleanup! | 14:58 |
| jeblair | AJaeger: yep | 14:58 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Block stable/feature branch for new project imports https://review.openstack.org/309044 | 14:59 |
| AJaeger | jeblair: fixed the double of - thanks for review | 14:59 |
| mordred | jeblair: I have a hunch on another thing to do to make less fip leaks | 15:00 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 15:00 |
| * AJaeger needs a spell checker. Thanks fungi | 15:00 | |
| fungi | AJaeger: one of those typos was a real word, so a spell checker would only have half helped | 15:00 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Block stable/feature branch for new project imports https://review.openstack.org/309044 | 15:00 |
| *** kushal has joined #openstack-infra | 15:01 | |
| jeblair | AJaeger: the infra-manual is up to date | 15:01 |
| AJaeger | fungi: I know. | 15:01 |
| *** Goneri has joined #openstack-infra | 15:01 | |
| AJaeger | jeblair: cool! | 15:01 |
| mordred | Shrews, jeblair: when I do a neutron floatingip-show on a leaked FIP - it shows "state: DOWN" | 15:02 |
| AJaeger | wow, we're very fast right now in proposing and reviewing changes ;) | 15:03 |
| mordred | I'm tinking that perhaps in the create_floating_ip routine - we check for getting a FIP with state: DOWN. if we do, delete it and try again | 15:03 |
| * AJaeger has to leave the party now, will be back later... | 15:03 | |
| pabelanger | AJaeger: o/ | 15:04 |
| *** psilvad_ has joined #openstack-infra | 15:04 | |
| *** psilvad_ has quit IRC | 15:04 | |
| Shrews | mordred: does it end up in the DOWN state on creation or deletion? | 15:04 |
| mordred | Shrews, jeblair: I need to do some testing to see if in a normal case where it's working the fip returns as down then flips to up - or if it returns as up when it works | 15:04 |
| mordred | Shrews: that's the question. but all of the leaked ones are definitely in down state | 15:05 |
| Shrews | mordred: creating a new FIP that starts in the DOWN state makes no sense to me. does that mean it's in an error state? | 15:05 |
| mordred | dunno | 15:05 |
| * Shrews offers no help | 15:05 | |
| mordred | it's the next thing I'm going to explore | 15:05 |
| Shrews | we should poke neutron'ers | 15:06 |
| jeblair | ++to the source | 15:06 |
| mordred | jeblair: got a sec to help me look at logs? | 15:07 |
| mordred | jeblair: node | 15:07 |
| mordred | jeblair: node 442047 | 15:07 |
| jeblair | (it may be really hard to thoroughly evaluate this in practice since, if being in 'down' is every a legit part of a successful operation, it may be very hard to catch) | 15:07 |
| jeblair | mordred: ya | 15:07 |
| mordred | is a node that had a leaked fip | 15:07 |
| *** roxanagh_ has quit IRC | 15:07 | |
| mordred | jeblair: but I can't see where that node either succeeded or failed | 15:07 |
| mordred | jeblair: also, d9657654-cf92-4442-9247-767ad97a32f2 is a newish leaked fip | 15:08 |
| jeblair | mordred: it's still building | 15:08 |
| mordred | jeblair: ah. SO - that means that we're waiting for it to show up on the server | 15:08 |
| jeblair | mordred: yeah | 15:08 |
| jeblair | mordred: 2016-04-21 14:25:21,481 DEBUG shade: Created FIP 172.99.106.241:f95c4cd2-2043-4ba7-8fa4-569b43dc75a1 for server e8e54f61-44e0-4125-801e-ba2768b5d654 | 15:08 |
| mordred | but it's showing down and no port id in neutron | 15:08 |
| jeblair | mordred: that's the last thing for it i think | 15:09 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use the cached ironic-python-agent images https://review.openstack.org/301699 | 15:09 |
| vikram | infra_core: Can someone please help modifying the ACL for the newly created project via https://review.openstack.org/#/c/268726/ | 15:09 |
| mordred | jeblair: maybe step one is "check to see that the returned fip has port_id == requested_port_id | 15:09 |
| jeblair | mordred: yeah -- another good question for neutron devs -- is that a transient state? | 15:10 |
| *** burgerk has joined #openstack-infra | 15:10 | |
| jeblair | mordred: (ie, if you request a fip on a port, is it ever valid for the port to be null?) | 15:10 |
| jeblair | (on the fip) | 15:10 |
| *** andymaier_ has quit IRC | 15:10 | |
| jeblair | [breakfast] | 15:11 |
| pabelanger | yolanda: when we disabled OVH, did we also clean up nodepool? I see a lot of ready nodes in OVH | 15:11 |
| *** Goneri has quit IRC | 15:11 | |
| pabelanger | yolanda: 2.5+ hours | 15:11 |
| *** tpsilva has joined #openstack-infra | 15:11 | |
| pabelanger | yolanda: think we might need to delete them from nodepool | 15:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 15:12 |
| mordred | jeblair, Shrews: ^^ something like this | 15:12 |
| mordred | mestery: any chance you know the answer here? | 15:13 |
| *** mylu has quit IRC | 15:14 | |
| *** schipiga_ has joined #openstack-infra | 15:15 | |
| *** e0ne has quit IRC | 15:15 | |
| *** salv-orlando has quit IRC | 15:16 | |
| *** jaosorior has joined #openstack-infra | 15:16 | |
| openstackgerrit | Chris Denneen proposed openstack-infra/jenkins-job-builder: Add BuildNameUpdater to Builders https://review.openstack.org/308457 | 15:17 |
| *** e0ne has joined #openstack-infra | 15:17 | |
| fungi | on a cleanup note, should we keep the old gerrit server around any longer? should i snapshot its rootfs and delete the instance? | 15:18 |
| pabelanger | infra-root: I just cleaned up the stale ready nodes from nodepool, FYI. | 15:19 |
| fungi | thanks pabelanger | 15:19 |
| mordred | I have asked about the port id thing in the neutron channel | 15:21 |
| *** inc0 has quit IRC | 15:22 | |
| pabelanger | Any objections on adding an --age argument to filter on nodepool list ? | 15:22 |
| openstackgerrit | Merged openstack-infra/project-config: Replace the packstack-dev channel by rdo https://review.openstack.org/308576 | 15:23 |
| *** BigWillie has quit IRC | 15:23 | |
| clarkb | good morning | 15:23 |
| clarkb | looks like fip leaks are being debugged and ceph will get both xenial and new release in near future. | 15:24 |
| pabelanger | clarkb: morning | 15:24 |
| mordred | clarkb: yup. we have new theories on the FIP leaks : | 15:24 |
| jeblair | clarkb: what nodepool docs change were you talking about with pleia2? | 15:26 |
| *** Goneri has joined #openstack-infra | 15:26 | |
| clarkb | jeblair: https://review.openstack.org/#/c/179840/ | 15:26 |
| *** andreww has quit IRC | 15:27 | |
| *** scheuran has quit IRC | 15:27 | |
| clarkb | nibalizer: looks like ES is still unhappy. I have no idea why this is happening | 15:27 |
| clarkb | nibalizer: as an improvement we seem to be indexing stuff unlike before but the cluster is refusing to finish up shard recovery | 15:27 |
| yolanda | pabelanger, no , i just set the max-servers to 0, then re-enabled again | 15:27 |
| nibalizer | clarkb: bah! | 15:27 |
| *** BigWillie has joined #openstack-infra | 15:28 | |
| pabelanger | yolanda: Thanks | 15:28 |
| clarkb | nibalizer: it seems that the issue is when recoverying a shard from the master node everything times out | 15:28 |
| clarkb | nibalizer: but there is network connectivity between them | 15:29 |
| *** e0ne has quit IRC | 15:29 | |
| *** Swami has joined #openstack-infra | 15:30 | |
| *** mhickey has joined #openstack-infra | 15:30 | |
| *** zeih has quit IRC | 15:30 | |
| *** Na3iL has joined #openstack-infra | 15:30 | |
| *** mylu has joined #openstack-infra | 15:31 | |
| yolanda | mordred, jeblair, can you take a look to the glean resolv.conf fix when you have a sec? https://review.openstack.org/307581 | 15:32 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:33 | |
| clarkb | nibalizer: http://paste.openstack.org/show/495008/ those seem to be the relevant logs | 15:33 |
| *** esikachev has quit IRC | 15:34 | |
| * nibalizer looks at bigdesk | 15:34 | |
| pabelanger | pleia2: docaedo: Did we maybe want to get onto the asterisk server this afternoon / tomorrow and have a quick chat about presentation. See if we need to make any other changes to overview and / or review the slides? Doing it on site at austin is another option | 15:35 |
| *** e0ne has joined #openstack-infra | 15:36 | |
| clarkb | nibalizer: I am going to delete the .kibana index because queries against it are creating noise in the logs (and since we aren't kibana4ing yet it isn't necessary) | 15:36 |
| nibalizer | ok | 15:36 |
| nibalizer | it says out of memory in the logs but bigdesk thinks 05 is doing fine on memory | 15:37 |
| nibalizer | i guess its now 30 minutes from those log events | 15:37 |
| *** jordanP has joined #openstack-infra | 15:37 | |
| *** yamahata has joined #openstack-infra | 15:38 | |
| clarkb | nibalizer: yup, but if you read further it says "actual exception" then "org.elasticsearch.indices.recovery.DelayRecoveryException: source node does not have the shard listed in its state as allocated on the node" is the error there | 15:38 |
| nibalizer | wow | 15:38 |
| *** fedexo has joined #openstack-infra | 15:38 | |
| clarkb | I wonder if the heap space is just noise in some error handling stack. And ^ is the real issue | 15:39 |
| nibalizer | it labeled the actual exception | 15:39 |
| mordred | clarkb, Shrews, jeblair: ok. I have tested (once) a valid server creation on osic and it returned the port_id in the return dict from the floating ip create | 15:41 |
| *** armax has joined #openstack-infra | 15:42 | |
| *** hdd has joined #openstack-infra | 15:43 | |
| *** Nikolay_St has joined #openstack-infra | 15:43 | |
| * jeblair installs an ftp server | 15:43 | |
| mordred | aha. SO - it comes with state DOWN and the requested port_id | 15:44 |
| jeblair | mordred: but if it doesn't have a port, it's definitely an error? | 15:45 |
| mordred | jeblair: well, that I don't know - but the successes have ports | 15:46 |
| *** vincentll has quit IRC | 15:46 | |
| mordred | jeblair: so I'm willing to take a plunge and treat no-port as error for now | 15:46 |
| *** hdd has quit IRC | 15:46 | |
| mordred | and also perhaps put in a wait for the fip to go from DOWN to ACTIVE | 15:46 |
| clarkb | nibalizer: https://github.com/elastic/elasticsearch/issues/12011 I am still reading that but I think it may be our problem | 15:46 |
| mordred | before we return success | 15:46 |
| *** roxanagh_ has joined #openstack-infra | 15:47 | |
| *** openstackgerrit has quit IRC | 15:48 | |
| *** cloudtrainme has joined #openstack-infra | 15:48 | |
| *** julim has joined #openstack-infra | 15:48 | |
| *** jaosorior has quit IRC | 15:48 | |
| *** openstackgerrit has joined #openstack-infra | 15:48 | |
| docaedo | pabelanger: I could hop on a call this afternoon to discuss, or else Sunday in AUS or Monday morning | 15:48 |
| pabelanger | docaedo: sure, lets see what pleia2 says | 15:49 |
| docaedo | pabelanger: works for me :) | 15:50 |
| clarkb | nibalizer: tl;dr is "we had some deadlocks that prevented shards from being freed. Should be fixed in 2.1" :( | 15:51 |
| *** xyang1 has quit IRC | 15:51 | |
| clarkb | nibalizer: no mention of whether or not such deadlocks would servive a full cluster restart but that may be our next step | 15:51 |
| clarkb | nibalizer: I am willing to run it in this state for now though since it is functioning, then if we get back to unfunctioning state try full cluster restart | 15:52 |
| nibalizer | did you run that sketchy curl to look at 'hot_threads' ? | 15:52 |
| clarkb | jesusaur: ^ FYI this may be interesting info to you | 15:52 |
| *** mikelk has quit IRC | 15:52 | |
| clarkb | nibalizer: I have not, but maybe we should | 15:52 |
| clarkb | nibalizer: I usually read the es docs on sketchy queries first :) | 15:52 |
| nibalizer | do we have 'failed to lock' in our logs? | 15:53 |
| *** trown is now known as trown|lunch | 15:53 | |
| clarkb | we did yesterday when I was first debugging this, not sure if it has persisted | 15:53 |
| openstackgerrit | Dean Troyer proposed openstack-infra/irc-meetings: Move OSC team meeting even weeks to 1300 UTC Thursday https://review.openstack.org/309077 | 15:53 |
| * clarkb uses grep | 15:53 | |
| * nibalizer not see it on 05 | 15:53 | |
| clarkb | 07 was where I saw it yesterday let me see if I can pull it up there | 15:54 |
| *** matrohon has quit IRC | 15:54 | |
| *** mrmartin has quit IRC | 15:54 | |
| clarkb | nibalizer: http://paste.openstack.org/show/495011/ found it | 15:54 |
| nibalizer | clarkb: clearly we need a log aggregation and indexing service to scan elasticsearch logs | 15:55 |
| clarkb | nibalizer: I have thought about that, but things get weird when you put elsaticsearch in elasticsearch | 15:55 |
| *** andreww has joined #openstack-infra | 15:55 | |
| clarkb | nibalizer: like you generate logs by indexing logs, and all of a sudden the snake is eating its tail | 15:55 |
| *** psilvad has joined #openstack-infra | 15:57 | |
| nibalizer | clarkb: haha yes im totally just joking around | 15:57 |
| nibalizer | second ES cluster for system logs | 15:58 |
| mordred | clarkb, Shrews: http://paste.openstack.org/show/495013/ | 15:58 |
| nibalizer | then if the systemlog ES cluster needs log analysis we just do it like this probably | 15:58 |
| mordred | Shrews: so two things- create and list have completely different FIP structures, so we need a normalize | 15:58 |
| mordred | and that is the sequence I get on a successful FIP creation | 15:58 |
| mordred | so I believe create_floating_ip wants a wait/timeout | 15:58 |
| EmilienM | fungi: can you please clean files in http://tarballs.openstack.org/puppet-aodh/ | 15:59 |
| mordred | so that it can wait for status==ACTIVE before returning | 15:59 |
| mordred | and we can short circuit the wait loop if we see port_id not populated | 15:59 |
| fungi | EmilienM: you just want all of those removed? | 15:59 |
| EmilienM | fungi: yes, please | 15:59 |
| EmilienM | fungi: just for puppet-aodh | 15:59 |
| *** baoli_ has quit IRC | 16:00 | |
| fungi | EmilienM: so puppet-aodh-7.0.0.tar.gz and puppet-aodh-tarball-master.tar.gz | 16:00 |
| *** baoli has joined #openstack-infra | 16:00 | |
| EmilienM | fungi: another question: would it be possible to generate tarballs for all our modules in master / stable/mitaka and stable/liberty ? | 16:00 |
| *** esikachev has joined #openstack-infra | 16:00 | |
| fungi | EmilienM: rather than waiting for new changes to merge for each of those branches? | 16:01 |
| EmilienM | fungi: right | 16:01 |
| EmilienM | fungi: specially for stable branches, where we have rare commits | 16:01 |
| fungi | EmilienM: it's possible but would be a fair amount of manual work to research and trigger all those jobs with the appropriate parameters | 16:01 |
| *** claudiub has joined #openstack-infra | 16:02 | |
| *** lezbar__ has quit IRC | 16:02 | |
| EmilienM | fungi: ok I see, so I better to commit on each repo and each branch | 16:02 |
| fungi | EmilienM: yeah, or just wait for them to appear over time, unless you urgently need them | 16:02 |
| clarkb | jeblair: mordred are you aware that we are failing to deliver root mail to you? | 16:03 |
| *** dalgaaf has joined #openstack-infra | 16:03 | |
| *** andreww is now known as xarses | 16:03 | |
| mordred | clarkb: nope | 16:03 |
| EmilienM | fungi: some of our operators need it | 16:03 |
| mordred | clarkb: I imagine our mail server thinks openstack is spam | 16:03 |
| clarkb | mordred: yes | 16:03 |
| fungi | clarkb: which messages? i get a lot of them that bounce for you, mordred, jeblair, nibalizer and yolanda | 16:03 |
| EmilienM | fungi: can't we trigger the post jobs manually? | 16:03 |
| *** lezbar__ has joined #openstack-infra | 16:04 | |
| clarkb | fungi: from graphite.o.o, looks like possibly related to not having AAAA and reverse ptr records? | 16:04 |
| fungi | clarkb: a major cause seems to be that teh from address doesn't actually pass sender callback tests | 16:04 |
| mordred | that would certainly do it | 16:04 |
| mordred | the reverse ptr record | 16:04 |
| clarkb | reverse ptr is there | 16:04 |
| mordred | hrm | 16:04 |
| nibalizer | i also get a lot of bounces | 16:04 |
| clarkb | but AAAA isn't | 16:05 |
| *** lezbar__ has quit IRC | 16:05 | |
| mordred | I doubt we'd reject from our email server due to lack of AAAA - but I could be wrong | 16:05 |
| *** lezbar__ has joined #openstack-infra | 16:05 | |
| mordred | maybe if it's coming in on IPV6 and we try to reverse then forward the ipv6 addr | 16:05 |
| zxiiro | zaro: electrofelix : can you guys review this patch? https://review.openstack.org/#/c/308705/ I'd like to get it merged before we cut a release. | 16:05 |
| nibalizer | mordred: that would be pretty ambitious of you | 16:05 |
| fungi | EmilienM: an infra root admin can reenqueue refs or manually inject job work requests, but would need to loop over a list of project names, branch names and resolved branch tip git shas for all of them | 16:05 |
| mordred | nibalizer: well, we do the reverse check | 16:05 |
| nibalizer | so mail bounces trying to reach me? | 16:06 |
| clarkb | mordred: 550-2001:4800:7810:512:3bc3:d7f6:ff04:8201 is listed in the Spamhaus DNSBL. that is the real reason I think | 16:06 |
| nibalizer | my email is hosted at fastmail so there is limited control I have over that | 16:06 |
| *** tphummel has joined #openstack-infra | 16:06 | |
| nibalizer | but if the mail gets to clark (who is on fastmail too I believe) then it should come to me fine | 16:06 |
| *** inc0 has joined #openstack-infra | 16:06 | |
| clarkb | nibalizer: correct fastmail here | 16:07 |
| mordred | clarkb: oh. yah | 16:07 |
| *** fhubik has quit IRC | 16:07 | |
| *** lakshmiS has joined #openstack-infra | 16:07 | |
| *** xyang1 has joined #openstack-infra | 16:08 | |
| *** fhubik has joined #openstack-infra | 16:08 | |
| *** imcsk8|z1z is now known as imcsk8 | 16:08 | |
| *** arxcruz has quit IRC | 16:09 | |
| electrofelix | zxiiro: have you seen https://review.openstack.org/274195? shows how to do version specific behaviour for the maven plugin | 16:09 |
| krotscheck | AJaeger: I'm not certain I understand your comment on https://review.openstack.org/#/c/308695/ - the idea with the patch is to use one core group - infra-javascript-core - for the various javascript projects that are generically infra. Removing the old ACL and replacing it with a new one. I'm guessing that editing this particular file is the wrong one, yes? | 16:09 |
| *** hashar has quit IRC | 16:10 | |
| *** schipiga_ has quit IRC | 16:10 | |
| zxiiro | electrofelix: ah interseting... I'll bookmark it and see if i can implement that tonight | 16:10 |
| *** brad_behle has joined #openstack-infra | 16:11 | |
| *** mhickey has quit IRC | 16:11 | |
| electrofelix | waynr zaro: I've got a few patches needing the final +2: https://review.openstack.org/265926, https://review.openstack.org/265959, https://review.openstack.org/282723, https://review.openstack.org/193660, https://review.openstack.org/289344, https://review.openstack.org/289343 | 16:12 |
| zxiiro | electrofelix: when are we cutting the release? | 16:12 |
| *** esikachev has quit IRC | 16:12 | |
| pleia2 | pabelanger, docaedo: any time today after 10:30am pacific works for me | 16:12 |
| electrofelix | zxiiro: I think Monday/Tuesday would be the sensible time just in case something sneaks in | 16:12 |
| *** kjorgensen has joined #openstack-infra | 16:13 | |
| *** inc0 has quit IRC | 16:13 | |
| zxiiro | electrofelix: ok great, I really want that CFP patch in so I'll ping you tomorrow about getting it reviewed | 16:13 |
| clarkb | nibalizer: I don't really see anything in hot_threads that looks terrible, but I also do not know what I am looking for | 16:13 |
| electrofelix | waynr: meant to ask, for the 2.0 work, with the patches targeted against a feature branch, what was the plan for merging in? Or if we cut a final 1.x release do you want to retarget them against master? | 16:13 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/requirements: Add global requirement update on python-brick-cinderclient-ext project https://review.openstack.org/309084 | 16:13 |
| zxiiro | sadly i'm stuck in meetings all day today so can't work on it during the day | 16:13 |
| fungi | krotscheck: if it's going to be a lot, probably needs to be done in the same way as infra-puppet-core. we have a script in system-config to manage it http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/maintain-infra-groups.py#n165 | 16:14 |
| fungi | krotscheck: if it's only going to be a few repos, we can just do it with repo-specific groups | 16:14 |
| *** ddieterly is now known as ddieterly[away] | 16:15 | |
| *** ddieterly[away] is now known as ddieterly | 16:15 | |
| krotscheck | fungi: I anticipate... 3, maybe 4 projects? Right now the only thing on the roadmap are the two mirror repos, a project generator (js-version of cookiecutter), and maybe moving eslit-config-openstack under the infra banner. | 16:15 |
| docaedo | pleia2 pabelanger - any time today after 10:30am PST works for me too | 16:15 |
| krotscheck | It may involve npm-publish-xstatic and some kind of a docs shim. | 16:15 |
| *** brad_behle has left #openstack-infra | 16:15 | |
| fungi | krotscheck: so by default we just create a specific core group for each repo, our script adds infra-core to the groups for it but we can also add other core reviewers individually to those repo-specific core groups | 16:16 |
| krotscheck | Yep. | 16:16 |
| fungi | four doesn't sound like a lot to deal with manually | 16:17 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade https://review.openstack.org/243239 | 16:17 |
| krotscheck | fungi: That's fair. Just stick to the normal groups naming convention then? | 16:17 |
| fungi | krotscheck: yeah, i vote for that | 16:17 |
| clarkb | nibalizer: I think we stick to what I originally proposed, let it run as is, if it breaks harder do a full cluster restart to hopefully free up the locks | 16:17 |
| krotscheck | fungi: Gotcha. I'll abandon that patch. | 16:18 |
| fungi | krotscheck: as soon as the governance changes for those repos merge i'll run the maintenance script to make sure the groups are done up correctly | 16:18 |
| *** inc0 has joined #openstack-infra | 16:18 | |
| clarkb | nibalizer: I tried to do hot threads based on cpu, block, and wait, don't really see anything glaring | 16:18 |
| amrith | sdague, would you help with this odd issue please; not sure if it is related to gerrit dash creator in some way but, see gist https://gist.github.com/amrith/30cc5f426f06a722d690252deb4186bc. there are two queries. You'll notice that they differ in only one way, the second has a final expression "NOT Code-Review<=-2". The latter search unfortunately drops a lot of reviews which it should not; i.e. a bunch of reviews | 16:18 |
| amrith | which have no -2's are being ommitted. | 16:18 |
| fungi | just give me a heads up in case i miss that happening | 16:18 |
| amrith | sdague ^^ | 16:18 |
| *** dtardivel has quit IRC | 16:18 | |
| amrith | this makes the dashboard suppress some reviews that it shouldn't | 16:18 |
| krotscheck | fungi; GOvernance for the first one landed. Not the second one. | 16:18 |
| pabelanger | docaedo: pleia2: Ack, 10:30am PST then | 16:19 |
| fungi | krotscheck: also let me know if there are any outstanding additions to infra in governance lacking my +1 so i can take care of it | 16:19 |
| nibalizer | clarkb: wfm | 16:19 |
| *** roxanag__ has joined #openstack-infra | 16:19 | |
| mordred | sdague: is this: http://paste.openstack.org/show/495021/ true simply for hysterical raisins? | 16:19 |
| mtreinish | clarkb, fungi, nibalizer, pleia2: quick patch to unblock puppet on health.o.o: https://review.openstack.org/#/c/308628/ should be good to go now | 16:20 |
| krotscheck | fungi: Urm... #308669, #308662, #308663 | 16:20 |
| *** nwkarsten has quit IRC | 16:20 | |
| docaedo | pabelanger pleia2 sounds good, let me know where we're calling in to :) Have used my own asterisk but not the openstack asterisk | 16:21 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade https://review.openstack.org/243239 | 16:21 |
| pleia2 | docaedo: info at https://wiki.openstack.org/wiki/Infrastructure/Conferencing | 16:21 |
| *** jistr has quit IRC | 16:21 | |
| *** roxanagh_ has quit IRC | 16:22 | |
| pleia2 | docaedo, pabelanger: say, bridge number 6002 | 16:22 |
| *** bpokorny has joined #openstack-infra | 16:22 | |
| amrith | sdague, a couple of google results indicate that rebuilding indexes on the database fixed the problem | 16:23 |
| docaedo | pleia2: thanks, bridge 6002 in a touch over an hour | 16:23 |
| *** madhu_ak has joined #openstack-infra | 16:23 | |
| fungi | krotscheck: what's the corresponding governance patch for 308669? | 16:24 |
| *** hdd has joined #openstack-infra | 16:24 | |
| *** flepied has quit IRC | 16:24 | |
| pleia2 | yay, new ubuntu lts :) https://lists.ubuntu.com/archives/ubuntu-announce/2016-April/000207.html | 16:24 |
| krotscheck | fungi: urrr.. I don't think that one requires a governance patch. | 16:24 |
| krotscheck | pleia2: YAY! | 16:24 |
| fungi | krotscheck: oh, nevermind. i skimmed the commit message | 16:25 |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Make main thread non-daemon https://review.openstack.org/308558 | 16:25 |
| *** lucasagomes is now known as lucas-dinner | 16:26 | |
| Shrews | mordred: that is amazing | 16:26 |
| fungi | pleia2: wow! i thought it wasn't due out for 5 more days | 16:26 |
| pabelanger | docaedo: pleia2: WFM | 16:26 |
| pleia2 | fungi: I thought about saying something when you said next week in the email yesterday, but then I forgot | 16:26 |
| amrith | anyone else in infra ... see gist https://gist.github.com/amrith/30cc5f426f06a722d690252deb4186bc. there are two queries. You'll notice that they differ in only one way, the second has a final expression "NOT Code-Review<=-2". The latter search unfortunately drops a lot of reviews which it should not; i.e. a bunch of reviews which have no -2's are being ommitted. a quick google search indicates that bad indexes may be | 16:27 |
| amrith | the problem. | 16:27 |
| pabelanger | pleia2: fungi: \o/ | 16:27 |
| pabelanger | wonder if rax has it yet, we can bring our xenial wheel mirror online :) | 16:27 |
| fungi | pleia2: yep, my dyslexia strikes again. https://wiki.ubuntu.com/XenialXerus/ReleaseSchedule i transposed the week number with the date there | 16:27 |
| fungi | thought it said april 26 | 16:28 |
| yottatsa | clarkb mordred speaking about spamhaus ipv6 dnsbl https://www.spamhaus.org/organization/statement/012/spamhaus-ipv6-blocklists-strategy-statement | 16:28 |
| prometheanfire | greghaynes: ianw: ya https://review.openstack.org/#/c/296626/ has my commit sitting in front of it, so https://review.openstack.org/#/c/299694 will need to merge first | 16:29 |
| *** ifarkas has quit IRC | 16:29 | |
| *** johnny has joined #openstack-infra | 16:30 | |
| yottatsa | and it really listed in sbl https://www.spamhaus.org/query/ip/2001%253A4800%253A7810%253A512%253A3bc3%253Ad7f6%253Aff04%253A8201 | 16:30 |
| greghaynes | prometheanfire: it's just waiting on my -1... | 16:30 |
| *** johnny is now known as Guest82423 | 16:31 | |
| prometheanfire | greghaynes: -1? | 16:31 |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Stop using a seperate retreiver thread https://review.openstack.org/308567 | 16:31 |
| greghaynes | prometheanfire: yes - https://review.openstack.org/#/c/299694/3/elements/dhcp-all-interfaces/package-installs.yaml | 16:31 |
| mtreinish | infra-root: ^^^ we should be good to restart the subunit gearman workers now | 16:31 |
| prometheanfire | greghaynes: ok, all the dependant commits will need rebasing then | 16:32 |
| *** jlanoux has quit IRC | 16:32 | |
| greghaynes | I think they do already | 16:32 |
| prometheanfire | ok, didn't want to ruin all those +w | 16:32 |
| mtreinish | well after puppet applies it on subunit-worker01.o.o and subunit-worker02.o.o | 16:32 |
| greghaynes | It shouldn't, the +2's stay so you just need a code to +w what already has the +2's it needs | 16:33 |
| greghaynes | Er, a core | 16:33 |
| *** mylu has quit IRC | 16:33 | |
| * greghaynes -> landing | 16:33 | |
| mordred | Shrews: I have a fun patch coming for you | 16:33 |
| prometheanfire | greghaynes: k | 16:33 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: gerrit trigger: Fix doc on topics. https://review.openstack.org/284244 | 16:35 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 16:36 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Added possibility to exclude project combinations https://review.openstack.org/175233 | 16:36 |
| prometheanfire | greghaynes: https://review.openstack.org/299694 removed the installtype: package | 16:36 |
| AJaeger | pabelanger: do you have time to check reviewday cron job again, please? The log file change should be active now | 16:36 |
| clarkb | amrith: just reading through that you have a redundant set of project clauses | 16:36 |
| amrith | clarkb | 16:37 |
| amrith | I have that on purpose | 16:37 |
| amrith | because I want to restrict (in foreach) to only the trove projects | 16:37 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Make the delorean-ci repository available when build overcloud images https://review.openstack.org/309092 | 16:37 |
| *** inc0 has quit IRC | 16:37 | |
| amrith | but some of the queries are for a subset | 16:37 |
| amrith | but ... | 16:37 |
| amrith | I found the problem | 16:37 |
| amrith | it was an error in the query | 16:37 |
| amrith | https://review.openstack.org/#/c/309091/ | 16:37 |
| pabelanger | AJaeger: sure in 15mins | 16:37 |
| amrith | the clause that gave trouble | 16:37 |
| clarkb | amrith: removing that fixes it | 16:37 |
| AJaeger | thanks, pabelanger | 16:37 |
| amrith | should have been NOT label:CodeReview<=-2 | 16:38 |
| *** baoli_ has joined #openstack-infra | 16:38 | |
| amrith | I missed the label: | 16:38 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 16:38 |
| pabelanger | mordred: q: what does No valid host was found error mean in nodepool? http://paste.openstack.org/show/495027/ | 16:38 |
| amrith | clarkb, removing what? | 16:38 |
| pabelanger | seeing that alot in ovh-gra1 | 16:38 |
| clarkb | amrith: if I remove the redundant clause I get the same results in both | 16:38 |
| amrith | that's right | 16:38 |
| clarkb | amrith: in any case I do not understand why you would have the redundant claause | 16:38 |
| amrith | that particular query in the dashboard | 16:38 |
| amrith | this came from a dashboard | 16:38 |
| amrith | take a look at the review I just linked to | 16:39 |
| amrith | you'll see the error I made | 16:39 |
| clarkb | ys I understand the issue | 16:39 |
| *** nadya has quit IRC | 16:39 | |
| clarkb | I am saying that you shouldn't need to restrict projects twice | 16:39 |
| openstackgerrit | Merged openstack-dev/hacking: Add support for PEP257 https://review.openstack.org/229686 | 16:39 |
| clarkb | in addition to the issue you fixed | 16:39 |
| amrith | clarkb, how do I get around it? | 16:39 |
| amrith | I must have a foreach | 16:39 |
| amrith | so I could have status:open there | 16:39 |
| clarkb | there is no foreach in the gits you linked? | 16:40 |
| amrith | sorry, please see https://review.openstack.org/#/c/309091/ | 16:40 |
| pabelanger | AJaeger: http://paste.openstack.org/show/495028/ | 16:40 |
| AJaeger | pabelanger: quick 15mins ;) Thanks | 16:40 |
| clarkb | ah I see | 16:40 |
| pabelanger | AJaeger: :) | 16:40 |
| amrith | I thought the issue was with the query and how gerrit-dash-creator did something | 16:40 |
| amrith | I presumed (incorrectly) | 16:40 |
| amrith | therefore I took just the query | 16:40 |
| pabelanger | AJaeger: I'm like scotty on the enterprise! | 16:40 |
| *** baoli has quit IRC | 16:40 | |
| *** Guest14509 has quit IRC | 16:40 | |
| pabelanger | AJaeger: guess we need a debug flag | 16:41 |
| amrith | In fact the error was in the queries ... why it didn't generate an error saying CodeReview<=-2 makes no sense, I know not | 16:41 |
| amrith | but ... | 16:41 |
| AJaeger | pabelanger: let me see what I can do with debug flag... | 16:41 |
| amrith | thanks AJaeger | 16:41 |
| amrith | clarkb, does the fix appear correct to you? | 16:42 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 16:42 |
| mordred | Shrews: ^^ | 16:42 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: support ftp publisher https://review.openstack.org/309095 | 16:42 |
| clarkb | amrith: ya Ithink you need the label there | 16:42 |
| clarkb | not sure why it isn't erroring on the other behavior but yay gerrir | 16:42 |
| clarkb | er gerrit | 16:42 |
| amrith | and oddly enough it only suppressed some reviews :) | 16:43 |
| amrith | grr | 16:43 |
| *** HeOS_ has joined #openstack-infra | 16:43 | |
| AJaeger | pabelanger: seems it cannot find gerrit-dash-creator command. | 16:43 |
| AJaeger | pabelanger: when you run it manually, did you run it as reviewday user with same arguments as the cronjob | 16:44 |
| pabelanger | AJaeger: Ya, see that now | 16:44 |
| pabelanger | AJaeger: it is likely a PATH issue | 16:44 |
| pabelanger | AJaeger: I did | 16:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 16:44 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: [Rally] Fix job for Manila project https://review.openstack.org/309096 | 16:44 |
| mordred | Shrews: (updated to make sure we deduct fip wait time from the total timeout) | 16:45 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for disable-strict-forbidden-file-verification https://review.openstack.org/240360 | 16:45 |
| pabelanger | AJaeger: I suspect crontab doesn't know about /usr/local/bin | 16:45 |
| pabelanger | AJaeger: and we need to update the PATH variable | 16:45 |
| *** schipiga has quit IRC | 16:45 | |
| *** ddieterly is now known as ddieterly[away] | 16:46 | |
| jeblair | clarkb, fungi: can you send me a bounce message? | 16:47 |
| *** inc0 has joined #openstack-infra | 16:47 | |
| AJaeger | pabelanger: let me prepare a patch | 16:47 |
| *** amitgandhinz has joined #openstack-infra | 16:47 | |
| clarkb | jeblair: ya just forward you what was sent? | 16:48 |
| *** baoli_ has quit IRC | 16:48 | |
| *** amitgandhinz has quit IRC | 16:48 | |
| *** baoli has joined #openstack-infra | 16:48 | |
| fungi | jeblair: i've been deleting the ones i receive but can bounce you the next one i get | 16:48 |
| *** ayoung has quit IRC | 16:48 | |
| pabelanger | AJaeger: we can use the environment param for cron in puppet | 16:48 |
| clarkb | I just fowarded one of the ones I got | 16:48 |
| pabelanger | AJaeger: just looking at syntax | 16:49 |
| jeblair | clarkb, fungi: yeah, whatever the backscatter message you get is | 16:49 |
| *** amitgandhinz has joined #openstack-infra | 16:49 | |
| clarkb | jeblair: mordred looks like other hosts are doing it too, not just graphite | 16:49 |
| jeblair | clarkb: perfect, thanks | 16:49 |
| fungi | oh, actually i may have some in my cronspam dumping ground. i'll check | 16:49 |
| *** alexpilotti has joined #openstack-infra | 16:49 | |
| *** arxcruz has joined #openstack-infra | 16:49 | |
| clarkb | jeblair: wiki, logstash, vexxhost mirror, stakckalytics | 16:49 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/puppet-reviewday: Add /usr/local/bin to path for cron job https://review.openstack.org/309100 | 16:50 |
| pabelanger | AJaeger: should be able to do environment => ['TMPDIR=/var/tmp', 'TMP=/var/tmp'], | 16:50 |
| Shrews | mordred: fyi, there are comments for you to address on https://review.openstack.org/308413 | 16:50 |
| Shrews | mordred: not from me, this time | 16:50 |
| mordred | Shrews: woot! | 16:50 |
| AJaeger | pabelanger: 309100 does it differently but I can update | 16:50 |
| jeblair | clarkb: i have removed graphite from the sblcss | 16:50 |
| pabelanger | AJaeger: let me check | 16:50 |
| *** ddieterly[away] is now known as ddieterly | 16:50 | |
| jeblair | clarkb: can you send all of those to me? | 16:51 |
| pabelanger | AJaeger: okay, let me manually test that | 16:51 |
| clarkb | jeblair: yes | 16:51 |
| fungi | clarkb: jeblair: those are the same ones i'm finding in my cronspam inbox, yeah. i'll see if i spot any for other hosts | 16:51 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: slack notifications on repeated failure https://review.openstack.org/290545 | 16:52 |
| *** apoorvad has joined #openstack-infra | 16:52 | |
| *** Nikolay_St has quit IRC | 16:52 | |
| AJaeger | pabelanger: so, alternative should be environment => 'PATH=/bin:/usr/bin:/usr/local/bin', - I'm no puppet expert, so need your advise on what's better | 16:53 |
| pabelanger | AJaeger: okay, testing in 8mins | 16:53 |
| AJaeger | pabelanger: thanks! | 16:53 |
| pabelanger | AJaeger: either should work | 16:53 |
| *** roxanag__ has quit IRC | 16:53 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: multijob: add support for "ALWAYS" continuation condition https://review.openstack.org/303822 | 16:53 |
| pabelanger | AJaeger: question, should it be \$PATH? | 16:53 |
| clarkb | jeblair: there is a different one for nibalizer yolanda and my self complaining about root@jeblair-nodepool | 16:54 |
| sdague | mordred: you are going to need to explain http://paste.openstack.org/show/495021/ context | 16:54 |
| *** sambetts is now known as sambetts|afk | 16:54 | |
| clarkb | jeblair: I am guessing that is from when you made the new host off the nodepool snapshot | 16:54 |
| *** HeOS_ has quit IRC | 16:54 | |
| jeblair | clarkb: yep; fungi is that host still up (from the second ressurection?) | 16:55 |
| AJaeger | pabelanger: let me use environment - we do this elsewhere as well... | 16:55 |
| mordred | sdague: that's a snippet from a nova server dict, and from neutron net-list on the same cloud (I was tracking down another thing and it looked funny to me so I thought I'd capture it for discussion) | 16:55 |
| *** ihrachys has quit IRC | 16:55 | |
| *** Goneri has quit IRC | 16:55 | |
| pabelanger | AJaeger: WFM | 16:55 |
| *** baoli has quit IRC | 16:55 | |
| mordred | sdague: essentially, the nova addresses dict is showing a list of two addresses from the openstackci-network1 network | 16:55 |
| *** alexpilotti has quit IRC | 16:55 | |
| sdague | mordred: I would not entirely be surprised if nova proxying neutron information about multiple networks is wrong | 16:55 |
| mordred | sdague: but the floating ip actually did not come from that network | 16:56 |
| mordred | sdague: ok. cool. I was mostly wondering if there was an interface intention there that I should wrap my head around | 16:56 |
| mordred | sdague: or if I should file a bug or something | 16:56 |
| sdague | filing a bug would be good | 16:56 |
| mordred | ossum | 16:56 |
| *** psachin has quit IRC | 16:56 | |
| mordred | sdague: also - related to that and your thread about killing the proxy things | 16:56 |
| *** fedexo has quit IRC | 16:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/puppet-reviewday: Add /usr/local/bin to path for cron job https://review.openstack.org/309100 | 16:57 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Fix comment on requirements job" https://review.openstack.org/309018 | 16:57 |
| AJaeger | pabelanger: updated ^ | 16:57 |
| mordred | sdague: are you planning on just killing proxy apis? or also killing the proxied data inside of the server dict (like that addresse dict) | 16:57 |
| AJaeger | bbl | 16:57 |
| sdague | mordred: honestly, just the pure proxy apis | 16:57 |
| mordred | awesome | 16:57 |
| mordred | that's what would make me happy | 16:57 |
| sdague | yeh | 16:57 |
| mordred | the data in the server dict is actually invaluable | 16:57 |
| pabelanger | AJaeger: okay, updated local cron too | 16:57 |
| sdague | mordred: agreed | 16:57 |
| mordred | \o/ | 16:57 |
| pabelanger | AJaeger: 2 mins | 16:57 |
| sdague | when nova needs to provide a composite view of resources, that's fine | 16:58 |
| *** doug-fish has joined #openstack-infra | 16:58 | |
| sdague | I just want to get out of the business of middleman for interfaces that you really should be going to the main interface for | 16:58 |
| clarkb | fungi: I am not seeing rax-ord git fails in logstash (assuming I clicked on the right bug search link) | 16:58 |
| *** Na3iL has quit IRC | 16:58 | |
| *** ociuhandu has quit IRC | 16:59 | |
| *** flepied has joined #openstack-infra | 16:59 | |
| sdague | nova servers not telling you about their networks and interfaces would just be crazy :) | 16:59 |
| *** thiagop has quit IRC | 16:59 | |
| *** dalgaaf has quit IRC | 17:00 | |
| *** dalgaaf has joined #openstack-infra | 17:00 | |
| *** claudiub has quit IRC | 17:00 | |
| *** tosky_ has joined #openstack-infra | 17:01 | |
| *** yonglihe has quit IRC | 17:01 | |
| *** sputnik13 has joined #openstack-infra | 17:01 | |
| mordred | sdague: indeed... but crazier things have happened before :) | 17:01 |
| mordred | sdague: https://bugs.launchpad.net/nova/+bug/1573142 | 17:01 |
| openstack | Launchpad bug 1573142 in OpenStack Compute (nova) "proxied neutron network information is incorrect" [Undecided,New] | 17:01 |
| *** mahatic_ has quit IRC | 17:01 | |
| *** tosky has quit IRC | 17:01 | |
| mordred | sdague: btw - this is not urgent or anyting - I mostly just happened upon it | 17:01 |
| *** nwkarsten has joined #openstack-infra | 17:02 | |
| *** nwkarsten has quit IRC | 17:02 | |
| sdague | mordred: any chance you have a reproduce for a devstack env on that? | 17:02 |
| *** trown|lunch is now known as trown | 17:02 | |
| *** doug-fis_ has quit IRC | 17:02 | |
| *** ddieterly has quit IRC | 17:02 | |
| *** abregman|pto has quit IRC | 17:02 | |
| *** pradk has quit IRC | 17:02 | |
| *** yarkot has quit IRC | 17:02 | |
| *** kevinbenton has quit IRC | 17:02 | |
| sdague | it would be handy to make it easier to chase down | 17:02 |
| *** nwkarsten has joined #openstack-infra | 17:02 | |
| mordred | sdague: I don't - but it should be super easy - make a vm with a floating ip, then grab the /servers/{id} for it - and also do a neutron net-list | 17:02 |
| *** mahatic has joined #openstack-infra | 17:02 | |
| mordred | lemme say that on the bug | 17:03 |
| *** fungi has quit IRC | 17:03 | |
| *** msuriar has quit IRC | 17:03 | |
| *** kevinshort has quit IRC | 17:03 | |
| *** jgriffith has quit IRC | 17:03 | |
| *** serverascode has quit IRC | 17:03 | |
| *** yonglihe has joined #openstack-infra | 17:03 | |
| *** sridhar_ram has joined #openstack-infra | 17:03 | |
| sdague | ok | 17:03 |
| *** dahoo has joined #openstack-infra | 17:03 | |
| *** kevinshort has joined #openstack-infra | 17:03 | |
| *** jgriffith has joined #openstack-infra | 17:03 | |
| *** rossella_s has quit IRC | 17:03 | |
| *** fungi has joined #openstack-infra | 17:04 | |
| *** lindsayk_ has quit IRC | 17:04 | |
| *** sc68cal has quit IRC | 17:04 | |
| fungi | jeblair: oh, yeah i mentioned an hour or so later that i was done with it but didn't know if i should delete it myself or if you wanted anything from it too | 17:04 |
| *** jgriffith is now known as Guest3894 | 17:04 | |
| fungi | clarkb: i've been checking for them too, so far no hits in ord | 17:04 |
| *** lindsayk_ has joined #openstack-infra | 17:04 | |
| *** cbader has quit IRC | 17:04 | |
| *** rossella_s has joined #openstack-infra | 17:04 | |
| openstackgerrit | Merged openstack-infra/grafyaml: Enable no fill in seriesOverrides https://review.openstack.org/306869 | 17:04 |
| *** msuriar has joined #openstack-infra | 17:04 | |
| *** cbader has joined #openstack-infra | 17:04 | |
| *** bookwar has quit IRC | 17:04 | |
| *** sc68cal has joined #openstack-infra | 17:04 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 17:05 |
| *** derekh has quit IRC | 17:05 | |
| *** kevinbenton has joined #openstack-infra | 17:05 | |
| *** arif-ali has quit IRC | 17:05 | |
| *** gongysh has quit IRC | 17:05 | |
| *** yarkot has joined #openstack-infra | 17:05 | |
| fungi | clarkb: if this continues, i'll push a change later to go back to our full quota there | 17:06 |
| *** serverascode has joined #openstack-infra | 17:06 | |
| *** sdake_ has joined #openstack-infra | 17:06 | |
| *** stevemar has quit IRC | 17:06 | |
| *** mnencia has quit IRC | 17:06 | |
| fungi | clarkb: most recent hit for the patterns associated with that bug were in dfw once late yesterday | 17:07 |
| *** sdake has quit IRC | 17:07 | |
| *** sshnaidm has quit IRC | 17:07 | |
| *** Kiall has quit IRC | 17:07 | |
| *** gabriel-bezerra has quit IRC | 17:07 | |
| fungi | and that's the only one in 6 days | 17:07 |
| *** arif-ali has joined #openstack-infra | 17:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add public helper method for cleaning floating ips https://review.openstack.org/308413 | 17:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 17:07 |
| fungi | clarkb: but not sure what the state of elasticsearch data is right now, so wasn't putting a lot of stock in it yet | 17:08 |
| *** Yarboa is now known as Yarboa_Zzzzz | 17:08 | |
| *** rfolco has quit IRC | 17:08 | |
| *** stevemar has joined #openstack-infra | 17:08 | |
| clarkb | fungi: maybe you can confirm that git is looking happy and we can use all of rax-ord again? | 17:08 |
| clarkb | also what was the deal with ovh earlier today? I thought we had already reenabled them? | 17:08 |
| clarkb | just a recurrence I guess? | 17:08 |
| *** gabriel-bezerra has joined #openstack-infra | 17:08 | |
| openstackgerrit | Merged openstack-infra/grafyaml: Add support for time range https://review.openstack.org/308539 | 17:08 |
| *** dalgaaf has quit IRC | 17:08 | |
| *** niska has quit IRC | 17:08 | |
| *** cschwede has quit IRC | 17:08 | |
| *** njohnston_afk has quit IRC | 17:08 | |
| *** ekarlso has quit IRC | 17:08 | |
| *** rfolco has joined #openstack-infra | 17:08 | |
| *** mnencia_ has joined #openstack-infra | 17:09 | |
| *** sdake has joined #openstack-infra | 17:09 | |
| *** cschwede has joined #openstack-infra | 17:09 | |
| *** mnencia_ is now known as mnencia | 17:09 | |
| *** ramishra has quit IRC | 17:09 | |
| AJaeger | mordred: could you review yolanda's change to update the shade jobs, please? https://review.openstack.org/#/c/305122 | 17:09 |
| *** bookwar has joined #openstack-infra | 17:09 | |
| *** niska has joined #openstack-infra | 17:09 | |
| *** rkukura_ has joined #openstack-infra | 17:09 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/elastic-recheck: Remove query about yum missing on ubuntu https://review.openstack.org/309114 | 17:10 |
| *** Kiall has joined #openstack-infra | 17:10 | |
| *** ramishra has joined #openstack-infra | 17:10 | |
| clarkb | fungi: the data from yesterday forward should be good | 17:10 |
| *** sridhar_ram1 has joined #openstack-infra | 17:10 | |
| clarkb | then there is a gap with the ~3 days before yesterday | 17:10 |
| *** sdake_ has quit IRC | 17:11 | |
| fungi | and nodepool shows we're definitely running jobs in ord | 17:11 |
| mordred | AJaeger: lgtm - maybe lets check wih Shrews too | 17:11 |
| *** pcm_ has joined #openstack-infra | 17:11 | |
| AJaeger | Shrews: please review https://review.openstack.org/#/c/305122 as well.. | 17:11 |
| *** zz_ja has joined #openstack-infra | 17:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Don't check for proposed branches in propose_update https://review.openstack.org/309045 | 17:12 |
| *** dalgaaf has joined #openstack-infra | 17:12 | |
| *** fernnest_ has joined #openstack-infra | 17:12 | |
| *** sshnaidm has joined #openstack-infra | 17:12 | |
| *** armax_ has joined #openstack-infra | 17:13 | |
| Shrews | mordred: does that style of plugin enablement mean the latest version from git is used? | 17:13 |
| Shrews | mordred: b/c if so, couldn't that be a problem with both magnum AND designate being used in our stable/kilo keystonev2 job? | 17:14 |
| *** zhiyan_ has joined #openstack-infra | 17:14 | |
| *** abregman|pto has joined #openstack-infra | 17:14 | |
| *** tristanC_ has joined #openstack-infra | 17:14 | |
| pabelanger | AJaeger: okay, check reviewday. I think it looks right | 17:14 |
| clarkb | Shrews: devstack-gate will checkout the appropriate ref for each job. So it will be from git but if testing stable/kilo you should get latest commit from kilo and so on | 17:14 |
| *** sc68cal_ has joined #openstack-infra | 17:14 | |
| *** njohnston has joined #openstack-infra | 17:14 | |
| Shrews | clarkb: ah, excellent. thanks | 17:15 |
| *** vdrok_ has joined #openstack-infra | 17:15 | |
| *** pradk has joined #openstack-infra | 17:15 | |
| *** inc0 has quit IRC | 17:15 | |
| *** nelsnels_ has joined #openstack-infra | 17:15 | |
| clarkb | mordred: re nodepool did sdake's IP thing ever get sorted? | 17:15 |
| *** pleia2_ has joined #openstack-infra | 17:15 | |
| *** yamamoto has quit IRC | 17:15 | |
| *** Vivek has joined #openstack-infra | 17:15 | |
| *** inc0 has joined #openstack-infra | 17:15 | |
| clarkb | there is far too much nodepool stuff in flux right now ; | 17:15 |
| sdake | clarkb we worked around it | 17:15 |
| clarkb | sdake: thanks, I assume that means the issue generally persists | 17:16 |
| *** Vivek is now known as Guest54448 | 17:16 | |
| *** shardy has quit IRC | 17:16 | |
| sdake | clarkb: https://review.openstack.org/#/c/308341/ | 17:16 |
| sdake | right same issue | 17:16 |
| *** arif-ali has quit IRC | 17:16 | |
| *** abregman|pto has quit IRC | 17:17 | |
| clarkb | mordred: maybe we can do a state of the union today before we all get on airplanes? | 17:17 |
| *** mrodden_ has joined #openstack-infra | 17:17 | |
| *** jlk` has joined #openstack-infra | 17:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Block stable/feature branch for new project imports https://review.openstack.org/309044 | 17:18 |
| *** jmccrory- has joined #openstack-infra | 17:18 | |
| *** electrofelix1 has joined #openstack-infra | 17:18 | |
| *** electrofelix has quit IRC | 17:18 | |
| vikram | Can someone plz approve this governance patch "https://review.openstack.org/#/c/268727/" | 17:18 |
| *** uberjay_ has joined #openstack-infra | 17:18 | |
| *** Ng_ has joined #openstack-infra | 17:18 | |
| *** aorourke_ has joined #openstack-infra | 17:19 | |
| *** sc68cal has quit IRC | 17:19 | |
| *** rossella_s has quit IRC | 17:19 | |
| *** lindsayk_ has quit IRC | 17:19 | |
| *** sridhar_ram has quit IRC | 17:19 | |
| *** armax has quit IRC | 17:19 | |
| *** yamahata has quit IRC | 17:19 | |
| *** kushal has quit IRC | 17:19 | |
| *** dizquierdo has quit IRC | 17:19 | |
| *** Yarboa_Zzzzz has quit IRC | 17:19 | |
| *** rkukura has quit IRC | 17:19 | |
| *** r-mibu has quit IRC | 17:19 | |
| *** Adri2000 has quit IRC | 17:19 | |
| *** pfallenop has quit IRC | 17:19 | |
| *** nt has quit IRC | 17:19 | |
| *** fernnest has quit IRC | 17:19 | |
| *** amit213 has quit IRC | 17:19 | |
| *** nelsnelson has quit IRC | 17:19 | |
| *** jmccrory has quit IRC | 17:19 | |
| *** pleia2 has quit IRC | 17:19 | |
| *** tchaypo has quit IRC | 17:19 | |
| *** Guest32495 has quit IRC | 17:19 | |
| *** zz_zz_ja has quit IRC | 17:19 | |
| *** jlk has quit IRC | 17:19 | |
| *** uberjay has quit IRC | 17:19 | |
| *** pc_m has quit IRC | 17:19 | |
| *** davideagnello has quit IRC | 17:19 | |
| *** mrodden has quit IRC | 17:19 | |
| *** dmsimard has quit IRC | 17:19 | |
| *** sweston has quit IRC | 17:19 | |
| *** Ng has quit IRC | 17:19 | |
| *** jasondotstar has quit IRC | 17:19 | |
| *** a2hill has quit IRC | 17:19 | |
| *** tristanC has quit IRC | 17:19 | |
| *** lbragstad has quit IRC | 17:19 | |
| *** vdrok has quit IRC | 17:19 | |
| *** rguillebert has quit IRC | 17:19 | |
| *** etoews has quit IRC | 17:19 | |
| *** zhiyan has quit IRC | 17:19 | |
| *** aorourke__ has quit IRC | 17:19 | |
| *** armax_ is now known as armax | 17:19 | |
| *** electrofelix1 is now known as help | 17:19 | |
| *** mrodden_ is now known as mrodden | 17:19 | |
| *** rkukura_ is now known as rkukura | 17:19 | |
| *** yamahata_ has joined #openstack-infra | 17:19 | |
| *** jmccrory- is now known as jmccrory | 17:19 | |
| *** dmsimard has joined #openstack-infra | 17:19 | |
| *** help is now known as electrofelix | 17:19 | |
| *** ptoohill has joined #openstack-infra | 17:20 | |
| *** tchaypo has joined #openstack-infra | 17:20 | |
| *** rossella_s has joined #openstack-infra | 17:20 | |
| *** vdrok_ is now known as vdrok | 17:20 | |
| *** pfallenop has joined #openstack-infra | 17:20 | |
| *** ekarlso has joined #openstack-infra | 17:20 | |
| *** pleia2_ is now known as pleia2 | 17:20 | |
| *** sweston has joined #openstack-infra | 17:21 | |
| *** weshay is now known as weshay_food | 17:21 | |
| *** Adri2000 has joined #openstack-infra | 17:21 | |
| *** lbragstad has joined #openstack-infra | 17:22 | |
| *** alexpilotti has joined #openstack-infra | 17:22 | |
| *** amit213 has joined #openstack-infra | 17:22 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add Designate recordsets support https://review.openstack.org/306502 | 17:22 |
| *** daemontool has quit IRC | 17:22 | |
| pabelanger | vikram: you'll have to wait for the TC to finish the rollcall | 17:22 |
| mordred | clarkb: yes - although I'm not getting on a plane today :) | 17:23 |
| *** alexpilotti has quit IRC | 17:23 | |
| vikram | infra_core: Can someone please help modifying the ACL for the newly created project via https://review.openstack.org/#/c/268726/ | 17:23 |
| mordred | clarkb: howeer, yes, I think that's a good idea | 17:23 |
| mordred | clarkb: have you looked at the most recent crazy patch btw? | 17:23 |
| *** etoews has joined #openstack-infra | 17:23 | |
| clarkb | mordred: no I am just trying to figure out what the current state of things is | 17:23 |
| mordred | k | 17:23 |
| *** zhiyan_ is now known as zhiyan | 17:23 | |
| *** sc68cal_ has quit IRC | 17:23 | |
| AJaeger | pabelanger: woot! Yeah! | 17:23 |
| clarkb | seems like the private/public ip behavior is still not addressed and we leak floating IPs due to the port not showing up on the ip after you attach it to the port? | 17:23 |
| *** lindsayk_ has joined #openstack-infra | 17:23 | |
| AJaeger | pabelanger: thanks! | 17:24 |
| vikram | pabelanger: currently, it has a rollcall-vote by Thierry Carrez | 17:24 |
| *** sc68cal has joined #openstack-infra | 17:24 | |
| AJaeger | any other infra-root to review https://review.openstack.org/309100 for me, please? | 17:24 |
| mordred | clarkb: yes. or, we're still leaking fips but we think we have found a way to detect the leak early and abort | 17:24 |
| *** jasondotstar has joined #openstack-infra | 17:24 | |
| *** abregman has joined #openstack-infra | 17:24 | |
| AJaeger | vikram: governance is approved by ttx - and only by him (ttx=Thierry) | 17:25 |
| waynr | electrofelix: i'll look at those patches today. as for the 2.0 work, we went with a separate branch originally so 1.x and 2.x reviews could happen in tandem but as it turns out we are waiting for a final 1.x release anyway...i'll just retarget against master eventually as long as after the final release we only take 1.x branch patches on a nonmaster 1.x-specific branch | 17:25 |
| mordred | clarkb: https://review.openstack.org/#/c/308413 needs to be approved so that we can get the nodepool fip cleanup in | 17:25 |
| AJaeger | vikram: ttx will approve after waiting for a week, no worries, this is pure housekeeping now | 17:25 |
| *** kushal has joined #openstack-infra | 17:25 | |
| mordred | clarkb: I need to put one more catch/delete into the latest patch to detect the lack of port_id | 17:25 |
| mordred | clarkb: and then add tests | 17:25 |
| *** ayoung has joined #openstack-infra | 17:26 | |
| vikram | AJaeger: ok.. got it .. thanks | 17:26 |
| *** nt has joined #openstack-infra | 17:26 | |
| *** MarkAtwood has joined #openstack-infra | 17:26 | |
| *** davideagnello has joined #openstack-infra | 17:26 | |
| *** psilvad has quit IRC | 17:26 | |
| *** jordanP has quit IRC | 17:27 | |
| pabelanger | sdake: you still on track to release kolla today? | 17:27 |
| *** alex_xu has quit IRC | 17:27 | |
| sdake | pabelanger yes | 17:27 |
| sdake | both 1.1.0 and 2.0.0 | 17:27 |
| *** Na3iL has joined #openstack-infra | 17:27 | |
| AJaeger | thanks, fungi! | 17:28 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add user/password command line argument https://review.openstack.org/305858 | 17:29 |
| *** fawadkhaliq has joined #openstack-infra | 17:29 | |
| clarkb | mordred: are the fips that don't have the correct port functional? or do they also fail to work | 17:30 |
| openstackgerrit | Merged openstack-infra/system-config: Remove proposed/ acls https://review.openstack.org/309049 | 17:30 |
| *** rguillebert has joined #openstack-infra | 17:30 | |
| mordred | clarkb: althugh I have tested it against osic and it does work (I have not run it enough times to see it leak) | 17:30 |
| mordred | clarkb: I have not been able to capture that state yet | 17:30 |
| pabelanger | sdake: great, please let me know when you've finished and re-review 301320. Thanks again | 17:30 |
| *** dtantsur is now known as dtantsur|afk | 17:30 | |
| *** kushal has quit IRC | 17:30 | |
| sdake | will do | 17:30 |
| sdake | we are trgeting 5pm pst | 17:31 |
| mordred | clarkb: the one thing I have been able to capture is the transition from DOWN to ACTIVE as normally occuring in all cases, and the leaked fips having no port_id | 17:31 |
| *** salv-orlando has joined #openstack-infra | 17:31 | |
| pabelanger | sdake: wfm | 17:31 |
| *** tqtran has joined #openstack-infra | 17:31 | |
| mordred | clarkb: leaked fips returning with no port_id is conjecture | 17:31 |
| *** alex_xu has joined #openstack-infra | 17:31 | |
| pabelanger | clarkb: ianw: looks like we should be able to finish our devstack-centos7 migration later tonight | 17:31 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 17:32 |
| *** maestro has joined #openstack-infra | 17:32 | |
| *** maestro has left #openstack-infra | 17:32 | |
| docaedo | pabelanger pleia2 - I'll be a minute late, dial in number for pbx is busy for me so will try jitsi | 17:32 |
| *** maestro has joined #openstack-infra | 17:32 | |
| fungi | vikram: i have added armax as the initial member of the neutron-dynamic-routing-core group in gerrit since it's proposed for inclusion in neutron. he can redelegate it as needed | 17:32 |
| pabelanger | docaedo: np, dialing in now | 17:32 |
| armax | fungi: ack | 17:32 |
| pleia2 | docaedo: it's busy for me too | 17:33 |
| mordred | clarkb: but with the new code, if we do keep leaking and see that tey have no port_id when leaked, we'll at least know they _had_ a port id at at least somepoint in their past | 17:33 |
| vikram | fungi: thanks | 17:33 |
| pleia2 | I don't know what that means :) | 17:33 |
| *** dizquierdo has joined #openstack-infra | 17:33 | |
| pabelanger | pleia2: we might be out for credits | 17:33 |
| docaedo | pleia2: ah well glad I have a little company there at least | 17:33 |
| *** jed56 has quit IRC | 17:33 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable magnum plugin on shade and use our atomic generated images https://review.openstack.org/305122 | 17:34 |
| maestro | Hi all.. I have cloned Disk Image builder in my devstack environment and started to prepare ubuntu image by "disk-image-create -a amd64 -o ubuntu-amd64 vm ubuntu" while doing getting error as "+ /tmp/image.gu56sfk7/hooks/bin/cache-url https://cloud-images.ubuntu.com/trusty/current/SHA256SUMS /home/pandy/.cache/image-create/SHA256SUMS.ubuntu.trusty.amd64 | 17:34 |
| maestro | * Hostname was NOT found in DNS cache | 17:34 |
| maestro | % Total % Received % Xferd Average Speed Time Time Time Current | 17:34 |
| maestro | Dload Upload Total Spent Left Speed | 17:34 |
| maestro | 0 0 0 0 0 0 0 0 --:--:-- 0:00:19 --:--:-- 0* Could not resolve host: cloud-images.ubuntu.com | 17:34 |
| maestro | * Closing connection 0 | 17:34 |
| maestro | curl: (6) Could not resolve host: cloud-images.ubuntu.com | 17:34 |
| maestro | Unmount /tmp/image.gu56sfk7/mnt/tmp/ccache | 17:34 |
| maestro | " | 17:34 |
| armax | vikram: I had a first set: https://review.openstack.org/#/admin/groups/1366,members | 17:34 |
| *** r-mibu has joined #openstack-infra | 17:34 | |
| *** salv-orlando has quit IRC | 17:34 | |
| armax | vikram: please refresh this page: http://docs.openstack.org/developer/neutron/policies/neutron-teams.html#neutron-teams | 17:34 |
| fungi | maestro: please use a paste site like http://paste.openstack.org/ in the future | 17:34 |
| *** salv-orlando has joined #openstack-infra | 17:34 | |
| *** jlk` is now known as jlk | 17:35 | |
| electrofelix | waynr: yeah, I think that's the best approach. I'm going to continue working on review stuff tomorrow, and I'll probably do a pass on Sat to tidy up any patches that have a -1 on them for minor tweaks to see if we can't close out on most things. | 17:35 |
| fungi | maestro: cloud-images.ubuntu.com resolves in dns for me | 17:35 |
| maestro | sure, getting error while preparing ubuntu image via disk image builder http://paste.openstack.org/show/495032/ | 17:35 |
| vikram | armax: what I should do? | 17:36 |
| pabelanger | docaedo: pleia2: restarting asterisk now | 17:36 |
| *** maestro has left #openstack-infra | 17:36 | |
| clarkb | mordred: commented on https://review.openstack.org/#/c/309060/4 (note it is previous patchset, you keep beating my comments to gerrit with new patchsets) | 17:36 |
| fungi | maestro: are you able to resolve any dns names from that machine? i think your dns resolution is broken | 17:36 |
| pleia2 | pabelanger: thanks | 17:36 |
| *** vikram has left #openstack-infra | 17:37 | |
| pabelanger | docaedo: pleia2: okay, better | 17:37 |
| *** vikram has joined #openstack-infra | 17:37 | |
| *** kurtmartin has joined #openstack-infra | 17:37 | |
| *** tpsilva has quit IRC | 17:37 | |
| pabelanger | possible deadlock on asterisk | 17:37 |
| *** ybathia has joined #openstack-infra | 17:37 | |
| pabelanger | we'll need to enable debug mode to see | 17:37 |
| *** kurtmartin has quit IRC | 17:37 | |
| *** dizquierdo has quit IRC | 17:38 | |
| mordred | clarkb: I do that. sorry :) | 17:38 |
| waynr | electrofelix: cool | 17:39 |
| pabelanger | pleia2: docaedo: http://docs.openstack.org/infra/publications/overview/#(1) | 17:39 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Tidy up True/False and use better exceptions https://review.openstack.org/245447 | 17:39 |
| *** vikram has quit IRC | 17:40 | |
| Shrews | clarkb: i let mordred get through at least 5 patchsets before i even try to comment :) | 17:40 |
| mordred | clarkb: the second call for attach is because the floating ip create might have used nova. the attach wait skips the actual attach call if it's not needed - but that code is what gets the updated server dict (and waits for nova to indicate that the fip has attached- the new wait in create only waits to see that neutron is now satisfied that this ip is happy) | 17:41 |
| mordred | clarkb: to be fair, the flow here could certainly be refactored - but I'd rather not do that surgery at the moment | 17:41 |
| clarkb | mordred: maybe we can at least point that out then? That seems desrving of a comment becuase the flow isn't really intuitive | 17:42 |
| *** vikram has joined #openstack-infra | 17:42 | |
| mordred | totally | 17:42 |
| mordred | I agree | 17:43 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow using lockfile per jenkins master https://review.openstack.org/293631 | 17:43 |
| electrofelix | yolanda: I've restored your lockfile work and combined it with a change to ensure unlocking only occurs when the cache object is finally deleted during a run. I've yet to review use of pylockfile as a cross platform solution though. | 17:46 |
| *** mpaolino has quit IRC | 17:46 | |
| clarkb | electrofelix: I just left a comment on it, I am confused about how a per master lockfile helps | 17:46 |
| clarkb | I think the lock needs to be per cache | 17:46 |
| vikram | armax: will refresh it | 17:46 |
| electrofelix | clarkb: the cache is per master | 17:46 |
| clarkb | it is? | 17:46 |
| *** ayoung has quit IRC | 17:47 | |
| *** flepied has quit IRC | 17:47 | |
| electrofelix | yes, uses the master url as the cache file name | 17:47 |
| clarkb | electrofelix: iirc only the what is in master foo part of the cache is per master | 17:47 |
| clarkb | but separately there is the listing of all the jobs built locally right? | 17:47 |
| *** ayoung has joined #openstack-infra | 17:47 | |
| *** Sukhdev has joined #openstack-infra | 17:47 | |
| clarkb | so two runs could trample each other on the build side? maybe I am mistaken | 17:47 |
| electrofelix | if you're using updating the files directly on the disk, and point two runs to the same path, yes | 17:48 |
| clarkb | ya I think that is what we are trying to prevent | 17:49 |
| AJaeger | rossella_s: the neutron dashboard is now updated every 30 mins on http://status.openstack.org//reviews/ | 17:49 |
| *** Goneri has joined #openstack-infra | 17:49 | |
| electrofelix | clarkb: slightly different issues, but still probably a bad idea to allow two runs on the same machine, targeting the same jenkins master via the API and using the same cache file without locking. | 17:49 |
| clarkb | electrofelix: the idea behind the lock was to prevent two runs on the same machine | 17:50 |
| clarkb | regardless of master | 17:50 |
| clarkb | (I still think not using a lock and instead juts mv'ing the cache at the end would be fine | 17:51 |
| electrofelix | two runs on the same machine is not necessarily invalid, since it is perfectly fine to target different masters simultaneously. | 17:51 |
| electrofelix | ensuring a single run regardless probably requires a global lockfile | 17:52 |
| clarkb | electrofelix: correct, which is why I think the simple just mv the cache idea is good enough | 17:52 |
| clarkb | electrofelix: basically I agree with you on what you are trying to do, I disagree on the implementation | 17:52 |
| openstackgerrit | Kiall Mac Innes proposed openstack/requirements: Add openstack/designate-tempest-plugin to projects list https://review.openstack.org/309127 | 17:52 |
| clarkb | electrofelix: If we are going to go through the trouble of using a lock that lock should be global IMO | 17:52 |
| clarkb | because the issue for what you are trying to fix can just be handled iwth smarter file writing aiui | 17:53 |
| electrofelix | when prevents two runs targetting different masters, that would not clash | 17:53 |
| clarkb | and is much simpler than a lockfile | 17:53 |
| clarkb | and has the added benefit of not corrupting the cache on unfortunate shutdown | 17:54 |
| *** tosky_ has quit IRC | 17:54 | |
| openstackgerrit | Kiall Mac Innes proposed openstack/requirements: Add openstack/designate-tempest-plugin to projects list https://review.openstack.org/309127 | 17:55 |
| electrofelix | I'm not sure that it covers all use cases, but yes moving would make the write atomic and less prone to issues. | 17:55 |
| *** ybathia has quit IRC | 17:55 | |
| *** ybathia has joined #openstack-infra | 17:55 | |
| electrofelix | I'll think on the different use cases, and add that to the review first. already marked it as a WIP in the mean time. | 17:55 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 17:55 | |
| clarkb | electrofelix: in the case of two or more runs against the same master using mv and not a lockfile they will fight each other over the jenkins api but that is jenkins' problem and I believe it does the correct thing. Then when each one finishes they will mv their files over and the last one to complete wins | 17:56 |
| *** SumitNaiksatam has joined #openstack-infra | 17:56 | |
| clarkb | which is a slightly different behavior than last one to start wins | 17:56 |
| *** electrofelix has quit IRC | 17:57 | |
| clarkb | and in really unfortunate cases you will have them overwrite each other in potentially unfortunate ways | 17:57 |
| openstackgerrit | melanie witt proposed openstack-infra/project-config: Add a new devstack plugin based src job for ceph https://review.openstack.org/308686 | 17:57 |
| clarkb | but the issue we have been having is the shtudown case more so than the run multiples case | 17:57 |
| AJaeger | team, project-config change https://review.openstack.org/#/c/283637/ by hashar has not seen any review. It's titled "Pass ZUUL_CACHE_NO_HARDLINKS to prevent hardlinking". Could one of the zuul experts have a look at it, please? | 17:57 |
| *** baoli has joined #openstack-infra | 17:58 | |
| clarkb | AJaeger: I thought we wanted hardlinks... | 17:58 |
| clarkb | huh I misread. Zuul currently does not hardlink | 17:59 |
| clarkb | so this is preserving the old zuul behavior once zuul updates | 17:59 |
| AJaeger | clarkb: the other patch hasn't merged either - so we could wait some more as well... | 18:01 |
| *** vikram has quit IRC | 18:01 | |
| clarkb | I wonder why we don't want hardlinks | 18:01 |
| clarkb | seems like that would be a good idea | 18:01 |
| *** doug-fis_ has joined #openstack-infra | 18:02 | |
| amrith | AJaeger, found another one with the same problem as the trove-dashboard. please take a look at https://review.openstack.org/#/c/309136/ | 18:03 |
| Shrews | mordred: i left a comment for you on 309060 | 18:04 |
| amrith | clarkb ^^ | 18:04 |
| rossella_s | AJaeger, thanks a lot, you are my hero :) | 18:04 |
| AJaeger | thanks, amrith | 18:04 |
| AJaeger | rossella_s: pabelanger did the detective work for us! | 18:04 |
| *** doug-fish has quit IRC | 18:04 | |
| rossella_s | thanks pabelanger I really appreciate! | 18:05 |
| openstackgerrit | melanie witt proposed openstack-infra/project-config: Add a new devstack plugin based src job for ceph https://review.openstack.org/308686 | 18:05 |
| *** flepied has joined #openstack-infra | 18:05 | |
| pabelanger | AJaeger: rossella_s: np! | 18:06 |
| AJaeger | clarkb: thanks, let's wait some more I guess ;) | 18:06 |
| AJaeger | We have https://review.openstack.org/305416 to make the beaker tests *voting* on infra puppet modules. fungi, clarkb, mordred, yolanda, pleia2: Ok to merge? nibalizer and pabelanger gave their +2 but the +W is missing. And since this changes quite a bit, I wanted to ask for feedback... | 18:08 |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/308772 | 18:08 |
| clarkb | did we fix centos7 beaker package installs? | 18:08 |
| *** mriedem has quit IRC | 18:09 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 18:09 | |
| crinkle | clarkb: should have https://review.openstack.org/#/c/308426/ | 18:09 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/309137 | 18:10 |
| AJaeger | clarkb: yes, we did | 18:10 |
| clarkb | AJaeger: seems fine to me then | 18:10 |
| *** mriedem has joined #openstack-infra | 18:10 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/309138 | 18:11 |
| *** inc0 has quit IRC | 18:11 | |
| openstackgerrit | Merged openstack/requirements: Bump oslo.log and oslo.il8n for april 18th releases https://review.openstack.org/308680 | 18:12 |
| *** yamahata_ has quit IRC | 18:13 | |
| *** EricGonc_ has joined #openstack-infra | 18:14 | |
| *** degorenko is now known as _degorenko|afk | 18:14 | |
| *** mrmartin has joined #openstack-infra | 18:15 | |
| EmilienM | fungi: re- tarballs, you mentionned I would have to provide a list of project names, branch names and resolved branch tip git shas for all of them -- can't we use HEAD of each branch? | 18:15 |
| *** yamamoto has joined #openstack-infra | 18:16 | |
| *** EricGonczer_ has quit IRC | 18:16 | |
| *** baoli has quit IRC | 18:19 | |
| *** claudiub has joined #openstack-infra | 18:19 | |
| *** mrmartin has quit IRC | 18:19 | |
| bknudson | I could use some help setting up other-requirements.txt in keystone -- https://review.openstack.org/#/c/308477/ | 18:20 |
| bknudson | have other projects with db setup done this already? | 18:21 |
| *** ayoung has quit IRC | 18:21 | |
| clarkb | bknudson: you are missing mysql | 18:21 |
| *** Ng_ is now known as Ng | 18:22 | |
| AJaeger | bknudson: you need the db server as well | 18:22 |
| bknudson | maybe http://git.openstack.org/cgit/openstack/requirements/tree/other-requirements.txt is a good example | 18:22 |
| AJaeger | bknudson: lines 27-30 is what you need for sure | 18:22 |
| *** sdake has quit IRC | 18:23 | |
| *** rfolco has quit IRC | 18:23 | |
| *** EricGonczer_ has joined #openstack-infra | 18:24 | |
| bknudson | thanks. We'll see how it goes. | 18:24 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Ansible launcher: support zuul stop commands https://review.openstack.org/309148 | 18:24 |
| *** rfolco has joined #openstack-infra | 18:25 | |
| bknudson | is the keystone other-requirements.txt overriding requirements/other-requirements.txt ? | 18:25 |
| AJaeger | bknudson: not at all - it's overriding project-config/jenkins/data/bindep-fallback.txt | 18:25 |
| *** yamamoto has quit IRC | 18:25 | |
| *** EricGonc_ has quit IRC | 18:25 | |
| fungi | EmilienM: an explicit tarball job invocation looks like: sudo /opt/zuul/tools/trigger-job.py --url=https://git.openstack.org --job puppet-aodh-branch-tarball --project openstack/puppet-aodh --pipeline post --newrev 607957dd427cb7369e5a8af8a3544a5340556f0e --refname refs/heads/stable/liberty --logpath 60/607957dd427cb7369e5a8af8a3544a5340556f0e/post/puppet-aodh-branch-tarball/manual_000/ | 18:26 |
| bknudson | AJaeger: ok, thanks. Maybe I should copy from there. | 18:26 |
| fungi | EmilienM: or we can reenqueue all jobs in post for a given branch tip like: sudo zuul enqueue-ref --trigger gerrit --pipeline post --project o | 18:26 |
| fungi | penstack/puppet-aodh --ref refs/heads/stable/liberty --newrev 607957dd427cb7369e5a8af8a3544a5340556f0e | 18:26 |
| fungi | (minus the stray newline in there) | 18:26 |
| AJaeger | bknudson: copy from there and remove what you don't need ;) | 18:27 |
| *** arxcruz has quit IRC | 18:27 | |
| bknudson | looks like that uses mariadb for rpm | 18:27 |
| AJaeger | bknudson: the bindep file is what keystone currently uses | 18:27 |
| *** megm has joined #openstack-infra | 18:27 | |
| AJaeger | so, your other-requirements overrides bindep-fallback | 18:27 |
| fungi | EmilienM: but either way we need the result of git show-ref for each branch tip to compose the parameters for the command | 18:27 |
| EmilienM | fungi: could you just try with puppet-aodh for master, stable/mitaka and stable/liberty - so we first see if the stable builds are ok | 18:28 |
| EmilienM | ? | 18:28 |
| fungi | EmilienM: sure, i can do that | 18:28 |
| EmilienM | fungi: thanks | 18:28 |
| EmilienM | fungi: I can write a script that prepare all commands automatically so we don't have to waste time on it | 18:28 |
| *** fhubik has quit IRC | 18:30 | |
| *** Sukhdev has quit IRC | 18:30 | |
| *** inc0 has joined #openstack-infra | 18:32 | |
| *** vhosakot has quit IRC | 18:33 | |
| *** vhosakot has joined #openstack-infra | 18:33 | |
| *** yamahata_ has joined #openstack-infra | 18:33 | |
| *** etoews has left #openstack-infra | 18:34 | |
| *** woodster_ has joined #openstack-infra | 18:34 | |
| *** salv-orlando has quit IRC | 18:44 | |
| *** armax has quit IRC | 18:44 | |
| *** armax has joined #openstack-infra | 18:45 | |
| *** ihrachys has joined #openstack-infra | 18:45 | |
| *** pvaneck has joined #openstack-infra | 18:48 | |
| *** ybathia has quit IRC | 18:49 | |
| *** armax has quit IRC | 18:50 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Fail the test if the pre test hook fails https://review.openstack.org/292175 | 18:50 |
| *** mrmartin has joined #openstack-infra | 18:52 | |
| *** Sukhdev has joined #openstack-infra | 18:55 | |
| *** cody-somerville has joined #openstack-infra | 18:57 | |
| *** flepied1 has joined #openstack-infra | 18:58 | |
| *** bpokorny_ has joined #openstack-infra | 18:59 | |
| *** mylu has joined #openstack-infra | 18:59 | |
| fungi | EmilienM: btw, i've got the liberty one queued, but it's taking a while to get a worker assigned i think | 19:00 |
| EmilienM | fungi: 193 jobs in post :-) | 19:00 |
| fungi | EmilienM: oh, also i had the syntax subtly wrong for trigger-job.py, it's --refname stable/liberty not --refname refs/heads/stable/liberty | 19:01 |
| *** flepied has quit IRC | 19:01 | |
| *** inc0 has quit IRC | 19:01 | |
| *** lennyb has quit IRC | 19:01 | |
| *** bpokorny_ has quit IRC | 19:01 | |
| *** esker has joined #openstack-infra | 19:02 | |
| *** esker has quit IRC | 19:02 | |
| *** baoli has joined #openstack-infra | 19:02 | |
| EmilienM | fungi: tbh, I prefer the cost of doing this manually versus triggering ~400 jobs | 19:02 |
| *** bpokorny_ has joined #openstack-infra | 19:02 | |
| *** esker has joined #openstack-infra | 19:02 | |
| EmilienM | fungi: but first, we need to make sure the stable builds are okay, that's why I asked if we can first check puppet-aodh | 19:02 |
| *** bpokorny has quit IRC | 19:03 | |
| *** madhu_ak has quit IRC | 19:04 | |
| *** amotoki has quit IRC | 19:05 | |
| *** doug-fis_ has quit IRC | 19:06 | |
| AJaeger | fungi, ok to make the beaker jobs voting for infra puppet? https://review.openstack.org/#/c/305416/ | 19:06 |
| *** edmondsw has joined #openstack-infra | 19:07 | |
| *** esker has quit IRC | 19:07 | |
| *** esikachev has joined #openstack-infra | 19:08 | |
| *** doug-fish has joined #openstack-infra | 19:08 | |
| *** baoli has quit IRC | 19:08 | |
| *** mrmartin has quit IRC | 19:09 | |
| *** salv-orlando has joined #openstack-infra | 19:10 | |
| EmilienM | AJaeger, crinkle: I'm not sure it's a good idea - some modules have failures, see https://review.openstack.org/#/c/308628/ | 19:10 |
| mtreinish | fungi, jeblair: if you get a sec I think we should be good to restart the subunit-workers now | 19:10 |
| jeblair | mtreinish: that sounds like a fun lunchtime activity, sure | 19:10 |
| EmilienM | AJaeger, crinkle: that will be fixed by https://review.openstack.org/309101 | 19:10 |
| jeblair | mtreinish: we expect them to not be running right now, correct? | 19:11 |
| mtreinish | jeblair: right, unless puppet started them up without us noticing | 19:11 |
| jeblair | mtreinish: nope, i don't see them. just wanted to make sure that was expected state, and it seems to be. | 19:11 |
| *** HeOS has quit IRC | 19:12 | |
| EmilienM | crinkle: well, +1 anyway. See comment | 19:13 |
| jeblair | mtreinish: worker A on 01 is running | 19:13 |
| jeblair | it's handling jobs. so far they are *entirely* 404s | 19:13 |
| crinkle | EmilienM: :) | 19:13 |
| mtreinish | jeblair: \o/ | 19:13 |
| jeblair | mtreinish: which seems right since they are almost all translation update jobs | 19:14 |
| mtreinish | heh, yeah there isn't any subunit emitted by those | 19:14 |
| jeblair | oh it got one! | 19:14 |
| *** ybathia has joined #openstack-infra | 19:14 | |
| *** esker has joined #openstack-infra | 19:14 | |
| jeblair | 2016-04-21 19:14:25,158 Handling event: {"fields": {"build_name": "gate-tempest-dsvm-neutron-full", "build_status": "SUCCESS", "build_branch": "master", "build_master": "jenkins05.openstack.org", "build_ref": "refs/zuul/master/Z5045bdd19db04f71ae250ba6021cbba7", "log_url": "http://logs.openstack.org/71/308171/1/gate/gate-tempest-dsvm-neutron-full/2066ea1/logs/testrepository.subunit", "build_change": "308171", "node_provider": ... | 19:14 |
| jeblair | ... "rax-dfw", "build_node": "ubuntu-trusty-rax-dfw-391573", "project": "openstack/requirements", "build_zuul_url": "http://zm04.openstack.org/p", "filename": "logs/testrepository.subunit", "build_uuid": "2066ea133b544eb4924a71f941b63c68", "build_queue": "gate", "build_short_uuid": "2066ea1", "build_patchset": "1", "voting": "1"}, "tags": ["testrepository.subunit"]} | 19:14 |
| jeblair | 2016-04-21 19:15:08,683 Sending packet to <gear.Connection 0x244f150 host: logstash.openstack.org port: 4730>: <gear.Packet 0x11addd0 type: WORK_COMPLETE handle: H:127.0.0.1:31218898> | 19:15 |
| jeblair | and done | 19:15 |
| jeblair | mtreinish: and then continued | 19:15 |
| jeblair | mtreinish: so all looks good here | 19:15 |
| jeblair | mtreinish: i'll restart 02 to help work through the backlog | 19:16 |
| mtreinish | jeblair: yay, yep should be good for now | 19:16 |
| mtreinish | jeblair: ++ | 19:16 |
| jeblair | mtreinish: then later we can see whether we need the second host | 19:16 |
| *** MarkAtwood has quit IRC | 19:16 | |
| craige | o/ | 19:16 |
| mtreinish | jeblair: sure, I was also thinking we should be able to start multiple workers on each node now | 19:16 |
| *** esker has quit IRC | 19:16 | |
| jeblair | mtreinish: yeah, i was just thinking the same thing | 19:16 |
| *** cloudtrainme has quit IRC | 19:16 | |
| mtreinish | we had to stop doing that before because of the memory pressure. But the single threaded approach should avoid that concern | 19:16 |
| jeblair | they have 8vcpus, so starting all 4 should be fine assuming we're ok on ram | 19:17 |
| *** esker has joined #openstack-infra | 19:17 | |
| clarkb | and if they keep up maybe remove the second worker? | 19:17 |
| *** dkehn_ has quit IRC | 19:17 | |
| *** dkehn has quit IRC | 19:17 | |
| mtreinish | clarkb: yeah | 19:17 |
| clarkb | neat | 19:17 |
| jeblair | mtreinish, clarkb: the init script is not correct for non-A workers | 19:17 |
| mtreinish | jeblair: yeah, I need to push a system config patch to resync those | 19:18 |
| *** mhickey has joined #openstack-infra | 19:18 | |
| mtreinish | we removed that chunk when we stopped using 4 workers | 19:18 |
| mtreinish | one sec I'll push the revert | 19:18 |
| jeblair | okay, i shut down B on 01 (which was briefly running with who-knows-what config). and i have started A on 02 | 19:18 |
| jeblair | A on 02 looks happy | 19:19 |
| *** rcernin has quit IRC | 19:19 | |
| *** dkehn has joined #openstack-infra | 19:20 | |
| *** dkehn_ has joined #openstack-infra | 19:20 | |
| openstackgerrit | Merged openstack-infra/puppet-reviewday: Add /usr/local/bin to path for cron job https://review.openstack.org/309100 | 19:20 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Set gerrit login cache to 2m https://review.openstack.org/295530 | 19:20 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Remove query about yum missing on ubuntu https://review.openstack.org/309114 | 19:20 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config: Revert "Only start 1 subunit worker per node" https://review.openstack.org/309158 | 19:20 |
| mtreinish | jeblair, clarkb: ^^^ the revert | 19:20 |
| jeblair | ++ | 19:21 |
| mtreinish | jeblair: the other thing I need to fix is to make all the db operations performed by the worker happen in a single transaction (so we can rollback on failures or crashes) | 19:23 |
| mtreinish | that should be a pretty quick subunit2sql patch | 19:23 |
| *** ybathia has quit IRC | 19:24 | |
| *** mrmartin has joined #openstack-infra | 19:26 | |
| openstackgerrit | melanie witt proposed openstack-infra/project-config: Add a new devstack plugin based src job for ceph https://review.openstack.org/308686 | 19:27 |
| *** mylu has quit IRC | 19:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Make the delorean-ci repository available when build overcloud images https://review.openstack.org/309092 | 19:30 |
| AJaeger | infra-root, I'll approve the voting of the beaker jobs for infra-puppet tomorrow if there's no -1 on https://review.openstack.org/#/c/305416 | 19:30 |
| *** madhu_ak has joined #openstack-infra | 19:30 | |
| crinkle | thanks AJaeger for raising attention on it | 19:31 |
| *** mylu has joined #openstack-infra | 19:31 | |
| fungi | crinkle: AJaeger: seems fine to me. if we have any modules still failing those jobs which are really hard to just fix, we can roll it back to non-voting for them on a case by case basis | 19:34 |
| fungi | and we have a lot of +2's already. adding mine to the mix now | 19:35 |
| fungi | also approving | 19:35 |
| crinkle | \o/ | 19:35 |
| *** Yarboa_Zzzzz has joined #openstack-infra | 19:36 | |
| *** Yarboa_Zzzzz is now known as Yarboa | 19:36 | |
| Yarboa | wznoinsk, | 19:36 |
| fungi | crinkle: thanks for driving that effort home. i'm excited to see what it catches that our apply tests miss | 19:39 |
| *** Guest3894 is now known as jgriffith | 19:40 | |
| crinkle | :D | 19:40 |
| AJaeger | thanks, fungi! | 19:40 |
| AJaeger | and thanks, crinkle ! | 19:40 |
| *** maishsk has joined #openstack-infra | 19:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Make Infra's puppet beaker jobs voting https://review.openstack.org/305416 | 19:42 |
| EmilienM | crinkle: does infra have plans already for a common gem, like we have in puppet-openstack? same question for integration testing jobs | 19:42 |
| *** baoli has joined #openstack-infra | 19:43 | |
| *** mylu has quit IRC | 19:44 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Run df to see status of undercloud storage https://review.openstack.org/309163 | 19:44 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Revert "Turn off rax-ord" https://review.openstack.org/309165 | 19:45 |
| clarkb | I was just going to ask if you were ready for that | 19:45 |
| *** ihrachys has quit IRC | 19:45 | |
| fungi | totally | 19:45 |
| fungi | bombs away | 19:46 |
| clarkb | +2 | 19:46 |
| *** ihrachys has joined #openstack-infra | 19:46 | |
| crinkle | EmilienM: we've brought it up, no one's done the work yet though | 19:46 |
| clarkb | fungi: any idea if our traceroutes were providing useful info? | 19:46 |
| *** dkehn_ has quit IRC | 19:46 | |
| *** dkehn has quit IRC | 19:46 | |
| fungi | clarkb: doubtful. i think our traceroutes probably just showed that packets were headed over the circuits between ord and dfw | 19:47 |
| *** mylu has joined #openstack-infra | 19:47 | |
| fungi | clarkb: but it was instrumental in getting the ticket past level 1 support to level 2 and then to the noc after some further explaining | 19:47 |
| clarkb | nibalizer: oh wow one of those shards finally finished, maybe this is just really inconsistently slow? /me holds out hope | 19:48 |
| *** dkehn has joined #openstack-infra | 19:48 | |
| clarkb | fungi: shibboleet | 19:48 |
| *** dkehn_ has joined #openstack-infra | 19:49 | |
| *** mylu has quit IRC | 19:49 | |
| fungi | after years of talking my way through uunet/mci/worldcom, sprintnet, at&t, et cetera... rackspace's noc requires much less shibboleet | 19:49 |
| *** doug-fis_ has joined #openstack-infra | 19:49 | |
| *** doug-fis_ has quit IRC | 19:50 | |
| *** doug-fis_ has joined #openstack-infra | 19:50 | |
| *** ihrachys has quit IRC | 19:50 | |
| *** ihrachys_ has joined #openstack-infra | 19:50 | |
| mtreinish | sigh, now it looks like http://status.openstack.org/openstack-health/ has diasapeared | 19:50 |
| AJaeger | fungi: +2A - do you want to enqueue and promote it so that it merges soonish? | 19:51 |
| *** mylu has joined #openstack-infra | 19:51 | |
| fungi | AJaeger: will do. looking at the backlog in check, it's not terrible, but this will help shorten it sooner | 19:51 |
| mtreinish | I'm guessing something screwed up in the puppet when building the js and it removed everything from the dir | 19:52 |
| mtreinish | is there anything in the logs? | 19:52 |
| fungi | enqueue should be plenty sufficient. promoting only makes sense if there's a bunch of other project-config changes queued u pin the gate pipeline though | 19:52 |
| AJaeger | fungi, ah. Learned something new ;) In that case enqueue is indeed enough... | 19:53 |
| fungi | and it's in the gate now | 19:53 |
| fungi | yeah, promoting it would do absolutely nothing, it's already at the front of its particular queue | 19:53 |
| clarkb | on the ipv6 front I am told they are working on it, but haven't heard more details | 19:53 |
| *** Goneri has quit IRC | 19:53 | |
| fungi | clarkb: rax? | 19:53 |
| *** doug-fish has quit IRC | 19:53 | |
| clarkb | ya | 19:54 |
| fungi | as in getting teh data into their configdrive? | 19:54 |
| fungi | cool | 19:54 |
| clarkb | ya | 19:54 |
| openstackgerrit | Merged openstack-dev/hacking: Updated from global requirements https://review.openstack.org/309137 | 19:54 |
| *** doug-fis_ has quit IRC | 19:54 | |
| *** IlyaG has joined #openstack-infra | 19:54 | |
| *** ayoung has joined #openstack-infra | 19:55 | |
| *** mylu has quit IRC | 19:56 | |
| * AJaeger waves good bye | 19:56 | |
| *** tqtran is now known as tqtran-afk | 19:56 | |
| fungi | night AJaeger! | 19:56 |
| *** mylu has joined #openstack-infra | 19:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Turn off rax-ord" https://review.openstack.org/309165 | 19:59 |
| *** MarkAtwood has joined #openstack-infra | 20:00 | |
| *** gyee has joined #openstack-infra | 20:00 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fail if FIP doens't have the requested port_id https://review.openstack.org/309060 | 20:01 |
| mordred | clarkb, Shrews: k. I think I covered both of your concerns | 20:02 |
| *** matrohon has joined #openstack-infra | 20:02 | |
| mtreinish | hmm, well it's back now | 20:03 |
| *** mylu has quit IRC | 20:03 | |
| *** Nikolay_St has joined #openstack-infra | 20:04 | |
| *** maishsk has quit IRC | 20:06 | |
| fungi | i'm going to pop out for a short walk while that finds its way onto nodepool.o.o | 20:06 |
| fungi | bbiab | 20:07 |
| *** armax has joined #openstack-infra | 20:07 | |
| *** mylu has joined #openstack-infra | 20:07 | |
| *** bpokorny_ has quit IRC | 20:08 | |
| fungi | also, looking at the test nodes graph, i have a feeling osic and bluebox have been doing very little for the past ~10 hours | 20:08 |
| fungi | other than complaining about fip quota | 20:08 |
| clarkb | ya | 20:08 |
| fungi | hence the broad yellow "building" band there | 20:08 |
| *** bpokorny has joined #openstack-infra | 20:09 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 20:09 | |
| *** Sukhdev has quit IRC | 20:09 | |
| *** baoli_ has joined #openstack-infra | 20:09 | |
| *** fawadkhaliq has quit IRC | 20:11 | |
| *** abregman has quit IRC | 20:12 | |
| *** baoli___ has joined #openstack-infra | 20:12 | |
| *** baoli has quit IRC | 20:12 | |
| *** apoorvad has quit IRC | 20:12 | |
| *** maishsk has joined #openstack-infra | 20:12 | |
| *** rcernin has joined #openstack-infra | 20:12 | |
| *** fawadkhaliq has joined #openstack-infra | 20:13 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 20:13 | |
| *** esikachev has quit IRC | 20:13 | |
| *** baoli_ has quit IRC | 20:14 | |
| *** megm has quit IRC | 20:14 | |
| *** nwkarste_ has joined #openstack-infra | 20:14 | |
| *** mrmartin has quit IRC | 20:15 | |
| *** nwkarste_ has quit IRC | 20:15 | |
| *** nwkarste_ has joined #openstack-infra | 20:16 | |
| *** kgiusti has left #openstack-infra | 20:17 | |
| *** megm has joined #openstack-infra | 20:17 | |
| *** inc0 has joined #openstack-infra | 20:18 | |
| *** nwkarsten has quit IRC | 20:18 | |
| *** esker has quit IRC | 20:18 | |
| *** fawadkhaliq has quit IRC | 20:19 | |
| *** fawadkhaliq has joined #openstack-infra | 20:20 | |
| *** baoli___ has quit IRC | 20:20 | |
| *** inc0 has quit IRC | 20:21 | |
| *** baoli has joined #openstack-infra | 20:21 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/shade: Add support for Designate zones https://review.openstack.org/302770 | 20:22 |
| *** maishsk has quit IRC | 20:23 | |
| *** mrmartin has joined #openstack-infra | 20:23 | |
| *** mrmartin has quit IRC | 20:23 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/publications: Update slide deck for 2016 Newton Summit https://review.openstack.org/308700 | 20:24 |
| *** e0ne has quit IRC | 20:24 | |
| pleia2 | pabelanger, docaedo ^^ screenshots I wanted to update have been updated | 20:24 |
| *** fawadkhaliq has quit IRC | 20:24 | |
| pabelanger | pleia2: ack | 20:24 |
| *** e0ne has joined #openstack-infra | 20:24 | |
| *** fawadkhaliq has joined #openstack-infra | 20:25 | |
| pleia2 | pabelanger, docaedo: I didn't rework slide 3 because I have too much on my plate today, might do tomorrow or something, but didn't want to hold up any other proposed changes from either of you | 20:25 |
| pleia2 | in another change | 20:26 |
| pabelanger | pleia2: wfm | 20:26 |
| docaedo | pleia2: thanks for that! | 20:26 |
| pabelanger | I'll get my changes up for tomorrow | 20:26 |
| *** maishsk has joined #openstack-infra | 20:27 | |
| *** jamielennox|away is now known as jamielennox | 20:29 | |
| *** mhickey has quit IRC | 20:30 | |
| *** armax has quit IRC | 20:30 | |
| *** doug-fish has joined #openstack-infra | 20:32 | |
| *** apoorvad has joined #openstack-infra | 20:32 | |
| *** thorst has quit IRC | 20:34 | |
| *** maishsk_ has joined #openstack-infra | 20:34 | |
| *** avarner_ has quit IRC | 20:35 | |
| *** maishsk has quit IRC | 20:35 | |
| *** maishsk_ is now known as maishsk | 20:35 | |
| *** ybathia has joined #openstack-infra | 20:36 | |
| *** rkukura has quit IRC | 20:36 | |
| *** thorst has joined #openstack-infra | 20:37 | |
| *** avarner has joined #openstack-infra | 20:37 | |
| *** piet has joined #openstack-infra | 20:38 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: grafana: added periodic oslo master jobs to unit test 'gate' dashboard https://review.openstack.org/307511 | 20:38 |
| *** BigWillie has quit IRC | 20:38 | |
| *** trown is now known as trown|outtypewww | 20:39 | |
| *** claudiub has quit IRC | 20:40 | |
| Shrews | yolanda: mordred: since magnum support was added, shade jobs seem to all be failing in the same peculiar way. coincidence? | 20:40 |
| *** thorst has quit IRC | 20:41 | |
| rcarrillocruz | eugh | 20:42 |
| *** avarner has quit IRC | 20:42 | |
| mordred | Shrews: how about we revert that? | 20:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Revert "Enable magnum plugin on shade and use our atomic generated images" https://review.openstack.org/309176 | 20:43 |
| Shrews | mordred: seems logical, though i have no proof of it other than the christmas tree of jenkins reports | 20:44 |
| mordred | infra-root: ^^ insta-approve real quick? | 20:44 |
| mordred | Shrews: yah. I think it's probably something that will be easy enough to diagnose ... but I need to finish fixing nodepool FIPs right now | 20:44 |
| *** avarner has joined #openstack-infra | 20:44 | |
| mordred | we can debug magnum next week or the week after | 20:44 |
| Shrews | ++ | 20:44 |
| mordred | clarkb: thanks | 20:45 |
| * clarkb wants workin nodepool ;) | 20:45 | |
| *** _ari_ has quit IRC | 20:45 | |
| mordred | today really seems to be magnum day for mordred | 20:45 |
| mordred | between this patch and the mailing list thread I'm somehow on | 20:46 |
| * mordred is confused | 20:46 | |
| *** inc0 has joined #openstack-infra | 20:46 | |
| clarkb | mordred: I want an api that makes rainbows. curl -X GET https://clouds.org/rainbows&zipcode=97203 and bam rainbow outside | 20:47 |
| clarkb | er s/&/?/ | 20:47 |
| mordred | clarkb: NO. BAD ENGINEER NO COOKIE | 20:47 |
| *** ihrachys_ has quit IRC | 20:48 | |
| mordred | pleia2: wow. that slide had marconi on it! | 20:48 |
| pleia2 | mordred: hehe, yeah | 20:48 |
| pleia2 | mordred: and I was so thrilled to delete the list of clients | 20:48 |
| pleia2 | long live OSC | 20:48 |
| *** ihrachys has joined #openstack-infra | 20:48 | |
| *** krotscheck has quit IRC | 20:48 | |
| *** stewie925 has joined #openstack-infra | 20:48 | |
| *** krotscheck has joined #openstack-infra | 20:48 | |
| pleia2 | mordred: thinking of reworking that slide to not be a list anymore, and something blah blah big tent, but my brain today /o\ | 20:49 |
| mordred | pleia2: oh, I hear that | 20:49 |
| *** avarner has quit IRC | 20:50 | |
| mordred | pleia2: I think you should actually just make the slide say "blah blah big tent" :) | 20:50 |
| clarkb | http://images.gearjunkie.com/uploads/2015/09/bear-in-tent-2.jpg use that picture | 20:50 |
| pleia2 | clarkb: hahaha <3 | 20:50 |
| *** matrohon has quit IRC | 20:50 | |
| *** avarner has joined #openstack-infra | 20:50 | |
| openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Fix CFP configuration for >=2.10.0 https://review.openstack.org/308705 | 20:51 |
| mordred | clarkb: ++ | 20:52 |
| *** dkehn__ has joined #openstack-infra | 20:52 | |
| zxiiro | zaro: mind reviewing my patch ^ | 20:53 |
| *** matrohon has joined #openstack-infra | 20:53 | |
| mtreinish | clarkb: I normally use this: https://raw.githubusercontent.com/mtreinish/qa-in-the-open/master/Burning_Tent.jpg | 20:54 |
| *** fawadk has joined #openstack-infra | 20:54 | |
| *** fawadkhaliq has quit IRC | 20:54 | |
| *** thorst has joined #openstack-infra | 20:54 | |
| *** thorst has quit IRC | 20:54 | |
| *** Yarboa has quit IRC | 20:54 | |
| *** aeng has joined #openstack-infra | 20:55 | |
| *** thorst has joined #openstack-infra | 20:55 | |
| *** avarner has quit IRC | 20:55 | |
| *** dkehn has quit IRC | 20:55 | |
| *** flwang has quit IRC | 20:56 | |
| *** ams_ has joined #openstack-infra | 20:56 | |
| *** maishsk has quit IRC | 20:56 | |
| nibalizer | clarkb: cool | 20:56 |
| *** thorst has quit IRC | 20:56 | |
| *** thorst has joined #openstack-infra | 20:57 | |
| nibalizer | clarkb: looks like only one shard initializng now | 20:57 |
| clarkb | nibalizer: ya I think what it is doing is when one host fails to restore it it moves on ot another host and that is happening slowly. Then eventually it gets to the one with the lock maybe and it works | 20:57 |
| clarkb | this doesn't fix the deadlock but it does work with it? | 20:57 |
| rcarrillocruz | blech | 20:59 |
| rcarrillocruz | i'll retry my patchsets tomorrow when magnum revert settles if that's the issue | 20:59 |
| rcarrillocruz | i call it a day | 20:59 |
| * rcarrillocruz waves | 20:59 | |
| pabelanger | clarkb: looks like ceph jewel will have xenial packages: http://download.ceph.com/debian-jewel/dists/ | 20:59 |
| *** fawadk has quit IRC | 20:59 | |
| *** maishsk has joined #openstack-infra | 21:00 | |
| pvaneck | nibalizer: hey, can you take a look at https://review.openstack.org/#/c/254426 ? | 21:01 |
| clarkb | pabelanger: if nova/ceph are ok with moving to jewel then that seems like a reasonable migration path (a little nanoying I set up the hammer repo for 2 weeks but whatever learned how to do it) | 21:01 |
| odyssey4me | hmm, it would appear that zuul queue lengths and results are climbing, and only climbing | 21:02 |
| clarkb | odyssey4me: last I checked they were falling pretty rapidly | 21:02 |
| clarkb | ya gearman job graph seems to ocnfirm | 21:03 |
| pabelanger | clarkb: will ask around next week | 21:03 |
| odyssey4me | they're growing slowly right now - and I have several successful post jobs completeed, but still displaying | 21:03 |
| odyssey4me | also, +w was given to a patch several minutes ago and it's not in the gate queue yet | 21:03 |
| clarkb | odyssey4me: post is the lowest priority, you'll see that check is quickly falling and as we get our heads above water on the backlog post will pick up | 21:03 |
| clarkb | odyssey4me: that is because zuul has ~2k events and results to process | 21:04 |
| odyssey4me | yeah, it figures - lemme be a little more patient | 21:04 |
| odyssey4me | ah, there it shows | 21:04 |
| clarkb | basically things are looking much better now than it has been for the last few days | 21:04 |
| * mordred hands odyssey4me a beer | 21:04 | |
| *** jheroux has quit IRC | 21:04 | |
| openstackgerrit | Merged openstack-infra/publications: Update slide deck for 2016 Newton Summit https://review.openstack.org/308700 | 21:04 |
| pabelanger | Oh, nice. rax-ord is back | 21:04 |
| mordred | clarkb: we have so much clouds back! | 21:04 |
| odyssey4me | note that a lot of IRC messages have been dropping lately | 21:04 |
| *** sdague has quit IRC | 21:04 | |
| odyssey4me | basically review submissions or merge events just haven't shown all the time - only around 10% of the time | 21:05 |
| * odyssey4me thanks mordred :) | 21:05 | |
| clarkb | odyssey4me: freenode has been under attack aiui | 21:05 |
| odyssey4me | oh nice, that's fun | 21:05 |
| clarkb | which is causing netsplits and servers to go offline which impacts the bots | 21:05 |
| odyssey4me | apparently some people have too much time on their hands :p | 21:05 |
| pabelanger | Ya, post pipeline is getting crushed right now | 21:06 |
| pabelanger | http://grafana.openstack.org/dashboard/db/zuul-status | 21:07 |
| *** tristanC_ is now known as tristanC | 21:07 | |
| mordred | clarkb: can I restart nodepool again? | 21:07 |
| pabelanger | last 1 hour / refresh every 5s | 21:07 |
| pabelanger | odyssey4me: http://grafana.openstack.org/dashboard/db/zuul-status?from=1461269247046&to=1461272847046 | 21:07 |
| *** e0ne has quit IRC | 21:07 | |
| *** fawadkhaliq has joined #openstack-infra | 21:07 | |
| clarkb | mordred: if you do all of the image uploads that are happening will be killed, that is the tradeoff | 21:08 |
| *** fawadkhaliq has quit IRC | 21:08 | |
| mordred | clarkb: nevermind then. I will wait | 21:08 |
| *** edmondsw has quit IRC | 21:08 | |
| odyssey4me | wowzer, yeah I saw the list of my stuff disappear | 21:08 |
| clarkb | mordred: it could be a while, uploads are slow | 21:08 |
| *** e0ne has joined #openstack-infra | 21:08 | |
| *** fawadkhaliq has joined #openstack-infra | 21:08 | |
| *** fawadkhaliq has quit IRC | 21:08 | |
| odyssey4me | I was trying to do some stuff in DFW earlier and the links were damned slow | 21:08 |
| odyssey4me | they picked up after 30 mins or so | 21:08 |
| *** flepied1 is now known as flepied | 21:09 | |
| clarkb | mordred: might be better to try and get nodepool reliable now then let tomorrow's uploads happen | 21:10 |
| openstackgerrit | Ye Na Rhee proposed openstack-infra/grafyaml: Add datasource option for graph and singlestat panel https://review.openstack.org/309181 | 21:10 |
| mordred | clarkb: yah. I wanna put the fail-early-with-no-port-id change in place | 21:10 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 21:10 |
| *** rfolco has quit IRC | 21:11 | |
| *** matt-borland has quit IRC | 21:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Enable magnum plugin on shade and use our atomic generated images" https://review.openstack.org/309176 | 21:12 |
| *** Sukhdev has joined #openstack-infra | 21:15 | |
| *** rhallisey has quit IRC | 21:16 | |
| *** maishsk has quit IRC | 21:17 | |
| *** flwang has joined #openstack-infra | 21:19 | |
| ianw | pabelanger: so in terms of removing devstack-centos7, people have worked around the lack of loclae tools and selinux issues? because fixes for those change are still outstanding | 21:19 |
| openstackgerrit | Merged openstack-infra/puppet-openstack_health: Add packages needed to build lxml https://review.openstack.org/308628 | 21:22 |
| *** lennyb has joined #openstack-infra | 21:22 | |
| krotscheck | node on xenial makes me happy | 21:23 |
| *** sridhar_ram1 is now known as sridhar_ram | 21:23 | |
| *** gordc has quit IRC | 21:25 | |
| *** vhosakot has quit IRC | 21:26 | |
| *** lakshmiS has quit IRC | 21:26 | |
| *** vhosakot has joined #openstack-infra | 21:26 | |
| openstackgerrit | Merged openstack-infra/system-config: Add database backups for refstack.openstack.org https://review.openstack.org/254426 | 21:27 |
| *** nikhil_k has joined #openstack-infra | 21:27 | |
| *** jtomasek has quit IRC | 21:27 | |
| *** HeOS has joined #openstack-infra | 21:28 | |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Support multi backends for Zaqar tempest job https://review.openstack.org/308698 | 21:30 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 21:31 |
| pabelanger | ianw: and we have | 21:32 |
| pabelanger | ianw: so, once we land those changes, we can remove all the work arounds | 21:32 |
| *** nwkarsten has joined #openstack-infra | 21:32 | |
| pvaneck | thanks nibalizer ^^ | 21:33 |
| *** Na3iL has quit IRC | 21:33 | |
| *** matrohon has quit IRC | 21:33 | |
| nibalizer | pvaneck: for sure | 21:33 |
| pabelanger | mordred: did you restart nodepool? | 21:35 |
| mordred | pabelanger: yes I did | 21:36 |
| pabelanger | mordred: ack | 21:36 |
| *** nwkarste_ has quit IRC | 21:36 | |
| *** nwkarsten has quit IRC | 21:36 | |
| pabelanger | Ya, post is down to 25 now. nodepool crushing it | 21:38 |
| *** piet has quit IRC | 21:38 | |
| *** Na3iL has joined #openstack-infra | 21:39 | |
| *** rcernin has quit IRC | 21:39 | |
| pabelanger | http://grafana.openstack.org/dashboard/db/zuul-status looks over all happy now. We are using 1/2 our capacity right now | 21:40 |
| pabelanger | with pipelines dropping | 21:40 |
| prometheanfire | bnemec: brainfart :D | 21:40 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 21:40 |
| *** nikhil has quit IRC | 21:40 | |
| *** nikhil_k is now known as nikhil | 21:40 | |
| bnemec | prometheanfire: We've all been there. :-) | 21:41 |
| *** IlyaG has quit IRC | 21:43 | |
| EmilienM | fungi: ok we're almost there: http://tarballs.openstack.org/puppet-aodh/ | 21:45 |
| EmilienM | fungi: we have puppet-aodh-stable-liberty.tar.gz instead of puppet-aodh-7.0.0.tar.gz | 21:45 |
| *** |-paul-| has joined #openstack-infra | 21:45 | |
| EmilienM | I guess I did something wrong in the script. /me looking | 21:45 |
| *** aimeeU has quit IRC | 21:46 | |
| openstackgerrit | Merged openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/309138 | 21:46 |
| EmilienM | fungi: well, in fact that's cool, other projects also have this model | 21:48 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add remaining pipelines to zuul-status dashboard https://review.openstack.org/309200 | 21:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add remaining pipelines to zuul-status dashboard https://review.openstack.org/309200 | 21:50 |
| *** fawadkhaliq has joined #openstack-infra | 21:52 | |
| flwang | clarkb: hi could you pls help review this https://review.openstack.org/#/c/308698/ ? need some suggestion to fix the jenkins failure | 21:55 |
| *** gordc has joined #openstack-infra | 21:55 | |
| fungi | EmilienM: i triggered the branch tarball script (the one that runs each time you merge a change to the branch tip). if you want tarballs built from tags instead, those are release pipeline jobs that need retriggering | 21:56 |
| *** mriedem has quit IRC | 21:56 | |
| EmilienM | fungi: I don't think we have the jobs in place yet | 21:57 |
| *** mylu has quit IRC | 21:57 | |
| EmilienM | fungi: afik, I only added the post job for branch-tarball | 21:57 |
| fungi | checking | 21:57 |
| *** flepied has quit IRC | 21:58 | |
| fungi | EmilienM: ahh, yep | 21:58 |
| fungi | you are correct | 21:58 |
| EmilienM | fungi: step by step | 21:58 |
| fungi | so anyway, that seems to work. i can trigger the ones for stable/mitaka and master | 21:59 |
| EmilienM | fungi: so, what do you suggest if we want tarballs for all projects. Should I write a script that find the latest SHA1? | 21:59 |
| fungi | for branch tarballs, latest sha on each branch yes | 21:59 |
| fungi | for tag tarballs, sha of the tags and the tag names are what we need | 22:00 |
| EmilienM | fungi: we'll see tags later. Let's do branch first | 22:00 |
| fungi | for the tag sha, it's teh result of `git show-ref 7.0.0` or whatever | 22:00 |
| EmilienM | oh well, I can also provide the tag. | 22:00 |
| fungi | for branches, you can `git show-ref stable/liberty` | 22:00 |
| EmilienM | right | 22:00 |
| fungi | the tags will only do us any good once you have release tarball jobs though | 22:00 |
| *** mylu has joined #openstack-infra | 22:01 | |
| fungi | i've triggered a work request for stable/mitaka next | 22:02 |
| fungi | clarkb: oh, too bad, zuul caught up on its waiting queue just after rax-ord went back into service, so we didn't really get a chance to peg it at all | 22:03 |
| *** Sukhdev has quit IRC | 22:03 | |
| clarkb | fungi: just slightly | 22:03 |
| pabelanger | clarkb: ianw: if we want to land 308105 tonight, I can kick off centos-7 dibs and monitro | 22:03 |
| clarkb | flwang: you have updated your job template but not instantiated the new jobs with that template so the test fails | 22:03 |
| clarkb | flwang: you need totell jjb to make jobs using that template with mongodb and redis | 22:03 |
| * clarkb mumbles something about redis being a terrible message queue backend | 22:03 | |
| *** HeOS_ has joined #openstack-infra | 22:04 | |
| *** Sukhdev has joined #openstack-infra | 22:04 | |
| flwang | clarkb: that's an interesting point, why do you think redis is a terrible backend for mq? | 22:04 |
| *** netsin has joined #openstack-infra | 22:04 | |
| clarkb | flwang: because I tried to use it for logstash's queiing and I broke it in 5 minutes | 22:05 |
| clarkb | flwang: it doesn't scale up well | 22:05 |
| flwang | clarkb: oh, really? did you use redis cluster? | 22:05 |
| *** armax has joined #openstack-infra | 22:06 | |
| flwang | sharding | 22:06 |
| clarkb | no just a single instance | 22:06 |
| clarkb | I was using their prescribed system architecture | 22:06 |
| fungi | this was a couple years ago, right? | 22:06 |
| clarkb | fungi: ya | 22:06 |
| fungi | or more recent? | 22:06 |
| clarkb | but redis hasn't really gotten better | 22:07 |
| clarkb | it uses all your memory, forks, OOMs then dies | 22:07 |
| fungi | maybe they've fixed redis to be "web scale" now | 22:07 |
| mtreinish | hmm, puppet hasn't run on health.o.o in a while: http://puppetboard.openstack.org/node/health.openstack.org | 22:07 |
| flwang | clarkb: it uses all your memory --- since it's a memory DB :) | 22:07 |
| clarkb | flwang: ya but then it forks | 22:07 |
| clarkb | flwang: the issue is with the forking | 22:07 |
| mtreinish | I'm still waiting on the next build which I hope will be able to work (and add the rss support) | 22:08 |
| clarkb | because that doesn't work when you have no memory | 22:08 |
| flwang | clarkb: ok, not sure if the issue is still there, but for zaqar, you have mongodb as well :) | 22:08 |
| fungi | EmilienM: now you have a stable-mitaka tarball too, and you already had a master tarball from a change that merged to that repo earlier today | 22:08 |
| pabelanger | mtreinish: last errors I see on health.o.o: http://paste.openstack.org/show/495051/ | 22:09 |
| *** Sukhdev has quit IRC | 22:09 | |
| *** burgerk has quit IRC | 22:10 | |
| EmilienM | fungi: awesome | 22:10 |
| EmilienM | fungi: I'm doing the script now | 22:10 |
| pabelanger | mtreinish: puppet just finished running, so you should see an update | 22:10 |
| mtreinish | pabelanger: ok, cool. Yeah that last error ran before (well right around) the patch to puppet-subunit2sql merged | 22:11 |
| EmilienM | fungi: http://paste.openstack.org/show/fEJJFLr1uDXPCBTz8P5r/ | 22:11 |
| *** flepied has joined #openstack-infra | 22:12 | |
| *** cody-somerville has quit IRC | 22:12 | |
| fungi | EmilienM: do you need master too, or are they moving fast enough not to bother? | 22:12 |
| pabelanger | mtreinish: facts should be posting now | 22:12 |
| EmilienM | fungi: are you scripting it? | 22:12 |
| EmilienM | fungi: if yes, I would ask master | 22:13 |
| EmilienM | if not, we can live without | 22:13 |
| fungi | EmilienM: you said you were writing the script, i just noticed you didn't have any master branches listed in that paste | 22:13 |
| pabelanger | mtreinish: and done | 22:14 |
| EmilienM | fungi: sorry misunderstanding. I'm writting the script | 22:14 |
| clarkb | pabelanger: did dib release with the change we need? | 22:14 |
| EmilienM | fungi: for master, should also provide the latest commit? | 22:14 |
| fungi | EmilienM: yes, if you want those | 22:14 |
| *** tqtran-afk is now known as tqtran | 22:14 | |
| *** doug-fish has quit IRC | 22:14 | |
| pabelanger | clarkb: Ya, looks like ianw landed it. Not sure about release status | 22:14 |
| fungi | master is treated just like any other branch | 22:14 |
| clarkb | pabelanger: we might be able to just merge both changes and get it through | 22:14 |
| *** Sukhdev has joined #openstack-infra | 22:15 | |
| clarkb | pabelanger: it hasn't so nevermind I will just approve my change | 22:15 |
| clarkb | er the first one | 22:15 |
| pabelanger | clarkb: okay | 22:15 |
| clarkb | pabelanger: actualyl there may be a small issue with it gonnatest first | 22:15 |
| fungi | clarkb: bad news, we have some new hits on ord now that we've cranked it back up. hit two jobs about an hour ago | 22:15 |
| pabelanger | clarkb: ack | 22:16 |
| *** armax has quit IRC | 22:16 | |
| pabelanger | ianw: is the plan to release diskimage-builder today? | 22:16 |
| flwang | clarkb: "flwang: you need totell jjb to make jobs using that template with mongodb and redis" would you mind pointing out a link where i should fix? | 22:16 |
| mtreinish | pabelanger: cool, yep I see it now | 22:16 |
| clarkb | pabelanger: I am worried about -x "" but quick local tests says it works | 22:16 |
| *** fawadkhaliq has quit IRC | 22:16 | |
| ianw | pabelanger: yep i can, especially if a few of us are around to monitor. be nice to get prometheanfire's 299694 change in | 22:16 |
| clarkb | pabelanger: so I think it is alright to merge | 22:17 |
| *** asettle has joined #openstack-infra | 22:17 | |
| clarkb | flwang: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n9248 | 22:18 |
| mtreinish | pabelanger: hmm, although I'm not seeing the new feature (that the xml libs were need for though) | 22:18 |
| fungi | clarkb: ouch, these jobs were also getting failures connecting locally to our mirror server in ord | 22:19 |
| clarkb | mordred: did you restart nodepool with the port thing? | 22:19 |
| flwang | clarkb: lovely, i owe you a beer | 22:19 |
| clarkb | fungi: :( | 22:19 |
| pabelanger | clarkb: WFM | 22:19 |
| fungi | clarkb: so at least in these two cases, it was networking broken in general for the workers, not just reaching to dfw | 22:19 |
| pabelanger | ianw: great | 22:19 |
| *** baoli has quit IRC | 22:20 | |
| clarkb | fungi: and it should be a problem wiht the private IP routes because mirrors are all public IP | 22:20 |
| fungi | right | 22:20 |
| *** inc0 has quit IRC | 22:21 | |
| fungi | unfortunately it's hard to tell what the exact network issues were because apt-get silently fell back to trying ipv6 and then complained about network unreachable once that didn't work | 22:21 |
| EmilienM | fungi: http://paste.openstack.org/show/495059/ | 22:21 |
| fungi | also these weren't jobs with our net-info macro, so no traceroutes | 22:21 |
| krotscheck | jeblair: Is that vos-release still going? | 22:22 |
| fungi | EmilienM: almost. the first two character of the logpath are supposed to be the first two characters of the git sha | 22:23 |
| fungi | EmilienM: so it's right for puppet-aodh liberty there (which was the example you were working from presumably) | 22:23 |
| EmilienM | fungi: we are saving 1408 CI jobs :) | 22:23 |
| openstackgerrit | Merged openstack-infra/project-config: Use setfiles to restore unbound selinux policy https://review.openstack.org/308105 | 22:24 |
| fungi | EmilienM: indeed. quite the savings! | 22:24 |
| clarkb | pabelanger: ^ there it is | 22:24 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Support multi backends for Zaqar tempest job https://review.openstack.org/308698 | 22:24 |
| pabelanger | clarkb: okay, let me start centos-7 build | 22:24 |
| clarkb | pabelanger: you may need to wait for a puppet run? I can't rmember how those elements get updated | 22:25 |
| *** fawadkhaliq has joined #openstack-infra | 22:25 | |
| EmilienM | fungi: the 2 caracteres of the logpath are for post queue, isn't? | 22:25 |
| EmilienM | fungi: I checked | 22:25 |
| pabelanger | clarkb: Yup, going to confirm on host first | 22:25 |
| *** netsin has quit IRC | 22:25 | |
| EmilienM | http://logs.openstack.org/60 is for post logs, iiuc | 22:26 |
| fungi | EmilienM: you have 60/607957dd427cb7369e5a8af8a3544a5340556f0e for the first line, so that's right. the second line you have 60/ec4473ff0bed4a0e2bda381f9af079239b94ad0c when it should be ec/ec4473ff0bed4a0e2bda381f9af079239b94ad0c | 22:26 |
| pabelanger | clarkb: do you use image-build or 2 step dib-image-build / image-upload | 22:27 |
| *** cody-somerville has joined #openstack-infra | 22:27 | |
| fungi | EmilienM: we use an extra directory level sharded on the first two characters of the sha to avoid having too many subdirectories in a single directory | 22:27 |
| EmilienM | fungi: how can I kow the caracters? | 22:27 |
| EmilienM | ohhh | 22:27 |
| clarkb | pabelanger: I use two step | 22:27 |
| EmilienM | fungi: let me fix that | 22:27 |
| pabelanger | clarkb: ya, do the same. | 22:27 |
| *** fawadkhaliq has quit IRC | 22:28 | |
| *** bpokorny_ has joined #openstack-infra | 22:28 | |
| pabelanger | clarkb: okay, patch landed. Starting builds | 22:28 |
| jeblair | Released volume mirror.npm successfully | 22:29 |
| jeblair | real 4847m44.626s | 22:29 |
| jeblair | krotscheck: ^ | 22:29 |
| mordred | clarkb: yes | 22:29 |
| clarkb | pabelanger: I would upload to osic first because it is fastest and can confirm if this fixes dns | 22:29 |
| jeblair | krotscheck: shall i kick off another? | 22:29 |
| fungi | that's a lot of minutes | 22:29 |
| jeblair | yeah, that was the bulk of the npm mirror | 22:29 |
| *** Adri2000 has quit IRC | 22:29 | |
| mordred | clarkb: we're still leaking, but not as fast as before | 22:29 |
| *** fawadkhaliq has joined #openstack-infra | 22:30 | |
| mordred | clarkb: I am not running with the extra shade debug patch, becuase I need to rewrite it now | 22:30 |
| clarkb | mordred: is it still worse than before we switched to shade? | 22:30 |
| pabelanger | clarkb: ack | 22:30 |
| clarkb | pabelanger: cloud sthat use qcow2 win the upload game | 22:30 |
| EmilienM | fungi: http://paste.openstack.org/show/495060/ | 22:30 |
| *** vhosakot has quit IRC | 22:30 | |
| jeblair | also just win | 22:30 |
| pabelanger | clarkb: okay, didn't know that | 22:30 |
| EmilienM | I'm going to save this script | 22:30 |
| krotscheck | jeblair: yeah, go ahead. you can also kill the mirror update script (but don't release the lock). | 22:31 |
| mordred | clarkb: yes, I think so. but the rate is slow enough that the reaper should take care of it and allow further debugging | 22:31 |
| clarkb | mordred: gotcha | 22:31 |
| jeblair | krotscheck: is there a reason to kill it? | 22:31 |
| krotscheck | jeblair: not really. It'll keep chugging. | 22:31 |
| krotscheck | jeblair: Once https://review.openstack.org/#/c/308669/ lands we can kill it. | 22:31 |
| jeblair | krotscheck: that sounds like a plan then | 22:31 |
| *** bpokorny has quit IRC | 22:31 | |
| jeblair | keep the delta small till then | 22:31 |
| krotscheck | alrightey. | 22:32 |
| krotscheck | See y'all tomorrow. | 22:32 |
| jeblair | o/ | 22:32 |
| *** krotscheck is now known as krotscheck_dcm | 22:32 | |
| *** netsin has joined #openstack-infra | 22:32 | |
| *** ihrachys has quit IRC | 22:32 | |
| EmilienM | fungi: when you tell me it's ok, I leave to go running | 22:33 |
| *** stewie925 has quit IRC | 22:33 | |
| fungi | EmilienM: lgtm, it's running (all except puppet-aodh which i left out since those were already run), so you can run too | 22:34 |
| *** ihrachys has joined #openstack-infra | 22:34 | |
| fungi | EmilienM: i don't get feedback on whether these complete successfully, so you'll want to double-check that all the expected tarballs show up later | 22:35 |
| EmilienM | fungi: thanks a ton for your help | 22:35 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:35 | |
| fungi | my pleasure | 22:35 |
| EmilienM | I can go running now :) | 22:35 |
| fungi | have fun! | 22:36 |
| EmilienM | thanks :) | 22:36 |
| mtreinish | clarkb, fungi, pabelanger: if you get a sec can you check the version of openstack-health installed inside the venv on health.o.o? I still don't think it's updating | 22:39 |
| mtreinish | http://health.openstack.org/runs/key/project/openstack/puppet-keystone/recent/rss should be an rss feed if it's got the latest commit (I dunno where the empty json is coming from) | 22:40 |
| *** fawadkhaliq has quit IRC | 22:40 | |
| fungi | mtreinish: i can't remember, is it installed system-wide or in a virtualenv? | 22:40 |
| mtreinish | fungi: it's in an venv | 22:40 |
| fungi | aha | 22:41 |
| fungi | 'splains why i didn't see it | 22:41 |
| mtreinish | fungi: http://git.openstack.org/cgit/openstack-infra/puppet-openstack_health/tree/manifests/api.pp#n40 | 22:41 |
| *** sdague has joined #openstack-infra | 22:41 | |
| *** gordc has quit IRC | 22:41 | |
| mtreinish | it's been on the list to just system install it | 22:41 |
| pabelanger | mtreinish: what likely happen, is the install didn't retrigger after the missing depends were added | 22:42 |
| mtreinish | pabelanger: ah, ok. So if we waited for another commit to merge that would take care of it | 22:42 |
| fungi | mtreinish: openstack-health (0.0.1.dev576, /opt/openstack-health) | 22:42 |
| pabelanger | mtreinish: Right | 22:43 |
| mtreinish | fungi: heh, I guess I need to count commits :) | 22:43 |
| *** |-paul-| has quit IRC | 22:43 | |
| fungi | mtreinish: openstack-health==0.0.1.dev576 # git sha 8093b5b | 22:44 |
| fungi | forgot i wanted pbr freeze not pip list | 22:44 |
| nibalizer | this, uh, doesn't really look right to me http://docs.openstack.org/developer/devstack/stack.sh.html | 22:44 |
| clarkb | nibalizer: ya their docs are a mess right now, the last attempt to fix them ran into other issues iirc | 22:45 |
| fungi | mtreinish: also that sha doesn't match what's checked out from git | 22:45 |
| nibalizer | it used to be so gorgeous | 22:45 |
| mtreinish | fungi: ok, well I just approved a couple of patches on my review list so hopefully after they land and puppet reruns everything will jump forward | 22:45 |
| fungi | mtreinish: seems to be four gerrit changes and a few merge commits behind master | 22:45 |
| mtreinish | fungi: yeah it probably stopped updating after the rss patch landed | 22:46 |
| fungi | mtreinish: yeah, looks like puppet has been checking out the latest ref in /opt/openstack-health but not successfully installing/upgrading | 22:46 |
| mtreinish | and the other commits came in before the xml libs were added | 22:46 |
| *** mylu has quit IRC | 22:46 | |
| fungi | mtreinish: probably because of missing the lxml build deps, yes | 22:46 |
| *** ihrachys has quit IRC | 22:47 | |
| fungi | i see those dep packages are installed now so ought to work | 22:47 |
| mtreinish | yep | 22:47 |
| mtreinish | well hopefully | 22:47 |
| fungi | unless it's gotten wedged somehow from earlier failed install attempts, but if so i can blow away the venv and recreate | 22:48 |
| * mtreinish wants to blame fungi for suggesting rss in the first place :) | 22:48 | |
| fungi | hey, i _also_ said "atom" | 22:48 |
| jeblair | i say 'finger' | 22:48 |
| fungi | YES | 22:48 |
| fungi | it's a world-class protocol | 22:49 |
| *** ihrachys has joined #openstack-infra | 22:49 | |
| mtreinish | fungi: heh, I just need to change: http://git.openstack.org/cgit/openstack/openstack-health/tree/openstack_health/api.py#n443 to call atom_str() instead to use atom | 22:50 |
| fungi | that reminded me to check that finger fungi@cthulhu.yuggoth.org still works. it does! | 22:50 |
| mordred | hesiod? | 22:51 |
| *** eil397 has joined #openstack-infra | 22:52 | |
| fungi | wow, that takes me back | 22:52 |
| openstackgerrit | Merged openstack-infra/project-config: Add a new devstack plugin based src job for ceph https://review.openstack.org/308686 | 22:53 |
| mtreinish | fungi: hmm, have you seen this before: http://logs.openstack.org/56/305556/2/gate/gate-openstack-health-npm-run-test/f1e26c2/console.html#_2016-04-21_22_45_00_467 | 22:56 |
| *** ihrachys has quit IRC | 22:57 | |
| *** mylu has joined #openstack-infra | 22:57 | |
| fungi | mtreinish: not in this situation, no | 22:58 |
| clarkb | fungi: I installed finger just for that :) | 22:59 |
| pabelanger | ha ha, same | 22:59 |
| *** xyang1 has quit IRC | 22:59 | |
| mtreinish | as did I :) | 22:59 |
| fungi | clarkb: what crazy unix are you on that doesn't have finger by default? | 22:59 |
| fungi | just kidding, a lot of distros have dropped it from their default package set these days | 22:59 |
| *** Sukhdev has quit IRC | 22:59 | |
| mtreinish | fungi: arch doesn't even keep it in the regular repos I had to build it from the AUR | 23:00 |
| fungi | wow | 23:00 |
| fungi | clarkb: did you see that job error mtreinish got? looks like it thought sudo wasn't runnable by jenkins but i don't see it being revoked either | 23:01 |
| *** mylu has quit IRC | 23:01 | |
| clarkb | mtreinish: at that point you might as well just write your own finger client in python | 23:01 |
| clarkb | fungi: I hand't looked, but I can now | 23:02 |
| fungi | finger is basically a tcp raw socket after all, with like a couple of commands it can accept | 23:02 |
| mtreinish | clarkb: heh, nah it just means I've got a -march native -O2 built version of finger on my desktop | 23:02 |
| mtreinish | clarkb: although I'm sure someone has already written a finger client in python | 23:03 |
| openstackgerrit | Merged openstack/diskimage-builder: Add Gentoo to the dhcp-all-interfaces element https://review.openstack.org/299694 | 23:03 |
| clarkb | mtreinish: I am mostly a fan of not aur'ing | 23:03 |
| clarkb | so much badness | 23:03 |
| mtreinish | http://forums.justlinux.com/showthread.php?47711-Python-finger-script | 23:04 |
| *** Sukhdev has joined #openstack-infra | 23:04 | |
| fungi | heh | 23:04 |
| clarkb | fungi: ya it looks like it wants to ask jenkins for a password | 23:05 |
| mtreinish | clarkb: sure, I can understand that. I don't mind it as much. I also maintain a couple packages there: https://aur.archlinux.org/packages/?K=mtreinish&SeB=m | 23:05 |
| fungi | i love that finger script. it's two dozen lines of stdlib pure python, if you ignore the comments | 23:05 |
| mtreinish | fungi: yeah it's pretty awesome | 23:06 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Preserve data type when constructing new container https://review.openstack.org/289343 | 23:06 |
| *** HeOS has quit IRC | 23:06 | |
| fungi | a good job of demonstrating how minimal the protocol is | 23:06 |
| *** rbrndt has quit IRC | 23:07 | |
| fungi | the second sentence of rfc 742 starts out "this is a simple protocol" | 23:08 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Use provided mapping object type instead OrderedDict https://review.openstack.org/289344 | 23:08 |
| fungi | also telling is that it's a 7-page rfc which is mostly examples | 23:09 |
| pabelanger | fungi: clarkb: that looks like an OLD version of install-distro-packages.sh | 23:09 |
| pabelanger | we do sudo apt-get -qq update now | 23:09 |
| fungi | the protocol description itself barely extends onto page 3 | 23:09 |
| fungi | pabelanger: so very old ubuntu-trusty image in rax-iad? | 23:10 |
| pabelanger | fungi: maybe | 23:10 |
| pabelanger | fungi: I can check | 23:10 |
| clarkb | wouldn't surprise me, mordreds hacking has essentially put a standstill to image updates and rax uploads are the least reliable | 23:10 |
| pabelanger | clarkb: centos-7 finished. starting upload | 23:10 |
| mtreinish | fungi: the other thing I just noticed about that finger script is it was posted 15 yrs ago | 23:12 |
| fungi | no wonder it only uses stdlib | 23:12 |
| clarkb | did it run on python 1.x? | 23:12 |
| pabelanger | fungi: I see 1 image from 4 days ago | 23:13 |
| pabelanger | other is only 22 hours old | 23:13 |
| clarkb | pabelanger: fungi oh wait is that part of the job or the image? | 23:13 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Allow id's for different templates to follow same naming https://review.openstack.org/282723 | 23:13 |
| fungi | clarkb: it could have been cutting edge and only supported python 2.1 15 years ago | 23:14 |
| mtreinish | clarkb: it must have, python 2.0 wasn't released when it was posted | 23:14 |
| pabelanger | clarkb: the script is in the image | 23:14 |
| clarkb | gotcha | 23:14 |
| pabelanger | so, possible it booted the old image? | 23:14 |
| fungi | clarkb: slave script install-distro-packages.sh | 23:14 |
| pabelanger | not sure how | 23:14 |
| mtreinish | err, or I don't think it was (just noticed all the dates on the python archive are the same across multiple releases) | 23:14 |
| fungi | pabelanger: how old would that have to have been? | 23:14 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Wrap stdout object only once with wrap_stream https://review.openstack.org/265959 | 23:15 |
| pabelanger | fungi: apparently 26 days go we merged our silence distro package | 23:15 |
| pabelanger | so something is going on here | 23:15 |
| *** sputnik13 has quit IRC | 23:16 | |
| mtreinish | clarkb: err it might have, python 2.0 was released about 6 months before the post | 23:16 |
| fungi | sunday was 15-year anniversary of the python 2.1 release | 23:17 |
| *** Adri2000 has joined #openstack-infra | 23:18 | |
| jeblair | 1.5.2 forever | 23:18 |
| fungi | pabelanger: i've confirmed the gate-{name}-npm-run-{command} job-template is definitely using our install-distro-packages macro and no revoke-sudo until later in the job | 23:18 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Support multi backends for Zaqar tempest job https://review.openstack.org/308698 | 23:18 |
| *** bpokorny_ has quit IRC | 23:18 | |
| pabelanger | clarkb: upload finished to osic | 23:19 |
| pabelanger | going to check the node before continuing | 23:19 |
| *** cody-somerville has quit IRC | 23:19 | |
| fungi | clarkb: i think this may be a fresh example of that bug i said last week we could close out | 23:20 |
| mtreinish | clarkb: I built python 1.6 and the finger script does not work. It doesn't understand += | 23:20 |
| clarkb | fungi: fun | 23:20 |
| *** markvoelker has quit IRC | 23:20 | |
| fungi | where it looks like nova boots an instance from an image which was supposed to have been deleted ages ago | 23:20 |
| clarkb | mtreinish: wow that is dedication | 23:20 |
| fungi | instead of the image we request | 23:20 |
| fungi | like indices get cross-wired in some nova host's local image cache | 23:21 |
| pabelanger | fungi: Ya, not sure | 23:21 |
| fungi | which would imply this isn't snapshot-related, because we never did snapshot-based for ubuntu-trusty | 23:21 |
| mtreinish | fwiw, the script doesn't do everything: http://paste.openstack.org/show/495064/ | 23:22 |
| *** dizquierdo has joined #openstack-infra | 23:23 | |
| fungi | mtreinish: anyway, recheck if you haven't already. this is a very strange behavior we see very infrequently and only ever in rackspace, which i'm almost certain is a problem in their systems | 23:23 |
| mtreinish | fungi: yep, already pushed the recheck :) | 23:24 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: dhcp-all-interfaces depends on dhcp https://review.openstack.org/296626 | 23:24 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: dhcp-all-interfaces depends on dib-init-system https://review.openstack.org/300842 | 23:24 |
| pabelanger | clarkb: wow, https://cloud1.osic.org is slow to login | 23:25 |
| clarkb | pabelanger: is it? I don't really use the gui except for making networks | 23:25 |
| *** dimtruck is now known as zz_dimtruck | 23:26 | |
| pabelanger | clarkb: finally, loaded. | 23:26 |
| pabelanger | ya, I should use openstack client more | 23:26 |
| pabelanger | need to brush up on shade syntax | 23:26 |
| fungi | shouldn't need shade syntax to use osc cli | 23:27 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Use generic "dhcp-client" name https://review.openstack.org/300256 | 23:27 |
| *** EricGonczer_ has quit IRC | 23:27 | |
| pabelanger | fungi: sorry, export syntax for os-client-config | 23:28 |
| fungi | and the grammer is nearly identical to the individual python clients | 23:28 |
| fungi | grammar | 23:28 |
| *** lakshmiS has joined #openstack-infra | 23:29 | |
| *** salv-orl_ has joined #openstack-infra | 23:29 | |
| pabelanger | clarkb: -rw-r--r--. root root system_u:object_r:named_conf_t:s0 forwarding.conf | 23:30 |
| pabelanger | looks good | 23:30 |
| pabelanger | unbound is running too | 23:31 |
| clarkb | yay, pabelanger run dig git.openstack.org | 23:31 |
| clarkb | and check the /etc/resolv.conf but that looks promising | 23:31 |
| zxiiro | waynr: Saw you reviewing some patches. You mind reviewing this one too? I want it merged before we cut a release https://review.openstack.org/308705 | 23:31 |
| *** bpokorny has joined #openstack-infra | 23:31 | |
| pabelanger | clarkb: http://paste.openstack.org/show/495066/ | 23:32 |
| pabelanger | clarkb: 172.99.106.38 if you want to poke around | 23:32 |
| *** salv-orlando has quit IRC | 23:32 | |
| clarkb | pabelanger: ya that lgtm | 23:33 |
| *** vhosakot has joined #openstack-infra | 23:33 | |
| *** cody-somerville has joined #openstack-infra | 23:34 | |
| *** mriedem has joined #openstack-infra | 23:36 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Move OSC team meeting even weeks to 1300 UTC Thursday https://review.openstack.org/309077 | 23:37 |
| pabelanger | clarkb: starting uploads to other clouds | 23:39 |
| *** asettle has quit IRC | 23:39 | |
| *** zz_dimtruck is now known as dimtruck | 23:40 | |
| *** asettle has joined #openstack-infra | 23:40 | |
| *** Swami has quit IRC | 23:42 | |
| *** Sukhdev has quit IRC | 23:42 | |
| flwang | clarkb: i have fixed the previous issue with your help, but the new error is also out of my knowledge scope http://logs.openstack.org/98/308698/5/check/gate-project-config-layout/095965c/console.html | 23:45 |
| *** jrmyjohn has quit IRC | 23:45 | |
| *** mylu has joined #openstack-infra | 23:46 | |
| *** dizquierdo has quit IRC | 23:46 | |
| pabelanger | if only regex worked for image-upload --provider | 23:47 |
| *** e0ne has quit IRC | 23:47 | |
| mtreinish | fungi, pabelanger: it doesn't look like puppet picked up the latest patches: http://puppetboard.openstack.org/report/health.openstack.org/24ca57e08050fda16b44630a1e4c99a47de6103e is the first run after additional changes landed | 23:48 |
| *** Goneri has joined #openstack-infra | 23:49 | |
| pabelanger | mtreinish: fungi: new errors... 1 src | 23:50 |
| pabelanger | mtreinish: fungi: http://paste.openstack.org/show/495067/ | 23:50 |
| mtreinish | pabelanger: hmm, still missing a dep? | 23:51 |
| *** mylu has quit IRC | 23:52 | |
| pabelanger | mtreinish: looks like you are missing: zlib1g-dev | 23:53 |
| mordred | clarkb: 2 leaked fips on osic since 1.5 hours ago | 23:53 |
| *** Guest82423 has quit IRC | 23:54 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Bump uc for oslo weekly release for apr 18th https://review.openstack.org/309216 | 23:55 |
| *** eil397 has left #openstack-infra | 23:55 | |
| mtreinish | pabelanger: sigh, ok I'll push another patch to add that package | 23:57 |
| *** ajmiller_ has quit IRC | 23:57 | |
| flwang | clarkb: never mind, fixed :) | 23:57 |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Support multi backends for Zaqar tempest job https://review.openstack.org/308698 | 23:57 |
| *** mylu has joined #openstack-infra | 23:58 | |
| *** SumitNaiksatam has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
