| *** s-shiono has joined #openstack-infra | 00:04 | |
| *** sflanigan has joined #openstack-infra | 00:05 | |
| *** salv-orlando has joined #openstack-infra | 00:07 | |
| *** gmann has quit IRC | 00:07 | |
| *** gmann has joined #openstack-infra | 00:07 | |
| *** salv-orlando has quit IRC | 00:12 | |
| *** felipemonteiro__ has quit IRC | 00:12 | |
| *** tsuzuki has joined #openstack-infra | 00:13 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:18 | |
| *** kzaitsev_mb has quit IRC | 00:22 | |
| *** bobh has joined #openstack-infra | 00:39 | |
| *** jkilpatr has quit IRC | 00:40 | |
| *** zhurong has joined #openstack-infra | 00:45 | |
| *** LindaWang has joined #openstack-infra | 00:48 | |
| *** tuanluong has joined #openstack-infra | 00:48 | |
| openstackgerrit | Merged openstack-infra/project-config master: Move dib image download jobs to -nv job https://review.openstack.org/476737 | 00:55 |
|---|---|---|
| openstackgerrit | Merged openstack-infra/project-config master: Revert "Pause opensuse image builds" https://review.openstack.org/476776 | 00:59 |
| *** mriedem has joined #openstack-infra | 01:02 | |
| *** salv-orlando has joined #openstack-infra | 01:08 | |
| *** gildub has quit IRC | 01:09 | |
| *** liujiong has joined #openstack-infra | 01:11 | |
| *** salv-orlando has quit IRC | 01:13 | |
| *** xinliang_ has quit IRC | 01:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 01:18 | |
| *** cshastri has joined #openstack-infra | 01:20 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Check for newlines in project descriptions https://review.openstack.org/477261 | 01:20 |
| *** gildub has joined #openstack-infra | 01:21 | |
| *** liusheng has quit IRC | 01:23 | |
| *** xinliang_ has joined #openstack-infra | 01:30 | |
| *** gcb has joined #openstack-infra | 01:32 | |
| *** hongbin has joined #openstack-infra | 01:33 | |
| *** MatthewLi has joined #openstack-infra | 01:33 | |
| *** cuongnv has joined #openstack-infra | 01:37 | |
| *** apetrich has quit IRC | 01:42 | |
| *** apetrich has joined #openstack-infra | 01:42 | |
| *** wolverineav has joined #openstack-infra | 01:46 | |
| *** bobh has quit IRC | 01:48 | |
| *** wolverineav has quit IRC | 01:50 | |
| *** zhurong has quit IRC | 02:01 | |
| *** salv-orlando has joined #openstack-infra | 02:09 | |
| *** salv-orlando has quit IRC | 02:14 | |
| *** gouthamr has joined #openstack-infra | 02:15 | |
| *** liusheng has joined #openstack-infra | 02:24 | |
| *** sbezverk has joined #openstack-infra | 02:34 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix mkfs use wrong label option for vfat https://review.openstack.org/476382 | 02:41 |
| *** zhurong has joined #openstack-infra | 02:44 | |
| *** bobh has joined #openstack-infra | 02:46 | |
| *** yee37924 has joined #openstack-infra | 02:56 | |
| *** wolverineav has joined #openstack-infra | 02:56 | |
| *** zhurong has quit IRC | 02:56 | |
| *** yee379 has quit IRC | 02:59 | |
| *** wolverineav has quit IRC | 03:00 | |
| *** armax has quit IRC | 03:04 | |
| *** armax has joined #openstack-infra | 03:04 | |
| *** tphummel has joined #openstack-infra | 03:07 | |
| *** zhurong has joined #openstack-infra | 03:07 | |
| *** bobh has quit IRC | 03:13 | |
| *** gcb has quit IRC | 03:14 | |
| *** armax has quit IRC | 03:14 | |
| *** gcb has joined #openstack-infra | 03:15 | |
| *** gouthamr has quit IRC | 03:22 | |
| *** zhurong has quit IRC | 03:23 | |
| *** zhurong has joined #openstack-infra | 03:35 | |
| ianw | clarkb: dib release, suse images rebuilt & uploaded, seem to boot fine and get network and valid unbound.conf. so i'm calling that done | 03:40 |
| *** spzala has quit IRC | 03:45 | |
| *** spzala has joined #openstack-infra | 03:47 | |
| *** spzala has quit IRC | 03:52 | |
| *** kornicameister has joined #openstack-infra | 03:54 | |
| *** yamamoto has joined #openstack-infra | 03:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: networking-odl: update graphana https://review.openstack.org/477076 | 03:54 |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo: move scenario004-multinode-oooq-container to gate https://review.openstack.org/477018 | 03:55 |
| *** wolverineav has joined #openstack-infra | 03:57 | |
| *** yamahata has joined #openstack-infra | 04:00 | |
| *** wolverineav has quit IRC | 04:01 | |
| *** amotoki_away is now known as amotoki | 04:02 | |
| *** aeng has quit IRC | 04:03 | |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: Support for Cloud Images on ppc64le for rhel7 and centos7 https://review.openstack.org/456055 | 04:08 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: [doc] Add some notes about PowerPC ARchitecture names https://review.openstack.org/477359 | 04:08 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: As far as block-device layout is concerned ppc64le == ppc64el https://review.openstack.org/477360 | 04:08 |
| *** wolverineav has joined #openstack-infra | 04:08 | |
| *** apetrich has quit IRC | 04:10 | |
| *** salv-orlando has joined #openstack-infra | 04:10 | |
| *** hongbin has quit IRC | 04:11 | |
| *** kornicameister has quit IRC | 04:11 | |
| *** apetrich has joined #openstack-infra | 04:11 | |
| *** salv-orlando has quit IRC | 04:15 | |
| *** wolverineav has quit IRC | 04:18 | |
| *** aeng has joined #openstack-infra | 04:20 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 04:21 | |
| *** adisky__ has joined #openstack-infra | 04:23 | |
| *** wolverineav has joined #openstack-infra | 04:34 | |
| *** aeng has quit IRC | 04:34 | |
| *** wolverineav has quit IRC | 04:38 | |
| *** links has joined #openstack-infra | 04:40 | |
| *** kzaitsev_mb has quit IRC | 04:40 | |
| *** kornicameister has joined #openstack-infra | 04:41 | |
| *** wolverineav has joined #openstack-infra | 04:47 | |
| *** aeng has joined #openstack-infra | 04:47 | |
| *** wolverineav has quit IRC | 04:51 | |
| *** wolverineav has joined #openstack-infra | 04:55 | |
| *** ramishra has joined #openstack-infra | 04:58 | |
| *** wolverineav has quit IRC | 05:01 | |
| *** salv-orlando has joined #openstack-infra | 05:04 | |
| *** tphummel has quit IRC | 05:28 | |
| *** dhajare has joined #openstack-infra | 05:34 | |
| openstackgerrit | Eric Kao proposed openstack-infra/project-config master: enable designate service in congress tests https://review.openstack.org/477379 | 05:37 |
| *** MasterOfBugs has joined #openstack-infra | 05:40 | |
| openstackgerrit | Merged openstack-dev/pbr master: rearrange existing documentation using the new standard layout https://review.openstack.org/476684 | 05:43 |
| *** psachin has joined #openstack-infra | 05:44 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config master: networking-midonet: Disable centos jobs on stable branches https://review.openstack.org/477382 | 05:47 |
| *** wolverineav has joined #openstack-infra | 05:50 | |
| *** Douhet has joined #openstack-infra | 05:53 | |
| *** wolverineav has quit IRC | 05:55 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Remove pholio.openstack.org https://review.openstack.org/477386 | 05:55 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: Support for Cloud Images on ppc64le for rhel7 and centos7 https://review.openstack.org/456055 | 05:58 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: [doc] Add some notes about PowerPC Architecture names https://review.openstack.org/477359 | 05:58 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: As far as block-device layout is concerned ppc64le == ppc64el https://review.openstack.org/477360 | 05:58 |
| *** wolverineav has joined #openstack-infra | 05:58 | |
| *** rcernin has joined #openstack-infra | 05:59 | |
| *** AJaeger has quit IRC | 06:07 | |
| *** MasterOfBugs has quit IRC | 06:13 | |
| *** MasterOfBugs has joined #openstack-infra | 06:13 | |
| *** wolverineav has quit IRC | 06:15 | |
| openstackgerrit | Merged openstack-infra/project-config master: Readd "update descriptions of some projects I maintain" https://review.openstack.org/476814 | 06:17 |
| *** salv-orlando has quit IRC | 06:19 | |
| *** wolverineav has joined #openstack-infra | 06:19 | |
| *** salv-orlando has joined #openstack-infra | 06:19 | |
| *** florianf has joined #openstack-infra | 06:21 | |
| *** tesseract has joined #openstack-infra | 06:24 | |
| *** salv-orlando has quit IRC | 06:24 | |
| *** wolverineav has quit IRC | 06:25 | |
| *** andreas_s has joined #openstack-infra | 06:27 | |
| *** salv-orlando has joined #openstack-infra | 06:28 | |
| *** salv-orl_ has joined #openstack-infra | 06:37 | |
| *** tushar has quit IRC | 06:38 | |
| *** markus_z has joined #openstack-infra | 06:38 | |
| *** tushar has joined #openstack-infra | 06:39 | |
| *** salv-orlando has quit IRC | 06:39 | |
| *** iyamahat has joined #openstack-infra | 06:41 | |
| *** yamahata has quit IRC | 06:43 | |
| *** pcaruana has joined #openstack-infra | 06:45 | |
| *** jpena|off is now known as jpena | 06:50 | |
| *** Hal has joined #openstack-infra | 06:52 | |
| *** shardy has joined #openstack-infra | 06:54 | |
| *** shardy has quit IRC | 06:54 | |
| *** iyamahat has quit IRC | 06:54 | |
| *** shardy has joined #openstack-infra | 07:07 | |
| openstackgerrit | Arx Cruz proposed openstack-infra/system-config master: Adding tripleo check jobs into logstash https://review.openstack.org/477421 | 07:08 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: Support for Cloud Images on ppc64le for rhel7 and centos7 https://review.openstack.org/456055 | 07:09 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: [doc] Add some notes about PowerPC Architecture names https://review.openstack.org/477359 | 07:09 |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: As far as block-device layout is concerned ppc64le == ppc64el https://review.openstack.org/477360 | 07:09 |
| *** e0ne has joined #openstack-infra | 07:15 | |
| *** jascott1 has quit IRC | 07:15 | |
| *** jascott1 has joined #openstack-infra | 07:16 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: Disable Swift on Kuryr-K8s tempest gate https://review.openstack.org/477423 | 07:19 |
| *** jascott1 has quit IRC | 07:20 | |
| *** ccamacho has joined #openstack-infra | 07:21 | |
| *** tushar has quit IRC | 07:27 | |
| *** gildub has quit IRC | 07:28 | |
| *** amoralej|off is now known as amoralej | 07:30 | |
| *** tushar has joined #openstack-infra | 07:30 | |
| *** Hal has quit IRC | 07:30 | |
| *** martinkopec has joined #openstack-infra | 07:33 | |
| *** jpich has joined #openstack-infra | 07:35 | |
| *** ralonsoh has joined #openstack-infra | 07:44 | |
| *** hashar has joined #openstack-infra | 07:48 | |
| *** Hal has joined #openstack-infra | 07:48 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/diskimage-builder master: Replace new location of isolinux.bin for Ubuntu 16.04 https://review.openstack.org/477437 | 07:54 |
| openstackgerrit | Tuan Luong-Anh proposed openstack/diskimage-builder master: Replace new location of isolinux.bin for Ubuntu 16.04 https://review.openstack.org/477437 | 07:56 |
| openstackgerrit | Merged openstack-dev/pbr master: Trivial: Fix docstring https://review.openstack.org/477238 | 07:56 |
| *** rossella_ has joined #openstack-infra | 07:57 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/diskimage-builder master: Replace new location of isolinux.bin for Ubuntu 16.04 https://review.openstack.org/477437 | 07:57 |
| *** pcaruana has quit IRC | 07:58 | |
| *** rcernin has quit IRC | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** raissa has quit IRC | 08:03 | |
| *** raissa has joined #openstack-infra | 08:10 | |
| *** dhajare has quit IRC | 08:11 | |
| *** rcernin has joined #openstack-infra | 08:11 | |
| *** pcaruana has joined #openstack-infra | 08:12 | |
| *** rossella_ has quit IRC | 08:18 | |
| *** rossella_ has joined #openstack-infra | 08:20 | |
| *** junbo has quit IRC | 08:21 | |
| *** spzala has joined #openstack-infra | 08:21 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config master: convert oslo.reports to the new unified doc build https://review.openstack.org/477444 | 08:22 |
| *** junbo has joined #openstack-infra | 08:25 | |
| *** spzala has quit IRC | 08:26 | |
| *** s-shiono has quit IRC | 08:31 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: bifrost: Promote the openSUSE jobs to non-voting https://review.openstack.org/477448 | 08:35 |
| *** ivyyy has quit IRC | 08:36 | |
| *** ivyyy has joined #openstack-infra | 08:37 | |
| *** yamamoto has quit IRC | 08:38 | |
| *** bauwser is now known as bauzas | 08:39 | |
| *** yamamoto has joined #openstack-infra | 08:39 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix names of periodic jobs in promotion script https://review.openstack.org/477452 | 08:40 |
| *** derekh has joined #openstack-infra | 08:42 | |
| *** dhajare has joined #openstack-infra | 08:43 | |
| *** tsuzuki has quit IRC | 08:43 | |
| *** psachin has quit IRC | 08:43 | |
| *** yamamoto has quit IRC | 08:45 | |
| *** MasterOfBugs has quit IRC | 08:47 | |
| *** rwsu has joined #openstack-infra | 08:47 | |
| *** dtantsur|afk is now known as dtantsur | 08:48 | |
| openstackgerrit | Merged openstack-infra/project-config master: enable designate service in congress tests https://review.openstack.org/477379 | 08:50 |
| *** shen has joined #openstack-infra | 08:52 | |
| shen | Hi, I am trying to set up a CI environment, and get some troubles. I follow the guild 'https://docs.openstack.org/infra/openstackci/third_party_ci.html', and in the end of step 'start nodepool' I get a HTTP Error 405, following is the error log in /var/log/nodepool/nodepool.log: ``` 2017-06-22 10:53:08,712 INFO nodepool.NodeLauncher: Node id: 469 is ready 2017-06-22 10:53:08,889 ERROR nodepool.NodeLauncher: HTTPError launching | 08:52 |
| openstackgerrit | Merged openstack-infra/project-config master: networking-midonet: Disable centos jobs on stable branches https://review.openstack.org/477382 | 08:52 |
| openstackgerrit | Merged openstack-infra/project-config master: Check for newlines in project descriptions https://review.openstack.org/477261 | 08:53 |
| openstackgerrit | Merged openstack-infra/project-config master: switch puppet-openstack-guide to unified docs build https://review.openstack.org/477028 | 08:53 |
| openstackgerrit | Merged openstack-infra/project-config master: switch os-client-config to the new unified doc jobs https://review.openstack.org/476670 | 08:54 |
| openstackgerrit | Merged openstack-infra/project-config master: convert pbr to the new unified documentation jobs https://review.openstack.org/476689 | 08:57 |
| openstackgerrit | Merged openstack-infra/project-config master: ceilometer: do not install Gnocchi via devstack in master https://review.openstack.org/468876 | 08:57 |
| openstackgerrit | Merged openstack-infra/project-config master: nova-lxd: Add py35 tests, refactor to use templates https://review.openstack.org/476890 | 08:57 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Change time for periodic OVB TripleO CI jobs https://review.openstack.org/477456 | 08:57 |
| sshnaidm | amoralej, ^^ | 08:57 |
| amoralej | sshnaidm, thx | 09:02 |
| *** khappone has quit IRC | 09:03 | |
| *** yamamoto has joined #openstack-infra | 09:03 | |
| *** spzala has joined #openstack-infra | 09:05 | |
| *** khappone has joined #openstack-infra | 09:05 | |
| *** spzala has quit IRC | 09:09 | |
| *** hashar has quit IRC | 09:13 | |
| *** hashar has joined #openstack-infra | 09:14 | |
| *** tosky has joined #openstack-infra | 09:14 | |
| *** jascott1 has joined #openstack-infra | 09:17 | |
| *** electrofelix has joined #openstack-infra | 09:20 | |
| *** jascott1 has quit IRC | 09:21 | |
| electrofelix | jamielennox: wonder if you've had a chance to look at https://review.openstack.org/475474 to fix a bug with the Mocker decorator applied to a method called multiple times. | 09:23 |
| jamielennox | electrofelix: i hadn't seen it no | 09:24 |
| jamielennox | but that seems like a likely problem | 09:25 |
| electrofelix | I took a relatively naive approach in looking at noticing how the class decorator used a copy | 09:26 |
| *** rwsu has quit IRC | 09:26 | |
| jamielennox | electrofelix: i don't really like using the class decorator so i haven't come across it yet | 09:27 |
| jamielennox | electrofelix: why take the value from self._adapter._case_sensitive rather than self.case_sensitive? | 09:27 |
| *** rkukura has quit IRC | 09:27 | |
| jamielennox | oh, we don't update it from kwargs | 09:28 |
| electrofelix | jamielennox: because it looks like that is simply a default value used in case case_sensitive isn't passed through as a kwarg to the __init__ | 09:28 |
| electrofelix | yep ;-) | 09:28 |
| *** rkukura has joined #openstack-infra | 09:28 | |
| electrofelix | I'm guessing that could be changed in the 2.x release? | 09:29 |
| jamielennox | yea, so it's an annoying bug that has cause a number of problems - but i don't see why we couldn't update self.case_sensitive at that point | 09:29 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Fix names of periodic jobs in promotion script https://review.openstack.org/477452 | 09:30 |
| *** shu-mutou is now known as shu-mutou-AWAY | 09:30 | |
| electrofelix | jamielennox: because that would change the value for all instances | 09:30 |
| jamielennox | the class value is there because (as mentioned in the comment) you can fix the issue for the whole project | 09:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/477468 | 09:31 |
| jamielennox | however if we do: self.case_sensitive = kwargs.pop('case_sensitive', self.case_sensitive) that shouldn't be an issue | 09:31 |
| electrofelix | jamielennox: would that not change the default behaviour for all subsequent class creations? | 09:31 |
| jamielennox | the instance variable will have priority over the class variable, but it doesn't actually change it for other classes | 09:31 |
| electrofelix | jamielennox: I'll have a look, didn't think I could safely shadow a class attribute | 09:33 |
| jamielennox | electrofelix: no, the way super() works in python it walks up the hierarchy and takes the first available, so when self.case_sensitive is defined class.case_sensitive is still set to the old value, just the instance taken instead | 09:33 |
| jamielennox | electrofelix: this is a really interesting topic that i'm not feeling elequent enough to explain, but there are some great blog posts | 09:34 |
| electrofelix | that's good to know, guess I'm still learning details about python after many years using it ;-) | 09:34 |
| electrofelix | no, makes sense, I just didn't realise that was how it worked | 09:34 |
| *** sambetts|afk is now known as sambetts | 09:35 | |
| jamielennox | electrofelix: but in summary: http://paste.openstack.org/show/613685/ | 09:35 |
| jamielennox | doh | 09:36 |
| jamielennox | http://paste.openstack.org/show/613686/ | 09:36 |
| jamielennox | so i'd prefer to change that to update self.case_sensitive, and then use self.case_sensitive in the copy() | 09:37 |
| *** rwsu has joined #openstack-infra | 09:42 | |
| *** jamesden_ has joined #openstack-infra | 09:46 | |
| *** rcernin has quit IRC | 09:46 | |
| *** jamesdenton has quit IRC | 09:47 | |
| *** aarefiev_afk is now known as aarefiev | 09:47 | |
| *** spzala has joined #openstack-infra | 09:48 | |
| *** spzala has quit IRC | 09:53 | |
| *** rossella_ has quit IRC | 09:54 | |
| *** stakeda has quit IRC | 09:56 | |
| *** salv-orl_ has quit IRC | 09:56 | |
| *** salv-orlando has joined #openstack-infra | 09:57 | |
| openstackgerrit | Gergely Csatari proposed openstack-infra/project-config master: Adding Vitrage install guide https://review.openstack.org/471786 | 09:59 |
| *** salv-orlando has quit IRC | 10:01 | |
| *** rcernin has joined #openstack-infra | 10:02 | |
| *** spzala has joined #openstack-infra | 10:04 | |
| *** kornicameister has quit IRC | 10:05 | |
| *** liujiong has quit IRC | 10:05 | |
| *** spzala has quit IRC | 10:08 | |
| *** rossella_ has joined #openstack-infra | 10:10 | |
| electrofelix | jamielennox: done, thanks for the pointers | 10:16 |
| *** yamamoto has quit IRC | 10:17 | |
| *** cshastri has quit IRC | 10:19 | |
| *** spzala has joined #openstack-infra | 10:19 | |
| *** kornicameister has joined #openstack-infra | 10:21 | |
| *** dizquierdo has joined #openstack-infra | 10:22 | |
| *** spzala has quit IRC | 10:24 | |
| *** jaosorior has joined #openstack-infra | 10:30 | |
| *** florianf has quit IRC | 10:36 | |
| *** LindaWang has quit IRC | 10:37 | |
| *** florianf has joined #openstack-infra | 10:41 | |
| *** mriedem has quit IRC | 10:41 | |
| *** Hal has quit IRC | 10:43 | |
| *** tosky has quit IRC | 10:49 | |
| *** ericyoung has joined #openstack-infra | 10:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/477468 | 10:53 |
| *** pcaruana has quit IRC | 10:53 | |
| *** LindaWang has joined #openstack-infra | 10:53 | |
| *** yamamoto has joined #openstack-infra | 10:59 | |
| *** rossella_ has quit IRC | 10:59 | |
| *** cuongnv has quit IRC | 11:01 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: DNM Test patch to find bug with nics https://review.openstack.org/473452 | 11:02 |
| *** pblaho has joined #openstack-infra | 11:02 | |
| electrofelix | anyone around to review some fixes for git-review? https://review.openstack.org/389701 - fix output with python3, https://review.openstack.org/244083 - add topic field to output, https://review.openstack.org/398353 - refactor display code | 11:03 |
| *** ccamacho is now known as ccamacho|lunch | 11:03 | |
| electrofelix | oh and https://review.openstack.org/312056 - limit list reviews by branch if set | 11:03 |
| *** pcaruana has joined #openstack-infra | 11:05 | |
| *** tosky has joined #openstack-infra | 11:06 | |
| *** jkilpatr has joined #openstack-infra | 11:06 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: WIP Make revision_number go away for testing https://review.openstack.org/477175 | 11:07 |
| *** rhallisey has joined #openstack-infra | 11:10 | |
| *** martinkopec has quit IRC | 11:11 | |
| *** martinkopec has joined #openstack-infra | 11:11 | |
| *** sdague has joined #openstack-infra | 11:12 | |
| *** gcb has quit IRC | 11:15 | |
| *** rossella_ has joined #openstack-infra | 11:15 | |
| mordred | electrofelix: all +2 from me | 11:16 |
| mordred | maybe fungi will get a moment when he's up to check them out | 11:16 |
| electrofelix | mordred: thanks, I've been meaning to follow up on them for ages | 11:17 |
| mordred | electrofelix: our stacks get rather deep don't they? | 11:20 |
| *** AJaeger has joined #openstack-infra | 11:21 | |
| *** ericyoung has quit IRC | 11:22 | |
| electrofelix | mordred: we're all just event driven processes with preemptive handing for critical bugs at heart | 11:23 |
| *** shen has quit IRC | 11:24 | |
| *** ericyoung has joined #openstack-infra | 11:25 | |
| *** jaypipes has joined #openstack-infra | 11:26 | |
| *** slagle_ is now known as slagle | 11:30 | |
| *** alexchadin has joined #openstack-infra | 11:31 | |
| mordred | electrofelix: ++ | 11:31 |
| *** yamamoto has quit IRC | 11:37 | |
| *** pradk has quit IRC | 11:38 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Fix dict key copy operation https://review.openstack.org/476902 | 11:39 |
| dnikishov | AJaeger: hello, does https://review.openstack.org/#/c/475323/ look good? if not, who else I might need to get reviews from on it? | 11:43 |
| *** ldnunes has joined #openstack-infra | 11:44 | |
| *** dizquierdo has quit IRC | 11:47 | |
| *** witek has joined #openstack-infra | 11:48 | |
| witek | hello | 11:58 |
| witek | is it a strong requirement for every OpenStack project to have its own devstack plugin? | 11:58 |
| *** sshnaidm is now known as sshnaidm|afk | 11:58 | |
| witek | in Monasca project, the installation of the system is quite complex | 11:58 |
| witek | and maintaining the devstack plugin has always been a significant effort for our small team | 11:59 |
| witek | in the last months we have done a lot of work to install Monasca using Docker containers | 11:59 |
| witek | would it be possible to use such environment instead of devstack to run tempest tests in OpenStack CI? | 11:59 |
| openstackgerrit | Merged openstack-infra/project-config master: Add fuel-plugin-detach-netnode https://review.openstack.org/475323 | 12:00 |
| *** dprince has joined #openstack-infra | 12:00 | |
| AJaeger | witek: better ask the QA team on #openstack-qa | 12:00 |
| *** rossella_ has quit IRC | 12:01 | |
| AJaeger | witek: (on the requirement) | 12:01 |
| arxcruz | mtreinish: hey, around? Can you take a look at https://review.openstack.org/#/c/475788/ ? | 12:01 |
| arxcruz | the stackviz on tripleo jobs are being overwritted because of the process_stackviz | 12:02 |
| *** rcernin has quit IRC | 12:02 | |
| *** amoralej is now known as amoralej|lunch | 12:02 | |
| witek | AJaeger: but technically it shouldn't be a problem, right? | 12:02 |
| *** rcernin has joined #openstack-infra | 12:04 | |
| AJaeger | witek: something for others to answer - My expectation: Far too early for that - we start VMs for each test... | 12:05 |
| openstackgerrit | Attila Darazs proposed openstack-infra/project-config master: tripleo: move containerized scenario002 to gate https://review.openstack.org/477505 | 12:05 |
| * AJaeger does not know how exactly kolla and tripleo use container for testing | 12:05 | |
| witek | AJaeger: thanks anyway | 12:06 |
| dnikishov | AJaeger: thanks! | 12:08 |
| mtreinish | arxcruz: is the problem that the tripleo jobs generate there own stackviz data? | 12:08 |
| mtreinish | it feels weird to me that tripleo would use devstack gate at all... | 12:08 |
| arxcruz | mtreinish: yes, that's the problem, and we use to call our internal scripts... | 12:12 |
| arxcruz | would be nice to at least have the option to not call the process_stackviz | 12:12 |
| openstackgerrit | Attila Darazs proposed openstack-infra/project-config master: tripleo: move containerized scenario002 to gate https://review.openstack.org/477505 | 12:13 |
| *** yamamoto has joined #openstack-infra | 12:13 | |
| *** rossella_ has joined #openstack-infra | 12:13 | |
| *** jpena is now known as jpena|lunch | 12:14 | |
| *** ldnunes has quit IRC | 12:15 | |
| *** gordc has joined #openstack-infra | 12:17 | |
| *** tushar has quit IRC | 12:20 | |
| dnikishov | AJaeger: can I also be added to fuel-plugin-detach-netnode-core and fuel-plugin-detach-netnode-release groups? | 12:21 |
| *** rcernin has quit IRC | 12:21 | |
| *** rcernin has joined #openstack-infra | 12:21 | |
| *** Hal has joined #openstack-infra | 12:23 | |
| *** tushar has joined #openstack-infra | 12:23 | |
| *** ccamacho|lunch is now known as ccamacho | 12:25 | |
| *** ldnunes has joined #openstack-infra | 12:28 | |
| *** salv-orlando has joined #openstack-infra | 12:29 | |
| *** ralonsoh has quit IRC | 12:30 | |
| *** baoli has joined #openstack-infra | 12:31 | |
| *** rlandy has joined #openstack-infra | 12:31 | |
| openstackgerrit | Merged openstack-infra/project-config master: Disable Swift on Kuryr-K8s tempest gate https://review.openstack.org/477423 | 12:32 |
| *** jcoufal has joined #openstack-infra | 12:32 | |
| *** salv-orlando has quit IRC | 12:33 | |
| *** rfolco has joined #openstack-infra | 12:34 | |
| *** baoli has quit IRC | 12:35 | |
| *** martinkopec has quit IRC | 12:36 | |
| *** trown|outtypewww is now known as trown | 12:40 | |
| *** bobh has joined #openstack-infra | 12:40 | |
| *** mdrabe has joined #openstack-infra | 12:41 | |
| *** jamesdenton has joined #openstack-infra | 12:42 | |
| *** jamesden_ has quit IRC | 12:43 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool request handling code https://review.openstack.org/468748 | 12:43 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Abstract Nodepool provider management code https://review.openstack.org/468749 | 12:43 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Collect request handling implementation in an OpenStack driver https://review.openstack.org/468750 | 12:43 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Extend Nodepool configuration syntax to support multiple drivers https://review.openstack.org/468751 | 12:43 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool feature/zuulv3: Implement a static driver for Nodepool https://review.openstack.org/468624 | 12:43 |
| *** spzala has joined #openstack-infra | 12:48 | |
| *** bobh has quit IRC | 12:50 | |
| *** kgiusti has joined #openstack-infra | 12:50 | |
| *** tuanluong has quit IRC | 12:50 | |
| *** camunoz has joined #openstack-infra | 12:52 | |
| *** spzala has quit IRC | 12:53 | |
| *** jkilpatr has quit IRC | 12:54 | |
| *** hrybacki is now known as hrybacki|trainin | 12:55 | |
| *** edmondsw_ has joined #openstack-infra | 12:56 | |
| *** wolverineav has joined #openstack-infra | 12:57 | |
| *** edmondsw_ has quit IRC | 12:59 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool feature/zuulv3: Add tox py35 environment https://review.openstack.org/477525 | 12:59 |
| *** rossella_ has quit IRC | 13:04 | |
| *** isaacb has joined #openstack-infra | 13:04 | |
| *** jkilpatr has joined #openstack-infra | 13:08 | |
| *** florianf has quit IRC | 13:16 | |
| *** gouthamr has joined #openstack-infra | 13:17 | |
| *** florianf has joined #openstack-infra | 13:18 | |
| *** amoralej|lunch is now known as amoralej | 13:19 | |
| *** jheroux has joined #openstack-infra | 13:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:19 |
| *** ralonsoh has joined #openstack-infra | 13:21 | |
| *** ivyyy has quit IRC | 13:23 | |
| *** electrofelix has quit IRC | 13:23 | |
| *** jpena|lunch is now known as jpena | 13:24 | |
| *** rossella_ has joined #openstack-infra | 13:25 | |
| *** gouthamr has quit IRC | 13:26 | |
| *** esberglu has joined #openstack-infra | 13:26 | |
| *** felipemonteiro has joined #openstack-infra | 13:28 | |
| *** salv-orlando has joined #openstack-infra | 13:30 | |
| *** felipemonteiro_ has joined #openstack-infra | 13:30 | |
| *** edmondsw_ has joined #openstack-infra | 13:31 | |
| *** thorst has joined #openstack-infra | 13:31 | |
| *** yland has joined #openstack-infra | 13:32 | |
| *** edmondsw_ has quit IRC | 13:32 | |
| *** rossella_ has quit IRC | 13:32 | |
| *** eharney has joined #openstack-infra | 13:33 | |
| *** spzala has joined #openstack-infra | 13:34 | |
| *** salv-orlando has quit IRC | 13:34 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:34 |
| *** felipemonteiro has quit IRC | 13:34 | |
| *** dhajare has quit IRC | 13:34 | |
| *** felipemonteiro_ has quit IRC | 13:37 | |
| *** felipemonteiro has joined #openstack-infra | 13:38 | |
| AJaeger | dnikishov: I don't have those permissions | 13:38 |
| AJaeger | dnikishov: give full details (Reference link to change) and ask later again, hope somebody picks it up | 13:38 |
| *** spzala has quit IRC | 13:39 | |
| *** ijw has joined #openstack-infra | 13:41 | |
| *** gcb has joined #openstack-infra | 13:42 | |
| *** spzala has joined #openstack-infra | 13:42 | |
| *** dhajare has joined #openstack-infra | 13:43 | |
| *** xyang1 has joined #openstack-infra | 13:43 | |
| openstackgerrit | Dong Ma proposed openstack-infra/jenkins-job-builder master: Update dependency_check plugin https://review.openstack.org/477537 | 13:44 |
| *** tphummel has joined #openstack-infra | 13:45 | |
| *** bobh has joined #openstack-infra | 13:45 | |
| *** rossella_ has joined #openstack-infra | 13:48 | |
| *** camunoz has quit IRC | 13:49 | |
| *** srwilkers has joined #openstack-infra | 13:50 | |
| *** superdan is now known as dansmith | 13:50 | |
| srwilkers | clarkb, fungi: what do i need to do to get some cores added to openstack-helm-infra? | 13:51 |
| *** chlong has joined #openstack-infra | 13:52 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci master: Add script parsing status multinode periodic jobs https://review.openstack.org/475197 | 13:53 |
| AJaeger | srwilkers: is the initial person added? | 13:55 |
| AJaeger | If not, link to the change that merged and created them and ask for initial person to be added. | 13:55 |
| AJaeger | srwilkers: btw. too early for clarkb - and fungi is not around today. They might read backscroll | 13:55 |
| srwilkers | oh nice, thanks AJaeger. https://review.openstack.org/#/c/469079/, lamt would be the one that needs added | 13:57 |
| AJaeger | infra-root, could somebody set up the ACLs, please ? ^ | 13:57 |
| *** links has quit IRC | 13:58 | |
| *** esberglu has quit IRC | 13:59 | |
| *** esberglu has joined #openstack-infra | 14:00 | |
| *** mriedem has joined #openstack-infra | 14:00 | |
| *** chlong has quit IRC | 14:01 | |
| jhesketh | AJaeger: I can take a look | 14:03 |
| jhesketh | srwilkers: excuse my ignorance, who is the ptl/should be the first member? | 14:04 |
| *** esberglu has quit IRC | 14:04 | |
| srwilkers | jhesketh: lamt (Tin Lam) should be added first i think, since he's the one who submitted the patchset to bring it up | 14:04 |
| *** camunoz has joined #openstack-infra | 14:04 | |
| *** rbrndt has joined #openstack-infra | 14:05 | |
| *** edmondsw_ has joined #openstack-infra | 14:05 | |
| jhesketh | srwilkers: yep, I've added him to both the core and infra groups | 14:05 |
| *** salv-orlando has joined #openstack-infra | 14:05 | |
| srwilkers | awesome, thank you :) | 14:05 |
| jhesketh | no worries :-) | 14:06 |
| *** edmondsw_ has quit IRC | 14:09 | |
| *** felipemonteiro_ has joined #openstack-infra | 14:09 | |
| *** felipemonteiro has quit IRC | 14:12 | |
| *** chlong has joined #openstack-infra | 14:14 | |
| *** Hal has quit IRC | 14:16 | |
| *** yland has quit IRC | 14:17 | |
| *** tphummel has quit IRC | 14:22 | |
| *** alexchadin has quit IRC | 14:22 | |
| *** hongbin has joined #openstack-infra | 14:24 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 14:24 |
| *** sshnaidm|afk is now known as sshnaidm | 14:24 | |
| sshnaidm | yolanda, pabelanger can you please review in your time? "Set up new logstash index files for TripleO" https://review.openstack.org/#/c/476524/ | 14:25 |
| *** ijw has quit IRC | 14:29 | |
| *** ijw has joined #openstack-infra | 14:30 | |
| *** eeiden has quit IRC | 14:30 | |
| *** markmcclain has quit IRC | 14:32 | |
| *** ijw has quit IRC | 14:32 | |
| *** jtomasek is now known as jtomasek|afk | 14:32 | |
| *** esberglu has joined #openstack-infra | 14:32 | |
| *** ijw has joined #openstack-infra | 14:32 | |
| *** markmcclain has joined #openstack-infra | 14:33 | |
| *** rossella_ has quit IRC | 14:38 | |
| *** srwilkers has quit IRC | 14:39 | |
| *** nibalizer has quit IRC | 14:40 | |
| *** xarses has joined #openstack-infra | 14:41 | |
| *** yamahata has joined #openstack-infra | 14:41 | |
| *** trown is now known as trown|brb | 14:41 | |
| *** Guest16704 is now known as rook | 14:42 | |
| *** dizquierdo has joined #openstack-infra | 14:43 | |
| *** electrofelix has joined #openstack-infra | 14:44 | |
| *** trown|brb is now known as trown | 14:45 | |
| *** pradk has joined #openstack-infra | 14:47 | |
| *** pradk has quit IRC | 14:47 | |
| *** camunoz has quit IRC | 14:48 | |
| clarkb | sshnaidm: how is progress on cleaning up the logs? looks like docs are still being built in every job and etc/ is still full of items (just looking at recent tripleo-common change that merged) | 14:50 |
| sshnaidm | clarkb, we'll have docs in periodic jobs, so we can remove them from gates: https://review.openstack.org/475480 | 14:52 |
| sshnaidm | clarkb, about /etc folders in containers, I don't think we have something in pipeline when we reduced the size significantly last time | 14:52 |
| sshnaidm | clarkb, how much does it take now in comparison to other jobs? | 14:53 |
| *** LindaWang has quit IRC | 14:53 | |
| *** rossella_ has joined #openstack-infra | 14:53 | |
| clarkb | sshnaidm: I haven't run a check on disk usage yet but it was much lower last I checked. I'd just like to see the other items we identified for cleanup cleaned up (docs, etc/ etc) | 14:54 |
| clarkb | ianw: thanks for getting suse images building again | 14:55 |
| *** andreww has joined #openstack-infra | 14:56 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add multinode jobs to promotion https://review.openstack.org/475200 | 14:56 |
| *** felipemonteiro_ has quit IRC | 14:57 | |
| *** xarses_ has quit IRC | 14:58 | |
| *** mriedem has quit IRC | 14:58 | |
| *** Julien-zte has joined #openstack-infra | 15:00 | |
| *** camunoz has joined #openstack-infra | 15:00 | |
| *** xarses_ has joined #openstack-infra | 15:00 | |
| *** andreww has quit IRC | 15:00 | |
| *** rcernin has quit IRC | 15:04 | |
| *** mriedem has joined #openstack-infra | 15:04 | |
| *** wolverineav has quit IRC | 15:06 | |
| *** wolverineav has joined #openstack-infra | 15:06 | |
| *** rbrndt has quit IRC | 15:07 | |
| *** rbrndt_ has joined #openstack-infra | 15:07 | |
| *** mriedem has quit IRC | 15:08 | |
| clarkb | rally rally jobs hit http://www.openstack.org in a HttpRequests.check_random_request test | 15:10 |
| *** Julien-zte has quit IRC | 15:12 | |
| *** rossella_ has quit IRC | 15:12 | |
| *** Julien-zte has joined #openstack-infra | 15:13 | |
| *** ijw has quit IRC | 15:16 | |
| *** wolverineav has quit IRC | 15:16 | |
| *** ijw has joined #openstack-infra | 15:16 | |
| *** marst has joined #openstack-infra | 15:17 | |
| *** tphummel has joined #openstack-infra | 15:17 | |
| *** links has joined #openstack-infra | 15:18 | |
| *** Julien-zte has quit IRC | 15:20 | |
| *** jascott1 has joined #openstack-infra | 15:20 | |
| *** aarefiev is now known as aarefiev_afk | 15:20 | |
| *** yamamoto has quit IRC | 15:21 | |
| *** yamahata has quit IRC | 15:21 | |
| clarkb | http://tarballs.openstack.org/ci/gerrit/plugins/its-storyboard/its-storyboard-805f9ac.jar and http://tarballs.openstack.org/ci/gerrit/plugins/javamelody/javamelody-v2.13.3.e4233d6.jar built implying those build are working \o/ the version on melody file won't work with our current puppetry to install gerrit plugins though. Will have to sort that out | 15:22 |
| clarkb | fungi: we are very close to being able to try another review-dev upgrade ^ | 15:22 |
| *** Julien-zte has joined #openstack-infra | 15:22 | |
| *** jascott1 has quit IRC | 15:24 | |
| *** yamamoto has joined #openstack-infra | 15:24 | |
| *** links has quit IRC | 15:25 | |
| *** felipemonteiro has joined #openstack-infra | 15:25 | |
| *** rossella_ has joined #openstack-infra | 15:25 | |
| *** ramishra has quit IRC | 15:27 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:27 | |
| *** chlong has quit IRC | 15:27 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 15:29 |
| *** yamamoto has quit IRC | 15:29 | |
| *** felipemonteiro has quit IRC | 15:30 | |
| *** e0ne has quit IRC | 15:31 | |
| *** ijw has quit IRC | 15:34 | |
| *** andreas_s has quit IRC | 15:35 | |
| *** dizquierdo has quit IRC | 15:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add configuration documentation https://review.openstack.org/463328 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Reorganize docs into user/admin guide https://review.openstack.org/475928 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use oslosphinx theme https://review.openstack.org/477585 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move status_expiry to webapp section https://review.openstack.org/477586 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move tenant_config option to scheduler section https://review.openstack.org/477587 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct sample zuul.conf https://review.openstack.org/477588 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use executor section of zuul.conf for executor dirs https://review.openstack.org/477589 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use scheduler-specific log config and pidfile https://review.openstack.org/477590 | 15:40 |
| *** Julien-zte has quit IRC | 15:40 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move zookeeper_hosts to zookeeper section https://review.openstack.org/477591 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add some information about canonical_hostname https://review.openstack.org/477592 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix some inconsistent indentation in docs https://review.openstack.org/477593 | 15:40 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename git_host to server in github driver https://review.openstack.org/477594 | 15:40 |
| *** chlong has joined #openstack-infra | 15:41 | |
| *** Julien-zte has joined #openstack-infra | 15:41 | |
| *** Julien-zte has quit IRC | 15:41 | |
| *** gcb has quit IRC | 15:41 | |
| *** Julien-zte has joined #openstack-infra | 15:41 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: Use export tempest plugins https://review.openstack.org/477595 | 15:47 |
| *** tosky has quit IRC | 15:49 | |
| *** Julien-zte has quit IRC | 15:50 | |
| *** markus_z has quit IRC | 15:50 | |
| *** Julien-zte has joined #openstack-infra | 15:50 | |
| *** rossella_ has quit IRC | 15:51 | |
| *** Julien-zte has quit IRC | 15:55 | |
| *** nich0s has joined #openstack-infra | 15:55 | |
| *** Julien-zte has joined #openstack-infra | 15:56 | |
| *** isaacb has quit IRC | 15:57 | |
| *** annegentle has joined #openstack-infra | 15:58 | |
| *** rossella_ has joined #openstack-infra | 16:00 | |
| *** rbrndt_ has quit IRC | 16:00 | |
| *** rbrndt_ has joined #openstack-infra | 16:00 | |
| *** rbrndt_ has quit IRC | 16:01 | |
| openstackgerrit | Yaron de Leeuw proposed openstack-infra/jenkins-job-builder master: Add groovy-script options to extended parameters https://review.openstack.org/477003 | 16:01 |
| *** pblaho has quit IRC | 16:02 | |
| inc0 | good morning everyone, so quick question about publishing to dockerhub. https://review.openstack.org/#/c/476989/3 when this merges and related changes to kolla merges, we'll tested tarball in tarballs.o.o | 16:03 |
| *** pcaruana has quit IRC | 16:03 | |
| inc0 | so we will be able to run job to pull from these tarballs and upload to registries | 16:03 |
| inc0 | which means access to secrets | 16:03 |
| inc0 | how do we go about that? | 16:04 |
| *** jamesmcarthur has joined #openstack-infra | 16:05 | |
| *** amotoki is now known as amotoki_away | 16:05 | |
| clarkb | inc0: you have to set up a job that runs on a static test node with access to those secrets. This job can only run code within in the project-config repo to control access to those secrets | 16:05 |
| *** ijw has joined #openstack-infra | 16:06 | |
| inc0 | so, static node which will run cronjob? how do I define it? | 16:06 |
| *** iyamahat has joined #openstack-infra | 16:06 | |
| inc0 | and where do I write code to do execute? | 16:06 |
| clarkb | inc0: in openstack-infra/system-config/manifests/site.pp look at proposal.slave.openstack.org for examples on how we set up the static node and hand it secrets | 16:07 |
| *** ijw has quit IRC | 16:08 | |
| clarkb | inc0: for code to execute I think we have been keeping those scripts in project-config/jenkins/scripts, but if it is a small amout of code you might just put it in the jjb directly | 16:08 |
| *** cody-somerville has joined #openstack-infra | 16:08 | |
| *** cody-somerville has quit IRC | 16:08 | |
| *** cody-somerville has joined #openstack-infra | 16:08 | |
| inc0 | well, I wrote some python to do the job | 16:08 |
| clarkb | the project-config/jenkins/scripts should be fine | 16:08 |
| *** Julien-zte has quit IRC | 16:09 | |
| inc0 | ok I'll clean it up and make single workflow, then get back to you | 16:09 |
| inc0 | one thing tho, this process will require docker deamon running | 16:09 |
| *** Apoorva has joined #openstack-infra | 16:10 | |
| *** gyee has joined #openstack-infra | 16:11 | |
| *** tosky has joined #openstack-infra | 16:11 | |
| *** jpich has quit IRC | 16:14 | |
| *** pcaruana has joined #openstack-infra | 16:14 | |
| *** isaacb has joined #openstack-infra | 16:15 | |
| *** pblaho has joined #openstack-infra | 16:16 | |
| *** jtomasek|afk is now known as jtomasek | 16:24 | |
| *** jpena is now known as jpena|off | 16:24 | |
| openstackgerrit | Daniel Mellado proposed openstack-infra/project-config master: Use export tempest plugins https://review.openstack.org/477595 | 16:26 |
| *** yamamoto has joined #openstack-infra | 16:27 | |
| *** yamamoto has quit IRC | 16:32 | |
| clarkb | infra-root can we get a second review on https://review.openstack.org/#/c/476929/ ? expected to correct the problem with cgit config we ran into thursday/friday | 16:34 |
| jeblair | clarkb: o/ | 16:38 |
| clarkb | morning | 16:40 |
| clarkb | pabelanger: https://review.openstack.org/#/c/476289/1 is one that may interest you. Poking at alternatives to the afs cache across atlantic problem | 16:41 |
| *** iyamahat has quit IRC | 16:41 | |
| jeblair | clarkb, sdague: did anyone suggest ">" to accomplish multiline descriptions in the yaml file instead of "|" ? | 16:41 |
| clarkb | jeblair: no, I think the concern is more that | is valid and if not caught in review it breaks cgit | 16:42 |
| clarkb | so we should handle it gracefully | 16:42 |
| jeblair | clarkb: oh yeah, i'm down with that. :) | 16:42 |
| sdague | jeblair: it was a question I had, however the safety concern seemed valid there | 16:42 |
| jeblair | clarkb: just *also* saying that > probably aligns with what was intended | 16:42 |
| sdague | so that we can't break cgit by accident | 16:42 |
| jeblair | we should definitely make it so we can't break by accident :) | 16:43 |
| jeblair | "aligns" see what i did there? :) | 16:43 |
| sdague | jeblair: yeh, it would, though unfortunately the mass reformatter that processes that yaml script actually doesn't preserve any of this | 16:43 |
| jeblair | sdague: oh neat. :) | 16:44 |
| *** dizquierdo has joined #openstack-infra | 16:44 | |
| *** rossella_ has quit IRC | 16:47 | |
| *** SumitNaiksatam has quit IRC | 16:47 | |
| *** iyamahat has joined #openstack-infra | 16:47 | |
| openstackgerrit | Merged openstack-infra/jeepyb master: strip out newlines when writing repo.desc https://review.openstack.org/476929 | 16:48 |
| *** iyamahat has quit IRC | 16:48 | |
| clarkb | logs.o.o utilization seems under control now. Trimming job size and then reducing retention seems to have worked (for now) | 16:49 |
| *** iyamahat has joined #openstack-infra | 16:49 | |
| *** tosky has quit IRC | 16:49 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata https://review.openstack.org/477606 | 16:49 |
| *** annegentle has quit IRC | 16:55 | |
| *** dhajare has quit IRC | 16:55 | |
| *** jascott1 has joined #openstack-infra | 16:56 | |
| *** iyamahat has quit IRC | 16:57 | |
| *** dprince has quit IRC | 16:58 | |
| *** derekh has quit IRC | 16:59 | |
| *** dprince has joined #openstack-infra | 17:00 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix some inconsistent indentation in docs https://review.openstack.org/477593 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add some information about canonical_hostname https://review.openstack.org/477592 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename git_host to server in github driver https://review.openstack.org/477594 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move tenant_config option to scheduler section https://review.openstack.org/477587 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use executor section of zuul.conf for executor dirs https://review.openstack.org/477589 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct sample zuul.conf https://review.openstack.org/477588 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move zookeeper_hosts to zookeeper section https://review.openstack.org/477591 | 17:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use scheduler-specific log config and pidfile https://review.openstack.org/477590 | 17:00 |
| jeblair | clarkb: pabelanger is out for 2 weeks | 17:01 |
| *** chlong has quit IRC | 17:02 | |
| openstackgerrit | Brianna Poulos proposed openstack-infra/project-config master: Change Barbican Tempest Plugin Gate to Voting https://review.openstack.org/472821 | 17:02 |
| *** pcaruana has quit IRC | 17:03 | |
| *** isaacb has quit IRC | 17:04 | |
| *** kzaitsev_mb has joined #openstack-infra | 17:04 | |
| *** trown is now known as trown|lunch | 17:05 | |
| jeblair | clarkb: re 476289, don't you think if we're going to switch to http caching, we should take the opportunity to stop using afs? | 17:09 |
| *** pblaho has quit IRC | 17:10 | |
| *** dizquierdo has quit IRC | 17:11 | |
| clarkb | jeblair: I'm not sure. AFS gives us a few useful features, particularly with the distro repos. We can avoid publishing mirrors until they are ready very easily, people can anonymously browse them locally, and we get redundant volumes | 17:11 |
| *** dizquierdo has joined #openstack-infra | 17:11 | |
| clarkb | jeblair: I mostly haven't gotten that far bceuase it is easy to test the reverse caching proxy against the afs mirrors whereas deciding to not use afs would require a lot more implementation and thinking | 17:11 |
| jeblair | clarkb: okay; i worry that 2 layers of caching is unecessarily complex.... | 17:13 |
| *** chlong has joined #openstack-infra | 17:14 | |
| clarkb | to start I just want to see if this is viable for speeding up jobs under real conditions. And for that pointing at mirror.dfw. shouldn't be a big difference to pointing at something with the data on eg ext4 | 17:14 |
| *** Swami has joined #openstack-infra | 17:14 | |
| jeblair | clarkb: i'm happy to +2 that change for experimentation... i'm just not sure i agree that if it works well, that should be the end state rather than just apache->pypi. but if you want to proceed with what's there and kick that coversation down the road for when it matters, i'm happy to do so. | 17:14 |
| clarkb | jeblair: well the problem as ianw points out is less pypi and more ubunut/debina/fedora/centos etc | 17:15 |
| clarkb | and those all really need the checkpointed releases | 17:15 |
| jeblair | clarkb: yeah (though -- people keep saying that maybe got better? is it worth verifying we still need it?) | 17:15 |
| clarkb | jeblair: it gets better on >= xenial if you enable fancy apt features. We might want to just consider trusty slightly less reliable and enable those features | 17:16 |
| clarkb | not sure about fedora/centos | 17:16 |
| jeblair | clarkb: another thing to consider, if we do want to keep afs, is to shard volumes more. | 17:16 |
| jeblair | clarkb: afs can handle hundreds of thousands of volumes easily. if we sharded the pypi mirror into *many* volumes, then each bandersnatch run may result in only a small number which need to be released. | 17:17 |
| jeblair | clarkb: however, that's somewhat counter to the goal of atomic-release, so we have to be careful there. | 17:17 |
| *** SumitNaiksatam has joined #openstack-infra | 17:17 | |
| jeblair | (perhaps a process like: release all of the package volumes, then release the index volume would be sufficient) | 17:18 |
| *** _bmjen is now known as bmjen | 17:18 | |
| clarkb | ya, we could also run cache warmers after release to reduce the chance a job has to warm the cache itself | 17:18 |
| jeblair | clarkb: or, of course, your suggestion of warm.. | 17:18 |
| jeblair | yeah that :) | 17:19 |
| clarkb | I think we can test ^ at the same time as testing the reverse caching proxy stuff | 17:19 |
| clarkb | since dfw mirror cold vs warm cache difference should be minimal if any | 17:19 |
| jeblair | clarkb: ++ | 17:20 |
| jeblair | clarkb: i just really want to avoid the day where we have to figure out whether we got an old package because apache was out of sync, or afs was, or....:/ | 17:20 |
| *** pblaho has joined #openstack-infra | 17:23 | |
| clarkb | jeblair: ya, though my understanding of the afs cache recently has been that you should never get an out of date file from afs because anytime you release (even on a noop) the afs client is forced to go check if it needs a new version | 17:23 |
| clarkb | granted there may be bugs or that understanding could be incomplete/wrong | 17:24 |
| *** jamesmcarthur has quit IRC | 17:28 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 17:34 |
| *** jcoufal has quit IRC | 17:35 | |
| *** ZZelle has joined #openstack-infra | 17:39 | |
| *** jcoufal has joined #openstack-infra | 17:39 | |
| *** HeOS has quit IRC | 17:40 | |
| *** ralonsoh has quit IRC | 17:41 | |
| *** Hal has joined #openstack-infra | 17:42 | |
| *** shardy is now known as shardy_afk | 17:44 | |
| openstackgerrit | Mark Hamzy proposed openstack/diskimage-builder master: Support CentOS7 in 01-override-yum-arch https://review.openstack.org/477616 | 17:46 |
| *** dizquierdo has quit IRC | 17:48 | |
| *** felipemonteiro_ has quit IRC | 17:49 | |
| *** felipemonteiro has joined #openstack-infra | 17:49 | |
| *** felipemonteiro_ has joined #openstack-infra | 17:50 | |
| electrofelix | anyone to review some changes for git-review? | 17:52 |
| electrofelix | https://review.openstack.org/389701 - string format fix for py3, https://review.openstack.org/244083 - adds topic field if using '-ll', https://review.openstack.org/398353 - refactor of review display code, https://review.openstack.org/312056 - list reviews for given branch only | 17:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move tenant_config option to scheduler section https://review.openstack.org/477587 | 17:52 |
| electrofelix | hopefully they all look good and I'll check in later in case someone had a question on them | 17:53 |
| *** electrofelix has quit IRC | 17:53 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix some inconsistent indentation in docs https://review.openstack.org/477593 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add some information about canonical_hostname https://review.openstack.org/477592 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename git_host to server in github driver https://review.openstack.org/477594 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use executor section of zuul.conf for executor dirs https://review.openstack.org/477589 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Correct sample zuul.conf https://review.openstack.org/477588 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move zookeeper_hosts to zookeeper section https://review.openstack.org/477591 | 17:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use scheduler-specific log config and pidfile https://review.openstack.org/477590 | 17:53 |
| *** felipemonteiro has quit IRC | 17:53 | |
| *** Rockyg has joined #openstack-infra | 18:00 | |
| *** Apoorva_ has joined #openstack-infra | 18:01 | |
| *** Apoorva has quit IRC | 18:04 | |
| *** dtantsur is now known as dtantsur|afk | 18:07 | |
| *** salv-orlando has quit IRC | 18:07 | |
| *** salv-orlando has joined #openstack-infra | 18:08 | |
| *** kzaitsev_mb has quit IRC | 18:10 | |
| *** salv-orlando has quit IRC | 18:12 | |
| *** amoralej is now known as amoralej|off | 18:13 | |
| *** tosky has joined #openstack-infra | 18:16 | |
| *** camunoz has quit IRC | 18:19 | |
| *** trown|lunch is now known as trown | 18:22 | |
| *** felipemonteiro_ has quit IRC | 18:23 | |
| clarkb | actually java melody can be installed with existing puppet we just have to pass that entier version string to it in puppet rather than just the short sha | 18:24 |
| clarkb | I think that means we have have all of the artifacts necessary to attempt an upgrade to 2.13.8 now. The only remaining question is which changes do we want to backport to openstack/2.13.8 maybe all of them and rather than base on tag we base on tip of branch? | 18:24 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix names of periodic jobs in promotion script https://review.openstack.org/477452 | 18:25 |
| clarkb | odyssey4me: are you around? did you catch my comments about possible reason for dns weirdness last week? | 18:26 |
| *** felipemonteiro has joined #openstack-infra | 18:28 | |
| *** florianf has quit IRC | 18:29 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use executor section of zuul.conf for executor dirs https://review.openstack.org/477589 | 18:29 |
| *** felipemonteiro_ has joined #openstack-infra | 18:29 | |
| *** JudeC has joined #openstack-infra | 18:29 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Use scheduler-specific log config and pidfile https://review.openstack.org/477590 | 18:30 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix some inconsistent indentation in docs https://review.openstack.org/477593 | 18:31 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add some information about canonical_hostname https://review.openstack.org/477592 | 18:31 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename git_host to server in github driver https://review.openstack.org/477594 | 18:31 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Move zookeeper_hosts to zookeeper section https://review.openstack.org/477591 | 18:31 |
| *** felipemonteiro has quit IRC | 18:33 | |
| *** kzaitsev_mb has joined #openstack-infra | 18:33 | |
| jeblair | clarkb: i missed the reason; what was it? | 18:35 |
| *** markmcclain has quit IRC | 18:35 | |
| clarkb | jeblair: lxc runs dnsmasq for both dhcp and dns for the containers it starts. The openstack-ansible jobs also disable all iptables firwall rules on the test nodes. My theory was that we were seeing rogue dns and dhcp servers all fighting each other | 18:36 |
| clarkb | jeblair: in part because on osic the IP addr that it binds to is within the 10/8 range assigned to our cloud ipv4 interface | 18:36 |
| clarkb | jeblair: lxc uses 10.0.3.1/24 which is routable in osic (unfortunately) | 18:37 |
| clarkb | jeblair: on the flip side our default iptables rules prevent dnsmasq from working with lxc proeprly so some editing to end up in the middle likely necessary | 18:37 |
| *** annegentle has joined #openstack-infra | 18:38 | |
| *** markmcclain has joined #openstack-infra | 18:38 | |
| *** kzaitsev_mb has quit IRC | 18:38 | |
| cloudnull | clarkb: jeblair: are you all running lxc things? in OSA we run lxc w/ dnsmaq maybe maybe you could pull from there | 18:43 |
| *** kzaitsev_mb has joined #openstack-infra | 18:44 | |
| cloudnull | https://github.com/openstack/openstack-ansible-tests/blob/master/test-vars.yml#L59-L72 | 18:44 |
| clarkb | cloudnull: ya its yall running lxc that is the problem :) your tests blow up on dns resolution | 18:44 |
| clarkb | cloudnull: well some subset of them do aiui | 18:44 |
| cloudnull | is that still happening ? | 18:45 |
| clarkb | cloudnull: and I think it is possibly because dnsmasq is using an ip range for containers and dnsmasq that is within the ipv4 range assigned by osic | 18:45 |
| cloudnull | i thought that was fixed recently | 18:45 |
| cloudnull | odyssey4me: ^ | 18:45 |
| clarkb | cloudnull: I think odyssey4me worked around it but not sure if it got fixed? | 18:45 |
| odyssey4me | we worked around it by hard coding the troublesome names into /etc/hosts | 18:46 |
| cloudnull | ah. | 18:46 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Make sure playbook and role repos are updated https://review.openstack.org/477627 | 18:46 |
| odyssey4me | https://review.openstack.org/#/q/topic:lnxcnt-org-workaround | 18:46 |
| odyssey4me | we were just hitting too many failures and couldn't merge patches reliably for a week | 18:47 |
| odyssey4me | so that's there for a workaround | 18:47 |
| odyssey4me | you think it might be an IP conflict? we can do an audit for that - I thought we had resolved it but it's possible there are stragglers | 18:48 |
| odyssey4me | especially in the older branches | 18:48 |
| clarkb | odyssey4me: well 10/8 is the ip range we get on every ipv4 interface in osic and 10.0.3.1/24 is what dnsmasq uses | 18:48 |
| *** rbrndt_ has joined #openstack-infra | 18:48 | |
| *** salv-orlando has joined #openstack-infra | 18:49 | |
| clarkb | and containers can route to the outside world as a result too. I think the removal of the iptables rules is potentially causing that to be problematic | 18:49 |
| clarkb | granted you have to relax the rules because otherwise dns/dhcp flat out doesn't work | 18:49 |
| odyssey4me | yeah, but we arranged exclusions - cloudnull do you still have access to check what those were? | 18:49 |
| clarkb | so ya I think it has to do with routing and firewalls just based on my local testing | 18:49 |
| cloudnull | odyssey4me: I can get them | 18:49 |
| cloudnull | we use the following config in test | 18:50 |
| cloudnull | https://github.com/openstack/openstack-ansible-tests/blob/master/test-vars.yml#L59-L72 | 18:50 |
| cloudnull | i'll go pull the exclusions in the subnet | 18:50 |
| clarkb | cloudnull: odyssey4me I would be curious what happens if you moved to something outside of 10/8 | 18:51 |
| clarkb | since 10.100.100/24 is still within 10/8 the behavior between it and 10.0.3/24 should be roughly the same | 18:51 |
| odyssey4me | clarkb I'm just trying to find our reference range | 18:51 |
| odyssey4me | we tried to use the same ranges as devstack where possible | 18:51 |
| clarkb | odyssey4me: the difference is the devstack run (actually neutron run) dnsmasq is firwalled off by neutron | 18:52 |
| clarkb | odyssey4me: whereas lxc is far more yolo | 18:52 |
| odyssey4me | well, the 10.x range is actually a host-only interface too | 18:52 |
| odyssey4me | but that will possibly still have issues if the host knows other routes | 18:52 |
| clarkb | odyssey4me: except it isn't because there is another interface with 10/8 and routing is enabled | 18:52 |
| clarkb | (Ideally osic would use a smaller range that we could just avoid in testing, but ya) | 18:53 |
| odyssey4me | ah, we use 10.100.100.x/24 as the override default in tests | 18:53 |
| odyssey4me | yeah, maybe osic could do that now that there are less people using it | 18:53 |
| odyssey4me | we did do a dhcp exclusion to block some parts of the range being used | 18:54 |
| odyssey4me | note that the dns issue we were seeing were not just osic though | 18:54 |
| clarkb | odyssey4me: yes I think you may have similar problems potentially anywhere else we share l2 | 18:55 |
| clarkb | odyssey4me: because no firewall | 18:55 |
| clarkb | the firewall is pretty important to test isolation here and it is being removed | 18:55 |
| odyssey4me | yeah | 18:55 |
| cloudnull | odyssey4me: https://pasteboard.co/1UiAhvc46.png | 18:56 |
| *** rbrndt_ has quit IRC | 18:57 | |
| *** adisky__ has quit IRC | 18:58 | |
| *** shardy_afk is now known as shardy | 18:59 | |
| *** chlong has quit IRC | 19:02 | |
| clarkb | odyssey4me: cloudnull I think the problem is less liekly osic handing out a 10.100.100/24 addr to some VM and more that 10/8 is routable | 19:05 |
| clarkb | and directly attached | 19:05 |
| clarkb | whcih affects how arp will be used for example | 19:05 |
| odyssey4me | yeah, that's probable | 19:05 |
| clarkb | so having a dhcp exclusion is good it won't fix all the problems | 19:06 |
| odyssey4me | so I have a suggestion | 19:06 |
| clarkb | *potential problems | 19:06 |
| odyssey4me | can we put a page up somewhere that defines a set of CIDR's for use in testing | 19:06 |
| odyssey4me | obviously use devstack as the reference, but we may wish to add a few more to it | 19:06 |
| odyssey4me | we can then model our deployment on that set | 19:07 |
| clarkb | odyssey4me: this is another case where devstack-gate aims to address this problem. We define a range that is expected to be good with it | 19:07 |
| clarkb | (though it also falls into the /8) | 19:07 |
| clarkb | so this particular corner case may not be solved by it | 19:07 |
| odyssey4me | we're wanting to move towards using devstack-gate to do the host bootstrapping, but that will take time and is more likely to happen next cycle than this | 19:07 |
| clarkb | the problem with statically defining it in eg docs is that we add and remove clouds so this changes | 19:09 |
| *** rbrndt has joined #openstack-infra | 19:09 | |
| clarkb | some clouds allow us to change it via custom defined networks otehrs don't | 19:09 |
| clarkb | (it is a hard problem and there hasn't been a great answer so far) | 19:10 |
| odyssey4me | yeah, I remember that being part of the previous discussion | 19:10 |
| clarkb | I think it would be good to update the firewall rules to only allow traffic from/to that range if it originates on the test host | 19:14 |
| clarkb | I think you may be able to do that simply by having a rule that only allows the traffic on the lxcbr0 interface | 19:15 |
| odyssey4me | hmm, but that doesn't help the 172.x interfaces which are bridges | 19:15 |
| clarkb | is that where neutron is attaching floating IPs? | 19:16 |
| clarkb | I think those are less problematic because they aren't bootstrapped by lxc | 19:16 |
| clarkb | (neutron properly firewalls stuff I think) | 19:16 |
| *** chlong has joined #openstack-infra | 19:16 | |
| odyssey4me | we bridge the containers onto host bridges | 19:16 |
| odyssey4me | the lxcbr0 interface is only used for fetching things from the internet | 19:17 |
| clarkb | and dns and dhcp | 19:17 |
| *** sdague has quit IRC | 19:17 | |
| *** jcoufal has quit IRC | 19:17 | |
| odyssey4me | the containers should be default routing to lxcbr0, then that uses dnsmasq on the host for dhcp and dns resolution | 19:18 |
| clarkb | odyssey4me: sort of | 19:18 |
| odyssey4me | dnsmasq should just use the host's resolvers | 19:18 |
| clarkb | odyssey4me: you are confusing host vs container here when that is sort of orthogonal. The issue is more ip range and routes and firwall | 19:18 |
| clarkb | dnsmasq attaches itself to lxcbr0 with ip 10.0.3.1 by default. It runs in the hosts ip namespace but that doesn't actually matter too much | 19:19 |
| clarkb | what matters is can the packets originating from/headed to 10.0.3.0/24 get to their intended destination and not go anywhere else | 19:19 |
| clarkb | when the host VM wants to send packets from itself to a container say at 10.0.3.22/24 it will source them as originating from 10.0.3.1/24 because of the dnsmasq setup | 19:21 |
| clarkb | so I think you can firewall off traffic to 10.0.3.0/24 and only allow it to originate on lxcbr0 then allow established connections created outbound for internet connectivity | 19:21 |
| clarkb | that should isolate you from other test envs out there | 19:22 |
| clarkb | you still potentially run the risk of internet bound traffic going to the wrong desitnation due to a conflit but 10.0.3.1 is going to be a consistent conflict | 19:23 |
| *** nicosuave has joined #openstack-infra | 19:28 | |
| openstackgerrit | Amrith Kumar proposed openstack-infra/project-config master: promote all trove experimental scenario jobs to check as non-voting https://review.openstack.org/477644 | 19:28 |
| clarkb | the problem with our default iptables rules is that it blocks the dnsmasq to unbound resolution it also prevents dhcp from happening to dnsmasq from lxcbr0 attached containers | 19:29 |
| *** nich0s has quit IRC | 19:29 | |
| *** nicosuave has quit IRC | 19:29 | |
| clarkb | so you do need to open things up, I'm just concerned that opening everything up completetly is what is causing the weirdness here | 19:29 |
| *** nich0s has joined #openstack-infra | 19:29 | |
| *** salv-orlando has quit IRC | 19:29 | |
| *** nich0s_ has joined #openstack-infra | 19:30 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: WIP: Add web-based console log streaming https://review.openstack.org/463353 | 19:30 |
| *** salv-orlando has joined #openstack-infra | 19:30 | |
| *** ChanServ has quit IRC | 19:30 | |
| *** nich0s_ has left #openstack-infra | 19:30 | |
| *** Rockyg has quit IRC | 19:31 | |
| *** nich0s has quit IRC | 19:32 | |
| *** salv-orlando has quit IRC | 19:35 | |
| *** ChanServ has joined #openstack-infra | 19:35 | |
| *** card.freenode.net sets mode: +o ChanServ | 19:35 | |
| *** nich0s has joined #openstack-infra | 19:37 | |
| *** nich0s has quit IRC | 19:37 | |
| *** nich0s has joined #openstack-infra | 19:37 | |
| *** sdague has joined #openstack-infra | 19:37 | |
| clarkb | anyways I *think* that if you were to use something out of 192.168.x.y/24 instead that would break the overlap with 10/8 and confirm if that is related | 19:38 |
| clarkb | I would expect the dns issue to go away in that case | 19:39 |
| odyssey4me | clarkb hmm, interesting - as a data note - we're only clearing the iptables rules in our integrated gate | 19:39 |
| odyssey4me | in our role tests we don't do that | 19:39 |
| *** spzala has quit IRC | 19:39 | |
| odyssey4me | do you have job names which are prolematic? | 19:39 |
| clarkb | odyssey4me: I should be able to get them from logstash again. Give me a few to look that up | 19:40 |
| *** spzala has joined #openstack-infra | 19:40 | |
| *** spzala has quit IRC | 19:40 | |
| *** spzala has joined #openstack-infra | 19:40 | |
| odyssey4me | that said, lxc's deployment and our container deployment does implement more rules which may be conflicting | 19:40 |
| odyssey4me | my logstash-foo is not good, I can't seem to get queries that work well for me | 19:41 |
| clarkb | gate-openstack-ansible-os_neutron-ansible-upgrade-ubuntu-xenial is one of them | 19:41 |
| clarkb | the nova and glance upgrade tests also affected | 19:41 |
| odyssey4me | any particular branch? | 19:42 |
| clarkb | looks like master | 19:42 |
| clarkb | (message:"Temporary failure in name resolution." OR message:"Temporary failure resolving" OR message:"wget: unable to resolve" OR message:"Could not resolve host") AND NOT message:"Could not resolve host: fake" AND NOT message:"somehost" AND NOT message:" epel.vpsnet.lt" AND tags:"console" | 19:42 |
| clarkb | that is my query | 19:42 |
| clarkb | then I extended that to 7 days | 19:42 |
| clarkb | tries to filter out known bad names like fake, somehost, and epel.vpsnet.lt (this one stopped resolving) | 19:43 |
| odyssey4me | I'm seeing a ton of keystone jobs, and yeah - seems osic is the worst for it | 19:46 |
| *** yamahata has joined #openstack-infra | 19:47 | |
| *** Apoorva_ has quit IRC | 19:47 | |
| *** Apoorva has joined #openstack-infra | 19:48 | |
| *** nich0s has quit IRC | 19:48 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata https://review.openstack.org/477606 | 19:51 |
| clarkb | we are definitely still seeing some flakyness outside of osic though the osic stuff seems to have largely gone away by only using ipv6 resolvers there | 19:51 |
| *** sshnaidm is now known as sshnaidm|afk | 19:52 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Fix undercloud-upgrade job for Newton to Ocata https://review.openstack.org/477606 | 19:52 |
| *** xyang1 has quit IRC | 19:55 | |
| odyssey4me | clarkb ok, we'll try to fit in some time to look at using devstack gate for host bootstrapping sooner rather than later... but for now we may have to hobble along | 19:55 |
| clarkb | odyssey4me: ya I'd mostly just be curious if it was happier with 192.168 range and removing the /etc/hosts workaround | 19:56 |
| clarkb | just to confirm if ip range overlap is problematic | 19:56 |
| *** e0ne has joined #openstack-infra | 19:57 | |
| *** spzala has quit IRC | 19:57 | |
| *** spzala has joined #openstack-infra | 19:58 | |
| odyssey4me | clarkb hmm, well I could fire up a review for that which we can recheck ad nauseum | 19:58 |
| *** xyang1 has joined #openstack-infra | 19:59 | |
| *** jkilpatr has quit IRC | 20:00 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix encrypt_secret for python3 https://review.openstack.org/477168 | 20:01 |
| *** marst has quit IRC | 20:01 | |
| *** marst has joined #openstack-infra | 20:01 | |
| *** spzala has quit IRC | 20:03 | |
| *** Odd_Bloke has quit IRC | 20:03 | |
| *** Odd_Bloke has joined #openstack-infra | 20:03 | |
| *** e0ne has quit IRC | 20:06 | |
| *** e0ne has joined #openstack-infra | 20:09 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix encrypt_secret for python3 https://review.openstack.org/477168 | 20:10 |
| *** ericyoung has quit IRC | 20:10 | |
| odyssey4me | clarkb I'm tied up in a VPN at the moment and unfortunately can't git-review. I'll pick it up in the morning and push up some test patches. | 20:11 |
| clarkb | odyssey4me: ok, sounds good | 20:12 |
| cmurphy | clarkb: I have a devstack-gate patch for you when you have a minute https://review.openstack.org/#/c/476440 | 20:13 |
| *** jamesmcarthur has joined #openstack-infra | 20:14 | |
| clarkb | cmurphy: I've got https://review.openstack.org/474293 to address that. But maybe I should just merge yours to avoid review conflict :) | 20:15 |
| *** e0ne has quit IRC | 20:15 | |
| openstackgerrit | Eric Kao proposed openstack-infra/project-config master: add designate-tempest-plugin in congress job https://review.openstack.org/477666 | 20:16 |
| cmurphy | clarkb: yours won't fix my problem | 20:16 |
| clarkb | oh I see | 20:17 |
| clarkb | we actually want a combo of both things I think | 20:17 |
| clarkb | cmurphy: if using horizon then include django auth else if using django auth then include horizon? | 20:17 |
| clarkb | s/else if/ or/ | 20:17 |
| cmurphy | clarkb: yeah something like that | 20:18 |
| *** yamahata has quit IRC | 20:18 | |
| *** tesseract has quit IRC | 20:21 | |
| *** jcoufal has joined #openstack-infra | 20:21 | |
| *** shardy has quit IRC | 20:22 | |
| *** jamesmcarthur has quit IRC | 20:23 | |
| *** jamesmcarthur has joined #openstack-infra | 20:23 | |
| clarkb | cmurphy: do you want to squash my changes into your change and I can approve? | 20:26 |
| clarkb | or I can rebase on yours and approve your thing | 20:26 |
| *** rderose has joined #openstack-infra | 20:27 | |
| clarkb | and wait for someone to review mine | 20:27 |
| cmurphy | clarkb: oh i just commented on yours, but yeah let me squash your changes into mine | 20:27 |
| cmurphy | that will be faster | 20:27 |
| *** salv-orlando has joined #openstack-infra | 20:28 | |
| *** kgiusti has quit IRC | 20:29 | |
| *** annegentle has quit IRC | 20:33 | |
| *** felipemonteiro has joined #openstack-infra | 20:33 | |
| *** felipemonteiro_ has quit IRC | 20:34 | |
| *** tinwood has quit IRC | 20:35 | |
| *** tinwood has joined #openstack-infra | 20:36 | |
| *** rbrndt has quit IRC | 20:38 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/devstack-gate master: Group all horizon-related projects together https://review.openstack.org/476440 | 20:38 |
| cmurphy | clarkb: ^ | 20:38 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix parsing of github PR url https://review.openstack.org/476286 | 20:38 |
| *** felipemonteiro_ has joined #openstack-infra | 20:38 | |
| clarkb | sdague: maybe you can review 466440 real quick? I'll probably approve it after lunch if no second reviewer takes a look | 20:40 |
| *** felipemonteiro has quit IRC | 20:41 | |
| clarkb | cmurphy: oh it exploded | 20:43 |
| *** rbrndt has joined #openstack-infra | 20:43 | |
| clarkb | cmurphy: need a space before the ]] I think | 20:43 |
| cmurphy | oops | 20:43 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/devstack-gate master: Group all horizon-related projects together https://review.openstack.org/476440 | 20:44 |
| clarkb | yup tested locally that is fix | 20:44 |
| sdague | clarkb: that's a tempest change? | 20:44 |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: switch from oslosphinx to openstackdocstheme https://review.openstack.org/476686 | 20:44 |
| clarkb | sdague: devstack-gate | 20:44 |
| clarkb | oh I typed it out wrong | 20:45 |
| sdague | urls are friends :) | 20:45 |
| clarkb | sdague: https://review.openstack.org/476440 that one | 20:45 |
| clarkb | sdague: thanks | 20:46 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: Project update to change enabled only when provided https://review.openstack.org/476914 | 20:46 |
| cmurphy | thanks guys | 20:46 |
| *** jheroux has quit IRC | 20:49 | |
| *** lamt has joined #openstack-infra | 20:51 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr master: switch from oslosphinx to openstackdocstheme https://review.openstack.org/476686 | 20:51 |
| jeblair | dhellmann: can you point me at a tldr on oslosphinx/openstackdocstheme if one exists? | 20:52 |
| clarkb | cmurphy: I have abandoned my old change | 20:53 |
| dhellmann | jeblair : do you mean how to migrate or why to migrate? | 20:53 |
| jeblair | dhellmann: why | 20:54 |
| cmurphy | clarkb: okie | 20:54 |
| dhellmann | jeblair: the docs team is going to maintain the theme to be consistent with the rest of openstack.org and the oslo team is going to deprecate oslosphinx | 20:54 |
| jeblair | dhellmann: differences between the two, etc. audience would be a hypothetical person who suddenly realized openstackdocstheme existed. :) | 20:54 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: wip: support custom playbook locations https://review.openstack.org/477672 | 20:55 |
| dhellmann | aha | 20:55 |
| dhellmann | the openstackdocstheme has some features for linking pages to bug trackers (though that only works with launchpad right now) | 20:55 |
| dhellmann | otherwise, they should have comparable features | 20:55 |
| dhellmann | well, the openstackdocstheme doesn't force itself on you, so there's a little less magic | 20:55 |
| dhellmann | basically, we learned better how to write themes and did that work in openstackdocstheme instead of oslosphinx | 20:56 |
| jeblair | dhellmann: ah cool | 20:56 |
| jeblair | i just wrote a change to switch zuul's docs to oslosphinx... i guess i'll write another one :) | 20:56 |
| dhellmann | annegentle is working on bringing some of the other features from oslosphinx into the docs theme, so we can stop maintaining multiple themes | 20:56 |
| dhellmann | sorry, we should probably do an announcement | 20:56 |
| dhellmann | we sort of rolled it into the doc-migration spec, since we had to touch every repo at least once for that anyway | 20:56 |
| jeblair | dhellmann: i confess, i can't find openstackdocstheme's own docs after about 10 seconds of looking | 20:57 |
| dhellmann | hrm | 20:58 |
| jeblair | (i mean, i found the pypi entry, which has docs, but i'm sure there must be an entry on docs.openstack.org with it self-rendering...) | 20:58 |
| dhellmann | I wonder if there's a docs job | 20:58 |
| *** annegentle has joined #openstack-infra | 21:02 | |
| dhellmann | jeblair : it appears to have its own special job | 21:03 |
| *** annegentle has quit IRC | 21:03 | |
| dhellmann | oh, no, not quite | 21:03 |
| *** jamesmcarthur has quit IRC | 21:03 | |
| dhellmann | it has the check and gate jobs, but no post job | 21:04 |
| *** chlong has quit IRC | 21:04 | |
| jeblair | yay i helped find a bug! | 21:05 |
| *** HeOS has joined #openstack-infra | 21:05 | |
| *** rockyg has joined #openstack-infra | 21:05 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: add doc publishing job for openstackdocstheme https://review.openstack.org/477674 | 21:05 |
| dhellmann | jeblair : ^^ | 21:05 |
| jeblair | +2 | 21:07 |
| dhellmann | ty | 21:07 |
| *** felipemonteiro_ has quit IRC | 21:08 | |
| *** wolverineav has joined #openstack-infra | 21:09 | |
| *** kevinbenton has quit IRC | 21:12 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** kevinbenton has joined #openstack-infra | 21:15 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Implement pipeline requirement of github labels https://review.openstack.org/473962 | 21:15 |
| *** annegentle has joined #openstack-infra | 21:19 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: config: refactor config get default https://review.openstack.org/474484 | 21:20 |
| *** dprince has quit IRC | 21:21 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: bubblewrap: adds --die-with-parent option https://review.openstack.org/473164 | 21:25 |
| *** aeng_ has joined #openstack-infra | 21:25 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: executor: run trusted playbook in a bubblewrap https://review.openstack.org/474460 | 21:25 |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Add Neutron fullstack python35 tests https://review.openstack.org/477679 | 21:28 |
| *** spzala has joined #openstack-infra | 21:28 | |
| *** esberglu has quit IRC | 21:32 | |
| *** esberglu has joined #openstack-infra | 21:32 | |
| *** rbrndt has quit IRC | 21:33 | |
| *** esberglu has quit IRC | 21:37 | |
| *** spzala has quit IRC | 21:39 | |
| *** xyang1 has quit IRC | 21:41 | |
| *** thorst has quit IRC | 21:44 | |
| *** rbrndt has joined #openstack-infra | 21:45 | |
| *** thorst has joined #openstack-infra | 21:46 | |
| *** thorst has quit IRC | 21:50 | |
| clarkb | as a followup on the dns things we have what appears to be a single dns failure in the last 6 hours that is valid | 21:51 |
| clarkb | happened in http://logs.openstack.org/17/475617/4/gate/gate-kolla-dsvm-build-oraclelinux-source-centos-7/354126a/console.html so possibly a fail in container networking there too? | 21:52 |
| clarkb | inc0: just fyi ^ | 21:53 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Deal with revision_number in neutron update_port tests https://review.openstack.org/477175 | 21:53 |
| mordred | clarkb: woot! | 21:53 |
| *** kzaitsev_mb has quit IRC | 21:54 | |
| clarkb | (this based on my logstash query which may be incomplete) | 21:55 |
| *** esberglu has joined #openstack-infra | 21:57 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/project-config master: Make neutron-lbaas tempest jobs voting https://review.openstack.org/477689 | 21:57 |
| *** gordc has quit IRC | 21:58 | |
| *** esberglu has quit IRC | 21:58 | |
| *** esberglu has joined #openstack-infra | 21:58 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Add Neutron fullstack python35 tests https://review.openstack.org/477679 | 21:59 |
| jeblair | zuul meeting time in #openstack-meeting-alt | 22:00 |
| *** jascott1 has quit IRC | 22:02 | |
| *** jascott1 has joined #openstack-infra | 22:03 | |
| *** thorst has joined #openstack-infra | 22:05 | |
| *** rockyg has quit IRC | 22:05 | |
| *** eharney has quit IRC | 22:06 | |
| *** jascott1 has quit IRC | 22:07 | |
| *** thorst has quit IRC | 22:09 | |
| *** rwsu has quit IRC | 22:11 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: Update stash plugin https://review.openstack.org/477189 | 22:13 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: Update dependency_check plugin https://review.openstack.org/477537 | 22:13 |
| *** xarses has quit IRC | 22:13 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: Update build_publisher plugin https://review.openstack.org/477077 | 22:14 |
| *** bobh has quit IRC | 22:14 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:15 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: Update git plugin test cases https://review.openstack.org/476920 | 22:16 |
| *** yamahata has joined #openstack-infra | 22:18 | |
| *** kzaitsev_mb has quit IRC | 22:20 | |
| *** mrhillsman is now known as codebauss | 22:22 | |
| *** ericyoung has joined #openstack-infra | 22:22 | |
| *** codebauss is now known as mrhillsman | 22:22 | |
| inc0 | clarkb: not sure, possibly | 22:30 |
| *** xarses has joined #openstack-infra | 22:30 | |
| inc0 | if this keeps break, tomorrow EU time our local oraclelinux expert will wake up | 22:31 |
| *** yamahata has quit IRC | 22:31 | |
| openstackgerrit | Michael Johnson proposed openstack-infra/project-config master: Make neutron-lbaas tempest jobs voting https://review.openstack.org/477689 | 22:31 |
| *** marst has quit IRC | 22:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Use 3/4 of CPUs by default instead of 1/2 https://review.openstack.org/477701 | 22:33 |
| clarkb | inc0: I'm not sure its specifically an oraclelinux problem. More likely a generic routing/firewall/dns resolver problem | 22:34 |
| *** marst has joined #openstack-infra | 22:35 | |
| inc0 | well docker will use this stuff from host | 22:35 |
| inc0 | so if node vm can resolve it, so will container | 22:36 |
| clarkb | inc0: thats not true as we've discovered with lxc at least | 22:36 |
| *** spzala has joined #openstack-infra | 22:36 | |
| clarkb | because of firewalls routing and such | 22:36 |
| inc0 | docker is different than lxc | 22:36 |
| clarkb | inc0: yes but its the same fundamental problem | 22:36 |
| inc0 | yeah, but docker deamon will put these confs | 22:36 |
| inc0 | into container | 22:36 |
| clarkb | if process X with ip foo wants to talk to resolver proxess Y with ip bar you have to get hte packets back and forth | 22:37 |
| inc0 | also, other tests seems to pass | 22:37 |
| clarkb | if iptables says no, then too bad packets get dropped | 22:37 |
| clarkb | even if you are running all on the same host | 22:37 |
| clarkb | (also I thought docker just hardcoded google dns, but I guess that changed) | 22:38 |
| inc0 | https://review.openstack.org/#/c/454743/2 other gate jobs seems to work fine | 22:38 |
| inc0 | clarkb: let me check for sure, but I'm almost certain it copies resolv.conf from host | 22:38 |
| inc0 | I know it copies /etc/hosts | 22:38 |
| inc0 | yup, it copies resolv too | 22:39 |
| clarkb | ya at least with lxc things I think it could be a cloud interface ip range interaction so you wouldn't see it everywhere | 22:39 |
| *** jascott1 has joined #openstack-infra | 22:40 | |
| clarkb | inc0: so if our resolv.conf says nameserver 127.0.0.1 how do lookups in a container find the host's 127.0.0.1? | 22:40 |
| clarkb | inc0: are you running in the hosts network namespace? | 22:40 |
| inc0 | not during build | 22:40 |
| clarkb | (our iamges all use 127.0.0.1 as the resolver) | 22:40 |
| inc0 | is it going to say 127.0.0.1? That might break too | 22:40 |
| inc0 | ahh | 22:40 |
| inc0 | hmm | 22:40 |
| *** spzala has quit IRC | 22:40 | |
| inc0 | yeah, that might be an issue | 22:41 |
| inc0 | can we put regular IP to resolv too? | 22:41 |
| clarkb | that is where the firewall becomes a problem because we don't allow packets to it | 22:41 |
| clarkb | on the public interface(S) | 22:41 |
| *** hashar has quit IRC | 22:41 | |
| inc0 | https://review.openstack.org/#/c/454743/2 ubuntu and centos passed tho, but both of these uses mirrors in infra | 22:42 |
| inc0 | oracle doesn't' | 22:42 |
| inc0 | so that might be affecting this | 22:42 |
| *** ericyoung has quit IRC | 22:44 | |
| * clarkb wonders how docker generally deals with localhost is resolver | 22:45 | |
| *** annegentle has quit IRC | 22:47 | |
| *** eeiden has joined #openstack-infra | 22:48 | |
| inc0 | probably it doesn't | 22:48 |
| *** xarses has quit IRC | 22:48 | |
| *** jascott1 has quit IRC | 22:51 | |
| *** rbrndt has quit IRC | 22:51 | |
| *** rbrndt has joined #openstack-infra | 22:51 | |
| *** rbrndt has quit IRC | 22:51 | |
| *** wolverineav has quit IRC | 22:54 | |
| inc0 | clarkb: https://review.openstack.org/#/c/475617/ on the other hand these gates passed | 22:55 |
| inc0 | and they were run after one that failed | 22:55 |
| inc0 | so it's not consistent | 22:56 |
| *** sdague has quit IRC | 22:56 | |
| clarkb | inc0: were they on the same cloud? perhaps there is a cloud/region weirdness there | 22:56 |
| clarkb | or perhaps it legitimetely just had the lookup fail upstream of it | 22:56 |
| inc0 | where can I check nodepool? | 22:57 |
| *** tosky has quit IRC | 22:57 | |
| clarkb | inc0: the beginning of each console log should record the host it ran on which includes the cloud and region | 22:58 |
| inc0 | osic failed | 22:58 |
| inc0 | seems like | 22:58 |
| clarkb | ya osic is where we have the 10/8 interface | 22:59 |
| clarkb | which could potentially make routing and firwalling funny for other things using 10.whatever | 23:00 |
| clarkb | I wonder if this is happening there | 23:00 |
| clarkb | inc0: I suggested to osa folks that they try using 192.168.x.y/24 ranges instead of 10.x.y.z/24 ranges to see if that avoided the problem in osic | 23:02 |
| clarkb | though in the docker case you aren't bridging directly on the host are you? so maybe thats less of an issue with docker | 23:03 |
| inc0 | we don't give network addresses to our containers | 23:03 |
| clarkb | ya that | 23:03 |
| inc0 | that being said, docker indeed uses 10.* ips for container | 23:03 |
| inc0 | maybe it's configurable | 23:03 |
| *** annegentle has joined #openstack-infra | 23:08 | |
| cloudnull | all of these dns failures all seem very odd. While I can't prove it, it semes like we're seeing this https://bbs.archlinux.org/viewtopic.php?id=204119 | 23:09 |
| cloudnull | is systemd-resolved running on some of these nodes? | 23:10 |
| clarkb | cloudnull: no systemd-resolved is not enabled on ubuntu xenial | 23:11 |
| clarkb | it is enabled in 17.04 apparently though | 23:11 |
| *** iyamahat has joined #openstack-infra | 23:11 | |
| cloudnull | it looks like 17+ is shipping it by default | 23:11 |
| cloudnull | do we have test images on 17 ? | 23:11 |
| clarkb | no | 23:11 |
| clarkb | we stopped testing the non lts releases when they went to 9 months of support | 23:11 |
| cloudnull | maybe some of these jobs are installing packages which bring in systemd-networkd/resolved ? | 23:12 |
| clarkb | cloudnull: also switching to ipv6 only forwarders for unbound fixed 99% of the problems looks like | 23:12 |
| cloudnull | which ubuntu then starts the service by default ? | 23:12 |
| cloudnull | ok | 23:12 |
| clarkb | cloudnull: that is a possibility, maybe lxc/docker/etc pull that in? | 23:12 |
| *** marst has quit IRC | 23:13 | |
| cloudnull | maybe ? | 23:13 |
| *** iyamahat has quit IRC | 23:13 | |
| clarkb | devstack-gate dumps the dpkg package listing but I don't think osa or kolla do that in their logs | 23:13 |
| * cloudnull spitballing | 23:13 | |
| inc0 | well we won't have resolved running in container | 23:14 |
| inc0 | because well, we run single pid | 23:14 |
| clarkb | inc0: right but it may be running on the host if however you install docker says it needs it | 23:14 |
| clarkb | inc0: not sure that it does but it is a possibility | 23:14 |
| cloudnull | maybe we need to have a larger conversation with projects to get folks using experemental class networks (class E) instead of the noraml class ABC? | 23:14 |
| inc0 | also container images are normally cut deeply | 23:14 |
| inc0 | from anything that can be useful | 23:15 |
| inc0 | like ping | 23:15 |
| clarkb | cloudnull: well I think the major problem is the overlap with the class A | 23:15 |
| clarkb | cloudnull: if osic handed out say a /20 then it would be a non issue | 23:15 |
| clarkb | inc0: yes thats actually one of my major grupes with containers. You add a ton of complixty and remove all the tools necessary to debug that complexity :) | 23:16 |
| clarkb | particularly when ti comes to networking | 23:16 |
| inc0 | you trade one complexity to another | 23:16 |
| cloudnull | except for the places where folks overlaped with the /20 :) | 23:16 |
| clarkb | cloudnull: right but at least they now have the option to stop overlapping | 23:16 |
| inc0 | fwiw, running kolla container is no issue because we run net=host | 23:16 |
| clarkb | cloudnull: with the 10/8 as is you don't really have that choice if using any of 10/8 | 23:16 |
| cloudnull | if we all used class E there'd never be any overlap with any provider | 23:17 |
| cloudnull | we do have a few blocks we dont assign | 23:17 |
| cloudnull | which was made to accomodate devstack | 23:17 |
| clarkb | cloudnull: you don't assign ips out of them but you still overlap in the range | 23:17 |
| clarkb | cloudnull: they are two related problems but fixing one doesn't fix the other | 23:18 |
| cloudnull | ++ | 23:18 |
| clarkb | inc0: I've learned that because all these containers have python installed to run openstack that the most reliable way to test if dns is working is python import socket; socket.gethostbyname() because none of the other tools are present :) | 23:19 |
| inc0 | yeah, that;) or running a container with all the tools | 23:19 |
| clarkb | inc0: but once you do that you are no longer replicating necessarily | 23:20 |
| clarkb | cloudnull: aiui some ip implementations nuke class E hard? | 23:20 |
| inc0 | container images are glorified packages, but I hear ya | 23:20 |
| clarkb | inc0: but they aren't because of things like networkign :) | 23:20 |
| *** kzaitsev_mb has joined #openstack-infra | 23:20 | |
| *** hongbin has quit IRC | 23:20 | |
| inc0 | depends how you use it | 23:20 |
| cloudnull | clarkb: that may be . | 23:20 |
| inc0 | again, we run net=host | 23:21 |
| cloudnull | I've only done it locally . | 23:21 |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Don't remove top-container element for flavors and clusters https://review.openstack.org/477708 | 23:21 |
| clarkb | inc0: deb or rpm packages don't need a linux bridge with a dns server and dhcp server running in order to use networking | 23:21 |
| cloudnull | I suspect it may be more headache than it's worth | 23:21 |
| cloudnull | ^ getting everyone on board with a experimental class | 23:21 |
| inc0 | hence glorified | 23:21 |
| clarkb | cloudnull: ya I imagine we'll spend more time debugging weird corner cases related to that then just tracking down non overlapping addrs | 23:21 |
| clarkb | clarly the answer is to ipv6 harder | 23:22 |
| clarkb | can anyone bug github about getting ipv6? | 23:22 |
| cloudnull | net=host makes containers more like an over complicated chroot :) | 23:22 |
| cloudnull | I can poke them again | 23:23 |
| *** rderose has quit IRC | 23:23 | |
| cloudnull | I'm all for making more things ipv6 -all the things | 23:23 |
| clarkb | github seems to remain our biggest ipv4 target | 23:24 |
| cloudnull | not that github will listen to little old me . but I'll keep at it | 23:24 |
| clarkb | but there are others too. I blame consumer ISPs not embracing ipv6 | 23:26 |
| clarkb | my isp won't do native ipv6 :( | 23:26 |
| cloudnull | :'( | 23:26 |
| cloudnull | I blame the ISPs too. | 23:26 |
| cloudnull | they should simply start with IPv6, and then give IPv4 access to folks who need it (which they can pay more for). | 23:27 |
| *** wolverineav has joined #openstack-infra | 23:29 | |
| clarkb | and since facebook has ipv6 AAAA records that will just work for the vast majority of people too :) | 23:29 |
| cloudnull | hahaha :) | 23:29 |
| *** SumitNaiksatam has quit IRC | 23:32 | |
| *** tsuzuki has joined #openstack-infra | 23:32 | |
| *** tsuzuki_ has joined #openstack-infra | 23:33 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Don't remove top-container element for flavors and clusters https://review.openstack.org/477708 | 23:34 |
| *** s-shiono has joined #openstack-infra | 23:35 | |
| *** tsuzuki has quit IRC | 23:36 | |
| *** wolverineav has quit IRC | 23:38 | |
| *** wolverineav has joined #openstack-infra | 23:40 | |
| *** Swami has quit IRC | 23:41 | |
| *** wolverineav has quit IRC | 23:44 | |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: dib-lint: Ignore editor temp files for linting run https://review.openstack.org/477711 | 23:44 |
| *** marst has joined #openstack-infra | 23:44 | |
| clarkb | dirk: fyi the suse devstack-gate tempest jobs are failing. http://logs.openstack.org/40/476440/3/check/gate-tempest-dsvm-neutron-full-opensuse-422-nv/7e83bef/console.html appears to be related to libguestfs? | 23:47 |
| *** wolverineav has joined #openstack-infra | 23:49 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Group all horizon-related projects together https://review.openstack.org/476440 | 23:51 |
| openstackgerrit | Yolande Amate proposed openstack-infra/jenkins-job-builder master: Update hipchat to use convert_mapping_to_xml() https://review.openstack.org/477222 | 23:51 |
| *** JudeC has quit IRC | 23:58 | |
| *** wolverineav has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
