| *** markvoelker has joined #openstack-infra | 00:01 | |
| ianw | the answer is no | 00:01 |
|---|---|---|
| *** sflanigan has quit IRC | 00:01 | |
| *** tosky has quit IRC | 00:01 | |
| *** ym200 has quit IRC | 00:02 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Move assertReportedStat to test_node to avoid race https://review.openstack.org/451119 | 00:02 |
| *** pvaneck has quit IRC | 00:05 | |
| *** markvoelker has quit IRC | 00:05 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Rename nodepoold to nodepool-launcher https://review.openstack.org/450877 | 00:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Force os-client-config to use ipv4 https://review.openstack.org/450983 | 00:06 |
| *** pahuang has quit IRC | 00:06 | |
| *** thorst has quit IRC | 00:12 | |
| *** sree has joined #openstack-infra | 00:13 | |
| *** tphummel has quit IRC | 00:14 | |
| *** john-davidge has joined #openstack-infra | 00:14 | |
| *** sflanigan has joined #openstack-infra | 00:14 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/shade master: Don't use project-id in catalog tests https://review.openstack.org/451123 | 00:16 |
| *** neiljerram has quit IRC | 00:17 | |
| *** sree has quit IRC | 00:18 | |
| *** john-davidge has quit IRC | 00:18 | |
| *** dave-mccowan has joined #openstack-infra | 00:21 | |
| openstackgerrit | Merged openstack-infra/project-config master: Kolla v4 support and upgrades in Kolla-Kubernetes https://review.openstack.org/450471 | 00:22 |
| *** pahuang has joined #openstack-infra | 00:23 | |
| ianw | root@libvirt:/etc/init.d# ls /var/core | 00:24 |
| ianw | core.libvirtd.3198.libvirt.1490747072 | 00:24 |
| ianw | it's that easy ... | 00:24 |
| *** beslemon has joined #openstack-infra | 00:35 | |
| *** aysyd has quit IRC | 00:40 | |
| *** Goneri has quit IRC | 00:41 | |
| *** gcb has quit IRC | 00:41 | |
| *** hongbin has quit IRC | 00:45 | |
| *** Julien-zte has joined #openstack-infra | 00:53 | |
| *** namnh has joined #openstack-infra | 00:59 | |
| *** tuanluong has joined #openstack-infra | 01:00 | |
| *** jamielennox is now known as jamielennox|away | 01:02 | |
| *** thorst has joined #openstack-infra | 01:08 | |
| *** dtantsur has quit IRC | 01:10 | |
| *** Apoorva has quit IRC | 01:10 | |
| *** katkapilatova has quit IRC | 01:10 | |
| *** liujiong has joined #openstack-infra | 01:11 | |
| *** pblaho has quit IRC | 01:11 | |
| *** katkapilatova has joined #openstack-infra | 01:11 | |
| *** csaba has quit IRC | 01:12 | |
| *** csaba has joined #openstack-infra | 01:12 | |
| *** pblaho has joined #openstack-infra | 01:12 | |
| *** thorst has quit IRC | 01:12 | |
| *** dtantsur has joined #openstack-infra | 01:14 | |
| *** gongysh has joined #openstack-infra | 01:15 | |
| *** jamielennox|away is now known as jamielennox | 01:16 | |
| *** adrian_otto has quit IRC | 01:18 | |
| *** thorst has joined #openstack-infra | 01:19 | |
| *** e0ne has joined #openstack-infra | 01:20 | |
| *** david-lyle has joined #openstack-infra | 01:24 | |
| *** e0ne has quit IRC | 01:25 | |
| *** yanyanhu has joined #openstack-infra | 01:26 | |
| *** furlongm has quit IRC | 01:28 | |
| *** mriedem has joined #openstack-infra | 01:28 | |
| *** thorst has quit IRC | 01:29 | |
| clarkb | ianw: is that with the change you pointed me at? | 01:38 |
| ianw | clarkb: no, manual testing so far, though maybe ci has tested that | 01:39 |
| ianw | i have libvirtd running under electric fence | 01:39 |
| ianw | it likes to calloc(0) | 01:40 |
| *** amotoki has joined #openstack-infra | 01:46 | |
| *** Julien-zte has quit IRC | 01:48 | |
| ianw | one thing might be to get world-dump to simply print a full bt from gdb for any cores it sees | 01:48 |
| *** mriedem has quit IRC | 01:50 | |
| *** dingyichen has quit IRC | 01:56 | |
| *** gcb has joined #openstack-infra | 01:58 | |
| *** pramodrj07 has quit IRC | 01:58 | |
| *** MasterOfBugs has quit IRC | 01:58 | |
| *** amotoki has quit IRC | 01:58 | |
| *** gongysh has quit IRC | 01:59 | |
| *** zhurong has joined #openstack-infra | 02:04 | |
| *** Julien-zte has joined #openstack-infra | 02:05 | |
| openstackgerrit | toan.t.pham proposed openstack-infra/jenkins-job-builder master: Add folder create for cloudbee folder jobs https://review.openstack.org/438795 | 02:08 |
| *** yamahata has quit IRC | 02:14 | |
| *** john-davidge has joined #openstack-infra | 02:15 | |
| *** sflanigan has quit IRC | 02:15 | |
| *** john-davidge has quit IRC | 02:19 | |
| *** yonglihe has joined #openstack-infra | 02:20 | |
| *** e0ne has joined #openstack-infra | 02:21 | |
| *** adrian_otto has joined #openstack-infra | 02:21 | |
| *** e0ne has quit IRC | 02:25 | |
| *** adrian_otto has quit IRC | 02:27 | |
| *** beslemon has quit IRC | 02:27 | |
| *** sflanigan has joined #openstack-infra | 02:28 | |
| *** yamamoto has joined #openstack-infra | 02:29 | |
| *** mat128 has joined #openstack-infra | 02:29 | |
| *** thorst has joined #openstack-infra | 02:30 | |
| *** Julien-zte has quit IRC | 02:32 | |
| *** yamamoto has quit IRC | 02:33 | |
| *** dharinic has joined #openstack-infra | 02:34 | |
| *** david-lyle has quit IRC | 02:36 | |
| *** gouthamr has quit IRC | 02:37 | |
| *** xarses has joined #openstack-infra | 02:39 | |
| *** rlandy has quit IRC | 02:43 | |
| *** gouthamr has joined #openstack-infra | 02:44 | |
| *** ihrachys has joined #openstack-infra | 02:47 | |
| *** gongysh has joined #openstack-infra | 02:48 | |
| *** thorst has quit IRC | 02:49 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 02:50 |
| *** Julien-zte has joined #openstack-infra | 02:51 | |
| *** yuanying has quit IRC | 02:55 | |
| *** amotoki has joined #openstack-infra | 03:00 | |
| *** dave-mccowan has quit IRC | 03:03 | |
| *** mdrabe has quit IRC | 03:09 | |
| *** EricGonczer_ has quit IRC | 03:10 | |
| *** links has joined #openstack-infra | 03:12 | |
| *** raginbajin has quit IRC | 03:14 | |
| *** nibalizer has quit IRC | 03:15 | |
| *** nicolasbock has quit IRC | 03:15 | |
| *** zerick has quit IRC | 03:15 | |
| *** nibalizer has joined #openstack-infra | 03:16 | |
| *** xarses has quit IRC | 03:17 | |
| *** xarses has joined #openstack-infra | 03:17 | |
| *** zerick has joined #openstack-infra | 03:17 | |
| *** gouthamr has quit IRC | 03:19 | |
| *** raginbajin has joined #openstack-infra | 03:21 | |
| *** e0ne has joined #openstack-infra | 03:22 | |
| *** dimtruck is now known as zz_dimtruck | 03:23 | |
| *** e0ne has quit IRC | 03:23 | |
| *** jeblair has quit IRC | 03:24 | |
| *** jeblair has joined #openstack-infra | 03:25 | |
| *** mat128 has quit IRC | 03:30 | |
| *** sflanigan has quit IRC | 03:33 | |
| *** erlon has quit IRC | 03:35 | |
| *** david-lyle has joined #openstack-infra | 03:37 | |
| *** dhajare has joined #openstack-infra | 03:45 | |
| *** gcb has quit IRC | 03:45 | |
| *** thorst has joined #openstack-infra | 03:46 | |
| *** sflanigan has joined #openstack-infra | 03:48 | |
| *** sflanigan has joined #openstack-infra | 03:48 | |
| *** mat128 has joined #openstack-infra | 03:50 | |
| *** thorst has quit IRC | 03:51 | |
| *** mat128 has quit IRC | 03:51 | |
| *** gcb has joined #openstack-infra | 03:59 | |
| *** Dinesh_Bhor has joined #openstack-infra | 04:00 | |
| *** tinwood has quit IRC | 04:05 | |
| *** tinwood has joined #openstack-infra | 04:06 | |
| *** jerryz has quit IRC | 04:15 | |
| *** john-davidge has joined #openstack-infra | 04:16 | |
| *** john-davidge has quit IRC | 04:20 | |
| *** e0ne has joined #openstack-infra | 04:22 | |
| *** psachin has joined #openstack-infra | 04:23 | |
| *** sflanigan has quit IRC | 04:24 | |
| *** aeng has quit IRC | 04:24 | |
| *** e0ne has quit IRC | 04:27 | |
| *** hichihara has joined #openstack-infra | 04:34 | |
| *** sflanigan has joined #openstack-infra | 04:36 | |
| *** sflanigan has joined #openstack-infra | 04:36 | |
| *** yuanying has joined #openstack-infra | 04:39 | |
| *** aeng has joined #openstack-infra | 04:42 | |
| *** prateek has joined #openstack-infra | 04:45 | |
| *** jordanP has joined #openstack-infra | 04:47 | |
| *** thorst has joined #openstack-infra | 04:47 | |
| *** jordanP has quit IRC | 04:51 | |
| *** thorst has quit IRC | 04:52 | |
| *** stakeda has joined #openstack-infra | 04:58 | |
| *** vryzhenkin has joined #openstack-infra | 05:07 | |
| *** freerunner has quit IRC | 05:07 | |
| *** askb has quit IRC | 05:07 | |
| *** vryzhenkin is now known as freerunner | 05:07 | |
| *** askb has joined #openstack-infra | 05:08 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/shade master: Add server security groups to shade https://review.openstack.org/451183 | 05:10 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config master: Setup known_hosts file on gerrit servers https://review.openstack.org/399822 | 05:14 |
| openstackgerrit | Jamie Lennox proposed openstack-infra/shade master: Add server security groups to shade https://review.openstack.org/451183 | 05:15 |
| openstackgerrit | Sonia Ramza proposed openstack-infra/groups master: Update how to link https://review.openstack.org/451185 | 05:19 |
| *** vikrant has joined #openstack-infra | 05:20 | |
| *** e0ne has joined #openstack-infra | 05:23 | |
| *** adrian_otto has joined #openstack-infra | 05:26 | |
| *** rbuzatu has quit IRC | 05:27 | |
| *** rbuzatu has joined #openstack-infra | 05:27 | |
| *** e0ne has quit IRC | 05:28 | |
| *** oomichi has quit IRC | 05:29 | |
| *** ramishra has quit IRC | 05:30 | |
| *** oomichi has joined #openstack-infra | 05:33 | |
| *** dhajare has quit IRC | 05:34 | |
| *** yamamoto has joined #openstack-infra | 05:35 | |
| *** ramishra has joined #openstack-infra | 05:35 | |
| *** nadya has joined #openstack-infra | 05:38 | |
| *** jimbaker` has joined #openstack-infra | 05:38 | |
| *** jimbaker has quit IRC | 05:39 | |
| *** rcernin has joined #openstack-infra | 05:39 | |
| *** yamamoto has quit IRC | 05:40 | |
| *** nadya has quit IRC | 05:41 | |
| *** yamahata has joined #openstack-infra | 05:48 | |
| *** thorst has joined #openstack-infra | 05:48 | |
| *** thorst has quit IRC | 05:52 | |
| *** zhurong has quit IRC | 05:54 | |
| *** luzC has quit IRC | 05:55 | |
| *** luzC has joined #openstack-infra | 05:56 | |
| *** sflanigan has quit IRC | 06:01 | |
| *** sflanigan has joined #openstack-infra | 06:04 | |
| *** sflanigan has joined #openstack-infra | 06:04 | |
| *** armax has quit IRC | 06:06 | |
| *** aeng has quit IRC | 06:08 | |
| *** jamielennox is now known as jamielennox|away | 06:10 | |
| *** dingyichen has joined #openstack-infra | 06:10 | |
| *** jaosorior has joined #openstack-infra | 06:14 | |
| *** john-davidge has joined #openstack-infra | 06:16 | |
| *** Hal has quit IRC | 06:20 | |
| *** john-davidge has quit IRC | 06:21 | |
| *** aeng has joined #openstack-infra | 06:22 | |
| *** isaacb has joined #openstack-infra | 06:24 | |
| *** pcaruana has joined #openstack-infra | 06:24 | |
| *** jamielennox|away is now known as jamielennox | 06:25 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move NTP management into openstack_project::server https://review.openstack.org/450972 | 06:26 |
| *** andreas_s has joined #openstack-infra | 06:26 | |
| *** dhajare has joined #openstack-infra | 06:27 | |
| *** apetrich has quit IRC | 06:35 | |
| *** apetrich has joined #openstack-infra | 06:35 | |
| *** dharinic has quit IRC | 06:35 | |
| *** dhajare has quit IRC | 06:40 | |
| *** yamamoto has joined #openstack-infra | 06:41 | |
| *** gcb has quit IRC | 06:42 | |
| *** florianf has joined #openstack-infra | 06:46 | |
| *** lihi has quit IRC | 06:46 | |
| *** yamamoto has quit IRC | 06:47 | |
| *** dimak has quit IRC | 06:48 | |
| *** oanson has quit IRC | 06:48 | |
| *** thorst has joined #openstack-infra | 06:49 | |
| *** jamielennox is now known as jamielennox|away | 06:50 | |
| *** gcb has joined #openstack-infra | 06:51 | |
| *** prateek_ has joined #openstack-infra | 06:51 | |
| *** thorst has quit IRC | 06:53 | |
| *** jkilpatr has quit IRC | 06:53 | |
| *** prateek has quit IRC | 06:54 | |
| *** matrohon has joined #openstack-infra | 06:55 | |
| *** jamielennox|away is now known as jamielennox | 06:57 | |
| *** pgadiya has joined #openstack-infra | 06:58 | |
| *** matrohon has quit IRC | 07:01 | |
| *** gongysh has quit IRC | 07:01 | |
| *** dhajare has joined #openstack-infra | 07:01 | |
| *** dharinic has joined #openstack-infra | 07:01 | |
| *** chem is now known as chem|brb | 07:04 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Fix test_leaked_node_not_deleted for v3 https://review.openstack.org/449375 | 07:06 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: I948f9f69ad911778fabb1c498aebd23acce8c89c https://review.openstack.org/451214 | 07:06 |
| *** dhajare has quit IRC | 07:08 | |
| *** dharinic has quit IRC | 07:09 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Fix test_leaked_node_not_deleted for v3 https://review.openstack.org/449375 | 07:12 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/445325 | 07:12 |
| *** chem|brb is now known as chem | 07:13 | |
| *** alex_xu has quit IRC | 07:13 | |
| *** tesseract has joined #openstack-infra | 07:14 | |
| *** prateek__ has joined #openstack-infra | 07:15 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate master: Enable libvirt coredumps & save to logs https://review.openstack.org/451219 | 07:16 |
| *** alex_xu has joined #openstack-infra | 07:16 | |
| *** prateek_ has quit IRC | 07:18 | |
| *** aviau has quit IRC | 07:19 | |
| *** aviau has joined #openstack-infra | 07:19 | |
| *** dhajare has joined #openstack-infra | 07:20 | |
| *** aviau has quit IRC | 07:21 | |
| *** aviau has joined #openstack-infra | 07:21 | |
| *** amoralej|off is now known as amoralej | 07:24 | |
| *** ralonsoh has joined #openstack-infra | 07:25 | |
| *** Hal has joined #openstack-infra | 07:27 | |
| *** oomichi has quit IRC | 07:29 | |
| *** aarefiev_afk is now known as aarefiev | 07:32 | |
| *** oomichi has joined #openstack-infra | 07:33 | |
| *** zhurong has joined #openstack-infra | 07:34 | |
| *** Swami has joined #openstack-infra | 07:34 | |
| *** Swami has quit IRC | 07:34 | |
| *** gongysh has joined #openstack-infra | 07:35 | |
| *** hashar has joined #openstack-infra | 07:41 | |
| *** yamamoto has joined #openstack-infra | 07:43 | |
| *** sileht has quit IRC | 07:45 | |
| openstackgerrit | Ferenc Horváth proposed openstack-infra/project-config master: Add new Tempest test plugin for the Nova project https://review.openstack.org/448482 | 07:46 |
| *** yamamoto has quit IRC | 07:48 | |
| *** lucas-afk is now known as lucas-event | 07:49 | |
| *** thorst has joined #openstack-infra | 07:49 | |
| *** e0ne has joined #openstack-infra | 07:54 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support upgrades in multinode CI https://review.openstack.org/450784 | 07:55 |
| *** zzzeek has quit IRC | 08:00 | |
| *** markus_z has joined #openstack-infra | 08:02 | |
| *** zzzeek has joined #openstack-infra | 08:03 | |
| *** shardy has joined #openstack-infra | 08:03 | |
| *** rossella_s has joined #openstack-infra | 08:03 | |
| *** thorst has quit IRC | 08:08 | |
| *** andreas_s has quit IRC | 08:09 | |
| openstackgerrit | Merged openstack-infra/project-config master: Adding networking-h3c project. https://review.openstack.org/448366 | 08:13 |
| *** hichihara has quit IRC | 08:13 | |
| *** jordanP has joined #openstack-infra | 08:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable Barbican for Cinder LIO job https://review.openstack.org/449799 | 08:14 |
| *** adrian_otto has quit IRC | 08:16 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add OSC functional tips job to osc-lib and os-client-config https://review.openstack.org/450419 | 08:16 |
| *** jamielennox is now known as jamielennox|away | 08:17 | |
| *** john-davidge has joined #openstack-infra | 08:17 | |
| *** john-davidge has quit IRC | 08:22 | |
| *** nadya has joined #openstack-infra | 08:22 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul feature/zuulv3: Use libyaml if possible https://review.openstack.org/451113 | 08:25 |
| *** matrohon has joined #openstack-infra | 08:27 | |
| *** matrohon_ has joined #openstack-infra | 08:28 | |
| *** matrohon has quit IRC | 08:31 | |
| *** yuanying has quit IRC | 08:31 | |
| *** neiljerram has joined #openstack-infra | 08:36 | |
| *** gcb has quit IRC | 08:39 | |
| *** gcb has joined #openstack-infra | 08:39 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate master: Enable libvirt coredumps & save to logs https://review.openstack.org/451219 | 08:44 |
| *** yamamoto has joined #openstack-infra | 08:45 | |
| *** dingyichen has quit IRC | 08:45 | |
| *** esberglu has joined #openstack-infra | 08:49 | |
| *** hrubi has quit IRC | 08:50 | |
| *** yamamoto has quit IRC | 08:50 | |
| *** hrubi has joined #openstack-infra | 08:50 | |
| *** rcarrillocruz has joined #openstack-infra | 08:52 | |
| *** esberglu has quit IRC | 08:53 | |
| *** rpodolyaka_afk is now known as rpodolyaka | 08:57 | |
| *** pgadiya has quit IRC | 09:01 | |
| *** cody-somerville has quit IRC | 09:02 | |
| *** gongysh has quit IRC | 09:02 | |
| *** cody-somerville has joined #openstack-infra | 09:02 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: WIP: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 09:05 |
| *** thorst has joined #openstack-infra | 09:05 | |
| *** ccamacho has joined #openstack-infra | 09:08 | |
| *** pgadiya has joined #openstack-infra | 09:09 | |
| *** ihrachys has quit IRC | 09:09 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add bare parameter to get/list/search server https://review.openstack.org/451264 | 09:09 |
| *** thorst has quit IRC | 09:09 | |
| *** ihrachys has joined #openstack-infra | 09:10 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 09:11 |
| *** electrofelix has joined #openstack-infra | 09:11 | |
| *** ihrachys has quit IRC | 09:17 | |
| openstackgerrit | Alfredo Moralejo proposed openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 09:18 |
| *** derekh has joined #openstack-infra | 09:20 | |
| *** alexchadin has joined #openstack-infra | 09:21 | |
| *** pedh has joined #openstack-infra | 09:22 | |
| *** rbuzatu has quit IRC | 09:23 | |
| *** jordanP has quit IRC | 09:24 | |
| openstackgerrit | Merged openstack-infra/shade master: Don't use project-id in catalog tests https://review.openstack.org/451123 | 09:25 |
| *** yamahata has quit IRC | 09:27 | |
| *** sdague has joined #openstack-infra | 09:29 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Fix a few minor annoyances that snuck in https://review.openstack.org/451276 | 09:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Enable H238 - classes should be subclasses of object https://review.openstack.org/451277 | 09:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Enable H201 - don't throw bare exceptions https://review.openstack.org/451278 | 09:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Reenable hacking tests that already pass https://review.openstack.org/451279 | 09:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Take care of multiple imports and update explanation https://review.openstack.org/451280 | 09:30 |
| fdegir | electrofelix: zxiiro: can we please get this reviewed/approved? | 09:30 |
| fdegir | electrofelix: zxiiro: https://review.openstack.org/#/c/349219/ | 09:30 |
| *** sambetts|afk is now known as sambetts | 09:30 | |
| *** Julien-zte has quit IRC | 09:34 | |
| *** yuanying has joined #openstack-infra | 09:39 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: WIP: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 09:39 |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: DNM: give me more debug https://review.openstack.org/450800 | 09:40 |
| *** amotoki has quit IRC | 09:40 | |
| *** flepied has quit IRC | 09:41 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/451296 | 09:43 |
| *** yuanying has quit IRC | 09:44 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 09:45 |
| *** yamamoto has joined #openstack-infra | 09:46 | |
| *** yuanying has joined #openstack-infra | 09:47 | |
| electrofelix | fdegir: I was just waiting till this morning to check the resulting generated docs before approving | 09:49 |
| pedh | Please add member huang.cheng@h3c.com to gerrit group networking-h3c-core and networking-h3c-release for new project | 09:49 |
| *** tosky has joined #openstack-infra | 09:49 | |
| *** andreas_s has joined #openstack-infra | 09:51 | |
| *** yanyanhu has quit IRC | 09:51 | |
| *** yanyanhu has joined #openstack-infra | 09:52 | |
| *** yamamoto has quit IRC | 09:52 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: Wrapper pre-scm-buildstep: added support for failOnError parameter https://review.openstack.org/349219 | 09:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add requirements gate jobs to shade https://review.openstack.org/451301 | 09:57 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: Put all scenario jobs under single job template https://review.openstack.org/451302 | 09:57 |
| *** matrohon_ has quit IRC | 09:57 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add requirements gate jobs to shade and requestsexceptions https://review.openstack.org/451301 | 09:59 |
| *** e0ne has quit IRC | 10:01 | |
| *** tuanluong has quit IRC | 10:01 | |
| *** e0ne has joined #openstack-infra | 10:01 | |
| fdegir | electrofelix: thx a lot! | 10:04 |
| openstackgerrit | Monty Taylor proposed openstack-infra/requestsexceptions master: Update tox for OpenStack https://review.openstack.org/451306 | 10:05 |
| openstackgerrit | Monty Taylor proposed openstack-infra/requestsexceptions master: Remove runtime depend on pbr https://review.openstack.org/451307 | 10:05 |
| *** thorst has joined #openstack-infra | 10:05 | |
| *** flepied has joined #openstack-infra | 10:09 | |
| *** thorst has quit IRC | 10:10 | |
| *** florianf has quit IRC | 10:13 | |
| *** florianf has joined #openstack-infra | 10:14 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Update tox build settings https://review.openstack.org/451312 | 10:14 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove heatclient and magnumclient from PROJECTS https://review.openstack.org/451315 | 10:16 |
| *** amotoki has joined #openstack-infra | 10:16 | |
| *** gcb has quit IRC | 10:16 | |
| *** amotoki has quit IRC | 10:17 | |
| *** john-davidge has joined #openstack-infra | 10:18 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove heatclient and magnumclient from PROJECTS https://review.openstack.org/451315 | 10:18 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add requirements gate jobs to shade and requestsexceptions https://review.openstack.org/451301 | 10:18 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add requestsexceptions to #openstack-shade https://review.openstack.org/451317 | 10:18 |
| *** liujiong has quit IRC | 10:19 | |
| dalvarez | anyone can point me out to how to add version constraints to bindep please? looks like it's exploding in the gate or i did it wrong https://review.openstack.org/#/c/451225/1 | 10:21 |
| *** john-davidge has quit IRC | 10:22 | |
| *** yanyanhu has quit IRC | 10:23 | |
| *** dizquierdo has joined #openstack-infra | 10:24 | |
| *** puiterwijk has quit IRC | 10:24 | |
| *** Guest77415 has joined #openstack-infra | 10:26 | |
| *** Guest77415 has joined #openstack-infra | 10:26 | |
| *** adarazs is now known as adarazs_lunch | 10:26 | |
| *** oomichi has quit IRC | 10:29 | |
| *** jordanP has joined #openstack-infra | 10:30 | |
| *** alexchadin has quit IRC | 10:31 | |
| *** nicolasbock has joined #openstack-infra | 10:31 | |
| *** amotoki has joined #openstack-infra | 10:31 | |
| *** oomichi has joined #openstack-infra | 10:33 | |
| *** tuanluong has joined #openstack-infra | 10:34 | |
| ianw | pedh: done | 10:36 |
| *** alexchadin has joined #openstack-infra | 10:37 | |
| *** amotoki has quit IRC | 10:40 | |
| *** knangia has quit IRC | 10:41 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 10:43 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 10:44 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 10:45 |
| mordred | dalvarez: it certainly seems like a bug | 10:45 |
| mordred | dalvarez: I can reproduce it locally | 10:45 |
| dalvarez | mordred, i reported it to storyboard | 10:45 |
| dalvarez | mordred, locally i get different error on centos | 10:45 |
| mordred | joy | 10:46 |
| mordred | dalvarez: oh - speaking of- I haven't checked, does normal centos have haproxy 1.5 already? | 10:46 |
| dalvarez | ometa.runtime.ParseError: | 10:46 |
| dalvarez | 1.5.18-3.el7_3.1 | 10:46 |
| dalvarez | ^ | 10:46 |
| dalvarez | Parse error at line 1, column 13: expected EOF. trail: [trailingdeb] | 10:46 |
| dalvarez | yes, 1.5.18-3 actually :) | 10:46 |
| mordred | cool | 10:46 |
| dalvarez | mordred, first time i report a bug to infra so i hope i did it okay :D | 10:47 |
| mordred | oh - I tihnk that your error may be due to lack of rich support for that rpm version string in its grammar | 10:47 |
| mordred | dalvarez: absolutely! sorry the tool is giving you issues :) | 10:47 |
| dalvarez | mordred, no worries, i have bugs all the time :p | 10:48 |
| *** yamamoto has joined #openstack-infra | 10:48 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 10:49 |
| mordred | lifeless: if you happen to be lurking and have any insight ^^ - the issue is trivially reproducible on Ubuntu if you add haproxy >=1.5.0 to a bindep file and run bindep | 10:50 |
| mordred | lifeless: the error message is inscrutible to me | 10:50 |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate master: Enable libvirt coredumps & save to logs https://review.openstack.org/451219 | 10:50 |
| ianw | TIL: gzip has a "-r" option | 10:50 |
| mordred | ianw: wow | 10:53 |
| *** yamamoto has quit IRC | 10:54 | |
| *** alexchadin has quit IRC | 10:57 | |
| *** nadya has quit IRC | 11:00 | |
| *** mat128 has joined #openstack-infra | 11:01 | |
| *** jkilpatr has joined #openstack-infra | 11:02 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack-infra/bindep master: Update 'pbr' version requirements https://review.openstack.org/451333 | 11:03 |
| openstackgerrit | Lukáš Löwinger proposed openstack-infra/jenkins-job-builder master: Support all parameters in gitlab-merge-request https://review.openstack.org/451334 | 11:03 |
| dalvarez | thanks mordred :) | 11:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add requirements gate jobs to shade and requestsexceptions https://review.openstack.org/451301 | 11:03 |
| *** rfolco has joined #openstack-infra | 11:05 | |
| *** aeng_ has joined #openstack-infra | 11:05 | |
| *** thorst has joined #openstack-infra | 11:06 | |
| *** matrohon_ has joined #openstack-infra | 11:07 | |
| *** jkilpatr has quit IRC | 11:07 | |
| *** jkilpatr has joined #openstack-infra | 11:07 | |
| *** tuanluong has quit IRC | 11:07 | |
| *** yamamoto has joined #openstack-infra | 11:09 | |
| *** thorst has quit IRC | 11:11 | |
| *** amotoki has joined #openstack-infra | 11:11 | |
| *** thomas_oneill is now known as thomas-oneill | 11:16 | |
| *** yamamoto has quit IRC | 11:19 | |
| *** alexchadin has joined #openstack-infra | 11:19 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config master: [rally]Move cinder scenario job out non-voting https://review.openstack.org/451339 | 11:21 |
| *** jamesdenton has joined #openstack-infra | 11:27 | |
| *** jamesden_ has joined #openstack-infra | 11:31 | |
| *** jamesdenton has quit IRC | 11:31 | |
| pabelanger | clarkb: Hmm, looks like glean is still failing in some cases: http://logs.openstack.org/65/449965/5/check/gate-kolla-dsvm-build-oraclelinux-source-centos-7/85d2ea7/logs/syslog.txt.gz#_Mar_29_10_55_35 | 11:32 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Fix test_leaked_node_not_deleted for v3 https://review.openstack.org/449375 | 11:33 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/445325 | 11:33 |
| pabelanger | clarkb: I think we could merge: https://review.openstack.org/#/c/450627/ and tag a release | 11:33 |
| openstackgerrit | Lukáš Löwinger proposed openstack-infra/jenkins-job-builder master: Support all parameters in gitlab-merge-request https://review.openstack.org/451334 | 11:34 |
| *** zhurong has quit IRC | 11:34 | |
| *** andreas_s has quit IRC | 11:36 | |
| *** matrohon_ has quit IRC | 11:37 | |
| *** spotz is now known as spotz_zzz | 11:40 | |
| *** Guest77415 is now known as puiterwijk | 11:41 | |
| *** cody-somerville has quit IRC | 11:42 | |
| dalvarez | mordred, ping ralonsoh is trying to reproduce the bindep issue | 11:47 |
| ralonsoh | mordred, dalvarez: this is my output (and the library versions used) http://paste.openstack.org/show/604645/ | 11:47 |
| dalvarez | ralonsoh, in my centos im getting this: | 11:48 |
| ralonsoh | it's failing only because I don't have some binaries, but not because of the version | 11:48 |
| dalvarez | ralonsoh, http://paste.openstack.org/show/604646/ | 11:49 |
| dalvarez | lemme execute tox -ebindep | 11:49 |
| *** askb has quit IRC | 11:49 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config master: [rally]Move cinder and heat scenario jobs out non-voting https://review.openstack.org/451339 | 11:50 |
| dalvarez | ralonsoh, fails with the same error message | 11:50 |
| dalvarez | ralonsoh, http://paste.openstack.org/show/604648/ | 11:51 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 11:52 |
| *** nadya has joined #openstack-infra | 11:52 | |
| *** wewe0901 has joined #openstack-infra | 11:52 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 11:54 |
| *** rhallisey has joined #openstack-infra | 11:54 | |
| *** thorst has joined #openstack-infra | 11:54 | |
| *** john-davidge has joined #openstack-infra | 11:56 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 11:56 |
| *** amoralej is now known as amoralej|lunch | 11:56 | |
| *** aysyd has joined #openstack-infra | 11:57 | |
| *** spotz_zzz is now known as spotz | 11:58 | |
| *** adarazs_lunch is now known as adarazs | 11:58 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Disable deltarpms for fedora mirrors https://review.openstack.org/451360 | 11:59 |
| pabelanger | infra-root: fedora images will need to be rebuild this morning to pickup ^, until then jobs will fail. Looks like dnf want drpms, which we don't host (saves HDD space) | 12:00 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Use stable release templates for all environments https://review.openstack.org/451361 | 12:00 |
| *** ilyashakhat_mobi has joined #openstack-infra | 12:02 | |
| *** ilyashakhat_mobi has quit IRC | 12:03 | |
| *** aeng_ has quit IRC | 12:03 | |
| *** chlong has quit IRC | 12:05 | |
| *** Julien-zte has joined #openstack-infra | 12:08 | |
| *** rbuzatu has joined #openstack-infra | 12:09 | |
| *** rbuzatu has quit IRC | 12:09 | |
| *** rbuzatu has joined #openstack-infra | 12:09 | |
| *** signed8bit_Zzz is now known as signed8b_ | 12:14 | |
| *** Julien-zte has quit IRC | 12:15 | |
| *** Julien-zte has joined #openstack-infra | 12:15 | |
| *** zinggggg has quit IRC | 12:18 | |
| *** deduped has joined #openstack-infra | 12:19 | |
| *** yamamoto has joined #openstack-infra | 12:20 | |
| *** Julien-zte has quit IRC | 12:20 | |
| *** deduped is now known as misterpink | 12:20 | |
| *** alexchadin has quit IRC | 12:22 | |
| *** gordc has joined #openstack-infra | 12:23 | |
| *** Julien-zte has joined #openstack-infra | 12:24 | |
| *** yamamoto has quit IRC | 12:25 | |
| *** dprince has joined #openstack-infra | 12:26 | |
| *** namnh has quit IRC | 12:29 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 12:30 |
| *** trown|outtypewww is now known as trown | 12:30 | |
| *** xyang1 has joined #openstack-infra | 12:34 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 12:35 |
| *** Julien-zte has quit IRC | 12:38 | |
| *** nadya has quit IRC | 12:38 | |
| *** krtaylor has quit IRC | 12:40 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 12:41 |
| pabelanger | yolanda: just left a comment | 12:42 |
| *** dolphm has joined #openstack-infra | 12:42 | |
| *** rossella_s has quit IRC | 12:42 | |
| yolanda | pabelanger, you mean update for newton, ocata? | 12:43 |
| *** ociuhandu has joined #openstack-infra | 12:43 | |
| *** rossella_s has joined #openstack-infra | 12:43 | |
| yolanda | it will make sense to do a follow up patch? different issue | 12:43 |
| pabelanger | yolanda: sure, just wanted to comment on it | 12:44 |
| yolanda | you are rigth | 12:44 |
| yolanda | i will file another | 12:44 |
| yolanda | so you think this makes sense to sort the dib problem? | 12:44 |
| fungi | mrmartin: we have a new contributor to the groups repo! https://review.openstack.org/451185 | 12:45 |
| mrmartin | fungi, I know, she's helping with the user groups. | 12:45 |
| *** jcoufal has joined #openstack-infra | 12:46 | |
| *** dave-mccowan has joined #openstack-infra | 12:46 | |
| *** pgadiya has quit IRC | 12:47 | |
| *** gouthamr has joined #openstack-infra | 12:47 | |
| *** rlandy has joined #openstack-infra | 12:47 | |
| *** signed8b_ is now known as signed8bit_Zzz | 12:47 | |
| *** Julien-zte has joined #openstack-infra | 12:48 | |
| fungi | awesome | 12:48 |
| *** matrohon_ has joined #openstack-infra | 12:48 | |
| *** rbuzatu_ has joined #openstack-infra | 12:49 | |
| *** edmondsw has joined #openstack-infra | 12:51 | |
| *** rbuzatu has quit IRC | 12:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Move gate-dsvm-nodepool-debian-src-nv to experimental https://review.openstack.org/451383 | 12:53 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: WIP: create a README_LOGS to document log files https://review.openstack.org/447653 | 12:54 |
| edmondsw | smcginnis dims I think I've hit https://github.com/eventlet/eventlet/issues/398. I don't see a change in global-requirements for this... is that coming? | 12:54 |
| *** alexchadin has joined #openstack-infra | 12:54 | |
| pabelanger | fungi: so, I've started writing a patch for rubygems-mirror to add directory hash support, so far I haven't pushed it upstream. What I wanted to know is, a) could we use this fork if we import into openstack-infra, b) I am hashing on filename, so foobar.gem becomes f/fo/foobar.gem, and plan to add a rewrite rule into apache2 to handle that. I'm looking for some feedback | 12:58 |
| smcginnis | edmondsw: We ended up changing the Cinder code to work around it. | 12:58 |
| pabelanger | https://github.com/pabelanger/rubygems-mirror/commit/dfdb464ce187bfd1ee76774a465a704239257924 is the commit for hashdir support | 12:59 |
| *** panda is now known as panda|afk | 12:59 | |
| smcginnis | edmondsw: Unfortunately, that appears to be the route everyone has chosen rather than fixing the root cause. | 12:59 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Select the right repo for stable branches https://review.openstack.org/451389 | 12:59 |
| edmondsw | smcginnis gah... I don't know if that will work for me | 12:59 |
| dims | edmondsw : which CI job? | 12:59 |
| edmondsw | smcginnis can you point me to the cinder patch? | 12:59 |
| smcginnis | edmondsw: Looking... | 13:00 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 13:00 |
| edmondsw | dims, I actually hit this in a gerrit my team has setup for old releases we still have to support | 13:00 |
| *** dtardivel has joined #openstack-infra | 13:01 | |
| smcginnis | edmondsw: Do you enforce any kind of upper constraints? | 13:01 |
| pabelanger | fungi: commit message references md5sum, but I think that would means a project apache2 will need to run to do the convert. Why I switched to filenames | 13:01 |
| edmondsw | smcginnis I have a question out on that, but I suspect no | 13:01 |
| smcginnis | edmondsw: I think that is the only other option. If you limit it to an older version, it didn't monkey_patch subprocess, so you don't hit this failure. | 13:02 |
| edmondsw | smcginnis anyway I noted that upper-constraints still has 20.1, which is what our gerrit used and has this problem | 13:02 |
| *** gordc has quit IRC | 13:02 | |
| smcginnis | edmondsw: Yep, that's going to hit it. | 13:02 |
| *** gordc has joined #openstack-infra | 13:02 | |
| edmondsw | smcginnis right, I'm trying to catch our build guy to suggest an upper constraint here | 13:03 |
| smcginnis | edmondsw: Here's the workaround: https://review.openstack.org/#/c/448201/ | 13:03 |
| *** lucas-event is now known as lucasagomes | 13:03 | |
| edmondsw | smcginnis tx... and are you backporting that to all releases? | 13:03 |
| *** mdrabe has joined #openstack-infra | 13:03 | |
| smcginnis | edmondsw: No, I think upper-constraints for stable branches did not include that. | 13:04 |
| *** trown is now known as trown|brb | 13:04 | |
| edmondsw | smcginnis ah ok | 13:04 |
| smcginnis | edmondsw: I didn't actually check on that I guess, so maybe I'm wrong? | 13:04 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Select the right repo for stable branches https://review.openstack.org/451389 | 13:04 |
| smcginnis | edmondsw: No, I think Ocata is OK: https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L132 | 13:05 |
| edmondsw | smcginnis yep, agreed | 13:05 |
| *** kgiusti has joined #openstack-infra | 13:05 | |
| * smcginnis gives a sigh of relief... | 13:05 | |
| *** ihrachys has joined #openstack-infra | 13:05 | |
| edmondsw | :) | 13:05 |
| fungi | pabelanger: have you started a pr for that patch yet? (with corrected commit message obviously) | 13:05 |
| edmondsw | smcginnis can I ask why we decided to patch our code everywhere rather than just not picking up this bad eventlet version? | 13:06 |
| *** dolphm has left #openstack-infra | 13:06 | |
| fungi | pabelanger: we were in a similar situation with bandersnatch until they merged jeblair's deep tree patch | 13:06 |
| smcginnis | edmondsw: I'm not the one you want to ask about that. ;) | 13:06 |
| edmondsw | dims? | 13:06 |
| fungi | edmondsw: is it really a bad eventlet version (bug/regression they intend to fix) or is it an intentional design choice on their part? | 13:07 |
| edmondsw | fungi my understanding is bug/regression they intend to fix | 13:07 |
| pabelanger | fungi: no PR yet, I want to make sure we are okay with the solution first, before I push upstream. I'd also want to include the apache configuration. Part of the reasons I'm asking for help now | 13:07 |
| dims | fungi : intentional change | 13:07 |
| pabelanger | fungi: but, I can do a PR and we can iterate on github. Yay? | 13:08 |
| edmondsw | dims fungi they say it's a duplicate of another issue and then "Thanks for the reminder, I'll try to make it sooner" | 13:08 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Fix test_leaked_node_not_deleted for v3 https://review.openstack.org/449375 | 13:08 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/445325 | 13:08 |
| edmondsw | dims fungi so sounds like something they're fixing | 13:08 |
| dims | edmondsw : that other one is a really long standing one | 13:08 |
| dims | edmondsw : which IMHO may not get fixed anytime soon | 13:08 |
| fungi | pabelanger: skimming, looks fine. but obviously they'll have to say | 13:09 |
| edmondsw | dims gotta love eventlet... | 13:09 |
| dims | this specific one about poll was tried before, reverted and then then are trying again | 13:09 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Fix test_leaked_node_not_deleted for v3 https://review.openstack.org/449375 | 13:09 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/nodepool feature/zuulv3: Merge branch 'master' into feature/zuulv3 https://review.openstack.org/445325 | 13:09 |
| edmondsw | dims yeah, I saw that | 13:09 |
| *** ihrachys has quit IRC | 13:10 | |
| *** mattmceuen has joined #openstack-infra | 13:10 | |
| *** pgadiya has joined #openstack-infra | 13:12 | |
| *** matrohon_ has quit IRC | 13:13 | |
| pabelanger | fungi: okay, do you have time today to help with the apache rewrite rules? | 13:13 |
| *** pgadiya has quit IRC | 13:14 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html" https://review.openstack.org/448108 | 13:15 |
| *** ihrachys has joined #openstack-infra | 13:16 | |
| *** amoralej|lunch is now known as amoralej | 13:17 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html", move report to ara_oooq https://review.openstack.org/448108 | 13:17 |
| fungi | pabelanger: sure thing, we can probably crib from our pypi rewrites | 13:17 |
| mnaser | so for kolla, we setup haproxy+keepalived in gate to listen on 169.254.169.10 (in the assumption that there shouldn't be anyone using that IP). we just had a job fail on bluebox because it looks like 169.254.169.10 responded to pings? http://logs.openstack.org/03/450203/2/check/gate-kolla-dsvm-deploy-centos-binary-centos-7-nv/f917f47/console.html | 13:17 |
| mnaser | is there a suggested range for us to work with? | 13:17 |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/451296 | 13:18 |
| *** sileht has joined #openstack-infra | 13:19 | |
| edmondsw | dims was there an upper-constraints for liberty? And is there still a way to find that? | 13:19 |
| *** vikrant has quit IRC | 13:20 | |
| SamYaple | edmondsw: https://github.com/openstack/requirements/blob/stable/liberty/upper-constraints.txt ? | 13:20 |
| *** ihrachys has quit IRC | 13:20 | |
| dims | edmondsw : looks like it https://github.com/openstack/requirements/blob/stable/liberty/upper-constraints.txt | 13:20 |
| *** links has quit IRC | 13:20 | |
| edmondsw | dims SamYaple oh, sorry... I assumed since liberty has been removed for the other projects... | 13:20 |
| *** erlon has joined #openstack-infra | 13:20 | |
| SamYaple | edmondsw: even if it had, you would find a liberty-eol tag | 13:20 |
| pabelanger | mnaser: you could look to devstack to see the ranges we setup for it. You could do the same | 13:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Add waitForNodes() for test_node_assignment https://review.openstack.org/451119 | 13:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Rename nodepoold to nodepool-launcher https://review.openstack.org/450877 | 13:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Force os-client-config to use ipv4 https://review.openstack.org/450983 | 13:21 |
| edmondsw | SamYaple, that's what I was looking for, tx | 13:21 |
| pabelanger | fungi: thanks | 13:21 |
| mnaser | ok cool ill checkout devstack-gate | 13:21 |
| *** zhurong has joined #openstack-infra | 13:21 | |
| *** vikrant has joined #openstack-infra | 13:21 | |
| SamYaple | edmondsw: ah i see. yea since the branch hasn't been decom'd there wasn't a tag yet. made that mistake myself a few times | 13:21 |
| fungi | mnaser: well, 169.254.169.10 is the ipv4 linklocal range, you can't treat it like rfc 1918 space. my guess is that there's an extra network interface on bluebox instances which is configured to get ip addresses via dhcp but there's no dhcp server listening on that lan so it ends up self-assigning a linklocal address (along with dozens of other instances, all of whom may see ping responses from one | 13:22 |
| fungi | another on those addresses) | 13:22 |
| *** yamamoto has joined #openstack-infra | 13:22 | |
| fungi | er, is IN the ipv4 linklocal range | 13:22 |
| SamYaple | can I get additional review for https://review.openstack.org/#/c/450473/ ? i haven't done some of these things in that patchset before so i want to make sure im doing them correctly | 13:22 |
| pabelanger | fungi: also, do you mind a +3 on https://review.openstack.org/#/c/451360/ will help get fedora workers back online | 13:22 |
| *** pradk has quit IRC | 13:23 | |
| mnaser | fungi: i see, so probably better to use rfc1918 space? (but then need to figure out something that doesnt conflict with all clouds) | 13:23 |
| fungi | mnaser: and yeah, if you're not _using_ devstack-gate, then reusing the same rfc 1918 addresses it does should be safe | 13:23 |
| lucasagomes | hi all, if you have few minutes mind taking a quick look at https://review.openstack.org/#/c/450685/ ? It just introducing a new repository for some tools that we use in ironic | 13:23 |
| fungi | mnaser: if we end up with a provider who's overlapping with the address space already in use for devstack-gate we'll have to figure out a solution for that anyway | 13:24 |
| *** knangia has joined #openstack-infra | 13:25 | |
| pabelanger | SamYaple: left a -1 suggestion | 13:25 |
| *** eharney has joined #openstack-infra | 13:26 | |
| *** rfolco has quit IRC | 13:26 | |
| SamYaple | pabelanger: i actually changed that because of how the other projects are doing it | 13:26 |
| fungi | mnaser: an alternative might be to use ipv6 ula (fc00::/7)? | 13:26 |
| mnaser | fungi that's an interesting option but i dont know how ipv6 ready kolla is for this sort of things | 13:27 |
| zigo | pabelanger: Hi there! | 13:27 |
| mnaser | because this is used for vrrp/haproxy | 13:27 |
| fungi | mnaser: though that introduces a new challenge since you need to %-bind the destinations on interfaces | 13:27 |
| SamYaple | pabelanger: specifically puppet-modules | 13:27 |
| zigo | pabelanger: Did you have time to look into the Stretch image creation? | 13:27 |
| *** yamamoto has quit IRC | 13:28 | |
| pabelanger | SamYaple: ya, it is valid, but if you start cloning more things you'll need to update it. Also, zuulv3 will have the full path, so some forward thinking on myside | 13:28 |
| SamYaple | pabelanger: ok. will do. ill upate it | 13:28 |
| *** signed8bit_Zzz is now known as signed8b_ | 13:28 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config master: Add non-voting initial gate for LOCI https://review.openstack.org/450473 | 13:29 |
| SamYaple | pabelanger: thanks! | 13:29 |
| mnaser | fungi it looks like tripleo ci uses 192.168.24.1 for services, .2 for haproxy public and .3 for haproxy admin/internal | 13:29 |
| mnaser | i think maybe we can try that | 13:29 |
| pabelanger | zigo: yes, but found an issue with glean on debian-jessie first. So, I am working to fix that, as we need it for stretch too | 13:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Add waitForNodes() for test_node_assignment https://review.openstack.org/451119 | 13:29 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Specify a location for the ARA database within the workspace https://review.openstack.org/451396 | 13:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Rename nodepoold to nodepool-launcher https://review.openstack.org/450877 | 13:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Force os-client-config to use ipv4 https://review.openstack.org/450983 | 13:29 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Support upgrades in multinode CI https://review.openstack.org/450784 | 13:29 |
| zigo | pabelanger: What is the issue about? | 13:29 |
| pabelanger | zigo: then, I am going to add a dsvm-nodepool-debian jobs to start building stretch in the gate. | 13:29 |
| dmsimard | clarkb, pabelanger: do Depends-On on devstack-gate reviews work ? | 13:30 |
| pabelanger | zigo: then, we should be in a better position to start supporting debian-stretch in infra | 13:30 |
| zigo | pabelanger: Oh, so you've found out how to fix *both* ? :P | 13:30 |
| * zigo .oO(pabelanger is awesome...) | 13:30 | |
| pabelanger | zigo: systemd network-pre target is causing us some issues, because it is still using init.d for networking things | 13:30 |
| pabelanger | zigo: I am on the track, but need some more time | 13:31 |
| fungi | mnaser: devstack-gate defines a $DEVSTACK_GATE_FIXED_RANGE defaulting to 10.1.0.0/20 and assigns addressing out of that using offsets. you might consider a similar overridable solution since we'll likely rely on being able to vary that per-provider in the future if we run into conflicts | 13:31 |
| pabelanger | dmsimard: it should, yes | 13:31 |
| zigo | pabelanger: Let me know if I can help. | 13:31 |
| *** rfolco has joined #openstack-infra | 13:32 | |
| SamYaple | is Strech released yet? | 13:32 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Replace "ara generate" by "ara generate html", move report to ara_oooq https://review.openstack.org/448108 | 13:32 |
| pabelanger | zigo: if you know how to write a proper systemd.service that needs to run before network-pre, let me know | 13:32 |
| pabelanger | zigo: that is what I am working on | 13:32 |
| mnaser | fungi the thing is this isnt a range we're defining for neutron networks. kolla sets up haproxy+keepalived to setup a vip for all the openstack services. the conflicting IP in this case is the address being used for the VIP/haproxy | 13:32 |
| SamYaple | i thought it was going to be like 4-5 months | 13:32 |
| *** baoli has joined #openstack-infra | 13:32 | |
| zigo | pabelanger: FYI, I got some ongoing fixes to do for OpenStack Newton on Stretch which have my priority right now, but I can try to help anyway. | 13:32 |
| pabelanger | zigo: issue is, debian as ifup@.service, which centos doesn't | 13:32 |
| zigo | pabelanger: I believe I do. | 13:32 |
| *** mat128 has quit IRC | 13:32 | |
| zigo | onovy: Maybe you can help pabelanger with this? | 13:32 |
| *** kiseok7_ has joined #openstack-infra | 13:32 | |
| SamYaple | pabelanger: you can use systemd-network for both as an alternative | 13:32 |
| *** kiseok7_ has left #openstack-infra | 13:33 | |
| pabelanger | SamYaple: yes, but that means rewriting glean | 13:33 |
| zigo | pabelanger: onovy worked on some @.service scripts for swift in Debian, so he would be able to help, I believe. | 13:33 |
| pabelanger | so far, I think we need to have 2 different systemd service, 1 for debian, 1 for centos | 13:33 |
| fungi | mnaser: sure, but still teh challenge is there that if we wind up with a provider assigning interfaces in or routes to new rfc 1918 cidrs we may eventually have no choice but to rely on jobs being able to vary their private network assignments based on some metadata we provide in an envvar or /etc/nodepool/something | 13:33 |
| zigo | SamYaple: FYI, Stretch will be release when the green curve in this graph reaches zero: https://bugs.debian.org/release-critical/ | 13:34 |
| *** jpich has joined #openstack-infra | 13:34 | |
| SamYaple | zigo: for Jessie that took 6 months :P | 13:34 |
| zigo | There's never a schedule for release dates, only for freeze time, then "it's ready when it's ready". | 13:34 |
| SamYaple | yea | 13:34 |
| fungi | mnaser: where the ci system essentially tells jobs what network range is safe for its private use in an given environment | 13:34 |
| zigo | SamYaple: Yeah, but we hate long freeze time, as this blocks all new development. | 13:34 |
| mnaser | so get a range (ex: a /20) and then start splitting small ranges out of it | 13:34 |
| zigo | SamYaple: The sooner the better for everyone. | 13:35 |
| *** trown|brb is now known as trown | 13:35 | |
| *** wolverineav has joined #openstack-infra | 13:35 | |
| SamYaple | agreed | 13:35 |
| fungi | mnaser: right. we basically future-proofed devstack-gate to be able to do that in case the need arises | 13:35 |
| mnaser | okay i guess i'll have to look it up and check | 13:35 |
| mnaser | and see how we can carve things out | 13:35 |
| *** ihrachys has joined #openstack-infra | 13:35 | |
| *** gcb has joined #openstack-infra | 13:36 | |
| fungi | it looks for a DEVSTACK_GATE_FIXED_RANGE falling back to a default of 10.1.0.0/20 and sets some FIXED_RANGE and IPV4_ADDRS_SAFE_TO_USE envvars from that | 13:36 |
| *** wolverineav has quit IRC | 13:37 | |
| *** wolverineav has joined #openstack-infra | 13:37 | |
| mnaser | cool i'll look into it thanks fungi | 13:37 |
| *** jcoufal has quit IRC | 13:37 | |
| fungi | it likely still has some 10.1.x.y things hard-coded in there because we've never had to override it, but it's at least designed with that as an intent | 13:38 |
| *** jaosorior has quit IRC | 13:38 | |
| *** dmsimard is now known as dmsimard|afk | 13:39 | |
| fungi | pabelanger: is the idea with delta-rpms that when updating you only end up downloading and applying the bindiff between the version you have installed and the new version, saving bandwidth and (maybe) some time? | 13:40 |
| *** EricGonczer_ has joined #openstack-infra | 13:40 | |
| *** ihrachys has quit IRC | 13:40 | |
| *** chlong has joined #openstack-infra | 13:40 | |
| *** e0ne has quit IRC | 13:41 | |
| fungi | ahh, yep, documentation says that's exactly what it is | 13:41 |
| *** e0ne has joined #openstack-infra | 13:41 | |
| fungi | debian does something similar with package indices in testing/unstable but honestly it ends up being more incremental overhead in a lot of cases than the full download would have been (and way slower because of the cpu-bound binpatching) | 13:42 |
| *** pkoniszewski has left #openstack-infra | 13:42 | |
| SamYaple | fungi: you can disable | 13:43 |
| SamYaple | that* | 13:43 |
| *** jaosorior has joined #openstack-infra | 13:43 | |
| SamYaple | fungi: you can also choose to not mirror those indicies | 13:43 |
| openstackgerrit | Merged openstack-infra/project-config master: Disable deltarpms for fedora mirrors https://review.openstack.org/451360 | 13:46 |
| *** esberglu has joined #openstack-infra | 13:46 | |
| *** jcoufal has joined #openstack-infra | 13:47 | |
| fungi | SamYaple: right, first we did the one (stopped mirroring them), now we've just approved a change to do the other (stop looking for them on update) | 13:48 |
| SamYaple | pfff well then. i guess everyone is on top of it | 13:48 |
| *** eharney has quit IRC | 13:48 | |
| fungi | oh, er you mean on debian. i actually set my systems to only use interdiff indices if a couple days out of date, otherwise do regular full index downloads | 13:49 |
| fungi | seems to be a sweet spot | 13:49 |
| SamYaple | fungi: heh. i went the opposite way and have my mirror only have the last couple of days | 13:51 |
| *** tongli has joined #openstack-infra | 13:51 | |
| fungi | that works too | 13:51 |
| pabelanger | fungi: yes, it does mean more I/O and CPU client side too | 13:51 |
| *** jamesden_ has quit IRC | 13:52 | |
| *** wolverineav has quit IRC | 13:52 | |
| *** e0ne has quit IRC | 13:54 | |
| openstackgerrit | Merged openstack-dev/pbr master: Lazy import pkg_resources https://review.openstack.org/450913 | 13:54 |
| *** jrist has quit IRC | 13:55 | |
| yolanda | hi pabelanger , shardy , can you review the tripleo-dib fixes? https://review.openstack.org/451259, https://review.openstack.org/451389 | 13:56 |
| *** jrist has joined #openstack-infra | 13:57 | |
| *** wolverineav has joined #openstack-infra | 13:58 | |
| *** skelso has joined #openstack-infra | 13:58 | |
| *** Goneri has joined #openstack-infra | 13:58 | |
| *** sekelso has joined #openstack-infra | 14:00 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 14:00 |
| *** beslemon has joined #openstack-infra | 14:00 | |
| *** EricGonc_ has joined #openstack-infra | 14:01 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config master: sahara: put all scenario jobs under single template https://review.openstack.org/451302 | 14:01 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: WIP exclude tripleo-image-elements https://review.openstack.org/451416 | 14:02 |
| *** EricGonczer_ has quit IRC | 14:02 | |
| *** sekelso has quit IRC | 14:02 | |
| *** sekelso has joined #openstack-infra | 14:03 | |
| *** skelso has quit IRC | 14:04 | |
| *** nicolasbock has quit IRC | 14:05 | |
| *** zhurong_ has joined #openstack-infra | 14:07 | |
| *** zhurong has quit IRC | 14:07 | |
| *** marst has quit IRC | 14:09 | |
| *** nadya has joined #openstack-infra | 14:09 | |
| *** sekelso has quit IRC | 14:10 | |
| *** sekelso has joined #openstack-infra | 14:10 | |
| *** armax has joined #openstack-infra | 14:11 | |
| *** rbrndt has joined #openstack-infra | 14:12 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use unicode for change number extraction https://review.openstack.org/450704 | 14:15 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul feature/zuulv3: Move dependency cycle detection into pipelines https://review.openstack.org/451423 | 14:15 |
| *** armax has quit IRC | 14:15 | |
| *** dizquierdo has quit IRC | 14:17 | |
| *** yatinkarel has quit IRC | 14:17 | |
| *** zhurong_ has quit IRC | 14:18 | |
| *** wewe0901 has quit IRC | 14:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean master: Add debian specific systemd service https://review.openstack.org/450775 | 14:19 |
| *** marst has joined #openstack-infra | 14:19 | |
| *** eharney has joined #openstack-infra | 14:24 | |
| *** yamamoto has joined #openstack-infra | 14:24 | |
| *** pradk has joined #openstack-infra | 14:24 | |
| *** mriedem has joined #openstack-infra | 14:25 | |
| *** avladu has joined #openstack-infra | 14:27 | |
| *** alexchadin has quit IRC | 14:28 | |
| *** yamamoto has quit IRC | 14:29 | |
| avladu | hello -- I am one of the core reviewers of https://github.com/openstack/cloudbase-init and I have a problem with the jenkins/zuul. Although I have +2a on this patch, it does not appear in http://status.openstack.org/zuul/ | 14:29 |
| fungi | avladu: what patch? | 14:30 |
| *** ihrachys has joined #openstack-infra | 14:30 | |
| yolanda | hi AJaeger_ , thx for review. Can you clarify comment on https://review.openstack.org/#/c/451259/6/jenkins/jobs/tripleo.yaml ? what shall i do to have an upper constraints file available? | 14:30 |
| *** zz_dimtruck is now known as dimtruck | 14:30 | |
| avladu | fungi: https://review.openstack.org/#/c/443617/ | 14:30 |
| *** yatinkarel has joined #openstack-infra | 14:31 | |
| fungi | avladu: that change depends on https://review.openstack.org/448006 (its git parent) which hasn't been approved yet | 14:31 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/system-config master: Add #openstack-forum to meetbot channels https://review.openstack.org/451434 | 14:31 |
| avladu | fungi: got it, thanks | 14:32 |
| *** vikrant has quit IRC | 14:32 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config master: Test pyeclib against libec master https://review.openstack.org/449774 | 14:33 |
| *** sekelso has quit IRC | 14:33 | |
| *** sekelso has joined #openstack-infra | 14:34 | |
| *** burgerk has joined #openstack-infra | 14:34 | |
| *** rbuzatu has joined #openstack-infra | 14:34 | |
| *** adrian_otto has joined #openstack-infra | 14:35 | |
| *** sekelso is now known as skelso | 14:35 | |
| *** prateek__ has quit IRC | 14:37 | |
| *** Swami has joined #openstack-infra | 14:37 | |
| openstackgerrit | Merged openstack-infra/project-config master: Select the right repo for stable branches https://review.openstack.org/451389 | 14:37 |
| *** rbuzatu_ has quit IRC | 14:37 | |
| *** dargains has joined #openstack-infra | 14:38 | |
| *** ldnunes has joined #openstack-infra | 14:38 | |
| *** Julien-zte has quit IRC | 14:38 | |
| *** Swami has quit IRC | 14:38 | |
| *** krtaylor has joined #openstack-infra | 14:39 | |
| *** rbuzatu has quit IRC | 14:39 | |
| *** Julien-zte has joined #openstack-infra | 14:40 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Add accessbot to #openstack-forum https://review.openstack.org/451442 | 14:41 |
| fungi | pabelanger: are those puppet apply on f25 failures what we need new images to fix? | 14:43 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Fix $PROJECTS for Cinder LIO job https://review.openstack.org/451443 | 14:43 |
| dims | fungi : yolanda : one of you please add me to https://review.openstack.org/#/admin/groups/1737,members and https://review.openstack.org/#/admin/groups/1738,members ? (original project-config request is here https://review.openstack.org/#/c/449641/) | 14:43 |
| fungi | pabelanger: e.g. https://review.openstack.org/451434 | 14:43 |
| pabelanger | fungi: yes! | 14:45 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 14:45 |
| pabelanger | fungi: DIBs are building now | 14:46 |
| fungi | okay, cool. thanks! | 14:46 |
| pabelanger | fungi: we should be starting uploads in 15mins | 14:46 |
| *** mpaolino has joined #openstack-infra | 14:47 | |
| *** ijw has quit IRC | 14:52 | |
| *** psachin has quit IRC | 14:53 | |
| *** armax has joined #openstack-infra | 14:53 | |
| *** EricGonc_ has quit IRC | 14:54 | |
| clarkb | dmsimard|afk: not sure if you got an answer, yes devstack-gate supports depends on (it has to so that all the tests based on it for nova neutron et al do) | 14:55 |
| clarkb | mnaser: fungi is it possible that anoyher kolla job is your IP conflict? | 14:55 |
| *** matrohon_ has joined #openstack-infra | 14:55 | |
| mnaser | clarkb i thought about it but not possible because arp filters should drop any outbound traffic with that ip | 14:55 |
| clarkb | mnaser: fungi we generally avoid issues in test jobs with default iptables rules but icmp is allowed through | 14:55 |
| mnaser | but looking at the traceroute to git.openstack.org in that log | 14:56 |
| mnaser | i saw something to 169.254.1.1 | 14:56 |
| mnaser | so i figured they use that range somehow internally | 14:56 |
| *** isaacb has quit IRC | 14:56 | |
| *** rwsu has quit IRC | 14:56 | |
| fungi | that would be sort of strange | 14:56 |
| *** amotoki has quit IRC | 14:56 | |
| fungi | routers aren't supposed to route to/from 169.254.0.0/16 so that would be an rfc violation | 14:57 |
| fungi | not that i'd be entirely surprised, mind you | 14:57 |
| *** EricGonczer_ has joined #openstack-infra | 14:57 | |
| clarkb | ya I would expect anoyher kolla job on same l2 with that IP | 14:58 |
| clarkb | and it pings becaise we allow icmp through | 14:59 |
| fungi | (as opposed to rfc 1918 space which you are allowed to route internally and also translate to global addressing, linklocal networks are never supposed to be able to reach the global internet even through nat) | 14:59 |
| fungi | basically a router should never have an ipv4 linklocal address bound to any interfaces | 14:59 |
| fungi | (unlike ipv6 linklocal, where you actually expect all routers to have one) | 15:00 |
| *** jistr is now known as jistr|mtg | 15:01 | |
| fungi | clarkb: my theory was dhcp trying to get a lease on eth1 or something, where all the instances have layer 2 connectivity between their eth1 interfaces but there's no actual dhcp server on that segment | 15:01 |
| *** mdrabe has quit IRC | 15:01 | |
| fungi | then again, the odds of an instance grabbing that specific address are pretty low (1 in 2^16) | 15:01 |
| *** rbuzatu has joined #openstack-infra | 15:02 | |
| *** pblaho has quit IRC | 15:02 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fetch list of AZs from nova if it's not configured https://review.openstack.org/450345 | 15:04 |
| *** matrohon_ has quit IRC | 15:05 | |
| *** rcernin has quit IRC | 15:05 | |
| *** erikmwil_ has quit IRC | 15:05 | |
| *** matrohon_ has joined #openstack-infra | 15:06 | |
| *** erikmwilson has joined #openstack-infra | 15:06 | |
| *** asselin_ has joined #openstack-infra | 15:07 | |
| *** asselin has quit IRC | 15:08 | |
| *** mdrabe has joined #openstack-infra | 15:11 | |
| *** dmsimard|afk is now known as dmsimard | 15:11 | |
| *** asselin__ has joined #openstack-infra | 15:12 | |
| *** e0ne has joined #openstack-infra | 15:13 | |
| *** mat128 has joined #openstack-infra | 15:13 | |
| *** isaacb has joined #openstack-infra | 15:13 | |
| *** asselin_ has quit IRC | 15:15 | |
| *** jaypipes has joined #openstack-infra | 15:16 | |
| *** mtanino has joined #openstack-infra | 15:16 | |
| *** xarses_ has joined #openstack-infra | 15:19 | |
| *** pblaho has joined #openstack-infra | 15:20 | |
| *** andreww has joined #openstack-infra | 15:20 | |
| *** jimbaker` is now known as jimbaker | 15:20 | |
| *** jimbaker is now known as Guest47227 | 15:21 | |
| *** Guest47227 has quit IRC | 15:21 | |
| *** Guest47227 has joined #openstack-infra | 15:21 | |
| *** Guest47227 is now known as jimbaker | 15:21 | |
| *** mriedem has quit IRC | 15:22 | |
| *** yamahata has joined #openstack-infra | 15:22 | |
| *** dargains has quit IRC | 15:23 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use stable release templates for all environments https://review.openstack.org/451361 | 15:23 |
| *** xarses_ has quit IRC | 15:24 | |
| *** xarses_ has joined #openstack-infra | 15:24 | |
| *** andreww has quit IRC | 15:25 | |
| *** yamamoto has joined #openstack-infra | 15:26 | |
| *** tongli has quit IRC | 15:26 | |
| *** beslemon has quit IRC | 15:29 | |
| *** rbuzatu_ has joined #openstack-infra | 15:29 | |
| *** adrian_otto has quit IRC | 15:30 | |
| *** rbuzatu has quit IRC | 15:30 | |
| *** yamamoto has quit IRC | 15:31 | |
| *** erikmwilson has quit IRC | 15:33 | |
| *** alex_xu has quit IRC | 15:33 | |
| *** eliqiao has quit IRC | 15:33 | |
| *** rbuzatu_ has quit IRC | 15:34 | |
| *** alex_xu has joined #openstack-infra | 15:35 | |
| *** erikmwilson has joined #openstack-infra | 15:36 | |
| *** eliqiao has joined #openstack-infra | 15:37 | |
| *** matrohon_ has quit IRC | 15:37 | |
| *** Julien-zte has quit IRC | 15:37 | |
| *** flepied has quit IRC | 15:38 | |
| *** panda|afk has left #openstack-infra | 15:39 | |
| pabelanger | clarkb: seem my comment about https://review.openstack.org/#/c/450627/ ? | 15:40 |
| pabelanger | I think we need to merge / release that | 15:40 |
| clarkb | pabelanger: I havent will look | 15:40 |
| pabelanger | still seeing systemctl enable network.service failures | 15:40 |
| *** dargains has joined #openstack-infra | 15:41 | |
| clarkb | pabelanger: is it possible those are from old images? but cleaning that up makes sense. Do you want me to +A? | 15:41 |
| pabelanger | clarkb: I believe they are latest images in gate now | 15:42 |
| pabelanger | clarkb: please +A, then we can see about a tag | 15:42 |
| *** beslemon has joined #openstack-infra | 15:45 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/userstory-dashboard master: Add a .gitreview file for the git-review tool https://review.openstack.org/451464 | 15:46 |
| *** eliqiao has quit IRC | 15:46 | |
| *** rbuzatu has joined #openstack-infra | 15:47 | |
| *** eroux has joined #openstack-infra | 15:47 | |
| *** beslemon has quit IRC | 15:48 | |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Rename nodepoold to nodepool-launcher https://review.openstack.org/450877 | 15:50 |
| fungi | dims: i've added you to those two groups now, sorry for the delay | 15:51 |
| *** dargains has quit IRC | 15:51 | |
| *** beslemon has joined #openstack-infra | 15:51 | |
| *** mriedem has joined #openstack-infra | 15:53 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Add ability to select flavor by name or id https://review.openstack.org/449784 | 15:53 |
| *** eliqiao has joined #openstack-infra | 15:53 | |
| openstackgerrit | Merged openstack-infra/glean master: Revert "Enable network.service with systemd" https://review.openstack.org/450627 | 15:55 |
| clarkb | pabelanger: ^ there you go | 15:56 |
| *** amotoki has joined #openstack-infra | 15:57 | |
| *** tesseract has quit IRC | 15:58 | |
| pabelanger | clarkb: cool, did you want to tag? | 15:58 |
| clarkb | pabelanger: need to figure out what stuff is in there since last tag first | 15:59 |
| pabelanger | sure | 15:59 |
| clarkb | I guess maybe not much since it was the fix for ipv6? | 15:59 |
| pabelanger | that sounds right | 15:59 |
| *** mat128 has quit IRC | 16:00 | |
| *** vhosakot has joined #openstack-infra | 16:00 | |
| pabelanger | clarkb: ya, nothing new since ipv6 fix | 16:00 |
| mtreinish | fungi: so the only thing that is a bit concerning about vernemq so far is that it's way more resource intensive than mosquitto. | 16:00 |
| mtreinish | but mosquitto never really consumed anything, so it's not actually that bad | 16:00 |
| clarkb | pabelanger: ya this is the only new change. Would you call it 1.9.1 (bugfix) or 1.10.0 (feature) I'm torn because it changes behavior but for a bugfix | 16:01 |
| mtreinish | its like 50% on each of the 2 cpus on my vm and about 1.3G of ram | 16:01 |
| *** marst_ has joined #openstack-infra | 16:01 | |
| *** marst has quit IRC | 16:02 | |
| clarkb | pabelanger: mordred I think 1.9.1 is most appropriate | 16:02 |
| fungi | mtreinish: was there any reason to switch away from mosquitto other than the libwebsockets crashes? | 16:02 |
| *** Sukhdev_ has joined #openstack-infra | 16:02 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool feature/zuulv3: Set socket timeout for SSH keyscan https://review.openstack.org/451470 | 16:02 |
| fungi | my brain is turning into swiss cheese | 16:02 |
| *** adrian_otto has joined #openstack-infra | 16:02 | |
| *** amotoki has quit IRC | 16:03 | |
| *** trown is now known as trown|lunch | 16:03 | |
| *** nadya has quit IRC | 16:04 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fetch list of AZs from nova if it's not configured https://review.openstack.org/450345 | 16:04 |
| *** Goneri has quit IRC | 16:05 | |
| pabelanger | clarkb: sure | 16:05 |
| mordred | pabelanger, clarkb: ++ | 16:05 |
| clarkb | ok I need caffeine then can dig out my gpg key and push a tag | 16:05 |
| *** Sukhdev_ has quit IRC | 16:05 | |
| *** e0ne has quit IRC | 16:06 | |
| *** EricGonczer_ has quit IRC | 16:06 | |
| *** annegentle has joined #openstack-infra | 16:06 | |
| *** e0ne has joined #openstack-infra | 16:06 | |
| mtreinish | fungi: clustering, for future real usage where we depend on it | 16:07 |
| *** Sukhdev_ has joined #openstack-infra | 16:08 | |
| *** aarefiev is now known as aarefiev_afk | 16:08 | |
| *** tphummel has joined #openstack-infra | 16:10 | |
| fungi | mtreinish: oh, right, that ;) | 16:10 |
| *** john-davidge has quit IRC | 16:10 | |
| fungi | okay, gonna pop out and grab lunch, back soon | 16:10 |
| *** john-davidge has joined #openstack-infra | 16:11 | |
| *** Apoorva has joined #openstack-infra | 16:12 | |
| *** isaacb has quit IRC | 16:12 | |
| *** Apoorva has quit IRC | 16:12 | |
| *** dmsimard is now known as dmsimard|afk | 16:13 | |
| *** Apoorva has joined #openstack-infra | 16:13 | |
| *** ociuhandu has quit IRC | 16:16 | |
| *** d0ugal has quit IRC | 16:17 | |
| *** hashar has quit IRC | 16:18 | |
| *** Sukhdev_ has quit IRC | 16:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Add upper constraints limitation of buildimage jobs https://review.openstack.org/451259 | 16:19 |
| *** mpaolino has quit IRC | 16:21 | |
| *** Rockyg has joined #openstack-infra | 16:24 | |
| asettle | Hey everyone - any chance we could get status bot in openstack-doc ? :) | 16:26 |
| *** yamamoto has joined #openstack-infra | 16:27 | |
| asettle | Actually, we are on the statusbot list: https://git.openstack.org/cgit/openstack-infra/system-config/tree/hiera/common.yaml | 16:28 |
| asettle | It doesn't appear to be working :) | 16:28 |
| asettle | #success PDF downloads at docs.o.o have landed into Ocata! | 16:29 |
| asettle | ^^ doesn't appear to be working here either | 16:29 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Set REVIEW_RELEASE to empty string by default https://review.openstack.org/451265 | 16:29 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Stop deployment before jobs end https://review.openstack.org/450381 | 16:32 |
| dims | fungi : thanks! wasn't a rush request :) | 16:32 |
| *** yamamoto has quit IRC | 16:33 | |
| *** rcarrill1 has joined #openstack-infra | 16:35 | |
| *** shardy has quit IRC | 16:35 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 16:35 |
| *** puiterwijk has quit IRC | 16:36 | |
| *** rcarrillocruz has quit IRC | 16:36 | |
| *** puiterwijk has joined #openstack-infra | 16:36 | |
| *** e0ne has quit IRC | 16:38 | |
| *** d0ugal has joined #openstack-infra | 16:38 | |
| *** florianf has quit IRC | 16:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add canonical hostname to source object https://review.openstack.org/451110 | 16:39 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 16:41 |
| *** Swami has joined #openstack-infra | 16:42 | |
| *** nadya has joined #openstack-infra | 16:42 | |
| *** d0ugal has quit IRC | 16:43 | |
| *** nadya has quit IRC | 16:46 | |
| *** nadya has joined #openstack-infra | 16:46 | |
| *** jistr|mtg is now known as jistr | 16:47 | |
| *** ociuhandu has joined #openstack-infra | 16:48 | |
| mtreinish | fungi: yeah, I'm not sure vernemq is gonna be a good choice. I can see cpu usage grow for each while loop publishing messages. Running 8 while trues is completely bogging down the broker and consuming ~100% on both cpus | 16:48 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 16:48 |
| mtreinish | heh, it's really fun the admin command is timing out trying to just show the open sessions | 16:48 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 16:48 |
| *** lucasagomes is now known as lucas-afk | 16:49 | |
| *** pblaho has quit IRC | 16:50 | |
| frickler | are we ready to recheck fedora failures yet? | 16:50 |
| *** yamahata has quit IRC | 16:50 | |
| pabelanger | frickler: yes | 16:51 |
| frickler | pabelanger: cool, thx | 16:52 |
| *** shardy has joined #openstack-infra | 16:52 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Test with bonded public interface https://review.openstack.org/385562 | 16:52 |
| *** matrohon_ has joined #openstack-infra | 16:53 | |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: Revert second repo-setup run for overcloud nodes https://review.openstack.org/447142 | 16:53 |
| *** rbuzatu has quit IRC | 16:54 | |
| *** derekh has quit IRC | 16:57 | |
| *** rhallisey has quit IRC | 16:58 | |
| *** amotoki has joined #openstack-infra | 16:59 | |
| *** rhallisey has joined #openstack-infra | 17:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean master: Add debian specific systemd service https://review.openstack.org/450775 | 17:00 |
| *** eliqiao has quit IRC | 17:01 | |
| *** markus_z has quit IRC | 17:02 | |
| *** eliqiao has joined #openstack-infra | 17:02 | |
| *** kashyap has joined #openstack-infra | 17:03 | |
| *** erikmwilson has quit IRC | 17:03 | |
| kashyap | clarkb: What timezone are eavesdrop.o.o are in? | 17:03 |
| kashyap | UTC? | 17:03 |
| clarkb | kashyap: yes utc | 17:03 |
| *** avladu has quit IRC | 17:03 | |
| *** chlong has quit IRC | 17:03 | |
| *** trown|lunch is now known as trown | 17:04 | |
| *** amotoki has quit IRC | 17:04 | |
| *** bh526r has joined #openstack-infra | 17:04 | |
| *** matrohon_ has quit IRC | 17:05 | |
| *** erikmwilson has joined #openstack-infra | 17:06 | |
| *** pblaho has joined #openstack-infra | 17:07 | |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: DNM: give me more debug https://review.openstack.org/450800 | 17:07 |
| *** beslemon has quit IRC | 17:07 | |
| *** links has joined #openstack-infra | 17:07 | |
| mwhahaha | Can i get some eyes on https://review.openstack.org/#/c/449834/ | 17:08 |
| *** mrhillsman has quit IRC | 17:10 | |
| *** sambetts is now known as sambetts|afk | 17:11 | |
| *** yamahata has joined #openstack-infra | 17:13 | |
| *** rwsu has joined #openstack-infra | 17:15 | |
| *** rbuzatu has joined #openstack-infra | 17:17 | |
| *** nadya has quit IRC | 17:18 | |
| *** vhosakot has quit IRC | 17:18 | |
| *** links has quit IRC | 17:19 | |
| *** beslemon has joined #openstack-infra | 17:20 | |
| *** signed8b_ is now known as signed8bit_Zzz | 17:21 | |
| *** dhajare has quit IRC | 17:22 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Add ocata and pike UCA repos https://review.openstack.org/451491 | 17:23 |
| *** codebauss has joined #openstack-infra | 17:23 | |
| *** codebauss is now known as mrhillsman | 17:23 | |
| *** jpich has quit IRC | 17:24 | |
| *** rbrndt has quit IRC | 17:25 | |
| *** yamamoto has joined #openstack-infra | 17:29 | |
| *** MasterOfBugs has joined #openstack-infra | 17:29 | |
| *** HeOS has quit IRC | 17:31 | |
| *** yamamoto has quit IRC | 17:35 | |
| *** electrofelix has quit IRC | 17:36 | |
| *** tosky has quit IRC | 17:37 | |
| clarkb | pabelanger: mordred about to push glean tag, so double checking first. We want 1.9.1 on the revert change that ianw pushed, 3bc62168289d0e135bbb526d0676db0f6754b97b | 17:40 |
| *** mtanino has quit IRC | 17:40 | |
| pabelanger | clarkb: yes | 17:40 |
| mordred | clarkb: yah - I think so | 17:40 |
| clarkb | ok pushed | 17:41 |
| clarkb | frickler: pabelanger and I am guessing whatever fedora rechecks you are talking about are different than the f25 dsvm tempest job failing consistently? | 17:42 |
| *** e0ne has joined #openstack-infra | 17:42 | |
| pabelanger | clarkb: yes, I fixed it this morning. needed to update configure_mirror and disable drpms | 17:43 |
| pabelanger | for our mirror | 17:43 |
| clarkb | oh the delta rpms thing got it | 17:44 |
| *** jerryz has joined #openstack-infra | 17:45 | |
| *** trown is now known as trown|brb | 17:46 | |
| *** rhallisey has quit IRC | 17:46 | |
| *** chem is now known as chem_gone | 17:47 | |
| frickler | clarkb: pabelanger: yes, like http://logs.openstack.org/34/451434/1/check/gate-infra-puppet-apply-3-fedora-25/6bf340e/ | 17:47 |
| *** eliqiao has quit IRC | 17:49 | |
| pabelanger | should be fixed, I had a fedora-25 pass for me | 17:49 |
| clarkb | ya thats different than the thing I was thinking of. fedora 25 tempest issues are that tests fail and things go very slowly and job times out | 17:50 |
| clarkb | wouldn';t get that far if rpms didn't work | 17:50 |
| *** eliqiao has joined #openstack-infra | 17:50 | |
| pabelanger | clarkb: oh, not sure of that issue then | 17:51 |
| clarkb | its what made us move the f25 job to experiemental on d-g | 17:51 |
| clarkb | since it took 3 hours to time out | 17:51 |
| pabelanger | ah | 17:51 |
| pabelanger | I have not looked at why for that | 17:51 |
| *** pcaruana has quit IRC | 17:52 | |
| clarkb | pabelanger: I briefly looked at nova logs and qemu-img isn't finding the nova disk iamges in the path it expects them | 17:53 |
| clarkb | so guessing its something to do with libvirt putting images not where we want them | 17:53 |
| *** e0ne has quit IRC | 17:53 | |
| *** EricGonczer_ has joined #openstack-infra | 17:54 | |
| *** trown|brb is now known as trown | 17:54 | |
| *** tonytan4ever has joined #openstack-infra | 17:56 | |
| *** rhallisey has joined #openstack-infra | 17:57 | |
| *** ralonsoh has quit IRC | 17:57 | |
| *** chlong has joined #openstack-infra | 17:58 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix on affiliation query https://review.openstack.org/451503 | 17:58 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix on affiliation query https://review.openstack.org/451503 | 17:59 |
| *** baoli has quit IRC | 18:00 | |
| *** dtardivel has quit IRC | 18:00 | |
| *** amotoki has joined #openstack-infra | 18:00 | |
| *** baoli has joined #openstack-infra | 18:01 | |
| *** edmondsw has left #openstack-infra | 18:01 | |
| *** tosky has joined #openstack-infra | 18:02 | |
| *** erikmwilson has quit IRC | 18:03 | |
| pabelanger | clarkb: centos-7 DIB building | 18:03 |
| clarkb | pabelanger: lets hope this works or its back to drawing board (I think it was good cleanup regardless) | 18:03 |
| pabelanger | ++ | 18:04 |
| *** amotoki has quit IRC | 18:05 | |
| *** erikmwilson has joined #openstack-infra | 18:05 | |
| *** amoralej is now known as amoralej|off | 18:07 | |
| *** chlong has quit IRC | 18:07 | |
| *** nadya has joined #openstack-infra | 18:07 | |
| *** alex_xu has quit IRC | 18:07 | |
| pabelanger | FinallY! | 18:08 |
| pabelanger | got glean to start on debian-jessie | 18:08 |
| pabelanger | only took 3 days | 18:08 |
| mordred | pabelanger: woot! | 18:08 |
| *** alex_xu has joined #openstack-infra | 18:08 | |
| pabelanger | however, it will require some input from people | 18:09 |
| *** ociuhandu has quit IRC | 18:09 | |
| pabelanger | cause, it might be ugly | 18:09 |
| *** mtanino has joined #openstack-infra | 18:09 | |
| mordred | dude. all of glean is ugly | 18:09 |
| pabelanger | well, this is systemd things | 18:09 |
| mordred | ewwww | 18:09 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Fetch list of AZs from nova if it's not configured https://review.openstack.org/450345 | 18:09 |
| openstackgerrit | Zara proposed openstack-infra/storyboard master: Remove story_types https://review.openstack.org/451505 | 18:10 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean master: Add debian specific systemd service https://review.openstack.org/450775 | 18:11 |
| *** nadya has quit IRC | 18:13 | |
| *** rbrndt has joined #openstack-infra | 18:13 | |
| mordred | infra-root: a human just asked a question about openstack-nose in #openstack-requirements ... which made it occur to me - perhaps it's time to retire openstack-nose? codesearch.o.o does not show any places it's used anymore | 18:14 |
| jamesmcarthur | The nose Knows. | 18:14 |
| mordred | jamesmcarthur: nicely played | 18:16 |
| *** mat128 has joined #openstack-infra | 18:17 | |
| *** Sukhdev_ has joined #openstack-infra | 18:18 | |
| pabelanger | no objection, but I have never used it | 18:18 |
| mordred | pabelanger: nobody in openstack _shold_ have used it in about 5 years | 18:19 |
| pabelanger | seems like a good time then | 18:19 |
| clarkb | didnt it just add colors to logs? | 18:20 |
| clarkb | +1 to removing it more if necessary | 18:21 |
| mordred | pabelanger: got a sec to do https://review.openstack.org/#/c/451301/ (and the 3 before it) ? | 18:21 |
| *** Sukhdev_ has quit IRC | 18:21 | |
| mordred | clarkb: I wish the human hadn't fled - I would have liked to understand why he was installing it | 18:21 |
| *** chlong has joined #openstack-infra | 18:22 | |
| pabelanger | mordred: do we need to wait for https://review.openstack.org/#/c/448191/ to merge? the governance change is stacked on that | 18:23 |
| *** beslemon has joined #openstack-infra | 18:23 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add debian-jessie DIB for dsvm testing https://review.openstack.org/449938 | 18:23 |
| mordred | pabelanger: I don't think so - the vote was in favor - that patch is just administrative work | 18:23 |
| pabelanger | ack | 18:23 |
| *** trown is now known as trown|brb | 18:29 | |
| *** EricGonczer_ has quit IRC | 18:30 | |
| *** yamamoto has joined #openstack-infra | 18:31 | |
| *** EricGonczer_ has joined #openstack-infra | 18:32 | |
| *** baoli_ has joined #openstack-infra | 18:32 | |
| *** chlong has quit IRC | 18:34 | |
| *** baoli has quit IRC | 18:34 | |
| openstackgerrit | Adam Harwell proposed openstack/diskimage-builder master: Use DIB_PYTHON_VERSION to run commands https://review.openstack.org/449721 | 18:35 |
| *** yamamoto has quit IRC | 18:36 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add secret top-level config object https://review.openstack.org/446156 | 18:38 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add per-repo public and private keys https://review.openstack.org/406382 | 18:38 |
| fungi | asettle: sorry, just got back from lunch and catching up. looks like openstackstatus is taking a break. i'm going to go figure out where it wandered to | 18:38 |
| fungi | mordred: ++increment to retiring the noseguy | 18:39 |
| fungi | no, wait, retiring openstack-nose. noseguy remains awesome decades later | 18:39 |
| *** mat128 has quit IRC | 18:41 | |
| fungi | 2017-03-26 20:55:32 <-- openstackstatus (~openstack@eavesdrop.openstack.org) has quit (Ping timeout: 252 seconds) | 18:41 |
| fungi | never rejoined | 18:41 |
| fungi | and its last log entry was from 2017-03-26 20:49:24,990 | 18:42 |
| fungi | it doesn't seem to realize it fell off the irc network | 18:42 |
| *** kzaitsev_mb has joined #openstack-infra | 18:42 | |
| fungi | i've restarted it, let's see what happens | 18:43 |
| *** openstackstatus has joined #openstack-infra | 18:44 | |
| *** ChanServ sets mode: +v openstackstatus | 18:44 | |
| *** beslemon_ has joined #openstack-infra | 18:44 | |
| *** trown|brb is now known as trown | 18:45 | |
| *** beslemon has quit IRC | 18:46 | |
| asettle | fungi: hahah thanks. lemme try my status again :) | 18:47 |
| asettle | #success PDF downloads at docs.o.o have landed into Ocata! | 18:47 |
| openstackstatus | asettle: Added success to Success page | 18:47 |
| asettle | Zoom zoom zoommmm | 18:47 |
| fungi | #status log statusbot restarted since it seems to have fallen victim to a ping timeout (2017-03-26 20:55:32) and never realized it | 18:47 |
| openstackstatus | fungi: finished logging | 18:47 |
| asettle | ianychoi: :D fungi got it working again | 18:47 |
| *** mat128 has joined #openstack-infra | 18:47 | |
| asettle | fungi: that's interesting. Why would it do that? | 18:47 |
| fungi | asettle: mumble mumble computers mumble | 18:47 |
| asettle | Hahahhahaa | 18:48 |
| asettle | That's all I need to know. | 18:48 |
| fungi | phrased differently, i lack sufficient data to answer your inquiry | 18:48 |
| clarkb | pabelanger: thinking about the reverse proxy idea more, I think it would be straightofward to just add that to apache config on all our mirror hosts so that $mirror_host/rdo is caching reverse proxy to rdo package repos | 18:48 |
| fungi | we have debug logging from the daemon, and it was eerily silent but the daemon was still running | 18:48 |
| clarkb | pabelanger: I may take stab at puppet change for that after lunch | 18:48 |
| clarkb | pabelanger: its easy beacuse we already have caching web server there | 18:49 |
| *** chlong has joined #openstack-infra | 18:49 | |
| pabelanger | clarkb: ya, I haven't had a chance to loop into that yet, so great! | 18:50 |
| openstackgerrit | Merged openstack-infra/project-config master: Move gate-dsvm-nodepool-debian-src-nv to experimental https://review.openstack.org/451383 | 18:50 |
| *** e0ne has joined #openstack-infra | 18:50 | |
| pabelanger | clarkb: what do we cache today? | 18:50 |
| clarkb | pabelanger: well afs does the caching right now but all of the afs mirrored stuff is cached | 18:52 |
| *** EricGonczer_ has quit IRC | 18:52 | |
| clarkb | but the hard work of having a server everywhere that all then odes know how to reach is already done | 18:53 |
| clarkb | just have to set up reverse proxy | 18:53 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Fix to workaround bug https://review.openstack.org/451519 | 18:53 |
| pabelanger | clarkb: oh, I though you were saying we had http reverse proxy setup already for something | 18:53 |
| clarkb | pabelanger: no but we have everything else | 18:53 |
| pabelanger | right | 18:53 |
| clarkb | so we need like 3 lines in a vhost file to make it work | 18:54 |
| clarkb | proxypass, proxypassreverse and cache config | 18:54 |
| *** IRCFrEAK has joined #openstack-infra | 18:54 | |
| *** jcoufal has quit IRC | 18:54 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Fix to workaround bug https://review.openstack.org/451519 | 18:54 |
| *** IRCFrEAK has left #openstack-infra | 18:55 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: WIP: test debian-jessie and glean https://review.openstack.org/451483 | 18:57 |
| *** gordc has quit IRC | 18:59 | |
| *** hongbin has joined #openstack-infra | 18:59 | |
| *** rwsu has quit IRC | 19:00 | |
| *** EricGonczer_ has joined #openstack-infra | 19:00 | |
| *** baoli_ has quit IRC | 19:01 | |
| *** amotoki has joined #openstack-infra | 19:01 | |
| *** dizquierdo has joined #openstack-infra | 19:01 | |
| *** hashar has joined #openstack-infra | 19:02 | |
| *** jcoufal has joined #openstack-infra | 19:02 | |
| *** brianw has quit IRC | 19:04 | |
| *** amotoki has quit IRC | 19:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Decrypt secrets and plumb to Ansible https://review.openstack.org/446688 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add 'allow-secrets' pipeline attribute https://review.openstack.org/447138 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Associate secrets with jobs https://review.openstack.org/446687 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for job allowed-projects https://review.openstack.org/447134 | 19:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Serve public keys through webapp https://review.openstack.org/446756 | 19:06 |
| *** e0ne has quit IRC | 19:06 | |
| *** baoli has joined #openstack-infra | 19:07 | |
| mordred | fungi: if you have a sec - wanna +A a simple patch: https://review.openstack.org/#/c/450977 ? I feel like it has your name all over it | 19:08 |
| fungi | that would be creepy, if true | 19:08 |
| *** IRCFrEAK has joined #openstack-infra | 19:08 | |
| *** felipemonteiro has joined #openstack-infra | 19:09 | |
| fungi | bon apetit | 19:09 |
| *** IRCFrEAK has left #openstack-infra | 19:10 | |
| *** dolphm has joined #openstack-infra | 19:10 | |
| *** rbuzatu has quit IRC | 19:13 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 19:13 |
| EmilienM | fungi: apétit ;-) | 19:14 |
| mordred | fungi: or tasty :) | 19:14 |
| *** rbuzatu has joined #openstack-infra | 19:14 | |
| EmilienM | oh wait, it's appétit | 19:15 |
| * EmilienM facepalm | 19:15 | |
| *** gyee has joined #openstack-infra | 19:15 | |
| *** ociuhandu has joined #openstack-infra | 19:15 | |
| mordred | EmilienM: wow, I'm glad the native speakers can get it wrong too :) | 19:15 |
| EmilienM | mordred: not sure I'm the best example :-P | 19:16 |
| *** rbuzatu_ has joined #openstack-infra | 19:16 | |
| *** rbuzatu__ has joined #openstack-infra | 19:17 | |
| *** signed8bit_Zzz is now known as signed8b_ | 19:17 | |
| mordred | heh | 19:18 |
| *** rbuzat___ has joined #openstack-infra | 19:18 | |
| *** rbuzatu has quit IRC | 19:19 | |
| fungi | EmilienM: i would have believed either. my last french language course was in 1988 i think | 19:19 |
| *** david-lyle has quit IRC | 19:19 | |
| *** david-lyle has joined #openstack-infra | 19:19 | |
| *** rbuzatu has joined #openstack-infra | 19:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Publish shade docs to docs.o.o/developer https://review.openstack.org/450977 | 19:19 |
| EmilienM | fungi: HEH I was 1 year old :-P | 19:20 |
| *** rbuzatu_ has quit IRC | 19:20 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove heatclient and magnumclient from PROJECTS https://review.openstack.org/451315 | 19:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Add requestsexceptions to #openstack-shade https://review.openstack.org/451317 | 19:20 |
| *** rbuzatu_ has joined #openstack-infra | 19:21 | |
| mordred | EmilienM, fungi: amusingly enough, my last french language course was fall of 86 - spring of 87 | 19:21 |
| mordred | EmilienM: so I may have known some french longer than you | 19:21 |
| EmilienM | mordred: I wasn't born. Ok now I leave. | 19:21 |
| EmilienM | :) | 19:21 |
| *** mat128 has quit IRC | 19:21 | |
| *** rbuzatu__ has quit IRC | 19:21 | |
| *** rbuzatu__ has joined #openstack-infra | 19:22 | |
| *** rbuzat___ has quit IRC | 19:22 | |
| *** rbuzatu has quit IRC | 19:24 | |
| *** ociuhandu has quit IRC | 19:25 | |
| *** rbuzatu_ has quit IRC | 19:25 | |
| *** GOLDPANK has joined #openstack-infra | 19:26 | |
| *** GOLDPANK has left #openstack-infra | 19:27 | |
| *** david-lyle has quit IRC | 19:27 | |
| *** eliqiao has quit IRC | 19:28 | |
| fungi | EmilienM: you're making me feel old | 19:29 |
| EmilienM | fungi: I'm sorry for that. Don't worry, I'm turning 30 this year. Hope you feel better. | 19:30 |
| *** david-lyle has joined #openstack-infra | 19:30 | |
| * fungi shakes his cane menacingly | 19:30 | |
| pabelanger | EmilienM: clarkb: centos-7 dibs uploading now | 19:31 |
| EmilienM | pabelanger: cool, it should help to make centos7 multinode jobs more stable right? | 19:31 |
| *** john-davidge has quit IRC | 19:31 | |
| mordred | fungi: I'm impressed you can still lift your cane! | 19:32 |
| pabelanger | EmilienM: hopefully | 19:32 |
| fungi | pabelanger: the f25 uploads earlier went smoothly? i haven't rechecked stuff that failed to check | 19:32 |
| pabelanger | fungi: they did! recheck away | 19:32 |
| fungi | mordred: it's because i drink my ensure every day | 19:32 |
| *** matrohon_ has joined #openstack-infra | 19:32 | |
| fungi | tastes just like ovaltine | 19:32 |
| fungi | thanks pabelanger! | 19:32 |
| *** yamamoto has joined #openstack-infra | 19:32 | |
| *** openstackgerrit has quit IRC | 19:33 | |
| *** jamielennox|away is now known as jamielennox | 19:33 | |
| *** eliqiao has joined #openstack-infra | 19:33 | |
| *** chlong has quit IRC | 19:34 | |
| *** yamamoto has quit IRC | 19:38 | |
| *** _I_R_C_F_R_E_A_K has joined #openstack-infra | 19:41 | |
| *** openstackgerrit has joined #openstack-infra | 19:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Decrypt secrets and plumb to Ansible https://review.openstack.org/446688 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add 'allow-secrets' pipeline attribute https://review.openstack.org/447138 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Isolate encryption-related methods https://review.openstack.org/447087 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add secret top-level config object https://review.openstack.org/446156 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Augment references of pkcs1 with oaep https://review.openstack.org/447088 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Associate secrets with jobs https://review.openstack.org/446687 | 19:45 |
| *** rbuzatu__ has quit IRC | 19:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add support for job allowed-projects https://review.openstack.org/447134 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add per-repo public and private keys https://review.openstack.org/406382 | 19:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Serve public keys through webapp https://review.openstack.org/446756 | 19:45 |
| *** eeiden has quit IRC | 19:45 | |
| openstackgerrit | Luz Cazares proposed openstack-infra/project-config master: Add Refstack jobs to publish documentation https://review.openstack.org/446613 | 19:49 |
| *** d0ugal has joined #openstack-infra | 19:49 | |
| *** _I_R_C_F_R_E_A_K has left #openstack-infra | 19:50 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add canonical hostname to source object https://review.openstack.org/451110 | 19:52 |
| *** matrohon_ has quit IRC | 19:54 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv https://review.openstack.org/438746 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 19:54 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 19:54 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add canonical hostname to source object https://review.openstack.org/451110 | 19:55 |
| *** dprince has quit IRC | 19:55 | |
| *** rbuzatu has joined #openstack-infra | 19:56 | |
| *** tonytan4ever has quit IRC | 19:57 | |
| *** baoli has quit IRC | 19:58 | |
| *** baoli has joined #openstack-infra | 19:58 | |
| *** d0ugal has quit IRC | 20:00 | |
| *** rbuzatu has quit IRC | 20:00 | |
| *** DennyZhang has joined #openstack-infra | 20:01 | |
| *** amotoki has joined #openstack-infra | 20:02 | |
| *** rbuzatu has joined #openstack-infra | 20:02 | |
| *** xarses_ has quit IRC | 20:03 | |
| *** annegentle has quit IRC | 20:04 | |
| *** sshnaidm is now known as sshnaidm|off | 20:04 | |
| *** amotoki has quit IRC | 20:06 | |
| *** rbuzatu has quit IRC | 20:07 | |
| openstackgerrit | James Slagle proposed openstack-infra/project-config master: Move ovb containers job to experimental queue https://review.openstack.org/451546 | 20:08 |
| *** bh526r has quit IRC | 20:08 | |
| *** annegentle has joined #openstack-infra | 20:09 | |
| *** john-davidge has joined #openstack-infra | 20:16 | |
| *** Goneri has joined #openstack-infra | 20:17 | |
| *** flepied has joined #openstack-infra | 20:17 | |
| *** krtaylor has quit IRC | 20:20 | |
| pabelanger | fungi: sorry, that was me with sudo on stackalytics | 20:21 |
| pabelanger | testing something | 20:21 |
| fungi | thanks for the heads-up | 20:21 |
| *** dimtruck is now known as zz_dimtruck | 20:21 | |
| pabelanger | fungi: so I think the issue of why stackalytics is not updating, is because of stale ssh connection | 20:23 |
| fungi | pabelanger: it's got a lot of gerrit event stream issues | 20:23 |
| pabelanger | gerrit returns Too many concurrent connections | 20:23 |
| fungi | yeah, that primarily | 20:23 |
| pabelanger | however, nothing is running on stackalytics.o.o | 20:24 |
| pabelanger | I think this is because paramiko didn't close the connection properly | 20:24 |
| fungi | the last time this happened, instead of looking into why and trying to fix it, the stackalytics.org maintainers just created a new gerrit account and switched to that | 20:24 |
| fungi | pabelanger: ooh, that sounds familiar | 20:24 |
| pabelanger | yes | 20:24 |
| pabelanger | I have a patch, but need to kill the current sessions | 20:24 |
| pabelanger | but, close-connection will not work | 20:24 |
| pabelanger | suggestions | 20:25 |
| clarkb | pabelanger: ok back from lunch, am throwing together a quick reverse proxy setup for rdo to see what it looks like | 20:26 |
| pabelanger | remote: https://review.openstack.org/451550 Add destructor to SSHClient | 20:26 |
| JayF | pabelanger: so you have a running python thing, with dangling paramiko conncetions ... restarting the python service isn't enough? | 20:26 |
| pabelanger | is what I'd like to try | 20:26 |
| pabelanger | JayF: nothing is running on stackalytics.o.o now | 20:26 |
| pabelanger | because we cannot connect back to gerrit | 20:26 |
| pabelanger | I believe this is a paramiko issue we seen in nodepool recently | 20:27 |
| pabelanger | and now, I am unable to close connections gerrit side | 20:27 |
| JayF | pabelanger: so I don't understand how the connections are still open. Do you see then with netstat -an on the stackalytics box? | 20:27 |
| pabelanger | nothing | 20:27 |
| clarkb | pabelanger: whats the url of the thing we want to get rdo packages from? | 20:27 |
| clarkb | EmilienM: ^ | 20:27 |
| *** shadower has quit IRC | 20:27 | |
| pabelanger | clarkb: trunk.rdoproject.org | 20:27 |
| pabelanger | I seem to recall gerrit keeping connections around for some reason | 20:28 |
| *** trown is now known as trown|outtypewww | 20:28 | |
| pabelanger | but, not sure | 20:28 |
| JayF | pabelanger: so basically the connections are network-dead on the client side, but the server is keeping them around | 20:28 |
| pabelanger | JayF: yes, from what I see | 20:28 |
| *** lyarwood has quit IRC | 20:28 | |
| JayF | pabelanger: can you see if they show up with netstat -an on the gerrit box, then? | 20:28 |
| *** Guest6666 has quit IRC | 20:28 | |
| JayF | pabelanger: if at any point, this isn't helpful or covering stuff you already checked, you can tell me to stfu ;) | 20:28 |
| *** Guest6666 has joined #openstack-infra | 20:29 | |
| mordred | infra-root: heads up - shade's gate is broken because designate is broken due to the bump of eventlet in upper-constratints | 20:29 |
| *** puiterwijk has quit IRC | 20:29 | |
| mordred | I am not aware of any infra-urgent shade patches that need landing, but it may be a second before we can sort the problem | 20:29 |
| *** lyarwood has joined #openstack-infra | 20:29 | |
| *** EricGonczer_ has quit IRC | 20:29 | |
| *** dhajare has joined #openstack-infra | 20:30 | |
| fungi | thanks for the heads-up mordred! | 20:30 |
| *** puiterwijk has joined #openstack-infra | 20:30 | |
| EmilienM | we have an outstanding request, thanks: https://review.openstack.org/451546 | 20:30 |
| *** jaypipes_ has joined #openstack-infra | 20:30 | |
| fungi | pabelanger: also curious how we got it into that state so quickly... gerrit was restarted a mere 6 days ago | 20:31 |
| *** pramodrj07 has joined #openstack-infra | 20:31 | |
| *** jaypipes_ is now known as brokenpipes | 20:32 | |
| *** jaypipes has quit IRC | 20:32 | |
| *** david-lyle has quit IRC | 20:33 | |
| *** MasterOfBugs has quit IRC | 20:34 | |
| pabelanger | sorry, was afk. No, nothing server side in netstat | 20:34 |
| pabelanger | fungi: not sure, we try to run process ever every | 20:34 |
| pabelanger | so possible it filled up quick | 20:34 |
| *** yamamoto has joined #openstack-infra | 20:34 | |
| pabelanger | going to look in database now | 20:34 |
| pabelanger | not sure if they are tracked there or not | 20:34 |
| *** asselin_ has joined #openstack-infra | 20:35 | |
| *** david-lyle has joined #openstack-infra | 20:35 | |
| pabelanger | mordred: clarkb: so, this appears to be the trick to get glean to work under debian-jessie: http://logs.openstack.org/83/451483/3/experimental/gate-dsvm-nodepool-debian-src-nv/1a7a098/logs/screen-nodepool-builder.txt.gz#_2017-03-29_20_02_40_203 | 20:38 |
| pabelanger | mordred: clarkb: which means, setting eth0 for debian jessie at image build time. | 20:38 |
| pabelanger | I am not sure if that is good or bad | 20:38 |
| *** asselin__ has quit IRC | 20:38 | |
| fungi | pabelanger: i don't see the connections open according to netstat either (not v4 nor v6) | 20:39 |
| fungi | at the review.o.o end | 20:39 |
| fungi | nothing for stackalytics.o.o addresses in netstat -Wnt output | 20:39 |
| pabelanger | fungi: Ya, I seem to recall something about gerrit keeping leaked connections open | 20:39 |
| pabelanger | but cannot find info about that | 20:39 |
| fungi | pabelanger: okay, so this is probably hung "open" in the jvm's ip stack | 20:40 |
| *** yamamoto has quit IRC | 20:40 | |
| pabelanger | fungi: yes, that is what I am thinking | 20:40 |
| *** david-lyle has quit IRC | 20:40 | |
| fungi | you see them under gerrit show-connections? | 20:40 |
| pabelanger | yup | 20:40 |
| pabelanger | and gerrit close-connection runs, but won't close them | 20:41 |
| fungi | and close-connection on the connection ids doesn't take them out? | 20:41 |
| pabelanger | correct | 20:41 |
| EmilienM | clarkb: any chance to approve https://review.openstack.org/#/c/451546/ please? | 20:41 |
| *** zz_dimtruck is now known as dimtruck | 20:42 | |
| *** david-lyle has joined #openstack-infra | 20:42 | |
| pabelanger | fungi: so, on our next reset, we can trying our paramiko patch to see if connections close properly | 20:42 |
| fungi | pabelanger: i don't see it on show-connections output | 20:43 |
| fungi | what's the account id? | 20:43 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Use caching reverse proxy for rdo repos https://review.openstack.org/451554 | 20:43 |
| clarkb | pabelanger: ^ there, if you ignore the one time setup fee its 3 lines per proxied service | 20:44 |
| fungi | i filtered by both ipv4 and ipv6 addresses for stackalytics.openstack.org, neither appear | 20:44 |
| pabelanger | fungi: 19164 | 20:44 |
| fungi | pabelanger: oh, fun! those have no remote address at all in gerrit's connections table | 20:44 |
| pabelanger | yup | 20:44 |
| pabelanger | I might have left that part out :) | 20:44 |
| clarkb | pabelanger: I do not know if that will actually help with reliability but seems straightforward to set up | 20:45 |
| pabelanger | clarkb: is that tested? | 20:45 |
| fungi | and yeah, confirmed close-connection on one of those connection ids does nothing for me either. persists in the table | 20:45 |
| clarkb | pabelanger: no | 20:45 |
| clarkb | pabelanger: I don't know how to test rdo things | 20:45 |
| clarkb | since the root url isn't actually a package repo | 20:45 |
| pabelanger | clarkb: but apache2 side should be okay? | 20:46 |
| *** david-lyle has quit IRC | 20:46 | |
| clarkb | pabelanger: well I haven't put it into a running apache either | 20:46 |
| pabelanger | clarkb: k | 20:46 |
| pabelanger | clarkb: I +2'd if we want to iterate on it | 20:47 |
| pabelanger | and give it a try | 20:47 |
| clarkb | pabelanger: I don't think it will hurt, fungi may have opinions though | 20:47 |
| pabelanger | k, I'm offline for the next few hours, there is an openstack meetup locally. but, if we do land it, I can help test later this evening. Otherwise, tomorrow | 20:49 |
| *** rcarrill1 is now known as rcarrillocruz | 20:49 | |
| *** dhajare has quit IRC | 20:49 | |
| clarkb | pabelanger: ya we'll need to update jobs to use that url instead of rdo itself, should be able to do that in a self testing way and then merge if it works | 20:49 |
| pabelanger | sure | 20:50 |
| *** rwsu has joined #openstack-infra | 20:50 | |
| fungi | clarkb: pabelanger: i guess the proxy idea is fine, but longer term i thought the goal was to add a validation step before vos release which should prevent us from publishing an update until the mirrored packageset is consistent | 20:51 |
| *** annegentle has quit IRC | 20:51 | |
| clarkb | fungi: the assertion here is that afs won't work for rdo because it churns too much | 20:51 |
| clarkb | fungi: so instead just make connectivity to the source more reliable | 20:51 |
| fungi | is it always inconsistent, or only occasionally so (daily or some such)? | 20:52 |
| clarkb | I'm not sure | 20:52 |
| pabelanger | I am working on the churn with rdo now | 20:52 |
| clarkb | aiui its under constant rebuild though | 20:52 |
| pabelanger | we might be able to do AFS long term | 20:52 |
| *** david-lyle has joined #openstack-infra | 20:52 | |
| pabelanger | but they might need to make some changes on their side | 20:52 |
| fungi | if most syncs produce a viable repository and a few don't (but often enough to be disruptive) then i think checking consistency and skipping vos release when that fails isn't a major issue | 20:53 |
| clarkb | fungi: I think the issue is more that they don't want our syncs to alg | 20:53 |
| openstackgerrit | Merged openstack-infra/project-config master: Move ovb containers job to experimental queue https://review.openstack.org/451546 | 20:53 |
| clarkb | fungi: since they depend on that constant churn to get cross project testing and the like to work | 20:53 |
| fungi | in that case they want some form of push mirroring | 20:53 |
| fungi | _they_ could quite easily (we have puppet modules!) set up an afs cell to push their mirror into, and we could serve that from our caches | 20:54 |
| pabelanger | fungi: yes, or move their builds upstream. | 20:54 |
| pabelanger | fungi: Oh, that is an idea | 20:54 |
| pabelanger | okay, have to run. Will loop bac | 20:54 |
| clarkb | fungi: except that there are all the problems in the world running afs on centos/rhel/fedora last I checked | 20:55 |
| clarkb | but other than that yet :) | 20:55 |
| openstackgerrit | Jim Rollenhagen proposed openstack/os-client-config master: Docs: add a note about rackspace API keys https://review.openstack.org/451563 | 20:55 |
| fungi | heh, good point. maybe that would incentivise them to fix the openafs module for their kernel builds? ;) | 20:55 |
| clarkb | but yes that would make it trivial on our end to serve their things | 20:55 |
| clarkb | my change is mostly a response to "JUST USE SQUID!" | 20:56 |
| fungi | i'm betting the openafs devs would willingly accept fixes if needed. they just happen to run a lot of debian so it gets a lot of first-class testing there | 20:56 |
| clarkb | since we already have systems that can do this and we likely don't want open forward proxy on internet | 20:56 |
| fungi | right, i'd prefer apache mod_proxy over squid for this. we're already running apache anyway | 20:56 |
| fungi | not that squid is at all bad, and we could certainly configure it to be not an open proxy | 20:57 |
| clarkb | its just more work than using the existing server thats there to do it | 20:57 |
| fungi | in years past i ran a ton of squid for customers as a "web accelerator" (on openbsd for that matter) | 20:58 |
| clarkb | and we avoid forward proxy ssl issues | 20:58 |
| fungi | yup | 20:58 |
| clarkb | can squid reverse proxy too? | 20:58 |
| fungi | definitely | 20:58 |
| clarkb | ah ok | 20:58 |
| clarkb | so I think my biggest thing was reverse > forward here | 20:58 |
| fungi | yeah, case in point, the local hockey team was forced to use the nhl's terrible site hosting platform | 21:00 |
| fungi | but wanted to run it in our data center | 21:00 |
| fungi | the thing dynamically generated every page. even static content. was a terrible cpu hog | 21:00 |
| fungi | stuck a squid reverse proxy in front of it and sailed through the stanley cup | 21:01 |
| fungi | i remember watching the cup games from a friend's bar because he had free wireless and i could still monitor the proxy load from there | 21:01 |
| fungi | was fun to watch the traffic spike enormously between periods | 21:02 |
| *** amotoki has joined #openstack-infra | 21:02 | |
| clarkb | cool well if apache doesn't work for some reason we can consider squid as a reverse (not forward) proxy, but apache is already there, easy mode. | 21:03 |
| fungi | since we were providing an openbsd firewall/load-balancer cluser for them, i just installed the openbsd package for squid4 or whatever it was at the time | 21:03 |
| *** rbuzatu has joined #openstack-infra | 21:03 | |
| *** ccamacho has quit IRC | 21:04 | |
| *** xarses_ has joined #openstack-infra | 21:04 | |
| JayF | fungi: .o(what team?) | 21:04 |
| fungi | actually, not completely true. this web application did some terrible cache-defeating tricks like setting expiration times in the past and every don-cache header known to rfc. there was i think one i couldn't configure squid to ignore and wound up hand-patching and recompiling to get around that | 21:04 |
| fungi | JayF: canes | 21:05 |
| clarkb | fungi: I'm a little worried we'll haev that problem with this setup too | 21:05 |
| clarkb | since we don't actually control the backends | 21:05 |
| *** andreww has joined #openstack-infra | 21:05 | |
| JayF | fungi: sweet. I thought so -- an IT gig at a team I'm a fan of would seem to be the holy grail of a job, but I imagine the innards of the tech at a pro team is probably ugly | 21:05 |
| JayF | fungi: but they all use the MLBAM platform stuff now, so it's gotta be completely different than it was in '06 | 21:06 |
| fungi | right, it's always possible services you proxy which are outside your control may set things that can be a problem to tune around | 21:06 |
| *** andreww has quit IRC | 21:06 | |
| *** andreww has joined #openstack-infra | 21:06 | |
| *** rwsu has quit IRC | 21:06 | |
| *** mat128 has joined #openstack-infra | 21:06 | |
| fungi | JayF: well, they didn't really have much of an it staff and outsourced their data center and network stuff to us | 21:07 |
| *** amotoki has quit IRC | 21:07 | |
| *** rhallisey has quit IRC | 21:08 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add bare parameter to get/list/search server https://review.openstack.org/451264 | 21:09 |
| *** xarses_ has quit IRC | 21:09 | |
| clarkb | JayF: while you are here, does the ironic testing run multiple VMs as fake baremetal at a time? and do they use the same base image? | 21:10 |
| JayF | clarkb: I'm not sure what question #1 is | 21:11 |
| JayF | clarkb: question #2: we use both a partition and whole-disk image | 21:11 |
| clarkb | JayF: the fake baremetal instances that are actually VMs, how many are running at any given time? | 21:11 |
| JayF | clarkb: We configure three in devstack, but aiui we run tempest in serial | 21:12 |
| JayF | clarkb: with the new standalone tests vsaienk0 setup, idk if that changed or not | 21:12 |
| *** baoli has quit IRC | 21:12 | |
| clarkb | ok so https://review.openstack.org/447119 may or may not affect you, just something to be aware of | 21:12 |
| *** annegentle has joined #openstack-infra | 21:12 | |
| clarkb | (we are trying things like that to reduce memory overhead | 21:12 |
| *** baoli has joined #openstack-infra | 21:13 | |
| *** baoli has quit IRC | 21:13 | |
| mordred | infra-root: https://review.openstack.org/#/c/451264/ may be a fix to the shade gate break via designate. I've pushed up https://review.openstack.org/451264 with a depends-on it to validate | 21:13 |
| mordred | and if it is, there's my ATC for designate this cycle | 21:13 |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Add python35 non-voting job networking-arista https://review.openstack.org/451571 | 21:13 |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Enable Python3.5 gating for networking-arista https://review.openstack.org/451572 | 21:13 |
| clarkb | mordred: how is it that designates gating didn't catch it? | 21:13 |
| *** krtaylor has joined #openstack-infra | 21:13 | |
| mordred | clarkb: it wasn't an error in old sqlalchemy | 21:14 |
| mordred | clarkb: but new sqlalchemy validates | 21:14 |
| clarkb | ah so once new sqlalchemy shows up boom | 21:14 |
| clarkb | got it | 21:14 |
| mordred | yah | 21:14 |
| *** baoli has joined #openstack-infra | 21:14 | |
| clarkb | while I am thinking about it https://review.openstack.org/#/c/450534/ is a fix for ianw's planet01.o.o booting | 21:14 |
| clarkb | would be nice for another infra-root to reviewas I think ianw is awake now | 21:15 |
| mordred | clarkb, ianw: +A | 21:15 |
| *** kgiusti has left #openstack-infra | 21:15 | |
| ianw | heh, yes, i got a little sidetracked yesterday :) | 21:15 |
| ianw | you know i can't resist a segfault | 21:16 |
| clarkb | ianw: :) | 21:16 |
| *** ldnunes has quit IRC | 21:16 | |
| clarkb | I got sniped by pkg_resources slowness | 21:16 |
| clarkb | mordred: did you see my root cause of ^ | 21:16 |
| clarkb | mordred: pkg_resources lists every python package it can find, parses their versions and then sorts them | 21:17 |
| clarkb | it turns out that is slow | 21:17 |
| mordred | uh - yah | 21:17 |
| clarkb | and even better gets slower the more packages you have :) | 21:17 |
| mordred | :) | 21:17 |
| *** rwsu has joined #openstack-infra | 21:20 | |
| *** gouthamr has quit IRC | 21:21 | |
| *** andreykurilin has quit IRC | 21:22 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add planet01.openstack.org https://review.openstack.org/450534 | 21:22 |
| *** jmorgan1_ has joined #openstack-infra | 21:22 | |
| *** andreykurilin has joined #openstack-infra | 21:22 | |
| *** jmorgan1 has quit IRC | 21:23 | |
| *** manjeets_ has quit IRC | 21:23 | |
| *** manjeets_ has joined #openstack-infra | 21:24 | |
| *** ccamacho has joined #openstack-infra | 21:24 | |
| *** yee379 has joined #openstack-infra | 21:25 | |
| *** lp|Kubecon has quit IRC | 21:25 | |
| *** yee37915 has quit IRC | 21:26 | |
| *** skelso has quit IRC | 21:26 | |
| *** skelso has joined #openstack-infra | 21:26 | |
| *** ihrachys has quit IRC | 21:26 | |
| *** hashar has quit IRC | 21:27 | |
| *** jmorgan1_ has quit IRC | 21:27 | |
| *** DennyZhang has quit IRC | 21:27 | |
| *** jmorgan1 has joined #openstack-infra | 21:27 | |
| *** mattmceuen has quit IRC | 21:28 | |
| *** lazyPower has joined #openstack-infra | 21:28 | |
| *** jcoufal has quit IRC | 21:29 | |
| *** burgerk has quit IRC | 21:31 | |
| *** ssbarnea has quit IRC | 21:34 | |
| markmcclain | If anyone has a moment, I want to add python35 non-voting job, I thought I was adding the right line, but the check failed https://review.openstack.org/#/c/451571/1/zuul/layout.yaml | 21:35 |
| markmcclain | Did I miss a step? | 21:35 |
| markmcclain | (my follow up change which depends on commits to merge into the project repo did pass - https://review.openstack.org/#/c/451572/1/zuul/layout.yaml | 21:36 |
| *** yamamoto has joined #openstack-infra | 21:36 | |
| *** DennyZhang has joined #openstack-infra | 21:37 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Update pip in DLRN venv https://review.openstack.org/438746 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 21:38 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 21:38 |
| *** kzaitsev_mb has quit IRC | 21:40 | |
| *** dimtruck is now known as zz_dimtruck | 21:41 | |
| *** pramodrj07 has quit IRC | 21:41 | |
| *** pramodrj07 has joined #openstack-infra | 21:41 | |
| *** yamamoto has quit IRC | 21:42 | |
| *** SergeyLukjanov has quit IRC | 21:43 | |
| *** ruhe has quit IRC | 21:44 | |
| *** DinaBelova has quit IRC | 21:44 | |
| *** NikitaKonovalov has quit IRC | 21:44 | |
| jhesketh | Morning | 21:44 |
| *** NikitaKonovalov has joined #openstack-infra | 21:45 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Disable designate in shade's gate jobs https://review.openstack.org/451579 | 21:46 |
| mordred | infra-root: ^^ | 21:46 |
| *** SergeyLukjanov has joined #openstack-infra | 21:46 | |
| *** DinaBelova has joined #openstack-infra | 21:46 | |
| mordred | there are too many overlapping problems with designate in devstack right now - Ive got a patch to fix the sqla bug up, but it also needs a python3 issue fixed (also fixed) and then that gets all the way to there being an eventlet version issue | 21:46 |
| *** john-davidge has quit IRC | 21:47 | |
| *** flepied has quit IRC | 21:49 | |
| *** ruhe has joined #openstack-infra | 21:49 | |
| *** mriedem has quit IRC | 21:50 | |
| *** shardy has quit IRC | 21:50 | |
| *** eharney has quit IRC | 21:50 | |
| *** beslemon_ has quit IRC | 21:53 | |
| *** erlon has quit IRC | 21:55 | |
| *** brokenpipes has quit IRC | 21:55 | |
| *** esberglu has quit IRC | 21:56 | |
| *** esberglu has joined #openstack-infra | 21:57 | |
| *** DennyZhang has quit IRC | 21:59 | |
| *** esberglu has quit IRC | 22:02 | |
| *** amotoki has joined #openstack-infra | 22:03 | |
| *** wolverineav has quit IRC | 22:04 | |
| *** wolverineav has joined #openstack-infra | 22:06 | |
| fungi | markmcclain: "FAILURE: Job gate-networking-arista-python35-nv not defined" means you haven't instantiated the job definition in the jenkins/jobs/ tree there | 22:06 |
| *** amotoki has quit IRC | 22:08 | |
| fungi | markmcclain: probably need to add gate-{name}-python35-nv to networking-arista's jobs list at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n7179 | 22:08 |
| *** jamielennox is now known as jamielennox|away | 22:09 | |
| *** adrian_otto has quit IRC | 22:09 | |
| fungi | markmcclain: jenkins/jobs/* basically defines what your jobs are, while zuul/layout.yaml specifies when to run those jobs (which is why you need to add in both places) | 22:09 |
| *** skelso has quit IRC | 22:10 | |
| fungi | now that we're not actually running jenkins, all this gets refactored in zuul v3 and becomes much simpler to reason about, thankfully | 22:10 |
| *** claudiub has quit IRC | 22:10 | |
| *** annegentle has quit IRC | 22:10 | |
| *** adrian_otto has joined #openstack-infra | 22:10 | |
| *** wolverineav has quit IRC | 22:11 | |
| fungi | but the configuration split was originally because one was a set of configuration for jenkins and the other was configuration for zuul | 22:11 |
| *** andreww has quit IRC | 22:11 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:11 | |
| *** xyang1 has quit IRC | 22:12 | |
| *** jamielennox|away is now known as jamielennox | 22:12 | |
| *** mdrabe has quit IRC | 22:15 | |
| openstackgerrit | Merged openstack-infra/project-config master: Disable designate in shade's gate jobs https://review.openstack.org/451579 | 22:16 |
| *** eeiden has joined #openstack-infra | 22:17 | |
| *** zz_dimtruck is now known as dimtruck | 22:17 | |
| *** coreyob has quit IRC | 22:20 | |
| *** baoli has quit IRC | 22:21 | |
| *** rwsu has quit IRC | 22:23 | |
| *** kzaitsev_mb has quit IRC | 22:24 | |
| *** felipemonteiro has quit IRC | 22:25 | |
| *** marst_ has quit IRC | 22:27 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Capture more of the bmc console log https://review.openstack.org/451591 | 22:28 |
| *** askb has joined #openstack-infra | 22:33 | |
| *** rwsu has joined #openstack-infra | 22:35 | |
| *** yamamoto has joined #openstack-infra | 22:38 | |
| *** krtaylor has quit IRC | 22:38 | |
| *** pradk has quit IRC | 22:38 | |
| *** dingyichen has joined #openstack-infra | 22:41 | |
| *** yamamoto has quit IRC | 22:42 | |
| *** eroux has quit IRC | 22:43 | |
| *** Julien-zte has joined #openstack-infra | 22:44 | |
| *** gouthamr has joined #openstack-infra | 22:46 | |
| *** sdague has quit IRC | 22:46 | |
| *** rbrndt has quit IRC | 22:48 | |
| *** marst has joined #openstack-infra | 22:49 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:50 | |
| *** john-davidge has joined #openstack-infra | 22:51 | |
| *** sihan has joined #openstack-infra | 22:54 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add bare parameter to get/list/search server https://review.openstack.org/451264 | 22:54 |
| sihan | Hi Guys, in zuul-server log, I found there are some zuul.IndependentPipelineManager: Unable to merge change <Change 0x7f313dbc88d0 449587,1> problem. Why is there merge problem? | 22:54 |
| *** xarses_ has joined #openstack-infra | 22:55 | |
| *** xarses_ has quit IRC | 22:56 | |
| *** thorst has quit IRC | 22:56 | |
| *** john-davidge has quit IRC | 22:56 | |
| *** xarses_ has joined #openstack-infra | 22:56 | |
| *** xarses has quit IRC | 22:58 | |
| *** aeng_ has joined #openstack-infra | 22:58 | |
| *** andreww has joined #openstack-infra | 22:59 | |
| *** andreww has quit IRC | 22:59 | |
| *** andreww has joined #openstack-infra | 22:59 | |
| *** xarses_ has quit IRC | 23:01 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add source to projects https://review.openstack.org/451596 | 23:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add a project index to Tenant https://review.openstack.org/451597 | 23:03 |
| openstackgerrit | Jamie Lennox proposed openstack-infra/shade master: Add server security groups to shade https://review.openstack.org/451183 | 23:03 |
| *** erikmwilson has quit IRC | 23:03 | |
| *** amotoki has joined #openstack-infra | 23:04 | |
| *** Apoorva_ has joined #openstack-infra | 23:05 | |
| clarkb | sihan: typically it is because the target branch has moved ahead and now the change no longer merges in cleanly and needs human to rebase it | 23:06 |
| *** Apoorva has quit IRC | 23:06 | |
| *** kornica has joined #openstack-infra | 23:06 | |
| clarkb | sihan: you can check the zuul merger logs to get exact reasons for why | 23:06 |
| *** erikmwilson has joined #openstack-infra | 23:07 | |
| *** kornicameister has quit IRC | 23:08 | |
| kevinbenton | can we get this irc-meetings time change merged today? https://review.openstack.org/#/c/448886/ | 23:08 |
| kevinbenton | I want it to be back to normal for tomorrows neutron-drivers meeting | 23:09 |
| *** amotoki has quit IRC | 23:09 | |
| clarkb | +2'd maybe fungi or jhesketh or mordred can double check it for second review | 23:10 |
| sihan | @clarkb Hi, I found in merger.log Run git config --global user.email "you@example.com" git config --global user.name "Your Name" to set your account's default identity. | 23:11 |
| sihan | I am setting up the vmware third party ci, how could set those? | 23:11 |
| sihan | I only have private key and username now | 23:11 |
| clarkb | sihan: you can run those commands as the user running zuul, or you can use config management | 23:12 |
| openstackgerrit | Jamie Lennox proposed openstack-infra/shade master: Add server security groups to shade https://review.openstack.org/451183 | 23:12 |
| jhesketh | kevinbenton, clarkb: +3 | 23:13 |
| clarkb | sihan: basically in order for git to properly make merge commits it needs to know who/what is authoring those merges | 23:13 |
| kevinbenton | jhesketh, clarkb: thx | 23:13 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Revert "Adjust time of neutron meeting and neutron-drivers" https://review.openstack.org/448886 | 23:17 |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Add python35 non-voting job networking-arista https://review.openstack.org/451571 | 23:21 |
| openstackgerrit | mark mcclain proposed openstack-infra/project-config master: Enable Python3.5 gating for networking-arista https://review.openstack.org/451572 | 23:21 |
| markmcclain | fungi: Thanks! | 23:22 |
| *** pramodrj07 has quit IRC | 23:22 | |
| *** chem_gone has quit IRC | 23:30 | |
| *** erikmwilson has quit IRC | 23:33 | |
| *** Julien-zte has quit IRC | 23:35 | |
| *** EricGonczer_ has joined #openstack-infra | 23:37 | |
| *** erikmwilson has joined #openstack-infra | 23:38 | |
| *** yamamoto has joined #openstack-infra | 23:39 | |
| rajinir | Hi I'm seeing a strange problem where the devstack slave nodes are getting shutdown in mins after they are added by nodepool. I'm using stable/newton and not able to find the root cause | 23:39 |
| clarkb | rajinir: this is for third party CI or using infra's hosts? | 23:39 |
| rajinir | clarkb: yes | 23:39 |
| rajinir | clarkb: I mean this is thirdparty CI | 23:40 |
| clarkb | rajinir: ok, from where are they being deleted? jenkins slave list or the cloud itself (maybe both?) | 23:40 |
| *** Swami has quit IRC | 23:41 | |
| rajinir | clarkb: They are deleted only on the cloud, jenkins and nodepool is still thinking they are ready. They are gone from libvirt too | 23:42 |
| rajinir | clarkb: Does it have anything to do with nodepool code? | 23:42 |
| *** mat128 has quit IRC | 23:42 | |
| rajinir | clarkb: looks similar to this problem this https://ask.openstack.org/en/question/1265/instances-shutoff/ | 23:43 |
| clarkb | rajinir: if nodepool thinks it is still ready then nodepool likely isn't deleting it. Do you have access to the nova logs? | 23:43 |
| clarkb | rajinir: you could see if anything is requesting the deletions (like maybe a rogue nodepool) | 23:43 |
| *** yamamoto has quit IRC | 23:44 | |
| *** tosky has quit IRC | 23:48 | |
| *** adrian_otto has quit IRC | 23:51 | |
| rajinir | clarkb: don't see any delete request in nova logs, the instances shutsoff like magic. It is wierd | 23:54 |
| clarkb | rajinir: ok, if you have a rogue nodepool running it could be deleting what it considers to be "aliens" | 23:54 |
| clarkb | er not aliens in this case, leaked nodes | 23:54 |
| clarkb | rajinir: I would try booting an instance manually, don't do anything special for it and see if it gets deleted. Nodepool adds special metadata to instances to know it is ok for it to delete them | 23:55 |
| clarkb | so it shouldn't delete your manually booted one | 23:55 |
| clarkb | that would be a good way to rule out nodepool leak handling vs something in the cloud | 23:55 |
| rajinir | clarkb:ok, will try | 23:56 |
| *** thorst has joined #openstack-infra | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!