| *** gouthamr has quit IRC | 00:00 | |
| *** esikachev has joined #openstack-infra | 00:01 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:04 | |
| openstackgerrit | Merged openstack-infra/system-config master: Thats what I'm trying to tell you, kid. It ain't there. It's been totally blown away. https://review.openstack.org/452604 | 00:05 |
|---|---|---|
| *** esikachev has quit IRC | 00:09 | |
| *** neiljerram has quit IRC | 00:10 | |
| *** EricGonczer_ has quit IRC | 00:12 | |
| *** esberglu has joined #openstack-infra | 00:18 | |
| *** esberglu has quit IRC | 00:23 | |
| openstackgerrit | Merged openstack-infra/system-config master: Install python-minimal for Xenial https://review.openstack.org/450526 | 00:24 |
| openstackgerrit | Merged openstack-infra/system-config master: launch-node: ignore failure to restart eth0 https://review.openstack.org/450529 | 00:26 |
| *** rhallisey has quit IRC | 00:27 | |
| *** kzaitsev_mb has quit IRC | 00:31 | |
| *** sflanigan has joined #openstack-infra | 00:33 | |
| *** zhurong has joined #openstack-infra | 00:33 | |
| *** thorst has quit IRC | 00:33 | |
| *** rfolco has joined #openstack-infra | 00:37 | |
| *** rfolco has quit IRC | 00:37 | |
| *** krtaylor has joined #openstack-infra | 00:38 | |
| *** esberglu has joined #openstack-infra | 00:39 | |
| *** esberglu has quit IRC | 00:43 | |
| *** nicolasbock has joined #openstack-infra | 01:10 | |
| *** gildub has joined #openstack-infra | 01:12 | |
| *** esberglu has joined #openstack-infra | 01:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable OSC plugin gates for python-octaviaclient https://review.openstack.org/445244 | 01:18 |
| *** esberglu has quit IRC | 01:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Adding missing dependencies into collect-ceilometer-plugin.yaml https://review.openstack.org/454727 | 01:19 |
| openstackgerrit | Merged openstack-infra/project-config master: Switch Puppet OpenStack CI to use tripleo-quickstart jobs https://review.openstack.org/454843 | 01:22 |
| openstackgerrit | Merged openstack/diskimage-builder master: Move do_extra_package_install to run in install phase https://review.openstack.org/452653 | 01:24 |
| openstackgerrit | Merged openstack/diskimage-builder master: Unify and fix doc of several Debian and Ubuntu elements https://review.openstack.org/421479 | 01:25 |
| *** kzaitsev_mb has joined #openstack-infra | 01:27 | |
| *** esikachev has joined #openstack-infra | 01:28 | |
| *** esikachev has quit IRC | 01:32 | |
| *** thorst has joined #openstack-infra | 01:34 | |
| *** yanyanhu has joined #openstack-infra | 01:36 | |
| *** thorst has quit IRC | 01:37 | |
| *** thorst has joined #openstack-infra | 01:37 | |
| *** thorst has quit IRC | 01:37 | |
| *** yanyanhu has quit IRC | 01:40 | |
| *** kzaitsev_mb has quit IRC | 01:56 | |
| *** zhurong has quit IRC | 01:58 | |
| *** skelso has joined #openstack-infra | 01:58 | |
| *** tuanluong has joined #openstack-infra | 01:59 | |
| *** tuanluong_ has joined #openstack-infra | 02:02 | |
| *** skelso has quit IRC | 02:03 | |
| *** tuanluong has quit IRC | 02:05 | |
| *** skelso has joined #openstack-infra | 02:05 | |
| *** gouthamr has joined #openstack-infra | 02:05 | |
| *** esberglu has joined #openstack-infra | 02:08 | |
| *** zhurong has joined #openstack-infra | 02:10 | |
| *** esberglu has quit IRC | 02:13 | |
| *** yanyanhu has joined #openstack-infra | 02:20 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:23 | |
| *** gildub has quit IRC | 02:24 | |
| *** kzaitsev_mb has quit IRC | 02:28 | |
| *** esikachev has joined #openstack-infra | 02:28 | |
| *** psedlak has quit IRC | 02:29 | |
| *** esikachev has quit IRC | 02:33 | |
| *** thorst has joined #openstack-infra | 02:38 | |
| *** ramishra has joined #openstack-infra | 02:39 | |
| *** armax has quit IRC | 02:42 | |
| *** armax has joined #openstack-infra | 02:42 | |
| *** armax has quit IRC | 02:43 | |
| *** esikachev has joined #openstack-infra | 02:45 | |
| *** yamamoto has joined #openstack-infra | 02:45 | |
| *** tuanluong has joined #openstack-infra | 02:47 | |
| *** skelso has quit IRC | 02:48 | |
| *** esikachev has quit IRC | 02:49 | |
| *** tuanluong_ has quit IRC | 02:49 | |
| *** nicolasbock has quit IRC | 02:53 | |
| *** thorst has quit IRC | 02:57 | |
| *** yamamoto has quit IRC | 03:01 | |
| *** esberglu has joined #openstack-infra | 03:03 | |
| *** mriedem has quit IRC | 03:06 | |
| *** esikachev has joined #openstack-infra | 03:07 | |
| *** esberglu has quit IRC | 03:07 | |
| *** esikachev has quit IRC | 03:11 | |
| *** gouthamr has quit IRC | 03:16 | |
| *** ramishra has quit IRC | 03:19 | |
| *** ramishra has joined #openstack-infra | 03:21 | |
| *** yamahata has joined #openstack-infra | 03:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:24 | |
| *** ym200 has joined #openstack-infra | 03:25 | |
| *** apetrich has quit IRC | 03:26 | |
| *** apetrich has joined #openstack-infra | 03:27 | |
| *** gildub has joined #openstack-infra | 03:29 | |
| *** esikachev has joined #openstack-infra | 03:30 | |
| *** ym200 has quit IRC | 03:30 | |
| *** ym200 has joined #openstack-infra | 03:33 | |
| *** esikachev has quit IRC | 03:34 | |
| *** ym200 has quit IRC | 03:37 | |
| *** vikrant has joined #openstack-infra | 03:37 | |
| *** john-davidge has joined #openstack-infra | 03:41 | |
| *** john-davidge has quit IRC | 03:46 | |
| *** thorst has joined #openstack-infra | 03:55 | |
| *** esberglu has joined #openstack-infra | 03:57 | |
| *** kzaitsev_mb has quit IRC | 03:57 | |
| *** thorst has quit IRC | 03:59 | |
| *** yamamoto has joined #openstack-infra | 04:01 | |
| *** esberglu has quit IRC | 04:01 | |
| *** markvoelker has joined #openstack-infra | 04:05 | |
| *** psachin has joined #openstack-infra | 04:09 | |
| *** esikachev has joined #openstack-infra | 04:14 | |
| *** esikachev has quit IRC | 04:18 | |
| *** Dinesh_Bhor has joined #openstack-infra | 04:22 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:22 | |
| *** sree has joined #openstack-infra | 04:23 | |
| *** kzaitsev_mb has quit IRC | 04:27 | |
| *** ym200 has joined #openstack-infra | 04:40 | |
| *** ym200 has quit IRC | 04:44 | |
| *** esberglu has joined #openstack-infra | 04:51 | |
| *** dharinic has quit IRC | 04:54 | |
| *** esberglu has quit IRC | 04:55 | |
| *** thorst has joined #openstack-infra | 04:55 | |
| *** kornica is now known as kornicameister | 04:59 | |
| *** ociuhandu has quit IRC | 05:00 | |
| *** thorst has quit IRC | 05:00 | |
| *** ociuhandu has joined #openstack-infra | 05:01 | |
| *** bknudson_ has quit IRC | 05:01 | |
| *** sree has quit IRC | 05:06 | |
| *** esikachev has joined #openstack-infra | 05:11 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:24 | |
| *** rcernin has joined #openstack-infra | 05:25 | |
| *** ym200 has joined #openstack-infra | 05:39 | |
| *** john-davidge has joined #openstack-infra | 05:42 | |
| *** yamamoto_ has joined #openstack-infra | 05:42 | |
| *** ym200 has quit IRC | 05:44 | |
| *** prateek has joined #openstack-infra | 05:44 | |
| *** esberglu has joined #openstack-infra | 05:45 | |
| *** yamamoto has quit IRC | 05:45 | |
| *** john-davidge has quit IRC | 05:46 | |
| *** esberglu has quit IRC | 05:49 | |
| *** ociuhandu has quit IRC | 05:55 | |
| *** thorst has joined #openstack-infra | 05:56 | |
| *** kzaitsev_mb has quit IRC | 05:57 | |
| *** gcb has joined #openstack-infra | 05:57 | |
| *** cshastri has joined #openstack-infra | 05:59 | |
| *** tuanluong has quit IRC | 06:00 | |
| *** thorst has quit IRC | 06:00 | |
| openstackgerrit | Merged openstack-infra/project-config master: Update APT indexes before bringing node online https://review.openstack.org/455063 | 06:00 |
| *** pcaruana has joined #openstack-infra | 06:01 | |
| *** ym200 has joined #openstack-infra | 06:02 | |
| *** ociuhandu has joined #openstack-infra | 06:05 | |
| *** ym200 has quit IRC | 06:07 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: dib-lint: basic check for duplicate element names https://review.openstack.org/455126 | 06:08 |
| *** pgadiya has joined #openstack-infra | 06:13 | |
| AJaeger | ianw: could you review a local_conf change - https://review.openstack.org/#/c/454635/ and two infra-manual ones of mine as time permits (nothing urgent), please? https://review.openstack.org/#/c/454666/ and https://review.openstack.org/#/c/455059/ | 06:14 |
| *** ym200 has joined #openstack-infra | 06:14 | |
| *** tuanluong has joined #openstack-infra | 06:14 | |
| *** ym200 has quit IRC | 06:19 | |
| *** yonglihe has joined #openstack-infra | 06:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:22 | |
| *** amotoki has joined #openstack-infra | 06:23 | |
| *** ym200 has joined #openstack-infra | 06:24 | |
| *** ramishra has quit IRC | 06:25 | |
| *** ramishra has joined #openstack-infra | 06:27 | |
| *** kzaitsev_mb has quit IRC | 06:27 | |
| *** ym200 has quit IRC | 06:29 | |
| *** ociuhandu has quit IRC | 06:31 | |
| *** ym200 has joined #openstack-infra | 06:32 | |
| *** markus_z has joined #openstack-infra | 06:33 | |
| *** rossella_s has quit IRC | 06:33 | |
| *** aeng has quit IRC | 06:33 | |
| *** rossella_s has joined #openstack-infra | 06:34 | |
| *** andreas_s has joined #openstack-infra | 06:35 | |
| *** jascott1_ has joined #openstack-infra | 06:37 | |
| *** ym200 has quit IRC | 06:37 | |
| *** esberglu has joined #openstack-infra | 06:39 | |
| *** HeOS has joined #openstack-infra | 06:41 | |
| *** ym200 has joined #openstack-infra | 06:41 | |
| *** jascott1_ has quit IRC | 06:42 | |
| *** namnh has joined #openstack-infra | 06:43 | |
| *** ociuhandu has joined #openstack-infra | 06:44 | |
| *** esberglu has quit IRC | 06:44 | |
| *** pbourke has quit IRC | 06:45 | |
| namnh | Hi everyone, could you please help me to review this patch set. It got +2 from a core-reviewer: https://review.openstack.org/#/c/453013/ | 06:45 |
| *** ym200 has quit IRC | 06:46 | |
| *** tesseract has joined #openstack-infra | 06:48 | |
| *** pbourke has joined #openstack-infra | 06:48 | |
| *** jaosorior has joined #openstack-infra | 06:49 | |
| *** ramishra has quit IRC | 06:51 | |
| namnh | yolanda, hi Yolanda. Are you free?, could you please review this patch set for me: https://review.openstack.org/#/c/453013/ | 06:53 |
| *** ramishra has joined #openstack-infra | 06:53 | |
| *** thorst has joined #openstack-infra | 06:57 | |
| *** esberglu has joined #openstack-infra | 07:00 | |
| *** thorst has quit IRC | 07:01 | |
| *** jascott1_ has joined #openstack-infra | 07:02 | |
| *** jascott1_ has quit IRC | 07:03 | |
| *** esberglu has quit IRC | 07:04 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Remove note about POST_FAILURE https://review.openstack.org/454666 | 07:04 |
| *** hashar has joined #openstack-infra | 07:06 | |
| *** dmellado has joined #openstack-infra | 07:08 | |
| namnh | ianw, thanks Ian | 07:09 |
| namnh | ianw, thanks for your review | 07:09 |
| openstackgerrit | Merged openstack-infra/project-config master: Adding some configuations for gate_grenade https://review.openstack.org/453013 | 07:09 |
| *** flepied has quit IRC | 07:10 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: dib-lint: basic check for duplicate element names https://review.openstack.org/455126 | 07:10 |
| *** markvoelker has quit IRC | 07:12 | |
| *** ccamacho has joined #openstack-infra | 07:13 | |
| *** markvoelker has joined #openstack-infra | 07:15 | |
| *** ym200 has joined #openstack-infra | 07:15 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add congress-dashboard to PROJECTS https://review.openstack.org/455136 | 07:16 |
| *** dimtruck is now known as zz_dimtruck | 07:18 | |
| *** ym200 has quit IRC | 07:20 | |
| *** aviau has quit IRC | 07:21 | |
| *** aviau has joined #openstack-infra | 07:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:24 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: dib-lint: basic check for duplicate element names https://review.openstack.org/455126 | 07:24 |
| *** alexchadin has joined #openstack-infra | 07:26 | |
| *** jpich has joined #openstack-infra | 07:29 | |
| *** ym200 has joined #openstack-infra | 07:33 | |
| *** adriant has quit IRC | 07:35 | |
| *** esberglu has joined #openstack-infra | 07:35 | |
| *** shardy has joined #openstack-infra | 07:36 | |
| *** neiljerram has joined #openstack-infra | 07:37 | |
| *** ym200 has quit IRC | 07:37 | |
| *** nadya has joined #openstack-infra | 07:39 | |
| *** esberglu has quit IRC | 07:39 | |
| *** flepied has joined #openstack-infra | 07:40 | |
| *** john-davidge has joined #openstack-infra | 07:43 | |
| *** gcb has quit IRC | 07:46 | |
| *** john-davidge has quit IRC | 07:48 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config master: Add congress-dashboard to PROJECTS https://review.openstack.org/455136 | 07:50 |
| *** ym200 has joined #openstack-infra | 07:55 | |
| *** kzaitsev_mb has quit IRC | 07:56 | |
| *** gildub has quit IRC | 07:56 | |
| *** thorst has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** ym200 has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:01 | |
| *** dizquierdo has joined #openstack-infra | 08:02 | |
| *** rossella_s has quit IRC | 08:02 | |
| *** rossella_s has joined #openstack-infra | 08:06 | |
| *** tmorin has joined #openstack-infra | 08:06 | |
| *** jpich has quit IRC | 08:08 | |
| *** rossella_s has quit IRC | 08:08 | |
| *** jpich has joined #openstack-infra | 08:09 | |
| *** florianf has joined #openstack-infra | 08:10 | |
| *** bhavik1 has joined #openstack-infra | 08:11 | |
| *** efoley has joined #openstack-infra | 08:12 | |
| *** gcb has joined #openstack-infra | 08:12 | |
| *** efoley_ has joined #openstack-infra | 08:17 | |
| *** rossella_s has joined #openstack-infra | 08:17 | |
| *** thorst has quit IRC | 08:17 | |
| *** jpich has quit IRC | 08:20 | |
| *** efoley has quit IRC | 08:20 | |
| *** jpich has joined #openstack-infra | 08:20 | |
| *** martinkopec has joined #openstack-infra | 08:21 | |
| *** ralonsoh has joined #openstack-infra | 08:21 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:22 | |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: drop deprecated map-services/packages from zypper element https://review.openstack.org/454786 | 08:25 |
| *** HeOS has quit IRC | 08:25 | |
| *** ym200 has joined #openstack-infra | 08:26 | |
| *** kzaitsev_mb has quit IRC | 08:27 | |
| *** ym200 has quit IRC | 08:30 | |
| openstackgerrit | chenhb proposed openstack-infra/project-config master: [rally]Move cinder and heat scenario jobs out non-voting https://review.openstack.org/451339 | 08:31 |
| *** derekh has joined #openstack-infra | 08:33 | |
| *** ggnel_t has joined #openstack-infra | 08:33 | |
| *** dizquierdo has quit IRC | 08:36 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Move rpm-packaging meeting an hour earlier due to DST https://review.openstack.org/454094 | 08:38 |
| *** john-davidge has joined #openstack-infra | 08:42 | |
| *** stakeda has joined #openstack-infra | 08:43 | |
| *** ssbarnea has joined #openstack-infra | 08:47 | |
| *** electrofelix has joined #openstack-infra | 08:49 | |
| *** electrofelix has quit IRC | 08:50 | |
| *** ociuhandu has quit IRC | 08:51 | |
| *** ym200 has joined #openstack-infra | 08:51 | |
| *** ym200 has quit IRC | 08:56 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 08:59 | |
| *** ociuhandu has joined #openstack-infra | 09:00 | |
| *** knangia has quit IRC | 09:01 | |
| *** ym200 has joined #openstack-infra | 09:01 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config master: Promote ironic check job for kolla-kubernetes https://review.openstack.org/454796 | 09:03 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config master: kolla: Test 4.0.0 images with service charts https://review.openstack.org/455170 | 09:03 |
| openstackgerrit | Merged openstack-infra/project-config master: Don't error about default project group for SB https://review.openstack.org/454829 | 09:05 |
| sdake | any cores around to ack those two reviews? - one has a +2 (the gate promotion) the other is a new experimental job needed quickly | 09:05 |
| *** ym200 has quit IRC | 09:06 | |
| *** Kevin_Zheng has joined #openstack-infra | 09:07 | |
| *** tuanluong has quit IRC | 09:10 | |
| *** aviau has quit IRC | 09:11 | |
| *** aviau has joined #openstack-infra | 09:12 | |
| *** stakeda has quit IRC | 09:13 | |
| *** thorst has joined #openstack-infra | 09:14 | |
| *** ociuhandu has quit IRC | 09:14 | |
| *** ociuhandu has joined #openstack-infra | 09:18 | |
| *** alexchadin has quit IRC | 09:18 | |
| *** thorst has quit IRC | 09:18 | |
| andreykurilin | Hi folks! How often are our pypi mirrors (http://mirror.*.openstack.org) updated? | 09:18 |
| frickler | sdake: https://review.openstack.org/455170 seems to be missing the corresponding definitions in projects.yaml | 09:19 |
| sdake | frickler got it - will fix now - thanks :) | 09:19 |
| frickler | andreykurilin: I think at least daily, but the mirroring has been failing sometimes. any particular update you are missing? | 09:20 |
| *** dizquierdo has joined #openstack-infra | 09:21 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** esberglu has joined #openstack-infra | 09:23 | |
| *** electrofelix has joined #openstack-infra | 09:24 | |
| *** tosky has joined #openstack-infra | 09:25 | |
| AJaeger | sdake: please do not rebase changes just for the fun of it, there's no need for it - and it makes reviewing diffs harder. | 09:27 |
| *** kzaitsev_mb has joined #openstack-infra | 09:27 | |
| sdake | AJaeger sorry - i just added on to the original patch | 09:27 |
| sdake | as as econd one as to not dro pthe =2 | 09:27 |
| sdake | +2 | 09:27 |
| sdake | i could squash them if you liek | 09:27 |
| AJaeger | sdake: let's leave them as is. | 09:28 |
| *** esberglu has quit IRC | 09:28 | |
| sdake | roger | 09:28 |
| *** sambetts|afk is now known as sambetts | 09:29 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config master: kolla: Test 4.0.0 images with service charts https://review.openstack.org/455170 | 09:30 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change the Cinder-Nova meeting time slot https://review.openstack.org/453199 | 09:31 |
| sdake | AJaeger apolgoeis for causing trouble with the review process - know how much difficulty it is reviewing | 09:31 |
| AJaeger | sdake: no worries | 09:32 |
| sdake | i'm not quite sure i got that second one correct - although it looks correct to me | 09:32 |
| frickler | sdake: dropping the "type: binary" from your second stanza still looks broken to me | 09:33 |
| sdake | agred i just picked up on that with gerrit | 09:33 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config master: kolla: Test 4.0.0 images with service charts https://review.openstack.org/455170 | 09:34 |
| andreykurilin | frickler: setuptools-scm 1.15.3 released last friday. It broke some other packages (upstream bug - https://github.com/pypa/setuptools_scm/issues/164). That release has been removed from pypi and the new one (1.15.5) was released at Saturday. But our gates still have 1.15.3 :( | 09:39 |
| *** ym200 has joined #openstack-infra | 09:41 | |
| sdake | AJaeger structure of project-config looking really good now | 09:42 |
| sdake | AJaeger compared to 3 years ago - much simpler :) | 09:42 |
| *** ym200 has quit IRC | 09:46 | |
| *** ym200 has joined #openstack-infra | 09:46 | |
| *** yanyanhu has quit IRC | 09:46 | |
| andreykurilin | frickler: hm...since we do not have direct requirements for setuptools-scm (g-r and u-c do not contain it too) and it is missed from `pip freeze` in job, I can assume that it was obtained while building images for gates | 09:47 |
| *** Douhet has quit IRC | 09:47 | |
| frickler | andreykurilin: that would mean another day delay. you could check the build logs at http://nb01.openstack.org/ or wait whether it gets better after the next rebuld today | 09:49 |
| *** bhavik1 has quit IRC | 09:51 | |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder master: drop deprecated map-services/packages from zypper element https://review.openstack.org/454786 | 09:51 |
| *** ym200 has quit IRC | 09:51 | |
| andreykurilin | frickler: ok. thanks. we have a workaround now, so it is not a blocker | 09:51 |
| *** dizquierdo has quit IRC | 09:57 | |
| *** HeOS has joined #openstack-infra | 09:58 | |
| *** mptacekx has joined #openstack-infra | 09:58 | |
| *** aarefiev_afk is now known as aarefiev | 09:59 | |
| *** kzaitsev_mb has quit IRC | 09:59 | |
| *** john-dav_ has joined #openstack-infra | 10:00 | |
| *** john-davidge has quit IRC | 10:00 | |
| *** john-dav_ is now known as john-davidge | 10:01 | |
| mptacekx | Hi infra, our CI hits the this bug - https://github.com/pypa/setuptools_scm/issues/164 (issue mentioned already above in the chat) | 10:01 |
| mptacekx | "That release has been removed from pypi and the new one (1.15.5) was released at Saturday. But our gates still have 1.15.3 :(" | 10:01 |
| mptacekx | I didn't find any dependency on setuptools_scm, how this package is coming to the nodes ? | 10:02 |
| AJaeger | I do not see 1.15.5 at http://mirror.iad.rax.openstack.org/pypi/simple/setuptools_scm/ | 10:05 |
| AJaeger | infra-root, is our pypi mirror bandersnatch (?) stuck again and did not copy setuptools_scm over? ^ | 10:05 |
| mptacekx | Ajaeger: I can install 1.15.5 from https://pypi.python.org/simple | 10:07 |
| AJaeger | mptacekx: we use a local mirror and it's not set up. | 10:07 |
| *** alexchadin has joined #openstack-infra | 10:09 | |
| AJaeger | mptacekx, andreykurilin: rally does not follow the requirements process - if it would, tools like upper-constraints would be a simple way to solve this... | 10:09 |
| *** sdague has joined #openstack-infra | 10:10 | |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Delete running tempest with plugins https://review.openstack.org/455207 | 10:11 |
| andreykurilin | AJaeger: u-c applies by default in gates and it doesn't matter if project follow requirements process or not | 10:13 |
| AJaeger | andreykurilin: that's wrong. u-c is applied for devstack only but not for any tox based ones, there projects need to subscribe to it. | 10:15 |
| AJaeger | andreykurilin: and also: If you have dependencies outisde of global-requirements.txt, those and their dependencies will not be added to u-c at all. | 10:16 |
| *** gcb has quit IRC | 10:16 | |
| *** esberglu has joined #openstack-infra | 10:18 | |
| *** ym200 has joined #openstack-infra | 10:19 | |
| *** esberglu has quit IRC | 10:22 | |
| *** nicolasbock has joined #openstack-infra | 10:22 | |
| *** Douhet has joined #openstack-infra | 10:23 | |
| *** ym200 has quit IRC | 10:24 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:24 | |
| sdake | AJaeger thanks :) | 10:24 |
| *** ociuhandu has quit IRC | 10:25 | |
| *** ym200 has joined #openstack-infra | 10:27 | |
| AJaeger | jpich: http://status.openstack.org/openstack-health/#/job/tripleo-ui-propose-translation-update - something is broken ;( | 10:28 |
| *** fverboso has joined #openstack-infra | 10:28 | |
| jpich | AJaeger: Damn :( Thank you for the heads-up, looking now | 10:28 |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Adding subunit files to artcl_collect_list https://review.openstack.org/455219 | 10:29 |
| *** kzaitsev_mb has quit IRC | 10:29 | |
| AJaeger | thanks, jpich | 10:30 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use infra's docker registry mirror for multinode jobs https://review.openstack.org/455221 | 10:31 |
| *** ym200 has quit IRC | 10:32 | |
| andreykurilin | AJaeger: for dependencies which are not in g-r we can easily manage versions via our own requirements.txt without posting patches to g-r and asking to review it. so it is not a problem. | 10:33 |
| *** rossella_s has quit IRC | 10:33 | |
| andreykurilin | AJaeger: as for the tox envs, we use u-c via tox.ini | 10:34 |
| *** rossella_s has joined #openstack-infra | 10:34 | |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Delete running tempest with plugins https://review.openstack.org/455207 | 10:36 |
| andreykurilin | AJaeger: Rally requirements process is quite near the regular openstack requirements process, but with some notes - we can use whatever we want additional dependencies and we can add upper bound for all requirements while making own release. | 10:36 |
| *** namnh has quit IRC | 10:37 | |
| *** ricardoas has joined #openstack-infra | 10:40 | |
| jpich | AJaeger: FYI we'll be tracking this at https://bugs.launchpad.net/tripleo/+bug/1681402 , honza on the tripleo-ui team seems to have ideas :) | 10:44 |
| openstack | Launchpad bug 1681402 in tripleo "Translation jobs broken: EntryModuleNotFoundError: Entry module not found: Error: Can't resolve 'babel' " [High,Triaged] | 10:44 |
| AJaeger | jpich: thanks | 10:45 |
| *** jkilpatr has quit IRC | 10:47 | |
| *** ociuhandu has joined #openstack-infra | 10:55 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing TLS everywhere for coalesce fix https://review.openstack.org/455247 | 10:56 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing TLS everywhere for duplication fix https://review.openstack.org/455248 | 10:56 |
| *** ym200 has joined #openstack-infra | 10:58 | |
| *** rhallisey has joined #openstack-infra | 10:58 | |
| dirk | cmurphy: approve this? https://review.openstack.org/#/c/438877/ | 11:01 |
| *** ym200 has quit IRC | 11:02 | |
| cmurphy | dirk: done | 11:03 |
| *** jtomasek_ has joined #openstack-infra | 11:03 | |
| *** sdague_ has joined #openstack-infra | 11:04 | |
| dirk | cmurphy: thanks! :) | 11:05 |
| *** ZZelle_ has quit IRC | 11:06 | |
| *** shardy is now known as shardy_lunch | 11:06 | |
| *** jamesdenton has joined #openstack-infra | 11:06 | |
| openstackgerrit | Merged openstack-infra/puppet-jenkins master: Add Suse family support to jenkins puppet module https://review.openstack.org/438877 | 11:09 |
| *** adarazs is now known as adarazs_lunch | 11:09 | |
| *** nadya has quit IRC | 11:10 | |
| *** esberglu has joined #openstack-infra | 11:11 | |
| *** jamesdenton has quit IRC | 11:12 | |
| *** mat128 has joined #openstack-infra | 11:13 | |
| *** sshnaidm|afk has joined #openstack-infra | 11:14 | |
| *** sshnaidm|afk is now known as sshnaidm|pto | 11:14 | |
| *** lucasagomes is now known as lucas-hungry | 11:15 | |
| *** ZZelle has joined #openstack-infra | 11:15 | |
| *** jkilpatr has joined #openstack-infra | 11:15 | |
| *** thorst has joined #openstack-infra | 11:15 | |
| *** ZZelle is now known as Guest85867 | 11:16 | |
| *** esberglu has quit IRC | 11:16 | |
| *** ym200 has joined #openstack-infra | 11:18 | |
| *** thorst has quit IRC | 11:20 | |
| *** ym200 has quit IRC | 11:22 | |
| *** mat128 has quit IRC | 11:24 | |
| *** mat128 has joined #openstack-infra | 11:24 | |
| *** jamielennox|away is now known as jamielennox | 11:25 | |
| *** Hal has quit IRC | 11:28 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:28 | |
| *** nadya has joined #openstack-infra | 11:35 | |
| *** florianf has quit IRC | 11:37 | |
| *** Guest70770 is now known as rook | 11:39 | |
| *** florianf has joined #openstack-infra | 11:44 | |
| *** EricGonczer_ has joined #openstack-infra | 11:46 | |
| *** mtanino has joined #openstack-infra | 11:51 | |
| openstackgerrit | Tom Barron proposed openstack-infra/project-config master: Add experimental manila cephfs CentOS jobs https://review.openstack.org/453910 | 11:51 |
| *** dizquierdo has joined #openstack-infra | 11:52 | |
| fungi | infra-root: i'm about to head out to catch a flight, but the stale pypi mirror issue mentioned in scrollback appears to be vos release failing for that volume do to an existing (stale?) lockfile | 11:54 |
| fungi | also, reminder, i'm not really around this week | 11:54 |
| mordred | fungi: cool - thanks | 11:55 |
| *** thorst has joined #openstack-infra | 11:55 | |
| mordred | fungi: oh - and I believe that stalelock file is me :) | 11:55 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move puppet service disablement to o_p::server https://review.openstack.org/455016 | 11:56 |
| mordred | fungi: oh - nevermind- no, that shouldn't be me | 11:57 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move puppet service disablement to o_p::server https://review.openstack.org/455016 | 11:58 |
| *** kzaitsev_mb has quit IRC | 12:00 | |
| *** pradk has joined #openstack-infra | 12:01 | |
| *** dprince has joined #openstack-infra | 12:01 | |
| *** ldnunes has joined #openstack-infra | 12:02 | |
| *** esberglu has joined #openstack-infra | 12:06 | |
| *** ym200 has joined #openstack-infra | 12:06 | |
| mordred | infra-root: I'm working on trying to get the pypi sitch back up and going | 12:06 |
| *** alexchadin has quit IRC | 12:07 | |
| *** shardy_lunch is now known as shardy | 12:07 | |
| *** alexchadin has joined #openstack-infra | 12:07 | |
| *** alexchadin has quit IRC | 12:08 | |
| *** alexchadin has joined #openstack-infra | 12:08 | |
| *** rlandy has joined #openstack-infra | 12:08 | |
| *** alexchadin has joined #openstack-infra | 12:09 | |
| *** alexchadin has quit IRC | 12:09 | |
| *** markvoelker has quit IRC | 12:10 | |
| *** alexchadin has joined #openstack-infra | 12:10 | |
| *** alexchadin has quit IRC | 12:10 | |
| *** esberglu has quit IRC | 12:10 | |
| *** ym200 has quit IRC | 12:10 | |
| *** alexchadin has joined #openstack-infra | 12:11 | |
| *** ym200 has joined #openstack-infra | 12:11 | |
| *** alexchadin has quit IRC | 12:11 | |
| *** esikachev has quit IRC | 12:11 | |
| *** alexchadin has joined #openstack-infra | 12:11 | |
| *** alexchadin has quit IRC | 12:12 | |
| *** stuxnet78 has joined #openstack-infra | 12:12 | |
| *** lucas-hungry is now known as lucasagomes | 12:12 | |
| *** alexchadin has joined #openstack-infra | 12:12 | |
| *** alexchadin has quit IRC | 12:12 | |
| *** alexchadin has joined #openstack-infra | 12:13 | |
| *** ym200 has quit IRC | 12:15 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use infra's docker registry mirror https://review.openstack.org/455221 | 12:17 |
| *** alexchadin has quit IRC | 12:17 | |
| *** ccamacho is now known as ccamacho|lunch | 12:19 | |
| *** ym200 has joined #openstack-infra | 12:23 | |
| *** markvoelker has joined #openstack-infra | 12:25 | |
| *** zhurong has quit IRC | 12:26 | |
| *** pgadiya has quit IRC | 12:26 | |
| *** trown|outtypewww is now known as trown | 12:27 | |
| *** ym200 has quit IRC | 12:27 | |
| *** gouthamr has joined #openstack-infra | 12:28 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Remove puppet pinning logic https://review.openstack.org/455017 | 12:28 |
| *** jcoufal has joined #openstack-infra | 12:29 | |
| *** ym200 has joined #openstack-infra | 12:30 | |
| *** florianf has quit IRC | 12:31 | |
| *** mdrabe has joined #openstack-infra | 12:31 | |
| *** stuxnet78 has quit IRC | 12:32 | |
| *** Hal has joined #openstack-infra | 12:33 | |
| *** krtaylor has quit IRC | 12:34 | |
| *** ym200 has quit IRC | 12:34 | |
| *** mriedem has joined #openstack-infra | 12:35 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul feature/zuulv3: Put test id in zk chroot path https://review.openstack.org/454925 | 12:36 |
| *** adarazs_lunch is now known as adarazs | 12:36 | |
| *** krtaylor has joined #openstack-infra | 12:36 | |
| *** kgiusti has joined #openstack-infra | 12:39 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Remove puppet pinning logic https://review.openstack.org/455017 | 12:40 |
| openstackgerrit | Chhavi Agarwal proposed openstack/diskimage-builder master: WIP: Enabling DIB for RHEL7 PPC64le https://review.openstack.org/453803 | 12:41 |
| *** patriciadomin has quit IRC | 12:44 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing TLS everywhere for etcd https://review.openstack.org/455309 | 12:45 |
| *** patriciadomin has joined #openstack-infra | 12:45 | |
| *** florianf has joined #openstack-infra | 12:46 | |
| *** gcb has joined #openstack-infra | 12:50 | |
| *** alexchadin has joined #openstack-infra | 12:51 | |
| AJaeger | fungi: safe travels! | 12:53 |
| *** xyang1 has joined #openstack-infra | 12:58 | |
| *** nadya has quit IRC | 12:58 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Don't run extra server info on every server in list https://review.openstack.org/454382 | 12:59 |
| *** vikrant has quit IRC | 13:00 | |
| *** nadya has joined #openstack-infra | 13:00 | |
| *** skelso has joined #openstack-infra | 13:00 | |
| *** Goneri has joined #openstack-infra | 13:00 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Run unitests twice to see if this is possible https://review.openstack.org/454931 | 13:01 |
| *** Julien-zte has joined #openstack-infra | 13:05 | |
| pabelanger | morning | 13:06 |
| *** Julien-zte has quit IRC | 13:07 | |
| *** dtantsur is now known as dtantsur|brb | 13:07 | |
| *** Julien-zte has joined #openstack-infra | 13:07 | |
| *** EricGonczer_ has quit IRC | 13:10 | |
| mordred | morning mr pabelanger ! | 13:11 |
| mordred | pabelanger: so - I think we're in one of those weird vos release places and I'm not sure what to do next or how to troubleshoot further | 13:11 |
| mordred | pabelanger: I'm hoping you have the magic unicorn sauce | 13:11 |
| openstackgerrit | Merged openstack-infra/project-config master: [rally]Move cinder and heat scenario jobs out non-voting https://review.openstack.org/451339 | 13:12 |
| *** Julien-zte has quit IRC | 13:13 | |
| *** Julien-zte has joined #openstack-infra | 13:13 | |
| pabelanger | mordred: just a waiting game now? | 13:13 |
| mordred | pabelanger: well - I'm not sure nor do I know how to verify that | 13:14 |
| *** tonytan4ever has joined #openstack-infra | 13:14 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Document RETRY_LIMIT https://review.openstack.org/455059 | 13:14 |
| *** rhallisey has quit IRC | 13:14 | |
| mordred | pabelanger: there was a stale lock left over from a failed release (a release a couple of days ago hit an auth issue I'm guessing related to a timeout or something) | 13:14 |
| mordred | pabelanger: so I removed that lock, then started another release with -localauth | 13:15 |
| pabelanger | mordred: we're currently pushng 300Mbit on afs01.dfw.o.o atm | 13:15 |
| pabelanger | let me check logs | 13:15 |
| mordred | cool | 13:15 |
| pabelanger | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2362&rra_id=all | 13:15 |
| *** claudiub has joined #openstack-infra | 13:15 | |
| *** rhallisey has joined #openstack-infra | 13:16 | |
| mordred | pabelanger: ok - cool - so the release may be actually running just fine and I should learn to be patient with commands that do not print things :) | 13:16 |
| *** rhallisey has quit IRC | 13:18 | |
| *** Julien-zte has quit IRC | 13:18 | |
| pabelanger | think we are recloning the volume | 13:18 |
| pabelanger | Mon Apr 10 13:00:01 2017 1 Volser: Clone: Recloning volume 536870991 to volume 536870992 | 13:18 |
| *** Julien-zte has joined #openstack-infra | 13:19 | |
| openstackgerrit | Merged openstack-infra/project-config master: Change acl for mistral-lib https://review.openstack.org/454391 | 13:20 |
| openstackgerrit | Merged openstack-infra/project-config master: Add openstack/enterprise-wg project https://review.openstack.org/454818 | 13:20 |
| openstackgerrit | Merged openstack-infra/project-config master: implement a builder for scenario jobs https://review.openstack.org/451302 | 13:20 |
| *** baoli has joined #openstack-infra | 13:20 | |
| mordred | pabelanger: ah! yah. I agree with you | 13:21 |
| mordred | pabelanger: at least we're not cloning it to chicago | 13:21 |
| *** zz_dimtruck is now known as dimtruck | 13:22 | |
| pabelanger | mordred: ya, I am not sure how to tell the stats of the clone. How much is done, and how much left | 13:22 |
| pabelanger | is the gate broken, or can we wait until RO volumes have updated? | 13:22 |
| *** dtardivel has joined #openstack-infra | 13:24 | |
| *** prad_ has joined #openstack-infra | 13:26 | |
| *** Julien-zte has quit IRC | 13:26 | |
| *** Guest85867 is now known as ZZelle_ | 13:26 | |
| *** eharney has joined #openstack-infra | 13:26 | |
| *** kzaitsev_mb has joined #openstack-infra | 13:26 | |
| *** ZZelle_ is now known as ZZelle | 13:26 | |
| *** Julien-zte has joined #openstack-infra | 13:26 | |
| *** bauwser is now known as bauzas | 13:27 | |
| mordred | pabelanger: I think there's just a stale package and the folks who reported it have a workaround | 13:28 |
| openstackgerrit | Merged openstack-infra/project-config master: sahara: mod-wsgi scenario job is added https://review.openstack.org/454083 | 13:28 |
| openstackgerrit | Merged openstack-infra/project-config master: Promote ironic check job for kolla-kubernetes https://review.openstack.org/454796 | 13:28 |
| openstackgerrit | Merged openstack-infra/project-config master: kolla: Test 4.0.0 images with service charts https://review.openstack.org/455170 | 13:28 |
| openstackgerrit | Merged openstack-infra/project-config master: Use local_conf in more places https://review.openstack.org/454635 | 13:28 |
| *** mtanino has quit IRC | 13:28 | |
| openstackgerrit | Merged openstack-infra/project-config master: New Iotronic Service components: https://review.openstack.org/453184 | 13:29 |
| openstackgerrit | Merged openstack-infra/project-config master: Upgrade gate-requirements-python34 to voting https://review.openstack.org/454775 | 13:29 |
| *** lewo has quit IRC | 13:30 | |
| *** lewo has joined #openstack-infra | 13:30 | |
| *** jianghuaw-m has joined #openstack-infra | 13:31 | |
| openstackgerrit | Andrey Kurilin proposed openstack-infra/project-config master: [rally] reuse neutron-unstable job for telemetry https://review.openstack.org/455321 | 13:31 |
| *** ym200 has joined #openstack-infra | 13:31 | |
| *** chlong has joined #openstack-infra | 13:31 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add experimental py35 gate for Barbican Tempest Testing https://review.openstack.org/454197 | 13:31 |
| *** ym200 has quit IRC | 13:31 | |
| *** openstackgerrit has quit IRC | 13:33 | |
| *** ym200 has joined #openstack-infra | 13:33 | |
| *** esberglu has joined #openstack-infra | 13:34 | |
| *** esberglu has quit IRC | 13:34 | |
| *** esberglu has joined #openstack-infra | 13:35 | |
| *** jianghuaw-m has quit IRC | 13:35 | |
| *** Julien-zte has quit IRC | 13:36 | |
| *** Julien-zte has joined #openstack-infra | 13:36 | |
| *** dimtruck is now known as zz_dimtruck | 13:39 | |
| *** Julien-zte has quit IRC | 13:41 | |
| *** esikachev has joined #openstack-infra | 13:42 | |
| *** Julien-zte has joined #openstack-infra | 13:42 | |
| *** jianghuaw-m has joined #openstack-infra | 13:42 | |
| *** jianghuaw-m has quit IRC | 13:44 | |
| *** felipemonteiro has joined #openstack-infra | 13:45 | |
| *** jcoufal_ has joined #openstack-infra | 13:46 | |
| *** IRCFrEAK has joined #openstack-infra | 13:47 | |
| *** openstackgerrit has joined #openstack-infra | 13:47 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove RDO AFS mirror https://review.openstack.org/455081 | 13:47 |
| *** IRCFrEAK has left #openstack-infra | 13:48 | |
| *** esikache1 has joined #openstack-infra | 13:48 | |
| *** jcoufal has quit IRC | 13:48 | |
| *** ccamacho|lunch is now known as ccamacho | 13:50 | |
| *** esikachev has quit IRC | 13:51 | |
| *** sdague has quit IRC | 13:52 | |
| *** baoli has quit IRC | 13:52 | |
| *** Julien-zte has quit IRC | 13:55 | |
| *** sdague has joined #openstack-infra | 13:56 | |
| *** sdague__ has joined #openstack-infra | 13:56 | |
| *** Julien-zte has joined #openstack-infra | 13:56 | |
| *** Goneri has quit IRC | 13:56 | |
| *** mat128 has quit IRC | 13:56 | |
| *** mat128 has joined #openstack-infra | 13:58 | |
| *** jcoufal has joined #openstack-infra | 13:58 | |
| *** Goneri has joined #openstack-infra | 13:59 | |
| *** prad_ has quit IRC | 13:59 | |
| *** prad_ has joined #openstack-infra | 13:59 | |
| *** jcoufal_ has quit IRC | 14:00 | |
| *** hongbin has joined #openstack-infra | 14:01 | |
| *** kzaitsev_mb has quit IRC | 14:01 | |
| *** cody-somerville has joined #openstack-infra | 14:01 | |
| *** cody-somerville has joined #openstack-infra | 14:01 | |
| *** askb has quit IRC | 14:01 | |
| *** srobert has joined #openstack-infra | 14:02 | |
| *** sekelso has joined #openstack-infra | 14:02 | |
| *** skelso has quit IRC | 14:02 | |
| *** rhallisey has joined #openstack-infra | 14:03 | |
| *** baoli has joined #openstack-infra | 14:03 | |
| *** dave-mccowan has joined #openstack-infra | 14:04 | |
| *** rbrndt has joined #openstack-infra | 14:06 | |
| *** prateek has quit IRC | 14:06 | |
| *** baoli has quit IRC | 14:08 | |
| *** sekelso has quit IRC | 14:09 | |
| *** dtantsur|brb is now known as dtantsur | 14:09 | |
| *** dave-mccowan has quit IRC | 14:09 | |
| *** sekelso has joined #openstack-infra | 14:09 | |
| *** ldnunes has quit IRC | 14:10 | |
| *** mptacekx has quit IRC | 14:11 | |
| *** baoli has joined #openstack-infra | 14:12 | |
| *** rhallisey has quit IRC | 14:12 | |
| *** sdague has quit IRC | 14:12 | |
| *** sdague__ is now known as sdague | 14:13 | |
| *** rhallisey has joined #openstack-infra | 14:13 | |
| *** Julien-zte has quit IRC | 14:14 | |
| *** Julien-zte has joined #openstack-infra | 14:15 | |
| *** gordc has joined #openstack-infra | 14:15 | |
| *** zz_dimtruck is now known as dimtruck | 14:15 | |
| *** sekelso has quit IRC | 14:15 | |
| *** mtanino has joined #openstack-infra | 14:16 | |
| *** tosky has quit IRC | 14:16 | |
| *** Julien-zte has quit IRC | 14:17 | |
| *** Julien-zte has joined #openstack-infra | 14:17 | |
| *** esikache1 has quit IRC | 14:19 | |
| *** Julien-zte has quit IRC | 14:20 | |
| *** Julien-zte has joined #openstack-infra | 14:21 | |
| *** ldnunes has joined #openstack-infra | 14:21 | |
| *** smarcet has joined #openstack-infra | 14:23 | |
| *** rkukura has joined #openstack-infra | 14:27 | |
| *** ihrachys has joined #openstack-infra | 14:27 | |
| *** markus_z has quit IRC | 14:28 | |
| *** Julien-zte has quit IRC | 14:28 | |
| *** Julien-zte has joined #openstack-infra | 14:29 | |
| *** ihrachys has quit IRC | 14:30 | |
| *** ihrachys has joined #openstack-infra | 14:30 | |
| *** rossella_s has quit IRC | 14:33 | |
| *** rossella_s has joined #openstack-infra | 14:34 | |
| *** Julien-zte has quit IRC | 14:35 | |
| *** winggundamth_ has quit IRC | 14:36 | |
| *** Julien-zte has joined #openstack-infra | 14:37 | |
| *** tosky has joined #openstack-infra | 14:43 | |
| *** Julien-zte has quit IRC | 14:47 | |
| *** Julien-zte has joined #openstack-infra | 14:48 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Tunning IDP https://review.openstack.org/455349 | 14:51 |
| openstackgerrit | Merged openstack-infra/shade master: Don't run extra server info on every server in list https://review.openstack.org/454382 | 14:51 |
| *** baoli has quit IRC | 14:51 | |
| *** armax has joined #openstack-infra | 14:52 | |
| *** xarses has joined #openstack-infra | 14:55 | |
| *** fverboso has left #openstack-infra | 14:55 | |
| *** andreww has joined #openstack-infra | 14:56 | |
| *** scottda has joined #openstack-infra | 14:57 | |
| *** xarses has quit IRC | 14:59 | |
| openstackgerrit | Merged openstack-infra/openstackid master: Tunning IDP https://review.openstack.org/455349 | 14:59 |
| *** dtantsur is now known as dtantsur|brb | 14:59 | |
| *** yamahata has quit IRC | 15:00 | |
| *** yamahata has joined #openstack-infra | 15:00 | |
| *** rcernin has quit IRC | 15:03 | |
| pabelanger | clarkb: mordred: I'm ready to help monitor the stack that cmurphy is working on, if we want to +3 https://review.openstack.org/#/c/449957 | 15:04 |
| pabelanger | this is for unpuppet-zuul-workers | 15:04 |
| *** baoli has joined #openstack-infra | 15:04 | |
| *** nadya has quit IRC | 15:06 | |
| mnaser | have folks noticed issues with rdo mirors returning 403? | 15:06 |
| mnaser | https://trunk.rdoproject.org/centos7/af/f5/aff5d8f30d73cf34e9a52a0b070143f128e37e79_57e4b623/python2-ceilometerclient-2.8.0-0.20170206121840.658d7e2.el7.centos.noarch.rpm: [Errno 14] HTTPS Error 403 - Forbidden | 15:06 |
| mnaser | its giving a 403 right now too | 15:06 |
| clarkb | pabelanger: I'm able to help too if necessary. Currently cleaning up the cloud archive change for devstdack | 15:06 |
| pabelanger | mnaser: where did we see that error? | 15:07 |
| mnaser | pabelanger kolla gate - http://logs.openstack.org/65/449965/8/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/87fdc5c/logs/build/openstack-base.txt.gz | 15:07 |
| pabelanger | mnaser: also, that isn't a mirror. that is rdoproject.org | 15:07 |
| pabelanger | mnaser: mirror.regionone.infracloud-vanilla.openstack.org:8080/rdo/centos7/ is our RDO proxy | 15:07 |
| mnaser | pabelanger yeah, i was just wondering if other people encountered similar failures (or if i was alone in it) | 15:07 |
| mnaser | i'll try to follow up with people at #rdo cause im not sure why its 403-ing | 15:08 |
| *** hashar is now known as hasharAway | 15:08 | |
| pabelanger | mnaser: source /etc/ci/mirror_info.sh | 15:08 |
| pabelanger | echo $NODEPOOL_RDO_PROXY | 15:08 |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n55 | 15:08 |
| pabelanger | you can use that in kolla jobs | 15:09 |
| frickler | mordred: have you finished sending out R voting in the meantime or did it get delayed somehow? | 15:09 |
| mnaser | pabelanger ill switch to it | 15:09 |
| mnaser | frickler i got mine yesterday so i think its taking a while | 15:09 |
| *** Julien-zte has quit IRC | 15:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set PermitRootLogin for sshd_config https://review.openstack.org/454918 | 15:09 |
| clarkb | mnaser: pabelanger that said switching to our proxy cache shouldn't change the 403 to a 200 | 15:10 |
| *** alexchadin has quit IRC | 15:10 | |
| clarkb | mnaser: pabelanger we will just proxy and cache the 403 | 15:10 |
| frickler | o.k., so the estimate of 6h was too optimistic | 15:10 |
| *** dharinic has joined #openstack-infra | 15:10 | |
| *** Julien-zte has joined #openstack-infra | 15:10 | |
| mnaser | yeah that's what im saying.. i know its not in your control but maybe it was a "common issue" that's been spotted | 15:10 |
| *** dosaboy has quit IRC | 15:10 | |
| *** nadya has joined #openstack-infra | 15:10 | |
| *** baoli has quit IRC | 15:10 | |
| *** nadya has quit IRC | 15:10 | |
| pabelanger | mnaser: clarkb: true, but if we cached it, I think'd we server it? | 15:11 |
| pabelanger | serve* | 15:11 |
| mordred | frickler: it's taking a long time - and yes, the 6h estimate was WAY too optimistic | 15:11 |
| mnaser | pabelanger cache things before they break them :D | 15:12 |
| *** Hal has quit IRC | 15:12 | |
| mnaser | (brb) | 15:12 |
| mordred | frickler: we're to "P" last names | 15:12 |
| clarkb | pabelanger: right but the server is serving a 403 so that is what we would cache | 15:12 |
| clarkb | (this is why a proxy cache is less good than a proper mirror, we are still at the mercy of the backend server rather than running it ourselves) | 15:13 |
| pabelanger | clarkb: ah, I was assuming we had it cached already. Or are you saying, the 403 would overwrite out cached version? | 15:13 |
| *** prad_ has quit IRC | 15:13 | |
| frickler | mordred: o.k., so might be another couple of days until done. for when is the end of the vote scheduled? | 15:14 |
| mordred | if the first access is 403, that's what we would cache - although one could argue that we should tell the proxy to not cache errors | 15:14 |
| mordred | frickler: well, it WAS going to be this week - but that was based on being able to send all of the balots out quickly. at this point, I believe I'll keep it open for a week after all the ballots go out | 15:14 |
| frickler | mordred: right, that was what I was thinking, in particular with the next weekend being a holiday in some places | 15:15 |
| mordred | frickler: yup | 15:15 |
| mordred | frickler: totally agree | 15:16 |
| clarkb | pabelanger: I'm assuming that if we had cached the rpm and it did 200 at one point that soon enough we would cache the 403 as thats current | 15:16 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder master: scm: introduce parent-credentials for git submodules https://review.openstack.org/452280 | 15:16 |
| clarkb | The response must have a HTTP status code of 200, 203, 300, 301 or 410. <- ok good we don't cache errors at all | 15:17 |
| clarkb | well 410 we do | 15:17 |
| pabelanger | k | 15:17 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Server params tweaking https://review.openstack.org/455358 | 15:19 |
| *** wolverineav has joined #openstack-infra | 15:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set PermitRootLogin for sshd_config https://review.openstack.org/454918 | 15:19 |
| pabelanger | clarkb: AJaeger: okay, fixed sshd_config change^ | 15:20 |
| openstackgerrit | Merged openstack-infra/system-config master: Use openstack_project::server class where possible https://review.openstack.org/449957 | 15:21 |
| openstackgerrit | Merged openstack-infra/system-config master: Remove thick_slave from single_use_slave https://review.openstack.org/449958 | 15:22 |
| mordred | clarkb: woot | 15:22 |
| *** dosaboy has joined #openstack-infra | 15:23 | |
| mordred | clarkb: yah - and caching 410 seems sane | 15:23 |
| *** prad_ has joined #openstack-infra | 15:23 | |
| *** esberglu has quit IRC | 15:25 | |
| *** esberglu has joined #openstack-infra | 15:25 | |
| pabelanger | clarkb: mordred: https://review.openstack.org/449960 and https://review.openstack.org/449959 refactor puppet code from DIB too. Copypasta from template.pp to server.pp. DIB changes are already landed and working | 15:25 |
| *** esberglu has quit IRC | 15:27 | |
| *** kzaitsev_mb has joined #openstack-infra | 15:27 | |
| *** aarefiev is now known as aarefiev_afk | 15:27 | |
| *** esikache1 has joined #openstack-infra | 15:31 | |
| mordred | pabelanger: ++ | 15:33 |
| clarkb | pabelanger: cmurphy left a note on https://review.openstack.org/#/c/449959/7 of something to keep an eye on. But not too worried about it | 15:35 |
| AJaeger | clarkb, mordred : Both of you +2ed pabelanger's change, any of you wants to +A? | 15:35 |
| *** thorst is now known as thorst_afk | 15:35 | |
| *** ym200 has quit IRC | 15:36 | |
| clarkb | AJaeger: this one https://review.openstack.org/#/c/449960/9 ? I can +! | 15:36 |
| clarkb | er +A | 15:36 |
| AJaeger | clarkb: I meant both https://review.openstack.org/449960 and https://review.openstack.org/449959 | 15:37 |
| *** ym200 has joined #openstack-infra | 15:37 | |
| clarkb | AJaeger: the first one is approved | 15:37 |
| clarkb | so I think we are good | 15:38 |
| *** cshastri has quit IRC | 15:38 | |
| openstackgerrit | Merged openstack-infra/system-config master: Move sources.list purging into o_p::server https://review.openstack.org/449959 | 15:38 |
| AJaeger | clarkb: yes, we're good now. Thanks | 15:38 |
| *** baoli has joined #openstack-infra | 15:40 | |
| *** prad_ has quit IRC | 15:41 | |
| *** makowals_ has joined #openstack-infra | 15:41 | |
| *** mat128 has quit IRC | 15:42 | |
| *** Julien-zte has quit IRC | 15:43 | |
| *** mat128 has joined #openstack-infra | 15:43 | |
| *** Julien-zte has joined #openstack-infra | 15:43 | |
| *** makowals has quit IRC | 15:43 | |
| openstackgerrit | Merged openstack-infra/system-config master: Move package resources to o_p::server https://review.openstack.org/449960 | 15:45 |
| openstackgerrit | Merged openstack-infra/system-config master: Move NTP management into openstack_project::server https://review.openstack.org/450972 | 15:45 |
| openstackgerrit | Merged openstack-infra/system-config master: Move unbound to openstack_project::server https://review.openstack.org/452979 | 15:45 |
| *** jpich has quit IRC | 15:45 | |
| pabelanger | clarkb: mordred: https://review.openstack.org/#/c/455004/ adds some logic to install_puppet.sh to skip setting up pip. If you don't mind reviewing. We can now do this since we are using the dib element for pip and virtualenv | 15:47 |
| *** ym200 has quit IRC | 15:48 | |
| *** psachin has quit IRC | 15:48 | |
| *** ccamacho is now known as ccamacho|brb | 15:51 | |
| *** ym200 has joined #openstack-infra | 15:53 | |
| *** dtantsur|brb is now known as dtantsur | 15:53 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove snmpd from zuul workers https://review.openstack.org/454915 | 15:54 |
| mnaser | pabelanger im doing the cache thing for kolla now, is buildlogs.centos.org also cached? | 15:54 |
| *** cody-somerville has quit IRC | 15:54 | |
| mnaser | https://trunk.rdoproject.org/centos7/delorean-deps.repo is something we pull in and it has baseurl=https://buildlogs.centos.org/centos/7/cloud/$basearch/openstack-pike/ | 15:54 |
| pabelanger | mnaser: no, we don't current proxy buildlogs.centos.org. We likely can, but we need to keep an eye on our locall mirror HDD usage atm | 15:55 |
| mnaser | okay cool, just wanted to double check | 15:55 |
| *** Julien-zte has quit IRC | 15:56 | |
| *** nadya has joined #openstack-infra | 15:56 | |
| clarkb | openstack-manuals is huge | 15:56 |
| pabelanger | mnaser: might want to double check with rdo folks, I am not sure when contents go to buildlog | 15:56 |
| *** ym200 has quit IRC | 15:56 | |
| mnaser | will do so | 15:57 |
| pabelanger | mnaser: however, I imagine once we come up with a long term plan for mirrors HDDs, we'll be able to proxy it | 15:57 |
| *** ym200 has joined #openstack-infra | 15:57 | |
| mnaser | im just making changes on what is already in place to test it out (also, using /etc/ci/mirror_info.sh rather than us doing it in our gate) | 15:57 |
| mnaser | doing the docker mirror too | 15:57 |
| clarkb | pabelanger: we may be able to split the afs cache into afs and apache caches | 15:57 |
| *** Julien-zte has joined #openstack-infra | 15:58 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add the ability to disable setup_pip function https://review.openstack.org/455004 | 15:58 |
| AJaeger | clarkb: openstack-manuals history is large | 15:58 |
| pabelanger | clarkb: Cool! | 15:58 |
| *** Julien-zte has quit IRC | 15:58 | |
| *** Apoorva has joined #openstack-infra | 15:58 | |
| pabelanger | mnaser: yes, let me know when you have docker registry proxy going, I'd like to monitor our apache logs | 15:59 |
| AJaeger | clarkb: 475 MB checked out - including 420MB for .git on my disk | 15:59 |
| *** Apoorva has quit IRC | 15:59 | |
| *** marst has joined #openstack-infra | 15:59 | |
| clarkb | AJaeger: ya, I was just surprised at how long it took to clone it | 15:59 |
| *** Apoorva has joined #openstack-infra | 15:59 | |
| *** yonglihe has quit IRC | 15:59 | |
| pabelanger | clarkb: mordred: Thanks for setup_pip change, https://review.openstack.org/#/c/455005/ is for DIB now | 16:00 |
| pabelanger | :) | 16:01 |
| AJaeger | clarkb: yeah, some errors done in the past ;( | 16:01 |
| *** dizquierdo has quit IRC | 16:01 | |
| *** kzaitsev_mb has quit IRC | 16:02 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: [WIP] add containerized deployment on multinode https://review.openstack.org/454152 | 16:02 |
| openstackgerrit | Nam Nguyen Hoai proposed openstack-infra/project-config master: Delete running tempest with all plugins https://review.openstack.org/455207 | 16:05 |
| *** lucasagomes is now known as lucas-afk | 16:05 | |
| *** martinkopec has quit IRC | 16:06 | |
| *** andreas_s has quit IRC | 16:07 | |
| pabelanger | clarkb: also, maybe when ianw is online tonight, we can discuss removing SSH keys again from workers. Add see how to our keys into glean root user | 16:09 |
| *** Zhongjun__ has joined #openstack-infra | 16:11 | |
| clarkb | ya I think step 0 in that is getting our pubkeys into all the cloud regions under a name like infra-root-keys | 16:11 |
| *** jokke__ has joined #openstack-infra | 16:11 | |
| *** jokke__ has quit IRC | 16:11 | |
| clarkb | but the nodepool change to specify a nova keyname per label should be pretty straightforward | 16:12 |
| mnaser | pabelanger - https://review.openstack.org/455374 - the first, docker mirror is a bit more complicated because its multinode (unless /etc/ci/mirror_info.sh is also present on those sub nodes, then that should be easy) | 16:12 |
| pabelanger | clarkb: I think we discussed cloud-launcher for adding the keys to clouds | 16:12 |
| pabelanger | I can poke at that today | 16:12 |
| pabelanger | mnaser: should be on subnodes | 16:13 |
| pabelanger | I believe we run ready_script on them too | 16:13 |
| mnaser | oh cool, let me do a patch for that too then | 16:13 |
| clarkb | ya I think we have to in order to get the firewall rules set up and the ssh keys in place | 16:13 |
| *** gyee has joined #openstack-infra | 16:14 | |
| *** nadya has quit IRC | 16:14 | |
| mordred | clarkb, pabelanger: so - what if we just moved user creation and key management to ansible instead of removing our users from the images/ | 16:17 |
| mordred | ? | 16:17 |
| clarkb | mordred: I'm not sure I udnerstand? | 16:18 |
| clarkb | IMO moving from pupept to ansible is the same issue | 16:18 |
| mordred | it's not | 16:18 |
| clarkb | you don't actually fix the underlying problem | 16:18 |
| clarkb | whcih is that you lose out on all of the dib element goodness | 16:18 |
| mordred | clarkb: we remove our user accounts from puppet completely. we make an ansible role that installs our user accounts. we run that ansible role for our long-lived servers as part of the ansible run we already do, and we run the ansible role as part ofour dib run | 16:19 |
| clarkb | (and secondarily having our users baked in has meant that reconsuming of our images is harder for other people because we have easy mode and haven't had to make normal mode useable) | 16:19 |
| clarkb | mordred: right but that doesn't fix the problem in dib | 16:19 |
| mordred | clarkb: I do not agree there is any dib goodness that is relevant here - but I do agree that the reconsuming case is valid, so I'll just go with that | 16:19 |
| clarkb | mordred: which is that by turning config management into the interface isntead of dib itself it creates problems | 16:19 |
| mordred | fair | 16:20 |
| *** dprince has quit IRC | 16:20 | |
| clarkb | (and I think thats an issue if you use pupept or ansible or whatever). If we want to have an element that creates our users thats fine (and it can use puppet or ansible) but the problem we have today is there is this giant monolithic make image step all in a single executable outside of the dib tooling | 16:20 |
| mordred | clarkb: I can poke at the nodepool change to do the keypair thing if you like | 16:20 |
| clarkb | mordred: sure. And the reason I came up with keypair idea was old plan was to just remove our users but ianw didn't like the idea of needing to jump through another host using a shared user that may not have root depending on when you ssh | 16:21 |
| *** tmorin has quit IRC | 16:22 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/project-config master: Add heat-agents to tripleo cloned list https://review.openstack.org/455379 | 16:22 |
| mordred | clarkb: yah - also, just using keypair makes the re-consume approach really straight forward | 16:22 |
| clarkb | and this way we have to use our images like anyone else would which should hopefully make that process more pleasant for everyone (speaking of still need to document config drive / make tool to make config drive) | 16:22 |
| mordred | "boot this image with this keypair" is a pretty normal workflow | 16:22 |
| mordred | if people boot the image in a differnt cloud | 16:23 |
| clarkb | mostly thinking of the local boot case, cloud should be easy | 16:24 |
| clarkb | another idea may be to push dibs ability to modify images a bit more | 16:25 |
| clarkb | seems like its a common misconception that you can't update images with dib. Possibly because its not directly exposed, but an element that is run scripts over here in image over there then repack image might be helpful | 16:26 |
| *** nadya has joined #openstack-infra | 16:27 | |
| *** knangia has joined #openstack-infra | 16:29 | |
| *** nadya has quit IRC | 16:29 | |
| *** skelso has joined #openstack-infra | 16:32 | |
| *** flepied has quit IRC | 16:33 | |
| v1k0d3n | hello everyone | 16:33 |
| v1k0d3n | i've put a -1 workflow on a project that we needed to clean up a bit before importing into openstack, and now that we've done so...i was wondering if someone could guide me a little on the best way to have things imported "as is" in github. | 16:34 |
| *** tonytan4ever has quit IRC | 16:35 | |
| clarkb | v1k0d3n: our import tool should do its best to import it as is already. So once you are happy with the repo state let us know and the project can be created in gerrit and imported | 16:36 |
| mordred | clarkb: yah - I think exposing an end-user-easy flow to do image editing would be awesome | 16:37 |
| v1k0d3n | clarkb: that would be amazing | 16:37 |
| v1k0d3n | so all i need to do is add upstream here? here's the PS https://review.openstack.org/#/c/439159/ | 16:38 |
| *** nadya has joined #openstack-infra | 16:38 | |
| clarkb | v1k0d3n: yes in https://review.openstack.org/#/c/439159/4/gerrit/projects.yaml | 16:39 |
| v1k0d3n | clarkb: perfect! man, thank you so much. | 16:39 |
| clarkb | v1k0d3n: also keep in mind once you have created the project in gerrit you should stop using the github upstream as they will not be synced in the future | 16:39 |
| v1k0d3n | do you know how long it would take, once i've done everything correctly? could you guys help with eyes on it (barring any issues)? | 16:40 |
| clarkb | v1k0d3n: basically once gerrit project exists it should be treated as the canonical repo location | 16:40 |
| v1k0d3n | right! most definitely. | 16:40 |
| *** prad_ has joined #openstack-infra | 16:40 | |
| *** john-davidge has quit IRC | 16:44 | |
| *** john-dav_ has joined #openstack-infra | 16:44 | |
| *** aNuposic has left #openstack-infra | 16:44 | |
| *** nadya_ has joined #openstack-infra | 16:45 | |
| *** mat128 has quit IRC | 16:46 | |
| *** nadya has quit IRC | 16:47 | |
| *** nadya has joined #openstack-infra | 16:48 | |
| *** dprince has joined #openstack-infra | 16:48 | |
| *** jaosorior is now known as jaosorior_away | 16:51 | |
| *** nadya_ has quit IRC | 16:51 | |
| *** prad_ has quit IRC | 16:52 | |
| *** tesseract has quit IRC | 16:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add SSH public key for pabelaner to cloud-launcher https://review.openstack.org/455388 | 16:53 |
| pabelanger | clarkb: mordred: ^should be out first step | 16:54 |
| clarkb | pabelanger: I think rather than a single pabelanger key (though we can do that too) we want a "key" with all our keys in it called infra-root-keys | 16:55 |
| clarkb | iirc you can do that as nova just splats the data into metadata and glean/cloudinit will just append to authorized_keys so it doesn't have to be 1:1 nova key to actual key | 16:56 |
| pabelanger | clarkb: ah, wasn't sure if we'd group them on nodepool side | 16:56 |
| smarcet | fungi: clarkb: afternoon, when i have some free time, please review https://review.openstack.org/#/c/455358/ thx :) | 16:56 |
| clarkb | we probably can, but I'm not actually sure how glean will handle a ton of keys | 16:56 |
| pabelanger | ack | 16:57 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add SSH public key for pabelaner to cloud-launcher https://review.openstack.org/455388 | 16:57 |
| pabelanger | changed | 16:57 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Create infra-root-keys and add pabelanger public key https://review.openstack.org/455388 | 16:58 |
| *** ramishra has quit IRC | 16:58 | |
| *** rossella_s has quit IRC | 16:59 | |
| clarkb | smarcet: looking at https://review.openstack.org/#/c/455358/1/manifests/init.pp do we really expect 100k new connections all at once? | 17:00 |
| *** tonytan4ever has joined #openstack-infra | 17:00 | |
| smarcet | clarkb: ups sorry | 17:00 |
| smarcet | let me fix it | 17:00 |
| clarkb | smarcet: but also, we have working ipv6 there too | 17:00 |
| smarcet | thx for spotting that | 17:00 |
| clarkb | smarcet: so you might want to consider tuning ipv6 | 17:00 |
| *** derekh has quit IRC | 17:00 | |
| smarcet | clarkb: ok thx for the info :) | 17:00 |
| *** electrofelix has quit IRC | 17:01 | |
| *** john-dav_ is now known as john-davidge | 17:02 | |
| pabelanger | clarkb: mind +3 on https://review.openstack.org/#/c/454918/ | 17:03 |
| pabelanger | allow root for sshd_config in dib | 17:04 |
| *** flepied has joined #openstack-infra | 17:05 | |
| clarkb | pabelanger: was that the only difference in the sshd configs? also I need to go read the dib docs and find out if finalise.d runs in the chroot or out of chroot :) | 17:06 |
| clarkb | pabelanger: according to the dib docs we should use post-install.d not finalise.d for that | 17:07 |
| openstackgerrit | Brandon B. Jozsa proposed openstack-infra/project-config master: New project - OpenStack-Helm https://review.openstack.org/439159 | 17:07 |
| clarkb | only fs metadata and the image itself should be modified in finalise.d apparently | 17:07 |
| v1k0d3n | hey clarkb and team: https://review.openstack.org/#/c/439159/ | 17:08 |
| v1k0d3n | oh you guys already saw that. sorry for the repeat. :-/ | 17:09 |
| *** amotoki has quit IRC | 17:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Set PermitRootLogin for sshd_config https://review.openstack.org/454918 | 17:12 |
| *** mat128 has joined #openstack-infra | 17:13 | |
| pabelanger | clarkb: ^ that was the only change for sshd that I see, others were path issues for sftp, but we shouldn't need that since we are not using OS version of sshd file. | 17:13 |
| pabelanger | clarkb: however, until we land the patch to remove puppet-ssh from DIB, this should be a noop | 17:14 |
| pabelanger | but I did rebuild on friday and didn't have any issues | 17:14 |
| clarkb | pabelanger: ok, I left a -1 comment with a couple minor things just to try and avoid problems in future when we wonder what we were doing :) | 17:15 |
| pabelanger | clarkb: np, already fixed :) | 17:15 |
| clarkb | oh I see now | 17:15 |
| *** thorst_afk is now known as thorst | 17:16 | |
| clarkb | pabelanger: oh one last thing, that doesn't require sudo? I guess if you have tested it then it doesn't? | 17:16 |
| pabelanger | Hmm | 17:16 |
| *** jcoufal_ has joined #openstack-infra | 17:16 | |
| pabelanger | clarkb: should work as is, I believe we are root user inside chroot | 17:17 |
| *** jcoufal has quit IRC | 17:17 | |
| *** john-davidge has quit IRC | 17:20 | |
| *** srobert_ has joined #openstack-infra | 17:21 | |
| sm_ | :pabelanger: After I got access to Omni-core, I posted a sample review https://review.openstack.org/#/c/454913/. After approval from jenkins and other code reviewers, it is still stuck un-merged. | 17:21 |
| sm_ | Can you please tell me what's missing? | 17:22 |
| pabelanger | sm_: looking | 17:23 |
| *** srobert has quit IRC | 17:25 | |
| *** efoley_ has quit IRC | 17:27 | |
| *** kzaitsev_mb has joined #openstack-infra | 17:28 | |
| *** srobert_ has quit IRC | 17:30 | |
| *** jlk has quit IRC | 17:30 | |
| *** tosky has quit IRC | 17:30 | |
| *** jlk has joined #openstack-infra | 17:30 | |
| *** jlk has quit IRC | 17:31 | |
| *** jlk has joined #openstack-infra | 17:31 | |
| *** ralonsoh has quit IRC | 17:31 | |
| *** nadya has quit IRC | 17:32 | |
| pabelanger | sm_: +3 455401 | 17:32 |
| openstackgerrit | Kaitlin Farr proposed openstack-infra/project-config master: Change Barbican KMIP gate to voting https://review.openstack.org/455403 | 17:33 |
| pabelanger | sm_: okay, now try +3 on 454913 | 17:33 |
| *** nadya has joined #openstack-infra | 17:33 | |
| sm_ | :pabelanger: Thanks, trying it out | 17:34 |
| pabelanger | sm_: 455401 too | 17:35 |
| sm_ | :pabelanger: done | 17:37 |
| pabelanger | sm_: okay, you should be okay moving forward | 17:37 |
| *** rbrndt has quit IRC | 17:37 | |
| clarkb | what was problem? | 17:38 |
| sm_ | :pabelanger: thanks | 17:38 |
| pabelanger | clarkb: initial patchset was needs verify, even though jenkins +1. so, I rebased to help it along | 17:39 |
| *** ociuhandu has quit IRC | 17:39 | |
| clarkb | typically in that case you just need a core reviewer to reapprove | 17:39 |
| clarkb | speaking of. Zaro gerrit 2.13 should allow us to force the vote numbers in all event stream events right? | 17:43 |
| openstackgerrit | Brian Haley proposed openstack-infra/project-config master: Move DVR+HA multinode tempest job to check queue https://review.openstack.org/455406 | 17:44 |
| pabelanger | clarkb: mordred: k, ansible-role-cloud-launcher still working ! Just tested it out on bluebox with infra-root-key | 17:48 |
| *** apetrich has quit IRC | 17:48 | |
| pabelanger | is somebody poking at nodepool? | 17:49 |
| clarkb | I am not | 17:49 |
| * clarkb is on a code review binge today | 17:49 | |
| pabelanger | k | 17:49 |
| *** apetrich has joined #openstack-infra | 17:49 | |
| pabelanger | actually, let me finish up with some unpuppeting stuff | 17:49 |
| pabelanger | clarkb: https://review.openstack.org/#/c/455005/ mind adding it to your review pile | 17:50 |
| mtreinish | clarkb: if you're reviewing I've got a bunch of firehose patches up: https://review.openstack.org/#/q/status:open+topic:more-firehose :) | 17:50 |
| pabelanger | https://review.openstack.org/#/c/454918/ if you don't mind | 17:50 |
| *** mriedem1 has joined #openstack-infra | 17:50 | |
| *** mriedem has quit IRC | 17:51 | |
| zaro | clarkb: yes, it should https://gerrit-review.googlesource.com/#/c/76071/ | 17:52 |
| kevinbenton | hi, can i get some help figuring out why https://review.openstack.org/#/c/453110/ didn't trigger a jenkins run? I checked the regex here and it looks like it shouldn't be skipping the pep8 job https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L1550 | 17:53 |
| mordred | pabelanger: I'm about to do the nodepool change | 17:53 |
| pabelanger | mordred: yay | 17:54 |
| mordred | pabelanger: also - rookie mistake on my part ... | 17:54 |
| mordred | pabelanger: I didn't run the vos release in screen :( | 17:54 |
| pabelanger | :( | 17:55 |
| mordred | pabelanger: vos examine shows: | 17:55 |
| mordred | Volume is currently LOCKED | 17:55 |
| mordred | Volume is locked for a release operation | 17:55 |
| mordred | but I do not show vos release still running | 17:55 |
| mordred | pabelanger: but I think the command line util just blocks til the release is done - so it might still be running, right? | 17:55 |
| pabelanger | I think so, I mean, I see a lot of traffic coming out of afs01.dfw.o.o still | 17:56 |
| mordred | yah | 17:56 |
| mordred | me too | 17:56 |
| pabelanger | lets see what happens | 17:56 |
| mordred | k. let's just leave it alone until the net traffic drops - yah | 17:56 |
| pabelanger | ++ | 17:56 |
| * mordred blames monday | 17:56 | |
| pabelanger | Ya, I've done that before too | 17:56 |
| mordred | mnaser: the add-clouds-yaml-to-horizon patch landed woot! | 17:57 |
| mnaser | mordred nice! | 17:57 |
| *** nadya has quit IRC | 17:58 | |
| mordred | dtroyer: that might give you happy too | 17:59 |
| *** baoli has quit IRC | 17:59 | |
| *** sambetts is now known as sambetts|afk | 18:00 | |
| *** esberglu_ has joined #openstack-infra | 18:00 | |
| *** mriedem1 is now known as mriedem | 18:00 | |
| *** tosky has joined #openstack-infra | 18:01 | |
| clarkb | pabelanger: reviewed https://review.openstack.org/#/c/455005/1 | 18:01 |
| *** dtantsur is now known as dtantsur|afk | 18:01 | |
| clarkb | mtreinish: thats quite the list | 18:02 |
| *** esberglu_ has quit IRC | 18:02 | |
| *** esberglu_ has joined #openstack-infra | 18:02 | |
| *** baoli has joined #openstack-infra | 18:02 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add support for $DO_BOOTSTRAP_SUBNODES https://review.openstack.org/437434 | 18:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Add generated nodepool key to authorized_keys https://review.openstack.org/437742 | 18:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Fix setting of node and node_private https://review.openstack.org/437433 | 18:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Support running toci_gate_test-oooq.sh locally https://review.openstack.org/437431 | 18:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Stop dstat at the end of a job https://review.openstack.org/438745 | 18:03 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci master: Guard adding bridge interface with $STABLE_RELEASE https://review.openstack.org/440838 | 18:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Stop installing pip from install_puppet.sh https://review.openstack.org/455005 | 18:04 |
| pabelanger | clarkb: fixed | 18:04 |
| *** kzaitsev_mb has quit IRC | 18:04 | |
| openstackgerrit | Brandon B. Jozsa proposed openstack-infra/project-config master: New project - OpenStack-Helm https://review.openstack.org/439159 | 18:04 |
| *** ociuhandu has joined #openstack-infra | 18:04 | |
| pabelanger | thought I had tested it | 18:04 |
| clarkb | pabelanger: I also think that doesn't work :P | 18:06 |
| pabelanger | really? | 18:06 |
| pabelanger | tested it | 18:07 |
| clarkb | oh wait | 18:07 |
| clarkb | ya I had a more complicated test that failed and simple case works | 18:07 |
| clarkb | so now I'm thinking my little complicated test was just silly | 18:07 |
| mtreinish | clarkb: heh, I'm trying to get stuff in a good place for the talk fungi and I are giving at the summit | 18:07 |
| clarkb | ya I see my derp | 18:07 |
| mtreinish | I'm probably going to be adding more to that list too | 18:07 |
| clarkb | pabelanger: I overrided the passed in value on comand line in my test script, derp | 18:08 |
| clarkb | +2'd your change | 18:08 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up puppetmaster cruft https://review.openstack.org/452558 | 18:10 |
| *** dharinic has quit IRC | 18:10 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql master: Fix puppet-lint failures https://review.openstack.org/453255 | 18:11 |
| *** jcoufal_ has quit IRC | 18:13 | |
| *** jcoufal has joined #openstack-infra | 18:13 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move puppet service disablement to o_p::server https://review.openstack.org/455016 | 18:14 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move package and file purging to o_p::server https://review.openstack.org/455013 | 18:14 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move automatic_upgrades management to o_p::server https://review.openstack.org/455012 | 18:14 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Move exim management to openstack_project::server https://review.openstack.org/455011 | 18:14 |
| *** esberglu_ is now known as esberglu | 18:15 | |
| openstackgerrit | Brandon B. Jozsa proposed openstack-infra/project-config master: New project - OpenStack-Helm https://review.openstack.org/439159 | 18:15 |
| *** rbrndt has joined #openstack-infra | 18:20 | |
| clarkb | mtreinish: paho-mqtt has a fun license (its compatible so fine) | 18:24 |
| pabelanger | mordred: do you mind reviewing: https://review.openstack.org/#/c/454863 | 18:24 |
| pabelanger | removes puppet-jenkins from zuul workers | 18:24 |
| clarkb | mtreinish: left a note on https://review.openstack.org/#/c/449279/4 | 18:24 |
| pabelanger | we still use puppet-jenkinsuser, for now | 18:24 |
| pabelanger | clarkb: https://review.openstack.org/#/c/454916/ is a good once to review too. Our removal of puppet-ssh from zuul workers | 18:25 |
| mordred | pabelanger: ++ | 18:25 |
| *** baoli has quit IRC | 18:26 | |
| mnaser | pabelanger https://review.openstack.org/#/c/455374/ - curious to see how its going to do on a second run in terms of how much faster | 18:28 |
| clarkb | mtreinish: also I see reading the docs that we remove type from the gerrit events over mqtt, maybe use it in the topic and also preserve it in the event? taht way consumers of events don't have to have mqtt specialness beyond receiving events to parse events properly. | 18:29 |
| *** kgiusti has left #openstack-infra | 18:30 | |
| *** esikache1 has quit IRC | 18:31 | |
| openstackgerrit | Merged openstack-infra/system-config master: Break dependency on jenkins::slave https://review.openstack.org/454863 | 18:32 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Add barbicanclient to Cinder LIO job https://review.openstack.org/455414 | 18:32 |
| *** baoli has joined #openstack-infra | 18:32 | |
| *** cody-somerville has joined #openstack-infra | 18:33 | |
| *** cody-somerville has joined #openstack-infra | 18:33 | |
| *** hasharAway is now known as hashar | 18:34 | |
| pabelanger | mnaser: k | 18:34 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/bindep master: bindep: depends: Add distro family aliases https://review.openstack.org/450634 | 18:35 |
| *** srobert has joined #openstack-infra | 18:37 | |
| hwoarang | yolanda: ianw: Hi! could you help me get these two patches ^^ in as it's blocking my openstack-ansible progress on Leap hosts :/ and once they are in I need to convince you to make a new release :) Thanks in advance! | 18:38 |
| kevinbenton | (ignore my earlier message, looks like the problem was change-id duplication across projects and depends-on between them) | 18:44 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/devstack-gate master: Add sahara to features.yaml in subnode https://review.openstack.org/447158 | 18:46 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/devstack-gate master: Add sahara to features.yaml in subnode https://review.openstack.org/447158 | 18:46 |
| AJaeger | pabelanger, clarkb, looking at https://review.openstack.org/#/q/topic:unpuppet-zuul-workers+status:open I see https://review.openstack.org/#/c/450030/ - are we ready to merge that? Then I'll +2A. Also, review of the other changes would be welcome... | 18:49 |
| *** dharinic has joined #openstack-infra | 18:50 | |
| *** ralonsoh has joined #openstack-infra | 18:50 | |
| pabelanger | AJaeger: we're actually working on that still | 18:51 |
| pabelanger | we should WIP until we get a patch for nodepool | 18:51 |
| AJaeger | pabelanger: ok, then please WIP it. | 18:51 |
| pabelanger | AJaeger: done | 18:52 |
| openstackgerrit | Merged openstack-infra/project-config master: Set PermitRootLogin for sshd_config https://review.openstack.org/454918 | 18:52 |
| clarkb | AJaeger: pabelanger ya thats what we were talking about setting up infra-root keys and all that | 18:53 |
| pabelanger | I've tested https://review.openstack.org/#/c/455388 already, so cloud-launcher worked as expected | 18:53 |
| pabelanger | now just to update nodepool | 18:53 |
| openstackgerrit | Merged openstack-infra/project-config master: Stop installing pip from install_puppet.sh https://review.openstack.org/455005 | 18:54 |
| AJaeger | clarkb, pabelanger thanks | 18:54 |
| *** sdague_ has quit IRC | 18:55 | |
| *** dtardivel has quit IRC | 19:00 | |
| openstackgerrit | Brandon B. Jozsa proposed openstack-infra/project-config master: New project - OpenStack-Helm https://review.openstack.org/439159 | 19:01 |
| openstackgerrit | Merged openstack-infra/system-config master: Remove CentOS 6 specific configs https://review.openstack.org/455019 | 19:01 |
| *** nadya has joined #openstack-infra | 19:01 | |
| v1k0d3n | AJaeger: hey, thanks for looking at the PS for openstack-helm. :) | 19:01 |
| v1k0d3n | i removed that ask you recommended. thanks for the eyes and direction! | 19:02 |
| *** ym200 has quit IRC | 19:02 | |
| *** esikache1 has joined #openstack-infra | 19:07 | |
| pabelanger | timothyb89: if I was to build stackviz on my local computer (fedora) and copy the /opt/stackviz folder to ubuntu, would it work? Or is compiling the npm app platform specific? | 19:11 |
| mordred | pabelanger: ok. it looks like there is no longer a release happenin | 19:12 |
| pabelanger | timothyb89: I'd like to create a tarball of the static bits of stackviz in a periodic job, then upload it to tarballs.o.o. Then, have our images use that. So we can remove npm as a dependency in our images | 19:13 |
| pabelanger | mordred: yay | 19:13 |
| clarkb | pabelanger: I want to say its compiling js to js whcih runs in your browser so that should be fine | 19:13 |
| mordred | pabelanger, clarkb: I've started a root screen on afsdb01 - would one of you attach to it to make sure I did that right? | 19:13 |
| *** kzaitsev_mb has joined #openstack-infra | 19:13 | |
| clarkb | npm is just the runtime used to do that compilation step but ultimately its firefox or chrome or whatever running the code | 19:13 |
| pabelanger | clarkb: okay, cool | 19:13 |
| pabelanger | mordred: sure | 19:13 |
| clarkb | I see ashell prompt and tahts it | 19:14 |
| pabelanger | same | 19:14 |
| mordred | cool - I want to do the thing from earlier again - unlock, then release - sound ok? | 19:14 |
| clarkb | yes, however I think the lock you wnat to hodl is on the mirror update host? its jsut a simple file lock to prevent bandersnatch from trying to also do things | 19:15 |
| *** esikache1 has quit IRC | 19:15 | |
| *** edmondsw_ has joined #openstack-infra | 19:15 | |
| *** edmondsw_ has quit IRC | 19:15 | |
| mordred | no - this is anAFS level lock | 19:15 |
| mordred | if you look at that output - you'll see "Volume is locked for a release operation" | 19:15 |
| clarkb | do you need both things to keep bandersnatch at bay? | 19:15 |
| mordred | probably | 19:15 |
| clarkb | gotcha | 19:15 |
| mordred | flock -n /var/run/pypi-mirror.lock bash | 19:16 |
| mordred | I did that on mirror-update | 19:16 |
| pabelanger | ++ | 19:16 |
| clarkb | looks good | 19:16 |
| pabelanger | agree | 19:16 |
| mordred | and nothing shows up there with ps -ef | grep release - so vos release shouldn't be running, yeah? | 19:16 |
| clarkb | could it be running on another host? | 19:17 |
| pabelanger | Mon Apr 10 18:52:42 2017 trans 438116 on volume 536870932 has timed out | 19:17 |
| pabelanger | don't think so | 19:17 |
| mordred | no - we run the pypi mirror release on mirror host | 19:17 |
| pabelanger | I see that in the log | 19:17 |
| clarkb | oh right and if you have lock on mirror host it shouldn't be running there | 19:18 |
| mordred | yah | 19:18 |
| mordred | so I'm going to start the (likely multi-hour) release again | 19:18 |
| pabelanger | wfm | 19:18 |
| mordred | looks like it took 5-6 hours earlier | 19:18 |
| *** john-davidge has joined #openstack-infra | 19:20 | |
| pabelanger | ack | 19:21 |
| pabelanger | fedora-25 DIB currently building, monitoring to see if it will still be happy | 19:22 |
| pabelanger | mordred: clarkb: Did we ever decided if it was a bad idea or good to have workers mount AFS for things? Like ISO images for example | 19:23 |
| *** john-davidge has quit IRC | 19:25 | |
| mordred | pabelanger: I think we've been trying to avoid it so far ... | 19:26 |
| mordred | pabelanger: mainly because mounting AFS is a kernel module and we were concerned about guest taint | 19:27 |
| pabelanger | that is true | 19:27 |
| *** marst_ has joined #openstack-infra | 19:27 | |
| mordred | and also since they're single use, we wouldn't get much benfit from the cache - so http from mirror it still likely a win | 19:27 |
| pabelanger | Ya, didn't think of the kernel actually | 19:28 |
| pabelanger | so ++ to http | 19:28 |
| *** nadya has quit IRC | 19:28 | |
| *** marst has quit IRC | 19:30 | |
| *** tonytan4ever has quit IRC | 19:36 | |
| * fungi is not really here, but wants to point out that retrieving large files over and over via udp (afs) across unreliable networks (or really any networks) is likely to vastly underperform tcp (http) anyway | 19:38 | |
| bkero | I thought that as well, but udpcast taught me differently | 19:38 |
| bkero | It depends on how well afs handles retransmits and how much overhead they're putting in the datagrams | 19:39 |
| fungi | true, i used to tune some wicked fast udp-based nfs | 19:40 |
| *** tonytan4ever has joined #openstack-infra | 19:40 | |
| *** esikache1 has joined #openstack-infra | 19:41 | |
| fungi | but anyway, the sheer throughput performance of afs is evident in the speed for cache misses/cold caches. i guess we could measure two successive retrievals of large files where the first is not present in the cache if curious | 19:42 |
| fungi | bigger issue i think is that we don't maintain afs replicas in proximity to our ci nodes, so afs directly from france to texas is likely to vastly underperform http to a cache in the same network | 19:43 |
| openstackgerrit | sebastian marcet proposed openstack-infra/puppet-openstackid master: Server params tweaking https://review.openstack.org/455358 | 19:44 |
| openstackgerrit | Tim Burke proposed openstack-infra/project-config master: Add release notes jobs for swift https://review.openstack.org/451118 | 19:46 |
| *** winggundamth has joined #openstack-infra | 19:46 | |
| fungi | clarkb: ^ looks like that addressed your concern with the earlier patchset | 19:46 |
| fungi | (455358 i mean) | 19:47 |
| mordred | fungi: yes. what you said | 19:49 |
| *** xarses has joined #openstack-infra | 19:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Don't force python2 for subunit2sql install on workers https://review.openstack.org/455435 | 19:50 |
| * fungi has arrived in ann arbor, btw | 19:50 | |
| *** arxcruz has quit IRC | 19:51 | |
| pabelanger | clarkb: ianw: looks like something changed on our subunit2sql install: http://nb01.openstack.org/dib.fedora-25.log | 19:51 |
| *** skelso has quit IRC | 19:51 | |
| pabelanger | trying to see if related to our puppet changes | 19:52 |
| *** xarses_ has quit IRC | 19:52 | |
| *** skelso has joined #openstack-infra | 19:52 | |
| pabelanger | but, I think we can allow python3.5 installs on fedora | 19:52 |
| *** ricardoas has left #openstack-infra | 19:52 | |
| *** arxcruz has joined #openstack-infra | 19:53 | |
| mordred | fungi: enjoy ann arbor! | 19:53 |
| pabelanger | I am guess virtualenv is now defaulting to python3.5 on fedora | 19:54 |
| AJaeger | mordred: did you send out all R release voting emails? I don't think I got one ;( | 19:54 |
| *** gouthamr has quit IRC | 19:54 | |
| mordred | AJaeger: they're still sending | 19:56 |
| mtreinish | clarkb: yeah I can add it back in, it'll be a germqtt patch. But it should be pretty straightforward to do | 19:58 |
| mtreinish | fwiw, I was surprised that it wasn't in there (I might have just missed it, there are a lot of fields) | 19:58 |
| AJaeger | mordred: wow, that takes long... | 19:58 |
| mrhillsman | cool, i thought i did not have a vote :( | 19:58 |
| openstackgerrit | Tim Burke proposed openstack-infra/project-config master: swift: Skip long running dsvm jobs for unrelated changes https://review.openstack.org/455439 | 20:03 |
| *** yamahata has quit IRC | 20:03 | |
| *** shardy has quit IRC | 20:03 | |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Add barbicanclient to Cinder LIO job https://review.openstack.org/455414 | 20:03 |
| mtreinish | clarkb: heh, you don't like the dual eclipse public license and eclipse distribution license | 20:04 |
| *** ekhugen has quit IRC | 20:06 | |
| *** esikache1 has quit IRC | 20:06 | |
| *** zz_ja has quit IRC | 20:07 | |
| *** patriciadomin has quit IRC | 20:08 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql master: Add MQTT support to the gearman worker https://review.openstack.org/449279 | 20:08 |
| *** dimtruck is now known as zz_dimtruck | 20:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Setup /usr/local/jenkins within puppet DIB element https://review.openstack.org/455440 | 20:10 |
| mordred | AJaeger: yah- 40k humans- 1 email every 18 seconds-ish right now | 20:10 |
| mordred | mrhillsman: yes! this is a game the whole family can play! | 20:10 |
| *** zz_ja has joined #openstack-infra | 20:10 | |
| *** ekhugen has joined #openstack-infra | 20:10 | |
| mordred | mrhillsman: actually - have you not gotten an email yet? | 20:10 |
| mrhillsman | hehe | 20:10 |
| *** cody-somerville has quit IRC | 20:11 | |
| *** Zhongjun__ has quit IRC | 20:11 | |
| *** patriciadomin has joined #openstack-infra | 20:11 | |
| mrhillsman | what's the subject line? i do not see it, i only found out because someone replied to operators ML about some names that were questionable | 20:12 |
| mrhillsman | he said he got on 4/5, i do not see it, and the googles does not find | 20:12 |
| mordred | mrhillsman: it would have the word "CIVS" in the subject | 20:14 |
| AJaeger | mordred: so, will you finish mailing out before the voting period ends? ;) | 20:15 |
| mrhillsman | lol | 20:15 |
| mrhillsman | nope, have not got it yet | 20:15 |
| mordred | AJaeger: probably not | 20:15 |
| mnaser | fwiw my subject was: "Poll: OpenStack P Release Naming" | 20:15 |
| mnaser | oh | 20:16 |
| mnaser | um | 20:16 |
| mnaser | i lied. | 20:16 |
| mnaser | Poll: OpenStack R Release Naming | 20:16 |
| mnaser | (not far off) | 20:16 |
| *** esikache1 has joined #openstack-infra | 20:16 | |
| mordred | AJaeger: I have decided that since it's taking so long, I will start the 1-week timer from the time I'm done sending emails | 20:16 |
| mordred | mrhillsman: I just poked the system with your email again - let me know if one shows up soon | 20:18 |
| mrhillsman | ok cool | 20:18 |
| pabelanger | we need to setup a spam farm, to deal with it in a matter of minutes | 20:18 |
| pabelanger | if only we had servers | 20:18 |
| mrhillsman | +1 | 20:18 |
| clarkb | I did get a poll on friday iirc | 20:18 |
| mordred | pabelanger: I believe I will actually want to start a conversation about running our own once this poll is done | 20:19 |
| mrhillsman | just got it mordred :) | 20:19 |
| mordred | mrhillsman: woot! | 20:19 |
| mrhillsman | search returned only one result :) | 20:19 |
| mordred | pabelanger: these 40k polls we do are actually stressful for the folks at CMU | 20:19 |
| mtreinish | clarkb: thanks for the reviews. fwiw, I probably should have given you a priority list because: https://review.openstack.org/#/c/453452/ would be best to land first (so we start collecting firehose usage metrics) | 20:19 |
| mrhillsman | so yeah, did not get it before | 20:19 |
| mtreinish | mordred: ^^^ | 20:19 |
| mordred | mrhillsman: cool | 20:19 |
| pabelanger | mordred: ++ | 20:19 |
| mrhillsman | ty sir | 20:20 |
| clarkb | mtreinish: ok I'll look at that one next | 20:20 |
| mordred | mrhillsman: also - re: names - all of them came with wikipedia links and seemed legit-ish ... so I hope I didn't include anyhting too terrible | 20:20 |
| mtreinish | clarkb: thanks | 20:20 |
| AJaeger | mordred: ok, thanks | 20:20 |
| mrhillsman | 0.0 | 20:21 |
| *** john-davidge has joined #openstack-infra | 20:21 | |
| pabelanger | clarkb: thinking more about https://review.openstack.org/#/c/455435 should we force python2 for virtualenv? | 20:22 |
| mtreinish | clarkb: also on the germqtt side 'type' is in there, I just missed it. I checked the code and we don't pop the key so it should still be in the dict when it gets serialized and sent over mqtt: http://git.openstack.org/cgit/openstack-infra/germqtt/tree/germqtt/germqtt.py#n153 | 20:22 |
| mtreinish | I'll fix my doc patches to address that | 20:22 |
| jroll | mordred: are mailgun and friends out of the picture because infra can't host them if they go away? seems like an easy solution to the problem | 20:23 |
| mordred | jroll: it's not a mail server problem | 20:24 |
| mordred | jroll: we REGULARLY send tons of mail | 20:24 |
| jroll | mordred: heh, true | 20:25 |
| mordred | jroll: it's more that CIVS itself is a service being hosted by carnegie mellon because they're nice - and I think their IT department is less happy about being the source of tons of mails | 20:25 |
| mordred | jroll: so if we ran a copy of CIVS ourselves, we could send the mail and all would be ok | 20:25 |
| clarkb | pabelanger: you mean when we create it? I think ideally we'd force python3 there but not all distros have python3 | 20:25 |
| jroll | mordred: ah, makes sense, we need a polling system | 20:26 |
| * jroll starts thinking before speaking | 20:26 | |
| clarkb | pabelanger: its probably fine as proposed to have it use `python` | 20:26 |
| *** rkukura has quit IRC | 20:26 | |
| *** sbezverk_ has joined #openstack-infra | 20:26 | |
| *** john-davidge has quit IRC | 20:26 | |
| *** rkukura has joined #openstack-infra | 20:26 | |
| mtreinish | mordred: we could run our own civs | 20:26 |
| mtreinish | I started looking at that at one point a while ago | 20:26 |
| mtreinish | (about the same time I started playing with writing a bot to automate most of the election work) | 20:27 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add firehose schema doc for launchpad message https://review.openstack.org/454911 | 20:27 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add firehose schema docs https://review.openstack.org/454862 | 20:27 |
| pabelanger | clarkb: k, that's what I expected | 20:28 |
| pabelanger | we do that for other virtualenvs too | 20:28 |
| clarkb | pabelanger: should I go ahead and approve? | 20:28 |
| pabelanger | ++ | 20:28 |
| *** john-davidge has joined #openstack-infra | 20:29 | |
| *** sbezverk has quit IRC | 20:29 | |
| mordred | mtreinish: yah - I think we've gotten to the point where it's a good idea | 20:30 |
| *** knangia has quit IRC | 20:31 | |
| *** zz_dimtruck is now known as dimtruck | 20:31 | |
| *** ralonsoh has quit IRC | 20:31 | |
| *** EricGonczer_ has joined #openstack-infra | 20:31 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up $update_pkg_list_cmd param https://review.openstack.org/455020 | 20:32 |
| pabelanger | AJaeger: left comment on 455440 | 20:32 |
| AJaeger | pabelanger: left another on it ;) | 20:33 |
| AJaeger | pabelanger: thanks | 20:33 |
| pabelanger | ++ | 20:33 |
| * AJaeger waves good bye | 20:33 | |
| *** srobert_ has joined #openstack-infra | 20:34 | |
| *** armax has quit IRC | 20:34 | |
| openstackgerrit | Merged openstack-infra/project-config master: Don't force python2 for subunit2sql install on workers https://review.openstack.org/455435 | 20:36 |
| *** ssbarnea has quit IRC | 20:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Setup /usr/local/jenkins within puppet DIB element https://review.openstack.org/455440 | 20:36 |
| *** ssbarnea has joined #openstack-infra | 20:36 | |
| *** ssbarnea has quit IRC | 20:36 | |
| *** srobert has quit IRC | 20:36 | |
| *** john-davidge has quit IRC | 20:37 | |
| *** rfolco has joined #openstack-infra | 20:38 | |
| *** srobert_ has quit IRC | 20:38 | |
| *** ssbarnea has joined #openstack-infra | 20:38 | |
| *** tonytan4ever has quit IRC | 20:41 | |
| *** tonytan4ever has joined #openstack-infra | 20:41 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Cleanup jenkins/scripts https://review.openstack.org/455446 | 20:44 |
| AJaeger | pabelanger: that's your cleanup ^ | 20:44 |
| pabelanger | nice | 20:46 |
| *** tonytan4ever has quit IRC | 20:46 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove zuul_swift_upload https://review.openstack.org/455448 | 20:47 |
| AJaeger | pabelanger: and one more (not really related to permissions) but removes one nodepool environment ^ | 20:48 |
| * AJaeger waves again... | 20:48 | |
| openstackgerrit | Sean Dague proposed openstack-infra/os-loganalyze master: Add support for systemd logs https://review.openstack.org/454831 | 20:49 |
| sdague | clarkb: should be better now | 20:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Setup /usr/local/jenkins within nodepool-base element https://review.openstack.org/455440 | 20:49 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up hiera hacks for fedora https://review.openstack.org/455449 | 20:52 |
| *** askb has joined #openstack-infra | 20:52 | |
| mtreinish | clarkb: fwiw I just pushed: https://github.com/eclipse/paho.mqtt.python/pull/179 to address your comment about the auth dict | 20:52 |
| mtreinish | although I'm pretty sure I'll have to open an eclipse foundation account and sign their cla before that patch will be accepted | 20:53 |
| cmurphy | pabelanger: ianw: interested in your feedback on https://review.openstack.org/455449 | 20:53 |
| *** florianf has quit IRC | 20:54 | |
| pabelanger | wow | 20:54 |
| inc0 | hey guys, question about https://review.openstack.org/#/c/447524/4' | 20:54 |
| *** rfolco has quit IRC | 20:54 | |
| inc0 | so can we do this without zuulv3? | 20:54 |
| pabelanger | cmurphy: +2 | 20:55 |
| inc0 | as having some single point to push/pull fresh images would help us tremendously | 20:55 |
| pabelanger | inc0: possible, but it would be a good use case for zuulv3 and secrets system | 20:56 |
| pabelanger | however, we could start on the pipeline today like we did for debian | 20:56 |
| pabelanger | then port it | 20:56 |
| inc0 | pabelanger: totally agree, I want us to be zuulv3 all the way down, just when it lands | 20:57 |
| inc0 | and not block stuff from happening before it does | 20:57 |
| *** arif-ali has quit IRC | 20:57 | |
| pabelanger | we likely can work on the export / upload / publish workflow before zuulv3 | 20:58 |
| inc0 | what about secrets? | 20:59 |
| *** ssbarnea has quit IRC | 20:59 | |
| inc0 | and what work would be involved? I can help | 20:59 |
| pabelanger | that depends on zuulv3 currently | 20:59 |
| inc0 | if it's ansible especially | 20:59 |
| *** arif-ali has joined #openstack-infra | 21:00 | |
| clarkb | I mean we deal with secrets today they are just confined to specific test nodes that don't run arbitrary code | 21:00 |
| mordred | yah - current system means that pushing to place with privs needs to be done on a specific and trusted host | 21:00 |
| mordred | yah | 21:00 |
| pabelanger | right | 21:00 |
| inc0 | that was original plan | 21:01 |
| pabelanger | that hardest part will be to have kolla docker save -o fedora fedora:latest, copy to publish directory, then download to trusted node and push | 21:01 |
| inc0 | I can write shellscript that will take our current tarballs hack, untar it, run registry with it and repush to dockerhub | 21:01 |
| mordred | well, they alreayd do that though | 21:01 |
| pabelanger | we can likely use some of the work we did for debian | 21:01 |
| inc0 | what I'd need is host with docker installed (can write shell for that too) and some way to trigger the shellscript | 21:02 |
| pabelanger | what is the contents of http://tarballs.openstack.org/kolla/images/ | 21:02 |
| pabelanger | I cannot remember | 21:03 |
| mordred | inc0: so - to split it out a little bit - we'll need a host managed by puppet that is a static build host that has docker on it | 21:03 |
| inc0 | pabelanger: contents of /var/lib/registry for docker-registry | 21:03 |
| *** tonytan4ever has joined #openstack-infra | 21:03 | |
| *** thorst has quit IRC | 21:03 | |
| mordred | then we'll need a job in project-config that responds to ... tags I guess? ... that runs on that host that does the shell script you were tlaking about to push to registry | 21:03 |
| *** cody-somerville has joined #openstack-infra | 21:03 | |
| inc0 | mordred: commits | 21:04 |
| mordred | inc0: on every commit? | 21:04 |
| inc0 | or daily | 21:04 |
| pabelanger | Ya, I don't think we need to whole registry you copy. just an export / save tarball of the images that have changed | 21:04 |
| inc0 | pabelanger: that's how it's going to work anyway | 21:04 |
| pabelanger | or does all of the registry contains only changed? | 21:04 |
| inc0 | well docker will figure out which layhers changed | 21:04 |
| inc0 | that being said, most of layers will be invalidated because software inside container gets updates too | 21:05 |
| inc0 | so we can safely assume that it will upload stuff more often than not | 21:05 |
| inc0 | daily cron would be a-ok tho | 21:05 |
| pabelanger | I was thinking the job would export the images, then import on trusty node an publish | 21:06 |
| inc0 | well job can already import tarballs daily, run local registry, pull images from it and repush to docker | 21:07 |
| inc0 | dockerhub* | 21:07 |
| pabelanger | docker save image > image.tar docker load < image.tar | 21:07 |
| inc0 | no, it's going to be horrible for performance | 21:07 |
| pabelanger | inc0: that is the issue, jobs won't publish directly, we'll do that with a publish in zuul | 21:07 |
| inc0 | pull tarballs from tarballs.o.o -> run registry -> docker pull lokolla/image-name -> rename lokolla/docker.ip -> docker push docker.io/image-name | 21:08 |
| openstackgerrit | Merged openstack-infra/system-config master: Clean up hiera hacks for fedora https://review.openstack.org/455449 | 21:08 |
| mordred | inc0: I think it would be awesome if you could write that script for us :) | 21:09 |
| inc0 | mordred: you got it | 21:09 |
| * mordred will then learn things about docker from inc0's script | 21:09 | |
| inc0 | if you can run it in any node, I'll provide stuff to run | 21:09 |
| pabelanger | can a registry be run without root? | 21:09 |
| inc0 | pabelanger: yeah I think so | 21:09 |
| inc0 | well, we need docker daemon anyway | 21:09 |
| mordred | inc0: well, I think we can work on the next steps in terms of figuring out where/how to run it | 21:09 |
| *** lazyPower has left #openstack-infra | 21:09 | |
| inc0 | so I can run registry in docker container then yes | 21:10 |
| mordred | but having a script we can run will be a huge first step | 21:10 |
| inc0 | mordred: if you can give me node with docker isntalled that's all I need | 21:10 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Remove puppet pinning logic https://review.openstack.org/455017 | 21:10 |
| pabelanger | ya, long term, I don't think we need to have jobs stand up a local registry, then push that to tarballs.o.o. We can likely just export each image as a tarball but I am unsure how docker layers work | 21:11 |
| pabelanger | would need to test it | 21:11 |
| inc0 | no, we do not want to export images as tarballs - way it works is it will squash image to self-contained tarball | 21:12 |
| inc0 | it takes lots of processing to do | 21:12 |
| inc0 | and image will end up being ~2gig | 21:13 |
| inc0 | every image will be ~2gig...think 200+gig of transfered data per uplaod | 21:13 |
| inc0 | so yeah, not ideal for us;) that being said tarballs.o.o has it figured out and whole thing is less than 3gig | 21:14 |
| pabelanger | Produces a tarred repository to the standard output stream. Contains all parent layers, and all tags + versions, or specified repo:tag, for each argument provided. | 21:14 |
| pabelanger | according to docs | 21:15 |
| pabelanger | https://docs.docker.com/engine/reference/commandline/save/ | 21:15 |
| inc0 | yeah...per image | 21:15 |
| pabelanger | like I said, I'll have to play with it | 21:15 |
| inc0 | which means images don't share stuff | 21:15 |
| inc0 | and we have lots of images | 21:15 |
| *** pcaruana has quit IRC | 21:15 | |
| pabelanger | understood | 21:16 |
| pabelanger | I still want to test it | 21:16 |
| inc0 | totally, it's cool feature | 21:16 |
| inc0 | I'm just saying I don't think it's good for our particular use case | 21:16 |
| inc0 | mordred: want shell or ansible play? | 21:17 |
| mordred | inc0: shell | 21:17 |
| inc0 | kk | 21:17 |
| *** Goneri has quit IRC | 21:17 | |
| *** ldnunes has quit IRC | 21:18 | |
| *** waynr has quit IRC | 21:18 | |
| fungi | ugh. my mailserver's network in rackspace suddenly (in the past day or two) got added to the spamhaus pbl :/ | 21:20 |
| mordred | fungi: yay! | 21:21 |
| *** rfolco has joined #openstack-infra | 21:22 | |
| *** rfolco has quit IRC | 21:22 | |
| fungi | it looks like rackspace may have "helpfully" told spamhaus to add 162.242.224.0/19 (at least the blocklist entry advises to review rackspace's aup before requesting a whitelist entry) | 21:23 |
| fungi | we may want to keep an eye out in case they did that for other networks as well | 21:23 |
| fungi | odd though, given that the pbl is supposed to be for tracking broadband/residential ip networks | 21:25 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Update OVB containers job to use infra docker proxy https://review.openstack.org/454893 | 21:26 |
| jpmaxman | I think RackSpace's stance is you should use mailgun ;) | 21:26 |
| mordred | yah | 21:26 |
| *** dprince has quit IRC | 21:27 | |
| mordred | it's them breaking the internet to sell a product I don't need | 21:27 |
| mordred | https://www.mailgun.com/rackspace | 21:27 |
| mordred | fungi: so, I would chalk that up as someone "helpfully" filing a malicious spamhaus entry to "helpfully" nudge you to their overpriced product | 21:27 |
| jpmaxman | yeah though they just spun them off | 21:27 |
| fungi | i'd rather run an mta so i can guarantee correct working ipv6 and tls support. then again, preaching to the choir | 21:28 |
| mordred | jpmaxman: the email services like mailgun boggle my mind - but clearly the internet is not for me anymore | 21:28 |
| * fungi wonders whether internet2 is ready yet | 21:28 | |
| jpmaxman | LOL | 21:28 |
| *** nadya has joined #openstack-infra | 21:29 | |
| jpmaxman | if I recall correctly you can get an individual IP excluded | 21:29 |
| mordred | Look! There used to be an internet that worked but was free. BUT - we've replaced it with one that doens't work as well and is more expensive!!! | 21:29 |
| *** hashar has quit IRC | 21:29 | |
| jpmaxman | but it's just a hassle because if you re-deploy the server you have to go through the process again | 21:29 |
| mordred | yah. I honestly can't believe rackspace has an entire network on a spamhaus list - what are they, softlayer? | 21:30 |
| jpmaxman | The Internet has abstracted itself with layers of $ between the abstractions! | 21:30 |
| * mordred sobs | 21:30 | |
| SamYaple | the real answer here is don't use email i think | 21:30 |
| mordred | SamYaple: it's hard to not use email when you need to use email though | 21:31 |
| *** jcoufal_ has joined #openstack-infra | 21:31 | |
| mordred | SamYaple: also, there are, as of yet, literally zero email replacements that are viable | 21:31 |
| SamYaple | mordred: I use IRC | 21:31 |
| mordred | SamYaple: ok - sold. I definitely think we should replace all use of email with IRC :) | 21:31 |
| SamYaple | sweet. another convert | 21:32 |
| *** pramodrj07 has joined #openstack-infra | 21:32 | |
| *** MasterOfBugs has joined #openstack-infra | 21:32 | |
| *** jcoufal has quit IRC | 21:32 | |
| fungi | jpmaxman: yep, i just finished the removal process. in theory i can safely rereply after 30 minutes to a couple of these which were rejected | 21:32 |
| *** nadya has quit IRC | 21:33 | |
| *** esikache1 has quit IRC | 21:33 | |
| fungi | though with the pbl, it's not really a removal just a per-address whitelist within the larger blacklisted ranges | 21:33 |
| *** eharney has quit IRC | 21:34 | |
| jpmaxman | right. it is a real pain. a lot of people cache those black lists too. and if the e-mail doesn't get through, guess who gets the blame ;) | 21:35 |
| mordred | "that's a nice email you've got there ... it would be a real shame if something were to happen to it ..." | 21:36 |
| fungi | what's extra hilarious is that johnthetubaguy's mailserver is blanket rejecting e-mails from rackspace ip addresses ;) | 21:36 |
| mordred | fungi: hahahaha | 21:36 |
| fungi | (maybe that's not such a terrible idea for him!) | 21:36 |
| *** ccamacho|brb has quit IRC | 21:37 | |
| fungi | the other rejection i got was for a recipient at an hpe.com address | 21:37 |
| fungi | oh, also fujitsu.com | 21:38 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid master: Added OpenId 2.0 SREG 1.0 ext support https://review.openstack.org/455453 | 21:39 |
| *** armax has joined #openstack-infra | 21:40 | |
| *** Sukhdev has joined #openstack-infra | 21:41 | |
| *** felipemonteiro has quit IRC | 21:43 | |
| *** baoli has quit IRC | 21:43 | |
| *** kzaitsev_mb has quit IRC | 21:43 | |
| *** baoli has joined #openstack-infra | 21:44 | |
| *** esikache1 has joined #openstack-infra | 21:46 | |
| *** baoli has quit IRC | 21:48 | |
| *** smarcet has quit IRC | 21:51 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Server params tweaking https://review.openstack.org/455358 | 21:52 |
| mordred | clarkb, pabelanger: for key name stuff - you earlier said you thought it should be per label, yeah? do you think we should have it just assume the user has uploaded a key of that name already? | 21:56 |
| *** cody-somerville has quit IRC | 21:57 | |
| clarkb | mordred: yes and yes. I don't think nodepool should manage the keys directly (just like it doesn't do flavors or crazy network stuff | 21:58 |
| clarkb | mordred: and mostly figured you'd want it at label level so that you could control access differently for different labels | 21:58 |
| clarkb | (I don't know if thats actually useful, I don't think we will do it that way) | 22:00 |
| *** abhi has joined #openstack-infra | 22:05 | |
| *** EricGonczer_ has quit IRC | 22:06 | |
| *** xyang1 has quit IRC | 22:08 | |
| *** esberglu has quit IRC | 22:09 | |
| *** winggundamth has quit IRC | 22:09 | |
| *** esberglu has joined #openstack-infra | 22:09 | |
| *** rlandy has quit IRC | 22:11 | |
| *** jcoufal has joined #openstack-infra | 22:11 | |
| *** skelso has quit IRC | 22:12 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Validate flavor specification in config https://review.openstack.org/451875 | 22:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Add ability to select flavor by name or id https://review.openstack.org/449784 | 22:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Cleanup from config syntax change https://review.openstack.org/451868 | 22:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Add support for specifying key-name per label https://review.openstack.org/455464 | 22:12 |
| mordred | clarkb, pabelanger: ^^ I'm not particularly sure how to test that | 22:12 |
| *** esberglu has quit IRC | 22:13 | |
| *** jcoufal_ has quit IRC | 22:13 | |
| clarkb | should it be on master? | 22:14 |
| *** jcoufal_ has joined #openstack-infra | 22:16 | |
| *** esikache1 has quit IRC | 22:17 | |
| *** jcoufal has quit IRC | 22:18 | |
| *** yolanda has quit IRC | 22:18 | |
| *** yolanda has joined #openstack-infra | 22:19 | |
| *** jcoufal has joined #openstack-infra | 22:19 | |
| *** jcoufal has quit IRC | 22:20 | |
| *** Goneri has joined #openstack-infra | 22:20 | |
| mordred | clarkb: well, I need to write that shim anyway, so I figured I'd just do this on v3 and then get off my ass and finish writing the v2/v3 shim | 22:20 |
| mordred | it'll merge conflict if we write it on master and merge it anyway - so it'd be writing it twice either way :) | 22:21 |
| *** gordc has quit IRC | 22:21 | |
| clarkb | ah | 22:21 |
| *** jcoufal_ has quit IRC | 22:21 | |
| clarkb | (just thinking we'd want to deploy the key stuff tomorrow maybe so master) | 22:22 |
| *** esberglu has joined #openstack-infra | 22:22 | |
| mordred | ah- gotcha | 22:22 |
| mordred | well, lemme see if I can't do the same thing on master :) | 22:22 |
| *** esikache1 has joined #openstack-infra | 22:24 | |
| *** knangia has joined #openstack-infra | 22:24 | |
| *** ihrachys has quit IRC | 22:25 | |
| *** esberglu has quit IRC | 22:26 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool master: Add support for specifying key-name per label https://review.openstack.org/455466 | 22:26 |
| mordred | clarkb: ^^ | 22:26 |
| *** armax has quit IRC | 22:26 | |
| *** dimtruck is now known as zz_dimtruck | 22:28 | |
| *** esikache1 has quit IRC | 22:28 | |
| inc0 | mordred: http://paste.ubuntu.com/24357347/ | 22:29 |
| inc0 | remove echo foo:P | 22:30 |
| *** shrircha has joined #openstack-infra | 22:30 | |
| clarkb | mordred: thanks, I know cmurphy in particular would like to see that done sooner or later. reviewing | 22:30 |
| *** gouthamr has joined #openstack-infra | 22:31 | |
| *** zz_dimtruck is now known as dimtruck | 22:33 | |
| mordred | inc0: cool - so - when you re-tag stuff ... | 22:34 |
| *** shrircha has quit IRC | 22:34 | |
| mordred | inc0: oh - nevermind- my brain doesn't fully work, I can read it now | 22:35 |
| *** coreycb is now known as coreycb_vaca | 22:35 | |
| inc0 | my shell is less-than-ideal, basically I need to run command like docker tag 127.0.0.1/lokolla/image-name:4.0.0 docker.io/kolla/image-name:4.0.0 | 22:35 |
| *** jkilpatr has quit IRC | 22:35 | |
| mordred | inc0: no - that's great- makes total sense | 22:36 |
| inc0 | and after that docker push docker.io/kolla/image-name:4.0.0 | 22:36 |
| inc0 | kk | 22:36 |
| mordred | inc0: can we do openstack/kolla-image-name instead of kolla/image-name or is kolla/image-name already a thing people expect? | 22:36 |
| inc0 | kolla is already semi-official repo in docker.io | 22:37 |
| mordred | nevermind - I see - you already have kolla there | 22:37 |
| mordred | nod | 22:37 |
| pabelanger | mordred: clarkb: we could maybe update the nodepool dsvm test, to all try to SSH as root | 22:37 |
| inc0 | so we can create new user for infra, I'll add this user to kolla repo | 22:37 |
| inc0 | and docker login will handle auth | 22:38 |
| *** smarcet has joined #openstack-infra | 22:38 | |
| mordred | inc0: sweet. I believe I grok. another question - the tag docker.io/kolla/image-name:4.0.0 ... is it appropriate to push that tag to a local registry if/when we wind up running one? | 22:41 |
| inc0 | so tag determines where docker will push it | 22:41 |
| mordred | gotcha | 22:41 |
| inc0 | as in, docker.io/kolla/image-name will always be pushed to docker.io under repo name kolla | 22:42 |
| inc0 | that being said one image can have many tags | 22:42 |
| *** esikache1 has joined #openstack-infra | 22:42 | |
| inc0 | which is what will happen here | 22:42 |
| mordred | so if we wanted to push to both dockerhub and a local registry, we'd tag it twice and then push,yah? | 22:42 |
| inc0 | yup | 22:42 |
| mordred | cool | 22:42 |
| mordred | awesome - thank you! I have learned things and I think I can take the next few steps here | 22:42 |
| inc0 | ofc final version will need some clever way to figure out $TAG and other variables and clean after itself | 22:43 |
| inc0 | but I'm happy to help with this one too | 22:43 |
| pabelanger | mordred: so, I'm toying with the idea of first doing this with dox images. Since I can build those images easily locally | 22:44 |
| mordred | inc0: image-name should be associated with the repo/job that triggered it yeah? | 22:44 |
| inc0 | no, image-name will be detected by script | 22:44 |
| inc0 | we will have couple dozens images in registry | 22:45 |
| inc0 | line 23 | 22:45 |
| mordred | oh - duh | 22:45 |
| pabelanger | how large is the images uncompressed? | 22:46 |
| mordred | are image tags and git tags associated? | 22:46 |
| inc0 | yes, they are | 22:46 |
| mordred | like, do you expect to do git tag -s 4.0.0 on a repo and then have a bunch of kolla/image-$foo:4.0.0 ? | 22:46 |
| inc0 | pabelanger: ~800MB with a lot of sharing between each other | 22:47 |
| mordred | so it's 800M - but we won't actually be pushing 800M to docker every time | 22:47 |
| inc0 | mordred: there will be only one tag in registry | 22:47 |
| inc0 | one we push from gates | 22:47 |
| inc0 | mordred: won't be pushing 800mb per image, total registry size is ~2gig | 22:48 |
| mordred | inc0: that last sentence didn't make sense to me- can you say it again? | 22:48 |
| inc0 | and that's worst case scenerio push | 22:48 |
| mordred | (the one about "there will be only one tag in registry") | 22:48 |
| inc0 | ok, so in our case | 22:48 |
| inc0 | in single tarball we pull | 22:48 |
| inc0 | there will be only one tag (as in 4.0.0) | 22:48 |
| mordred | yah - because that one got built by the gate job and uploaded to tarballs.o.o | 22:49 |
| *** john-davidge has joined #openstack-infra | 22:49 | |
| inc0 | exactly | 22:49 |
| mordred | I notice right now that you only have master and branch tarballs there | 22:49 |
| inc0 | and that's going to stay this way | 22:50 |
| mordred | well, that's a problem | 22:50 |
| inc0 | how so? | 22:50 |
| mordred | let me splain why I think it is | 22:50 |
| mordred | if you have some commits on master | 22:50 |
| mordred | each builds a set of image and then pushes them to blah-master.tar.gz right? | 22:50 |
| inc0 | yes | 22:50 |
| *** jascott1_ has joined #openstack-infra | 22:51 | |
| jhesketh | Morning | 22:51 |
| mordred | then you say "you know, that's awesome, I want to tag this as 4.0.0" - so you do "git tag -s 4.0.0 ; git push origin 4.0.0" | 22:51 |
| inc0 | ah I think I see where you're going | 22:51 |
| mordred | when the job runs in response to the tag event to publish to dockerhub, it has no way of grabbing the correct version of -master.tar.gz - it's a race condition | 22:51 |
| inc0 | tag 4.0 != tag 4.0 of what we have | 22:52 |
| *** esikache1 has quit IRC | 22:52 | |
| inc0 | that's something that was moved on last meeting in general, I'll add this to next meeting agenda (Wed 16UTC( | 22:53 |
| mordred | I mean, I suppose you can manage it for a while by disallowing people to merge things between the time you decide to tag something and the time you do - but that would be a social construct with no enforcement | 22:53 |
| *** john-davidge has quit IRC | 22:53 | |
| mordred | honestly - there's an issue no matter which way we do this currently | 22:54 |
| inc0 | agreed | 22:54 |
| mordred | if we keep it as it is now, you have a race between landing and tagging where someone could land another change | 22:54 |
| pabelanger | inc0: http://logs.openstack.org/11/454911/2/check/gate-infra-puppet-apply-3-fedora-25/eed102c/console.html#_2017-04-10_22_54_01_242319 | 22:54 |
| pabelanger | inc0: sorry | 22:54 |
| pabelanger | ianw: ^ | 22:54 |
| pabelanger | is bindep python3? | 22:55 |
| mordred | if we add a tag build job, we remove that - but then the content you publish is not the same content as what you decided to tag anyway | 22:55 |
| inc0 | yes, that wasn't issue when we push tagged image from actual tags | 22:55 |
| inc0 | but now we want HEAD of each branch | 22:55 |
| *** Goneri has quit IRC | 22:55 | |
| inc0 | we can specify new set of tags like master or ocata-latest | 22:55 |
| inc0 | but that's a discussion we need to have in community | 22:56 |
| mordred | yah - doing those should be fairly easy on per-commit post jobs, since we have access to branch info | 22:56 |
| *** rbrndt has quit IRC | 22:56 | |
| inc0 | or daily to lower amount of bytes pushed around | 22:56 |
| mordred | yah - either way for master/ocata/etc | 22:57 |
| mordred | so maybe we just start with those, and then we figure out how tags work next :) | 22:57 |
| mordred | (git tags, not master/ocata type tags) | 22:57 |
| inc0 | agree | 22:57 |
| inc0 | ok, I'll have a talk with people:) | 22:57 |
| mordred | cool - I'll work with pabelanger to get a straw man going | 22:58 |
| mordred | pabelanger: I have thoughts, but I believe I need to make a drink first | 22:58 |
| inc0 | afk for a bit | 22:58 |
| *** esikache1 has joined #openstack-infra | 22:58 | |
| inc0 | thanks mordred | 22:58 |
| mordred | inc0: thank you ! I believe I have learned things | 22:59 |
| inc0 | we'll make docker expert out of you yet | 22:59 |
| inc0 | one command at the time;) | 22:59 |
| mtreinish | pabelanger: did 454911 and 454862 need rechecks? They both got the jenkins +1 | 22:59 |
| mordred | pabelanger: tl;dr - I think we should spin up an additional static slave for this for now- since it's going to involve running docker things and since docker is a thing we don't run a lot in infra, I think keeping it segregated for a while while we figure it out for us would be better | 22:59 |
| mordred | pabelanger: in the form it's being used here I don't think there's any issues - but i'd rather start with baby steps :P) | 23:00 |
| mtreinish | pabelanger: also if you get a sec: https://review.openstack.org/#/c/453452/ should be simple :) | 23:00 |
| mordred | before we add a daemon to the same host that uploads other artifacts | 23:00 |
| pabelanger | mordred: Ya, pre zuulv3 a new static node make sense | 23:01 |
| mordred | pabelanger: yah - and I think gives us a nice playground to figure out how it works for v3 | 23:01 |
| fungi | mordred: i believe mnaser and i came to a similar conclusion, though the point there was to avoid decoupling the image generation and upload stages which would result in a fair amount of extra load on whatever interim storage solution we tried to buffer them through | 23:01 |
| mordred | fungi: cool | 23:01 |
| mordred | fungi: independently arriving at the same conclusions is a good thing! | 23:02 |
| fungi | should hopefully be reflected in the proposed spec, though i'll admit to not having read it closely yet | 23:02 |
| mordred | fungi: have you created an openstackinfra account on dockerhub yet? | 23:02 |
| *** thorst has joined #openstack-infra | 23:02 | |
| fungi | i have done no such thing | 23:02 |
| *** esikache1 has quit IRC | 23:02 | |
| mordred | awesome (I did squat on the openstack and openstackinfra organizations in dockerhub a while ago - although it seems that kolla is its own top-level org in this structure, so maybe we're futher along the remove-the-openstack-prefix road here...) | 23:03 |
| *** adriant has joined #openstack-infra | 23:03 | |
| *** andreww has quit IRC | 23:06 | |
| ianw | pabelanger: i guess not | 23:06 |
| pabelanger | ianw: ya, just testing patch now | 23:07 |
| *** DFFlanders has joined #openstack-infra | 23:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Force python2.7 for bindep-env https://review.openstack.org/455473 | 23:11 |
| pabelanger | ianw: ^should hold us over | 23:11 |
| pabelanger | fedora-25 DIB currently broken | 23:11 |
| *** sdague has quit IRC | 23:12 | |
| clarkb | trying to think if we need to use /usrc/bin/python2 anywhere but I don't think so since 2.6 isn't on any of our supported playforms | 23:12 |
| pabelanger | mordred: see my comment about dox images too? We likely can start testing those, since they are small | 23:12 |
| pabelanger | clarkb: I don't think so either | 23:12 |
| pabelanger | I looked at ubuntu and fedora | 23:12 |
| pabelanger | I can quickly check centos | 23:12 |
| clarkb | does bindep run a py3k job? first step might be adding that non voting | 23:13 |
| mtreinish | why do we run the puppet apply jobs on docs only patches? | 23:13 |
| pabelanger | clarkb: not sure, that was my next check | 23:13 |
| clarkb | it has python35-jobs | 23:13 |
| * clarkb tests locally | 23:14 | |
| pabelanger | mtreinish: we don't have skip-if for infra jobs usually | 23:14 |
| *** scottda has quit IRC | 23:15 | |
| mtreinish | pabelanger: is there a reason why? Otherwise I'll write up a patch | 23:15 |
| clarkb | pabelanger: tox -epy36 works locally... | 23:15 |
| ianw | i'm quite surprised it got to that bit of the build without python | 23:15 |
| ianw | python2 | 23:15 |
| pabelanger | mtreinish: we're not a fan of it honestly :) | 23:15 |
| *** dharinic has quit IRC | 23:15 | |
| mordred | pabelanger: yes, I agree | 23:16 |
| pabelanger | ianw: clarkb: I can reproduce the issue locally, until f25 | 23:16 |
| pabelanger | created virtualenv, ran bindep manually | 23:17 |
| clarkb | ya I think its a hole in the testsuite as this is a place where it shells out to rpm | 23:17 |
| ianw | 2017-04-10 19:34:27,165 INFO nodepool.image.build.fedora-25: New python executable in /usr/bindep-env/bin/dib-python ... hmm | 23:18 |
| pabelanger | heh | 23:18 |
| pabelanger | thats not good | 23:18 |
| fungi | are we activating the bindep env and not deactivating? | 23:19 |
| clarkb | its beacuse we use universal_newlines=True so we get back a unicode string looks like | 23:19 |
| fungi | that's why i prefer deep calls into the bindirs rather than using activate | 23:19 |
| *** tonytan4ever has quit IRC | 23:20 | |
| *** dimtruck is now known as zz_dimtruck | 23:20 | |
| *** smarcet has quit IRC | 23:21 | |
| mordred | fungi: I do too - although care must be taken in tox-type setups with testsuites that call external programs to make sure that the virtualenv bin dir is in the PATH of the test suite | 23:21 |
| mordred | fungi: (because of the opposite issue) | 23:22 |
| *** esikache1 has joined #openstack-infra | 23:22 | |
| fungi | yeah, but that shouldn't be the case for things like dib elements | 23:23 |
| *** zz_dimtruck is now known as dimtruck | 23:24 | |
| ianw | /usr/local/bin/dib-python /tmp/get-pip.py | 23:24 |
| ianw | is at the root of /urs/bindep-env/bin/dib-python weirdness i think | 23:25 |
| pabelanger | 2017-04-03 21:05:11,531 INFO nodepool.image.build.fedora-25: + ln -sf /usr/bin/python3 /usr/local/bin/dib-python | 23:26 |
| pabelanger | we've need doing that for some time | 23:26 |
| pabelanger | however, what is different now | 23:26 |
| pabelanger | we no longer setup pip with install_puppet.sh | 23:26 |
| pabelanger | which, was likely overriding the symlink? | 23:26 |
| ianw | yes, that link is intended | 23:26 |
| *** esikache1 has quit IRC | 23:27 | |
| ianw | basically, dib scripts use #!/usr/local/bin/dib-python because they don't know if it's python2 or 3 on the system | 23:27 |
| *** Hal has joined #openstack-infra | 23:27 | |
| ianw | it abstracts us | 23:27 |
| clarkb | pabelanger: I am writing a patch for bindep I think I have it sorted out | 23:27 |
| ianw | however, for non-#! uses, like running get-pip.py, I think we should be taking the interpreter from the environment | 23:27 |
| openstackgerrit | Merged openstack-infra/openstackid master: Added OpenId 2.0 SREG 1.0 ext support https://review.openstack.org/455453 | 23:28 |
| fungi | ohh, i get it. so the problem is arising when trying to install bindep into its venv, and dib has helpfully overridden the interpreter name in the venv? | 23:28 |
| clarkb | but I don't currently have a red hat, ubuntu, arch, or fedora system to test on | 23:28 |
| ianw | fungi: overwriting doesn't make much difference, it's just ugly | 23:28 |
| fungi | ahh | 23:28 |
| *** marst_ has quit IRC | 23:29 | |
| ianw | fungi: but i think that install_puppet.sh was actually ending up getting python2 installed and thus virtualenv was using that | 23:29 |
| pabelanger | yes, we had this issue too: https://review.openstack.org/#/c/455435/ | 23:30 |
| *** waynr has joined #openstack-infra | 23:30 | |
| pabelanger | I think we can just drop the decode on check_output | 23:31 |
| pabelanger | since it is a string | 23:31 |
| pabelanger | https://review.openstack.org/#/c/410933/ | 23:33 |
| clarkb | pabelanger: no we want to keep it | 23:34 |
| clarkb | because python2 | 23:34 |
| fungi | pabelanger: clarkb: i appear to have locally staged a change dropping the decode()s from weeks ago when some (similar?) regression was reported and get some ugly failures with py35 | 23:34 |
| clarkb | I've got a couple patches I am working on | 23:34 |
| clarkb | I don't think we want to drop the decodes as you could get utf8 or similar back on python2 | 23:34 |
| clarkb | in which case you'd be sad | 23:35 |
| pabelanger | universal_newlines | 23:35 |
| pabelanger | is the key I think | 23:35 |
| ianw | pabelanger: sounds exactly like -> https://review.openstack.org/#/c/420996/ | 23:35 |
| clarkb | yes we want to drop universal_newlines everhywhere since we don't actually care about newlines in that code and then add decode everywhere | 23:35 |
| pabelanger | ianw: yes, I think so | 23:35 |
| *** nadya has joined #openstack-infra | 23:35 | |
| pabelanger | okay, clarkb working on a fix | 23:35 |
| pabelanger | need to #dadops for a few minutes | 23:36 |
| fungi | when i first started investigating, seems the regression was added in https://review.openstack.org/410933 | 23:36 |
| openstackgerrit | Clark Boylan proposed openstack-infra/bindep master: Consistently check subprocess output https://review.openstack.org/455475 | 23:38 |
| openstackgerrit | Clark Boylan proposed openstack-infra/bindep master: Use locale's getpreferredencoding instead of utf8 https://review.openstack.org/455476 | 23:38 |
| clarkb | fungi: see end of https://docs.python.org/3/library/subprocess.html#frequently-used-arguments for why this doesn't work | 23:39 |
| fungi | yup | 23:39 |
| clarkb | guessing eric was testing on arch? its the odd one out there and would've work as specified | 23:40 |
| *** dharinic has joined #openstack-infra | 23:40 | |
| clarkb | anyways universally decoding should get us the same behavior on python2 and python3 whereas universal_newlines won't | 23:40 |
| clarkb | so this way is simpler imo | 23:40 |
| *** nadya has quit IRC | 23:42 | |
| clarkb | if I run bindep against nodepool's bindep.txt on tumbleweed using py36 I get no output and return code of 0 | 23:42 |
| clarkb | so not sure if ts actually doing anything, adding dummy package to nodepool's bindep seems to say no its doesn't do anything | 23:43 |
| fungi | sweet | 23:44 |
| fungi | is that with the opensuse support patches? | 23:45 |
| clarkb | oh are there opensuse patches? | 23:45 |
| clarkb | its tip of master + my patches I think | 23:45 |
| fungi | one already merged but there's a followup in review | 23:45 |
| ianw | oh wow, what a mess with our virtualenv install and python2 v 3 | 23:48 |
| clarkb | aha I see the patch I need let me retest with that | 23:48 |
| clarkb | ok I get it now. https://review.openstack.org/#/c/410933/1 commit message is confusing | 23:49 |
| clarkb | endswith is being called on a str but it takes bytes | 23:50 |
| *** tosky has quit IRC | 23:50 | |
| *** jkilpatr has joined #openstack-infra | 23:51 | |
| fungi | yup, that's the exception i ended up with when i originally tried to unwind it | 23:52 |
| clarkb | so I think this is actually in the handling of the exception case not the attempt | 23:54 |
| clarkb | anyways I have it reproduceable locally so sorting it out | 23:54 |
| *** dimtruck is now known as zz_dimtruck | 23:54 | |
| *** zz_dimtruck is now known as dimtruck | 23:54 | |
| ianw | arrrggghhhh why did i start looking at this | 23:56 |
| mordred | ianw: it hurts good don't it? | 23:56 |
| ianw | i guess we have an expectation that "pip" means python2 | 23:57 |
| ianw | which i think we are violating | 23:57 |
| ianw | because "python3 get-pip.py" will install "/usr/bin/pip" as v3 pip, i think | 23:58 |
| *** marst has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!