| *** rfolco has quit IRC | 00:06 | |
| fungi | the purpose of timesyncd seems to be for systemd to put ntp out of business? | 00:06 |
|---|---|---|
| fungi | "systemd-timesyncd does no clock discipline: the clock is not trained or compensated, and internal clock drift over time is not reduced. It has rudimentary logic to adjust poll interval but without disciplining the host will end up with uneven time forever as systemd-timesyncd pushes or pulls at whatever interval it thinks the near-term drift requires. It also can't assess the quality of the remote | 00:08 |
| fungi | time source. You're unlikely to get accuracy much greater than 100ms." | 00:08 |
| fungi | https://unix.stackexchange.com/questions/305643/ntpd-vs-systemd-timesyncd-how-to-achieve-reliable-ntp-syncing | 00:08 |
| corvus | +/- 7 minutes according to recent experience | 00:09 |
| fungi | indeed | 00:09 |
| ianw | well i would be almost certain that was when my external screen refused to wake up (long standing bug) so i suspended my work vm and rebooted | 00:10 |
| clarkb | ianw: is that screen hooked up via displayport and you are using intel integrated graphics? | 00:11 |
| clarkb | if so I've had reasonable luck turning the monitor off and on again a few times and eventually the right events get through and it starts working again :/ | 00:11 |
| fungi | i run into that occasionally, and can solve it by blindly typing `xset dpms force on` into a terminal or over ssh from a separate system | 00:12 |
| ianw | it's https://bugzilla.redhat.com/show_bug.cgi?id=1506339 | 00:14 |
| openstack | bugzilla.redhat.com bug 1506339 in xorg-x11-drv-intel "[drm:intel_cpu_fifo_underrun_irq_handler [i915]] *ERROR* CPU pipe B FIFO underrun" [High,New] - Assigned to ajax | 00:14 |
| ianw | one of those great 2+ year bugs with no answer | 00:14 |
| ianw | i think this laptop is probably old enough for a lease refresh ... however, the probability a new laptop will bring even more issues is probably higher :) | 00:16 |
| ianw | clarkb: on your point with the le certs refreshing at the same time -- possibly they do do a no-op task and then call a notify for a common restart handler? | 00:18 |
| clarkb | ianw: my laptop is now 5 years old and ya the problems you know seem safer than new problems | 00:18 |
| clarkb | ianw: I think that concern is far less of an issue with the switch to graceful apache relods | 00:18 |
| clarkb | we should be able to queue those up several deep and not worry | 00:18 |
| ianw | yeah, i should cycle back on the listen: thing at the top of that file now we're using later ansible versions | 00:18 |
| *** ricolin has joined #openstack-infra | 00:37 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheels : generate indexes version 2 https://review.opendev.org/702531 | 00:46 |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: package-afs-centos: fix centos8 build https://review.opendev.org/702562 | 01:05 |
| *** adriant has quit IRC | 01:36 | |
| *** iokiwi has quit IRC | 01:36 | |
| *** jamesmcarthur has joined #openstack-infra | 01:37 | |
| *** michael-beaver has quit IRC | 01:40 | |
| *** jamesmcarthur has quit IRC | 01:44 | |
| *** adriant has joined #openstack-infra | 01:48 | |
| *** hongbin has joined #openstack-infra | 02:02 | |
| *** hongbin has quit IRC | 02:02 | |
| *** hongbin has joined #openstack-infra | 02:03 | |
| *** hongbin has quit IRC | 02:03 | |
| *** hongbin has joined #openstack-infra | 02:04 | |
| *** hongbin has quit IRC | 02:04 | |
| *** hongbin has joined #openstack-infra | 02:06 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: package-afs-centos: fix centos8 build https://review.opendev.org/702562 | 02:09 |
| openstackgerrit | Merged openstack/devstack-gate master: Use python3 for virtualenv if exists https://review.opendev.org/702126 | 02:12 |
| *** hamzy_ has joined #openstack-infra | 02:15 | |
| openstackgerrit | sebastian marcet proposed openstack/project-config master: Removed OpenstackId legacy jobs https://review.opendev.org/702572 | 02:23 |
| openstackgerrit | sebastian marcet proposed openstack/openstack-zuul-jobs master: Removed OpenstackId Legacy Jobs https://review.opendev.org/702573 | 02:24 |
| *** jamesmcarthur has joined #openstack-infra | 02:25 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Update ansible-lint https://review.opendev.org/702574 | 02:26 |
| *** jamesmcarthur_ has joined #openstack-infra | 02:28 | |
| *** jamesmcarthur has quit IRC | 02:28 | |
| openstackgerrit | sebastian marcet proposed openstack/project-config master: Removed OpenstackId legacy jobs https://review.opendev.org/702572 | 02:30 |
| *** roman_g has quit IRC | 02:34 | |
| openstackgerrit | sebastian marcet proposed openstack/project-config master: Removed OpenstackId legacy jobs https://review.opendev.org/702572 | 02:35 |
| openstackgerrit | sebastian marcet proposed openstack/openstack-zuul-jobs master: Removed OpenstackId Legacy Jobs https://review.opendev.org/702573 | 02:35 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: package-afs-centos: fix centos8 build https://review.opendev.org/702562 | 02:44 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Update ansible-lint to version 4 https://review.opendev.org/702575 | 02:45 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels: more fixes https://review.opendev.org/702576 | 02:50 |
| ianw | this time for sure | 02:50 |
| *** dychen has joined #openstack-infra | 02:56 | |
| *** dchen has quit IRC | 02:59 | |
| *** rlandy has quit IRC | 03:20 | |
| *** factor has quit IRC | 03:27 | |
| *** dave-mccowan has quit IRC | 03:29 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheels: more fixes https://review.opendev.org/702576 | 03:34 |
| *** tkajinam has quit IRC | 03:48 | |
| *** dave-mccowan has joined #openstack-infra | 03:53 | |
| *** dingyichen has joined #openstack-infra | 03:54 | |
| *** dychen has quit IRC | 03:56 | |
| *** gyee has quit IRC | 03:56 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: openafs-client: add centos8 https://review.opendev.org/702579 | 04:07 |
| *** jamesmcarthur_ has quit IRC | 04:08 | |
| *** jamesmcarthur has joined #openstack-infra | 04:10 | |
| *** rh-jelabarre has quit IRC | 04:11 | |
| *** hongbin_ has joined #openstack-infra | 04:12 | |
| *** hongbin has quit IRC | 04:15 | |
| *** tkajinam has joined #openstack-infra | 04:28 | |
| *** hongbin_ has quit IRC | 04:37 | |
| *** dave-mccowan has quit IRC | 04:42 | |
| *** jamesmcarthur has quit IRC | 04:43 | |
| *** jamesmcarthur has joined #openstack-infra | 04:44 | |
| *** zxiiro has quit IRC | 04:48 | |
| *** jamesmcarthur has quit IRC | 04:50 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: openafs-client: add centos8 https://review.opendev.org/702579 | 05:03 |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheel: package install needs to be root https://review.opendev.org/702583 | 05:06 |
| *** jamesmcarthur has joined #openstack-infra | 05:15 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: openafs-client: add centos8 https://review.opendev.org/702579 | 05:15 |
| *** rosmaita has quit IRC | 05:16 | |
| *** jamesmcarthur has quit IRC | 05:23 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheel: package install needs to be root https://review.opendev.org/702583 | 05:24 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Require JDK 8 for translations https://review.opendev.org/702515 | 05:27 |
| *** rosmaita has joined #openstack-infra | 05:30 | |
| *** evrardjp has quit IRC | 05:34 | |
| *** evrardjp has joined #openstack-infra | 05:34 | |
| *** jamesmcarthur has joined #openstack-infra | 05:57 | |
| *** jamesmcarthur has quit IRC | 06:02 | |
| *** mugsie has quit IRC | 06:11 | |
| *** mugsie has joined #openstack-infra | 06:14 | |
| *** lmiccini has joined #openstack-infra | 06:24 | |
| *** jtomasek has joined #openstack-infra | 06:28 | |
| *** auristor has quit IRC | 06:29 | |
| *** jamesmcarthur has joined #openstack-infra | 06:36 | |
| *** auristor has joined #openstack-infra | 06:39 | |
| *** jamesmcarthur has quit IRC | 06:42 | |
| *** dmsimard has quit IRC | 06:50 | |
| *** dmsimard has joined #openstack-infra | 06:54 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels: fix index build https://review.opendev.org/702591 | 07:07 |
| *** apetrich has quit IRC | 07:11 | |
| *** iurygregory has quit IRC | 07:13 | |
| *** kjackal has joined #openstack-infra | 07:15 | |
| *** KeithMnemonic1 has joined #openstack-infra | 07:15 | |
| *** KeithMnemonic has quit IRC | 07:19 | |
| openstackgerrit | Merged openstack/project-config master: Use Bionic for translation jobs https://review.opendev.org/702516 | 07:23 |
| *** ralonsoh has joined #openstack-infra | 07:27 | |
| *** jtomasek has quit IRC | 07:29 | |
| *** jtomasek has joined #openstack-infra | 07:29 | |
| AJaeger | amotoki: thanks for the Pint change - we'll go to python 3.6 anyway ^ | 07:37 |
| *** jamesmcarthur has joined #openstack-infra | 07:38 | |
| *** jamesmcarthur has quit IRC | 07:43 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheels: fix index build https://review.opendev.org/702591 | 07:45 |
| *** tesseract has joined #openstack-infra | 07:58 | |
| *** tesseract has quit IRC | 07:58 | |
| *** tesseract has joined #openstack-infra | 07:59 | |
| *** kjackal has quit IRC | 08:01 | |
| *** lxkong has quit IRC | 08:06 | |
| *** slaweq has joined #openstack-infra | 08:09 | |
| *** pgaxatte has joined #openstack-infra | 08:17 | |
| *** tosky has joined #openstack-infra | 08:19 | |
| *** dingyichen has quit IRC | 08:19 | |
| *** arxcruz|off is now known as arxcruz | 08:20 | |
| *** iurygregory has joined #openstack-infra | 08:21 | |
| *** rpittau|afk is now known as rpittau | 08:22 | |
| *** dchen has joined #openstack-infra | 08:22 | |
| *** dchen has quit IRC | 08:23 | |
| *** dpawlik has joined #openstack-infra | 08:25 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:38 | |
| *** jamesmcarthur has joined #openstack-infra | 08:39 | |
| *** kjackal has joined #openstack-infra | 08:42 | |
| *** jamesmcarthur has quit IRC | 08:45 | |
| *** tkajinam has quit IRC | 08:48 | |
| *** jpena|off is now known as jpena | 08:50 | |
| *** dmellado has quit IRC | 08:51 | |
| openstackgerrit | Jan Kubovy proposed zuul/zuul master: Add spec for scale out scheduler https://review.opendev.org/621479 | 08:55 |
| *** dmellado has joined #openstack-infra | 08:55 | |
| *** gfidente is now known as gfidente|afk | 08:56 | |
| *** aedc has quit IRC | 09:07 | |
| *** ccamacho has joined #openstack-infra | 09:15 | |
| *** lucasagomes has joined #openstack-infra | 09:16 | |
| *** apetrich has joined #openstack-infra | 09:21 | |
| *** xek has joined #openstack-infra | 09:25 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels: fix index https://review.opendev.org/702604 | 09:31 |
| *** derekh has joined #openstack-infra | 09:36 | |
| *** tonyb has joined #openstack-infra | 09:38 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: copy-wheels: fix index path, remove f-strings https://review.opendev.org/702604 | 09:40 |
| *** jamesmcarthur has joined #openstack-infra | 09:41 | |
| *** pcaruana has joined #openstack-infra | 09:42 | |
| *** jamesmcarthur has quit IRC | 09:46 | |
| *** iurygregory is now known as iury_mtg | 09:50 | |
| openstackgerrit | Merged openstack/project-config master: copy-wheels: fix index path, remove f-strings https://review.opendev.org/702604 | 10:04 |
| *** jaosorior has joined #openstack-infra | 10:12 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/project-config master: Update ansible-lint to version 4.2 https://review.opendev.org/702575 | 10:14 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 10:26 |
| AJaeger | yeah, translation jobs are working again! | 10:30 |
| AJaeger | amotoki: ^ | 10:30 |
| *** dtantsur|afk is now known as dtantsur | 10:32 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/project-config master: Update ansible-lint to version 4.2 https://review.opendev.org/702575 | 10:33 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: JWT drivers: Deprecate RS256withJWKS, introduce OpenIDConnect https://review.opendev.org/701972 | 10:34 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 10:34 |
| openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: DNM try breaking the ironic jobs https://review.opendev.org/702640 | 10:37 |
| *** ahosam has joined #openstack-infra | 10:38 | |
| *** exsdev has quit IRC | 10:39 | |
| *** jamesmcarthur has joined #openstack-infra | 10:42 | |
| *** jamesmcarthur has quit IRC | 10:46 | |
| openstackgerrit | Merged openstack/devstack-gate master: nova: Enable n-cauth on stable/rocky for cells v1 jobs https://review.opendev.org/702089 | 11:03 |
| *** melwitt has quit IRC | 11:09 | |
| *** pcaruana has quit IRC | 11:12 | |
| *** dchen has joined #openstack-infra | 11:21 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Document the buildsets endpoint https://review.opendev.org/702127 | 11:30 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Support dynamic badges https://review.opendev.org/702128 | 11:30 |
| *** pkopec has joined #openstack-infra | 11:34 | |
| *** tbachman has quit IRC | 11:39 | |
| *** jamesmcarthur has joined #openstack-infra | 11:43 | |
| *** jaosorior has quit IRC | 11:46 | |
| *** gfidente|afk is now known as gfidente | 11:47 | |
| *** dave-mccowan has joined #openstack-infra | 11:48 | |
| *** jamesmcarthur has quit IRC | 11:48 | |
| dulek | We're seeing some missing packages on CentOS 8 mirror used by the gate (glibc, glibc-common, glibc-minimal-langpack, platform-python, python3-libs). Is there an OpenDev mirror, or is it more of a real mirror issue? | 11:49 |
| *** dchen has quit IRC | 11:59 | |
| *** iury_mtg has quit IRC | 12:00 | |
| *** iurygregory has joined #openstack-infra | 12:01 | |
| zbr | ianw: https://review.opendev.org/#/c/702575/ is ready. if you need help with ansible-lint in any other place ask me. | 12:03 |
| *** rfolco has joined #openstack-infra | 12:06 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:09 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 12:18 |
| *** ociuhandu has joined #openstack-infra | 12:26 | |
| *** jpena is now known as jpena|lunch | 12:33 | |
| jrosser | getting some unexpected log-files-rendered-as-gzip, like this https://zuul.opendev.org/t/openstack/build/2f9ff8b43a094518a2094471f7fadb61/log/logs/host/python_venv_build.log.txt.gz | 12:35 |
| *** jamesmcarthur has joined #openstack-infra | 12:44 | |
| *** udesale has joined #openstack-infra | 12:45 | |
| amotoki | AJaeger: you're welcome. it was a simple fix. | 12:46 |
| amotoki | AJaeger: btw, both changes on Pint have not been merged yet. how did you fix the translation jobs? | 12:47 |
| *** pcaruana has joined #openstack-infra | 12:49 | |
| amotoki | ah.. I found https://review.opendev.org/702516 has been merged. | 12:49 |
| *** jamesmcarthur has quit IRC | 12:49 | |
| AJaeger | amotoki: yes. Still your Pint changes is good to have. | 12:56 |
| amotoki | AJaeger: yeah. it was a good chance to know Pint is no longer needed in horizon :) | 12:57 |
| amotoki | AJaeger: re: translation jobs, if we cannot change ubuntu version due to JDK reqs of zanata-cli, we can use PPT from "deadsnakes" team who provides other python versions for ubuntu https://launchpad.net/~deadsnakes/+archive/ubuntu/ppa | 12:58 |
| *** cgoncalves has quit IRC | 12:58 | |
| *** ociuhandu has quit IRC | 12:59 | |
| AJaeger | amotoki: we are now on Bionic, so we're fine for a bit - but question is what to do with zanata going forward since it's dead... | 12:59 |
| *** cgoncalves has joined #openstack-infra | 13:00 | |
| *** rh-jelabarre has joined #openstack-infra | 13:00 | |
| *** cgoncalves has quit IRC | 13:04 | |
| amotoki | AJaeger: yes, I know we succeeded to migrate the translation job node to bionic. | 13:05 |
| amotoki | AJaeger: honestly I have no idea on the future of zanata...... I don't have priority on i18n now unfortunately, so I can say nothing. | 13:05 |
| *** rlandy has joined #openstack-infra | 13:05 | |
| AJaeger | same here | 13:09 |
| *** cgoncalves has joined #openstack-infra | 13:10 | |
| *** jamesmcarthur has joined #openstack-infra | 13:15 | |
| *** eharney has quit IRC | 13:20 | |
| *** dpawlik has quit IRC | 13:23 | |
| *** jamesmcarthur has quit IRC | 13:24 | |
| *** jamesmcarthur has joined #openstack-infra | 13:24 | |
| *** aedc has joined #openstack-infra | 13:25 | |
| *** ociuhandu has joined #openstack-infra | 13:27 | |
| smcginnis | No one is active on Zanata anymore? | 13:29 |
| *** dave-mccowan has quit IRC | 13:33 | |
| *** jpena|lunch is now known as jpena | 13:35 | |
| *** jamesmcarthur has quit IRC | 13:36 | |
| amotoki | AFAIK redhat closed zanata development two? years ago, so zanata no longer has active developers. | 13:36 |
| smcginnis | Yikes | 13:37 |
| smcginnis | I didn't see anything in zanata-cli that looked too complicated to not be able to work with JDK 11, but it's been many years since I've touched Java code. | 13:37 |
| smcginnis | Maybe worth sending something to the ML looking for anyone interested in picking up some work there to get it updated? | 13:38 |
| *** dave-mccowan has joined #openstack-infra | 13:39 | |
| *** liuyulong has joined #openstack-infra | 13:42 | |
| amotoki | if it is only about zanata-cli, we can directly talk with zanata, for example, using requests. I think most worried part is the server side of zanata. | 13:46 |
| *** jamesmcarthur has joined #openstack-infra | 13:47 | |
| amotoki | I agree it is worth sending a mail for volunteer(s). I've not be involved in Zanata in OpenStack. I think Ian or Frank can raise it. | 13:51 |
| *** mnaser has quit IRC | 13:54 | |
| *** mnaser has joined #openstack-infra | 13:55 | |
| *** rfolco has quit IRC | 14:00 | |
| *** rfolco has joined #openstack-infra | 14:01 | |
| *** jackedin has joined #openstack-infra | 14:01 | |
| *** eharney has joined #openstack-infra | 14:01 | |
| *** hrybacki has quit IRC | 14:03 | |
| *** hrybacki has joined #openstack-infra | 14:03 | |
| *** rcernin has quit IRC | 14:04 | |
| *** jackedin_ has joined #openstack-infra | 14:15 | |
| *** avladu has joined #openstack-infra | 14:17 | |
| *** jackedin has quit IRC | 14:17 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 14:18 |
| avladu | hello, can someone review and +2/workflow, please? https://review.opendev.org/#/c/702259/ It already has one +2 | 14:19 |
| *** jungleboyj has quit IRC | 14:20 | |
| *** jungleboyj has joined #openstack-infra | 14:21 | |
| *** jackedin_ has quit IRC | 14:21 | |
| *** jackedin has joined #openstack-infra | 14:24 | |
| *** sshnaidm|afk is now known as sshnaidm | 14:39 | |
| openstackgerrit | Lucian Petrut proposed openstack/project-config master: Update compute-hyperv test jobs https://review.opendev.org/702673 | 14:40 |
| *** jamesmcarthur has quit IRC | 14:40 | |
| *** lseki has quit IRC | 14:44 | |
| *** diablo_rojo_phon has quit IRC | 14:44 | |
| *** lseki has joined #openstack-infra | 14:44 | |
| *** dpawlik has joined #openstack-infra | 14:45 | |
| *** diablo_rojo_phon has joined #openstack-infra | 14:49 | |
| *** electrofelix has joined #openstack-infra | 14:49 | |
| *** smarcet has joined #openstack-infra | 14:50 | |
| *** aedc has quit IRC | 14:52 | |
| openstackgerrit | Lucian Petrut proposed openstack/project-config master: Update compute-hyperv test jobs https://review.opendev.org/702673 | 14:57 |
| *** ociuhandu has quit IRC | 15:01 | |
| openstackgerrit | Merged openstack/project-config master: New charm for watcher https://review.opendev.org/702071 | 15:01 |
| *** rfolco is now known as rfolco|bbl | 15:03 | |
| *** avladu has quit IRC | 15:03 | |
| *** apetrich has quit IRC | 15:07 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Bump ansible-lint to 4.2.0 https://review.opendev.org/702679 | 15:07 |
| *** eernst has quit IRC | 15:07 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new application https://review.opendev.org/702106 | 15:07 |
| fungi | smcginnis: amotoki: yes, we've already had a fairly major security vulnerability crop up in zanata after it was abandoned: https://review.opendev.org/693477 | 15:11 |
| fungi | dulek: do you have an example log where it shows the failure to retrieve those packages? i can take a look | 15:11 |
| smcginnis | Yeee | 15:12 |
| dulek | fungi: Sure, on the bottom: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_408/696657/18/check/kuryr-kubernetes-tempest-containerized/408c49d/controller/logs/devstacklog.txt | 15:12 |
| openstackgerrit | Merged zuul/zuul-helm master: Add option to manage secrets outside of helm https://review.opendev.org/702052 | 15:13 |
| dulek | fungi: But now I wonder if it wasn't caused by recent update to centos containers on DockerHub and 8.1 release. | 15:13 |
| dulek | fungi: I'm trying to figure that out at the moment. | 15:13 |
| dulek | fungi: BTW some context - this happens during container build. | 15:13 |
| fungi | jrosser: there was a necessary change in handling of compressed log files, jobs should not compress logs on their own now if you want them to be viewable in a browser (this was to solve a problem where tarballs were getting silently decompressed on download without changing their filenames to drop the .gz extension) | 15:13 |
| jrosser | hmm ok we need to change a *lot* of stuff then :) | 15:14 |
| openstackgerrit | Merged zuul/zuul-helm master: Add Zuul charts https://review.opendev.org/700460 | 15:14 |
| openstackgerrit | Merged zuul/zuul-helm master: Allow tenant config file to be managed externally https://review.opendev.org/702057 | 15:14 |
| openstackgerrit | Merged zuul/zuul-helm master: Allow override of service type for zuul-web https://review.opendev.org/702101 | 15:14 |
| fungi | jrosser: zuul will still compress the logs when it uploads them to swift, and swift will serve them with appropriate content encoding headers | 15:14 |
| fungi | we patched the common cases we knew about, but there are likely some project-specific jobs which also need adjusting | 15:15 |
| jrosser | sure, i think i know where ours are | 15:15 |
| fungi | dulek: i think you're right. our mirror is for centos 8.1 not 8.0, so has for example glibc-2.28-42.el8.1.x86_64.rpm (el8.1 not el8) | 15:19 |
| fungi | we mirror and build base images for whatever the latest centos 8 version is, we don't maintain separate images and mirrors for minor release versions of centos | 15:19 |
| fungi | http://files.openstack.org/mirror/centos/8/BaseOS/x86_64/os/Packages/ | 15:20 |
| fungi | in case you wanted to inspect what's in there | 15:20 |
| dulek | fungi: Okay, I'll try to figure this out and will update you if I'll make any sense of it. At the moment it seems to me like DockerHub just doesn't have x86 images for 8.1, but I'm getting more and more confused here. | 15:20 |
| dulek | fungi: Thanks! | 15:20 |
| *** jamesmcarthur has joined #openstack-infra | 15:22 | |
| fungi | can't 8.0 install 8.1 packages? | 15:22 |
| *** ociuhandu has joined #openstack-infra | 15:28 | |
| *** pkopec_ has joined #openstack-infra | 15:29 | |
| *** pkopec has quit IRC | 15:29 | |
| dulek | Those packages have versions defined in dependencies, so I'm guessing there's a mismatch there. | 15:30 |
| *** dpawlik has quit IRC | 15:33 | |
| openstackgerrit | Merged openstack/project-config master: x/cloudbase-init: remove openstack gates https://review.opendev.org/702259 | 15:37 |
| *** ociuhandu has quit IRC | 15:39 | |
| *** ociuhandu has joined #openstack-infra | 15:40 | |
| *** eharney has quit IRC | 15:48 | |
| *** eharney has joined #openstack-infra | 15:52 | |
| *** udesale_ has joined #openstack-infra | 15:54 | |
| *** efried is now known as efried_afk | 15:56 | |
| *** ykarel has joined #openstack-infra | 15:57 | |
| *** udesale has quit IRC | 15:57 | |
| *** zxiiro has joined #openstack-infra | 15:57 | |
| clarkb | dulek: fungi is it possible the centos repo is in a transition state between 8.0 and 8.1? | 15:59 |
| clarkb | we've seen that happen in the past with other centos releases I think | 15:59 |
| fungi | i wouldn't rule it out | 15:59 |
| fungi | basically centos periodically breaks the ability of their users to perform package updates while they're switching between minor versions? | 16:00 |
| *** melwitt has joined #openstack-infra | 16:00 | |
| fungi | debian does this, but the impact is limited to the unstable suite | 16:00 |
| dulek | clarkb: Well, technically it all works fine on my local system. How often are infra mirrors updated? | 16:01 |
| * fungi checks | 16:01 | |
| clarkb | I believe every 4 hours | 16:01 |
| clarkb | and we pull from a second level mirror too | 16:01 |
| clarkb | so depending on when that mirror updates it could compound | 16:01 |
| fungi | 43 */2 * * * | 16:01 |
| clarkb | its pretty easy to compare the package lists upstream | 16:02 |
| fungi | so 43 minutes after the hour every two hours (on even hours) | 16:02 |
| dulek | Okay, so that would get fixed if that was the only reason. | 16:02 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 16:02 |
| fungi | last vos release for that volume was 2020-01-15T15:37:47 | 16:02 |
| fungi | utc | 16:02 |
| fungi | so less than half an hour ago | 16:03 |
| *** gyee has joined #openstack-infra | 16:03 | |
| clarkb | compare http://mirror.dfw.rax.openstack.org/centos/8/BaseOS/x86_64/os/Packages/ to http://mirror.centos.org/centos/8/BaseOS/x86_64/os/Packages/ | 16:03 |
| clarkb | the first package in the list is different | 16:03 |
| fungi | on that pulse, rsync said: | 16:04 |
| clarkb | so ya that implies to me that there is desync happening | 16:04 |
| fungi | sent 581 bytes received 2,336,497 bytes 150,779.23 bytes/sec | 16:04 |
| fungi | total size is 43,538,322,424 speedup is 18,629.38 | 16:04 |
| fungi | we retrieved from mirror.dal.nexril.net | 16:05 |
| fungi | so it may have synced from elsewhere mid-update too | 16:05 |
| openstackgerrit | Merged zuul/zuul master: Fix nits from initial reorg https://review.opendev.org/702532 | 16:06 |
| fungi | http://mirror.dal.nexril.net/centos/8/BaseOS/x86_64/os/Packages/ | 16:06 |
| *** armax has joined #openstack-infra | 16:07 | |
| fungi | in theory our mirrors ~match that one for the moment | 16:07 |
| dulek | Just a data point - this happens for at least 7 hours. | 16:07 |
| fungi | yeah, i'm starting to suspect that mirror.dal.nexril.net grabbed a snapshot of the master centos mirror when it was in the middle of getting centos 8.0 packages swapped out for 8.1 | 16:08 |
| fungi | so we're synchronizing to a broken "official" centos mirror | 16:08 |
| fungi | (in theory) | 16:09 |
| *** kjackal has quit IRC | 16:09 | |
| *** kjackal has joined #openstack-infra | 16:09 | |
| dulek | mirror.dal.nexril.net seems different than mirror.centos.org - i.e. it has el8.1 packages. | 16:10 |
| clarkb | dulek: yes see above :) | 16:10 |
| clarkb | dulek: and we then sync from that | 16:10 |
| clarkb | so we are different | 16:10 |
| clarkb | (we don't pull directly from upstream because only those official mirrors are supposed to do that aiui) | 16:11 |
| dulek | clarkb: Yes, yes, I'm just trying to figure out if you will keep mirroring 8.0 or want to switch to 8.1? | 16:11 |
| clarkb | dulek: we want to track "8" which means latest 8.x | 16:11 |
| clarkb | because older 8.y is no longer supported when newer 8.x is released | 16:11 |
| clarkb | we can wait for our upstream to catch up or look for a better upstream | 16:12 |
| dulek | clarkb: Okay, good. And the centos.org centos/8/BaseOS works for us. | 16:12 |
| clarkb | another option would be to contact that mirror and ask them to resync | 16:12 |
| dulek | clarkb: I guess making that decision is our of my competence level. This breaks kuryr-kubernetes CI, but most contributors are from Europe and it's already EOD here, so I guess no hurry. | 16:14 |
| fungi | or we could switch to a different rsync mirror which isn't broken | 16:14 |
| clarkb | fungi: ya I want to say we've used limestone in the past due to locality and having logan- here | 16:15 |
| clarkb | I don't recall what prompted the switch from that mirror | 16:15 |
| fungi | there's also a long-standing todo to add a package repository checker which would analyze the dependencies in the rpms and refuse to release the volume until they reach consistency | 16:15 |
| *** lmiccini has quit IRC | 16:16 | |
| openstackgerrit | Merged openstack/project-config master: New repo: "ideas" https://review.opendev.org/701530 | 16:16 |
| *** jackedin has quit IRC | 16:17 | |
| *** hrw has joined #openstack-infra | 16:21 | |
| hrw | morning | 16:21 |
| hrw | can someone help me with understanding http://zuul.openstack.org/buildset/2e228315d13f4c7a887734e74fded1d5 failure? was because kolla-publish-debian-source-multiarch-aarch64 ended with POST_FAILURE because it took 5h? or was it other reason? | 16:22 |
| hrw | if it is this then I will remove that job | 16:22 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Making zuul-jobs-test-multinode-roles-opensuse-tumbleweed nv https://review.opendev.org/702693 | 16:23 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Bump ansible-lint to 4.2.0 https://review.opendev.org/702679 | 16:24 |
| clarkb | hrw: 2020-01-15 10:46:04.526946 | POST-RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/kolla/tests/playbooks/publish.yml@master] | 16:25 |
| clarkb | from the job-output.txt file | 16:25 |
| hrw | thanks. somehow missed that part | 16:25 |
| evrardjp | thanks clarkb AJaeger | 16:25 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: JWT drivers: Deprecate RS256withJWKS, introduce OpenIDConnect https://review.opendev.org/701972 | 16:26 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 16:26 |
| clarkb | seems it spent three hours pushing docker images | 16:26 |
| fungi | very large images? | 16:26 |
| hrw | I suspect that linaro-london pipe is new bottleneck there | 16:26 |
| hrw | same amount pushed from x86-64 job in ~50 minutes | 16:27 |
| hrw | will discuss it internally and remove job from CI as it makes no sense to keep it | 16:27 |
| *** pgaxatte has quit IRC | 16:30 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Extract project config YAML into ref docs https://review.opendev.org/701977 | 16:32 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new application https://review.opendev.org/702106 | 16:32 |
| fungi | now that the zuul operator call has wrapped up, i'm going to go out for lunch but should be back in an hour | 16:34 |
| openstackgerrit | sebastian marcet proposed openstack/project-config master: Removed OpenstackId legacy jobs https://review.opendev.org/702572 | 16:38 |
| *** hrw has left #openstack-infra | 16:38 | |
| *** ociuhandu has quit IRC | 16:39 | |
| *** ociuhandu has joined #openstack-infra | 16:39 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Making zuul-jobs-test-multinode-roles-opensuse-tumbleweed nv https://review.opendev.org/702693 | 16:39 |
| dulek | fungi, clarkb: Seems like mirror.dal.nexril.net just resynched correctly. | 16:40 |
| zbr | AJaeger: does https://review.opendev.org/#/c/702693 makes sense? | 16:41 |
| zbr | it should prevent other accidental modification of that file. | 16:41 |
| *** lsell has quit IRC | 16:42 | |
| *** lsell has joined #openstack-infra | 16:42 | |
| *** openstackgerrit has quit IRC | 16:43 | |
| *** pcaruana has quit IRC | 16:45 | |
| *** udesale_ has quit IRC | 16:45 | |
| clarkb | dulek: cool and I think at 16:43UTC we would've started a new sync so we should be up to date shortly | 16:46 |
| dulek | clarkb: Yup! Meanwhile it seems that Kuryr gate works, so probably it was using another mirror, which suffered the same desynch. | 16:47 |
| dulek | Weird that yum does not indicate which mirror is used. | 16:48 |
| *** openstackgerrit has joined #openstack-infra | 16:48 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Stop compressing files during intermediate steps part 2 https://review.opendev.org/701282 | 16:48 |
| dulek | Anyway thanks for help! | 16:48 |
| *** clayg has quit IRC | 16:49 | |
| *** clayg has joined #openstack-infra | 16:49 | |
| *** beisner has quit IRC | 16:50 | |
| *** beisner has joined #openstack-infra | 16:50 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 16:50 |
| *** eernst has joined #openstack-infra | 16:55 | |
| *** ociuhandu has quit IRC | 16:59 | |
| *** ykarel is now known as ykarel|away | 17:01 | |
| *** lucasagomes has quit IRC | 17:02 | |
| openstackgerrit | Clément Mondion proposed zuul/nodepool master: add requirements for json logging https://review.opendev.org/702704 | 17:03 |
| *** iurygregory has quit IRC | 17:04 | |
| openstackgerrit | Merged opendev/system-config master: afs-client: move reduced cache to group variable https://review.opendev.org/698128 | 17:05 |
| openstackgerrit | Merged opendev/system-config master: Periodically release additional AFS volumes https://review.opendev.org/699163 | 17:05 |
| *** ykarel|away has quit IRC | 17:07 | |
| *** ociuhandu has joined #openstack-infra | 17:08 | |
| *** gmann has quit IRC | 17:09 | |
| *** gmann has joined #openstack-infra | 17:10 | |
| *** iurygregory has joined #openstack-infra | 17:14 | |
| *** jcoufal has joined #openstack-infra | 17:15 | |
| *** rpittau is now known as rpittau|afk | 17:15 | |
| *** tesseract has quit IRC | 17:26 | |
| *** iurygregory has quit IRC | 17:26 | |
| *** arxcruz is now known as arxcruz|off | 17:29 | |
| *** guilhermesp has quit IRC | 17:31 | |
| *** guilhermesp has joined #openstack-infra | 17:32 | |
| *** ociuhandu has quit IRC | 17:33 | |
| *** evrardjp has quit IRC | 17:34 | |
| *** evrardjp has joined #openstack-infra | 17:34 | |
| *** dtantsur is now known as dtantsur|afk | 17:35 | |
| fungi | dulek: i would take that as a sign that it's worth looking into why those jobs aren't using the local ci mirrors as well. you may get some helpful speed improvements from fixing that | 17:49 |
| fungi | and possibly stability improvements | 17:49 |
| *** npochet has quit IRC | 17:49 | |
| fungi | but also that's a great demonstration that our mirrors are only as good as whatever they're mirroring from | 17:49 |
| *** smarcet has quit IRC | 17:49 | |
| *** npochet has joined #openstack-infra | 17:50 | |
| *** jpena is now known as jpena|off | 17:57 | |
| *** eernst has quit IRC | 17:58 | |
| *** eernst has joined #openstack-infra | 18:00 | |
| *** electrofelix has quit IRC | 18:07 | |
| *** derekh has quit IRC | 18:08 | |
| clarkb | thinking out loud here. I wonder if centos updates so infrequently that we should just update after each minor release? | 18:08 |
| clarkb | I don't know how often packages get updated between releases | 18:09 |
| clarkb | I guess the risk with that is if our images update before our mirror updates then we have newer packages on the images than in the mirror | 18:10 |
| *** ociuhandu has joined #openstack-infra | 18:14 | |
| *** smarcet has joined #openstack-infra | 18:15 | |
| *** xek_ has joined #openstack-infra | 18:18 | |
| *** eernst has quit IRC | 18:18 | |
| *** eernst has joined #openstack-infra | 18:19 | |
| *** ociuhandu has quit IRC | 18:19 | |
| *** xek has quit IRC | 18:20 | |
| *** smarcet has quit IRC | 18:21 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Revert "Disable compression of files in stage-output role" https://review.opendev.org/702715 | 18:22 |
| fungi | well, and more specifically that attempts to install additional packages result in the packages on the mirror depending on older versions of things than are already installed on the rootfs, leading to yum/dnf failing to install them | 18:22 |
| *** smarcet has joined #openstack-infra | 18:23 | |
| clarkb | infra-root ^ that should conclude our compression settings changes. zuul-jobs now sets that var to false by default so we can rely on role defaults | 18:23 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Update sdk to v0.13.0 and install dhall-to-json https://review.opendev.org/702103 | 18:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Import dhall-operator https://review.opendev.org/702104 | 18:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Import zuul application from dhall-zuul https://review.opendev.org/702105 | 18:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new application https://review.opendev.org/702106 | 18:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Generate TLS certificats for the gearman service https://review.opendev.org/702716 | 18:25 |
| *** eharney has quit IRC | 18:26 | |
| sean-k-mooney | donnyd: is FN still disabled as a provider by the way or have you been able to resolve your power issues | 18:26 |
| *** eernst has quit IRC | 18:28 | |
| *** eernst has joined #openstack-infra | 18:28 | |
| *** rfolco|bbl is now known as rfolco | 18:28 | |
| sean-k-mooney | looking at http://grafana.openstack.org/d/3Bwpi5SZk/nodepool-fortnebula?orgId=1 ill assume it is disabled | 18:29 |
| *** TheJulia has quit IRC | 18:29 | |
| *** mwhahaha has quit IRC | 18:30 | |
| *** rpittau|afk has quit IRC | 18:30 | |
| *** vdrok has quit IRC | 18:30 | |
| *** cjohnston has quit IRC | 18:30 | |
| *** seongsoocho has quit IRC | 18:30 | |
| *** masayukig has quit IRC | 18:30 | |
| *** evgenyl has quit IRC | 18:30 | |
| *** coreycb has quit IRC | 18:30 | |
| *** cyberpear has quit IRC | 18:30 | |
| *** zxiiro has quit IRC | 18:30 | |
| *** donnyd has quit IRC | 18:30 | |
| *** csatari has quit IRC | 18:30 | |
| *** jamespage has quit IRC | 18:30 | |
| *** thedac has quit IRC | 18:30 | |
| *** tdasilva has quit IRC | 18:30 | |
| *** sdoran has quit IRC | 18:30 | |
| *** npochet has quit IRC | 18:30 | |
| *** ildikov has quit IRC | 18:31 | |
| *** srwilkers has quit IRC | 18:31 | |
| *** arne_wiebalck_ has joined #openstack-infra | 18:31 | |
| *** rpioso has quit IRC | 18:31 | |
| *** mnaser has quit IRC | 18:31 | |
| *** thedac has joined #openstack-infra | 18:31 | |
| *** MarkMaglana has quit IRC | 18:31 | |
| *** donnyd has joined #openstack-infra | 18:31 | |
| *** davidlenwell has quit IRC | 18:31 | |
| *** tonyb[m] has quit IRC | 18:31 | |
| *** arne_wiebalck has quit IRC | 18:31 | |
| *** Shrews has quit IRC | 18:31 | |
| *** arne_wiebalck_ is now known as arne_wiebalck | 18:31 | |
| *** jamespage has joined #openstack-infra | 18:32 | |
| *** diablo_rojo_phon has quit IRC | 18:32 | |
| *** TheJulia has joined #openstack-infra | 18:32 | |
| *** cjohnston has joined #openstack-infra | 18:32 | |
| *** cyberpear has joined #openstack-infra | 18:32 | |
| *** seongsoocho has joined #openstack-infra | 18:32 | |
| *** openstackstatus has quit IRC | 18:32 | |
| *** mwhahaha has joined #openstack-infra | 18:32 | |
| *** coreycb has joined #openstack-infra | 18:33 | |
| *** vdrok has joined #openstack-infra | 18:33 | |
| *** ildikov has joined #openstack-infra | 18:33 | |
| *** tdasilva has joined #openstack-infra | 18:33 | |
| *** csatari has joined #openstack-infra | 18:33 | |
| *** johnsom has quit IRC | 18:33 | |
| *** crodriguez has quit IRC | 18:33 | |
| *** tosky has quit IRC | 18:33 | |
| *** npochet has joined #openstack-infra | 18:33 | |
| clarkb | sean-k-mooney: yes I believe it was disabled due to the mirror flakyness after power work | 18:34 |
| *** mnaser has joined #openstack-infra | 18:34 | |
| *** eernst has quit IRC | 18:34 | |
| *** srwilkers has joined #openstack-infra | 18:34 | |
| *** crodriguez has joined #openstack-infra | 18:34 | |
| *** smarcet has quit IRC | 18:34 | |
| *** rpioso has joined #openstack-infra | 18:34 | |
| *** davidlenwell has joined #openstack-infra | 18:34 | |
| *** tonyb[m] has joined #openstack-infra | 18:35 | |
| *** Shrews has joined #openstack-infra | 18:35 | |
| *** sdoran has joined #openstack-infra | 18:35 | |
| *** johnsom has joined #openstack-infra | 18:35 | |
| *** masayukig has joined #openstack-infra | 18:35 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:38 | |
| *** csatari has quit IRC | 18:38 | |
| *** eharney has joined #openstack-infra | 18:38 | |
| openstackgerrit | Carlos Goncalves proposed openstack/diskimage-builder master: Fix Yum repositories and GPG keys for CentOS 8.1 https://review.opendev.org/702721 | 18:39 |
| *** rcernin has joined #openstack-infra | 18:40 | |
| *** crodriguez has quit IRC | 18:40 | |
| *** TheJulia has quit IRC | 18:40 | |
| *** jamespage has quit IRC | 18:40 | |
| *** thedac has quit IRC | 18:40 | |
| *** lathiat has quit IRC | 18:40 | |
| *** donnyd has quit IRC | 18:40 | |
| *** thedac has joined #openstack-infra | 18:42 | |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: DNM debugging centos 8.1 updates https://review.opendev.org/702722 | 18:42 |
| *** donnyd has joined #openstack-infra | 18:42 | |
| *** tdasilva has quit IRC | 18:43 | |
| *** cyberpear has quit IRC | 18:43 | |
| openstackgerrit | Clark Boylan proposed openstack/diskimage-builder master: DNM debugging centos 8.1 updates https://review.opendev.org/702722 | 18:43 |
| cgoncalves | clarkb, see https://review.opendev.org/702721 | 18:43 |
| clarkb | cgoncalves: oh gool | 18:44 |
| clarkb | er cool | 18:44 |
| *** jamesmcarthur has quit IRC | 18:44 | |
| clarkb | cgoncalves: that populates /etc/yum.repos.d/ I take it | 18:45 |
| cgoncalves | correct. tested building an octavia image too | 18:45 |
| openstackgerrit | Merged openstack/project-config master: Revert "Disable compression of files in stage-output role" https://review.opendev.org/702715 | 18:46 |
| *** slaweq has quit IRC | 18:47 | |
| sean-k-mooney | clarkb: cool thanks if you think of it can you ping me when its back. no rush just we have 1 job that only runs there however we dont have anything urgnet either so it can wait | 18:48 |
| clarkb | cgoncalves: re paul's question on that change shoudl we install those packages only if the version is exactl 8 or >=8.1? | 18:51 |
| clarkb | cgoncalves: excluding 8.0* | 18:52 |
| cgoncalves | clarkb, do we need to support 8.0 when a newer .y version is out? | 18:52 |
| clarkb | cgoncalves: I think users shouldn't install 8.0 when a newer .y is available, but my hunch is that people will need it | 18:53 |
| cgoncalves | centos-minimal installs centos "8" and that is latest .y | 18:53 |
| clarkb | cgoncalves: ya but you can set the dib version to 8.0 and get 8.0 I think | 18:53 |
| clarkb | or rather 8.0.1905 | 18:53 |
| cgoncalves | not so sure users can set different DIB_RELEASE other than "7" and "8" | 18:55 |
| *** efried_afk is now known as efried | 18:55 | |
| clarkb | cgoncalves: ok confirmed that centos-minimal README says set to 7 or 8 | 18:56 |
| openstackgerrit | Merged opendev/system-config master: Update registry testing to use LE https://review.opendev.org/702541 | 18:56 |
| clarkb | given that I think it is ok to merge as is then if people want to add support for 8.0.* its another set of changes | 18:57 |
| cgoncalves | right | 18:57 |
| *** thedac has quit IRC | 18:58 | |
| clarkb | I'll leave that note on the change | 18:58 |
| zbr | afaik, "centos-8" reads as latest 8.x version, a not 8.0 (since two hours ago). if anyone wants 8.0 exactly they will need new jobs. Makes sense? | 18:58 |
| clarkb | zbr: they will need to update dib yes | 18:58 |
| zbr | clarkb: I am watching your change. | 18:59 |
| clarkb | zbr: cgoncalves change is the fix https://review.opendev.org/702721 | 18:59 |
| *** thedac has joined #openstack-infra | 19:00 | |
| *** cyberpear has joined #openstack-infra | 19:00 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: install-kubernetes: disable docker userland proxy https://review.opendev.org/702723 | 19:01 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: DNM: test without docker userland proxy https://review.opendev.org/702724 | 19:02 |
| AJaeger | clarkb: could you review https://review.opendev.org/#/c/702571/ , https://review.opendev.org/#/c/702572/ and https://review.opendev.org/#/c/702573/ for openstackid jobs, please? | 19:06 |
| openstackgerrit | Merged zuul/zuul master: Add note about GitHub Action limitations https://review.opendev.org/702503 | 19:08 |
| *** sshnaidm|afk is now known as sshnaidm | 19:09 | |
| *** thedac has quit IRC | 19:10 | |
| *** openstackstatus has joined #openstack-infra | 19:22 | |
| *** ChanServ sets mode: +v openstackstatus | 19:22 | |
| fungi | #status log restarted statusbot service on eavesdrop.o.o to recover following a 18:32z ctcp ping timeout | 19:22 |
| openstackstatus | fungi: finished logging | 19:22 |
| rosmaita | hello infra people ... i need some help configuring the .zuul.yaml for python-cinderclient | 19:22 |
| rosmaita | i've got the functional-py36 job working, but the functional-py37 job is failing with a retry_limit | 19:22 |
| rosmaita | only difference in config is that the py37 job specifies nodeset: ubuntu-bionic | 19:22 |
| rosmaita | i'm seeing this when it does the write-devstack-local-conf task: | 19:22 |
| rosmaita | The task includes an option with an undefined variable. The error was: \"hostvars['controller']\" is undefined | 19:22 |
| rosmaita | and then it skips the RUN phase and goes directly to POST-RUN | 19:22 |
| rosmaita | here's the patch where it's happening: https://review.opendev.org/#/c/691467/ | 19:22 |
| rosmaita | thanks! | 19:22 |
| clarkb | rosmaita: chances are there is no python3.7 available | 19:24 |
| * clarkb loks | 19:24 | |
| clarkb | rosmaita: ah yup its going to be the nodeset | 19:25 |
| clarkb | this is a devstack based job so it expects a devstack compatible nodeset | 19:25 |
| rosmaita | shoot, i thought bionic always had py3.7 | 19:25 |
| clarkb | rosmaita: its installable but not there by default | 19:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Dockerfile: add support for arbritary uid https://review.opendev.org/650246 | 19:25 |
| rosmaita | clarkb: can you point me to an example of how i would install it? | 19:26 |
| clarkb | rosmaita: https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L11-L19 try using that nodeset | 19:26 |
| rosmaita | ty | 19:26 |
| clarkb | I think the tox py37 jobs are expected to list python37 packages in bindep | 19:27 |
| clarkb | I don't know if that has been plumbed into devstack at all | 19:27 |
| clarkb | I would see if the qa team knows | 19:27 |
| rosmaita | clarkb: thanks | 19:28 |
| fungi | clarkb: i thought we got to the point where the ensure_python role was actually installing it, but a lot of the tox jobs in the openstack-zuul-jobs repo weren't setting the right variable to make that happen | 19:34 |
| clarkb | oh that could be | 19:34 |
| fungi | simply because they predated that feature | 19:34 |
| fungi | and didn't get revisited | 19:34 |
| clarkb | rosmaita: ^ you may be able to use the ensure_python role in those jobs to get the version you want | 19:34 |
| AJaeger | rosmaita: see change I46d6780a5a32c443c37ef040b2af2459641dd123 as well, maybe setting python_version is enough | 19:36 |
| *** iurygregory has joined #openstack-infra | 19:36 | |
| *** dklyle has quit IRC | 19:36 | |
| rosmaita | clarkb: ok, i will try that too -- will i still need to specify a nodeset, or will zuul figure that out? | 19:36 |
| AJaeger | (if your job uses ensure_python already) | 19:36 |
| *** ociuhandu has joined #openstack-infra | 19:36 | |
| rosmaita | AJaeger: thanks, i am not using ensure_python | 19:36 |
| clarkb | rosmaita: you need to specify the nodeset because the devstack jobs expect a specific host topology | 19:36 |
| clarkb | rosmaita: you need the controller group at the very least (which the nodeset I linked to provides) | 19:37 |
| rosmaita | ok, cool, so both changes -- thanks! | 19:37 |
| *** dklyle has joined #openstack-infra | 19:37 | |
| *** dklyle has quit IRC | 19:37 | |
| AJaeger | rosmaita: openstack-zuul-jobs sets python_version for the functional job, so it should be installed... | 19:37 |
| *** dklyle has joined #openstack-infra | 19:38 | |
| AJaeger | rosmaita: no, just change the nodeset. | 19:38 |
| AJaeger | ah, you're not parenting to openstack-tox-functional-py37, so then you need python_version | 19:39 |
| *** jcoufal has quit IRC | 19:39 | |
| rosmaita | ok | 19:40 |
| AJaeger | rosmaita: but all depends on the job inheritance. Sorry, no time to check this further. | 19:41 |
| AJaeger | I meant: no time tonight. | 19:41 |
| rosmaita | ok, well y'all have given me some stuff to try out | 19:41 |
| rosmaita | i will bug you tomorrow if i don't get it working :) | 19:41 |
| AJaeger | quick look: Seems ensure-python is not used | 19:41 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: DNM: test without docker userland proxy https://review.opendev.org/702724 | 19:51 |
| *** jamespage has joined #openstack-infra | 19:52 | |
| *** jamespage has quit IRC | 19:52 | |
| *** MarkMaglana has joined #openstack-infra | 20:07 | |
| *** TheJulia has joined #openstack-infra | 20:08 | |
| smcginnis | I thought there was a patch up to make sure ensure_python installed the version if needed. | 20:12 |
| smcginnis | I at least remember it being discussed a few weeks back. | 20:13 |
| clarkb | smcginnis: in devstack jobs? | 20:13 |
| clarkb | smcginnis: I think that is the disconnnect here. That job is a devstack job | 20:13 |
| smcginnis | Wherever that role is defined. | 20:13 |
| clarkb | the ensure_python stuff that happened is in the tox jobs | 20:13 |
| clarkb | they are disjoint because one basically just runs tox and the other installs openstack with devstack then runs stuff | 20:13 |
| smcginnis | I think it was the tox one. I can't recall the situation, but I think the failure under question was not a devstack job. Someone at least said "we should make sure the base ensure_python role installs the version if it's needed", but I don't recall the specifics now. | 20:14 |
| *** ccamacho has quit IRC | 20:16 | |
| AJaeger | smcginnis: see change I46d6780a5a32c443c37ef040b2af2459641dd123 for what we did | 20:17 |
| ianw | clarkb: i've made a mess of the wheel generation. i now realise that we only create the final structure on afs which means very slow indexing. i'm going to have to go for version 3 with larger changes to create and move folders rather than files | 20:17 |
| ianw | AJaeger: i know you looked at trusty some more last year ... can we kill it? | 20:18 |
| smcginnis | AJaeger: Thanks - that was the one. | 20:18 |
| ianw | it would be great to not build wheels for it as it's the only python3.5 (even centos7 has python3.6 in epel) | 20:18 |
| clarkb | ianw: I think at this point trusty is largely a small number of infra jobs | 20:19 |
| clarkb | AJaeger cleaned up fueld which was a big consumer | 20:19 |
| clarkb | and we've deleted the infra trusty jobs we don't need | 20:19 |
| *** jamesmcarthur has joined #openstack-infra | 20:19 | |
| AJaeger | ianw: there are a few uses for infra jobs ;( | 20:19 |
| clarkb | AJaeger: ianw chances are we don't need the wheels in those jobs though | 20:20 |
| clarkb | (and simply rely on pypi) | 20:20 |
| ianw | ok, well wheels probably aren't important there, i think we can kill that path | 20:20 |
| rosmaita | clarkb: when you have a minute -- what would be the exact syntax for adding ensure-python to the job defined at line 22 here: https://review.opendev.org/#/c/691467/17/.zuul.yaml | 20:20 |
| AJaeger | ianw: check openstack-zuul-jobs repo - that's the main user | 20:20 |
| AJaeger | https://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/zuul-legacy-jobs.yaml | 20:20 |
| ianw | thanks, will do | 20:20 |
| clarkb | rosmaita: you want to add it to https://opendev.org/openstack/python-cinderclient/src/branch/master/playbooks/python-cinderclient-functional.yaml#L2 | 20:21 |
| ianw | infra-root: also, some eyes on https://review.opendev.org/#/c/702579/ to add centos8 openafs builds would be great | 20:21 |
| fungi | any trusty jobs which are lingering solely due to wiki.openstack.org can go away. it's not puppeted anyway, and the -dev server (which is somewhat puppeted) runs on xenial | 20:21 |
| ianw | the only trick is that for some reason kstart isn't in epel8, i have a temporary copr repo with it and have filed and upstream bug | 20:21 |
| AJaeger | legacy-gearman-plugin-maven-build-ubuntu-trusty, legacy-puppet-openstack-infra-spec-helper-unit-ubuntu-trusty, legacy-zmq-event-publisher-maven-build-ubuntu-trusty | 20:22 |
| clarkb | ianw: see also dib centos-8 problems. cgoncalves wrote a fix which I have approved. Will need a release | 20:22 |
| clarkb | AJaeger: zmq-event-publisher can be removed | 20:22 |
| clarkb | AJaeger: someone on the internet forked it from us and took it over for jenkins | 20:22 |
| clarkb | (can probably treat gearman plugin similarly though I don't think anyone took it over) | 20:23 |
| AJaeger | so, should we retire that repo? | 20:23 |
| AJaeger | let me remove jobs... | 20:23 |
| clarkb | rosmaita: I think you can drop the nodeset entirely too fwiw. Now that I see the python36 job relies on the devstack default | 20:23 |
| rosmaita | clarkb: well, the nodeset did make the py37 job pass finally | 20:24 |
| clarkb | rosmaita: have you run it with no nodeset though? | 20:24 |
| clarkb | rosmaita: specifying the wrong nodeset is what broke it before. I think specifying no nodest will have it use the default for devstack which should work | 20:24 |
| ianw | clarkb: will do on dib. just have to decamp as movers are coming soon, bib | 20:25 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Add noop-jobs for zmq-event-publisher https://review.opendev.org/702745 | 20:26 |
| AJaeger | clarkb, ianw, ^ | 20:26 |
| clarkb | ianw: one minor thing on https://review.opendev.org/#/c/702579/3 if it ends up needing a new ps | 20:26 |
| AJaeger | clarkb: shall we retire completely? | 20:26 |
| rosmaita | clarkb: with no nodeset the functional-py37 job skipped all the tests (couldn't find py3.7 interpreter) | 20:26 |
| clarkb | AJaeger: I think we can, people would be consuming the built artifacts and not git if still using our stuff | 20:27 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove zmq-event-publisher jobs https://review.opendev.org/702747 | 20:28 |
| AJaeger | clarkb: ok, let me send an email and do the next steps then... | 20:28 |
| clarkb | rosmaita: ok. That surprises me because we don't install python37 by default but maybe devstack is grabbing it | 20:28 |
| clarkb | rosmaita: it also doesn't hurt to have the nodeset there | 20:29 |
| rosmaita | clarkb: ok, cool | 20:32 |
| AJaeger | clarkb: do you know the new name and location? | 20:34 |
| openstackgerrit | Andreas Jaeger proposed x/zmq-event-publisher master: Retire zmq-event-publisher https://review.opendev.org/702748 | 20:35 |
| *** eharney has quit IRC | 20:36 | |
| *** slaweq has joined #openstack-infra | 20:36 | |
| *** iurygregory has quit IRC | 20:37 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire x/zmq-event-publisher https://review.opendev.org/702749 | 20:38 |
| AJaeger | clarkb: pushed everything ^, somebody needs to abandon the two open jobs in https://review.opendev.org/#/q/project:x/zmq-event-publisher+is:open | 20:39 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire x/zmq-event-publisher https://review.opendev.org/702749 | 20:42 |
| clarkb | AJaeger: I'm not finding the new location. I think it may hve just been a github fork? | 20:45 |
| *** aedc has joined #openstack-infra | 20:49 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Re-elect James Blair as project lead https://review.opendev.org/701267 | 20:51 |
| smcginnis | I see clarkb's - https://github.com/cboylan/zmq-event-publisher | 20:52 |
| smcginnis | And a related project - https://github.com/KuraudoTama/jenkins-events-handlers | 20:53 |
| *** aedc has quit IRC | 20:54 | |
| *** aedc has joined #openstack-infra | 20:54 | |
| clarkb | ya I'm not finding the fork, also searching email isn't turning it up. I may have misremembered | 20:54 |
| clarkb | however we haven't used that software in many years | 20:54 |
| clarkb | I think we can retire it | 20:54 |
| smcginnis | Yeah, even that last link that was working along with it doesn't look like it's been touched since 2015. | 20:55 |
| *** ralonsoh has quit IRC | 20:57 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: OIDCAuthenticator: add capabilities, scope option https://review.opendev.org/702275 | 20:58 |
| *** tdasilva has joined #openstack-infra | 21:00 | |
| AJaeger | clarkb: Antoine Musso had a patch for it recently, what was his nick? | 21:03 |
| fungi | hashar | 21:03 |
| AJaeger | not around - thanks, fungi | 21:03 |
| clarkb | in 2017 | 21:03 |
| AJaeger | oh, indeed | 21:04 |
| clarkb | I think either this will not cause any problems or someone will notice and then we can resurrect it properly with them leading the way | 21:04 |
| clarkb | either way I think this is a good next step | 21:04 |
| AJaeger | ok | 21:04 |
| AJaeger | that leaves two more jobs on trusty... | 21:05 |
| AJaeger | legacy-gearman-plugin-maven-build-ubuntu-trusty, legacy-puppet-openstack-infra-spec-helper-unit-ubuntu-trusty | 21:05 |
| fungi | oof | 21:05 |
| fungi | those are some lengthy job names | 21:06 |
| *** jamesmcarthur has quit IRC | 21:06 | |
| AJaeger | second one used here: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L803 - on opendev/puppet-openstack_infra_spec_helper | 21:06 |
| AJaeger | first one on x/gearman-plugin, https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L5359 | 21:07 |
| AJaeger | do we need the repos - or should we just drop jobs? | 21:07 |
| *** smarcet has joined #openstack-infra | 21:09 | |
| * AJaeger calls it a day, if somebody wants to cleanup, please go for it. I'll happily review tomorrow | 21:09 | |
| *** jamesmcarthur has joined #openstack-infra | 21:10 | |
| clarkb | AJaeger: I've abandoned the zmq changes | 21:12 |
| openstackgerrit | Merged openstack/project-config master: Add noop-jobs for zmq-event-publisher https://review.opendev.org/702745 | 21:13 |
| clarkb | AJaeger: for infra-spec helper we should make sure there is a xenial job which is legacy-puppet-openstack-infra-spec-helper-unit so I think we can delete that trusty job | 21:13 |
| *** lseki has quit IRC | 21:14 | |
| openstackgerrit | Merged x/zmq-event-publisher master: Retire zmq-event-publisher https://review.opendev.org/702748 | 21:15 |
| *** jamesmcarthur has quit IRC | 21:15 | |
| *** jamesmcarthur has joined #openstack-infra | 21:15 | |
| harlowja | yo yo folks (long time, yes i know) | 21:18 |
| harlowja | do folks know if there is any document/blog about how openstack moved from jenkins -> zuul using jenkins -> zuulv2 ....? | 21:18 |
| harlowja | i'd like to share it with folks at my place, and i'm pretty sure such a thing exists | 21:18 |
| harlowja | (i just don't recall where, ha) | 21:18 |
| clarkb | AJaeger: gearman-plugin is in similar situation as zmq-event-publisher, we basically don't use it and its been effectively dead. That one is actually required to do zuulv2 so might be worth keeping alive ? | 21:19 |
| clarkb | harlowja: fungi is your thing available yet? | 21:19 |
| clarkb | harlowja: ^ I meant to say fungi was working on something along those lines | 21:19 |
| *** slaweq has quit IRC | 21:19 | |
| harlowja | ohhh | 21:20 |
| harlowja | niceeee | 21:20 |
| fungi | yeah, i have an article submitted to opensource.com which details all that history | 21:20 |
| harlowja | published soon? | 21:20 |
| fungi | not sure where it is on their publication schedule yet | 21:20 |
| harlowja | k | 21:20 |
| harlowja | cool though, i'll keep a lookout for it | 21:20 |
| fungi | my guess is likely end of january/early february | 21:21 |
| fungi | i touch on where we started, outline the various things we built up around jenkins, the pitfalls and jenkins shortcomings we worked around, and the eventual reasons we chose to eliminate it from our environment | 21:22 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: DNM: debug docker command line options https://review.opendev.org/702752 | 21:23 |
| fungi | but with an aim of not being particularly negative about jenkins itself. it's another free/libre open source project after all, and it's useful for the things it's designed to do | 21:23 |
| fungi | i mostly try to underscore that even though people refer to jenkins as a "ci system" it's really not, it's an automation engine people frequently build ci systems around | 21:24 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: use-buildset-registry: disable docker userland proxy https://review.opendev.org/702753 | 21:25 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: DNM: test without docker userland proxy https://review.opendev.org/702724 | 21:27 |
| harlowja | fungi, sounds good | 21:27 |
| harlowja | sounds just like what i want | 21:28 |
| fungi | i'm just sorry it's not already published to point you at it | 21:28 |
| *** igordc has joined #openstack-infra | 21:29 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove zmq-event-publisher jobs https://review.opendev.org/702747 | 21:33 |
| rosmaita | clarkb: sorry to be a PITA, but when you have a minute can you look at https://review.opendev.org/#/c/691467/17..18/.zuul.yaml and tell me what i did wrong? the functional-py37 job is running, but it's using py36 | 21:34 |
| harlowja | fungi, no worries, better late than never :) | 21:35 |
| rosmaita | harlowja: what are you up to these days? | 21:36 |
| *** tdasilva has quit IRC | 21:36 | |
| harlowja | https://plus.ai/ | 21:37 |
| harlowja | seeing how that works out, haha | 21:37 |
| harlowja | we also delivered some butter run, lol https://www.bbc.com/news/technology-50742080 | 21:38 |
| rosmaita | very cool | 21:38 |
| harlowja | reddit thread on that was funny as heck | 21:38 |
| harlowja | https://www.reddit.com/r/Futurology/comments/e8xwm2/a_selfdriving_truck_delivered_butter_from/ | 21:38 |
| harlowja | comments are awesome | 21:38 |
| rosmaita | we have torc robotics in my town doing self-driving cars, every so often you see them driving around -- not sure they have gone cross-country, though | 21:39 |
| harlowja | neats | 21:40 |
| *** rcernin has quit IRC | 21:42 | |
| *** tommylikehu has quit IRC | 21:42 | |
| *** piotrowskim has quit IRC | 21:42 | |
| *** eharney has joined #openstack-infra | 21:48 | |
| *** eernst has joined #openstack-infra | 21:53 | |
| *** ociuhandu has quit IRC | 21:54 | |
| *** gfidente has quit IRC | 21:55 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: use-buildset-registry: disable docker userland proxy https://review.opendev.org/702753 | 21:57 |
| fungi | around here the horses sometimes wander into the road. they're fairly autonomous | 21:58 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Import dhall-operator https://review.opendev.org/702104 | 21:58 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Import zuul application from dhall-zuul https://review.opendev.org/702105 | 21:58 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new application https://review.opendev.org/702106 | 21:58 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Generate TLS certificats for the gearman service https://review.opendev.org/702716 | 21:58 |
| harlowja | autonomous horses, powered by horseAI | 22:04 |
| fungi | though to be clear, most of the routines in horseai seem to be centered around rooting through unsecured trashcans | 22:05 |
| *** jamesmcarthur has quit IRC | 22:06 | |
| clarkb | rosmaita: will do though I need to grab late lunch | 22:06 |
| clarkb | so give me a few :) | 22:06 |
| *** pkopec_ has quit IRC | 22:08 | |
| clarkb | rosmaita: your comment is spot on I think | 22:10 |
| clarkb | rosmaita: delete the line you highlighted the nthe vars you set at the higher level will be passed through I think | 22:10 |
| *** kjackal has quit IRC | 22:11 | |
| *** jamesmcarthur has joined #openstack-infra | 22:16 | |
| *** jamesmcarthur has quit IRC | 22:19 | |
| *** jtomasek has quit IRC | 22:19 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add Openshift SCC and functional test https://review.opendev.org/702758 | 22:23 |
| *** xek_ has quit IRC | 22:24 | |
| tristanC | zuul tenant container build job are failing unexpectedly with a https://zuul.opendev.org/t/zuul/build/None url | 22:26 |
| clarkb | tristanC: that happens if there is a failed image build for the parent | 22:28 |
| clarkb | tristanC: this is a zuul issue not an infra issue | 22:28 |
| clarkb | (I ran into it yesterday too and discovered zuul doesn't report this to you you just get an empty build) | 22:28 |
| tristanC | clarkb: i see thanks, one of the parent review does have a 'net/http: TLS handshake timeout' image build failure | 22:29 |
| clarkb | tristanC: I think it would be good for zuul to report a better error message back but I haven't had time to debug why it doesnt' | 22:30 |
| rosmaita | clarkb: thanks for looking! | 22:31 |
| fungi | infra-root: anybody else care to weigh in on whether we should revert the replication.autoReload addition in gerrit? https://review.opendev.org/691452 | 22:34 |
| clarkb | fungi: done | 22:34 |
| openstackgerrit | Merged opendev/zone-opendev.org master: Reorganize zonefile https://review.opendev.org/701833 | 22:34 |
| fungi | thanks clarkb! | 22:35 |
| *** icey has quit IRC | 22:36 | |
| *** dosaboy has quit IRC | 22:36 | |
| *** dklyle has quit IRC | 22:40 | |
| *** diablo_rojo has quit IRC | 22:45 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add Openshift SCC and functional test https://review.opendev.org/702758 | 22:46 |
| *** smarcet has quit IRC | 22:46 | |
| *** rfarr has joined #openstack-infra | 22:47 | |
| *** thedac has joined #openstack-infra | 22:48 | |
| *** dklyle has joined #openstack-infra | 22:49 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove infra trusty jobs https://review.opendev.org/702764 | 22:50 |
| *** icey has joined #openstack-infra | 22:51 | |
| *** exsdev has joined #openstack-infra | 22:51 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Remove legacy-puppet-openstack-infra-spec-helper-unit-ubuntu-trusty https://review.opendev.org/702765 | 22:52 |
| *** rfarr has quit IRC | 22:53 | |
| *** dosaboy has joined #openstack-infra | 22:53 | |
| *** rcernin has joined #openstack-infra | 22:55 | |
| openstackgerrit | Merged opendev/system-config master: Revert "Enable gerrit replication.autoReload for review" https://review.opendev.org/691452 | 22:56 |
| *** eernst has quit IRC | 23:01 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Move legacy-gearman-plugin-mavin-build away from Trusty https://review.opendev.org/702768 | 23:03 |
| *** tkajinam has joined #openstack-infra | 23:03 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove legacy-gearman-plugin-mavin-build-ubuntu-trusty https://review.opendev.org/702769 | 23:04 |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Remove legacy-ubuntu-trusty nodeset https://review.opendev.org/702771 | 23:07 |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Remove legacy-puppet-openstack-infra-spec-helper-unit-ubuntu-trusty https://review.opendev.org/702765 | 23:09 |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Move legacy-gearman-plugin-mavin-build away from Trusty https://review.opendev.org/702768 | 23:09 |
| *** igordc has quit IRC | 23:09 | |
| openstackgerrit | Ian Wienand proposed openstack/openstack-zuul-jobs master: Remove legacy-ubuntu-trusty nodeset https://review.opendev.org/702771 | 23:09 |
| *** igordc has joined #openstack-infra | 23:10 | |
| openstackgerrit | Ian Wienand proposed openstack/project-config master: Remove trusty wheel jobs https://review.opendev.org/702774 | 23:19 |
| *** calebb has joined #openstack-infra | 23:20 | |
| ianw | it's a very tangled graph but working through https://review.opendev.org/#/q/topic:trusty-removal from https://review.opendev.org/702764 should unravel to remove a big chunk of remaining trusty | 23:23 |
| clarkb | ianw: k I'll get to reviews on that shortly | 23:24 |
| clarkb | ianw: https://review.opendev.org/#/c/702721/1 failed in the gate so I've rechecked it (this is the dib centos 8 fix) | 23:24 |
| clarkb | as soon as that lands we should get a release out | 23:24 |
| *** jamespage has joined #openstack-infra | 23:27 | |
| ianw | ++ yep | 23:28 |
| clarkb | ianw: I think we should add a change to the mirror configurator rule to stop adding the wheel mirror to trusty nodes? | 23:32 |
| clarkb | ianw: at least until we completely remove the trusty nodes | 23:32 |
| clarkb | otherwise we may get unexpected behavior if we stop updating those? | 23:33 |
| clarkb | its probably ok because pip will use an sdist if the package is newer | 23:33 |
| clarkb | ya the more I think of it the more I think its probably ok | 23:33 |
| clarkb | as long as we remove the mirror itself after the nodepool nodes | 23:34 |
| ianw | yeah, i'm hoping it will be very brief. i think only dib jobs remain, which i only keep because we're building it in the gate | 23:34 |
| ianw | the only other one i can find is https://opendev.org/openstack/openstack-ansible-ops/src/branch/master/zuul.d/jobs.yaml#L76 | 23:35 |
| clarkb | ianw: do we not have a puppet job that runs it either? | 23:35 |
| clarkb | I half expected ^ but maybe we've gotten past that already | 23:35 |
| clarkb | the system-config puppet apply all job or whatever its called | 23:35 |
| clarkb | (does the noop puppet) | 23:35 |
| ianw | mmm, yeah ok looking at system-config | 23:36 |
| clarkb | that gives us a small bit of coverage over static.o.o and status and refstack I think | 23:37 |
| *** tdasilva has joined #openstack-infra | 23:37 | |
| clarkb | maybe we need to hunker down and just finish those upgrades. | 23:37 |
| ianw | yeah, i guess they fall more into "control plane" jobs rather than project jobs | 23:38 |
| *** tobiash has quit IRC | 23:38 | |
| clarkb | if we haven't yet a first good step is to test those on xenial | 23:39 |
| *** tobiash has joined #openstack-infra | 23:39 | |
| clarkb | then if those pass maybe we just delete the trusty jobs and plan to redeploy on xenial real soon now | 23:39 |
| ianw | it's mostly the wheel jobs i want to stop right now, to make one less target there | 23:40 |
| clarkb | ya I think that should be safe | 23:41 |
| clarkb | since control plane doesn't rely on libvirt-python and lxml | 23:41 |
| clarkb | we can just use pypi | 23:41 |
| ianw | yeah, i don't think any of the system-config jobs setup the mirror? | 23:42 |
| clarkb | ianw: they may get it from our base job? | 23:42 |
| ianw | possibly, we can do the "drop mirror if trusty" | 23:43 |
| clarkb | ianw: when do we get you back from moving? | 23:44 |
| clarkb | maybe we can plan a sprint day or two and focus on finishing the control plane upgrades | 23:44 |
| openstackgerrit | Merged zuul/zuul master: Re-elect James Blair as project lead https://review.opendev.org/701267 | 23:45 |
| ianw | 21st (.au time) | 23:45 |
| clarkb | maybe give you a bit of time to settle in and plan for the 27th and 28th (thats 28th and 29th au time I think) | 23:45 |
| clarkb | fungi: ^ will you have departed for fosdem at that point yet? or would you be able to help then? | 23:46 |
| ianw | yeah, i'd be happy to focus on it then | 23:46 |
| clarkb | k lets pencil that in | 23:46 |
| clarkb | I think we are really close and its mostly just a matter of writing the changes and booting some nodes | 23:46 |
| clarkb | focused time on that should help us get it done | 23:47 |
| fungi | clarkb: checking, but it's close anyway | 23:47 |
| fungi | clarkb: looks like my first flight leaves on thursday 2020-01-30 so i could do the 27th and 28th | 23:48 |
| clarkb | great | 23:48 |
| ianw | of course, there is the incredibly complex issue of running a cable from the street to the new house thru pre-laid specific conduit for wired internet, which i'm sure will take the ISP weeks to figure out | 23:48 |
| ianw | and then, when they eventually arrive, the correct person 15 minutes to actually do | 23:49 |
| fungi | none of my talks got selected, so i don't have any last-minute material to prepare, just need to practice looking good so when folks come by the osf table asking about zuul or something they won't be too bad when i just smile and nod | 23:49 |
| fungi | er, won't be too mad | 23:49 |
| fungi | here, it's all explained in this very glossy onesheet | 23:49 |
| fungi | see the high sheen on the print? that's a quality onesheet | 23:50 |
| clarkb | fungi: also you'll need one liners for the kids looking for stickers | 23:50 |
| fungi | in fact, have two. give one to a friend! | 23:50 |
| *** dchen has joined #openstack-infra | 23:50 | |
| clarkb | ianw: oof lets hope they get it right the first time around | 23:50 |
| fungi | i'll have to learn how to say "we're out of zuul stickers" in 5 or 6 different languages | 23:50 |
| ianw | clarkb: almost certain they won't ... i have a 4g hotspot i can enable month-to-month, which stupidly is faster than the HFC available anyway. i could probably even live with the data cap, but the cgnat it does annoys me | 23:51 |
| fungi | i still don't understand how anyone puts up with the down-under isps. is it just one of the many outcomes of being settled as a penal colony? | 23:54 |
| fungi | here, have some prison internet | 23:54 |
| fungi | i mean, internet is pretty terribad in the usa compared to lots of places, but nothing like au | 23:55 |
| clarkb | I just upgraded to half gig symettric service. I get about quarter gig in reality | 23:56 |
| clarkb | fungi: I think it has to do with limited bw to the outside world | 23:56 |
| ianw | so we have the NBN which is supposed to connect everyone. originally everyone was getting fibre, but now it's a complete mess of fibre-to-curb, HFC, etc. then ISP's sell access to the NBN | 23:57 |
| ianw | AFAICT, the only thing ISPs can really compete on is "how little backhaul can i buy to support X customers without them getting so annoyed at the shitty service they leave" | 23:58 |
| fungi | so race to the bottom | 23:58 |
| ianw | i mean, they're all selling access to the same NBN network, once connected to that i can theoretically call any isp and just switch whenever | 23:58 |
| clarkb | ah here its all separate infrastructure. So I can get fiber with frontier up to gigabit, comcast does cable with docsis up to 1000/10 I think, and centurylink will do adsl up to like 8mbps | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!