| *** DSpider has quit IRC | 00:25 | |
| *** redrobot has quit IRC | 01:08 | |
| openstackgerrit | Merged opendev/system-config master: Remove nb04 https://review.opendev.org/752740 | 02:40 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix typo in collection install tasks https://review.opendev.org/752846 | 03:06 |
| ianw | fungi: i'm seeing good acme.sh runs on grafana01.opendev.org | 03:27 |
| ianw | oh, hang on, you said graphite | 03:43 |
| ianw | [Mon Sep 21 03:07:14 UTC 2020] Skip, Next renewal time is: Tue Nov 3 06:41:58 UTC 2020 | 03:43 |
| ianw | also seeing good runs there. i guess maybe old processes? | 03:43 |
| ianw | yeah i bet the container never restarts | 03:45 |
| clarkb | ianw: itsthe 02 server | 03:45 |
| clarkb | oh graphite02 | 03:46 |
| ianw | clarkb: yeah, i think the certs up to date, but the service presenting it isn't | 03:46 |
| clarkb | got it | 03:46 |
| ianw | i gotta bite the bullet and finish this. i'll page back in the bits that were missing from the puppet and try to port them | 03:46 |
| *** ykarel|away has joined #opendev | 04:05 | |
| *** kden has joined #opendev | 04:12 | |
| *** ykarel|away is now known as ykarel | 04:21 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix typo in collection install tasks https://review.opendev.org/752846 | 04:33 |
| *** kden has quit IRC | 04:42 | |
| *** marios has joined #opendev | 05:07 | |
| openstackgerrit | yatin proposed openstack/diskimage-builder master: Revert "Avoid disabling rhel-7-server-rh-common-rpms" https://review.opendev.org/752851 | 05:08 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix typo in collection install tasks https://review.opendev.org/752846 | 05:15 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix collections install for devel job https://review.opendev.org/752846 | 05:49 |
| ianw | fungi: graphite should be restarting when the cert rotates ... but maybe not https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/letsencrypt-create-certs/handlers/restart_graphite.yaml | 05:55 |
| ianw | i stupidly manually restarted it before checking the cert, but now it's showing an expiry of 3 December 2020 | 05:56 |
| *** qchris has quit IRC | 06:21 | |
| *** qchris has joined #opendev | 06:34 | |
| *** andrewbonney has joined #opendev | 06:50 | |
| *** bhagyashris is now known as bhagyashri|rover | 06:55 | |
| *** hashar has joined #opendev | 07:01 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: letsencrypt: Fix graphite02 restart handler https://review.opendev.org/752879 | 07:03 |
| *** slaweq has joined #opendev | 07:03 | |
| ianw | fungi: ^ there's 40+ minutes of digging through logs for something that ultimately doesn't exist :) | 07:03 |
| *** tosky has joined #opendev | 07:03 | |
| ianw | "ERROR Project github.com/ansible-collections/ansible.posix does not have the default branch master" interesting | 07:06 |
| ianw | i guess we need to override-checkout; but it might be nice if we could somehow tag the project as having a "main" instead of "master" in project-config? | 07:09 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix collections install for devel job https://review.opendev.org/752846 | 07:22 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: install-ansible: fix collections install for devel job https://review.opendev.org/752846 | 07:27 |
| *** moppy has quit IRC | 08:01 | |
| *** moppy has joined #opendev | 08:01 | |
| *** DSpider has joined #opendev | 08:36 | |
| *** auristor has quit IRC | 08:40 | |
| *** marios has quit IRC | 09:30 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:52 | |
| openstackgerrit | Alfredo Moralejo proposed zuul/zuul-jobs master: Use Train deps repo to install openvswitch https://review.opendev.org/752908 | 10:18 |
| *** marios has joined #opendev | 10:26 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: tox: allow tox to be upgraded https://review.opendev.org/690057 | 10:27 |
| ykarel | Can we get some eyes on https://review.opendev.org/#/c/752908/ | 10:56 |
| ykarel | AJaeger, clarkb frickler ^ | 10:57 |
| *** Tengu has quit IRC | 11:05 | |
| *** Tengu has joined #opendev | 11:07 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: bindep: perform serial install if needed https://review.opendev.org/693637 | 11:13 |
| *** auristor has joined #opendev | 11:35 | |
| *** ysandeep is now known as ysandeep|brb | 11:59 | |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: Updated openstack id to include message broker configuration https://review.opendev.org/752925 | 12:02 |
| openstackgerrit | Merged openstack/project-config master: Add 'check arm64' trigger to check-arm64 pipeline https://review.opendev.org/751829 | 12:05 |
| *** ysandeep|brb is now known as ysandeep | 12:14 | |
| *** priteau has joined #opendev | 12:21 | |
| zbr | https://review.opendev.org/#/c/545607/ needs an abandon | 12:22 |
| openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Added cloud storage config https://review.opendev.org/752929 | 12:25 |
| *** ykarel_ has joined #opendev | 12:39 | |
| *** ykarel has quit IRC | 12:43 | |
| openstackgerrit | Alfredo Moralejo proposed zuul/zuul-jobs master: Use Train deps repo to install openvswitch https://review.opendev.org/752908 | 13:42 |
| *** jeremyfreudberg has joined #opendev | 13:55 | |
| jeremyfreudberg | hi folks, i was wondering why a project-config change that i made a year and a half ago is still not reflected on gitea. https://review.opendev.org/#/c/655527/1/gerrit/projects.yaml i remember asking once (closer to the time that the change was merged) but forget the reason. anyway, what can be done? | 13:57 |
| *** ykarel_ is now known as ykarel|away | 13:58 | |
| frickler | hmm, interesting, the description on github does seem to have been updated | 14:00 |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Disable broken fetch-sphinx-tarball test job https://review.opendev.org/752957 | 14:05 |
| *** hashar has quit IRC | 14:27 | |
| *** ykarel|away has quit IRC | 14:29 | |
| *** ajya|afk is now known as ajya | 14:29 | |
| clarkb | frickler: jeremyfreudberg iirc we don't dynamically update descriptions because it is very costly (in terms of api requests) to check and them update them | 14:34 |
| clarkb | that is for github, I expect gitea inherited the same behavior | 14:34 |
| clarkb | yes, looks like we have a separate "sync-gitea-project.yaml" playbook that sets the gitea_always_update flag to true which I think forces those updates to happen. I expect this has to be run manually with ansible's lock file held on bridge? | 14:38 |
| clarkb | infra-root ^ does that sound right? | 14:38 |
| openstackgerrit | Merged opendev/system-config master: letsencrypt: Fix graphite02 restart handler https://review.opendev.org/752879 | 14:52 |
| openstackgerrit | Merged opendev/system-config master: Updated openstack id to include message broker configuration https://review.opendev.org/752925 | 14:52 |
| *** hashar has joined #opendev | 14:57 | |
| *** ysandeep is now known as ysandeep|away | 15:10 | |
| *** priteau has quit IRC | 15:10 | |
| *** redrobot has joined #opendev | 15:23 | |
| openstackgerrit | Carlos Goncalves proposed openstack/project-config master: Linaro US: Add a 16GB RAM label for CentOS 8 https://review.opendev.org/753036 | 15:30 |
| openstackgerrit | Merged opendev/bindep master: Add OracleLinux support https://review.opendev.org/536355 | 15:32 |
| *** mlavalle has joined #opendev | 15:33 | |
| *** marios has quit IRC | 16:00 | |
| *** hashar has quit IRC | 16:18 | |
| *** andrewbonney has quit IRC | 16:59 | |
| jeremyfreudberg | clarkb: thanks for that info. pending any ideas from the rest of your collleagues, any chance that we can schedule a run of that? | 17:01 |
| clarkb | jeremyfreudberg: I'm in meetings this morning but can possibly help with that this afternoon if that is the agreed solution | 17:03 |
| fungi | also we could brainstorm ways to perform per-project updates of that data based on what's changed | 17:04 |
| fungi | so that it could in the future happen automatically | 17:05 |
| *** zbr is now known as zbr|pto | 17:07 | |
| *** diablo_rojo has joined #opendev | 17:44 | |
| corvus | ianw: you can set a default branch in project-config with this: https://zuul-ci.org/docs/zuul/reference/project_def.html#attr-project.default-branch | 17:45 |
| clarkb | corvus: in this case I think the projects don't have a project block because they are only used as deps, however, maybe that means we should add a project block | 17:45 |
| corvus | clarkb: yeah, i think the latter would work in this instance | 17:46 |
| *** hamalq has joined #opendev | 17:57 | |
| clarkb | infra-root the change to remove nb04 from config management has landed. I'm going to double check we have no images associated with it in nodepool then work on deleting it, its volume, and dns records | 18:18 |
| fungi | thanks clarkb! once the cinder volume is gone i'll double-check the uuids from the maintenance ticket and hopefully close it out | 18:18 |
| clarkb | fungi: I might need your help on claening up the volume but will get there when I get there :) for now it looks like no images from nb04 are in zk | 18:20 |
| clarkb | I am deleting nb04.opendev.org 9f51d27e-abe7-4e4c-9246-15cfa08718fb now | 18:21 |
| clarkb | fungi: ya where can I find your working client config to speak to rax voluem service? | 18:23 |
| clarkb | hrm ~fungi/clouds.yaml maybe | 18:24 |
| clarkb | yup that was it | 18:25 |
| clarkb | Now deleting nb04.opendev.org/main df50b5c7-1908-4719-9116-06ae5154387a | 18:26 |
| clarkb | #status log Deleted nb04.opendev.org (9f51d27e-abe7-4e4c-9246-15cfa08718fb) and its cinder volume, nb04.opendev.org/main (df50b5c7-1908-4719-9116-06ae5154387a), as this server is no longer necessary (replaced with nb01 and nb02.opendev.org). | 18:27 |
| openstackstatus | clarkb: finished logging | 18:27 |
| fungi | clarkb: yep, you got it | 18:28 |
| openstackgerrit | Clark Boylan proposed opendev/zone-opendev.org master: Remove nb04 records https://review.opendev.org/753120 | 18:29 |
| clarkb | I've reapproved https://review.opendev.org/#/c/752741/1 to get it into the gate. Then ^ should be the last related cleanup we need | 18:30 |
| fungi | confirmed, none of the 29 dfw volume uuids in the maintenance ticket show up in the list any longer | 18:32 |
| clarkb | excellent I think we can consider the volume maintenance handled from our side then. Thank you for driving that | 18:34 |
| fungi | no worries, i'll close out the ticket | 18:34 |
| openstackgerrit | Merged openstack/project-config master: Remove old nodepool builder configs https://review.opendev.org/752741 | 18:37 |
| clarkb | fungi: https://review.opendev.org/#/c/753120/ have a quick moment for that one to finish our cleanup? (dns records removal for nb04) | 18:46 |
| clarkb | I'm going to pop out for lunch now. Back in a bit | 18:47 |
| prometheanfire | would it be possible to cut a realease of glean so I can stop forcing git master? for https://opendev.org/opendev/glean/commit/a507b711170c970c82db93565f23af8a3ce902e3 | 18:48 |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackID v3.0.13 https://review.opendev.org/753121 | 18:49 |
| *** hashar has joined #opendev | 19:02 | |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenStackID v3.0.14 https://review.opendev.org/753121 | 19:11 |
| clarkb | prometheanfire: tagging a507b711170c970c82db93565f23af8a3ce902e3 as 1.18.1 ? fungi that look right ot you too? | 19:37 |
| prometheanfire | wfm | 19:43 |
| fungi | sorry, stepped away to eat dinner, checking | 19:46 |
| fungi | test/job updates, and a gentoo fix. yeah, that looks right | 19:47 |
| fungi | tag at will | 19:47 |
| clarkb | cool I'm writing a few emails but then can make that tag | 19:49 |
| fungi | #status log provider maintenance 2020-10-02 01:00-05:00 utc involving ~5-minute outages for databases used by health, review-dev, zuul | 19:51 |
| openstackstatus | fungi: finished logging | 19:51 |
| fungi | infra-root: ^ not sure what we should expect the zuul scheduler to do if its database goes away briefly | 19:52 |
| fungi | maybe sqla will just reconnect? | 19:52 |
| clarkb | fungi: we may get reporting failures and I think that will result in failed jobs? | 19:52 |
| fungi | also they mentioned the "ara" db which i think we never wound up using | 19:52 |
| clarkb | not sure if we decoupled the secondary reporters from the primary somehow | 19:53 |
| *** hashar has quit IRC | 19:55 | |
| *** slaweq has quit IRC | 20:07 | |
| openstackgerrit | Merged opendev/system-config master: OpenStackID v3.0.14 https://review.opendev.org/753121 | 20:10 |
| *** slaweq has joined #opendev | 20:12 | |
| clarkb | alright emails sent, now to find my gpg key | 20:16 |
| clarkb | prometheanfire: fungi 1.18.1 has been pushed | 20:24 |
| openstackgerrit | Merged opendev/zone-opendev.org master: Remove nb04 records https://review.opendev.org/753120 | 20:31 |
| openstackgerrit | sebastian marcet proposed opendev/system-config master: OpenstackId config updates https://review.opendev.org/753147 | 20:40 |
| openstackgerrit | Merged opendev/puppet-openstackid master: Added cloud storage config https://review.opendev.org/752929 | 20:46 |
| clarkb | infra-root and other channel lurkers I've just populated https://etherpad.opendev.org/p/opendev-ptg-planning-oct-2020 with a number of topic ideas for the PTG. Please feel free to add input or your own topic ideas | 20:50 |
| clarkb | https://pypi.org/project/glean/1.18.1/ exists now | 20:55 |
| clarkb | infra-root https://review.opendev.org/#/c/749766/ is a good cleanup to land after the setuptools fun a while back | 21:04 |
| clarkb | gets us back to using up to date setuptools | 21:04 |
| clarkb | (and they seem much more determined to make any updates work well this time) | 21:04 |
| *** slaweq has quit IRC | 21:06 | |
| *** qchris has quit IRC | 21:07 | |
| *** qchris has joined #opendev | 21:13 | |
| clarkb | I think we'd be able to just reboot with the correct configs on disk | 21:46 |
| clarkb | er wrong window | 21:46 |
| openstackgerrit | Merged opendev/system-config master: OpenstackId config updates https://review.opendev.org/753147 | 21:58 |
| ianw | corvus / clarkb: thanks, yeah it was that they are only deps; I wasn't sure about a project block, won't they need a no-op job and then start querying github then? | 22:03 |
| clarkb | ianw: I think the project block can omit the pipeline configs entirely | 22:03 |
| *** Dmitrii-Sh has quit IRC | 22:05 | |
| *** Dmitrii-Sh has joined #opendev | 22:10 | |
| clarkb | jeremyfreudberg: I'm not sure I'll get to that resync today, but I did add it to the meeting agenda for tomorrow to ensure we dont' forget about it and think about the problem space in general | 22:42 |
| *** Dmitrii-Sh has quit IRC | 22:48 | |
| *** tosky has quit IRC | 22:49 | |
| *** mlavalle has quit IRC | 22:50 | |
| *** Dmitrii-Sh has joined #opendev | 22:55 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!