| *** hamalq has quit IRC | 01:19 | |
| *** sboyron has joined #opendev-meeting | 06:08 | |
| *** sboyron has quit IRC | 07:37 | |
| *** sboyron has joined #opendev-meeting | 07:38 | |
| *** sboyron has quit IRC | 07:38 | |
| *** sboyron has joined #opendev-meeting | 07:39 | |
| *** kopecmartin has joined #opendev-meeting | 09:33 | |
| *** sboyron has quit IRC | 09:54 | |
| *** sboyron has joined #opendev-meeting | 09:55 | |
| *** hamalq has joined #opendev-meeting | 16:20 | |
| clarkb | anyone else here for the meeting? we'll get started momentarily | 19:00 |
|---|---|---|
| ianw | o/ | 19:00 |
| fungi | hey-o | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Apr 13 19:01:48 2021 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link http://lists.opendev.org/pipermail/service-discuss/2021-April/000220.html Our Agenda | 19:01 |
| clarkb | #topic Announcements | 19:02 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:02 | |
| clarkb | OpenStack should be finishing its release up tomorrow | 19:02 |
| clarkb | and I'm told we should be clear of airship concerns by friday (I'll try to start zk on friday as a result) | 19:03 |
| clarkb | keep that in mind as you make changes the next couple of days :) | 19:03 |
| clarkb | #topic Actions from last meeting | 19:04 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:04 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2021/infra.2021-04-06-19.01.txt minutes from last meeting | 19:04 |
| clarkb | ianw has had an action to push up changes to retire pbx/asterisk server | 19:04 |
| ianw | oh, i didn't get to that | 19:05 |
| clarkb | #action ianw propose changes to retire the asterisk server | 19:05 |
| clarkb | no worries | 19:05 |
| clarkb | #topic Priority Efforts | 19:05 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:05 | |
| clarkb | #topic OpenDev | 19:05 |
| *** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:05 | |
| clarkb | I completed the external id cleanup of about 224 accounts | 19:07 |
| clarkb | I have started the cleanup of another 56 and reached out to users about ~7 | 19:07 |
| clarkb | I'll plan to complete the 56 account external id cleanups thursday. I gave the users I contacted until the 19th before I would proceed with the described plan | 19:08 |
| clarkb | overall good progress. Expecting things may become more difficult soon and need to contact users more frequently | 19:08 |
| fungi | i suppose we can also get more aggressive with our recency calculations around those accounts too, and maybe just send users notifications of what we're doing in case they need help adjusting afterward | 19:09 |
| clarkb | that is not a bad idea | 19:10 |
| clarkb | but we can see what it looks like as we whittle it down further | 19:10 |
| fungi | possible as the set shrinks further, new patterns will emerge from what remains | 19:11 |
| clarkb | ++ | 19:11 |
| clarkb | definitely, has helped to do it in batches so far to make those sets of users easier to see | 19:11 |
| clarkb | #link https://groups.google.com/g/repo-discuss/c/BQKxAfXBXuo Upstream conversation with people struggling with similar problems. | 19:12 |
| clarkb | This was the other thing I noticed. Some other gerrit users describing similar issues to what we saw with gerrit GCing | 19:12 |
| clarkb | tldr seems to be use more memory (which we have a plan for now) and reduce resources like ssh threads | 19:13 |
| clarkb | I think we should probably stick with the server upgrade as step 1 then if we need to reconsider tuning variables like ssh threads afterwards | 19:13 |
| clarkb | but wanted to call that out as there is some interesting conversation going on | 19:13 |
| fungi | oh, i've also been trying to spend a little time troubleshooting the update-bug hooks by hand-patching the hook script to write output to /home/gerrit2/review_site/tmp/update-bug.log on the server. seems to work now i just need to push some test changes | 19:14 |
| clarkb | did you manage to get tracebacks? | 19:14 |
| fungi | not yet, no | 19:15 |
| fungi | it's only been a few minutes, and also i just realized i need to also redirect stderr ;) | 19:15 |
| clarkb | k, mostly just curious to see what is causing the problem :) | 19:16 |
| clarkb | #topic Update Config Management | 19:16 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:16 | |
| clarkb | Lets move along. Any config management updates to call out this week? | 19:16 |
| fungi | ianw has encoded our vexxhost ipv6 routes workaround into ansible for the gerrit server replacement | 19:17 |
| clarkb | and did it with a verbatim yaml content to write out | 19:18 |
| clarkb | which seems sane enough | 19:18 |
| ianw | yep, i rebooted the server | 19:18 |
| ianw | ... and just checking right now it only has one address, wihch is good | 19:18 |
| clarkb | sounds like it is working | 19:20 |
| clarkb | #topic General Topics | 19:20 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:20 | |
| clarkb | #topic Server Upgrades | 19:20 |
| *** openstack changes topic to "Server Upgrades (Meeting topic: infra)" | 19:20 | |
| clarkb | as mentioned earlier my plan is to start the zk cluster rolling replacements friday | 19:21 |
| clarkb | should be able to do it then with minimal disruption to release processes | 19:21 |
| clarkb | the review replacement continues to make progress | 19:21 |
| clarkb | any otherreplacements people are working on right now? | 19:21 |
| ianw | only removals :) | 19:21 |
| clarkb | which are next on the agenda :) | 19:21 |
| clarkb | #topic Retire planet.openstack.org | 19:21 |
| *** openstack changes topic to "Retire planet.openstack.org (Meeting topic: infra)" | 19:21 | |
| clarkb | The email notifying of this plan went out. ianw also recorded the source of blogs in a standard format should there be an attempt to resurrect it later | 19:22 |
| clarkb | I think fungi has this news going into the openinfra newsletter too | 19:22 |
| ianw | if i cloud get some reviews on | 19:22 |
| ianw | #link https://review.opendev.org/q/topic:%22planet-static%22+(status:open%20OR%20status:merged) | 19:22 |
| fungi | yeah, it's in the openstack section of the foundation newsletter going out tomorrow | 19:23 |
| ianw | that will create a planet.openstack.org redirector to the blank project | 19:23 |
| clarkb | I'll review that topic after the meeting | 19:23 |
| ianw | i guess i should get that in today so it matches whatever is in newsletter? | 19:24 |
| fungi | well, the newsletter refers to the copy attached to your announcement anyway | 19:25 |
| fungi | as long as we don't approve any new changes to the planet config it should be consistent regardless, right? | 19:25 |
| ianw | well yeah, | 19:26 |
| ianw | #link https://review.opendev.org/c/openstack/openstack-planet/+/785995 | 19:26 |
| ianw | does the actual retirement, after we stop puppeting | 19:26 |
| clarkb | ya I think we'll be fine in that case as new stuff won't be able to be added once we stop puppeting (and even then I doubt there are many of those changes) | 19:27 |
| clarkb | #topic Retiring survey.openstack.org | 19:28 |
| *** openstack changes topic to "Retiring survey.openstack.org (Meeting topic: infra)" | 19:28 | |
| clarkb | I have received notice that survey's ssl cert expires in less than a month | 19:29 |
| clarkb | I'm not sure this service ever saw much use and wonder if we can just go ahead and plan to turn it off too | 19:29 |
| clarkb | fungi: ^ do you have thoughts as I think you were most involved? | 19:29 |
| fungi | yeah, we only ever referred to it as a beta, and i think we can basically do same-week (same-day?) announcement we're discontinuing it | 19:30 |
| clarkb | cool | 19:30 |
| fungi | i can write up something | 19:30 |
| clarkb | thanks, do you think you also want to push the cahnges and hit the claenup button too? | 19:30 |
| fungi | sure, figured i'd do all that | 19:30 |
| clarkb | thanks! | 19:31 |
| clarkb | #action fungi announce survey.o.o retirement and push changes to clean it up | 19:31 |
| clarkb | #topic docs-old cleanup | 19:31 |
| *** openstack changes topic to "docs-old cleanup (Meeting topic: infra)" | 19:31 | |
| * fungi feels like a man of action now | 19:31 | |
| clarkb | ianw you reported that ajaeger says cleaning this up is fine | 19:31 |
| clarkb | anything else to add on this item or just that it can be done and will be done soon (if not already?) | 19:31 |
| ianw | yep in my queue | 19:32 |
| ianw | we should also put a robots.txt on static as well, that came up when discussing it | 19:32 |
| clarkb | ++ | 19:32 |
| fungi | oh, right-o | 19:32 |
| clarkb | I'll pull this item off the agenda then | 19:32 |
| clarkb | #topic PTG Planning | 19:33 |
| *** openstack changes topic to "PTG Planning (Meeting topic: infra)" | 19:33 | |
| clarkb | The PTG is next week. | 19:33 |
| clarkb | From meetpad's perspective it seems we never cleaned up the extra jvb after the last ptg so we should be fine there | 19:33 |
| clarkb | Our blocks of time are Thursday April 22 1400-1600UTC and 2200-0000UTC | 19:33 |
| clarkb | feel free to skip if that has you staying up all night or waking up terribly early | 19:33 |
| clarkb | the first one should be more Europe friendly and the second more apac friendly | 19:34 |
| clarkb | #link https://etherpad.opendev.org/p/apr2021-ptg-opendev | 19:34 |
| clarkb | That is our etherpad for notes as well as our meetpad room | 19:34 |
| clarkb | I sent email to service-discuss@lists.opendev.org and openstack-discuss inviting others to join us. I primarily see these blocks being used for office hours which I described in those emails | 19:34 |
| clarkb | hopeflly we can get some config reviewer volunteers in there to aks any questions, projects wanting to look at jobs, etc | 19:35 |
| clarkb | One thing I did want to ask is whether or not we thought we would be around for our weekly meeting next week | 19:35 |
| clarkb | http://ptg.openstack.org/ptg.html has the schedule and our 1900 block doesn't conflict with official ptg blocks | 19:36 |
| clarkb | But I know that we tend to get uscked in and need a break between the all day meeting blocks. | 19:36 |
| fungi | seems pragmatic to skip anyway so that the break can actually be a break | 19:36 |
| clarkb | yup | 19:36 |
| clarkb | why don't we plan to skip, and if we decide we'd rather meet I can get an agenda sent out | 19:37 |
| clarkb | this was another reason I put our time on thursday, I was hoping things would be settled down a bit by then (early ptg week tends to be busy) | 19:38 |
| ianw | ++ | 19:39 |
| clarkb | ok, that was what I had on the agenda | 19:39 |
| clarkb | #topic Open Discussion | 19:39 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:39 | |
| clarkb | Anything else? | 19:39 |
| fungi | progress on the update-bug front. apparently there are new command-line options passed to hook scripts | 19:40 |
| fungi | i have a change in progress to add those now | 19:40 |
| fungi | oh, also i updated my stack for the openstack/meta-config project addition, it should hopefully be passing tests now | 19:41 |
| clarkb | ah so we just need to accept new parameters, that is easy thankfully | 19:41 |
| fungi | yeah, argparse doesn't like being given unrecognized options | 19:41 |
| ianw | i'm trying to get some new ARM resources donated by OSU OSL (that is surprisingly easy to typo :) online | 19:42 |
| clarkb | looks like some openstacksdk struggles? | 19:42 |
| ianw | the mirror is up, but we can't talk to it as it seems the cloud launcher is hitting a bug in openstacksdk setting up the security groups | 19:42 |
| clarkb | as a workaround you can probably configure the security groups with openstackclient or neutronclient | 19:43 |
| clarkb | and then not bother with cloud launcher until the sdk is fixed | 19:43 |
| fungi | or downgrade the sdk? | 19:43 |
| ianw | yep, or pin it to an older versions | 19:43 |
| ianw | i might as well try and fix it, i don't think anyone else is rushing to :) | 19:44 |
| clarkb | ++ | 19:44 |
| ianw | one other one is | 19:46 |
| ianw | #link https://review.opendev.org/c/opendev/system-config/+/778116 | 19:46 |
| ianw | changes have merged to the upstream zuul summary plugin to have REST endpoint that projects can enable/disable the summary tab | 19:47 |
| fungi | ooh neat | 19:47 |
| ianw | as a result the plugin is a .jar with .java bits now, so we need to update as we pull from master | 19:47 |
| ianw | s/master/main actually in that case | 19:47 |
| clarkb | ianw: will that affect 3.2.8 when we update too? or is that just for 3.3 and newer ? I assume 3.2 as well since it is on the plugin side? | 19:48 |
| ianw | clarkb: yeah, 3.2.8 as well, i made a note in your update change iirc | 19:48 |
| clarkb | ok, just making sure I understand the implications :) should land yours first then | 19:48 |
| clarkb | in fact landing yours may be sufficient since I think mine is a noopy change to rebuild the image | 19:49 |
| ianw | possibly, yeah | 19:50 |
| clarkb | is this specific to zuul results or the more generic results summary tab? | 19:50 |
| clarkb | (curious if this implies lots of people using zuul now ) | 19:50 |
| clarkb | Sounds like that may be all for the meeting. Thank you for your time, we'll skip next week and hope to see you at the PTG! | 19:52 |
| clarkb | #endmeeting | 19:52 |
| *** openstack changes topic to "Incident management and meetings for the OpenDev sysadmins; normal discussions are in #opendev" | 19:52 | |
| openstack | Meeting ended Tue Apr 13 19:52:58 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:53 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2021/infra.2021-04-13-19.01.html | 19:53 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2021/infra.2021-04-13-19.01.txt | 19:53 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2021/infra.2021-04-13-19.01.log.html | 19:53 |
| ianw | clarkb: sorry, yeah the summary tab. it seems like upstream would like to include it as a base plugin | 19:53 |
| ianw | so they did the work to make it configurable per project | 19:53 |
| ianw | which was nice :) | 19:53 |
| ianw | now we have the REST example, i can probably cargo cult in other things we've wanted like making the order of results configurable | 19:54 |
| *** sboyron has quit IRC | 20:46 | |
| *** tristanC_ is now known as tristanC | 21:19 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!