| *** ysandeep|out is now known as ysandeep | 06:05 | |
| *** dmsimard6 is now known as dmsimard | 06:38 | |
| *** amoralej|off is now known as amoralej | 07:56 | |
| ykarel | opendevreview bot died? | 08:12 |
|---|---|---|
| *** ysandeep is now known as ysandeep|lunch | 08:30 | |
| *** jpena|off is now known as jpena | 08:37 | |
| frickler | ykarel: seems it lost its IRC connection without actually noticing. restarted it now | 08:37 |
| frickler | #status log restarted gerritbot which had gone missing at 04:56:40 | 08:39 |
| opendevstatus | frickler: finished logging | 08:39 |
| gthiemonge | Hi Folks, I would like to investigate CI issues, is it possible to hold a node so I could ssh to it? | 08:41 |
| frickler | gthiemonge: sure, job name and patch ID, please ;) | 08:43 |
| gthiemonge | frickler: patch id: 816370 jobname: octavia-v2-dsvm-scenario-centos-9-stream | 08:48 |
| gthiemonge | oops, it failed for an unrelated reason :/ | 08:48 |
| frickler | gthiemonge: so - no hold needed for now? | 08:52 |
| gthiemonge | frickler: yeah, probably a mirror issue with Centos, I'll ping you when this step passes, thanks! | 08:55 |
| ykarel | Thanks frickler | 08:57 |
| frickler | infra-root: https://review.opendev.org/c/zuul/nodepool/+/826538/2 is weird to me, recheck triggers gating instead of running checks again first, not sure if that's intentional or some kind of bug. | 09:01 |
| *** ysandeep|lunch is now known as ysandeep | 09:17 | |
| hrw | morning | 10:13 |
| hrw | in next week Kolla project switches to using Yoga packages. https://review.opendev.org/c/opendev/system-config/+/826500 adds mirroring of canonical UCA repo for Yoga. | 10:16 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 10:17 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 10:29 |
| *** sboyron_ is now known as sboyron | 10:44 | |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 10:46 |
| *** rlandy|out is now known as rlandy|ruck | 11:01 | |
| *** bhagyashris_ is now known as bhagyashris|ruck | 11:05 | |
| gthiemonge | Folks, could you hold the job octavia-v2-dsvm-scenario-centos-9-stream for change id 816370 for me? | 11:17 |
| *** dviroel|afk is now known as dviroel | 11:20 | |
| frickler | infra-root: ^^ I now get: sudo docker exec -it zuul-scheduler_scheduler_1 zuul autohold-list --tenant openstack | 11:21 |
| frickler | Unable to find a way to connect to Zuul, add a "web" section to your configuration file | 11:21 |
| frickler | what's the new way of doing that? if we have already documented that somewhere, I missed it | 11:21 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 11:29 |
| *** sshnaidm|afk is now known as sshnaidm | 11:35 | |
| frickler | ah, it's simply "sudo zuul-client something ..." | 12:19 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: DNM test only https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 12:22 |
| frickler | the quoting is broken the way it is being passed into that docker command, though | 12:24 |
| frickler | gthiemonge: your hold is in place now, it should catch the job that is currently running if it fails. what's your ssh pubkey? | 12:25 |
| amoralej | hi, it seems tox-py27 is broken in zuul-jobs https://zuul.opendev.org/t/zuul/build/400a9a0a5a1f435896e76d0c5ba031b5 | 12:27 |
| amoralej | ERROR: Package 'oauthlib' requires a different Python: 2.7.18 not in '>=3.6' | 12:28 |
| amoralej | is this known issue? | 12:28 |
| gthiemonge | frickler: https://github.com/gthiemonge.keys | 12:36 |
| gthiemonge | thanks | 12:36 |
| opendevreview | Dr. Jens Harbott proposed opendev/system-config master: Fix quoting in zuul-client docker wrapper https://review.opendev.org/c/opendev/system-config/+/826653 | 12:38 |
| frickler | gthiemonge: root@158.69.70.115 , let us know once you are done debugging | 12:44 |
| gthiemonge | frickler: thanks | 12:44 |
| hrw | amoralej: update pip to 20.* and retry | 12:45 |
| hrw | amoralej: if this is c7 then pip 8 is used which tries to download whatever and then complain it fails | 12:46 |
| amoralej | no, it seems that runs on ubuntu-focal | 12:46 |
| amoralej | it was working until yesterday https://zuul.opendev.org/t/zuul/builds?job_name=tox-py27&project=zuul/zuul-jobs | 12:47 |
| amoralej | i though we wouldn't be testing py27 at this point | 12:47 |
| hrw | amoralej: oauthlib 1.3.1 is fetched in newer jobs. and it dropped py2 code | 12:49 |
| amoralej | yep | 12:49 |
| hrw | wheel file is py2.py3 but there is no py2 inside | 12:49 |
| amoralej | but it seems to be in the mirrors since december | 12:49 |
| hrw | upper-constraints to the rescue ;( | 12:49 |
| amoralej | should i pin for python2.7? | 12:49 |
| amoralej | mmm do we use u-c there, let me check | 12:49 |
| amoralej | actually seems related to the version of pip or tox | 12:50 |
| amoralej | in my fedora it pulls 3.1.0 | 12:50 |
| hrw | 3.1.0 I meant and 3.1.1 | 12:50 |
| hrw | 3.1.0 is last really py2.py3 | 12:50 |
| amoralej | yep 3.1.0 is fine | 12:51 |
| amoralej | but it's pulling 3.1.1 since today | 12:51 |
| hrw | I treat py27 jobs as ugly legacy where pinning is allowed as they will be dropped 'real soon now' | 12:51 |
| hrw | took me 3 days to fix stable/train in kolla - mostly 2.7 fixes and c7/c8 handling | 12:52 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 12:55 |
| amoralej | thanks hrw ! | 12:55 |
| amoralej | let's see how it goes | 12:55 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 12:57 |
| hrw | amoralej: I wonder why tox-py27 is called in cs9 jobs | 12:57 |
| amoralej | hrw, is called in all changes in zuul-jobs | 12:57 |
| hrw | you do yoga time change when py27 is history and should be forgotten | 12:57 |
| hrw | ok | 12:58 |
| amoralej | see https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 12:58 |
| hrw | you need to add u-c change to it | 13:00 |
| hrw | oauthlib<3.1.1;python<3 | 13:00 |
| hrw | or sth like that | 13:00 |
| * hrw out | 13:00 | |
| amoralej | i did it in https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 13:00 |
| amoralej | https://review.opendev.org/c/zuul/zuul-jobs/+/826603/6/test-constraints.txt | 13:01 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: pin oauthlib version for python2.7 https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 13:10 |
| gthiemonge | frickler: I'm done with 158.69.70.115, thank you, it helps me a lot! | 13:13 |
| *** amoralej is now known as amoralej|lunch | 13:23 | |
| frickler | gthiemonge: welcome, node released | 13:27 |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: pin oauthlib version for python2.7 https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 13:32 |
| opendevreview | Dr. Jens Harbott proposed zuul/zuul-jobs master: pin oauthlib version for python2.7 https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 13:32 |
| frickler | amoralej|lunch: oops, my edit clashed with yours, I'll restore | 13:34 |
| opendevreview | Dr. Jens Harbott proposed zuul/zuul-jobs master: pin oauthlib version for python2.7 https://review.opendev.org/c/zuul/zuul-jobs/+/826648 | 13:35 |
| *** ysandeep is now known as ysandeep|brb | 13:35 | |
| opendevreview | Dr. Jens Harbott proposed openstack/project-config master: Drop gerritbot from #osism channel https://review.opendev.org/c/openstack/project-config/+/826671 | 13:41 |
| fungi | frickler: yeah, the /usr/local/bin/zuul-client on the schedulers is a wrapper around docker run already. and i agree, it would be nice if we could get multi-word parameter quoting to work reliably. i managed with escaping my quotes last time i needed to do it | 13:49 |
| frickler | fungi: see 826653, I tested that successfully on zuul02 | 13:50 |
| fungi | oh, awesome--thanks! | 13:51 |
| frickler | I always forget which way around that works, so I added a link to the bash docs where I found it again | 13:51 |
| fungi | yep, perfect. i'm the same way with $@ vs $* | 13:52 |
| *** ysandeep|brb is now known as ysandeep | 14:03 | |
| *** amoralej|lunch is now known as amoralej | 14:23 | |
| opendevreview | Alfredo Moralejo proposed zuul/zuul-jobs master: Add CentOS Stream 9 to configure-mirrors role https://review.opendev.org/c/zuul/zuul-jobs/+/826603 | 14:24 |
| *** artom__ is now known as artom | 14:50 | |
| fungi | openstack tc meeting is starting now, and the agenda includes an entry to discuss the possibility of renaming the primary branches for all projects, which is something we've discussed the potential complexities of in the past. i'll do my best to reiterate our current situation and what we know so far | 15:00 |
| *** Guest292 is now known as diablo_rojo_phone | 15:01 | |
| Clark[m] | fungi: thanks. I won't be able to make the meeting. I do still think having a single repo do it first to sort out unexpected issues is a good first step. And better if we can find a new repo rather than a well entrenched one to be the first. | 15:15 |
| fungi | yes, for actual branch moves i've seen a number of projects use symbolic refs on their remotes, but i think that would be challenging in our case because of our replication model (those don't replicate) | 15:17 |
| fungi | i think we'd have to independently create the refs on gerrit and every single gitea backend, and on github too if that mattered to people | 15:18 |
| fungi | Clark[m]: summary is that lourot is going to help us test importing an unimportant new project with a default branch of main and see how things go, as a means of gathering more info and helping spot any unforeseen problems in our basic tooling | 15:44 |
| frickler | does anyone have experience with https://gerrithub.io/ ? just the other day I was once again lamenting about how much better I like the gerrit review process over github and that might be a low-key solution | 15:45 |
| fungi | i've been aware of gerrithub for years, and i know they pioneered some of the high-availability multi-gerrit stuff, but i've never used their service | 15:45 |
| corvus | frickler: it's run by folks who are deeply involved in the gerrit community | 15:51 |
| *** dviroel is now known as dviroel|lunch | 16:13 | |
| opendevreview | Merged openstack/project-config master: Drop gerritbot from #osism channel https://review.opendev.org/c/openstack/project-config/+/826671 | 16:30 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Drop wiki-dev03 from inventory https://review.opendev.org/c/opendev/system-config/+/826734 | 16:41 |
| *** jpena is now known as jpena|off | 16:43 | |
| clarkb | fungi: frickler if you have time to review https://review.opendev.org/c/opendev/system-config/+/826145 and child I probably have time to monitor those today | 16:52 |
| frickler | clarkb: +2 on the first but some comment on the second patch | 17:01 |
| clarkb | frickler: perfect. I was far less confident in the second so questions are good (this is why I split them too) | 17:02 |
| clarkb | frickler: aha I was trying to find where it came form on newer ubuntu and not finding it. I think you are right though we can just accept the overlap instead | 17:03 |
| clarkb | I'll update | 17:03 |
| clarkb | infra-root I think I've been given the votes I need to merge the signed tag fix on gerrit 3.4, but there were questions around asking another reviewer to take a look first. I'm thinking I'll go ahead and land it early next week if the other reviewer doesn't get back to us and we can always work towards improvements in the future with them if necessary | 17:04 |
| frickler | clarkb: "dpkg -S /etc/apt/apt.conf.d/10periodic" is what I did, though it might not be installed on our nodepool images | 17:14 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Manage 10periodic and 20auto-upgrades together https://review.opendev.org/c/opendev/system-config/+/826146 | 17:19 |
| clarkb | oh right dpkg will only query its local package list | 17:19 |
| clarkb | frickler: ^ does that look better? | 17:19 |
| *** ysandeep is now known as ysandeep|out | 17:21 | |
| hrw | clarkb, fungi: can you review https://review.opendev.org/c/opendev/system-config/+/826500 one? Adds mirroring of Yoga UCA for Focal | 17:26 |
| *** dviroel|lunch is now known as dviroel | 17:26 | |
| clarkb | done | 17:28 |
| hrw | thanks | 17:28 |
| clarkb | hrw: re python2.7 earlier because zuul is a CI that people might want to use to test python2.7 despite its EOL we still need to test that zuul can run python2.7 jobs | 17:28 |
| hrw | clarkb: understood | 17:28 |
| clarkb | I agree that people should migrate away but even openstack is still running python2.7 tests and we have to support that | 17:29 |
| clarkb | (for old branches) | 17:29 |
| hrw | yeah, I spent 3 days in py27/train hell | 17:29 |
| hrw | this week | 17:29 |
| hrw | if py2.7 jobs fail then pip 20.* is kind of mandatory update for start | 17:30 |
| *** amoralej is now known as amoralej|off | 17:30 | |
| opendevreview | Merged opendev/system-config master: Manage apt.conf.d/20auto-upgrades https://review.opendev.org/c/opendev/system-config/+/826145 | 17:34 |
| fungi | yeah, i'm still unclear on why pip 9 and later isn't sufficient, in cases where there's a python_requires excluding 2.7 for packages that don't support it | 17:34 |
| fungi | pip 9 was when the python_requires support was integrated | 17:34 |
| hrw | it is all to '8-9 or 20' nowadays | 17:34 |
| hrw | and probably most of people building wheel files use latest possible | 17:34 |
| clarkb | hrm suddenlty I wonder if I should've confirmed yoga uca exists | 17:36 |
| hrw | it does | 17:36 |
| clarkb | http://ubuntu-cloud.archive.canonical.com/ubuntu/dists/focal-updates/yoga/ yupconfirmed | 17:36 |
| hrw | they created it during first weeks of Yoga cycle. | 17:36 |
| hrw | In previous cycles I sent such patch much earlier but in Kolla we decided to switch to binary packages in R-8 week instead of as-soon-as-possible | 17:37 |
| fungi | clarkb: catching up on the repo-discuss thread about unresolved inline review comments, i have a feeling the majority of them in our projects are where i see you typoed something and make an inline comment pointing it out, then you push a new revision which fixes the thing i pointed out... gerrit has enough information to be able to tell whether the line i commented on changed since the | 17:47 |
| fungi | patchset where i made the comment, and could consider that resolution | 17:48 |
| clarkb | fungi: ya one person was suggesting that heuristic could be used | 17:48 |
| fungi | or at least consider it an indication that the old comment should be hidden if it's not for either side of the current diff | 17:48 |
| fungi | maybe not explicitly resolved, just not shown (or maybe minimized) | 17:49 |
| fungi | if i comment on a line to point something out, and you push a new patchset without changing that line, then continuing to display the inline comment about it could make sense in that workflow | 17:50 |
| clarkb | ++ we're transitioning the discussion to the issue tracker if you want to add any info | 17:50 |
| fungi | i found the link, thanks | 17:50 |
| fungi | replied | 17:54 |
| clarkb | looks good thanks and ya that might be a good simple rule they can apply | 18:06 |
| *** sshnaidm is now known as sshnaidm|afk | 18:13 | |
| opendevreview | Merged opendev/system-config master: reprepro: mirror Ubuntu UCA Yoga https://review.opendev.org/c/opendev/system-config/+/826500 | 18:15 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Rebuild Gerrit images particularly for 3.4 https://review.opendev.org/c/opendev/system-config/+/826761 | 18:29 |
| clarkb | that isn't particularly urgent but seems like a good idea | 18:29 |
| clarkb | we'll need to do it again when the signed tag fix lands. As mentioned before I figured I'd give the additional reviewer until monday to weigh in if they like before proceeding on that one | 18:29 |
| clarkb | zuul is busy today | 18:38 |
| fungi | wish there was more movement on https://bugs.chromium.org/p/gerrit/issues/detail?id=15589 | 18:39 |
| clarkb | fungi: maybe we should just clean up my fix (add docs updates etc) and push it up? | 18:39 |
| fungi | maybe if we pushed your "fix" up for review in their gerrit, they'd be more inclined to comment? | 18:39 |
| fungi | hah, jinx | 18:39 |
| fungi | though it might make more sense to start with correcting the ${commit} macro behavior in gitweb.file and then pivot to a separate macro and doc updates if they decide that's a bad idea | 18:41 |
| fungi | but as you observed, the straightforward fix might have ripple effects in their gitiles integration | 18:41 |
| clarkb | ya I'm pretty sure this will breka gitiles if we just change the type of commit | 18:44 |
| clarkb | and who knows what other installations rely on this. I strongly suspect we need to add the new value | 18:44 |
| clarkb | Let me clean up that fix on 3.4 (it conflicts) and add a doc update and push that upstream | 18:44 |
| clarkb | also I just realized I think we can depends on the chagnes when pushed to gerrit upstream | 18:45 |
| clarkb | this should simplify testing and is worht a try | 18:45 |
| fungi | oh! indeed, neat idea | 18:46 |
| clarkb | fungi: ok I've got that staged up locally. I wrote myself some TODOs for what needs doing before pushing upstream (they have a linter I need to run that takes me forever to figure out and I need to make sure this still builds on 3.4 etc) | 18:50 |
| clarkb | But I've got a meeting in a few minutes so will probably happen after lunch | 18:51 |
| fungi | oh, no rush, i'm just trying to decide whether/how to roll forward with gitiles disablement | 18:53 |
| fungi | thanks for that! | 18:53 |
| clarkb | Their linter changes the files in place and I don't like that bceause it makes it hard to understand what rules they want you to follow. But I guess most people don't mind because it makes it the way they need it to be | 18:53 |
| clarkb | but also its a java tool from google that you have to figure out how to execute | 18:54 |
| fungi | eww | 18:54 |
| fungi | hopefully they have straightforward contributor docs | 18:54 |
| fungi | i guess java linters aren't easily come by so they couldn't just reuse a more generic one | 18:55 |
| clarkb | ya you basically download the jar from google and then run it directly | 18:58 |
| clarkb | or at least that is what the CI system did that first -1'd me so is what I've done since then | 18:58 |
| clarkb | there may be a better method | 18:58 |
| frickler | checking the space needed by the yoga UCA (seems neglegible), I saw that ubuntu and centos both seem very close to their limits. can we clean something up there or do we have room to bump those limits? | 19:40 |
| clarkb | frickler: we can delete centos8 in its entirety at the end of the month (that is when I announced we would do it) | 19:41 |
| clarkb | that should free up quite a bit of space on the centos volume | 19:41 |
| clarkb | ubuntu is more difficult and we might need to bump its quota | 19:42 |
| clarkb | https://grafana.opendev.org/d/T5zTt6PGk/afs?orgId=1 shows we probably have some headroom to do that now | 19:42 |
| clarkb | (thats a lot more headroom than I expected too I guess the tumbleweed and other cleanups helped) | 19:42 |
| clarkb | oh and I think fedora 34 is also in line to go away | 19:43 |
| frickler | centos is at 348/350G and seems to be growing by about 1G/d. unrelated, project.opendev has a limit of 1T, which seems a bit excessive with 134M being used, was that meant to be 1G instead? | 19:47 |
| fungi | i expect so, yes | 19:53 |
| clarkb | huh I wonder why centos is growing like that | 20:07 |
| clarkb | I wonder if we are syncing a daily VM image or container image that we shouldn't be | 20:07 |
| clarkb | fungi: https://gerrit-review.googlesource.com/c/gerrit/+/329279 | 20:16 |
| fungi | thanks! | 20:17 |
| *** dviroel is now known as dviroel|out | 20:20 | |
| ianw | frickler: heh, https://review.opendev.org/c/opendev/system-config/+/825019 had also fixed the quotes on that | 20:43 |
| opendevreview | M Camp proposed openstack/project-config master: Update StarlingX docs promote job for R6 release https://review.opendev.org/c/openstack/project-config/+/826775 | 21:33 |
| opendevreview | Merged opendev/system-config master: Run zuul project rename steps on a single scheduler https://review.opendev.org/c/opendev/system-config/+/826156 | 21:46 |
| opendevreview | Merged opendev/system-config master: Fix quoting in zuul-client docker wrapper https://review.opendev.org/c/opendev/system-config/+/826653 | 21:46 |
| opendevreview | Merged openstack/project-config master: Update StarlingX docs promote job for R6 release https://review.opendev.org/c/openstack/project-config/+/826775 | 22:03 |
| *** hrww is now known as hrw | 23:08 | |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 23:26 | |
| opendevreview | Merged openstack/diskimage-builder master: Rename existing BLS entry with the new machine-id https://review.opendev.org/c/openstack/diskimage-builder/+/825695 | 23:27 |
| clarkb | fungi: do you mind if I rebase your gitweb stack off of the local patch change we have and add a depends on to the upstream change? | 23:36 |
| clarkb | I want to see if that will work | 23:36 |
| fungi | rebase at will, and thanks again! | 23:37 |
| fungi | i'm interested to see as well | 23:37 |
| fungi | sounds like a fun experiment in cross-source dependencies | 23:37 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Drop gitweb dependencies https://review.opendev.org/c/opendev/system-config/+/825337 | 23:39 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Fix mixed spaces and hard tabs in Gerrit config https://review.opendev.org/c/opendev/system-config/+/825338 | 23:39 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Use Gitea for Gerrit's code browser URLs https://review.opendev.org/c/opendev/system-config/+/825339 | 23:39 |
| opendevreview | Clark Boylan proposed opendev/system-config master: DNM: Fail our Gerrit testing for an autohold https://review.opendev.org/c/opendev/system-config/+/825396 | 23:39 |
| clarkb | I'll put a hold on the job for 825396 too | 23:40 |
| clarkb | nice the zuul status for that stack even renders the gerrit upsteam change into the list | 23:40 |
| clarkb | and gives you a link to it too | 23:40 |
| clarkb | ok hold is in place | 23:42 |
| opendevreview | Merged openstack/diskimage-builder master: Add debian-bullseye-arm64 build test https://review.opendev.org/c/openstack/diskimage-builder/+/821652 | 23:49 |
| opendevreview | Merged openstack/diskimage-builder master: debian-minimal: remove old testing targets https://review.opendev.org/c/openstack/diskimage-builder/+/821654 | 23:53 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!