| *** DSpider has quit IRC | 00:19 | |
| *** qchris has quit IRC | 01:12 | |
| *** hamalq_ has quit IRC | 01:21 | |
| *** qchris has joined #opendev | 01:23 | |
| *** Topner has joined #opendev | 02:50 | |
| *** Topner has quit IRC | 02:54 | |
| openstackgerrit | Merged opendev/gerritlib master: Allow custom retries on gerrit connection https://review.opendev.org/754719 | 03:01 |
|---|---|---|
| openstackgerrit | Merged opendev/gerritlib master: Fix package metadata https://review.opendev.org/754788 | 03:02 |
| openstackgerrit | Merged opendev/gerritlib master: Decouple linters from unit testing https://review.opendev.org/754724 | 03:07 |
| *** cloudnull has quit IRC | 03:34 | |
| *** cloudnull has joined #opendev | 03:34 | |
| *** cloudnull4 has joined #opendev | 03:54 | |
| *** cloudnull has quit IRC | 03:55 | |
| *** cloudnull4 is now known as cloudnull | 03:55 | |
| *** ykarel|away has joined #opendev | 04:12 | |
| *** ykarel|away is now known as ykare | 04:12 | |
| *** ykare is now known as ykarel | 04:12 | |
| *** ykarel_ has joined #opendev | 04:34 | |
| *** ykarel has quit IRC | 04:36 | |
| *** marios has joined #opendev | 04:48 | |
| *** diablo_rojo has quit IRC | 04:50 | |
| *** ysandeep|away is now known as ysandeep | 04:51 | |
| *** ykarel_ is now known as ykarel | 05:10 | |
| *** roman_g has joined #opendev | 05:57 | |
| *** bhagyashri is now known as bhagyashris | 06:02 | |
| roman_g | Hello folks. Please, remind me on how do I search for a phrase across all opendev git repositories? Or is there a page with all opendev services? | 06:03 |
| frickler | roman_g: I don't think we have that currently, as the search function for gitea is still pretty broken. for openstack code we have codesearch.openstack.org but I don't think it includes other opendev repos | 06:12 |
| roman_g | frickler, thank you! | 06:12 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/755431 | 06:17 |
| *** eolivare has joined #opendev | 06:26 | |
| *** ykarel_ has joined #opendev | 06:27 | |
| *** ykarel has quit IRC | 06:29 | |
| *** slaweq has joined #opendev | 06:30 | |
| *** jhesketh has quit IRC | 06:35 | |
| *** hillpd has quit IRC | 06:54 | |
| *** rosmaita has quit IRC | 06:54 | |
| *** hamalq has joined #opendev | 06:57 | |
| *** hashar has joined #opendev | 06:59 | |
| openstackgerrit | Merged openstack/project-config master: Normalize projects.yaml https://review.opendev.org/755431 | 07:06 |
| *** andrewbonney has joined #opendev | 07:07 | |
| *** ykarel_ is now known as ykarel | 07:07 | |
| *** jhesketh has joined #opendev | 07:10 | |
| *** zigo has joined #opendev | 07:10 | |
| *** fressi has joined #opendev | 07:10 | |
| ianw | i've brought up a new backup server in vexxhost ca-ymq-1 for the borg backups. i had to delete the old openstack.org mirror, which i guess we just forgot about, for quota. will finish integrating it tomorrow | 07:13 |
| openstackgerrit | Merged opendev/system-config master: Add borg-backup roles https://review.opendev.org/741366 | 07:36 |
| *** tosky has joined #opendev | 07:39 | |
| *** moppy has quit IRC | 08:01 | |
| *** moppy has joined #opendev | 08:01 | |
| *** rosmaita has joined #opendev | 08:07 | |
| *** hillpd has joined #opendev | 08:07 | |
| *** roman_g has quit IRC | 08:14 | |
| *** hamalq has quit IRC | 08:18 | |
| *** persia has quit IRC | 08:32 | |
| *** persia has joined #opendev | 08:32 | |
| *** roman_g has joined #opendev | 08:43 | |
| *** tkajinam has quit IRC | 08:47 | |
| *** hillpd has quit IRC | 08:52 | |
| *** rosmaita has quit IRC | 08:52 | |
| *** hamalq has joined #opendev | 09:00 | |
| *** ysandeep is now known as ysandeep|away | 09:01 | |
| *** hamalq has quit IRC | 09:04 | |
| *** rosmaita has joined #opendev | 09:10 | |
| *** hillpd has joined #opendev | 09:10 | |
| *** DSpider has joined #opendev | 09:17 | |
| *** fressi has quit IRC | 09:21 | |
| *** fressi has joined #opendev | 09:24 | |
| *** eolivare has quit IRC | 09:31 | |
| *** eolivare has joined #opendev | 09:31 | |
| *** fressi has quit IRC | 09:45 | |
| *** fressi has joined #opendev | 09:45 | |
| *** priteau has joined #opendev | 09:48 | |
| *** hamalq has joined #opendev | 10:05 | |
| *** ysandeep|away is now known as ysandeep|sick | 10:09 | |
| *** hamalq has quit IRC | 10:09 | |
| *** roman_g has quit IRC | 10:15 | |
| *** smcginnis has quit IRC | 10:22 | |
| *** smcginnis has joined #opendev | 10:22 | |
| *** Gyuseok_Jung has joined #opendev | 11:59 | |
| *** hamalq has joined #opendev | 12:06 | |
| *** hamalq has quit IRC | 12:10 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 12:26 |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Update ensure-docker for new releases https://review.opendev.org/752630 | 12:28 |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 12:48 |
| *** fressi has quit IRC | 12:50 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 13:22 |
| *** slaweq has quit IRC | 13:36 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 13:41 |
| *** slaweq has joined #opendev | 13:42 | |
| *** diablo_rojo has joined #opendev | 14:02 | |
| *** hamalq has joined #opendev | 14:07 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 14:10 |
| *** hamalq has quit IRC | 14:11 | |
| *** hashar has quit IRC | 14:21 | |
| fungi | frickler: codesearch.openstack.org does index all of opendev's repositories, for what it's worth | 14:38 |
| fungi | if i see roman_g return i'll try to remember to let him know | 14:38 |
| frickler | fungi: oh, o.k., good to know | 14:40 |
| fungi | all except the retired ones, i think | 14:41 |
| fungi | though it only indexes the master branches (i think gitea's search, if it worked, also only returns results on the default branch of each repository too) | 14:41 |
| *** fressi has joined #opendev | 14:53 | |
| openstackgerrit | Jens Harbott (frickler) proposed opendev/zone-opendev.org master: Increase the default TTL in the opendev.org zone to 1h https://review.opendev.org/755550 | 14:55 |
| frickler | dirk: fungi: ^^ | 14:55 |
| fungi | thanks! | 14:59 |
| *** fressi has quit IRC | 15:06 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 15:07 |
| clarkb | frickler: fungi: since we don't use dynamic dns for load balancing or similar I expect that change is fine. We might also want to clean up the records that have a 3600 second ttl already set | 15:07 |
| *** mlavalle has joined #opendev | 15:08 | |
| fungi | oh, indeed, i missed that some of the mirrors in particular already have that | 15:08 |
| *** Topner has joined #opendev | 15:15 | |
| *** Topner has quit IRC | 15:19 | |
| *** hashar has joined #opendev | 15:40 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Validate ensure-docker works https://review.opendev.org/755505 | 15:41 |
| *** ykarel is now known as ykarel|away | 15:48 | |
| zbr | did anyone had time to look into enabling issue tracker on gitea? i remember that the issue was the distributed part. | 15:51 |
| *** ykarel|away has quit IRC | 15:53 | |
| clarkb | zbr: the next release of gitea will include support for a centralized index system. With that we should be able to test running a gitea cluster again (database and git storage are the other two items which we think we already sorted out last time with mariadb clustering and cephfs). THis is a topic on the ptg agenda fwiw | 15:53 |
| clarkb | basically it can't happen any sooner than giteas next release and potentially needs more time after that | 15:54 |
| clarkb | I expect the first step will be to upgrade our existing systems to the latest release. Ensure it works happily. Then possibly add in the index system in a non centralized manner (because its easy and allows us to test in prod), then look at k8s again. But all of that can be discussed during the ptg | 15:55 |
| zbr | that is great as I am really missing an integrated issue tracker near the code, we just have too many separated systems. | 15:55 |
| clarkb | note, that we won't necessarily enable additional features once we've redeployed into a cluster either. All of that will need to be sorted out once the underlying issue is addressed | 15:56 |
| *** diablo_rojo has quit IRC | 15:57 | |
| * zbr lowers his expectations for 2020 | 15:57 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Update ensure-docker for new releases https://review.opendev.org/752630 | 16:00 |
| clarkb | fungi: re abi3 python wheels I wonder if we should try building abi3 wheels for our mirror first, then fallback to python specific next | 16:00 |
| openstackgerrit | Merged zuul/zuul-jobs master: Merge upload logs modules into common role https://review.opendev.org/742732 | 16:00 |
| *** hamalq has joined #opendev | 16:00 | |
| clarkb | to slowly get away from needing to build distro release specific wheels instad we might be able to do linux x86_64 and linux aarch64 | 16:01 |
| clarkb | (I'm sure reality is <10% of them build cleanly that way though) | 16:01 |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Update ensure-docker for new releases https://review.opendev.org/752630 | 16:02 |
| fungi | clarkb: we'll need to build them in appropriate containers, but yeah if someone works out the logistics it seems like a win | 16:03 |
| *** hamalq has quit IRC | 16:04 | |
| fungi | looks like the zuul images have updated with the rollback to python 3.7 as of half an hour ago, so we should be safe to restart executors, yeah? | 16:04 |
| *** hamalq has joined #opendev | 16:04 | |
| clarkb | fungi: the zuul-executor image on ze01 is 2 hours old | 16:05 |
| clarkb | you may want to docker-compose pull ; docker-compose down ; docker-compose up -d just to be sure you get the latest image | 16:05 |
| clarkb | but yes I expect so | 16:05 |
| fungi | yeah, i intended to do a pull | 16:05 |
| openstackgerrit | Jens Harbott (frickler) proposed opendev/zone-opendev.org master: Increase the default TTL in the opendev.org zone to 1h https://review.opendev.org/755550 | 16:06 |
| fungi | infra-root: i'm going to pull/down/up -d on ze01 here in a moment for the python 3.7 rollback, speak up if you have concerns | 16:06 |
| frickler | clarkb: ^^ amended with removal of all the explicit 3600 TTLs | 16:06 |
| fungi | if ze01 goes well, i'll proceed with the others | 16:06 |
| clarkb | fungi: sounds good to me | 16:06 |
| *** hamalq has quit IRC | 16:07 | |
| *** hamalq has joined #opendev | 16:08 | |
| fungi | fungi@ze01:/etc/zuul-executor$ sudo docker-compose exec executor python3 --version | 16:08 |
| fungi | Python 3.7.8 | 16:08 |
| clarkb | doesn't look like the image updated so the 2 hour old image is likely the one that switched to 3.7 | 16:09 |
| fungi | no, the revert only merged at 1521z | 16:09 |
| fungi | so it's been well under an hour | 16:09 |
| fungi | how/where are you inspecting the image? | 16:11 |
| fungi | the output from when i did the pull was "Pulling executor ... done" so it at least thinks it has the latest image | 16:11 |
| clarkb | fungi: `sudo docker image list` we build the image in gate and them relabel it in promote so I think the image may be that old | 16:11 |
| fungi | oh, i guess it was approved at 14:07:15 so could in theory have been uploaded from the gate pipeline that quickly | 16:12 |
| fungi | i was looking at timing for the promote job tasks, but yeah that's just relabelling not uploading | 16:13 |
| fungi | okay, well it looks like ze01 has jobs running for a few minutes already, i'll check its logs for a success | 16:17 |
| clarkb | I expect its fine since we had run on 3.7 for a long long time | 16:17 |
| fungi | yeah, i'm not worried about it, just due diligence before i go killing the entire system with some subtle bug | 16:18 |
| fungi | the debug log on ze01 says this reported success: https://e63daf97f32f2cebe260-b80014e5a7a6453c822c4dc8f22159da.ssl.cf1.rackcdn.com/754064/1/gate/kayobe-tox-ansible-syntax/fb0b56b/ | 16:25 |
| fungi | the buildset hasn't reported yet though so just had to confirm by digging in the uploaded logs | 16:25 |
| clarkb | the log confirms that ran on ze01, I think you're clear to proceed with the others | 16:25 |
| fungi | yeah, well i mean, it wouldn't have been in ze01's debug log if it hadn't run on ze01 | 16:29 |
| fungi | thanks for confirming! | 16:29 |
| fungi | proceeding with the others now in an orderly fashion | 16:30 |
| fungi | #status log restarted all zuul executors on latest docker image for https://review.opendev.org/755518 to fix the ensure-twine role failures | 16:37 |
| openstackstatus | fungi: finished logging | 16:37 |
| clarkb | I can help reenqueue things to deal with the failed jobs too if that helps | 16:37 |
| fungi | not necessary. i basically just feed the list of build urls to a script and then run the resulting command | 16:40 |
| clarkb | k | 16:41 |
| fungi | only takes a moment | 16:41 |
| fungi | but i'll dip my toe in the waters with one to start, just to make sure stuff's back to working | 16:41 |
| *** eolivare has quit IRC | 16:45 | |
| fungi | i've reenqueued a cinder ref into the release pipeline for the openstack tenant now | 16:46 |
| fungi | watching to make sure it works | 16:46 |
| *** marios is now known as marios|out | 16:55 | |
| fungi | success on the release-openstack-python job this time, so i think we're back in business on pypi uploads | 16:59 |
| clarkb | ianw: ^ fyi I think that this restart has enabled the find moduel via your change | 17:21 |
| fungi | oh, good point | 17:22 |
| *** ykarel|away has joined #opendev | 17:43 | |
| *** dtroyer has quit IRC | 17:55 | |
| *** hillpd has quit IRC | 18:00 | |
| *** rosmaita has quit IRC | 18:00 | |
| *** marios|out has quit IRC | 18:09 | |
| *** ykarel|away has quit IRC | 18:20 | |
| *** diablo_rojo has joined #opendev | 18:22 | |
| *** Topner has joined #opendev | 18:39 | |
| openstackgerrit | Merged openstack/project-config master: Cleanup unneeded lines for os-loganalyze https://review.opendev.org/754990 | 18:45 |
| *** rosmaita has joined #opendev | 18:47 | |
| *** hillpd has joined #opendev | 18:47 | |
| *** iurygregory has quit IRC | 18:55 | |
| *** priteau has quit IRC | 19:11 | |
| *** Topner has quit IRC | 19:16 | |
| *** iurygregory has joined #opendev | 19:43 | |
| *** Topner has joined #opendev | 19:46 | |
| *** rosmaita has left #opendev | 19:49 | |
| *** Topner has quit IRC | 19:50 | |
| *** hashar has quit IRC | 20:48 | |
| *** andrewbonney has quit IRC | 21:13 | |
| *** slaweq has quit IRC | 21:15 | |
| ianw | clarkb: cool, that means we can probably get that sphinx zuul-job working without too much re-writing | 21:20 |
| ianw | fungi / clarkb: if you have a sec to look over https://review.opendev.org/#/c/755181/1/playbooks/roles/static/files/50-tarballs.opendev.org.conf and https://review.opendev.org/#/c/754257/2/renames/move.sh that's something i can clear out | 21:23 |
| fungi | yep, sorry, i meant to look at that this morning, and then... stuff | 21:24 |
| ianw | always the way :) | 21:25 |
| fungi | so much stuff | 21:37 |
| openstackgerrit | Catie Rencricca proposed opendev/storyboard master: Add project to email notifications https://review.opendev.org/755664 | 22:25 |
| openstackgerrit | Catie Rencricca proposed opendev/storyboard master: Add project to email notifications https://review.opendev.org/755664 | 22:35 |
| *** tosky has quit IRC | 22:45 | |
| clarkb | #status log review-test has been synced from prod. The sync playbook won't work as is due to db backups including extra databases. We just did it manually. | 22:49 |
| openstackstatus | clarkb: finished logging | 22:49 |
| clarkb | infra-root ^ fyi fungi and I worked through that today. Plan is to turn on a gerrit 2.13 review-test gerrit tomorrow | 22:49 |
| clarkb | assuming we get that to turn on happily we'll snapshot the cinder volume at 2.13 and then can work on testing the upgrade | 22:50 |
| *** tkajinam has joined #opendev | 23:00 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: ensure-twine: remove readme_renderer https://review.opendev.org/755670 | 23:15 |
| openstackgerrit | Merged zuul/zuul-jobs master: ensure-twine: remove readme_renderer https://review.opendev.org/755670 | 23:32 |
| *** DSpider has quit IRC | 23:34 | |
| *** mlavalle has quit IRC | 23:41 | |
| ianw | ok, so i'm planning on doing a "vos backup" of the tarballs, then doing the move, then committing the apache redirects | 23:42 |
| clarkb | oh sorry I meant to look at those files you pointed out then got distracted | 23:44 |
| clarkb | ianw: on the redirects when you root the regex with ^ do you need to have / as the first character or is that implied? | 23:44 |
| ianw | i think it's implied? | 23:45 |
| clarkb | k I wasn't sure | 23:45 |
| clarkb | move.sh seems fine too and we can always mv back or rstore for backup? so ya I think that looks good | 23:46 |
| ianw | i presume you just mount "project.tarballs.backup" | 23:46 |
| clarkb | ianw: ya I expect you attach it in the afs tree and then cp? | 23:47 |
| *** Topner has joined #opendev | 23:48 | |
| ianw | rmdir: failed to remove 'openstack/afsmon': Connection timed out | 23:50 |
| ianw | what is sardonic? | 23:51 |
| ianw | https://opendev.org/sardonic/sardonic looks like it never really started | 23:52 |
| *** Topner has quit IRC | 23:52 | |
| clarkb | ianw: re the rmdir maybe its empty checks don't work with afs? | 23:52 |
| ianw | i dunno :/ that was the only error from move.sh | 23:53 |
| ianw | everything else seems to be where i'd expect it | 23:53 |
| ianw | zuul/zuul is filled out | 23:54 |
| *** hillpd has quit IRC | 23:54 | |
| ianw | hrm, although the dirs might be owned by me, damn, didn't think of that | 23:55 |
| ianw | ultimately it doesn't matter if the acl is right though i guess? | 23:56 |
| clarkb | I think it matters for the dirs if zuul jobs will be able to write there. If zuul jobs can write there I think it should be fine | 23:56 |
| clarkb | but ya otherwise if apache can read the files I think we're good? | 23:57 |
| ianw | Normal rights: | 23:59 |
| ianw | opendev-tarballs rlidwk | 23:59 |
| ianw | system:administrators rlidwka | 23:59 |
| ianw | system:anyuser rl | 23:59 |
| *** redrobot has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!