| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 00:03 |
|---|---|---|
| *** rlandy|rover is now known as rlandy|rover|bbl | 00:04 | |
| *** jtomasek has quit IRC | 00:04 | |
| *** gyee has quit IRC | 00:13 | |
| fungi | ianw: yeah, you can check the syslog or daemon log | 00:23 |
| fungi | should see the time when the reload was called and what the results of that were | 00:23 |
| ianw | fungi: yeah, so far i'm doing a "dig -t" in the testinfra phase and not seeing the TXT records installed | 00:25 |
| *** gregoryo has joined #openstack-infra | 00:25 | |
| ianw | i think the file looks right -> http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/hosts/bridge.openstack.org/ara-report/result/4126c705-eaf8-4bcc-9561-7b6102060f71/ | 00:25 |
| ianw | https://git.openstack.org/cgit/openstack-infra/system-config/tree/testinfra/test_letsencrypt.py?h=refs/changes/59/636759/61#n28 is what i was hoping would show the records installed | 00:27 |
| *** tosky has quit IRC | 00:27 | |
| fungi | @localhost is the test bridge in this case? | 00:29 |
| fungi | where is the output of that call in your test run? | 00:29 |
| ianw | fungi: that should be running on the test adns1.opendev.org server | 00:30 |
| ianw | fungi: the output is captured into -> http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/bridge.openstack.org/junit.xml.gz | 00:31 |
| fungi | okay, so serial is 1552977177 | 00:35 |
| *** diablo_rojo has quit IRC | 00:35 | |
| fungi | and no TXT records | 00:35 |
| *** lseki has quit IRC | 00:36 | |
| ianw | yeah, the serial made with the TXT records is 1553559245 | 00:36 |
| fungi | so that suggests the updated zonefile was never loaded successfully | 00:37 |
| fungi | do we capture syslog? | 00:37 |
| ianw | the check worked http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/hosts/bridge.openstack.org/ara-report/result/3fc3577d-df82-4a3f-8911-08c7ac657d5f/ | 00:37 |
| ianw | hrm, let's see | 00:37 |
| fungi | http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/adns1.opendev.org/syslog.txt.gz | 00:37 |
| fungi | we do! | 00:37 |
| ianw | http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/adns1.opendev.org/syslog.txt.gz | 00:38 |
| ianw | jinx | 00:38 |
| fungi | http://logs.openstack.org/59/636759/61/check/system-config-run-letsencrypt/2e8b646/adns1.opendev.org/syslog.txt.gz#_Mar_26_00_16_42 | 00:38 |
| fungi | is where it's called to reload for that serial | 00:39 |
| ianw | zone acme.opendev.org/IN (signed): could not get zone keys for secure dynamic update | 00:39 |
| fungi | yeah, so maybe not setting up dnssec signing keys correctly for that zone? | 00:40 |
| ianw | that is likely. is dnssec useful here? | 00:40 |
| fungi | by "here" you mean in the job or for letsencrypt domain validation? | 00:41 |
| ianw | i mean for acme.opendev.org | 00:41 |
| fungi | there wouldn't be much benefit to performing a mitm attack on the domain validation record, no | 00:42 |
| fungi | and we don't really have control over whether le checks dnssec | 00:42 |
| ianw | hrm, ok, have to look at what these roles are doing with dnssec ... getting closer anyway ... | 00:45 |
| *** yamamoto has joined #openstack-infra | 00:46 | |
| *** yamamoto has quit IRC | 00:50 | |
| *** jamesmcarthur has joined #openstack-infra | 00:53 | |
| fungi | ianw: regarding the zanata situation, ianychoi mentioned it in his ptl candidate platform as well, so the i18n team seems to be aware of the situation | 00:54 |
| ianw | oh good, yeah it's a shame as it seemed to be working well with the proposal bot etc | 00:55 |
| *** dustinc|away has quit IRC | 00:56 | |
| *** tosky has joined #openstack-infra | 01:01 | |
| *** tosky has quit IRC | 01:06 | |
| *** ricolin has joined #openstack-infra | 01:07 | |
| *** yamamoto has joined #openstack-infra | 01:17 | |
| *** wolverineav has quit IRC | 01:21 | |
| *** wolverineav has joined #openstack-infra | 01:22 | |
| *** yamamoto has quit IRC | 01:23 | |
| *** wolverineav has quit IRC | 01:23 | |
| *** wolverineav has joined #openstack-infra | 01:23 | |
| *** wolverineav has quit IRC | 01:27 | |
| *** wolverineav has joined #openstack-infra | 01:28 | |
| *** jamesmcarthur has quit IRC | 01:30 | |
| *** wolverineav has quit IRC | 01:33 | |
| *** jamesmcarthur has joined #openstack-infra | 01:38 | |
| *** whoami-rajat has joined #openstack-infra | 01:57 | |
| *** ykarel|away has joined #openstack-infra | 02:06 | |
| *** jamesmcarthur has quit IRC | 02:13 | |
| *** mpjetta has quit IRC | 02:17 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: master-nameserver: Add unmanaged domains; add acme.opendev.org https://review.openstack.org/641155 | 02:18 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 02:18 |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:31 | |
| *** rlandy|rover has quit IRC | 02:31 | |
| *** hongbin has joined #openstack-infra | 02:34 | |
| *** yamamoto has joined #openstack-infra | 02:37 | |
| *** yamamoto has quit IRC | 02:42 | |
| *** jamesmcarthur has joined #openstack-infra | 02:48 | |
| *** armax has quit IRC | 02:51 | |
| *** jamesmcarthur has quit IRC | 02:51 | |
| *** jamesmcarthur has joined #openstack-infra | 02:52 | |
| *** roman_g has quit IRC | 02:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 03:02 |
| *** reed has quit IRC | 03:04 | |
| *** ramishra has joined #openstack-infra | 03:11 | |
| *** ykarel|away is now known as ykarel | 03:12 | |
| *** jamesmcarthur has quit IRC | 03:14 | |
| *** apetrich has quit IRC | 03:14 | |
| *** mpjetta has joined #openstack-infra | 03:18 | |
| *** yamamoto has joined #openstack-infra | 03:23 | |
| *** yamamoto has quit IRC | 03:27 | |
| *** yamamoto has joined #openstack-infra | 03:30 | |
| *** wolverineav has joined #openstack-infra | 03:42 | |
| *** jamesmcarthur has joined #openstack-infra | 03:44 | |
| *** jamesmcarthur has quit IRC | 03:48 | |
| *** adam_g has quit IRC | 03:51 | |
| *** adam_g has joined #openstack-infra | 03:52 | |
| *** udesale has joined #openstack-infra | 03:58 | |
| *** janki has joined #openstack-infra | 03:59 | |
| *** yamamoto has quit IRC | 04:10 | |
| *** yamamoto has joined #openstack-infra | 04:10 | |
| *** hongbin has quit IRC | 04:10 | |
| *** janki has quit IRC | 04:16 | |
| *** ykarel has quit IRC | 04:16 | |
| *** janki has joined #openstack-infra | 04:17 | |
| *** eernst has joined #openstack-infra | 04:18 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 04:30 |
| *** ykarel has joined #openstack-infra | 04:39 | |
| *** wolverineav has quit IRC | 04:45 | |
| *** eernst has quit IRC | 04:46 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Get executor job params https://review.openstack.org/607078 | 04:47 |
| *** ricolin is now known as ricolin_phone | 05:02 | |
| *** ricolin_phone is now known as ricolin | 05:04 | |
| *** ricolin is now known as ricolin_ | 05:04 | |
| *** ricolin_ is now known as ricolin_afk | 05:04 | |
| *** ricolin_afk is now known as ricolin | 05:05 | |
| *** tkajinam_ has joined #openstack-infra | 05:06 | |
| *** ricolin_phone has joined #openstack-infra | 05:08 | |
| *** tkajinam has quit IRC | 05:08 | |
| *** yamamoto has quit IRC | 05:09 | |
| *** ricolin_phone has quit IRC | 05:14 | |
| *** markvoelker has joined #openstack-infra | 05:17 | |
| openstackgerrit | Merged openstack-infra/zuul master: web: check if project has variant https://review.openstack.org/647260 | 05:20 |
| *** yboaron has joined #openstack-infra | 05:44 | |
| ianw | fungi: well there's several hours of debugging ... :) @localhost gets you a response from unbound ... @<ip address> gets you the listening bind process ... which has the txt records | 05:46 |
| *** ykarel has quit IRC | 05:52 | |
| *** diablo_rojo has joined #openstack-infra | 05:54 | |
| *** yboaron_ has joined #openstack-infra | 05:58 | |
| *** yboaron has quit IRC | 06:01 | |
| *** ykarel has joined #openstack-infra | 06:16 | |
| *** wolverineav has joined #openstack-infra | 06:25 | |
| *** diablo_rojo has quit IRC | 06:27 | |
| *** wolverineav has quit IRC | 06:33 | |
| *** quiquell|off is now known as quiquell | 06:43 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 06:45 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Organize documentation by subject area https://review.openstack.org/645955 | 06:51 |
| *** kjackal has joined #openstack-infra | 06:54 | |
| *** kopecmartin|off is now known as kopecmartin | 07:00 | |
| *** tkajinam__ has joined #openstack-infra | 07:05 | |
| *** wolverineav has joined #openstack-infra | 07:06 | |
| *** tkajinam_ has quit IRC | 07:07 | |
| *** kaisers has joined #openstack-infra | 07:09 | |
| *** pcaruana has joined #openstack-infra | 07:10 | |
| *** apetrich has joined #openstack-infra | 07:12 | |
| *** slaweq has quit IRC | 07:15 | |
| *** slaweq has joined #openstack-infra | 07:17 | |
| *** pgaxatte has joined #openstack-infra | 07:18 | |
| *** e0ne has joined #openstack-infra | 07:25 | |
| *** ykarel is now known as ykarel|lunch | 07:26 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Add tripleo-collect-logs project to TripleO https://review.openstack.org/647667 | 07:27 |
| *** ramishra_ has joined #openstack-infra | 07:31 | |
| *** ramishra has quit IRC | 07:34 | |
| cmurphy | there was a new opensuse-150 image built on nb01 yesterday but on nb02 the latest is from two days ago, how can we tell which one is being used in a job? | 07:36 |
| *** gregoryo has quit IRC | 07:36 | |
| *** wolverineav has quit IRC | 07:39 | |
| *** ricolin_phone has joined #openstack-infra | 07:42 | |
| *** ricolin_phone has quit IRC | 07:44 | |
| *** ricolin_phone has joined #openstack-infra | 07:45 | |
| *** ricolin_phone has quit IRC | 07:57 | |
| *** ccamacho has joined #openstack-infra | 08:03 | |
| *** rpittau|afk is now known as rpittau | 08:06 | |
| *** wolverineav has joined #openstack-infra | 08:06 | |
| AJaeger | cmurphy: http://logs.openstack.org/55/646855/1/check/openstack-infra-base-integration-opensuse15/4120ed6/job-output.txt.gz#_2019-03-26_06_33_44_621989 | 08:10 |
| cmurphy | AJaeger: thanks, so i guess that's a new image :/ | 08:11 |
| AJaeger | looks like it ;( | 08:11 |
| *** tosky has joined #openstack-infra | 08:14 | |
| *** ginopc has joined #openstack-infra | 08:16 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Elasticsearch Zuul reporter https://review.openstack.org/644927 | 08:17 |
| cmurphy | the unbound log shows it seems to resolve git.opentack.org just fine http://logs.openstack.org/90/645890/3/check/keystone-dsvm-functional-federation-opensuse15/e320b54/controller/logs/unbound_log.txt so weird that the traceroute command later complains about name resolution | 08:17 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Separate out executor server from runner https://review.openstack.org/607079 | 08:18 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: implement prep-workspace https://review.openstack.org/607082 | 08:18 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: add configuration schema https://review.openstack.org/640672 | 08:18 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: add execute sub-command https://review.openstack.org/630944 | 08:18 |
| *** jpena|off is now known as jpena | 08:21 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Elasticsearch Zuul reporter https://review.openstack.org/644927 | 08:23 |
| *** xek has joined #openstack-infra | 08:23 | |
| *** tkajinam__ has quit IRC | 08:25 | |
| *** ykarel|lunch is now known as ykarel | 08:32 | |
| *** dtantsur|afk is now known as dtantsur | 08:33 | |
| *** helenafm has joined #openstack-infra | 08:34 | |
| *** rcernin has quit IRC | 08:36 | |
| AJaeger | cmurphy: indeed strange. Looking at the file, it does a git lookup at 21:52:28 - and the error is at the same time, see http://logs.openstack.org/90/645890/3/check/keystone-dsvm-functional-federation-opensuse15/e320b54/job-output.txt.gz#_2019-03-25_21_52_28_528265 | 08:36 |
| AJaeger | so, unbound.log shows both IPv4 and IPv6 returns - but still traceroute is unhappy? I'm confused ;( | 08:37 |
| cmurphy | me too | 08:38 |
| AJaeger | cmurphy: that's not the answer I had hoped for ;) | 08:40 |
| *** wolverineav has quit IRC | 08:40 | |
| *** electrofelix has joined #openstack-infra | 08:40 | |
| cmurphy | :P | 08:40 |
| cmurphy | i can see it's happening on at least rax and vexxhost so probably not a cloud provider issue | 08:41 |
| cmurphy | i don't see any major differences in the unbound log on my machine where it works and the unbound log in ci where it doesn't | 08:41 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 08:42 |
| cmurphy | i see i have a slightly different version of unbound - unbound-1.6.8-lp150.2.6.1.x86_64 vs unbound-1.6.8-lp150.1.4.x86_64 http://logs.openstack.org/90/645890/3/check/keystone-dsvm-functional-federation-opensuse15/e320b54/controller/logs/rpm-qa.txt.gz | 08:43 |
| cmurphy | but downgrading doesn't change anything | 08:45 |
| AJaeger | ;( | 08:46 |
| *** quiquell has quit IRC | 08:47 | |
| *** quiquell has joined #openstack-infra | 08:47 | |
| cmurphy | maybe there's an infra-root who can hold an opensuse-150 node for me so i can poke around? | 08:50 |
| openstackgerrit | Hervé Beraud proposed openstack-dev/pbr master: Set subparser argument required https://review.openstack.org/647492 | 08:51 |
| *** priteau has joined #openstack-infra | 08:58 | |
| *** jpich has joined #openstack-infra | 08:58 | |
| *** sshnaidm|pto is now known as sshnaidm|rover | 09:00 | |
| *** Lucas_Gray has joined #openstack-infra | 09:00 | |
| *** priteau has quit IRC | 09:01 | |
| *** priteau has joined #openstack-infra | 09:03 | |
| *** rossella_s has quit IRC | 09:06 | |
| *** rossella_s has joined #openstack-infra | 09:11 | |
| ianw | cmurphy: umm, is there a job known to fail to place the hold for? | 09:14 |
| AJaeger | ianw: we can recheck https://review.openstack.org/646855 again | 09:15 |
| ianw | i just logged into one and did a ping google.com -> http://paste.openstack.org/show/748369/ | 09:17 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 09:18 |
| ianw | hang on, http://paste.openstack.org/show/748370/ is more it | 09:19 |
| cmurphy | looks the same as the other logs for failing jobs http://logs.openstack.org/90/645890/3/check/keystone-dsvm-functional-federation-opensuse15/e320b54/controller/logs/unbound_log.txt | 09:20 |
| cmurphy | www.google.com. 106 IN A 172.217.164.164 | 09:21 |
| ianw | opensuse-150-rax-iad-0004295209:~ # ping www.google.com | 09:21 |
| ianw | ping: www.google.com: Temporary failure in name resolution | 09:21 |
| cmurphy | confusing | 09:23 |
| *** yboaron_ has quit IRC | 09:23 | |
| ianw | cmurphy: http://paste.openstack.org/show/748372/ | 09:27 |
| ianw | i can jump on a host for a second, but then it disappears. | 09:27 |
| ianw | i'll try a hold on 656855 | 09:27 |
| cmurphy | this is different from my tests info: failed to prime trust anchor -- DNSKEY rrset is not secure . DNSKEY IN | 09:28 |
| ianw | i wodner if it is looking like that issue i linked to last night with the dnssec issues ... | 09:30 |
| *** bringha has joined #openstack-infra | 09:30 | |
| cmurphy | maybe :( | 09:31 |
| ianw | i've got a hold, trying to see if i can grab one | 09:31 |
| ianw | a zuul hold i mean, on 646855 | 09:32 |
| AJaeger | ianw: ah, indeed! That was already in cmurphy's unbound log: "info: validation failure git.openstack.org. A IN" but I missed that one ;( Thanks! | 09:34 |
| *** wolverineav has joined #openstack-infra | 09:37 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/infra-manual master: Improve the details about settings i18n for new repos https://review.openstack.org/630981 | 09:37 |
| *** rcernin has joined #openstack-infra | 09:44 | |
| SotK | is there an easy way to test the behaviour of a post job, ie. to make sure a patch isn't breaking it? | 09:46 |
| *** e0ne has quit IRC | 09:49 | |
| ianw | SotK: no magic tricks really; other than sort of validating by parts in local testing, but some post things just can't be done anywhere else | 09:49 |
| *** ykarel is now known as ykarel|afk | 09:52 | |
| ianw | cmurphy: looks like we go 149.202.184.197 held | 09:53 |
| *** ccamacho has quit IRC | 09:53 | |
| *** fakir has joined #openstack-infra | 09:55 | |
| *** Lucas_Gray has quit IRC | 09:55 | |
| *** lucasagomes has quit IRC | 09:56 | |
| *** e0ne has joined #openstack-infra | 09:56 | |
| *** Lucas_Gray has joined #openstack-infra | 09:56 | |
| *** ykarel|afk has quit IRC | 09:57 | |
| ianw | there's no editor on this host | 09:58 |
| fakir | Hey guys, I got a problem with connecting secund openstack project to the zuul. I ve add new provider with correct pools and labels to the nodepool.yaml and 2nd. project to the clouds.yaml, but still i cannot spawn nodes on that machine :/ | 09:58 |
| *** Lucas_Gray has quit IRC | 10:00 | |
| ianw | fakir: #zuul might be a little more help | 10:01 |
| *** Lucas_Gray has joined #openstack-infra | 10:01 | |
| fakir | ty | 10:03 |
| ianw | cmurphy: i've added your keys from github to 149.202.184.197 which is exhibiting the issue. it feels a lot like the dnssec thing i linked to last night, but i dunno... | 10:04 |
| *** ccamacho has joined #openstack-infra | 10:04 | |
| cmurphy | ianw: thanks, looking | 10:04 |
| *** jtomasek has joined #openstack-infra | 10:05 | |
| *** cmoura has quit IRC | 10:07 | |
| cmurphy | ianw: what was the resolution to that dnssec problem? | 10:08 |
| ianw | cmurphy: switching dns providers -- https://review.openstack.org/#/c/635895/ -- but it seems like it is using the right ones now | 10:09 |
| *** wolverineav has quit IRC | 10:09 | |
| *** cmoura has joined #openstack-infra | 10:10 | |
| *** yboaron_ has joined #openstack-infra | 10:10 | |
| *** bringha has quit IRC | 10:11 | |
| cmurphy | it's definitely an unbound issue because switching the nameserver to 8.8.8.8 fixes it | 10:13 |
| ianw | does switching unbound to 8.8.8.8 fix it? | 10:14 |
| cmurphy | unbound already has forward-addr: 8.8.8.8 in /etc/unbound/forwarding.conf | 10:15 |
| *** yboaron_ has quit IRC | 10:16 | |
| *** yboaron_ has joined #openstack-infra | 10:16 | |
| ianw | fungi: http://logs.openstack.org/59/636759/66/check/system-config-run-letsencrypt/6f1b649/bridge.openstack.org/junit.xml.gz -- yay, it's showing the TXT records. i just need to beat it into a reviewable state now, but i don't have anything else i plan to code | 10:16 |
| ianw | cmurphy: hrm, wasn't the log showing it hitting 1.1.1.1? | 10:16 |
| ianw | cmurphy: sorry, i gotta go, it's getting late :/ i'll leave you to the joy of unbound debugging ... | 10:17 |
| cmurphy | ianw: the log showed it hitting both i think | 10:17 |
| ianw | as the suse login prompt thing says "Have a lot of fun..." | 10:17 |
| cmurphy | ianw: have a good night | 10:18 |
| openstackgerrit | Nir Magnezi proposed openstack/diskimage-builder master: Add version-less RHEL element for RHEL7 and RHEL8 https://review.openstack.org/643731 | 10:18 |
| cmurphy | lol | 10:18 |
| *** rcernin has quit IRC | 10:24 | |
| zbr | codesearch is borked: ERROR:open /home/hound/data/idx-cd47ea7066e22bb1/raw/heat_dashboard/static/dashboard/project/heat_dashboard/template_generator/js/components/modal-template.controller.js: too many open files | 10:26 |
| cmurphy | zbr: that happens if you search for something that has too many matches | 10:26 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Don't create a tarball in the post job https://review.openstack.org/647706 | 10:26 |
| frickler | ianw: cmurphy: I'm seeing things like this on the held node, I seem to remember that we had some issue during KSK rollover earlier, maybe that has regressed? Mar 26 10:22:16 unbound[2408:1] debug: Failed to match any usable anchor to a DNSKEY. | 10:27 |
| cmurphy | frickler: k2k rollover? | 10:28 |
| zbr | cmurphy: ouch, thanks. seems that "nodeset" was too much for it :p | 10:28 |
| frickler | cmurphy: something with unbound being too old. https://www.icann.org/dns-resolvers-updating-latest-trust-anchor | 10:32 |
| *** xek_ has joined #openstack-infra | 10:37 | |
| frickler | cmurphy: if you agree I'd give updating the root.key file as described in that doc a try | 10:37 |
| frickler | cmurphy: /var/lib/unbound/root.key dates from Apr 2018, which is definitively too old | 10:39 |
| *** xek has quit IRC | 10:39 | |
| *** ykarel has joined #openstack-infra | 10:40 | |
| AJaeger | cmurphy: do we have an too old unbound version? Might be that is a fault of our update repo breakage from Friday, so we could wait another day for mirroring repos (and check that update repo is current) | 10:40 |
| frickler | AJaeger: dirk: not sure about the needed version, here's the log from last Oct about a similar issue http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2018-10-16.log.html#t2018-10-16T12:00:19 | 10:43 |
| frickler | installed version on the node is 1.6.8-lp150.1.4 , but I have no idea whether that's new or old | 10:44 |
| *** gfidente has joined #openstack-infra | 10:45 | |
| AJaeger | frickler: the openSUSE admins deleted by accident on Friday the 15.0 updates, I wonder whether this is all a fallout from that and we need to reach out to them and check current version. | 10:45 |
| frickler | AJaeger: if the deleted all 15.0 updates and we are running now something like 15.0 unpatched, that would certainly explain the issue | 10:46 |
| frickler | s/the/they/ | 10:46 |
| *** roman_g has joined #openstack-infra | 10:47 | |
| AJaeger | frickler: they restored it - but might be incomplete. Could you point me to the local mirror we use? | 10:48 |
| frickler | AJaeger: the held node shows http://mirror.dfw.rax.openstack.org/opensuse/distribution/leap/15.0/repo/oss/ and http://mirror.dfw.rax.openstack.org/opensuse/update/leap/15.0/oss/ , we might use a different mirror during image build | 10:49 |
| *** lucasagomes has joined #openstack-infra | 10:49 | |
| *** psachin has joined #openstack-infra | 10:50 | |
| frickler | AJaeger: the latter indeed looks empty. I'll try to check the mirror update | 10:50 |
| AJaeger | so, if that is empty: It explains everything... | 10:51 |
| cmurphy | frickler: sorry was afk, back now | 10:51 |
| cmurphy | AJaeger: wow the update repo was deleted? | 10:52 |
| *** jtomasek has quit IRC | 10:52 | |
| AJaeger | cmurphy: https://lists.opensuse.org/opensuse-factory/2019-03/msg00324.html is the thread | 10:53 |
| AJaeger | cmurphy: yes, it was - but should be back again. | 10:53 |
| cmurphy | i know from experience that a restored project doesn't always come back the same | 10:54 |
| openstackgerrit | Nir Magnezi proposed openstack/diskimage-builder master: Deprecate rhel7 in favor of rhel https://review.openstack.org/647710 | 10:54 |
| AJaeger | cmurphy: indeed - they might have changed something here. | 10:55 |
| AJaeger | Ok, let's stop debugging unbound and get the mirror up again - and hope we're good then ;) | 10:55 |
| frickler | AJaeger: the mirror we update our mirror from has the same state: https://mirror.us.leaseweb.net/opensuse/update/leap/15.0/oss/ | 10:55 |
| openstackgerrit | Nir Magnezi proposed openstack/diskimage-builder master: Deprecate rhel7 in favor of rhel https://review.openstack.org/647710 | 10:56 |
| AJaeger | http://download.opensuse.org/update/leap/15.0/oss/rpms/x86_64/ is looking better - might take the upstream mirror time to update. | 10:56 |
| AJaeger | Should we wait another day - and monitor? | 10:57 |
| cmurphy | those packages are 3 days old, would it take that long for the mirrors to update? | 10:58 |
| frickler | AJaeger: yeah, I don't think it makes sense to try to fiddle with changing mirrors now. | 10:58 |
| AJaeger | looking at the list of mirrors: There are only a few up, see for example http://download.opensuse.org/update/leap/15.0/oss/rpms/x86_64/aaa_base-84.87+git20180409.04c9dae-lp150.2.3.1.x86_64.rpm.mirrorlist | 10:58 |
| AJaeger | 4 mirrors - normally over 20 AFAIR | 10:58 |
| *** owalsh has quit IRC | 10:59 | |
| frickler | cmurphy: seems the master server was fixed only yesterday according to the timestamps | 10:59 |
| *** e0ne has quit IRC | 10:59 | |
| AJaeger | frickler: yes, only yesterday morning | 10:59 |
| cmurphy | i was looking at the package timestamps on http://download.opensuse.org/update/leap/15.0/oss/rpms/x86_64/ 23-Mar-2019 10:57 where should i have been looking? | 11:00 |
| frickler | cmurphy: I guess the repodata would match the latest update: http://download.opensuse.org/update/leap/15.0/oss/repodata/ | 11:01 |
| cmurphy | ah yeah | 11:02 |
| *** ricolin has quit IRC | 11:04 | |
| *** owalsh has joined #openstack-infra | 11:04 | |
| *** wolverineav has joined #openstack-infra | 11:07 | |
| *** gfidente has quit IRC | 11:11 | |
| *** udesale has quit IRC | 11:16 | |
| *** gfidente has joined #openstack-infra | 11:19 | |
| tosky | I know that #openstack-unregistered is also a spam-catcher channel, but can you please ban a specific IPv6 IP? It seems like a user misconfigured the client (continuous connect/disconnect) | 11:21 |
| *** rh-jelabarre has joined #openstack-infra | 11:27 | |
| *** priteau has quit IRC | 11:29 | |
| *** e0ne has joined #openstack-infra | 11:37 | |
| mgoddard | Hello infra team. Following the lead of monasca, we have started doing a 10 minute warning for our IRC meeting, where anyone can add their nick to a list on the wiki to get a reminder | 11:38 |
| mgoddard | mnasiadka suggested this could be something the meeting bot could do | 11:38 |
| mgoddard | is there support for this, and if not any ideas how hard it would be to add? | 11:38 |
| *** derekh has joined #openstack-infra | 11:39 | |
| *** wolverineav has quit IRC | 11:40 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add OpenAPI documentation https://review.openstack.org/535541 | 11:46 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: implement prep-workspace https://review.openstack.org/607082 | 11:53 |
| dirk | AJaeger: hilarious | 12:03 |
| *** jtomasek has joined #openstack-infra | 12:03 | |
| dirk | on an unrelated note: does anyone know how to fix http://zuul.openstack.org/build/933d7f5ccebe4fd1a81fb07eb6d1810f ? | 12:03 |
| dirk | somehow we're missing the openstack-ansible repository embedded in the images | 12:03 |
| *** trown|outtypewww is now known as trown | 12:08 | |
| *** dmsimard has joined #openstack-infra | 12:10 | |
| frickler | dirk: I think that's a followup error of the unbound issue, the job fails so early that zuul didn't get to prepare those dirs | 12:13 |
| *** e0ne has quit IRC | 12:22 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: add configuration schema https://review.openstack.org/640672 | 12:25 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: runner: add execute sub-command https://review.openstack.org/630944 | 12:26 |
| *** e0ne has joined #openstack-infra | 12:27 | |
| *** rkukura has quit IRC | 12:31 | |
| *** markvoelker has quit IRC | 12:31 | |
| *** jpena is now known as jpena|lunch | 12:35 | |
| *** rlandy has joined #openstack-infra | 12:37 | |
| *** wolverineav has joined #openstack-infra | 12:37 | |
| *** janki has quit IRC | 12:45 | |
| *** janki has joined #openstack-infra | 12:45 | |
| *** jamesmcarthur has joined #openstack-infra | 12:46 | |
| *** janki has quit IRC | 12:46 | |
| *** janki has joined #openstack-infra | 12:46 | |
| *** bringha has joined #openstack-infra | 12:52 | |
| *** aaronsheffield has joined #openstack-infra | 12:52 | |
| *** lseki has joined #openstack-infra | 12:57 | |
| *** udesale has joined #openstack-infra | 13:00 | |
| *** bringha has quit IRC | 13:04 | |
| *** e0ne has quit IRC | 13:08 | |
| *** jtomasek has quit IRC | 13:08 | |
| *** mriedem has joined #openstack-infra | 13:09 | |
| *** jtomasek has joined #openstack-infra | 13:10 | |
| *** wolverineav has quit IRC | 13:11 | |
| *** e0ne has joined #openstack-infra | 13:11 | |
| *** dpawlik has quit IRC | 13:12 | |
| *** jistr is now known as jistr|afk | 13:16 | |
| *** e0ne has quit IRC | 13:18 | |
| *** kjackal has quit IRC | 13:19 | |
| *** kjackal has joined #openstack-infra | 13:20 | |
| *** fakir has quit IRC | 13:20 | |
| openstackgerrit | Radwa S. Khattab proposed openstack-infra/storyboard-webclient master: Fixing Tasks Filtering in Project-Group using checkBoxes https://review.openstack.org/646937 | 13:21 |
| *** e0ne has joined #openstack-infra | 13:26 | |
| *** jpena|lunch is now known as jpena | 13:35 | |
| *** dpawlik has joined #openstack-infra | 13:35 | |
| *** gfidente has quit IRC | 13:38 | |
| *** dpawlik has quit IRC | 13:40 | |
| *** janki has quit IRC | 13:42 | |
| *** eharney has joined #openstack-infra | 13:43 | |
| *** michael-beaver has joined #openstack-infra | 13:44 | |
| openstackgerrit | Radwa S. Khattab proposed openstack-infra/storyboard-webclient master: Fixing Tasks Filtering in Project-Group using checkBoxes https://review.openstack.org/646937 | 13:46 |
| *** michaelbeaver has joined #openstack-infra | 13:48 | |
| mordred | infra-root: I'm travelling/conferencing this week starting today - so my existence will be sporadic at best | 13:50 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/647149 | 13:52 |
| *** michael-beaver has quit IRC | 13:52 | |
| *** dpawlik has joined #openstack-infra | 13:53 | |
| *** rkukura has joined #openstack-infra | 13:57 | |
| *** jcoufal has joined #openstack-infra | 13:57 | |
| *** dpawlik has quit IRC | 13:58 | |
| openstackgerrit | Merged openstack-infra/puppet-ciwatch master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646926 | 13:58 |
| *** ramishra_ has quit IRC | 13:59 | |
| *** udesale has quit IRC | 14:03 | |
| *** kaisers has quit IRC | 14:05 | |
| *** kaisers has joined #openstack-infra | 14:06 | |
| *** wolverineav has joined #openstack-infra | 14:07 | |
| openstackgerrit | Merged openstack-infra/puppet-ethercalc master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646931 | 14:09 |
| openstackgerrit | Merged openstack-infra/puppet-germqtt master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646934 | 14:10 |
| openstackgerrit | Merged openstack-infra/puppet-grafyaml master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646939 | 14:10 |
| openstackgerrit | Merged openstack-infra/puppet-hound master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646942 | 14:10 |
| openstackgerrit | Merged openstack-infra/puppet-infracloud master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646945 | 14:10 |
| openstackgerrit | Merged openstack-infra/puppet-lpmqtt master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646956 | 14:10 |
| openstackgerrit | Merged openstack-infra/puppet-mosquitto master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646964 | 14:10 |
| *** jamesmcarthur has quit IRC | 14:11 | |
| *** jamesmcarthur has joined #openstack-infra | 14:13 | |
| openstackgerrit | Merged openstack-infra/puppet-mqtt_statsd master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646965 | 14:14 |
| openstackgerrit | Merged openstack-infra/puppet-openstack_health master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646978 | 14:14 |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646994 | 14:14 |
| openstackgerrit | Merged openstack-infra/puppet-translation_checksite master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/647008 | 14:14 |
| *** jamesmcarthur has quit IRC | 14:14 | |
| *** ramishra has joined #openstack-infra | 14:15 | |
| *** jistr|afk is now known as jistr | 14:15 | |
| Shrews | mordred: existence is merely an illusion anyway | 14:16 |
| *** dpawlik has joined #openstack-infra | 14:17 | |
| *** quiquell is now known as quiquell|off | 14:18 | |
| *** e0ne has quit IRC | 14:18 | |
| fungi | #status log deleted 2012.2 from the cinder releases on pypi.org per http://lists.openstack.org/pipermail/openstack-discuss/2019-March/004224.html | 14:22 |
| openstackstatus | fungi: finished logging | 14:22 |
| *** udesale has joined #openstack-infra | 14:24 | |
| *** xek_ has quit IRC | 14:24 | |
| *** xek_ has joined #openstack-infra | 14:24 | |
| *** e0ne has joined #openstack-infra | 14:25 | |
| *** dpawlik has quit IRC | 14:27 | |
| *** dpawlik has joined #openstack-infra | 14:29 | |
| smcginnis | Thanks fungi | 14:32 |
| *** armax has joined #openstack-infra | 14:33 | |
| openstackgerrit | Dantali0n proposed openstack-infra/irc-meetings master: Change watcher meeting schedule and chair https://review.openstack.org/647757 | 14:35 |
| *** jamesmcarthur has joined #openstack-infra | 14:36 | |
| fungi | smcginnis: my pleasure | 14:37 |
| *** wolverineav has quit IRC | 14:40 | |
| *** gfidente has joined #openstack-infra | 14:45 | |
| *** zbr has quit IRC | 14:47 | |
| *** zbr has joined #openstack-infra | 14:50 | |
| *** ccamacho has quit IRC | 14:51 | |
| *** xek_ has quit IRC | 14:53 | |
| *** diablo_rojo has joined #openstack-infra | 14:54 | |
| *** jcoufal_ has joined #openstack-infra | 14:56 | |
| *** jcoufal has quit IRC | 14:59 | |
| *** eernst has joined #openstack-infra | 14:59 | |
| *** bringha has joined #openstack-infra | 15:03 | |
| *** michael-beaver has joined #openstack-infra | 15:06 | |
| *** bringha has quit IRC | 15:08 | |
| *** michaelbeaver has quit IRC | 15:09 | |
| *** kgiusti has joined #openstack-infra | 15:11 | |
| *** e0ne has quit IRC | 15:12 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Elasticsearch Zuul reporter https://review.openstack.org/644927 | 15:15 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Elasticsearch Zuul reporter https://review.openstack.org/644927 | 15:15 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: WIP: Fix for image build leaks https://review.openstack.org/647599 | 15:17 |
| *** michaelbeaver has joined #openstack-infra | 15:21 | |
| *** ykarel is now known as ykarel|afk | 15:23 | |
| *** janki has joined #openstack-infra | 15:23 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: Elasticsearch Zuul reporter https://review.openstack.org/644927 | 15:24 |
| *** michael-beaver has quit IRC | 15:25 | |
| *** yboaron_ has quit IRC | 15:26 | |
| *** e0ne has joined #openstack-infra | 15:27 | |
| *** e0ne has quit IRC | 15:32 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: WIP: Fix for image build leaks https://review.openstack.org/647599 | 15:32 |
| *** e0ne has joined #openstack-infra | 15:33 | |
| *** wolverineav has joined #openstack-infra | 15:37 | |
| corvus | fungi: can you +3 https://review.openstack.org/645953 when you have a moment? and separately, but related, are you planning on obtaining a cert? | 15:42 |
| *** iurygregory has quit IRC | 15:45 | |
| *** kjackal_v2 has joined #openstack-infra | 15:45 | |
| fungi | corvus: yep, it's at the top of my to do list once i get caught up on correspondence. should i also obtain one for review.opendev.org? any others off the top of your head? | 15:46 |
| *** kjackal has quit IRC | 15:46 | |
| *** iurygregory has joined #openstack-infra | 15:46 | |
| frickler | fungi: corvus: did you see my whitespace nit? probably fine for a followup, though | 15:47 |
| *** trown is now known as trown|lunch | 15:47 | |
| corvus | fungi: there's a non-zero chance that LE may be ready by thet time we are for review.opendev.org, but if it's more appealing to just batch the two up to save time and have it as insurance, i see no reason not to. i can't think of any others we'd need for the transition. | 15:48 |
| *** michaelbeaver has quit IRC | 15:48 | |
| *** michael-beaver has joined #openstack-infra | 15:49 | |
| fungi | yeah, i wouldn't mind having said insurance to take the pressure off the le implementation work | 15:50 |
| *** e0ne has quit IRC | 15:50 | |
| corvus | frickler: no i missed that. is there a reason i should care about whitespace there? | 15:50 |
| fungi | if it works and is readable/maintainable, i'm disinclined to care. if someone else is patching that file to update something and replaces that tab with spaces while they're at it, i'm also fine with that | 15:51 |
| frickler | corvus: it was my understanding that using tabs is generally not recommended. their rendition also depends on peoples editor settings, which may lead to inconsistencies | 15:52 |
| frickler | and then personally I like consistency, having one line with a tab and others within the same context not looks ugly to me. | 15:53 |
| corvus | yeah. that wasn't intentional, and i'd be happy to fix it next time i'm there, or anyone else is welcome too. i just didn't know that we cared that much. | 15:55 |
| frickler | well, if the majority votes to just don't care, I can try to live with that, too | 15:56 |
| *** e0ne has joined #openstack-infra | 15:56 | |
| corvus | i suspect my outlook on updating patches like that would change if we didn't have the clean-check requirement... which leads me to: | 15:57 |
| corvus | https://review.openstack.org/642100 and https://review.openstack.org/642101 are the next steps for a tenant for zuul | 15:57 |
| * frickler needs to leave now, now sure yet whether I'll make it to the meeting later | 15:57 | |
| corvus | i'll make similar changes for an opendev-itself tenant | 15:58 |
| corvus | frickler: o/ hope to see you there :) | 15:58 |
| tosky | corvus: it's not important as the opendev transition, also because there is a workaround, but I found an issue with the stage-output role: https://review.openstack.org/#/c/645239/ | 15:59 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Change watcher meeting schedule and chair https://review.openstack.org/647757 | 15:59 |
| *** e0ne has quit IRC | 16:00 | |
| corvus | tosky: lgtm, thx! | 16:01 |
| tosky | \o/ | 16:02 |
| corvus | tosky: might be worth testing that with a depends-on from a devstack change if you haven't already | 16:02 |
| tosky | corvus: I did it here: https://review.openstack.org/#/c/639774/ and https://review.openstack.org/#/c/638390/ | 16:03 |
| tosky | (testing jobs for the new grenade native job) | 16:03 |
| corvus | kk | 16:03 |
| *** ricolin has joined #openstack-infra | 16:04 | |
| *** jtomasek has quit IRC | 16:06 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add OpenDev project-config repo https://review.openstack.org/647791 | 16:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add OpenDev project-config repo https://review.openstack.org/647791 | 16:07 |
| *** ykarel|afk has quit IRC | 16:08 | |
| *** Lucas_Gray has quit IRC | 16:08 | |
| *** eernst has quit IRC | 16:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add an OpenDev Zuul tenant https://review.openstack.org/647795 | 16:10 |
| *** wolverineav has quit IRC | 16:10 | |
| openstackgerrit | Merged openstack-infra/system-config master: Serve docs.opendev.org from files.openstack.org https://review.openstack.org/645953 | 16:11 |
| *** michaelbeaver has joined #openstack-infra | 16:16 | |
| *** michael-beaver has quit IRC | 16:19 | |
| *** iurygregory has quit IRC | 16:20 | |
| *** psachin has quit IRC | 16:20 | |
| *** iurygregory has joined #openstack-infra | 16:21 | |
| *** imacdonn has quit IRC | 16:22 | |
| *** imacdonn has joined #openstack-infra | 16:22 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add the tox_install_bindep option to the tox job https://review.openstack.org/635877 | 16:23 |
| *** diablo_rojo has quit IRC | 16:24 | |
| *** michael-beaver has joined #openstack-infra | 16:24 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add a role to mirror a git repository to a remote git server https://review.openstack.org/643394 | 16:24 |
| *** gyee has joined #openstack-infra | 16:25 | |
| *** e0ne has joined #openstack-infra | 16:25 | |
| *** ykarel has joined #openstack-infra | 16:27 | |
| *** michaelbeaver has quit IRC | 16:27 | |
| *** e0ne has quit IRC | 16:28 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Pin nodejs package to upstream repo https://review.openstack.org/627823 | 16:31 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: run-test-command: support list in test_command variable https://review.openstack.org/610888 | 16:34 |
| *** ramishra has quit IRC | 16:37 | |
| *** jpich has quit IRC | 16:46 | |
| *** eharney has quit IRC | 16:49 | |
| *** iurygregory has quit IRC | 16:54 | |
| *** jtomasek has joined #openstack-infra | 16:56 | |
| *** mriedem has quit IRC | 16:57 | |
| *** trown|lunch is now known as trown | 16:58 | |
| *** tjgresha has quit IRC | 16:58 | |
| *** rpittau is now known as rpittau|afk | 16:59 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Optionally silence git in mirror-workspace-git-repos https://review.openstack.org/635166 | 17:00 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Use ubuntu-xenial for openstack-tox-cover on stable https://review.openstack.org/647818 | 17:08 |
| *** janki has quit IRC | 17:09 | |
| mnaser | where are we getting upper requirements with the opendev move? | 17:10 |
| mnaser | I remember someone was working on a redirect url? | 17:10 |
| mnaser | I remember approving a change that started using it? :x | 17:10 |
| gmann | fungi: clarkb openstack-tox-cover fix for bionic https://review.openstack.org/647818 | 17:11 |
| *** ykarel is now known as ykarel|away | 17:12 | |
| *** ricolin has quit IRC | 17:13 | |
| *** chandankumar is now known as raukadah | 17:14 | |
| *** wolverineav has joined #openstack-infra | 17:15 | |
| *** pgaxatte has quit IRC | 17:15 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zone-opendev.org master: Temporary DV records for docs and review SSL certs https://review.openstack.org/647823 | 17:16 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/zone-opendev.org master: Revert "Temporary DV records for docs and review SSL certs" https://review.openstack.org/647824 | 17:16 |
| *** lucasagomes has quit IRC | 17:16 | |
| fungi | corvus: ^ | 17:16 |
| openstackgerrit | Merged openstack-infra/zone-opendev.org master: Temporary DV records for docs and review SSL certs https://review.openstack.org/647823 | 17:17 |
| corvus | fungi: ^ | 17:17 |
| fungi | thanks!!! | 17:18 |
| *** ykarel|away has quit IRC | 17:19 | |
| fungi | i'll dump them in bridge:~root/certs/2019-03-26/ shortly, i hope | 17:19 |
| *** kopecmartin is now known as kopecmartin|off | 17:21 | |
| *** jamesmcarthur has quit IRC | 17:25 | |
| *** gfidente has quit IRC | 17:26 | |
| *** zbr|ssbarnea has joined #openstack-infra | 17:29 | |
| *** jpena is now known as jpena|off | 17:31 | |
| *** zbr has quit IRC | 17:31 | |
| *** eernst has joined #openstack-infra | 17:33 | |
| *** janki has joined #openstack-infra | 17:33 | |
| *** rlandy is now known as rlandy|biab | 17:35 | |
| *** kjackal_v2 has quit IRC | 17:35 | |
| *** udesale has quit IRC | 17:40 | |
| fungi | corvus: okay, certs and associated files are now added to that dir | 17:43 |
| openstackgerrit | Merged openstack-infra/zone-opendev.org master: Revert "Temporary DV records for docs and review SSL certs" https://review.openstack.org/647824 | 17:43 |
| fungi | and revert merged ^ | 17:43 |
| corvus | the gitea folks have fixed the issue with pushing tags containing "%" (they actually fixed it in master 2 days before we found the bug). they are aware of and will fix the web form validation to match (though that doesn't affect us) | 17:43 |
| *** wolverineav has quit IRC | 17:44 | |
| fungi | glad to hear they're so responsive | 17:45 |
| *** eharney has joined #openstack-infra | 17:47 | |
| *** janki has quit IRC | 17:49 | |
| *** jamesmcarthur has joined #openstack-infra | 17:56 | |
| *** helenafm has quit IRC | 17:59 | |
| *** manjeets_ has joined #openstack-infra | 18:01 | |
| *** manjeets_ has quit IRC | 18:02 | |
| *** wolverineav has joined #openstack-infra | 18:02 | |
| *** wolverineav has quit IRC | 18:04 | |
| *** wolverineav has joined #openstack-infra | 18:04 | |
| *** jtomasek has quit IRC | 18:07 | |
| *** dtantsur is now known as dtantsur|afk | 18:10 | |
| *** ginopc has quit IRC | 18:13 | |
| *** armax has quit IRC | 18:14 | |
| *** wolverineav has quit IRC | 18:14 | |
| *** wolverineav has joined #openstack-infra | 18:17 | |
| *** rlandy|biab is now known as rlandy | 18:23 | |
| *** derekh has quit IRC | 18:25 | |
| *** jtomasek has joined #openstack-infra | 18:30 | |
| *** bringha has joined #openstack-infra | 18:41 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard master: Projects can be browsed using stories https://review.openstack.org/645169 | 18:43 |
| *** bringha has quit IRC | 18:48 | |
| *** armax has joined #openstack-infra | 18:48 | |
| *** armax has quit IRC | 18:52 | |
| *** eernst has quit IRC | 18:53 | |
| *** wolverineav has quit IRC | 18:55 | |
| *** wolverineav has joined #openstack-infra | 18:55 | |
| *** wolverineav has quit IRC | 18:58 | |
| ianw | hello, infra meeting in a few mins in #openstack-meeting | 18:59 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Upgrade lists servers to puppet 4 https://review.openstack.org/647875 | 18:59 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Update review.openstack.org to puppet 4 https://review.openstack.org/647876 | 19:00 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Update ask.openstack.org to puppet 4 https://review.openstack.org/647877 | 19:00 |
| *** yboaron_ has joined #openstack-infra | 19:07 | |
| *** shardy has quit IRC | 19:09 | |
| *** wolverineav has joined #openstack-infra | 19:10 | |
| *** wolverineav has quit IRC | 19:12 | |
| *** wolverin_ has joined #openstack-infra | 19:12 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: A reporter for Elasticsearch with the capability to index build and buildset results in an index. https://review.openstack.org/644927 | 19:19 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: A reporter for Elasticsearch with the capability to index build and buildset results in an index. https://review.openstack.org/644927 | 19:20 |
| *** cmoura has left #openstack-infra | 19:20 | |
| *** eernst has joined #openstack-infra | 19:24 | |
| *** eernst has quit IRC | 19:24 | |
| *** jtomasek has quit IRC | 19:26 | |
| *** jtomasek has joined #openstack-infra | 19:32 | |
| *** yolanda has quit IRC | 19:33 | |
| *** kjackal has joined #openstack-infra | 19:35 | |
| *** electrofelix has quit IRC | 19:37 | |
| *** mriedem has joined #openstack-infra | 19:41 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/devstack-gate master: Update grenade settings for stable/stein https://review.openstack.org/647899 | 19:41 |
| *** jamesmcarthur has quit IRC | 19:45 | |
| *** diablo_rojo has joined #openstack-infra | 19:45 | |
| *** panda|ko is now known as panda|off | 19:55 | |
| *** yolanda has joined #openstack-infra | 20:01 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Use ubuntu-xenial for openstack-tox-cover on stable https://review.openstack.org/647818 | 20:02 |
| *** rkukura has quit IRC | 20:03 | |
| fungi | corvus: i see where it adds an hrStorageDescr for "/" explicitly, but not for other filesystems | 20:05 |
| fungi | oh, nevermind... it's the "for disk ..." loop at the end | 20:06 |
| fungi | aha! | 20:06 |
| fungi | | grep xvd[a-z]$ | 20:07 |
| fungi | that doesn't catch anything in a logical volume | 20:07 |
| fungi | er, though that's just for i/o not space | 20:08 |
| fungi | so using the raw block devices there makes sense | 20:09 |
| fungi | so i'm back to not seeing where that adds disk space for filesystems besides root | 20:09 |
| corvus | fungi: i agree. the bug seems to be that functionality is missing. | 20:10 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/devstack-gate master: Add gate job for stable/stein https://review.openstack.org/647912 | 20:11 |
| corvus | fungi, frickler: seems to need a for loop around line 57 | 20:12 |
| fungi | did some quick skimming the git history for that file and it doesn't look like we ever had and accidentally (or even purposely) removed that functionality | 20:14 |
| *** jcoufal_ has quit IRC | 20:14 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/openstack-zuul-jobs master: Add stable/stein to periodic-stable templates https://review.openstack.org/647915 | 20:17 |
| *** kgiusti has left #openstack-infra | 20:23 | |
| *** jtomasek has quit IRC | 20:23 | |
| *** wolverin_ has quit IRC | 20:24 | |
| *** wolverineav has joined #openstack-infra | 20:25 | |
| *** jtomasek has joined #openstack-infra | 20:26 | |
| *** dustinc has joined #openstack-infra | 20:27 | |
| *** wolverineav has quit IRC | 20:30 | |
| *** wolverineav has joined #openstack-infra | 20:31 | |
| *** fatema_ has joined #openstack-infra | 20:34 | |
| *** mriedem has quit IRC | 20:36 | |
| *** jtomasek has quit IRC | 20:46 | |
| *** jtomasek has joined #openstack-infra | 20:48 | |
| *** eharney has quit IRC | 20:48 | |
| *** rkukura has joined #openstack-infra | 20:50 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Upgrade lists servers to puppet 4 https://review.openstack.org/647875 | 20:53 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Update review.openstack.org to puppet 4 https://review.openstack.org/647876 | 20:53 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Update ask.openstack.org to puppet 4 https://review.openstack.org/647877 | 20:53 |
| *** jtomasek has quit IRC | 21:02 | |
| slaweq | clarkb: hi | 21:06 |
| slaweq | clarkb: can You maybe do me a favor and block for me nodes on which job tobiko-devstack-neutron-fedora is now running? | 21:07 |
| slaweq | I'm trying to make fedora based multinode job but it still fails on spawning nova-compute service on subnodes and I have no idea why | 21:07 |
| *** trown is now known as trown|outtypewww | 21:07 | |
| slaweq | maybe when I will be able to log to those nodes I will find what is going wrong there | 21:07 |
| ianw | slaweq: i don't think the hold will work on jobs in flight | 21:08 |
| ianw | i can set one up, however; what's the change? | 21:08 |
| slaweq | ianw: I can send new PS to start job again :) | 21:08 |
| slaweq | ianw: patch is https://review.openstack.org/#/c/643084/ | 21:08 |
| slaweq | it adds this job so it is run only on this patch | 21:09 |
| ianw | ok give me a few minutes and i can put a hold on this job | 21:10 |
| slaweq | ianw: thx a lot | 21:10 |
| corvus | ianw: holds are evaluated when jobs are complete; as long as you get it in before it finishes, it'll catch it | 21:10 |
| *** bringha has joined #openstack-infra | 21:11 | |
| ianw | corvus: cool, TIL | 21:13 |
| corvus | dmsimard: i think a while ago you mentioned that gitea wasn't returning as many search results as you expected? | 21:15 |
| corvus | i've confirmed that gitea only displays the first appearance of a given search term in a file -- so if a file has 2 matches, only the first is displayed. this is apparently intentional in order to reduce space. this is the key line in the commit which implemented that: https://github.com/go-gitea/gitea/pull/3452/files#diff-5a86edbfc139b253fa59bb1a2cd8ccbfR113 | 21:17 |
| ianw | slaweq: in that case, http://zuul.openstack.org/stream/2c451c84f08b4cfda2712dec02ef6a1e?logfile=console.log should be held. do you have a link to a public key to put on the host for you? | 21:17 |
| slaweq | ianw: http://paste.openstack.org/show/748427/ | 21:18 |
| corvus | i believe gitea could be modified to return more than one match with only moderate difficulty (would probably take a day or so). i'm unclear on how much that would increase the search index storage size. | 21:18 |
| *** bringha has quit IRC | 21:18 | |
| corvus | fungi, ianw, mordred, dmsimard: ^ | 21:19 |
| ianw | slaweq: ok, should be able to login at root@198.72.124.130 | 21:20 |
| slaweq | ianw: works fine, but it is controller node, right? how about compute1 and compute2 nodes? Can You add ssh key to them too? | 21:22 |
| ianw | corvus: there's no plans for deprecation of codesearch.o.o anyway right? the thing that does that gitea doesn't is regex? | 21:22 |
| ianw | slaweq: you should be able to bounce between them via that 192.72.124.130 | 21:23 |
| corvus | ianw: i think deprecation of codesearch is implicit -- it was one of the reasons we chose gitea | 21:24 |
| corvus | ianw: actually, explicit: http://specs.openstack.org/openstack-infra/infra-specs/specs/opendev-gerrit.html#proposed-change | 21:24 |
| corvus | "Once it is up and running, we can retire codesearch.openstack.org (and redirect that URL to opendev.org)." | 21:24 |
| fungi | keep in mind that one thing hound doesn't support is searching across multiple branches | 21:26 |
| slaweq | ianw: ok, thx a lot | 21:26 |
| fungi | so using gitea's search instead of hound does solve some long-standing problems too | 21:26 |
| corvus | fungi: gitea doesn't support more than one branch either | 21:27 |
| fungi | oh, it only indexes master? | 21:27 |
| corvus | it only searches the default branch. | 21:27 |
| fungi | oh, hrm, for some reason i thought we confirmed it could. i must have dreamt it | 21:27 |
| corvus | i believe it could be modified to support multiple branches; that change would be of a similar difficulty except that i think it would require more UI work (presumably that behavior may need to be easily toggled by the end user) | 21:28 |
| corvus | so, you know, call that "two days of work" :) | 21:29 |
| fungi | heh | 21:29 |
| tosky | is it possible to filter based on repositories and also ignore case when searching? Maybe there is some hidden option | 21:30 |
| corvus | tosky: case is ignored already. you can search all repos and an individual repo, i'm unsure if you can search an arbitrary set of repos. | 21:31 |
| ianw | fair enough, it's called out there. i use that regex/glob matching quite a bit, along with the file matching as well. it would be a shame to not have a facility for it, but ultimately nothing grep can do | 21:31 |
| ianw | grep can't do i mean | 21:32 |
| tosky | corvus: I mean, force case, not ignore one - I should have written toggle :) | 21:32 |
| corvus | tosky: ah. it forces case-insensitive. that's in the index, so supporting that would be another code change. | 21:33 |
| *** pcaruana has quit IRC | 21:33 | |
| *** yboaron_ has quit IRC | 21:35 | |
| *** jtomasek has joined #openstack-infra | 21:35 | |
| tosky | also: is the index still being generated? I tried searching a known string but I get less results than expeced | 21:36 |
| tosky | expected* | 21:36 |
| corvus | tosky: fewer than the one-per-file i described above? (21:17 utc) | 21:37 |
| *** whoami-rajat has quit IRC | 21:37 | |
| tosky | corvus: yes, it's missing results | 21:37 |
| corvus | tosky: can you share examples? | 21:38 |
| fungi | can you share an example search returning results other than expected? | 21:38 |
| tosky | compare: | 21:38 |
| tosky | https://opendev.org/explore/code?q=TEMPEST_PLUGINS&tab= | 21:38 |
| tosky | http://codesearch.openstack.org/?q=TEMPEST_PLUGINS&i=nope&files=&repos= | 21:38 |
| corvus | i agree that https://opendev.org/openstack/congress-tempest-plugin/search?q=tempest_plugins does not produce https://opendev.org/openstack/congress-tempest-plugin/src/branch/master/playbooks/legacy/congress-devstack-api-base/run.yaml#L45 | 21:40 |
| tosky | (and various others :) | 21:40 |
| *** jtomasek has quit IRC | 21:44 | |
| corvus | there's some weird behavior | 21:46 |
| corvus | https://opendev.org/openstack/congress-tempest-plugin/search?q=localrc | 21:46 |
| corvus | that works and shows that the enable_plugin line is indexed (the exceprts come from the index) | 21:46 |
| corvus | but https://opendev.org/openstack/congress-tempest-plugin/search?q=enable_plugin returns nothing | 21:46 |
| corvus | i don't have an answer for that, we might need to dig into the index to debug that | 21:50 |
| dmsimard | can you search across multiple repositories in gitea ? | 21:55 |
| dmsimard | oh, I just couldn't find it. | 21:56 |
| dmsimard | maybe gitea should just adopt hound :D | 21:56 |
| dmsimard | It has been a bit neglected: https://github.com/etsy/hound | 21:57 |
| corvus | dmsimard: i think i answered that question earlier? | 21:58 |
| corvus | dmsimard: hound is not without problems -- we receive a pretty steady stream of error reports in here about it | 21:58 |
| corvus | we restart hound once a day to deal with some of those | 22:00 |
| dmsimard | yeah, that's what I'm saying.. it needs a bit of love :( | 22:02 |
| dmsimard | I have a weird fork going to support non-master branches | 22:02 |
| corvus | fungi: have you verified the redirects yet? | 22:05 |
| corvus | fungi: i updated /etc/hosts on my machine to point to files02 and got /var/www/git-redirect/.htaccess: RewriteCond not allowed here | 22:06 |
| ianw | nothings perfect :) like i don't understand why "github.com/<change-sha>" doesn't just bring it up ... it seems like an easy thing to have indexed | 22:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Allow all mod_rewrite directives in git-redirect vhosts https://review.openstack.org/647936 | 22:10 |
| corvus | ianw, fungi: ^ | 22:10 |
| *** panda|off has quit IRC | 22:24 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Use docs.opendev.org ssl cert https://review.openstack.org/647939 | 22:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Update hieraedit for python3 https://review.openstack.org/647940 | 22:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/zone-opendev.org master: Add docs.opendev.org https://review.openstack.org/647941 | 22:34 |
| *** slaweq has quit IRC | 22:37 | |
| *** michaelbeaver has joined #openstack-infra | 22:38 | |
| *** rcernin has joined #openstack-infra | 22:38 | |
| *** michael-beaver has quit IRC | 22:42 | |
| *** michaelbeaver has quit IRC | 22:43 | |
| *** wolverineav has quit IRC | 22:45 | |
| *** wolverineav has joined #openstack-infra | 22:48 | |
| *** wolverineav has quit IRC | 22:50 | |
| *** wolverineav has joined #openstack-infra | 22:50 | |
| *** tkajinam has joined #openstack-infra | 22:57 | |
| *** tosky has quit IRC | 23:02 | |
| *** wolverineav has quit IRC | 23:19 | |
| *** aaronsheffield has quit IRC | 23:22 | |
| *** wolverineav has joined #openstack-infra | 23:26 | |
| *** rlandy has quit IRC | 23:27 | |
| *** wolverineav has quit IRC | 23:31 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: master-nameserver: Add unmanaged domains; add acme.opendev.org https://review.openstack.org/641155 | 23:31 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 23:31 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add fake DNSSEC keys for zones https://review.openstack.org/647952 | 23:31 |
| *** wolverineav has joined #openstack-infra | 23:32 | |
| fungi | corvus: nope, as you have astutely identified, it was not tested yet. i had gotten so far as identifying and correcting the incorrect hiera keys for various ssl bits of those sites and making sure puppet was applying correctly. that was next on my list | 23:40 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add fake DNSSEC keys for zones https://review.openstack.org/647952 | 23:42 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: master-nameserver: Add unmanaged domains; add acme.opendev.org https://review.openstack.org/641155 | 23:42 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 23:42 |
| openstackgerrit | William Huang proposed openstack-infra/zuul-jobs master: Add variable `npm_mirror` for changing default npm package registry https://review.openstack.org/647305 | 23:48 |
| *** gyee has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!