Thursday, 2020-08-06

ianwi guess so, or versions of ssh-keygen that include -D *also* ignore DSS/DSA00:00
ianwalthough, no, that's ssh-keygen -r running on a focal node (the new mirror node)00:01
ianwyeah, ssh-keyscan -D shows only 1,3,4 .. so i guess it generates the dsa keys but doesn't use them or something00:05
*** ryohayakawa has joined #opendev00:05
openstackgerritIan Wienand proposed opendev/zone-opendev.org master: Add replacement OE mirror  https://review.opendev.org/74500000:06
openstackgerritMerged opendev/zone-opendev.org master: Add replacement OE mirror  https://review.opendev.org/74500000:11
ianwmnaser: so we have bionic hosts in use on ca-ymq ... so i assume the old image is ok.  is there anything i can do at this point?00:30
mnaserYeah I think we’re good ianw   Thanks00:31
fungi#status log updated review.openstack.org cname to refer to review.opendev.org rather than review01.openstack.org00:47
openstackstatusfungi: finished logging00:47
fungihopefully that completes solving the sshfp regression users were hitting for the gerrit ssh api00:48
ianwit seems like an oversight to not include ports in the record00:51
ianwthen again, it would also advertise your non-standard ssh port ... so00:52
openstackgerritIan Wienand proposed opendev/system-config master: launch-node: get sshfp entries from the host  https://review.opendev.org/74482102:57
*** markmcclain has quit IRC03:31
*** markmcclain has joined #opendev03:35
*** sgw1 has quit IRC04:40
*** ryohayakawa has quit IRC04:41
*** ryohayakawa has joined #opendev04:41
*** ryohayakawa is now known as rhayakaw04:41
*** raukadah is now known as chkumar|rover05:06
*** ysandeep|off is now known as ysandeep05:58
openstackgerritLajos Katona proposed openstack/project-config master: Import netowrking-l2gw & networking-l2gw-tempest-plugin to x/  https://review.opendev.org/74411006:35
*** DSpider has joined #opendev06:37
*** xiaolin has quit IRC06:49
*** ysandeep is now known as ysandeep|lunch07:18
*** fressi has joined #opendev07:28
*** dtantsur|afk is now known as dtantsur07:30
openstackgerritMichal Nasiadka proposed opendev/system-config master: Add focal to deb-docker mirror  https://review.opendev.org/74508407:45
*** tosky has joined #opendev07:46
lourotAJaeger o/ does https://review.opendev.org/#/c/744890/ now look ok? thanks!07:54
*** moppy has quit IRC08:01
*** moppy has joined #opendev08:01
*** hashar has joined #opendev08:14
*** ysandeep|lunch is now known as ysandeep08:16
*** jaicaa has quit IRC08:22
*** jaicaa has joined #opendev08:25
*** priteau has joined #opendev08:29
*** osmanlicilegi has quit IRC08:32
lourot^ thanks! it looks like I need more approvals. ttx, mordred maybe?08:41
*** iurygregory has quit IRC08:51
*** iurygregory has joined #opendev09:02
*** osmanlicilegi has joined #opendev09:10
*** rhayakaw has quit IRC10:07
*** tkajinam has quit IRC10:33
*** fressi has quit IRC10:37
*** ysandeep is now known as ysandeep|afk10:38
*** fressi has joined #opendev10:41
*** ysandeep|afk is now known as ysandeep11:14
*** sshnaidm is now known as sshnaidm|afk11:33
*** sshnaidm|afk is now known as sshnaidm11:49
*** cloudnull has quit IRC12:43
*** cloudnull has joined #opendev12:44
*** fressi has quit IRC13:26
openstackgerritMerged openstack/project-config master: Mirror keystone-kerberos and ceph-iscsi charms to GitHub  https://review.opendev.org/74489013:34
openstackgerritMerged zuul/zuul-jobs master: Avoid to use 'length' filter with null value  https://review.opendev.org/74231613:36
lourotAJaeger, thanks for merging the mirroring of charm-keystone-kerberos to GitHub. I remember from last time that the next merge will trigger the mirroring for the first time. However from what I remember from last time I would expect https://github.com/openstack/charm-keystone-kerberos to now exist empty at this point13:48
lourotbut it's not there. Is it normal?13:48
AJaegerlourot: best ask ttx ^13:48
fungilourot: AJaeger: github project creation happens via a daily periodic job, i believe13:49
fungiafter that, mirroring is refreshed on each new change which merges to the repository13:50
AJaegerfungi: so, should the URL be available from the daily run? Or did it fail13:52
fungii think the job to create them checks to see whether the mirror job has been added for them, so would in theory run this coming time around, but i'd have to go hunt down the job to confirm13:54
AJaegerthanks13:56
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: ensure-pip: add instructions for RedHat system  https://review.opendev.org/74375014:00
*** icey has joined #opendev14:01
*** ysandeep is now known as ysandeep|brb14:19
*** ysandeep|brb is now known as ysandeep14:24
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs  https://review.opendev.org/74056015:03
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use (upload|promote)-docker-image roles in periodic jobs  https://review.opendev.org/74056015:04
*** hashar has quit IRC15:19
*** mlavalle has joined #opendev15:19
*** chkumar|rover is now known as raukadah15:20
donnydfungi: ianw I noticed the mirror instance is running, but I cannot get to the web server to see if its working or not15:30
fungidonnyd: i think we need a second infra-root review/approval on https://review.opendev.org/74499915:32
donnydwell I will throw my +1 in there for good measure15:34
donnydLOL15:34
fungior maybe i'll just single-core approve it if nobody else gets time to take a look here shortly15:35
clarkbdone15:35
fungithanks clarkb!15:36
openstackgerritMerged opendev/system-config master: Add OE mirror to inventory  https://review.opendev.org/74499915:57
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use *-docker-image roles in periodic jobs  https://review.opendev.org/74056016:05
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use *-docker-image roles in periodic jobs  https://review.opendev.org/74056016:10
*** iurygregory has quit IRC16:10
*** iurygregory has joined #opendev16:11
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use *-docker-image roles in periodic jobs  https://review.opendev.org/74056016:12
openstackgerritAndrii Ostapenko proposed zuul/zuul-jobs master: Add ability to use *-docker-image roles in periodic jobs  https://review.opendev.org/74056016:34
openstackgerritGhanshyam Mann proposed openstack/project-config master: Fix 'submit' permission for retired repo acl  https://review.opendev.org/74518716:52
openstackgerritClark Boylan proposed openstack/project-config master: Cleanup old periodic pbr jobs  https://review.opendev.org/74518917:02
*** dtantsur is now known as dtantsur|afk17:03
openstackgerritMerged openstack/project-config master: Fix 'submit' permission for retired repo acl  https://review.opendev.org/74518717:09
*** priteau has quit IRC17:27
*** priteau has joined #opendev17:27
*** priteau has quit IRC17:32
clarkbdonnyd: fungi fyi http://mirror.us-east.openedge.opendev.org/ and https://mirror.us-east.openedge.opendev.org/ seem happy at first glance if we want to enable the nodepool provider17:37
clarkbis there a change for that yet?17:37
fungii didn't see one yet, no17:37
clarkbdonnyd: ^ maybe you want to propose that now since you've got the best idea of what reasonable capacity will be17:39
fungibasically start with a revert of the change where we removed oe, but tweak the max-servers line(s) according to current capacity17:43
fungioh, i guess we didn't remove it, just set max-servers to 017:46
fungi:q17:46
fungihah, you're not my vi17:46
fungihttps://review.opendev.org/739605 (openstack/project-config da3f580) was the change17:47
openstackgerritMatt McEuen proposed openstack/project-config master: New Project Request: hostconfig-operator  https://review.opendev.org/74519317:48
donnydclarkb: fungi i am thinking of setting things pretty low and monitoring for a while17:50
donnydPatch inbound17:50
clarkbdonnyd: sounds good17:51
openstackgerritDonny Davis proposed openstack/project-config master: revert https://review.opendev.org/739605  https://review.opendev.org/74519517:55
*** priteau has joined #opendev18:06
*** priteau has quit IRC18:11
openstackgerritMerged openstack/project-config master: revert https://review.opendev.org/739605  https://review.opendev.org/74519518:17
*** gmann is now known as gmann_afk18:35
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479518:36
clarkbfungi: ianw ^ ok I've crippled the connection details in testing to avoid making gerrit or freenode sad18:36
clarkbbut that should actualyl start the container18:37
fungiawesome18:37
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Fix partial subunit stream logging  https://review.opendev.org/74456518:40
*** priteau has joined #opendev18:46
clarkbianw: I also updated the lack of restarts when the config changed. That was a good catch. I intended to do that and simply missed it in the original config18:46
clarkbalso I've not updated ansible vars on bridge to make that work in production yet. Figured we'd want to coordinate that with a disabling of gerritbot on review anyway18:47
clarkbbut I think it is really close now18:47
*** sshnaidm is now known as sshnaidm|afk18:47
fungiyeah, we'll want to make sure we don't wind up with two processes fighting over the account and ghosting each other18:49
*** priteau has quit IRC18:51
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479518:58
clarkbit is weird that linting didn't catch that on ps118:58
* clarkb pops out for lunch18:59
*** tosky has quit IRC19:20
donnydhey for once I didn't start off with a bunch of errors when I turned things back on20:22
donnydit usually blows up on my immediately20:22
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479520:22
clarkbdoes no get parsed to a boolean in yaml? testing complained my no value above was not a string ... /me forces it to be a string20:23
clarkbdonnyd: we're getting better at this :)20:23
donnydI need to let it run for a day or so to gather some average metrics and I will be back to full operations20:23
clarkbfungi: https://zuul.opendev.org/t/zuul/build/844437ca7d9a4a9e9ae6fce8a8148076/console#1/3/12/opensuse-15 we're hitting the suse/ package prefix bug on zuul-jobs jobs now20:32
clarkbthat tells me the issue remains persistent and that it is unlikely an issue with ironic20:33
* clarkb looks into this again and tries to figure it out20:33
clarkbI'm going to put a hold on the zuul-jobs job as that is a smaller problem space than ironic and try and igure it out from the host20:34
clarkbdoing a package install manually and ignoring the failures shows that while most packages have this issue not all do20:48
clarkbrepo-oss seems to have the problem but not repo-update20:49
fungiyou have at least some familiarity with opensuse compared to the none i possess20:49
clarkbok I removed the repo we have configured, added it back in but let zypper autodetect things like repo type and that works20:56
clarkbI think the fix here is to minimize our config and let zypper figure things out automatically20:56
clarkbI expect the upstream repo layout/type changed on us and now our old configs don't map to that20:57
fungiany way for you to diff the configs and figure out what changed20:59
openstackgerritClark Boylan proposed zuul/zuul-jobs master: Drop suse mirror types in our zypper repo configs  https://review.opendev.org/74522521:00
clarkbfungi: its basically ^21:00
clarkbwhen I zypper addrepo mirror-url repo-oss-test I don't get the type set21:00
clarkband reading manpages it says let zypper autodetect21:00
clarkbthat will be self testing so we can wait and watch, but I expect suse upstream of us chagned the repo type21:01
clarkband now our hard set value is wrong and we fail21:01
fungiawesome, thanks!21:01
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479521:07
clarkbfungi: the two suse jobs have passed on https://review.opendev.org/74522521:15
clarkbcorvus: ^ fyi that would be a good one to land21:15
corvusclarkb: i agree that looks like a change that makes things turn green.  +2  :)21:22
fungigreen is soothing21:27
clarkbI'll respond to dtantsur once that lands21:28
fungithanks for running that down the rest of the way!21:31
*** DSpider has quit IRC21:36
openstackgerritMerged zuul/zuul-jobs master: Drop suse mirror types in our zypper repo configs  https://review.opendev.org/74522521:41
openstackgerritMerged zuul/zuul-jobs master: Fix partial subunit stream logging  https://review.opendev.org/74456521:56
clarkbanyone know where/how we configure docker to log to journald? (I think it is what we want because that means we get auto rotation I htink)21:57
clarkbbut I can' see how we've done that21:57
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479522:04
clarkbfungi: ianw ^ I'm beginning to suspect that gerritbot's default double forking is a problem there but wanted to ensure logging supports that22:04
clarkbdocker will exit with failure if the first fork exits right?22:06
clarkbwe can address that either by not forking or using simple-init?22:06
clarkbdo we have a preference?22:06
fungii think "the docker way" (much like "the systemd way") is to run in the foreground without forking and direct all logging to stdout, so i guess if we're going to run it under docker then that gets my vote22:18
ianwclarkb: daemonizing i guess would make it look like init died ... it's not running an init?22:18
fungithe days of the traditional unix daemon are apparently numbered22:18
openstackgerritClark Boylan proposed opendev/gerritbot master: Add option to disable daemonization  https://review.opendev.org/74524022:21
clarkbianw: no init, the cmd is gerritbot itself22:21
*** qchris has quit IRC22:22
clarkbI've added an option to --no-daemon the process in ^ though I've not done any testing of that22:22
clarkbit may be worth letting taht build an imgae, then running the image locally against review.o.o and freenode with a minimal config just to sanity check it22:22
clarkbI guess alternatively I can figure out how to depeonds on that in system-config22:24
ianwit should "just work" from the intermediate registry?22:26
clarkbI think we need to do the requires and provides things22:28
clarkbI've got chagnes for thta and will add depends-on22:28
openstackgerritClark Boylan proposed opendev/gerritbot master: Add option to disable daemonization  https://review.opendev.org/74524022:32
openstackgerritClark Boylan proposed opendev/gerritbot master: Update docker image jobs to advertise the image they build  https://review.opendev.org/74524122:32
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479522:32
clarkbthat may work?22:33
*** qchris has joined #opendev22:34
clarkbhrm the buildset registry job ahs started before the image build completed. Will it do the right thing in that case?22:34
clarkbcorvus: ^22:34
*** gmann_afk is now known as gmann22:35
clarkbthe sun finally came out so I'm going to go for a walk or something. Feel free to update if I got the tying together of those jobs wrong22:38
donnydseems like the expanded flavors are quite popular22:55
*** tkajinam has joined #opendev22:55
donnydor there has just been a bunch of jobs waiting on OE to be back up22:55
*** mlavalle has quit IRC22:56
fungiprobably a bit of both22:58
donnydif the custom jobs are popular, I am thinking with my reduced capacity maybe OE is best utilized to support these types of workloads. curious to know what everyone thinks about that23:00
donnydi also am curious if there is a way to find out if it curns through jobs faster with these processors or the old processors23:01
donnydchurns*23:01
clarkbso we do actually use dumb-init on all our python images23:48
clarkbwhich makes me think the double fork wasn't a problem and intead it was just the logging config?23:48
clarkbI'm going to force it to fail testing one more time to review logs and see what it looks like23:49
openstackgerritClark Boylan proposed opendev/system-config master: Add ansible role to manage gerritbot  https://review.opendev.org/74479523:49

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!