Saturday, 2020-03-28

mordredbut I think we're good to go to land project changes again00:00
fungisorry, got sidetracked filling out an expense report00:00
* fungi grumbles about necessary paperwork00:00
mordredmaybe over the weekend we can try another gerrit restart and see what breaks00:00
johnsomYeah, I need to run too. I wonder if there isn't a "marketing" factor that silent would not quiet help with. I do like supporting the effort of the driver developers.00:01
clarkbthats a first, I've just been suggested that I be careful updating software because the virus means support techs can't travel00:01
clarkbfungi: don't forget your census too00:01
fungialready did00:01
clarkb(it was actually pretty easy online)00:01
fungiwell, christine filled it out00:01
johnsomquiet->quite (this Is why it's time to sign off)00:01
fungiyeah, we did online census00:01
mordredfungi: if you have a sec: https://review.opendev.org/#/c/715551/00:02
fungisure, lookin'00:02
clarkbI've detached from root screen00:02
clarkbits EOD for me00:02
mordredI have also detached00:02
johnsommordred Let me know if you noodle on it and there is a place I should write something up. I'm happy to throw the RFE/proposal out.00:03
mordredjohnsom: will do00:03
clarkbthe weirdest bit is going to be figuring out of zuul needs changes first00:03
clarkbif it doesn't then its just a matter of updating configs00:03
johnsomCatch you all next week00:05
openstackgerritMerged opendev/gerritlib master: Run gerritlib integration tests with python3  https://review.opendev.org/71554600:09
mnasermordred: https://review.opendev.org/#/c/715544/2 if you want a test :)00:28
*** tosky has quit IRC00:35
openstackgerritAdam Coldrick proposed opendev/storyboard master: Drop Python 2.7 support  https://review.opendev.org/71547600:55
openstackgerritAdam Coldrick proposed opendev/storyboard master: Drop Python 2.7 support  https://review.opendev.org/71547600:57
ianwnoonedeadpunk / clarkb : i hope with virtualenv issues fixed i can get f31 done too, and we can release it all on my monday.  if it turns out difficult, can release anyway05:37
*** factor has quit IRC06:41
openstackgerritMerged openstack/project-config master: Add openstacksdk and python-openstackclient to integrated  https://review.opendev.org/71555907:05
*** DSpider has joined #opendev07:46
openstackgerritAdam Coldrick proposed opendev/storyboard master: Drop Python 2.7 support  https://review.opendev.org/71547611:00
*** elod has quit IRC11:43
*** elod has joined #opendev11:45
*** tosky has joined #opendev12:06
noonedeadpunkianw: ok, thanks for updating!12:40
openstackgerritJeremy Stanley proposed opendev/storyboard master: Drop Python 2.7 support  https://review.opendev.org/71547614:29
corvusfungi, mordred, clarkb, ttx, frickler: fyi https://www.jwz.org/blog/2020/03/zoom-is-bad-and-you-should-feel-bad/14:46
fungiindeed, thanks! i saw some of that last week but some i hadn't yet14:49
* fungi is glad to have never installed their nasty proprietary client/browser extension/spyware14:49
corvusthe epic complaint is interesting reading;  it's a bit of a shotgun approach, but there's some real bad stuff in there.14:51
fungihttps://epic.org/privacy/zoom/EPIC-FTC-Complaint-In-re-Zoom-7-19.pdf14:52
corvusmordred: as a mac user, you may want to pay particular attention to the bit about the http server that is installed and running without the user's consent14:53
openstackgerritMerged opendev/storyboard master: Drop Python 2.7 support  https://review.opendev.org/71547615:08
mnasercorvus, mordred: i actually make a conscious decision of killing the zoom process whenever it's not running :X15:17
mnasers/not running/not using it15:17
openstackgerritMonty Taylor proposed opendev/storyboard-webclient master: Build container images  https://review.opendev.org/69732216:03
openstackgerritMonty Taylor proposed opendev/storyboard-webclient master: Update node to v10  https://review.opendev.org/69732416:03
fungimordred: so we should be all clear to merge project creation changes again, right?16:08
mordredfungi: yes - although we should take gerrit out of emergency16:10
mordredlemme do that real quick16:10
fungioh, i thought you already did16:10
mordreddone16:10
fungi715544 has volunteered to serve as a guinea pig if we want to test the waters hands-off16:11
mordredI was going to last night, but then I was also about to leave16:11
mordredyeah - I think that's a fine choice16:11
fungino worries16:11
fungii'm approving it now16:11
fungior do we want to wait a bit for ansible to run once and attain a steady state?16:11
AJaegersome more changes with repo creation that are ready: https://review.opendev.org/#/c/714965/ https://review.opendev.org/#/c/704133/ https://review.opendev.org/#/c/713650/ https://review.opendev.org/#/c/713809/ - enough to test16:14
mordredfungi: I think it should be fine - we ran the ansible yesterday anyway16:15
mordredso we should already be in steady state16:15
fungibombs away, in that case16:17
mordred\o/16:17
fungiif 715544 works we can probably mass approve the rest of the backlog16:18
fungiotherwise i'll take a look and see if i can tell what went wrong16:18
fungiin the meantime, overdue yardwork beckons16:19
AJaegerfungi: approve https://review.opendev.org/#/c/713809/ next - that adds import of repo and new ACL.16:19
AJaegerIf that works, I suggest we can mass approve16:19
AJaegerso, 715544 is minimal work (no new ACL, no repo import) and 713809 covers all the fun.16:20
AJaeger(including gerribot update)16:20
mordredhrm16:20
AJaegermordred: what's troubling you?16:21
fungiAJaeger: good call16:21
mordredfungi: **totally** missed gerritbot in the ansible16:22
mordred(turns out there's a few things we do on review that we don't do on review-dev16:23
corvusgerritbot really shouldn't be on review.o.o anyway16:23
openstackgerritMerged openstack/project-config master: Add vexxhost/smokeping_prober-helm  https://review.opendev.org/71554416:24
corvusif fixing that needs serious work, we might want to think about going ahead and putting it on eavesdrop or something16:24
mordredit's going to be non-zero amount of work16:24
mordredso yeah- I could put it somewhere else16:24
corvusit's not that important -- just bringing it up as whichever way is easiest16:25
mordredcorvus: it would be the same amount of work wherever we put it16:25
mordredso we might as well put it somewhere else if we're doing that :)16:25
mordredcorvus: if Im reading the puppet right, we restart the daemon every time the config file changes, yes/16:26
corvus(i feel like the fewer processes running on the server which is The Source Of All Truth, the better)16:26
corvusmordred: i think so16:26
corvusi don't think there's a reload thingy16:26
mordredyeah.16:26
mordredso, I'll get to work on this - for now we might just want to manually copy the file and reload after a batch of project changes goes through16:27
mordredor we can just wait until it's all ready16:27
mordredsort of depends on relative level of importance of bot config updates16:27
corvusi don't feel like it needs to be a blocker16:27
mordred++16:28
corvusbut i also am not around today16:28
corvusi mean, i'm around.  i just have commitments in other rooms of the house.  :)16:28
AJaegeragreed, gerritbot is not a blocker16:29
clarkbI'm being recruited to make a castle out if cardboard boxes16:31
mordredclarkb: that seems like a good task16:33
fungiclarkb: cardboard boxes you've left out in the sun for 48 hours i guess? ;)16:39
fungiand yeah, i don't see gerritbot updates as critical right now if we have to update and restart it manually occasionally until we can put it in the right place16:40
clarkbfungi: we've actually got some that are much older that I've not evicted from the garage yet16:40
fungiooh, so you can also do arachnid education at the same time!16:40
fungii agree the gerrit server is probably not a great place for gerritbot. the only thing that's got going for it is that connecting to localhost for the event stream might be a little more stable, but zuul seems to cope doing that remotely just fine16:41
openstackgerritMonty Taylor proposed opendev/gerritbot master: Update for python3  https://review.opendev.org/71563416:46
openstackgerritMonty Taylor proposed opendev/gerritbot master: Build docker images  https://review.opendev.org/71563516:46
mordredthere's step one :)16:47
openstackgerritMonty Taylor proposed opendev/gerritbot master: Build docker images  https://review.opendev.org/71563516:53
AJaegerhttps://opendev.org/vexxhost/smokeping_prober-helm exists17:03
AJaeger\o/17:03
AJaegercongrats, mordred !17:03
AJaegermordred: https://opendev.org/vexxhost/smokeping_prober-helm - host=localhost???17:03
mordredAJaeger: woot! - and oh - yeah - that's certainly fun17:05
mordredwe shoudl fix that17:05
AJaegermnaser, mordred https://review.opendev.org/715636 fixes gitreview of vexxhost/smokeping_prober-helm17:06
openstackgerritMonty Taylor proposed opendev/system-config master: Use gerrit_vhost_name in projects.ini  https://review.opendev.org/71563717:07
mordredAJaeger, clarkb, fungi: ^^17:07
AJaegermordred: that looks better but I know to little about this17:08
AJaegerbbl17:08
openstackgerritMonty Taylor proposed opendev/gerritbot master: Build docker images  https://review.opendev.org/71563517:09
fungimnaser: noonedeadpunk: https://opendev.org/vexxhost/smokeping_prober-helm17:10
noonedeadpunkfungi: thanks!17:10
fungiapproving 713809 next at AJaeger's recommendation17:10
*** DSpider has quit IRC17:14
openstackgerritMerged opendev/gerritbot master: Update for python3  https://review.opendev.org/71563417:19
fungiunapproved it now that i see https://opendev.org/vexxhost/smokeping_prober-helm/src/branch/master/.gitreview#L217:19
fungii should pay more attention to scrollback17:20
mnaserAJaeger: i think i will have to add a noop job17:26
mnaserlet me do it17:26
mnaserfungi, mordred: i think we have another issue, gerrit acls17:30
mnaseri dont have +2 on https://review.opendev.org/#/c/715636/17:30
mnaserhttps://review.opendev.org/#/admin/projects/vexxhost/smokeping_prober-helm,access17:30
mnaseractually, i think the same reason we had 'localhost' in git review might have been teh same reason the acls didn't get updated?17:35
mordredmnaser: lemme go look at logs17:47
mnasermordred: is this still driven by cron or driven by zuul directly (aka can i also help by looking at a post job?)17:47
mordred2020-03-28 16:47:52,010: manage_projects - INFO - vexxhost/smokeping_prober-helm has matching sha, skipping ACLs17:48
mordredmnaser: it's still right now just run by cron - but I think we're in a good position to move it to zuul soon17:49
mordredok. so - in jeepyb ...17:50
mordredthis: https://opendev.org/opendev/jeepyb/src/branch/master/jeepyb/cmd/manage_projects.py#L552-L56317:52
mordredis the relevant code17:52
mordredI can confirm there is no acl-sha entry in the project cache for vexxhost/smokeping_prober-helm17:52
mordredsigh. I bet you anything it's glob returning bytes17:53
mordredhrm. no - glob returns strings17:53
mordredhttps://opendev.org/opendev/jeepyb/src/branch/master/jeepyb/cmd/manage_projects.py#L457-L46117:54
mordredis the acl_cache part17:54
mordredI see the bug17:57
openstackgerritMerged opendev/system-config master: Add an image pull to manage-projects playbook  https://review.opendev.org/71555117:58
mnaserThe projects folder not being mounted in?17:59
openstackgerritMonty Taylor proposed opendev/system-config master: Bind-mount acls dir to /home/gerrit2  https://review.opendev.org/71564217:59
mordredmnaser, clarkb, fungi: ^^18:00
mordredthat should fix it18:00
mordredmnaser: I tried to "clean up" how we were mounting in the acls18:00
mordredturns out -that was a mistake :)18:00
mordredso - we hit the logic where there was no acl-sha in the project_cache, so it was None - and there was also no sha for the path in the acl_cache since the path didn't exist, so it was also None = so None == None and we found that the state matched so nothing to do18:01
mordredonce that lands and runs, the acls should get applied as expected, since we don't have an acl-sha entry in the project cache18:01
mnasercool, I am not intimately familiar with all that tooling but hey18:02
mnasermostly a successful process so far18:02
mordredmnaser: almost nobody is :)18:03
mordredinfra-root: as people filter back through online, https://review.opendev.org/#/c/715637/ and both need landing (fix the issues we've found on applying the vexxhost projects)18:05
mordredgah18:05
mordredinfra-root: as people filter back through online, https://review.opendev.org/#/c/715637/ and  https://review.opendev.org/#/c/715642/ both need landing (fix the issues we've found on applying the vexxhost projects)18:05
fungii've single-core approved them both, i'm around again, waiting on tasty thai delivery18:15
mnaserlooks like `system-config-run-gitea` failed, i recheck'd because it _seems_ like a random failure19:03
mordredmnaser: I saw that fail earlier - on an issue creating docker dir19:10
mordred(whcih also just seemed fluky - but maybe we've got a race condition lurking somewhere or something)19:12
mnasermordred: interesting, it looks like opendev/system-config is still in the openstack tenant19:31
mnaserno fast approve :(19:31
mnaser(or rather a straight-to-gate thing)19:32
fungimnaser: yep, untangling it will take a while, what with its integration test jobs involving lots of other repos which are still also in the openstack tenant19:33
mordredyeah. I think I'm kinda thinking it'll be easiest once we've killed puppet :)19:57
mordred(the biggest sticking point atm being teh puppet integration tests which are legacy jobs ... it's hard to find the motivation to go and rework them)19:58
openstackgerritsebastian marcet proposed opendev/system-config master: OpenstackId production deployment 3.0.7  https://review.opendev.org/71565520:15
openstackgerritMerged opendev/system-config master: Use gerrit_vhost_name in projects.ini  https://review.opendev.org/71563720:30
mordredfungi: I've seen that create docker directory issue more than once now20:42
mordredbut I cannot for the life of me fathom why it would fail20:46
*** DSpider has joined #opendev20:58
openstackgerritMerged opendev/system-config master: Bind-mount acls dir to /home/gerrit2  https://review.opendev.org/71564221:37
mordredmnaser: ^^ ok - you should get acls next pulse21:39
mnasermordred: i got my powa :) thank you so very much22:27
mnaseri guess that should be an indicator that we can continue adding other projects22:28
* mnaser will gladly be the testbed for the other project addition in case we have to make cleanup commits22:28
mnaserehhhh22:32
mnasernevermind, i don't have no power yet.  that was my bad.22:32
* mnaser waits a couple more hours22:32
*** DSpider has quit IRC22:37
fungido we maybe need to clear the jeepyb cache for that repo?22:54
openstackgerritMohammed Naser proposed zuul/zuul-jobs master: chart-testing: add dirs option  https://review.opendev.org/71566423:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!