Tuesday, 2020-07-14

*** andrebeltrami has quit IRC00:01
*** yamamoto has joined #openstack-meeting-alt00:10
*** tetsuro has joined #openstack-meeting-alt00:10
*** gyee has quit IRC00:52
*** enriquetaso has quit IRC01:11
*** knomura has joined #openstack-meeting-alt01:13
*** knomura has quit IRC01:17
*** knomura has joined #openstack-meeting-alt01:21
*** knomura has quit IRC01:25
*** knomura has joined #openstack-meeting-alt01:27
*** knomura has quit IRC01:32
*** knomura has joined #openstack-meeting-alt01:39
*** knomura has quit IRC01:44
*** ayoung has quit IRC01:56
*** knomura has joined #openstack-meeting-alt02:09
*** knomura has quit IRC02:13
*** knomura has joined #openstack-meeting-alt02:14
*** apetrich has quit IRC02:14
*** knomura has quit IRC02:18
*** knomura has joined #openstack-meeting-alt02:24
*** knomura has quit IRC02:28
*** knomura has joined #openstack-meeting-alt02:38
*** knomura has quit IRC02:43
*** rfolco has quit IRC02:59
*** ricolin_ has joined #openstack-meeting-alt03:00
*** tetsuro has quit IRC03:04
*** knomura has joined #openstack-meeting-alt03:49
*** m5z has quit IRC03:54
*** lhinds has quit IRC03:54
*** knomura has quit IRC03:54
*** knomura has joined #openstack-meeting-alt03:54
*** lhinds|out has joined #openstack-meeting-alt03:54
*** knomura has quit IRC03:58
*** tetsuro has joined #openstack-meeting-alt04:22
*** tetsuro_ has joined #openstack-meeting-alt04:26
*** tetsuro has quit IRC04:27
*** tetsuro_ has quit IRC04:41
*** tetsuro has joined #openstack-meeting-alt04:46
*** tetsuro has quit IRC04:58
*** vishalmanchanda has joined #openstack-meeting-alt05:41
*** links has joined #openstack-meeting-alt05:50
*** knomura has joined #openstack-meeting-alt06:07
*** knomura has quit IRC06:09
*** knomura_ has joined #openstack-meeting-alt06:09
*** knomura_ has quit IRC06:13
*** ccamacho has joined #openstack-meeting-alt06:18
*** diurnalist has quit IRC06:22
*** knomura has joined #openstack-meeting-alt06:23
*** knomura has quit IRC06:28
*** diurnalist has joined #openstack-meeting-alt06:29
*** knomura has joined #openstack-meeting-alt06:31
*** knomura has quit IRC06:36
*** SotK has quit IRC06:54
*** SotK has joined #openstack-meeting-alt06:55
*** rdopiera has joined #openstack-meeting-alt07:05
*** rcernin has quit IRC07:05
*** ralonsoh has joined #openstack-meeting-alt07:31
*** ccamacho has quit IRC07:32
*** yamamoto has quit IRC07:38
*** yamamoto has joined #openstack-meeting-alt07:40
*** m5z has joined #openstack-meeting-alt07:41
*** diurnalist has quit IRC07:44
*** e0ne has joined #openstack-meeting-alt08:01
*** rcernin has joined #openstack-meeting-alt08:16
*** rcernin has quit IRC08:42
*** derekh has joined #openstack-meeting-alt08:48
*** ccamacho has joined #openstack-meeting-alt09:00
*** apetrich has joined #openstack-meeting-alt09:00
*** diurnalist has joined #openstack-meeting-alt09:43
*** frickler is now known as frickler_pto09:44
*** frickler_pto is now known as frickler09:47
*** yamamoto has quit IRC10:16
*** yamamoto has joined #openstack-meeting-alt10:22
*** gouthamr has quit IRC10:22
*** gouthamr has joined #openstack-meeting-alt10:23
*** yamamoto has quit IRC10:26
*** yamamoto has joined #openstack-meeting-alt11:02
*** yamamoto has quit IRC11:08
*** rcernin has joined #openstack-meeting-alt11:14
*** yamamoto has joined #openstack-meeting-alt11:40
*** raildo has joined #openstack-meeting-alt12:02
*** rfolco has joined #openstack-meeting-alt12:03
*** yamamoto has quit IRC12:08
*** yamamoto has joined #openstack-meeting-alt12:13
*** derekh has quit IRC12:23
*** yamamoto has quit IRC12:27
*** vishakha has joined #openstack-meeting-alt12:28
*** yamamoto has joined #openstack-meeting-alt12:41
*** rcernin has quit IRC12:48
*** baojg has joined #openstack-meeting-alt12:54
*** derekh has joined #openstack-meeting-alt13:03
*** yamamoto has quit IRC13:10
*** eharney has joined #openstack-meeting-alt13:11
*** baojg has quit IRC13:15
*** baojg has joined #openstack-meeting-alt13:16
*** enriquetaso has joined #openstack-meeting-alt13:22
*** benj_ has quit IRC13:39
*** benj_ has joined #openstack-meeting-alt13:41
*** ralonsoh has quit IRC13:49
*** frickler is now known as frickler_pto13:50
*** ralonsoh has joined #openstack-meeting-alt14:00
*** john153 has joined #openstack-meeting-alt14:10
*** knikolla has joined #openstack-meeting-alt14:21
*** yamamoto has joined #openstack-meeting-alt14:28
*** dave-mccowan has joined #openstack-meeting-alt14:38
*** johnthetubaguy has quit IRC14:50
*** johnthetubaguy has joined #openstack-meeting-alt14:52
gagehugo#startmeeting openstack-helm15:00
*** andrii_ostapenko has joined #openstack-meeting-alt15:00
openstackMeeting started Tue Jul 14 15:00:16 2020 UTC and is due to finish in 60 minutes.  The chair is gagehugo. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: openstack-helm)"15:00
openstackThe meeting name has been set to 'openstack_helm'15:00
gagehugo#link https://etherpad.opendev.org/p/openstack-helm-weekly-meeting agenda15:00
stevthedevHello15:00
gagehugoo/15:00
*** lamt has joined #openstack-meeting-alt15:00
andrii_ostapenkoo/15:01
lamt\o15:01
gagehugowe will start in a couple mins15:02
*** yamamoto has quit IRC15:03
*** sangeet has joined #openstack-meeting-alt15:04
gagehugook15:04
gagehugo#topic congrats andrii15:05
*** openstack changes topic to "congrats andrii (Meeting topic: openstack-helm)"15:05
stevthedev\o/15:05
andrii_ostapenkothank you :)15:05
gagehugothe OSH core team would like to welcome andrii as a core reviewer, thanks andrii for all your hard work!15:05
gagehugoand I believe andrii has more things to discuss today too :)15:07
lamt\o/15:07
gagehugo#topic Improvements in jobs execution time15:07
*** openstack changes topic to "Improvements in jobs execution time (Meeting topic: openstack-helm)"15:07
gagehugoandrii_ostapenko: the floor is yours15:07
andrii_ostapenkoyes. Thank you, gagehugo. I started with small think for now and sorry for commit message. I'm introducing a mechanism to parallelize gate scripts execution that at this point saves 10-20% of execution time. https://review.opendev.org/739659 https://review.opendev.org/73989115:08
andrii_ostapenkoif we're going in this direction i have several more optimizations in my mind15:09
andrii_ostapenkolike script refactoring and running all tests in parallel at the end15:10
gagehugoThe gates could use cleanup like this, so I'm in favor of something like this15:10
andrii_ostapenkoalso looking to switch back to kubeadm but move kubeadm-aio image build to osh images and reuse it in osh during the build15:10
andrii_ostapenkothis should be evaluated if we can save couple mins there, so rnd for now15:11
andrii_ostapenkoalso pre-pulling some images in parallel15:11
andrii_ostapenkofor now only https://review.opendev.org/739659 https://review.opendev.org/739891 - i'll prepare commits for review later15:11
andrii_ostapenkoso if you have some other ideas - please share15:12
gagehugoI think there was discussion previously about hosting some images in the infra mirror15:12
gagehugoidk what happened there though15:12
andrii_ostapenkomy goal is to have minimum time for compute-kit ~30 mins15:12
gagehugoThat would be amazing15:13
*** tosky has joined #openstack-meeting-alt15:13
lamt++15:13
andrii_ostapenkoi don't feel we can have an average 30 mins, but at least we should move in this direction15:14
gagehugoI'm for it15:15
andrii_ostapenkoalso i noticed it's a bit worse on 8GB nodes. maybe we have memory consumption spikes due to parallel execution. still it's faster than consequent one15:15
gagehugoThere may be things we can reduce there as well15:15
gagehugoreplica counts15:15
andrii_ostapenkoi'll prepare some comparison based on statistics15:15
gagehugomin memory values15:15
andrii_ostapenkoyes. looking at individual charts is the next step15:16
gagehugook cool15:16
andrii_ostapenkominute here, minute there - every minute matters15:17
stevthedev++15:17
gagehugoyup, might just be a bunch of small tweaks that add up to larger gains15:17
gagehugo#topic osh-infra-images testing15:17
*** openstack changes topic to "osh-infra-images testing (Meeting topic: openstack-helm)"15:17
gagehugoandrii_ostapenko: this is you as well I believe15:18
andrii_ostapenkohttps://review.opendev.org/#/q/topic:test-osh-images15:18
andrii_ostapenkoit's a mechanism to reuse osh jobs in osh-images on post-review15:18
andrii_ostapenkoso what is suggest is to build and upload images during the gates on osh-images and test it there as well15:19
andrii_ostapenkoalso in future I want periodic builds for loci images, testing and promotion for loci images. we often have a situation when the last latest image is more then 1 month old15:20
andrii_ostapenkobecause we build them only on commits to corresponding code in osh-images15:20
gagehugoyeah, we've already hit issues where some images are old and out-of-date with upstream changes15:20
gagehugoI'm in favor of this as well15:21
gagehugoit's been some pain points15:21
andrii_ostapenkothis topic is ready for review. it provides mechanism and implements it for loci stein and train on gates15:21
stevthedevIf we build on each commit, why do we need to build periodically?15:21
andrii_ostapenkowe build on each commit to osh-images to corresponding to particular image code15:22
andrii_ostapenkobut don't build for new openstack component merges15:22
stevthedevAh okay15:22
stevthedevI don't think I run into this problem much with the LMA images15:23
andrii_ostapenkoyes. we need periodic one only for loci15:23
gagehugoIt's been a bit annoying with things like the requirements image and stable images for openstack15:23
stevthedevThanks for clarifying for me15:23
gagehugobranches get updated with bug fixes or reqs change, but the image is months behind15:23
stevthedevMakes sense15:23
gagehugoand suddenly images fail because the reqs match up game breaks15:24
andrii_ostapenkoperiodic ones will be available if i manage to merge https://review.opendev.org/#/c/740560/15:24
andrii_ostapenkobut now we can at least run test deployment on gates and topic is ready for review15:24
andrii_ostapenkoi'm going to implement this logic for other images, not only loci15:24
andrii_ostapenkoif we have a corresponding test job in osh or osh-infra15:25
stevthedevI think thats a good idea. I remember Steve W wanting more robust testing between osh-infra and osh-images too15:25
andrii_ostapenkoe.g. for some changes in kibana image we can run osh-infra-logging job15:25
stevthedev++15:26
andrii_ostapenkoalso i want to get rid of some duplication across the repos https://review.opendev.org/#/c/740530/15:26
andrii_ostapenkoand inherit from infra job and reuse osh-infra-gate-runner instead of having it in both repos15:27
stevthedevI will go through the chain of patches and take a look15:27
andrii_ostapenkothank you15:27
gagehugosounds good!15:28
gagehugothanks andrii!15:28
gagehugo#topic Open Discussion/Reviews15:28
*** openstack changes topic to "Open Discussion/Reviews (Meeting topic: openstack-helm)"15:28
gagehugo#link https://review.opendev.org/#/c/740825/ node-down detector15:28
gagehugo#undo15:28
openstackRemoving item from minutes: #link https://review.opendev.org/#/c/740825/15:28
stevthedevI want to pass on a Q from my team15:28
stevthedevRadhika has been working on a dockerfile for the node-problem-detector. The dockerfile merged, and she is following that up with a zuul job for the image (https://review.opendev.org/#/c/740825/). The job log shows the image was built successfully, but we don't see it on dockerhub (https://hub.docker.com/u/openstackhelm/)15:28
gagehugo#link https://review.opendev.org/#/c/740825/ node problem detector15:28
gagehugoyeah it may need to get added15:29
stevthedevIs there a missing component, does the repo need to be created manually, will this get fixed when PS merges?15:29
andrii_ostapenkoit will be uploaded after merge only15:29
gagehugobut also there's credentials I believe in the repo15:29
andrii_ostapenkoactually it's being uploaded on post-review15:29
andrii_ostapenkowith temp tag15:30
andrii_ostapenkoand promoted to defined tag after the merge15:30
andrii_ostapenkoimage is not uploaded to dockerhub in untrusted pre-review pipeline in case if zuul-jobs *-docker-image jobs are used15:31
stevthedevUpon merging https://review.opendev.org/#/c/740825/ do we have to make a change to the dockerfile to trigger the build? Or will it run once the zuul addition is merged?15:32
stevthedevto rephrase that - is it merge to the image directory that triggers the build, or any change to osh-images15:33
andrii_ostapenko- node-problem-detector/.*15:34
andrii_ostapenko- zuul.d/node-problem-detector.yaml15:34
andrii_ostapenkoso it's defined in zuul.d/node-problem-detector.yaml15:34
andrii_ostapenkowhen to run it15:34
stevthedevAh I see now. ty15:34
*** baojg has quit IRC15:37
gagehugoAnyone else have anything for this week?15:38
andrii_ostapenkothat actually have a relation to testing an image15:38
andrii_ostapenkowe'll be able to do it on post-review for this image as well15:38
*** baojg has joined #openstack-meeting-alt15:38
andrii_ostapenkoif there's any job in osh or osh-infra that deploys this chart15:39
stevthedevYep :)15:39
andrii_ostapenkobut not in pre-review15:39
stevthedevI'm not sure if it's been included in an osh-infra job yet. But I'll have to double check15:39
stevthedevmight be in monitoring?15:39
andrii_ostapenkohttps://review.opendev.org/#/c/668754/15:40
andrii_ostapenkoaio-monitoring15:41
gagehugoThanks everyone have a good rest of the week15:44
gagehugo#endmeeting15:44
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:44
openstackMeeting ended Tue Jul 14 15:44:24 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:44
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-07-14-15.00.html15:44
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-07-14-15.00.txt15:44
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-07-14-15.00.log.html15:44
*** gyee has joined #openstack-meeting-alt15:50
*** andrii_ostapenko has quit IRC15:51
*** links has quit IRC15:59
*** knomura has joined #openstack-meeting-alt16:38
*** e0ne has quit IRC16:38
*** derekh has quit IRC16:58
knikolla#startmeeting keystone16:59
openstackMeeting started Tue Jul 14 16:59:12 2020 UTC and is due to finish in 60 minutes.  The chair is knikolla. Information about MeetBot at http://wiki.debian.org/MeetBot.16:59
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:59
*** openstack changes topic to " (Meeting topic: keystone)"16:59
openstackThe meeting name has been set to 'keystone'16:59
*** knomura has quit IRC16:59
knikollao/16:59
cmurphyo/16:59
vishakhao/17:00
knikollahow's everyone?17:00
*** yamamoto has joined #openstack-meeting-alt17:01
vishakhaGood. How are you?17:02
cmurphynot too bad17:03
knikolladoing alright.17:04
knikollagoing to maine the weekend next week.17:04
knikollaI guess that's all of us for this meeting.17:05
knikolla#topic Review Requests17:05
*** openstack changes topic to "Review Requests (Meeting topic: keystone)"17:05
vishakhaI have few review requests that closes some bugs17:06
vishakha#link https://review.opendev.org/#/c/731087/17:07
vishakha#link https://review.opendev.org/#/c/740473/17:07
vishakha#link https://review.opendev.org/#/c/737225/17:07
vishakha#link https://review.opendev.org/#/c/739784/17:08
vishakha#link https://review.opendev.org/#/c/738190/17:08
knikollaThanks vishakha17:09
knikollaabout https://review.opendev.org/#/c/731087/ i'm not entirely sure about the best time to prune stale assignment, i'17:10
knikollai'm not sure delete role is the best time, but i'd like to hear other opinions17:10
cmurphywe should just keep it consistent with how we do it with project and domain assignments right?17:11
knikollado we prune those?17:13
vishakhaI  did not saw anywhere in keystone pruning assignments17:14
cmurphyoh maybe i misunderstood, by stale you mean the ones that exist because of this bug?17:14
cmurphysorry i'm not sure i'm being clear, i haven't looked too deeply at this bug yet17:15
knikollayes, the ones prior to this bug being fixed.17:16
vishakhaThis bug is specific to system assignments, where while deleting system assignments , the assignments are not deleted from the system assignment table17:17
cmurphyi don't really think we should be going and retroactively fixing people's deployments and messing with their databases, and leaving in code that does a one-time cleanup but then forever exists in the code base17:20
cmurphyi would rather the release note included mysql instruction to help them clean it up one time17:20
bnemecI could use another opinion on https://review.opendev.org/#/c/733881/ It's what we agreed to at the PTG, but there was some disagreement on the review. I left more thoughts related to it on https://review.opendev.org/#/c/72692917:22
bnemec(for oslo.limit and keystoneauth)17:22
knikollacmurphy: hmmm... unsure if a good idea, but maybe a sql migration?17:23
cmurphyknikolla: i'd be more in favor of that than code that runs in the driver17:24
cmurphybut that wouldn't fix older deployments17:25
knikollathat is true.17:25
vishakhaStill not sure should I add a note in the document informing the deployers?17:29
knikollayes, that while the bug is fixed moving forward, the previously stale system role assignments will need to be cleaned manually.17:30
knikollawe should provide some guidance on how to do that.17:31
cmurphyi'm saying i disagree with lance's suggestion to add remove_stale_role_assignments and i would prefer documenting manual steps in the release note17:31
cmurphyi'll comment on the review and see what lbragstad thinks17:32
vishakhaThanks cmurphy knikolla17:32
* lbragstad walks in late17:32
knikollaanother possible solution is to catch the exception when a stale assignment is encountered, and clean it then.17:32
lbragstadsorry - i got wrapped up reading some docs17:32
toskyand also https://review.opendev.org/#/c/733801/ which removes the last legacy job, which already received a +2 from last week17:37
knikollalbragstad, cmurphy: thoughts on cleaning up on exception encountered?17:39
lbragstadknikolla cmurphy yep - i just responded on the review, but i can repeat here, too17:40
lbragstadi can empathize with not running that code every time we delete a role17:40
lbragstadnot wanting to run that code*17:40
lbragstadbut a better alternative wasn't coming to me17:40
lbragstadto make sure i understand correctly, cmurphy is your recommendation to provide documentation that tells operators how to fix this with SQL statements?17:42
cmurphylbragstad: yes that is my proposal, it should be a pretty simple sql query, and also a pretty easy test to see if you are affected by it (see if you can run role assignment list --names)17:43
lbragstadwhat about an upgrade check?17:44
knikollaThat is a better option than running it each time during delete_role, but I would love to avoid adding more work to operators, even if it is a one time thing.17:44
lbragstadwe typically put things like this in keystone-manage17:45
lbragstadinstead of asking operators to tinker with the database directly17:45
lbragstad(keystone-manage token_flush was an example)17:46
knikollaWhat about adding a try/catch in listing roles with names and doing the cleanup if the exception is caught? That will add more code with limited usefulness, but we would be doing the same by adding documentation.17:46
cmurphytoken_flush was a task that needed to happen every so often17:46
cmurphythis is a one time thing17:46
knikollaAnd the code won't run if the exception is never encountered.17:46
cmurphywe have a precedent for asking operators to run db queries to fix a broken state left by a bug17:49
cmurphyhttps://bugs.launchpad.net/keystone/+bug/184834217:49
openstackLaunchpad bug 1848342 in OpenStack Identity (keystone) "Duplicated entries in users API" [Medium,Fix released] - Assigned to Pedro Henrique Pereira Martins (pedrohpmartins)17:49
cmurphyi don't really see why it's that big of a deal17:49
cmurphyit feels really inelegant to leave code in keystone that will last forever that will only ever run once on a deployment in its lifetime17:50
knikollahmm, i wasn't aware of the precedent. interesting.17:51
lbragstadi don't recall seeing this bug17:51
*** yamamoto has quit IRC17:53
knikollai'm okay with a release not for this. given that very few deployments will be using system role assignments at this point in time, it feels like very few people will be running into this.17:54
knikollanote*17:54
lbragstadif others are ok with the approach, i won't get in the way17:57
*** ralonsoh has quit IRC17:57
lbragstadi was unaware of cases where we did this in the past'17:57
knikollai was unaware too17:57
knikollavishakha: you can revise your spec with the new approach, and we can continue talking on the review, or in next weeks meeting17:58
cmurphythis may be the only case, if we've come up with another solution for a similar problem in the past we could look at that but i'm unaware of any17:58
*** diurnalist has quit IRC17:59
cmurphyit looks like it was mostly just me involved in the review of that last bugfix so i may be biased17:59
lbragstadthe only other case that's jogging my memory is asking operators to adjust character encoding in the database... which in my opinion is a bit different than this because it's a database setting out of keystone's control18:00
cmurphyyeah18:01
knikollaeither way, we're out of time18:01
knikollathanks all18:01
vishakhaSure, i will wait until we agree on something. Thanks knikolla lbragstad cmurphy18:01
knikolla#endmeeting18:01
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"18:01
openstackMeeting ended Tue Jul 14 18:01:25 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-07-14-16.59.html18:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-07-14-16.59.txt18:01
openstackLog:            http://eavesdrop.openstack.org/meetings/keystone/2020/keystone.2020-07-14-16.59.log.html18:01
*** tosky has left #openstack-meeting-alt18:03
*** diurnalist has joined #openstack-meeting-alt18:26
*** ricolin_ has quit IRC18:41
*** slaweq has joined #openstack-meeting-alt18:54
*** enriquetaso has quit IRC18:55
*** slaweq has quit IRC18:56
*** sangeet has quit IRC19:10
*** knomura has joined #openstack-meeting-alt19:11
*** knomura has quit IRC19:15
*** sangeet has joined #openstack-meeting-alt19:41
*** sangeet has left #openstack-meeting-alt19:41
*** yamamoto has joined #openstack-meeting-alt19:51
*** vishakha has quit IRC20:09
*** yamamoto has quit IRC20:51
*** e0ne has joined #openstack-meeting-alt20:57
*** enriquetaso has joined #openstack-meeting-alt21:05
*** markvoelker has joined #openstack-meeting-alt21:23
*** markvoelker has quit IRC21:27
*** yamamoto has joined #openstack-meeting-alt21:35
*** e0ne has quit IRC21:37
*** e0ne has joined #openstack-meeting-alt21:38
*** rdopiera has quit IRC21:59
*** knomura has joined #openstack-meeting-alt22:11
*** knomura has quit IRC22:16
*** e0ne has quit IRC22:21
*** jamesmcarthur has joined #openstack-meeting-alt22:32
*** vishalmanchanda has quit IRC22:39
*** rcernin has joined #openstack-meeting-alt22:45
*** rcernin has quit IRC22:51
*** rcernin has joined #openstack-meeting-alt22:51
*** yamamoto has quit IRC23:02
*** e0ne has joined #openstack-meeting-alt23:11
*** e0ne has quit IRC23:13
*** yamamoto has joined #openstack-meeting-alt23:33
*** jamesmcarthur has quit IRC23:36
*** jamesmcarthur has joined #openstack-meeting-alt23:48
*** enriquetaso has quit IRC23:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!