| *** jmasud has joined #openstack-meeting | 00:04 | |
| *** ianychoi__ has joined #openstack-meeting | 00:14 | |
| *** tosky has quit IRC | 00:15 | |
| *** ianychoi_ has quit IRC | 00:17 | |
| *** martial has quit IRC | 00:17 | |
| *** yasufum has quit IRC | 00:19 | |
| *** jmasud has quit IRC | 01:26 | |
| *** yasufum has joined #openstack-meeting | 01:28 | |
| *** jmasud has joined #openstack-meeting | 01:35 | |
| *** jmasud has quit IRC | 01:36 | |
| *** jmasud has joined #openstack-meeting | 01:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:42 | |
| *** baojg has joined #openstack-meeting | 01:48 | |
| *** yasufum has quit IRC | 01:52 | |
| *** yasufum has joined #openstack-meeting | 01:54 | |
| *** mlavalle has quit IRC | 01:55 | |
| *** jamesmcarthur has quit IRC | 02:07 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:14 | |
| *** lbragstad_ has joined #openstack-meeting | 02:14 | |
| *** lbragstad has quit IRC | 02:17 | |
| *** jamesmcarthur has quit IRC | 02:19 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:29 | |
| *** toabctl has quit IRC | 02:34 | |
| *** jmasud has quit IRC | 02:35 | |
| *** rcernin has quit IRC | 02:37 | |
| *** toabctl has joined #openstack-meeting | 02:50 | |
| *** rcernin has joined #openstack-meeting | 02:51 | |
| *** jamesmcarthur has quit IRC | 03:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:06 | |
| *** jamesmcarthur has quit IRC | 03:11 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:13 | |
| *** jamesmcarthur has quit IRC | 03:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:16 | |
| *** jamesmcarthur has quit IRC | 03:20 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:20 | |
| *** jamesmcarthur has quit IRC | 03:20 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:22 | |
| *** jamesmcarthur has quit IRC | 03:26 | |
| *** dustinc has joined #openstack-meeting | 03:29 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:32 | |
| *** jamesmcarthur has quit IRC | 03:37 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:51 | |
| *** lbragstad_ is now known as lbragstad | 03:51 | |
| *** jamesmcarthur has quit IRC | 03:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:53 | |
| *** manpreet has joined #openstack-meeting | 04:33 | |
| *** baojg has quit IRC | 04:37 | |
| *** baojg has joined #openstack-meeting | 04:38 | |
| *** psahoo has joined #openstack-meeting | 04:40 | |
| *** jmasud has joined #openstack-meeting | 04:53 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-meeting | 05:33 | |
| *** xinranwang has joined #openstack-meeting | 05:35 | |
| *** dustinc has quit IRC | 05:39 | |
| *** psahoo has quit IRC | 05:58 | |
| *** psahoo has joined #openstack-meeting | 06:05 | |
| *** rcernin has quit IRC | 06:08 | |
| *** rcernin has joined #openstack-meeting | 06:08 | |
| *** rcernin has quit IRC | 06:17 | |
| *** rcernin has joined #openstack-meeting | 06:17 | |
| *** rcernin has quit IRC | 06:17 | |
| *** rcernin has joined #openstack-meeting | 06:19 | |
| *** jamesmcarthur has quit IRC | 06:34 | |
| *** dasp has joined #openstack-meeting | 07:00 | |
| *** dasp_ has quit IRC | 07:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 07:04 | |
| *** jamesmcarthur has quit IRC | 07:10 | |
| *** psahoo has quit IRC | 07:11 | |
| *** psahoo has joined #openstack-meeting | 07:11 | |
| *** jamesmcarthur has joined #openstack-meeting | 07:22 | |
| *** slaweq has joined #openstack-meeting | 07:28 | |
| *** ralonsoh has joined #openstack-meeting | 07:28 | |
| *** vishalmanchanda has joined #openstack-meeting | 07:33 | |
| *** ircuser-1 has joined #openstack-meeting | 07:45 | |
| *** dklyle has quit IRC | 07:58 | |
| *** psachin has joined #openstack-meeting | 08:11 | |
| *** e0ne has joined #openstack-meeting | 08:12 | |
| *** macz_ has joined #openstack-meeting | 08:23 | |
| *** macz_ has quit IRC | 08:27 | |
| *** jamesmcarthur has quit IRC | 08:40 | |
| *** tosky has joined #openstack-meeting | 08:40 | |
| *** rpittau|afk is now known as rpittau | 08:41 | |
| *** jamesmcarthur has joined #openstack-meeting | 08:56 | |
| *** jamesmcarthur has quit IRC | 09:04 | |
| *** ociuhandu has joined #openstack-meeting | 09:06 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:15 | |
| *** jamesmcarthur has quit IRC | 09:22 | |
| *** ociuhandu has quit IRC | 09:28 | |
| *** ociuhandu has joined #openstack-meeting | 09:33 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:34 | |
| *** baojg has quit IRC | 09:34 | |
| *** baojg has joined #openstack-meeting | 09:35 | |
| *** psachin has quit IRC | 09:40 | |
| *** jamesmcarthur has quit IRC | 09:40 | |
| *** psachin has joined #openstack-meeting | 09:43 | |
| *** ociuhandu has quit IRC | 09:45 | |
| *** jmasud has quit IRC | 09:46 | |
| *** yasufum has quit IRC | 09:50 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:51 | |
| *** jamesmcarthur has quit IRC | 09:58 | |
| *** yamamoto_ has quit IRC | 10:04 | |
| *** psachin has quit IRC | 10:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 10:09 | |
| *** baojg has quit IRC | 10:12 | |
| *** jamesmcarthur has quit IRC | 10:17 | |
| *** ociuhandu has joined #openstack-meeting | 10:19 | |
| *** tris has quit IRC | 10:23 | |
| *** ociuhandu has quit IRC | 10:24 | |
| *** rcernin has quit IRC | 10:24 | |
| *** jamesmcarthur has joined #openstack-meeting | 10:29 | |
| *** jamesmcarthur has quit IRC | 10:36 | |
| *** ociuhandu has joined #openstack-meeting | 10:36 | |
| *** e0ne has quit IRC | 10:40 | |
| *** ociuhandu has quit IRC | 10:41 | |
| *** ociuhandu has joined #openstack-meeting | 10:42 | |
| *** jamesmcarthur has joined #openstack-meeting | 10:47 | |
| *** rcernin has joined #openstack-meeting | 10:55 | |
| *** jamesmcarthur has quit IRC | 10:59 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:12 | |
| *** xinranwang has quit IRC | 11:13 | |
| *** jmasud has joined #openstack-meeting | 11:15 | |
| *** rcernin has quit IRC | 11:15 | |
| *** jamesmcarthur has quit IRC | 11:19 | |
| *** yamamoto has joined #openstack-meeting | 11:23 | |
| *** ociuhandu has quit IRC | 11:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:31 | |
| *** jamesmcarthur has quit IRC | 11:37 | |
| *** baojg has joined #openstack-meeting | 11:44 | |
| *** yamamoto has quit IRC | 11:46 | |
| *** e0ne has joined #openstack-meeting | 11:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 11:49 | |
| *** jamesmcarthur has quit IRC | 11:56 | |
| *** ociuhandu has joined #openstack-meeting | 11:59 | |
| *** yamamoto has joined #openstack-meeting | 12:00 | |
| *** rcernin has joined #openstack-meeting | 12:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:09 | |
| *** ociuhandu_ has joined #openstack-meeting | 12:12 | |
| *** ociuhandu has quit IRC | 12:15 | |
| *** jamesmcarthur has quit IRC | 12:16 | |
| *** macz_ has joined #openstack-meeting | 12:20 | |
| *** macz_ has quit IRC | 12:24 | |
| *** jmasud has quit IRC | 12:24 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:30 | |
| *** jamesmcarthur has quit IRC | 12:37 | |
| *** rcernin has quit IRC | 12:43 | |
| *** ociuhandu_ has quit IRC | 12:46 | |
| *** ociuhandu has joined #openstack-meeting | 12:47 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:50 | |
| *** jamesmcarthur has quit IRC | 12:57 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:09 | |
| *** ociuhandu has quit IRC | 13:10 | |
| *** ociuhandu has joined #openstack-meeting | 13:11 | |
| *** jamesmcarthur has quit IRC | 13:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:27 | |
| *** baojg has quit IRC | 13:30 | |
| *** jamesmcarthur has quit IRC | 13:36 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:51 | |
| *** jamesmcarthur has quit IRC | 13:56 | |
| *** lbragstad has quit IRC | 13:57 | |
| *** zaneb has quit IRC | 13:58 | |
| *** ociuhandu has quit IRC | 14:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:08 | |
| *** ociuhandu has joined #openstack-meeting | 14:09 | |
| *** thgcorrea has joined #openstack-meeting | 14:10 | |
| *** jamesmcarthur has quit IRC | 14:15 | |
| *** ociuhandu has quit IRC | 14:27 | |
| *** ociuhandu has joined #openstack-meeting | 14:28 | |
| *** ociuhandu has quit IRC | 14:32 | |
| *** lbragstad has joined #openstack-meeting | 14:35 | |
| *** yasufum has joined #openstack-meeting | 14:41 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:52 | |
| *** jamesmcarthur has quit IRC | 14:57 | |
| *** bcafarel has quit IRC | 14:58 | |
| *** bcafarel has joined #openstack-meeting | 14:59 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:05 | |
| *** ociuhandu has joined #openstack-meeting | 15:06 | |
| *** jamesmcarthur has quit IRC | 15:09 | |
| *** ociuhandu has quit IRC | 15:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:18 | |
| *** ociuhandu has joined #openstack-meeting | 15:18 | |
| *** jamesmcarthur has quit IRC | 15:23 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:36 | |
| *** jamesmcarthur has quit IRC | 15:43 | |
| *** dklyle has joined #openstack-meeting | 15:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:52 | |
| *** dklyle has quit IRC | 15:53 | |
| *** david-lyle has joined #openstack-meeting | 15:53 | |
| *** jamesmcarthur has quit IRC | 15:57 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:58 | |
| *** ociuhandu_ has joined #openstack-meeting | 16:00 | |
| *** ociuhandu has quit IRC | 16:03 | |
| *** macz_ has joined #openstack-meeting | 16:12 | |
| *** jamesmcarthur has quit IRC | 16:14 | |
| *** psahoo has quit IRC | 16:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 16:29 | |
| *** jamesmcarthur has quit IRC | 16:29 | |
| *** ociuhandu_ has quit IRC | 16:30 | |
| *** jmasud has joined #openstack-meeting | 16:34 | |
| *** mlavalle has joined #openstack-meeting | 16:34 | |
| *** jamesmcarthur has joined #openstack-meeting | 16:36 | |
| *** ociuhandu has joined #openstack-meeting | 16:38 | |
| *** yasufum has quit IRC | 16:46 | |
| *** yasufum has joined #openstack-meeting | 17:03 | |
| *** ralonsoh has quit IRC | 17:31 | |
| *** ociuhandu_ has joined #openstack-meeting | 17:34 | |
| *** ociuhandu has quit IRC | 17:37 | |
| *** ociuhandu_ has quit IRC | 17:38 | |
| *** david-lyle is now known as dklyle | 17:39 | |
| *** ociuhandu has joined #openstack-meeting | 17:56 | |
| *** ociuhandu has quit IRC | 18:01 | |
| *** yasufum has quit IRC | 18:04 | |
| *** rpittau is now known as rpittau|afk | 18:08 | |
| *** jmasud has quit IRC | 18:32 | |
| *** jmasud has joined #openstack-meeting | 18:33 | |
| *** e0ne has quit IRC | 18:43 | |
| *** e0ne has joined #openstack-meeting | 18:56 | |
| *** e0ne has quit IRC | 19:35 | |
| *** rcernin has joined #openstack-meeting | 19:49 | |
| *** e0ne has joined #openstack-meeting | 20:00 | |
| *** e0ne has quit IRC | 20:00 | |
| *** ociuhandu has joined #openstack-meeting | 20:04 | |
| *** e0ne has joined #openstack-meeting | 20:16 | |
| *** rcernin has quit IRC | 20:20 | |
| *** rcernin has joined #openstack-meeting | 20:20 | |
| *** jamesmcarthur has quit IRC | 20:22 | |
| *** e0ne has quit IRC | 20:25 | |
| *** SpamapS has quit IRC | 20:52 | |
| *** jmasud has quit IRC | 20:58 | |
| *** acoles has joined #openstack-meeting | 20:59 | |
| timburke_ | #startmeeting swift | 21:00 |
|---|---|---|
| openstack | Meeting started Wed Feb 3 21:00:03 2021 UTC and is due to finish in 60 minutes. The chair is timburke_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke_ | who's here for the swift meeting? | 21:00 |
| mattoliverau | o/ | 21:00 |
| seongsoocho | o/ | 21:00 |
| kota_ | o/ | 21:00 |
| rledisez | o/ | 21:00 |
| clayg | o/ | 21:01 |
| acoles | o/ | 21:01 |
| timburke_ | as usual, the agenda's at | 21:01 |
| timburke_ | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| timburke_ | first up | 21:01 |
| timburke_ | #topic vagrant swift all in one | 21:01 |
| *** openstack changes topic to "vagrant swift all in one (Meeting topic: swift)" | 21:02 | |
| timburke_ | #link https://github.com/swiftstack/vagrant-swift-all-in-one | 21:02 |
| *** zaitcev has joined #openstack-meeting | 21:02 | |
| timburke_ | i know clayg and i have been pretty heavy users of this tooling to set up our dev environments | 21:02 |
| clayg | 🍴 IT WHILE IT'S 🔥 | 21:03 |
| timburke_ | but in the near future, it's likely to go away (as part of some long-standing cleanup necessary to get rid of the old swiftstack github account) | 21:03 |
| rledisez | me and alecuyer (and some other colleagues) used it a lot too. very useful | 21:03 |
| *** e0ne has joined #openstack-meeting | 21:04 | |
| clayg | timburke_: update as of today - there's a non-zero chance it will just end up living at github.com/nvidia/vagrant-swift-all-in-one 🤷♂️ | 21:04 |
| clayg | everyone here that uses it should still fork it now just in case | 21:04 |
| timburke_ | i do wonder if it'd be good for us to have something like it moved in-tree... | 21:05 |
| clayg | virtualbox yes, vagrant maybe, chef NO (like HELL NO) | 21:06 |
| timburke_ | could probably re-use a lot of the ansible playbooks we've already got for setting up probe tests | 21:06 |
| clayg | timburke_: SOLD | 21:06 |
| rledisez | it's so handy that i'm wondering if there is swift devs that does not use it :D | 21:06 |
| seongsoocho | I really love this tool :-) | 21:08 |
| clayg | rledisez: apparently mattoliverau has "better things" that he keeps to himself | 21:08 |
| timburke_ | it's the sort of thing i'm always a bit torn about -- it's way easier to stand up an environment, but there's definite value in having a range of setups that we each use. vsaio's definitely got some opinions baked in | 21:08 |
| mattoliverau | lol, I don't know about better :P | 21:08 |
| mattoliverau | I just have a dodgy bash script I wrote back when I needed to deploy a bunch on rackspace cloud that sets SAIO the way I want it (and am now used too). But it doesn't do all the things vsaio does. (like s3api). | 21:09 |
| timburke_ | fwiw, i remember notmyname linking https://gist.github.com/notmyname/40b8131963346676dd18817aeb5ef799 a while back if anyone wanted to go virtualbox with no vagrant ;-) | 21:09 |
| zaitcev | I always follow our in-tree manual to set up SAIO. | 21:10 |
| clayg | zaitcev: you are a hero 😍 | 21:10 |
| zaitcev | https://knowyourmeme.com/memes/no-take-only-throw | 21:11 |
| timburke_ | 🤔 i wonder if we could generate some bits of the manual based on in-tree playbooks.... | 21:11 |
| zaitcev | "IT dog, how do you automate?" "No automate" "Only type" | 21:11 |
| clayg | timburke_: the super weird thing about vsaio is the configuration - like it's opinionated, but supports *some* options (which in a few cases are like... flip this ONE config option to false 🤨) | 21:12 |
| timburke_ | py3? yes/no | 21:12 |
| clayg | right, then there's other options that are super useful - maybe when we port to in-tree ansible we can square that up to something more sensible | 21:13 |
| timburke_ | (i *still* wish i had good tooling for working with mixed py2/py3 development) | 21:13 |
| clayg | it'd be nice to have a change that requires some crazy config (servers-per-port) and you can include the saio stuff for reviewers to check it out! | 21:13 |
| *** jmasud has joined #openstack-meeting | 21:14 | |
| mattoliverau | my dodgy one is: https://github.com/matthewoliver/simple_saio but ignore the ubuntu in the readme. I'm not sure what it really supports. I mainly using centos SAIOs atm and Opensuse probably works, well it did a few months ago. | 21:15 |
| acoles | IMHO a common dev and CI ansible setup would be great | 21:15 |
| rledisez | one thing that always bothered me is that it seems there is in the code stuff that are specific so that ir works in SAIO. I'm wondering if the one server/vm is still relevant in a world where docker is everywhere. I can imagine creating a real cluster just with some docker-compose file | 21:15 |
| mattoliverau | but yeah, vsaio + ansible would be nicer. | 21:15 |
| mattoliverau | I have a some chef experience, and I didn't enjoy it :P | 21:15 |
| *** e0ne has quit IRC | 21:15 | |
| timburke_ | anyway, i guess we covered what needed to be said. namely, vsaio is a repo that (might) go away, so if you want to keep using it, it's probably a good idea to fork it sooner rather than later | 21:15 |
| clayg | rledisez: i think that's quite reasonable - the trick is porting probetests 🤔 | 21:16 |
| timburke_ | i think it was also (vaguely) what notmyname was trying to do with runway | 21:16 |
| clayg | s/might/probably/ go away - s/sooner rather than later/like right now... during this meeting/ | 21:17 |
| clayg | oh right runway!!! that one might already be gone 🤔 | 21:17 |
| timburke_ | yeah, that one's already gone | 21:17 |
| clayg | https://gitlab.com/nvidia/proxyfs-ci/runway | 21:18 |
| timburke_ | we can keep thinking about how best to do dev envs and how similar they need to be to CI vs prod vs some other crazy thing, but i think we should probably keep moving | 21:19 |
| timburke_ | #topic sharding in train | 21:19 |
| *** openstack changes topic to "sharding in train (Meeting topic: swift)" | 21:19 | |
| timburke_ | zaitcev, i haven't seen patches yet, how's it going? | 21:19 |
| zaitcev | I put together a stack of 18 patches, they pass unit tests. | 21:20 |
| zaitcev | The 19th was much too hard, so I gave up. | 21:20 |
| timburke_ | \o/ | 21:20 |
| clayg | didn't sinatra do a song about "sharding in the rain"? | 21:20 |
| zaitcev | Unfortunately, I must focus on RBAC this week. | 21:20 |
| timburke_ | no worries, and thank you for taking on the RBAC work! | 21:21 |
| timburke_ | i just wanted to check in, make sure you weren't blocked | 21:21 |
| zaitcev | So, I'm tempted to throw them into Gerrit in one big stack, just so they're not locked in my laptop. | 21:21 |
| zaitcev | After we talked about it last week, I wanted to feed them in batches of 4 or 5, to let review them easier. | 21:21 |
| timburke_ | that's fine by me. i'll try to get through them quickly once they're up | 21:21 |
| zaitcev | I replaced Change-ID at least | 21:22 |
| *** rcernin has quit IRC | 21:22 | |
| timburke_ | if possible, try to include the cherry-picked sha in the commit message; makes it a little easier for me to compare master vs stable | 21:23 |
| zaitcev | Yes, I changed old Change-Id with Cherry-Picked-From. | 21:23 |
| zaitcev | That's all | 21:23 |
| timburke_ | #topic eventlet and ssl | 21:24 |
| *** openstack changes topic to "eventlet and ssl (Meeting topic: swift)" | 21:24 | |
| timburke_ | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-January/020100.html | 21:24 |
| *** jmasud has quit IRC | 21:24 | |
| timburke_ | i was catching up on mailing list recently and saw zigo has been having trouble with eventlet and ssl in swift-proxy | 21:25 |
| zigo | timburke_: I found out that the issue is dnspython 2.0. | 21:25 |
| timburke_ | i wanted to check if anyone has a ssl-enabled-keystone handy to try to repro | 21:25 |
| *** jmasud has joined #openstack-meeting | 21:25 | |
| timburke_ | oh, curious | 21:26 |
| zigo | timburke_: The issue is swift-proxy connecting to Keystone to check credentials... | 21:26 |
| zaitcev | Ironically I don't | 21:26 |
| zaitcev | I created a different region for Keystone and set Swift to talk using that region. | 21:26 |
| zigo | So the problem is not a swift-proxy binding over SSL. | 21:26 |
| rledisez | timburke_: we do have that, swift talking to a Keystone over SSL | 21:26 |
| timburke_ | ...i guess maybe dnspython imports ssl before eventlet's monkey-patched it? | 21:26 |
| zigo | timburke_: I can't tell, but it's definitively a monkey paching issue between dnspython and eventlet. | 21:27 |
| timburke_ | i know i've seen similar recursion errors before, and it's been a matter of not monkey-patching early enough | 21:27 |
| zigo | The same issue happens when Neutron tries to tell Nova (over the Nova API) that a VM port is up. | 21:27 |
| zigo | Well, I'd prefer if there was a strong movement to get out of this madness. | 21:28 |
| zigo | Monkey patching is a terrible idea. | 21:28 |
| zigo | It has numerous times, and still bites hard... | 21:29 |
| zigo | https://github.com/eventlet/eventlet/issues/619 <--- The issue has been opened since 25th of June ... | 21:30 |
| timburke_ | https://github.com/rthalley/dnspython/blob/v2.0.0/dns/query.py#L48 i guess? i don't see an ssl import on 1.16.0 (at a quick glance, anyway) | 21:30 |
| timburke_ | yeah, monkey-patching's... not great. one more reason we ought to look at that PUT+POST(+POST) patch again... it bugs me that we're so tied to eventlet | 21:31 |
| zigo | My guess, is that we do eventlet monkey patching early, but then dnspython does monkey patching *after*, and then accessing stuff on the SSLContext object breaks hard. | 21:32 |
| zigo | (I'm not sure, just double-guessing) | 21:33 |
| timburke_ | oh -- it does its own monkey patching or something, is that it? ick | 21:33 |
| zigo | Isn't what you've just linked does? | 21:34 |
| zigo | (ie: creating an SSLSocket object...) | 21:34 |
| timburke_ | does anyone have bandwidth to try to repro/fix the issue? having a pin on a two-year-old version of dnspython doesn't seem sustainable | 21:35 |
| zigo | It's also currently completely broken in both Fedora and Debian (both have dnspython 2.0.x). | 21:35 |
| zigo | I'm trying to push to revert to 1.16.0, but I'm not sure I'll be successful. | 21:36 |
| *** jmasud has quit IRC | 21:36 | |
| clayg | timburke_: does anyone remember why we depend on dnspython? | 21:36 |
| zigo | clayg: eventlet does depend on it ... | 21:36 |
| *** ociuhandu has quit IRC | 21:36 | |
| clayg | cname_lookup | 21:37 |
| zigo | python-eventlet (master)$ cat setup.py | grep dns | 21:37 |
| zigo | 'dnspython >= 1.15.0, < 2.0.0', | 21:37 |
| timburke_ | so we *do* use it for cname_lookup, but the bigger issue seems to be that if you have it installed for the sake of something else, it'll break ssl in eventlet-ified processes | 21:38 |
| zigo | Indirectly, yes. | 21:38 |
| zigo | We use keystoneauth, which calls requests, which calls urllib3. | 21:39 |
| zigo | Urllib3 access the SSL socket SSLContext.options object, and when it does ... big crash ! | 21:39 |
| zigo | I believe the issue is because this: | 21:40 |
| zigo | https://github.com/eventlet/eventlet/blob/master/eventlet/green/ssl.py#L449 | 21:40 |
| zigo | isn't in use because of dnspython overriding the eventlet monkey patching. | 21:40 |
| zigo | I may be wrong, but so far, that's where I am... | 21:41 |
| timburke_ | all right, i'll look into it. the dnspython tip was useful, looks like i might have a repro now! | 21:41 |
| zigo | What's the intention behind this: | 21:42 |
| zigo | https://github.com/rthalley/dnspython/blob/v2.0.0/dns/query.py#L58 | 21:42 |
| zigo | ? | 21:42 |
| timburke_ | #topic orphaned shard ranges | 21:42 |
| *** openstack changes topic to "orphaned shard ranges (Meeting topic: swift)" | 21:42 | |
| zigo | Ok, thanks. | 21:42 |
| zigo | timburke_: Feel free to ping me anytime and we can discuss this later. | 21:42 |
| timburke_ | zigo, i think it's just trying to stub out enough to prevent NameErrors and the like in case ssl isn't available | 21:43 |
| * zigo will try to patch this out, just to see if it continues to work ... | 21:43 | |
| timburke_ | i know we picked up https://review.opendev.org/c/openstack/swift/+/771086 recently to prevent us from running into this orphaned-shard situation... | 21:45 |
| timburke_ | is https://review.opendev.org/c/openstack/swift/+/770529 still viable for cleaning up any orphans that may already be on disk? or should we abandon that? | 21:46 |
| mattoliverau | yup, and that stops them being created. | 21:46 |
| mattoliverau | There is work on getting the new shrink code working. | 21:46 |
| mattoliverau | acoles: has a chain starting: https://review.opendev.org/c/openstack/swift/+/771885 | 21:47 |
| timburke_ | yeah, maybe i should change the agenda item to cover shrinking generally ;-) | 21:47 |
| mattoliverau | yeah | 21:47 |
| mattoliverau | the start of the chain will allow the root to provide the final shard acceptor as it's self when collapsing. (to keep it root driven) | 21:48 |
| mattoliverau | acoles recently did an awesome job of simlifying that with a auditing state | 21:49 |
| acoles | I prefer the root driven shrink & delete approach rather than the shard self-determination in https://review.opendev.org/c/openstack/swift/+/770529 | 21:49 |
| mattoliverau | +1 | 21:49 |
| mattoliverau | later on that chain is the new compact shard-manage-shard-ranges command | 21:49 |
| mattoliverau | which reworks how shrinking works in the sharder. | 21:50 |
| acoles | in general the shrinking and overlap repair is coming along nicely, but we uncovered a couple of bugs along the way | 21:50 |
| mattoliverau | Once all these peices are done, orphan shards will be dealt with. initially manually, but its moving in the right direction for automatically too. | 21:50 |
| acoles | mattoliverau: has fixed one https://review.opendev.org/c/openstack/swift/+/773832 | 21:50 |
| acoles | I'm about to push another fix, these are both bug fixes in addition to the new feature in swift-manage-shard-ranges commands | 21:51 |
| acoles | so its been an interesting journey :) | 21:52 |
| mattoliverau | :) | 21:52 |
| timburke_ | cool! sounds like things are moving right along. blocked on anything? | 21:52 |
| acoles | timburke_: not enough hours in a day ! :) | 21:54 |
| mattoliverau | not right now, just testing, reviews, coding.. and confidence we've fixed all the bugs :P | 21:54 |
| acoles | there's the other bug fix https://review.opendev.org/c/openstack/swift/+/774002 | 21:54 |
| *** SpamapS has joined #openstack-meeting | 21:54 | |
| timburke_ | all right then | 21:54 |
| timburke_ | #topic relinker | 21:54 |
| *** openstack changes topic to "relinker (Meeting topic: swift)" | 21:55 | |
| acoles | note: these bugs would not impact *sharding*, just shrinking of shards | 21:55 |
| timburke_ | i'm still working on some relinker enhancements, and wanted to call out a couple things | 21:55 |
| timburke_ | first, my patches are (mostly) in a single chain now, so it's easier to try out all the improvements at once by checking out the end of the chain | 21:55 |
| timburke_ | second, the first couple patches in the chain make it so you can point the relinker at a config file to read most (but not quite all) of the cli flags | 21:56 |
| timburke_ | that was mostly because i realized we've got a bunch of options that should already be in you [DEFAULT] section of your object-server.conf (--swift-dir, --devices, --skip-mount-check) | 21:57 |
| timburke_ | with https://review.opendev.org/c/openstack/swift/+/772419, --user | 21:57 |
| timburke_ | i was mainly wondering if the config file seemed like as reasonable idea to everyone; i can't think of any other one-off tools we have in the swift repo that would go read a conf file... | 21:58 |
| mattoliverau | the config file is still optional tho right? you can still use cli ops if need be. | 21:59 |
| mattoliverau | So I think it makes sense to allow a config, esp when most of the options may already be set. But also it optional so wont stop how others may already be using the tool. | 21:59 |
| timburke_ | yup -- existing cli tooling should all still work | 21:59 |
| mattoliverau | great job | 22:00 |
| timburke_ | with that in mind, should i make sure that all config options get CLI args? | 22:00 |
| acoles | timburke_:+1 I think it is very reasonable | 22:00 |
| acoles | +1 was for having a conf file. not sure if you *must* expose all the options if they are beyond current cli | 22:01 |
| acoles | if the defaults are sensible | 22:02 |
| mattoliverau | I think we're at time :( | 22:02 |
| timburke_ | yeah, i was noticing that, too ;-) | 22:02 |
| timburke_ | thank you all for coming, and thank you for working on swift! | 22:02 |
| timburke_ | #endmeeting | 22:02 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:02 | |
| openstack | Meeting ended Wed Feb 3 22:02:30 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-02-03-21.00.html | 22:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-02-03-21.00.txt | 22:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-02-03-21.00.log.html | 22:02 |
| *** rcernin has joined #openstack-meeting | 22:05 | |
| *** rcernin has quit IRC | 22:06 | |
| *** rcernin has joined #openstack-meeting | 22:07 | |
| *** zaitcev has left #openstack-meeting | 22:12 | |
| *** vishalmanchanda has quit IRC | 22:30 | |
| *** slaweq has quit IRC | 22:41 | |
| *** slaweq has joined #openstack-meeting | 22:43 | |
| *** rcernin has quit IRC | 22:45 | |
| *** slaweq has quit IRC | 22:47 | |
| *** thgcorrea has quit IRC | 23:09 | |
| *** bbowen_ has quit IRC | 23:24 | |
| *** tosky has quit IRC | 23:54 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!