Thursday, 2020-11-19

*** mvalsecc has joined #openstack-swift00:09
*** gyee has quit IRC01:38
*** rcernin has quit IRC02:22
*** rcernin has joined #openstack-swift02:26
*** ianychoi has joined #openstack-swift04:36
*** m75abrams has joined #openstack-swift04:52
openstackgerritPete Zaitcev proposed openstack/swift master: proxy: stop sending frags to PyECLib with a Queue  https://review.opendev.org/70489204:53
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-swift05:33
*** m75abrams has quit IRC07:03
*** m75abrams has joined #openstack-swift07:04
*** rpittau|afk is now known as rpittau08:03
*** baojg has quit IRC08:34
*** baojg has joined #openstack-swift08:35
*** baojg has quit IRC08:35
*** rcernin has quit IRC08:37
*** baojg has joined #openstack-swift08:42
*** mvalsecc has quit IRC09:12
openstackgerritAlistair Coles proposed openstack/swift master: ssync: don't log tracebacks for client disconnects  https://review.opendev.org/76320510:14
*** baojg has quit IRC11:04
*** baojg has joined #openstack-swift11:05
*** dsariel has joined #openstack-swift11:25
*** tkajinam has quit IRC11:29
*** tkajinam has joined #openstack-swift11:30
*** baojg has quit IRC11:40
*** baojg has joined #openstack-swift11:41
*** baojg has quit IRC11:55
*** baojg has joined #openstack-swift11:56
*** camelCaser has quit IRC12:15
*** rpittau is now known as rpittau|brb13:16
*** baojg has quit IRC14:36
*** baojg has joined #openstack-swift14:37
*** rpittau|brb is now known as rpittau14:51
*** m75abrams has quit IRC15:53
acolesclayg: thanks for review of caching shard ranges, FYI I have squashed your test changes in16:15
*** evrardjp has quit IRC16:17
openstackgerritClay Gerrard proposed openstack/swift master: Enforce response length harder  https://review.opendev.org/76340516:20
clayg@acoles THANK YOU!  my test "changes" were entirely mechanical - i genuinely found it helpful to break things up during my review when I was "zooming in" on a specific behaviors - I hope it didn't come across as entirely cosmetic nonsense busy work (it certainly WAS nit-picky!)16:25
acolesnah I had it in mind to refactor them so you just helped me along16:26
acolessorry you had to grok the loooong version16:26
claygyay i was helpful for a change!!! 🤪16:30
*** gyee has joined #openstack-swift16:34
*** gyee has quit IRC16:50
*** rpittau is now known as rpittau|afk16:52
*** gyee has joined #openstack-swift17:05
acoleslol17:11
*** klamath_atx has joined #openstack-swift17:20
klamath_atxGood day, I was wondering when container sharder will be production ready.  I noticed in the config examples it is listed as experimental however we have been using it with swiftstack for a while without issue.18:03
*** dsariel has quit IRC18:05
*** dsariel has joined #openstack-swift18:06
timburkeklamath_atx, i think we'd probably feel comfortable removing that "experimental" tag once we've got a better handle on how to fix it when it goes off the rails (specifically, when there are overlapping shard ranges)18:06
timburkei'd say it's in a state like EC was for a while after it was released: it's certainly "production ready" in the sense that people are running it in production (you, me, a bunch of other former-swiftstack customers)18:08
timburkethere's just a lot of rough edges out there that operators ought to be aware of if they're going to be using it18:09
*** dsariel has quit IRC18:10
timburkespecifically: 1. fixing overlapping shard ranges (there's been a decent bit of work around this recently; it's kind of a big deal since sharding basically locks up for a container when it happens)18:11
timburke2. we need a way to manually mark shards as shrinking, similar to what operators can do today to split up a large DB (there's some hope that this will fall out of the work for 1)18:12
timburke3. we need a robust way to shard that won't lead to overlapping ranges (or, alternatively, we need to find a way to get the fix for 1 baked into the sharder process instead of requiring manual intervention)18:14
timburkethere are a handful of other improvements that would be nice to have (things like caching shard ranges in more places; see p 761659), but those are the items i'd look for before removing the "experimental" tag18:16
patchbothttps://review.opendev.org/#/c/761659/ - swift - WIP - Use cached shard ranges for container GETs - 4 patch sets18:16
claygwait, is gerrit down or slow for anyone else?18:18
claygtimburke: I think if you're manually picking your replicas to run `swift-manage-shard-ranges` overlaps aren't as much of a problem - the reason *we* got overlaps was a bug in the controller's auto-sharding (which has since been fixed)18:19
claygthere's really nothing "experimental" about sharding - the problem is *auto* sharding - and the lack of shrinking18:20
claygpeople suffering with big containers deserve to have - at least - the same confidence we have in `swift-manage-shard-ranges` to split up their worst offenders and move on with live18:20
timburkeclayg, yeah, but human processes can have bugs, too. we *know* you can get into trouble, and we don't have a good way to fix it (yet; like i said, we're definitely working on it ;-)18:21
clayg50+ GB databases SUCK18:21
klamath_atxthank you @timburke, gave me some info to digest.18:26
*** rcernin has joined #openstack-swift20:33
*** rcernin has quit IRC20:37
*** rcernin has joined #openstack-swift21:02
openstackgerritClay Gerrard proposed openstack/swift master: Enforce response length harder  https://review.opendev.org/76340521:10
openstackgerritTim Burke proposed openstack/python-swiftclient master: Allow tempurl times to have units  https://review.opendev.org/75850021:28
*** jv has quit IRC21:33
*** jv has joined #openstack-swift21:44
*** dsariel has joined #openstack-swift21:58
*** dsariel has quit IRC22:03
*** baojg has quit IRC22:56
*** baojg has joined #openstack-swift22:57
*** baojg has quit IRC23:20
*** baojg has joined #openstack-swift23:21
*** rcernin has quit IRC23:35
*** rcernin has joined #openstack-swift23:35
*** baojg has quit IRC23:42
*** baojg has joined #openstack-swift23:42

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!