Tuesday, 2019-10-29

*** ccamel has joined #openstack-swift00:02
*** camelCaser has quit IRC00:04
*** diablo_rojo has joined #openstack-swift00:15
*** ccamacho has quit IRC00:51
*** nanzha has joined #openstack-swift01:22
*** tomha has joined #openstack-swift01:49
*** tomha has quit IRC01:54
*** Guest14611 has quit IRC03:50
*** benj has joined #openstack-swift03:51
*** benj is now known as Guest8534503:51
*** diablo_rojo has quit IRC06:11
*** diablo_rojo has joined #openstack-swift06:26
*** tkajinam has quit IRC06:50
*** tkajinam has joined #openstack-swift06:51
*** diablo_rojo has quit IRC07:03
*** nanzha has quit IRC07:04
*** nanzha has joined #openstack-swift07:08
*** rcernin has quit IRC07:28
*** ccamacho has joined #openstack-swift07:33
*** pcaruana has joined #openstack-swift07:37
*** tesseract has joined #openstack-swift07:49
*** tkajinam has quit IRC07:54
openstackgerritThiago da Silva proposed openstack/swift master: Enable s3api and staticweb tests across all func tests  https://review.opendev.org/69174708:25
*** rdejoux has joined #openstack-swift08:33
*** mikecmpbll has joined #openstack-swift08:48
openstackgerritGilles Biannic proposed openstack/swift master: Stop retrying every deletes in container-sync  https://review.opendev.org/69172908:50
*** rpittau|afk is now known as rpittau09:08
*** tkajinam has joined #openstack-swift09:15
*** tkajinam has quit IRC09:16
*** pcaruana has quit IRC10:03
*** pcaruana has joined #openstack-swift10:24
*** ianychoi__ is now known as ianychoi11:24
openstackgerritThiago da Silva proposed openstack/swift master: Enable s3api and staticweb tests across all func tests  https://review.opendev.org/69174712:38
*** pcaruana has quit IRC12:45
*** pcaruana has joined #openstack-swift12:58
openstackgerritThiago da Silva proposed openstack/swift master: WIP: Allow internal clients to use reserved namespace  https://review.opendev.org/68213813:18
claygtdasilva: that test should probably patch policies 😬13:36
tdasilvaoh, good point, let me fix it up13:37
openstackgerritThiago da Silva proposed openstack/swift master: WIP: Allow internal clients to use reserved namespace  https://review.opendev.org/68213813:44
tdasilvaclayg: ^^^ let me know if you were thinking something different13:44
*** pcaruana has quit IRC13:52
*** pcaruana has joined #openstack-swift13:55
claygno, that looks perfect!14:02
clayg😍14:02
*** diablo_rojo has joined #openstack-swift14:02
*** renich_ has joined #openstack-swift14:09
*** renich has quit IRC14:09
*** gyee has joined #openstack-swift14:57
openstackgerritClay Gerrard proposed openstack/python-swiftclient master: WIP: object versioning features  https://review.opendev.org/69187714:59
clayg^ I'm acctually still figuring out the API - so it'd be great to have some help with this fella15:00
claygtdasilva: do you have an etherpad going on object versioning?15:09
tdasilvaclayg: https://etherpad.openstack.org/p/swift-object-versioning15:10
tdasilvaclayg: the proposed api has probably changed a bit since I first wrote it, so i need to update it15:18
claygno worries, if I spot something that seems off I'll just update - thanks15:18
*** renich has joined #openstack-swift15:40
*** renich_ has quit IRC15:41
*** renich has quit IRC15:49
*** nanzha has quit IRC15:58
*** nanzha has joined #openstack-swift15:59
*** nanzha has quit IRC16:31
*** tesseract has quit IRC16:38
*** nanzha has joined #openstack-swift16:59
*** nanzha has quit IRC17:05
*** rpittau is now known as rpittau|afk17:25
*** gmann is now known as gmann_afk17:29
*** gmann_afk is now known as gmann17:35
timburke\o/ there's gonna be a cschwede! https://etherpad.openstack.org/p/swift-ptg-shanghai17:39
*** rdejoux has quit IRC17:42
*** mikecmpbll has quit IRC17:47
clayg🙌18:19
binwiederhiertimburke: You said a while ago that people have thought about getting rid of the 3-syncs-per-PUT, and I have been thinking about the same thing. With 3 replicas in 3 different failure domains (potentially even physical locations), the chances of losing all writes is pretty slim, don't you agree? Have you thought about making the sync calls optional or otherwise configurable?18:48
zaitcevYou can't decide which one to sync before you know which one succeeded. So, I suppose, the best we can do is to mandate a form of PUT+POST even for the replicated policies. Then, proxy first lays down non-durable copies, then issues POSTs until a quorum is accomplished.18:52
binwiederhierI think you are talking about still ensuring durable writes, while I'm talking about accepting the risk of 3 failures and just straight up not syncing (i.e. let xfs do the sync)18:55
DHEeven if one machine is up in smoke between OK'ing the object and its death because sync writes were disabled, you still have 2 other copies that are far enough away that any failure would be contained18:56
DHEwhile I like the idea conceptually, I think I would want to make it a per-storage-policy option which is... uhh...18:56
binwiederhierYeah I was thinking of a object-node wide setting `sync_behavior = nosync|always|every-now-and-then`, but per storage policy is probably even better18:57
zaitcevMeh, that's shallow thinking. What you really need are John Corbin's RAM arrays. There's no way to lose power on 3 continents simultaneously, right?18:59
DHEI have plans that involve some storage policies spanning multiple locations, but also some that are going to be in a much smaller footprint. hence my preference that it be a storage policy option.19:02
*** Guest85345 is now known as benj_19:08
binwiederhierWhy does it have to be this hard though?19:08
binwiederhierMaybe I'm not quite following when you say "spanning multiple locations"; how is that related to the sync behavior?19:09
DHE<binwiederhier> timburke: You said a while ago that people have thought about getting rid of the 3-syncs-per-PUT, and I have been thinking about the same thing. With 3 replicas in 3 different failure domains (potentially even physical locations)   # this bit here at the end19:09
binwiederhierok I see, so you'd like to make the sync behavior dependend on the failure domains.19:10
binwiederhierInteresting.19:11
DHEthere's some situations where the failure domains are sufficiently apart that it would be worth doing, but other storage policies not so much...19:11
binwiederhierIt would be significantly easier to leave that up to the administrator though; leave the default at `sync = always`, but give the option to change the behavior19:12
DHEyes, but put the option inside the storage policy section rather than making it global. that's my suggestion19:13
binwiederhier:+1:19:14
binwiederhierShip it.19:14
claygzaitcev: I have to assume on p 691729 the assumption is that 409 typically means the remote side has a newer timestamp19:25
patchbothttps://review.opendev.org/#/c/691729/ - swift - Stop retrying every deletes in container-sync - 2 patch sets19:25
zaitcevSo, fortunately we're unable to delete it because someone else wrote it, right?19:26
zaitcevMeaning, our deletion listing is out of date. Okay.19:26
gmanntimburke: clayg : sent the requirement of swift on py2 on ML - http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010430.html19:54
gmannfeel free to explain or add more if needed19:54
clayg🤗19:55
openstackgerritTim Burke proposed openstack/swift master: exclude utf8 tests under py3  https://review.opendev.org/68922520:12
*** renich has joined #openstack-swift20:27
*** renich has quit IRC20:35
*** renich has joined #openstack-swift21:12
*** pcaruana has quit IRC21:15
openstackgerritThiago da Silva proposed openstack/swift master: WIP: New Object Versioning mode  https://review.opendev.org/68238221:27
openstackgerritThiago da Silva proposed openstack/swift master: Enable s3api and staticweb tests across all func tests  https://review.opendev.org/69174721:43
*** renich has quit IRC21:59
*** rcernin has joined #openstack-swift22:02
*** gyee has quit IRC22:27
*** gyee has joined #openstack-swift22:52
*** tkajinam has joined #openstack-swift23:08
*** diablo_rojo has quit IRC23:10
*** diablo_rojo has joined #openstack-swift23:11
*** tkajinam has quit IRC23:48
*** gyee has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!