Wednesday, 2019-03-20

*** renich has joined #openstack-swift00:42
*** gyee has quit IRC00:57
openstackgerritMerged openstack/swift master: Clean up account-reaper a bit  https://review.openstack.org/61168601:05
openstackgerritMerged openstack/swift master: s3token: Add note about config change when upgrading from swift3  https://review.openstack.org/64115301:07
*** mikecmpbll has quit IRC01:21
*** renich has quit IRC01:48
*** renich has joined #openstack-swift01:51
*** psachin has joined #openstack-swift02:57
*** itlinux has joined #openstack-swift03:04
openstackgerritMerged openstack/swift master: Simplify empty suffix handling  https://review.openstack.org/63766203:06
openstackgerritMerged openstack/swift master: Refactor write_affinity DELETE handling  https://review.openstack.org/64152703:11
openstackgerritMerged openstack/swift master: Implemented the fix to handle the HTTP request methods other than GET.  https://review.openstack.org/56680603:13
*** tkajinam has quit IRC03:54
*** tkajinam has joined #openstack-swift03:57
notmynamekota_: around?03:58
*** psachin has quit IRC04:34
*** psachin has joined #openstack-swift04:42
*** itlinux has quit IRC04:45
*** sleterrier_ has joined #openstack-swift05:35
*** sleterrier_ has quit IRC05:38
*** _david_sohonet has quit IRC05:59
*** renich has quit IRC06:07
*** renich_ has joined #openstack-swift06:07
*** renich_ is now known as renich06:09
*** renich has quit IRC06:54
*** e0ne has joined #openstack-swift07:17
*** pcaruana has joined #openstack-swift07:21
*** e0ne has quit IRC07:27
*** rchurch has joined #openstack-swift07:40
*** e0ne has joined #openstack-swift07:42
*** ccamacho has joined #openstack-swift08:11
*** e0ne has quit IRC08:15
*** tkajinam has quit IRC08:35
*** rcernin has quit IRC08:38
*** mikecmpbll has joined #openstack-swift09:23
*** psachin has quit IRC09:48
*** psachin has joined #openstack-swift10:25
*** e0ne has joined #openstack-swift10:45
*** dlcastor has joined #openstack-swift11:12
dlcastorhello everyone; I'm trying to "empty" a disk so I can then replace it. For that, I did a swift-ring-builder on all 3 ring with set_weight id 0 on a cluster node and then I ran rebalance on all the rings. Then, I copied the ring.gz files to the other nodes. Now, on the other nodes I get Ring file /etc/swift/object.ring.gz is obsolete for all rings - any ideas?11:14
*** ccamacho has quit IRC11:24
*** ccamacho has joined #openstack-swift11:26
*** rcernin has joined #openstack-swift11:28
*** pcaruana has quit IRC11:38
*** e0ne has quit IRC12:07
*** psachin has quit IRC12:11
*** pcaruana has joined #openstack-swift12:16
*** psachin has joined #openstack-swift12:19
tdasilvadlcastor: having a difficult time understanding your description, when do you get that error? after copying rings to other nodes. From looking at swift code, the only place that you would get a similar message would be here: https://github.com/openstack/swift/blob/master/swift/cli/ringbuilder.py#L51712:23
tdasilvaso it seems that you get that message when you are actually running the ringbuilder, but you may have a older .builder file lying around (or vice-versa)12:24
dlcastorsorry for not being clear12:49
dlcastori have 3 nodes, on one node I ran:12:49
dlcastorswift-ring-builder /etc/swift/container.builder set_weight d18 0 (and then object and account)12:49
dlcastorswift-ring-builder /etc/swift/container.builder rebalance (and then object and account)12:49
dlcastorthen I copied the /etc/swift/account.ring.gz container.ring.gz object.ring.gz to the other 2 nodes12:49
dlcastornow, when I run swift-ring-builder /etc/swift/account.builder object.builder or account.builder on the 2 nodes where I copied the rings.gz I get12:50
dlcastorswift-ring-builder /etc/swift/account.builder12:50
dlcastor /etc/swift/account.builder, build version 3312:50
dlcastor1024 partitions, 3.000000 replicas, 1 regions, 1 zones, 30 devices, 0.59 balance, 0.00 dispersion12:50
dlcastorThe minimum number of hours before a partition can be reassigned is 1 (0:00:00 remaining)12:50
dlcastorThe overload factor is 0.00% (0.000000)12:50
dlcastorRing file /etc/swift/account.ring.gz is obsolete12:50
dlcastorso, you are saying that the account, object and container builder files on my other 2 nodes are older than the ones on the node I ran the set-weight and rebalance? then, how can I update those?12:51
tdasilvadlcastor: so yeah, i think i understand the confusion. you should only run swift-ring-builder in one machine, that's typically where you would do all your ring changes. It doesn't have to be a node in the cluster, could just be your host machine. Once you are doing the rebalance then you need to copy the ring.gz file to the cluster nodes13:12
tdasilvadlcastor: but make sure you backup your .builder files, you never want to lose them. One way people typically backup .builder files is by copying them together with the .ring.gz files to the cluster nodes. In that case, you just have to make sure that you are always copying all 6 files (in case only one storage policy) 3 .builder and 3 .ring.gz13:15
*** rcernin has quit IRC13:16
*** e0ne has joined #openstack-swift13:16
*** ccamacho has quit IRC13:23
*** ccamacho has joined #openstack-swift13:23
*** ccamacho has quit IRC13:28
*** ccamacho has joined #openstack-swift13:28
*** psachin has quit IRC13:30
dlcastortdasilva: so the 6 files are required _only_ when you are operating on the cluster and it's best practice to have them backed up on all the nodes with the latest version; did I get that right?14:00
tdasilvadlcastor: you make changes to the rings using .builder files (i don't think *.ring.gz files are even required to be present). *.ring.gz are just static output, can't make changes to them. The cluster only needs the *.ring.gz to properly function (i.e., .builder are not required on cluster nodes). You can backup .builder files anyway you would like, one practice is to copy them while also copying .ring.gz files to14:04
tdasilvacluster nodes14:04
tdasilvadlcastor: i really just wanted to clarify that you run swift-ring-builder on just one node, not on every cluster node...14:06
tdasilvadlcastor: https://docs.openstack.org/swift/latest/admin_guide.html#managing-the-rings14:07
dlcastorI run the swift-ring-builder with set-weight and rebalance _only_ on one node14:18
dlcastoron the others, I ran it without doing anything, like just swift-ring-builder builder_file14:19
*** itlinux has joined #openstack-swift14:39
tdasilvadlcastor: ah, understood, you were trying to just see the output. so yeah, in that case it's just because you had an older .builder file on that node...14:40
dlcastortdasilva: thanks a lot for your help and explanations ;-)14:40
tdasilvayw, good luck14:41
openstackgerritAlexandre Lécuyer proposed openstack/swift feature/losf: WIP - start working on ansible playbooks for LOSF  https://review.openstack.org/64487914:45
*** mvkr has quit IRC15:30
*** renich has joined #openstack-swift15:32
*** renich has quit IRC15:48
*** gyee has joined #openstack-swift15:51
*** itlinux has quit IRC16:00
openstackgerritClay Gerrard proposed openstack/swift master: Fix how we UTF-8-ify func tests  https://review.openstack.org/64185516:00
*** mvkr has joined #openstack-swift16:07
*** itlinux has joined #openstack-swift16:09
*** itlinux has quit IRC16:14
*** itlinux has joined #openstack-swift16:17
*** renich has joined #openstack-swift16:21
*** itlinux has quit IRC16:27
*** itlinux has joined #openstack-swift16:29
*** itlinux has quit IRC16:37
*** altlogbot_2 has joined #openstack-swift16:40
*** altlogbot_2 has quit IRC16:41
*** itlinux has joined #openstack-swift16:43
*** itlinux has quit IRC16:50
notmynameI've got a customer meeting to be at this afternoon, so timburke will be leading today's meeting17:07
*** e0ne has quit IRC17:07
*** altlogbot_1 has joined #openstack-swift17:27
*** renich has quit IRC17:28
*** altlogbot_1 has quit IRC17:28
*** renich_ has joined #openstack-swift17:29
*** altlogbot_0 has joined #openstack-swift17:30
clayg@timburke if you wanna see p 633671 move forward can we at least confirm lp bug #1813725 if not set a priority?17:31
openstackLaunchpad bug 1813725 in OpenStack Object Storage (swift) "Object encryption key truncated sometimes when used with Barbican" [Undecided,New] https://launchpad.net/bugs/181372517:31
patchbothttps://review.openstack.org/#/c/633671/ - swift - Fix decryption for broken objects - 8 patch sets17:31
*** mvkr has quit IRC17:31
*** ccamacho has quit IRC17:36
*** mikecmpbll has quit IRC17:59
*** renich_ has quit IRC18:14
*** renich_ has joined #openstack-swift18:17
*** e0ne has joined #openstack-swift18:17
*** irclogbot_2 has quit IRC18:21
*** irclogbot_3 has joined #openstack-swift18:24
*** irclogbot_3 has quit IRC18:27
*** irclogbot_0 has joined #openstack-swift18:29
*** clayg has quit IRC18:30
openstackgerritMerged openstack/swift master: Fix how we UTF-8-ify func tests  https://review.openstack.org/64185518:30
*** clayg has joined #openstack-swift18:33
*** ChanServ sets mode: +v clayg18:33
*** mikecmpbll has joined #openstack-swift18:35
kota_hello18:43
kota_timburke: I might not be available today's meeting because of business meeting.18:44
*** e0ne has quit IRC18:53
*** zaitcev_ is now known as zaitcev18:56
zaitcevThat Michele Valsecchi is pretty good, as it turns out. Although her initial contribution was to fix typo. I'm wondering if we could entice her to do more.18:57
*** altlogbot_0 has quit IRC19:00
*** altlogbot_1 has joined #openstack-swift19:02
*** dlcastor has quit IRC19:04
*** altlogbot_1 has quit IRC19:06
*** altlogbot_0 has joined #openstack-swift19:08
*** irclogbot_0 has quit IRC19:16
*** irclogbot_2 has joined #openstack-swift19:18
openstackgerritPete Zaitcev proposed openstack/swift master: Rename ContainerBroker.path to cpath  https://review.openstack.org/63567719:19
*** irclogbot_2 has quit IRC19:30
*** irclogbot_1 has joined #openstack-swift19:32
*** altlogbot_0 has quit IRC19:34
*** altlogbot_2 has joined #openstack-swift19:36
claygtimburke: why did we think that hardlinks should make listings have a hardlink_size key (instead of just overwriting "bytes")?19:41
claygtimburke: I don't feel like there's really a "loss of information" by replacing the 0 with something more interesting...19:41
claygwe decided for content-type we can just let the symlink have the content-type of the target object resp19:42
claygi know in versioned writes we were going to fix the etag - so if we do go with symlink_bytes we can fix it there too, but it seems maybe useful to just do it for all hardlinks?19:44
timburkeclayg, double-counting bytes in the container stats20:45
*** irclogbot_1 has quit IRC20:45
*** mikecmpbll has quit IRC20:46
claygno, i just mean in the *listings* like SLO does - in the row bytes i'd still have zero - i'm talking like what SLO does20:47
*** mikecmpbll has joined #openstack-swift20:47
*** irclogbot_3 has joined #openstack-swift20:47
claygwe add the new symlink_etag key (using the symlink_target_etag value from the etag column), for some reason I wrote down symlink_size key too - but I think really I can just overwrite bytes?20:47
clayg... but that's what I'm double-checking ... either way there's no double counting (that I'm aware of!)20:48
timburke...'cause i hate the way SLO does it? *shrug*20:48
claygorly?  the only thing I remember hating about SLO is that it uses content-type20:48
claygwell I guess a SLO manifest *does* have a valid (useful?) value in bytes already - so that one IS lossy20:49
timburkethat's the big reason i hate it. the other part is that the cotnainer-server needs to know about it, and do the translation there (so m/w never even get a chance to second-guess it)20:49
timburkemaybe since symlinks are by definition zero-bytes *in actuality*, it's fine? idk20:50
*** e0ne has joined #openstack-swift20:52
*** altlogbot_2 has quit IRC20:53
claygwell, doing it in the container server is just silly 🤣20:54
*** altlogbot_2 has joined #openstack-swift20:55
timburkeso why *not* do it the better way? establish precedent that was actually like, and hope that some day we get data migrations to fix up on-disk SLOs?20:57
claygok, well it turns out it's pretty easy to flip that around either way20:57
timburkemeeting ping clayg tdasilva zaitcev cschwede alecuyer rledisez kota_ mattoliverau20:58
claygtimburke: sure, we can return symlink_bytes & bytes - i'm glad I ran it by you!20:58
timburke(notmyname's in a meeting, so i'll chair)20:58
mattoliveraumorning, I was just in a OUI meeting re:denver. done now20:59
notmynameoh hi21:31
timburkeoh, right! i should create an etherpad for topics for Denver for next week...21:33
*** itlinux has joined #openstack-swift21:39
*** mikecmpbll has quit IRC21:59
zaitcevWhat?! Denver is still a month away, ISN'T IT22:00
zaitcevhttps://www.linkedin.com/jobs/view/1073741562/22:00
*** e0ne has quit IRC22:00
zaitcev(nowhere in the ad is mentioned if RAX is going to terminate the whole project in a few months as they did with Hummingbird)22:01
timburkehey, better to start collecting ideas early!22:01
notmynamezaitcev: yeah, I wouldn't recommend that anyone actively purse jobs at rackspace at this point. at least based on all their recent layoffs22:08
*** pcaruana has quit IRC22:11
*** mvkr has joined #openstack-swift22:16
*** rcernin has joined #openstack-swift22:57
*** rcernin has quit IRC22:58
*** rcernin has joined #openstack-swift22:58
timburkenotmyname just reminded me how https://review.openstack.org/#/c/629659/ might be a good thing to get...22:59
patchbotpatch 629659 - swift - slo_manifest_hook follow-up - 2 patch sets22:59
*** itlinux has quit IRC22:59
notmynameI'M NOT LOOKING FOR MORE PATCHES TO LAND, TIM22:59
*** itlinux has joined #openstack-swift23:00
*** itlinux has quit IRC23:08
*** itlinux has joined #openstack-swift23:09
*** renich has joined #openstack-swift23:16
*** renich_ has quit IRC23:18
openstackgerritMerged openstack/swift master: Verify client input for v4 signatures  https://review.openstack.org/62930123:52
openstackgerritMerged openstack/swift master: Clean up how we walk through ranges in ECAppIter  https://review.openstack.org/63801923:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!