Monday, 2020-05-04

*** gregwork has quit IRC01:33
*** mahatic has joined #openstack-swift02:50
*** ChanServ sets mode: +v mahatic02:50
*** psachin has joined #openstack-swift03:33
*** evrardjp has quit IRC04:35
*** evrardjp has joined #openstack-swift04:36
*** rpittau|afk is now known as rpittau06:33
openstackgerritAndreas Jaeger proposed openstack/swift master: Switch to new grenade job name  https://review.opendev.org/72519006:41
*** ccamacho has joined #openstack-swift07:23
*** mikecmpbll has joined #openstack-swift07:54
*** dtantsur|afk is now known as dtantsur08:43
*** rpittau is now known as rpittau|bbl10:14
openstackgerritSean McGinnis proposed openstack/swift master: Use local py2 upper-constraints  https://review.opendev.org/72442212:04
*** rpittau|bbl is now known as rpittau12:22
*** mikecmpbll has quit IRC12:49
*** mikecmpbll has joined #openstack-swift12:53
*** psachin has quit IRC13:14
seongsoochoHi ~ I have a question about how the object-replicator works.  (only for update process) The replicator compare the suffix directory's hash value of partition between local and remote then run rsync if different.   So.. How to know which node has newest data?  Does rsync send a file only newest ?13:35
DHEas i understand it (mere user here) each object is named with its creation timestamp to the microsecond. so if there are duplicates then rsync will give BOTH objects to the node and it can sort it out. the receiver needs to do a pass over the received data anyway14:04
seongsoochoDHE:  Thanks.  I modified a file in one node, the replicator restored it. So.. I was confused about how rsync and replicator know the correct file.14:10
DHEthere's an auditor that md5'd the file, found it corrupted, and removed it for replication to fix14:15
DHEalthough...14:15
DHEyeah, --ignore-existing is one of the args, so one machine won't overwrite an existing file on another machine, so if one is corrupted it won't push a corrupted update14:19
seongsoochoDHE:  oh i see...   Actually, the weird things happen to my cluster.14:24
seongsoochoThe object replicator try to replicate empty suffix variable.. so the rsync method return false and replicate job record as a failure..14:25
openstackgerritChris MacNaughton (icey) proposed openstack/swift master: Monkey patch original current_thread _active  https://review.opendev.org/72528814:31
*** gyee has joined #openstack-swift15:25
*** rpittau is now known as rpittau|afk16:08
openstackgerritMerged openstack/swift master: Use separate name for HeaderKeyDict var vs list of response headers  https://review.opendev.org/72373616:26
*** evrardjp has quit IRC16:35
*** evrardjp has joined #openstack-swift16:36
*** dtantsur is now known as dtantsur|afk16:57
*** hoonetorg has quit IRC17:23
seongsoochoclayg:  HI,  I read your commit about 3 years ago. ( https://github.com/openstack/swift/commit/aa71d7e77b266a4111b3b61ed41a204a28ec24e8 ) .  After reading the commit message, it seems that I need to delete all hashes.pkl to upgrade from earlier rocky to latest. Is it correct ??17:52
openstackgerritTim Burke proposed openstack/swift master: probe tests: Work when fronted by a TLS terminator  https://review.opendev.org/70557917:54
*** Jeffrey4l has quit IRC18:23
*** Jeffrey4l has joined #openstack-swift18:31
*** hugokuo has joined #openstack-swift18:32
*** timburke has joined #openstack-swift18:32
*** ChanServ sets mode: +v timburke18:32
*** Jeffrey4l has quit IRC18:36
*** Jeffrey4l has joined #openstack-swift18:43
timburkeseongsoocho, my memory of that patch was just that you might need to delete hashes.pkl if you upgraded *and then attempted to roll back* -- upgrades were fine, i think, it was just that the old code would fail in some bad way if it saw the new format18:47
seongsoochotimburke:  aha. thanks.  Because .. After I upgrade from ocata to train, some partition's hashes.pkl is missmatch with other node.. So I try to find the reason.. ( with crying )18:50
seongsoochoIs it safe(?) to remove hashes.pkl in production...?18:51
*** hoonetorg has joined #openstack-swift19:00
timburkeyeah -- it'll cause a little extra IO, but should recover pretty quickly19:01
seongsoochogreat... try to delete a hashes.pkl .... 🙂19:03
seongsoochoalways thank you !19:03
timburkehappy to help :-)19:03
*** threestrands has joined #openstack-swift20:34
*** ccamacho has quit IRC21:39
*** rcernin has joined #openstack-swift22:22
zaitcevGate cannot even verify a change to docs.22:31
mattoliveraumorning23:15
openstackgerritTim Burke proposed openstack/swift master: WIP: Batched updates for object-updater  https://review.opendev.org/72494323:16
openstackgerritTim Burke proposed openstack/swift master: Add a tool to peek inside async_pendings  https://review.opendev.org/72542923:16
mattoliverautimburke: I assume you've seen it, but there is an email re last call for project to signup for virtual PTG, and I don't see Swift on this list.23:16
timburkeyeah, i *do* need to do that... uhg. i feel like i have no time or mental bandwidth for this :-(23:17
openstackgerritMerged openstack/swift stable/ussuri: Use separate name for HeaderKeyDict var vs list of response headers  https://review.opendev.org/72439523:25
openstackgerritTim Burke proposed openstack/swift master: object-updater: Include update path when logging errors  https://review.opendev.org/72543223:34
mattoliverautimburke: need help? I guess we can talk about times during the next meeting. Want me to go see what we need to do to signup? And if it doesn't require giving all sessions and times make it happen (if I am able to).23:36
timburkemattoliverau, that'd be great, thanks! 🤗23:46

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!