Wednesday, 2021-03-03

*** Underknowledge has quit IRC01:08
*** Underknowledge has joined #openstack-swift01:09
*** gyee has quit IRC01:17
*** Underknowledge2 has joined #openstack-swift01:51
*** Underknowledge has quit IRC01:54
*** Underknowledge2 is now known as Underknowledge01:54
*** rcernin has quit IRC02:00
*** rcernin has joined #openstack-swift02:29
*** rcernin has quit IRC02:29
*** aluria has quit IRC02:29
*** rcernin has joined #openstack-swift02:30
*** aluria has joined #openstack-swift02:33
*** fingo has quit IRC02:34
*** Underknowledge has quit IRC02:38
*** fingo has joined #openstack-swift02:44
*** rcernin has quit IRC02:44
*** rcernin has joined #openstack-swift03:16
*** dasp has quit IRC03:34
*** dasp has joined #openstack-swift03:45
*** psachin has joined #openstack-swift03:51
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-swift05:33
openstackgerritMatthew Oliver proposed openstack/swift master: Add a config file option to swift-manage-shard-ranges  https://review.opendev.org/c/openstack/swift/+/77458405:35
*** m75abrams has joined #openstack-swift05:35
*** rcernin has quit IRC07:44
*** rpittau|afk is now known as rpittau07:52
*** Underknowledge has joined #openstack-swift09:11
openstackgerritAlistair Coles proposed openstack/swift master: Add a config file option to swift-manage-shard-ranges  https://review.opendev.org/c/openstack/swift/+/77458410:47
acolesmattoliverau: fixed py3 error that was squashed in with my test fixups ^^10:48
openstackgerritMerged openstack/python-swiftclient stable/ussuri: Add release note for 3.9.1  https://review.opendev.org/c/openstack/python-swiftclient/+/76955110:55
*** dsariel has joined #openstack-swift11:51
*** psachin has quit IRC13:01
*** jv_ has quit IRC13:55
*** jv_ has joined #openstack-swift14:00
*** takamatsu has joined #openstack-swift14:17
*** jv_ has quit IRC14:33
*** jv_ has joined #openstack-swift14:34
openstackgerritAlistair Coles proposed openstack/swift master: Fix race in diskfile.relink_paths  https://review.opendev.org/c/openstack/swift/+/77847414:40
*** jv_ has quit IRC14:59
*** jv_ has joined #openstack-swift15:07
*** takamatsu has quit IRC16:11
*** m75abrams has quit IRC16:48
*** jv_ has quit IRC17:01
*** hoonetorg has quit IRC17:01
*** stand has quit IRC17:01
*** klamath_atx has quit IRC17:01
*** lifeless_ has quit IRC17:01
*** mahatic has quit IRC17:01
*** timss has quit IRC17:01
*** openstackgerrit has quit IRC17:02
*** stand has joined #openstack-swift17:05
*** jv_ has joined #openstack-swift17:07
*** hoonetorg has joined #openstack-swift17:07
*** mahatic has joined #openstack-swift17:07
*** klamath_atx has joined #openstack-swift17:07
*** lifeless_ has joined #openstack-swift17:07
*** timss has joined #openstack-swift17:07
*** tepper.freenode.net sets mode: +v mahatic17:07
*** fingo has quit IRC18:10
*** fingo has joined #openstack-swift18:10
*** rpittau is now known as rpittau|afk18:11
acolesgerrit announcements seems to be broken18:37
acolesmattoliverau: timburke__ clayg pls note https://review.opendev.org/c/openstack/swift/+/778530 Fix os.stat/os.link race in diskfile.relink_paths [NEW]18:37
acolesand https://review.opendev.org/c/openstack/swift/+/778540 Add unit test for diskfile.relink_paths [NEW]18:38
*** fingo has quit IRC18:44
*** fingo has joined #openstack-swift18:46
*** fingo has quit IRC18:46
*** fingo has joined #openstack-swift18:47
DHElooking at the API doc, ?multipart-manifest=delete will delete the segment files when deleting the large object, but only for SLO types? looking at https://docs.openstack.org/api-ref/object-store/index.html19:21
timburke__DHE, yes, that's correct. if it's not an SLO, that same request will 40019:28
*** fingo has quit IRC19:38
*** fingo has joined #openstack-swift19:39
*** lifeless_ is now known as lifeless19:56
*** klamath_atx has quit IRC20:05
*** klamath_atx has joined #openstack-swift20:07
*** rcernin has joined #openstack-swift20:46
timburke__almost meeting time20:53
mattoliveraumorning20:55
seongsoochomorning !!20:55
kota_morning all20:58
*** openstackgerrit has joined #openstack-swift20:59
openstackgerritAlistair Coles proposed openstack/swift master: WIP: relinker: only invalidate hash when link is created  https://review.opendev.org/c/openstack/swift/+/77857920:59
*** gyee has joined #openstack-swift21:01
*** rcernin has quit IRC21:17
*** irclogbot_2 has quit IRC21:33
*** tristanC has quit IRC21:33
*** irclogbot_2 has joined #openstack-swift21:34
*** tristanC has joined #openstack-swift21:34
seongsoochoIs there fast(???) way to count diskfiles on disk?21:47
DHEmost filesystems offer an inode count with `df -i` which is not the same thing, but may be useful in making an estimate21:50
seongsoochoand I rechecked the relinker log file, there are almost 100 millions diskfiles are relinked on one node.21:52
seongsoochoIn my mornitoring dashboard, It took approximately 2 days to complete relink job per disk....21:55
*** rcernin has joined #openstack-swift22:05
*** rcernin has quit IRC22:11
*** timburke_ has joined #openstack-swift22:11
*** ChanServ sets mode: +v timburke_22:11
*** rcernin has joined #openstack-swift22:11
*** timburke__ has quit IRC22:13
seongsoochoDHE:  Thanks.  `df -i` says, there are 20,000,000 inode are used. so.. there are almost 10,000,000 disk files in disk before the relink job.22:15
seongsoochohttps://usercontent.irccloud-cdn.com/file/Z1kgKEkM/image.png22:15
DHEsounds about right22:18
DHEI'd say less than half would be the right estimate22:19
DHE20 million inodes would probably be in the 9.5 to 10 million objects range22:19
timburke_that would about line up with OVH's findings when looking at the lots-of-small-files work22:32
DHEI'm just estimating since each object would be in its own private directory (give or take replication shenanigans),  so double. And of course there's more than that for hash prefixes/suffixes, so more than double22:35
DHEwell, in the other direction, so less than half22:36
*** rcernin has quit IRC22:56
*** rcernin has joined #openstack-swift23:01
*** timburke__ has joined #openstack-swift23:01
*** ChanServ sets mode: +v timburke__23:01
*** timburke_ has quit IRC23:04
*** rcernin has quit IRC23:26

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!