Saturday, 2019-01-26

DHEtimburke: I'm not sure that's going to work. basically I'm looking to store data in such a way that an extra column in the 'objects' table of the container DB would be the dream implementation for me... running HEAD on tens/hundreds of millions of objects isn't exactly living the dream...00:04
timburkeDHE: what's the extra data? can it get baked into the object name? what's its lifecycle like? i.e., can it be updated on POST, or is it set only via PUT?00:07
DHEset only at PUT time and never changed again. not feasible to put into the object name, no. the value is itself a full URL00:08
DHEhmmm... now you've got me thinking... not that much of the URL changes between objects...00:09
timburkemight also want to take a look at https://github.com/openstack/swift/blob/2.20.0/swift/common/middleware/symlink.py#L433-L452 -- if you can include some custom middleware in your pipeline, you could do something similar and then pick it back out of the hash/etag during listings00:13
timburkenote that symlink has it easy, though -- it forces the object to be zero bytes, so it already knows the base etag to include. https://github.com/openstack/swift/blob/master/swift/common/middleware/crypto/encrypter.py has to deal with arbitrary content (and does so by using a "footers" callback) but like i said, it gets a bit hairy00:15
*** NM has quit IRC00:26
*** baojg has joined #openstack-swift00:56
*** gyee has quit IRC01:18
*** mikecmpbll has quit IRC02:42
*** baojg has quit IRC02:58
*** baojg has joined #openstack-swift07:44
*** baojg has quit IRC07:49
*** baojg has joined #openstack-swift07:55
*** baojg has quit IRC08:31
*** baojg has joined #openstack-swift08:31
*** baojg has quit IRC09:36
*** mikecmpbll has joined #openstack-swift09:56
*** baojg has joined #openstack-swift10:28
openstackgerritMerged openstack/swift master: misc test cleanup  https://review.openstack.org/63107712:38
openstackgerritMerged openstack/swift master: Treat all invalid frag indexes the same  https://review.openstack.org/61599013:29
*** baojg has quit IRC14:42
*** baojg has joined #openstack-swift14:43
*** baojg has quit IRC15:32
*** e0ne has joined #openstack-swift19:57
*** e0ne has quit IRC20:05
*** e0ne has joined #openstack-swift20:26
*** early has quit IRC20:33
*** early has joined #openstack-swift21:20
*** e0ne has quit IRC21:58
*** baojg has joined #openstack-swift23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!