Tuesday, 2019-08-06

*** diablo_rojo has joined #openstack-swift00:12
*** gyee has quit IRC00:19
*** diablo_rojo has quit IRC00:25
*** diablo_rojo__ has joined #openstack-swift00:25
openstackgerritTim Burke proposed openstack/swift master: py3: mostly port s3 func tests  https://review.opendev.org/67471600:37
*** diablo_rojo__ has quit IRC00:54
openstackgerritTim Burke proposed openstack/swift master: py3: mostly port s3 func tests  https://review.opendev.org/67471600:55
*** spsurya has joined #openstack-swift01:17
*** altlogbot_2 has quit IRC01:37
*** altlogbot_3 has joined #openstack-swift01:39
*** BjoernT has joined #openstack-swift02:41
*** zaitcev__ has joined #openstack-swift02:45
*** ChanServ sets mode: +v zaitcev__02:45
*** zaitcev_ has quit IRC02:49
*** BjoernT_ has joined #openstack-swift02:58
*** BjoernT has quit IRC02:59
*** tdasilva_ has quit IRC03:14
*** tdasilva_ has joined #openstack-swift03:14
*** ChanServ sets mode: +v tdasilva_03:14
*** zaitcev_ has joined #openstack-swift03:45
*** ChanServ sets mode: +v zaitcev_03:45
*** zaitcev__ has quit IRC03:49
*** thiago__ has joined #openstack-swift04:02
*** ChanServ sets mode: +v thiago__04:02
*** tdasilva_ has quit IRC04:04
*** BjoernT_ has quit IRC04:12
*** thiago__ has quit IRC05:15
*** thiago__ has joined #openstack-swift05:15
*** ChanServ sets mode: +v thiago__05:15
*** tkajinam has quit IRC05:38
*** tkajinam has joined #openstack-swift05:38
*** gkadam_ has joined #openstack-swift05:54
*** gkadam_ has quit IRC05:54
*** gkadam has quit IRC05:56
*** tesseract has joined #openstack-swift07:30
*** zaitcev_ has quit IRC07:37
*** zaitcev_ has joined #openstack-swift07:51
*** ChanServ sets mode: +v zaitcev_07:51
*** mikecmpbll has joined #openstack-swift07:55
*** rcernin has quit IRC08:04
*** tkajinam has quit IRC08:06
*** ccamacho has joined #openstack-swift08:07
*** ccamacho has quit IRC08:08
*** ccamacho has joined #openstack-swift08:08
*** e0ne has joined #openstack-swift08:35
*** zaitcev_ has quit IRC08:56
*** zaitcev_ has joined #openstack-swift09:09
*** ChanServ sets mode: +v zaitcev_09:09
*** thiago__ has quit IRC09:50
*** tdasilva has joined #openstack-swift11:03
*** ChanServ sets mode: +v tdasilva11:03
*** henriqueof has joined #openstack-swift12:11
*** mvkr has quit IRC12:21
*** zaitcev_ has quit IRC12:47
*** zaitcev_ has joined #openstack-swift12:59
*** ChanServ sets mode: +v zaitcev_12:59
*** mvkr has joined #openstack-swift13:11
*** zaitcev_ has quit IRC13:17
*** zaitcev_ has joined #openstack-swift13:29
*** ChanServ sets mode: +v zaitcev_13:29
*** BjoernT has joined #openstack-swift13:40
*** BjoernT has quit IRC13:44
*** BjoernT has joined #openstack-swift13:48
*** ndk_ has quit IRC13:51
*** altlogbot_3 has quit IRC14:12
*** altlogbot_2 has joined #openstack-swift14:15
*** zaitcev_ has quit IRC14:39
*** BjoernT has quit IRC14:42
*** zaitcev_ has joined #openstack-swift14:52
*** ChanServ sets mode: +v zaitcev_14:52
*** zaitcev__ has joined #openstack-swift15:01
*** ChanServ sets mode: +v zaitcev__15:01
*** diablo_rojo has joined #openstack-swift15:02
*** zaitcev_ has quit IRC15:05
*** BjoernT has joined #openstack-swift15:10
*** ccamacho has quit IRC15:15
*** BjoernT has quit IRC15:23
*** hoonetorg has quit IRC15:24
*** hoonetorg has joined #openstack-swift15:25
*** gyee has joined #openstack-swift15:29
*** BjoernT has joined #openstack-swift15:33
*** mrjk__ has quit IRC15:53
*** mvkr has quit IRC16:20
*** mikecmpbll has quit IRC16:31
*** tdasilva has quit IRC16:32
*** e0ne has quit IRC16:48
*** BjoernT has quit IRC16:48
openstackgerritTim Burke proposed openstack/swift master: py3: mostly port s3 func tests  https://review.opendev.org/67471616:50
openstackgerritTim Burke proposed openstack/swift master: py3: Add swift-tox-func-encryption-py37 gate job  https://review.opendev.org/67487817:01
*** mrjk has joined #openstack-swift17:02
*** BjoernT has joined #openstack-swift17:08
openstackgerritTim Burke proposed openstack/swift master: Use `is` to compare against sentinel object  https://review.opendev.org/67488317:15
claygtimburke: so what do you think about ripping the SLO brains out of symlink - and clients creating hardlinks don't get slo container listing bits in the bucket listing containing the hardlink?17:22
claygThe alternatives being 1) *sometimes* clients creating hardlinks don't get slo container listing bits in the bucket listing or 2) we teach symlinks to get container listing bits from upstream middlewares via callback hooks17:23
*** tdasilva has joined #openstack-swift17:26
claygmy pipeline being `copy slo dlo versioned_writes symlink` means if versioned writes *does* want to get SLO bits in container listing it still has to learn how to handle legacy SLOs or do the callback bits - so i'm not sure "don't make SLO learn about symlinks" really makes the problem simpler as much as moves it around to another middleware17:26
*** ChanServ sets mode: +v tdasilva17:26
timburkei'm partial toward alternative 1, personally17:28
timburkenot such a fan of ripping it out if only because the listings feel *so* different between the SLO being pointed at, the client-created hardlink, and the VW-created hardlink17:28
timburkenot a fan of adding more callbacks as we know from experience (with authorize and copy_hook) that properly chaining callbacks all the time is hard17:28
timburkebut maybe i've just done a poor job of organizing callbacks? *shrug*17:30
claygno, I 100% agree the callback ordering is *super* hard - it can be a very frail interface17:31
claygon the "sometimes client's hardlinks ..." - can we define "sometimes" by some quantifiable client oversable difference?17:31
clayglike ... "hey i created a hardlink to this object and it's not doing the listings right" - then we HEAD the object and say "yeah, you need make a COPY request over itself and recreate the hardlink"17:32
clayghell, at that point maybe SLO's call back is more like "x-newest copy/fix this SLO" 😬17:34
*** diablo_rojo has quit IRC17:45
*** spsurya has quit IRC17:52
*** diablo_rojo has joined #openstack-swift17:55
openstackgerritTim Burke proposed openstack/swift master: py3: decode stdout from backgrounded servers  https://review.opendev.org/67470517:58
openstackgerritTim Burke proposed openstack/swift master: s3api: Translate 503 to S3-style 503s  https://review.opendev.org/67490118:12
*** e0ne has joined #openstack-swift18:17
* timburke whispers "audit-watcher-driven data migrations"18:18
tdasilvalol18:26
*** e0ne has quit IRC18:31
*** tdasilva has quit IRC18:33
*** tdasilva has joined #openstack-swift18:33
*** ChanServ sets mode: +v tdasilva18:33
*** henriqueof has quit IRC18:38
*** tesseract has quit IRC18:52
*** zaitcev_ has joined #openstack-swift18:54
*** ChanServ sets mode: +v zaitcev_18:54
*** zaitcev__ has quit IRC18:57
*** e0ne has joined #openstack-swift19:04
*** e0ne has quit IRC19:13
*** e0ne has joined #openstack-swift19:14
*** e0ne has quit IRC19:15
*** zaitcev_ has quit IRC19:27
claygtimburke: so prior to swift 2.19.0 SLOs didn't put the slo_etag in the container listing19:39
claygafter c4c98eb64d3d99a5fb58f0390600f3e7755da1b2 it did, and it writes it down in X-Object-Sysmeta-Container-Update-Override-Etag - but you can't see that just doing a HEAD on the SLO/manifest19:40
*** zaitcev_ has joined #openstack-swift19:40
*** ChanServ sets mode: +v zaitcev_19:40
claygso a client can't know if a SLO has an entry in the listing except for ... going through the listing with prior knowledge of which objects are SLOs and infering from the missing slo_etag key that it was created < 2.19.019:41
claygwhat's interesting is that even in c4c98eb64d3d99a5fb58f0390600f3e7755da1b2^ we DO have the X-Object-Sysmeta-Slo-Etag and X-Object-Sysmeta-Slo-Size keys in sysmeta, so symlinks could still *build* the X-Object-Sysmeta-Container-Update-Override-Etag if it wanted to 🤷‍♂️19:42
*** henriqueof has joined #openstack-swift19:42
claygthat goes all the way back to 2.12 2d25fe6ad319:44
claygand even before then we we might still be able to pull swift_bytes out of content-type 🤔19:48
*** e0ne has joined #openstack-swift19:51
*** diablo_rojo has quit IRC20:12
*** tdasilva has quit IRC20:14
*** tdasilva has joined #openstack-swift20:15
*** ChanServ sets mode: +v tdasilva20:15
timburkeclayg, 😞 https://logs.opendev.org/16/674716/3/check/swift-tox-py37/e2bbe2b/job-output.txt.gz#_2019-08-06_20_24_07_46277520:31
claygWOW!!!20:31
claygso close 2019-08-06 20:24:07.463279 | ubuntu-bionic | cont2 INFO: 127.0.0.1 - - [06/Aug/2019:20:23:30 +0000] "PUT /sdb1/0/a/versions" 201 - "PUT http://localhost/v1/a/versions" "tx881c24bdbaae49e79ecd2-005d49e1ae" "proxy-server 7197" 20.1892 "-" 7197 020:32
timburkelooks like it was *really* close tho -- 2019-08-06 20:23:10.101014 vs 2019-08-06 20:23:30.32843920:32
clayglet's just go for 60s and call it a win20:33
claygat least we know the plumbing is working 🤣20:33
*** zaitcev_ has quit IRC20:34
timburkeoh good, you're right -- obj server *does* send swift_bytes in the content-type, it's the proxy server app that drops it: https://github.com/openstack/swift/blob/2.22.0/swift/proxy/controllers/obj.py#L251-L25320:38
*** zaitcev_ has joined #openstack-swift20:48
*** ChanServ sets mode: +v zaitcev_20:48
*** e0ne has quit IRC20:48
*** tdasilva_ has joined #openstack-swift20:53
*** ChanServ sets mode: +v tdasilva_20:53
*** tdasilva has quit IRC20:56
openstackgerritTim Burke proposed openstack/swift master: py3: Add swift-tox-func-encryption-py37 gate job  https://review.opendev.org/67487820:57
*** zaitcev_ has quit IRC21:05
openstackgerritTim Burke proposed openstack/python-swiftclient stable/stein: Fix up stable gate  https://review.opendev.org/67418021:15
*** zaitcev_ has joined #openstack-swift21:17
*** ChanServ sets mode: +v zaitcev_21:17
timburkei think the most compelling reason to finish off the py3 func test series is so we can say, "ok, we have reason to believe they all pass on both -- let's split it up so *these* run on py2 and *those* on py3"21:21
timburke'cause doubling the number of func tests in the mean time dramatically increases the risk of needing a recheck21:21
timburkeok, maybe not *so* dramatic. but still, roughly doubling the risk sucks21:26
*** henriqueof has quit IRC21:45
openstackgerritTim Burke proposed openstack/swift master: s3api: Translate 503 to S3-style 503s  https://review.opendev.org/67490121:53
*** henriqueof has joined #openstack-swift22:43
*** tkajinam has joined #openstack-swift22:51
*** threestrands has joined #openstack-swift23:24
*** rcernin has joined #openstack-swift23:26
mattoliveraumorning23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!