Wednesday, 2019-06-12

mattoliveraumorning00:10
*** ianychoi_ has joined #openstack-swift00:18
*** ianychoi has quit IRC00:20
*** ndk_ has quit IRC00:39
*** zaitcev has quit IRC01:22
*** zaitcev has joined #openstack-swift01:35
*** ChanServ sets mode: +v zaitcev01:35
*** spsurya has joined #openstack-swift01:52
*** itlinux has joined #openstack-swift01:58
*** BjoernT_ has quit IRC02:02
*** BjoernT has joined #openstack-swift02:02
*** BjoernT has quit IRC02:06
*** itlinux_ has joined #openstack-swift02:14
*** itlinux has quit IRC02:18
*** zaitcev has quit IRC02:31
*** gkadam has quit IRC02:38
*** gkadam has joined #openstack-swift02:39
*** zaitcev has joined #openstack-swift02:43
*** ChanServ sets mode: +v zaitcev02:43
*** itlinux_ has quit IRC02:54
zaitcevtimburke: Firefox detected a potential security threat and did not continue to storyboard-dev.openstack.org. If you visit this site, attackers could try to steal information like your passwords, emails, or credit card details.02:55
zaitcev"The certificate is not trusted because it is self-signed. "02:55
zaitcevIn the age of Let's Encrypt, there's no reason for this02:56
*** m75abrams has joined #openstack-swift03:01
hugokuomorning03:05
*** psachin has joined #openstack-swift03:29
*** m75abrams has quit IRC03:31
*** m75abrams has joined #openstack-swift03:32
*** itlinux has joined #openstack-swift03:35
*** BjoernT has joined #openstack-swift03:36
*** itlinux has quit IRC03:36
*** zaitcev has quit IRC03:49
*** zaitcev has joined #openstack-swift03:49
*** ChanServ sets mode: +v zaitcev03:49
*** BjoernT has quit IRC03:53
*** gkadam has quit IRC04:01
*** gkadam has joined #openstack-swift04:01
*** zaitcev has quit IRC04:24
kota_timburke: not yet for storyboard, will do.04:33
mattoliverautimburke: I need to fly to Melbourne tomorrow. Which involves driving to the closest city to fly. So wont make tomorrows meeting. Sorry.04:40
*** pcaruana has joined #openstack-swift04:54
*** pcaruana has quit IRC04:59
*** gkadam has quit IRC05:05
kota_timburke: oh story board, my chrome browser says NET::ERR_CERT_AUTHORITY_INVALID too, as well as zaitcev.05:33
*** e0ne has joined #openstack-swift05:51
*** e0ne has quit IRC06:22
*** takamatsu has quit IRC06:46
*** pcaruana has joined #openstack-swift06:56
zigokota_: I always get a 403 when trying swift with s3cmd ... :/06:57
zigoI don't get what I'm doing wrong.06:58
*** rdejoux has joined #openstack-swift07:00
*** tesseract has joined #openstack-swift07:14
*** psachin has quit IRC07:19
*** rcernin has quit IRC07:22
*** takamatsu has joined #openstack-swift07:37
*** gkadam has joined #openstack-swift07:42
*** gkadam has quit IRC07:50
*** e0ne has joined #openstack-swift07:57
*** ccamacho has joined #openstack-swift07:58
*** mikecmpbll has joined #openstack-swift08:03
*** tdasilva_ has quit IRC08:04
*** tkajinam has quit IRC08:23
*** takamatsu has quit IRC08:39
*** takamatsu has joined #openstack-swift08:40
*** m75abrams has quit IRC09:10
*** takamatsu has quit IRC09:14
*** mikecmpbll has quit IRC09:32
*** mikecmpbll has joined #openstack-swift09:33
*** takamatsu has joined #openstack-swift09:51
*** gkadam has joined #openstack-swift09:53
*** gkadam has quit IRC09:53
*** takamatsu has quit IRC10:16
*** rdejoux has quit IRC10:41
*** takamatsu has joined #openstack-swift10:49
*** m75abrams has joined #openstack-swift10:54
*** joeljwright has quit IRC10:55
*** rdejoux has joined #openstack-swift11:48
claygwhat's the difference between a wsgi string and a native string?11:56
claygI thought they were both bytes on py2 and unicode on py311:57
claygit's just a quoting/encoding thing?11:57
*** baojg has joined #openstack-swift12:14
*** joeljwright has joined #openstack-swift12:23
*** ChanServ sets mode: +v joeljwright12:23
*** baojg has quit IRC12:44
*** tdasilva has joined #openstack-swift12:52
*** ChanServ sets mode: +v tdasilva12:52
*** BjoernT has joined #openstack-swift13:12
*** DHE has quit IRC13:18
*** m75abrams has quit IRC13:28
*** pcaruana has quit IRC13:30
*** pcaruana|afk| has joined #openstack-swift13:30
*** gkadam has joined #openstack-swift14:08
*** gkadam has quit IRC14:08
*** takamatsu has quit IRC14:18
*** ianychoi_ is now known as ianychoi14:22
*** takamatsu has joined #openstack-swift14:31
*** takamatsu has quit IRC14:38
*** tdasilva has quit IRC14:39
*** tdasilva has joined #openstack-swift14:40
*** ChanServ sets mode: +v tdasilva14:40
*** pcaruana|afk| has quit IRC15:30
rlediseztimburke: i won't be at the meeting tonight, neither (at least) the 3 following meetings. I'm preparing to move to montreal. see you next month guys!15:54
tdasilvarledisez: hope the move goes well!15:58
*** zaitcev has joined #openstack-swift15:58
*** ChanServ sets mode: +v zaitcev15:58
*** tdasilva has quit IRC15:59
*** tdasilva has joined #openstack-swift16:00
*** ChanServ sets mode: +v tdasilva16:00
*** gyee has joined #openstack-swift16:03
*** pcaruana|afk| has joined #openstack-swift16:09
*** mikecmpbll has quit IRC16:32
*** e0ne has quit IRC16:44
*** spsurya has quit IRC17:19
*** ianychoi has quit IRC17:25
*** zaitcev has quit IRC17:28
openstackgerritTim Burke proposed openstack/liberasurecode master: Update .gitreview following project rename  https://review.opendev.org/66498417:30
claygtimburke: i'm a list confused by p 664710 isn't merged yet?17:31
patchbothttps://review.opendev.org/#/c/664710/ - swift - Ensure get_*_info keys are native strings - 1 patch set17:31
*** tdasilva has quit IRC17:36
*** tdasilva has joined #openstack-swift17:37
*** ChanServ sets mode: +v tdasilva17:37
*** zaitcev has joined #openstack-swift17:41
*** ChanServ sets mode: +v zaitcev17:41
*** zaitcev has quit IRC18:02
*** tdasilva has quit IRC18:03
*** rdejoux has quit IRC18:08
openstackgerritTim Burke proposed openstack/pyeclib master: Update .gitreview and playbooks following project rename  https://review.opendev.org/66499118:09
*** e0ne has joined #openstack-swift18:10
*** e0ne has quit IRC18:12
*** e0ne has joined #openstack-swift18:12
timburkeclayg, on py2, bytes is native is wsgi. on py3, full unicode is native, while unicode limited to codepoints 0-255 is wsgi (so you can map one-to-one with bytes be encoding/decoding with latin1)18:15
timburkerledisez, good luck with the move! hope it all goes well!18:16
timburkeclayg, p 664710 is chained with p 664459 which is gonna un-bust our gate18:16
patchbothttps://review.opendev.org/#/c/664710/ - swift - Ensure get_*_info keys are native strings - 1 patch set18:16
patchbothttps://review.opendev.org/#/c/664459/ - swift - Bump up minimum cryptography version - 2 patch sets18:16
*** e0ne has quit IRC18:17
*** BjoernT has quit IRC18:18
timburkeotherwise, swift-tox-lower-constraints would've failed like it has for every other patch that's been checked since... 4 days ago or so18:18
*** zaitcev has joined #openstack-swift18:18
*** ChanServ sets mode: +v zaitcev18:18
*** e0ne has joined #openstack-swift18:19
timburkebeen waiting 5 hours now for that recheck... makes me glad i woke up early :-(18:21
timburkeif yesterday's recheck is representative of what to expect from today's gate queue, it's gonna be another 4 hours...18:24
clayg@timburke so, do I need to DO anything to get that patched merged - or just wait?18:27
timburkejust wait :-/18:27
timburkeand maybe recheck.18:27
*** e0ne has quit IRC18:35
timburkeoh good! things are a least a *little* better today -- jobs have started already, so should have a check result within like a half-hour or something... but there's still the gate queue, and either of those may fail for spurious reasons18:44
*** BjoernT has joined #openstack-swift18:45
*** BjoernT_ has joined #openstack-swift18:50
*** BjoernT has quit IRC18:53
*** tesseract has quit IRC18:54
openstackgerritMerged openstack/liberasurecode master: Update .gitreview following project rename  https://review.opendev.org/66498419:18
openstackgerritMerged openstack/pyeclib master: Update .gitreview and playbooks following project rename  https://review.opendev.org/66499119:21
zaitcevall that but not the cryptography!19:22
*** e0ne has joined #openstack-swift19:23
*** e0ne has quit IRC19:26
timburkeyeah, i don't understand why it takes so long to get to swift's check jobs. in the gate, it makes some sense because of the integrated queue -- not sure what's blocking us on the check :-(19:27
timburke(those were basically reverts of some changes that came in with the opendev migration, btw -- seemed ok to self-approve)19:28
zigotimburke: Hello ! Around?19:39
timburkezigo, hi! i hear you're having trouble with s3api19:39
zigoYeah.19:39
zigoI'm currently trying to debug it.19:39
zigotimburke: If Swift finds out the PATH_INFO thing, does that mean it's already authenticated?19:40
timburkeif PATH_INFO looks halfway valid (like, '/v1/AUTH_test/...' or '/v1/KEY_test/...' or however you've got your auth prefixes configured) then we've at least mapped from the credential to the account, which is a good sign. if i remember right, that means keystone successfully validated the signature19:42
zigotimburke: Well, I get to that point, but my proxy still replies "The request signature we calculated does not match the signature you provided. Check your key and signing method."19:43
zigotimburke: Is s3cmd a good enough client?19:43
timburkeyeah, should be able to work just fine19:44
zigotimburke: I'm using a version I ported to Py3 ! :)19:44
zigoHopefully, running with py3 wont break it ...19:44
timburkedoes the proxy respond with the document that it was expecting to have signed?19:44
timburkerunning the *client* with py3, right? ;-)19:45
zigoYeah.19:45
timburkei'm getting close on swift! i swear!19:45
zigos3cmd.19:45
zigoHopefully ! :)19:45
zigotimburke: Debian Buster will be released on the 6th of July, at that point, we start removing py2 from Debian...19:45
zigo:)19:45
zigotimburke: To me, it goes correctly up to S3Token.__call__, then I'm not sure where to trace... :/19:46
timburkewhat do we see in keystone's log? next hop should be a POST to /v3/s3tokens or the like19:48
zigotimburke: how may I run pdb with swift-proxy?19:48
zigoIn keystone's log, I only see some 200 reply, everything looks like working on the keystone side.19:48
zigoIt really would help if I could just run pdb on swift-proxy.19:49
zigoIs there some kind of mode so swift-proxy could run with a single thread or something?19:49
timburkei think it'd probably work out ok to run it directly instead of using swift-init... not sure i've ever tried that though19:50
*** hoonetorg has quit IRC19:51
timburkesomething like `swift-proxy-server -v /etc/swift/proxy-server.conf`?19:52
zigoRight.19:54
timburkeor maybe that won't work :-( just tried it and got a traceback ending with `if self.quitting: raise BdbQuit#012BdbQuit`19:54
timburkeif you drop an early return in swift.common.utils.capture_stdio i think it'll work tho19:58
timburke(like, as soon as we enter the function -- make the whole thing a no-op)19:59
*** hoonetorg has joined #openstack-swift20:03
zigotimburke: It's working for me to run swift-proxy on the shell directly, but as soon as I add a breakpoint in the code, it crashes.20:04
zigoSo I end up lamely doing some prints ... :)20:04
timburkeright, i think that's the BdbQuit i was bumping into20:04
zigotimburke: Currently, in here: https://github.com/openstack/swift/blob/master/swift/common/middleware/s3api/s3request.py#L1335 I get status = 40120:04
zigoEven though self.account seems right ...20:05
zigotimburke: Is there a special role for s3 ?20:06
zigoOr just the normal SwiftOperator thing ...20:06
zigoI'm admin anyways ...20:06
timburkenope. what's your pipeline look like? i know there were some changes that needed to happen to make everything happy with keystone v3...20:07
zigopipeline = catch_errors healthcheck proxy-logging cache container_sync bulk ratelimit s3api s3token authtoken keystone copy container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server20:08
zigoMy "keystone" is the same as "keystoneauth", it's just puppet that does this ...20:08
zigoThe [filter:keystone] bit is right and working ...20:08
zigo"openstack container list" does work.20:08
timburketry putting authtoken left of s3api20:09
zigoOh ...20:10
zigoGosh, working ... :(20:11
zigoI mean :)20:11
timburkei know we used to recommend that order, but there were... complications...20:11
zigoWell, not sure if I should be super happy it works, or super sad it wasted all of my time today and yesterday ! :)20:11
zigotimburke: In anyways, thanks a lot!20:11
timburkefixed up swift3's docs in https://github.com/openstack/swift3/commit/c63f89c but i think the original breakage came out of https://github.com/openstack/swift3/commit/6ffcc29 and https://github.com/openstack/swift3/commit/2a4886120:13
timburkesorry for the wasted time, but definitely be glad that it now works!20:14
zigotimburke: It's going to solve lots of issues for our customers now that it does work in my PoC! :)20:15
zigotimburke: Like, QNAP users that only had keystone v2 auth ...20:15
zigoThey'll be able to use s3.20:15
timburkeyay! yeah, there's definitely a lot of good stuff that's landed :-)20:15
timburkeeven beyond the auth stuff; S3 compatibility has gotten a lot better in general20:16
zigotimburke: Have you see there's also a s4cmd ?20:17
zigoWhich one would you recommend?20:17
zigos4cmd is packaged in Debian, I saw.20:17
zigoNot s3.20:17
zigoI'm confused on which client to use.20:17
timburkei hadn't heard of s4cmd -- so i can't really judge i'm afraid20:18
timburkepersonally, i tend to use awscli -- but that's just because i like being able to use amazon's own tooling against a swift cluster :-)20:18
timburkehttps://github.com/wbingli/awscli-plugin-endpoint makes the endpoint management a good bit better20:19
openstackgerritJohn Dickinson proposed openstack/swift master: WIP swift api overview  https://review.opendev.org/66501320:42
zaitcevI have to admit, my first thought was "do we even... need something like this?"20:51
zaitcevtimburke, At a guess, the s3cmd was in Perl, which probably limited its ability to track the advancement of S3 API. Probably does not even support domain buckets, let alone v4 signatures.20:53
kota_morning20:59
timburkemeeting time!21:00
timburkezaitcev, clayg ^^^21:02
claygtimburke: thanks21:03
*** pcaruana|afk| has quit IRC21:16
timburkekota_, basically, the UnicodeEncodeError at http://logs.openstack.org/24/664424/1/check/swift-tox-lower-constraints/c1489db/job-output.txt.gz#_2019-06-10_23_46_22_546976 happens because tox is trying to print out the compile failure in http://logs.openstack.org/24/664424/1/check/swift-tox-lower-constraints/c1489db/tox/lower-constraints-1.log21:52
timburkewhich comes back to some const vs non-const typing between openssl and cryptography21:53
kota_i see. and it looks to include multi bytes char?21:53
kota_ah... or just using another encoding21:54
*** rcernin has joined #openstack-swift22:41
*** tkajinam has joined #openstack-swift22:56
*** lifeless has quit IRC23:05

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!