Tuesday, 2016-07-26

*** furlongm has quit IRC00:05
*** furlongm has joined #openstack-swift00:05
*** Suyi_ has quit IRC00:05
*** mahatic_ has quit IRC00:12
*** mahatic has joined #openstack-swift00:18
*** aagrawal has joined #openstack-swift00:40
*** abhitechie has joined #openstack-swift00:40
*** abhinavtechie has joined #openstack-swift00:41
*** arch-nemesis has quit IRC00:43
*** hosanai has joined #openstack-swift00:54
*** ChanServ sets mode: +v hosanai00:54
openstackgerritCheng Li proposed openstack/swift: check _last_part_moves when pretend_min_part_hours_passed  https://review.openstack.org/34680600:58
*** m_kazuhiro has joined #openstack-swift01:00
*** ukaynar has joined #openstack-swift01:08
*** Jeffrey4l has joined #openstack-swift01:09
*** tqtran has quit IRC01:09
m_kazuhirogood morning01:09
notmynamem_kazuhiro: hello!01:12
notmynamem_kazuhiro: we missed you in san antonio01:12
*** klrmn has quit IRC01:17
m_kazuhironotmyname: hello!01:18
*** NM has joined #openstack-swift01:21
*** ukaynar has quit IRC01:28
kota_good morning01:29
*** cdelatte has quit IRC01:29
kota_it looks like a bunch of interesting patches ware pushed to gerrit.01:31
* kota_ will look at there.01:31
mattoliveraukota_: morning01:33
kota_good morning matt101:33
kota_!01:34
mattoliverauok LCA talk proposal submitted. notmyname and jrichli that you done yours ;)01:34
mattoliveraus/that/have/01:34
kota_mattoliverau: hew, nice!01:34
*** hoonetorg has quit IRC01:35
jrichlimattoliverau: congrats!  As for me, I am working on a chip to put into the segway Mitch just bought01:41
jrichliok, ... no, not really!  But Mitch did get a segway. ugh.01:41
mattoliveraujrichli: sounds like a great LCA talk ;)01:42
mattoliverau:P01:42
*** dmorita has quit IRC01:45
*** dmorita has joined #openstack-swift01:46
*** hoonetorg has joined #openstack-swift01:49
*** dmorita has quit IRC01:49
*** _JZ_ has quit IRC01:50
*** dmorita has joined #openstack-swift01:50
*** mmcardle has joined #openstack-swift02:01
*** mmcardle has quit IRC02:05
*** catintheroof has quit IRC02:06
*** tqtran has joined #openstack-swift02:07
*** ukaynar has joined #openstack-swift02:09
*** klrmn has joined #openstack-swift02:09
*** tqtran has quit IRC02:11
*** trananhkma has joined #openstack-swift02:24
*** NM has quit IRC02:27
notmynameactually, yeah. that would be an awesome LCA talk02:27
notmynamehaven't done mine yet. been working on ideas, though02:27
*** jistr has quit IRC02:32
*** jistr has joined #openstack-swift02:33
*** dmorita has quit IRC02:49
*** mattoliverau has quit IRC02:58
*** Jeffrey4l has quit IRC03:01
openstackgerritCharles Hsu proposed openstack/swift: Retrieve recon data from one of object ports and add --exclude-zeroweight.  https://review.openstack.org/34351403:02
*** Jeffrey4l has joined #openstack-swift03:04
*** matt6434 has joined #openstack-swift03:06
*** asettle has joined #openstack-swift03:06
openstackgerritJanie Richling proposed openstack/swift: WIP - Enable in-process func tests to optionally use encryption  https://review.openstack.org/34710103:09
*** siva_krish has joined #openstack-swift03:10
*** asettle has quit IRC03:14
*** derekjhyang has joined #openstack-swift03:15
*** abhinavtechie has quit IRC03:16
*** aagrawal has quit IRC03:16
*** abhitechie has quit IRC03:16
openstackgerritJanie Richling proposed openstack/swift: WIP - Enable in-process func tests to optionally use encryption  https://review.openstack.org/34710103:17
*** Suyi_ has joined #openstack-swift03:28
*** matt6434 is now known as mattoliverau03:30
*** ChanServ sets mode: +v mattoliverau03:31
*** links has joined #openstack-swift04:03
*** takashi has joined #openstack-swift04:06
*** abhitechie has joined #openstack-swift04:18
*** abhinavtechie has joined #openstack-swift04:18
*** aagrawal has joined #openstack-swift04:19
*** ukaynar has quit IRC04:22
*** pcaruana has quit IRC04:34
*** psachin has joined #openstack-swift04:35
*** dmorita has joined #openstack-swift04:49
*** dmorita has quit IRC04:53
*** ppai has joined #openstack-swift04:57
*** flwang1 has quit IRC05:12
*** siva_krish has quit IRC05:14
*** Suyi_ has quit IRC05:27
*** abhitechie has quit IRC05:28
*** abhinavtechie has quit IRC05:28
*** ChubYann has quit IRC05:43
*** SkyRocknRoll has joined #openstack-swift05:44
*** silor has joined #openstack-swift05:57
*** flwang1 has joined #openstack-swift06:03
*** silor has quit IRC06:10
*** silor has joined #openstack-swift06:10
*** sanchitmalhotra has quit IRC06:13
*** sanchitmalhotra has joined #openstack-swift06:13
*** silor1 has joined #openstack-swift06:16
*** silor has quit IRC06:17
*** silor1 is now known as silor06:17
*** geaaru has joined #openstack-swift06:26
*** tesseract- has joined #openstack-swift06:39
*** hseipp has joined #openstack-swift06:41
*** hseipp has quit IRC06:44
*** hseipp has joined #openstack-swift06:44
*** pcaruana has joined #openstack-swift06:55
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844107:00
*** takashi has quit IRC07:01
*** rcernin has joined #openstack-swift07:06
*** asettle has joined #openstack-swift07:08
*** tqtran has joined #openstack-swift07:09
*** klrmn has quit IRC07:10
*** tqtran has quit IRC07:13
*** asettle has quit IRC07:13
*** rledisez has joined #openstack-swift07:21
*** oshritf has joined #openstack-swift07:24
*** ppai has quit IRC07:26
openstackgerritzheng yin proposed openstack/swift: Use pop instead del  https://review.openstack.org/34716207:29
*** zul has quit IRC07:35
*** takashi has joined #openstack-swift07:43
*** zul has joined #openstack-swift07:52
*** swat30 has quit IRC07:52
*** thurloat has quit IRC07:52
*** thurloat has joined #openstack-swift07:56
*** swat30 has joined #openstack-swift07:56
oshritfacoles_: Thanks for the container sync review! Will dive more into it in the next few days07:58
mahaticacoles_: thanks a lot for reviewing!08:01
mahaticclarkb: ack, thanks!08:01
mahaticclayg: ack, thanks!08:01
admin6Hi there, do you know what this object reconstructor log means : Unexpected response: ":ERROR: 0 '15 seconds: /srv/node/s03z3ecd08/.lock’". I’ve plenty of them for the last added new devices in my EC ring.08:17
*** joeljwright has joined #openstack-swift08:17
*** ChanServ sets mode: +v joeljwright08:17
charzcschwede: I'm a bit confused about the comment in patch 34351408:18
patchbotcharz: https://review.openstack.org/#/c/343514/ - swift - Retrieve recon data from one of object ports and a...08:18
*** asettle has joined #openstack-swift08:18
charzcschwede: here is a output with my local cluster with `swift-recon -d -v`08:19
charzhttps://gist.github.com/charz/1307f8bc188853e2204babd5c3f065a208:19
cschwedecharz: look at this output - without and with your patch applied: http://paste.openstack.org/show/542011/08:20
cschwedecharz: also, the large amount of changes in the tests is only required because of the unique ip filtering. without it, no change is required there - that’s a regression IMO08:20
*** ppai has joined #openstack-swift08:21
charzcschwede: could you add -v option for the output.08:21
charz@cschwede yes, that's for unique ip filtering.08:22
cschwedecharz: with verbose: http://paste.openstack.org/show/542013/08:23
*** mvk has quit IRC08:24
cschwedecharz: let me know if you have more questions08:25
charz@cschwede okay, it seems I missing the parts in my cluster, I got empty output.08:25
*** abhinavtechie has joined #openstack-swift08:27
charzI'll check that later. And more question about, if we won't use unique host for swift-recon, it seems like summary output will be different between w/o server-per-port and with server-per-port08:28
charzDisk usage: space free: 159511805952 of 16281029836808:28
charzDisk usage: space free: 46186995712 of 47129296896 <--- unique host08:29
cschwedecharz: yes, because you are not querying all disks08:29
*** aagrawal has quit IRC08:31
charzcschwede: no, I think I only have 12 x 4GB drives in my cluster around 3 nodes08:31
cschwedecharz: ah, yes, there might be a bug then if you have server-per-port - sounds like the usage is counted multiple times then08:33
cschwedemaybe?08:33
*** abhinavtechie has quit IRC08:33
charz@cschwede yes, it did.08:33
*** abhinavtechie has joined #openstack-swift08:33
charzI tried to disable that, and I got same report when I use the patch with unique host.08:34
charz@cschwede here is all disks https://gist.github.com/charz/1307f8bc188853e2204babd5c3f065a2#file-gistfile1-txt08:34
*** zul has quit IRC08:35
charz@cschwede not only in disk usage, all status report form swift-recon are counted multiple times.08:35
charzcschwede: ^^08:36
cschwedecharz: so you need to filter per device, not per host ip then?08:37
cschwedethat would make sense imo08:37
*** acoles_ is now known as acoles08:38
charz@cschwede yeah, but it still got multiple report from same host and all data are same.08:38
cschwedecharz: well, as i said - you need to filter per device then, and ensure that each device is only counted once08:39
charzcschwede: yeah! It should work.08:40
charzcschwede: thanks08:40
cschwedecharz: yw :)08:41
acolesgood morning08:44
acolesoshritf: glad you are still working on it :)08:44
*** mvk has joined #openstack-swift08:51
charzcschwede: I can't reproduce your case in my cluster http://paste.openstack.org/show/542015/08:52
charzcschwede: I can get all umount disks from one of ports.08:53
*** zul has joined #openstack-swift08:53
cschwedecharz: is http://paste.openstack.org/show/542015/ with your patch applied? looks like there is no unique filtering?08:55
charzcschwede: http://paste.openstack.org/show/542017/ here is the output of the patch applied.08:56
charzcschwede: yes, the 542015 is upstream code, but check the output of curl, I can got same result form each port. That's different between your env.08:57
charzis something not sync in saio?08:58
cschwedecharz: yes, because we have different rings.08:58
cschwedecharz: no, everything is fine with my saio08:58
cschwedecharz: and looking at the filtering, this is what i expect, but not in all cases08:58
cschwedecharz: the saio is somewhat special, because each port uses a different mountpoint for the disks08:59
charzcschwede: okay, I remember that! I should test on it.09:00
charzyeah! and there is different `devices path` in object-server config and that causes that.09:02
*** ouchkernel has quit IRC09:04
*** ouchkernel has joined #openstack-swift09:10
*** tqtran has joined #openstack-swift09:10
*** tqtran has quit IRC09:15
openstackgerritlokesh s proposed openstack/swift: Py3: Fixes TypeError: keys must be a string  https://review.openstack.org/34721209:24
openstackgerritlokesh s proposed openstack/swift: Py3: Fixes TypeError: keys must be a string  https://review.openstack.org/34721209:27
*** KriskK has joined #openstack-swift09:27
*** thurloat has quit IRC09:29
*** swat30 has quit IRC09:30
*** thurloat has joined #openstack-swift09:33
*** swat30 has joined #openstack-swift09:33
KriskKhi, I’m doing POC of swift just to backup data which are sent to AWS locally, I configured one test server with SWIFT, code is get from mitaka (ubuntu packages) I’m using swift3 (GIT, because keystone v3) with s3_acl=true and s3token, when I add ACL for “everyone READ” I’m not sure how to get that obcject as anonymous / “everyone:read”, I’m using keystone auth as well. am I miss something in configuration ?09:36
*** aagrawal has joined #openstack-swift09:38
*** abhinavtechie has quit IRC09:38
*** abhinavtechie has joined #openstack-swift09:39
*** aagrawal has quit IRC09:42
*** fbo has joined #openstack-swift09:46
*** fbo has quit IRC09:47
*** fbo has joined #openstack-swift09:48
*** mvk has quit IRC09:56
*** mvk has joined #openstack-swift09:57
*** KriskK has quit IRC09:58
*** KriskK has joined #openstack-swift09:59
acolesKriskK: the people more likely to be able to help with swift3 are in US and Japan timezones, try asking again later10:02
KriskKacoles: thanks10:03
kota_oh, what?10:03
acoleskota_: good evening :)10:03
kota_Hi acoles: -)10:04
acoleskota_: swift3 question ^^10:04
kota_yup, reading now10:04
kota_hmm... it seems a good question.10:05
kota_IIRC, swift3 doesn't support anoymous READ10:06
kota_KriskK:^^10:07
kota_KriskK: buckets in swift3 can be public for only in anonymous usres in the tenant (actually it requires auth for tenant)10:08
KriskKkota_: I think it would be really great if ACL is like EVERYONE:READ it should bypass any auth mechanizm10:10
kota_KriskK: I hope so. However, the hard part for the implementation is that swift3 cannot find the account to pass to the Swift from S3 request which includes only the info for bucket and object10:12
kota_KriskK: Swift API requires /version/account/container/object path but S3 doesn't.10:13
kota_if we bypass the auth (i.e. no auth header), we cannot find the account the request *actually* want to address.10:13
kota_that's a big reason today we cannot do that.10:14
kota_There might be an option (note that not yet implemented), if we could assume all users in *one* tenant, we could solve it.10:17
*** dmorita has joined #openstack-swift10:18
kota_with configuration likely "default_tenant=something", if anonymous access comming in, swift3 anyway to point to /v1/AUTH_something/bucket/object10:19
kota_timburke: maybe?10:19
*** dmorita has quit IRC10:19
kota_ah, one more thing for hard parts, how we can assume the annonymous access as S3 request?10:20
kota_w/o auth headers.10:20
kota_not sure10:20
kota_(is it able to find it via domain?)10:21
openstackgerritChristian Schwede proposed openstack/swift: Add doc entry to check partition count  https://review.openstack.org/32748910:25
*** zul has quit IRC10:27
*** zul has joined #openstack-swift10:27
*** mathiasb has quit IRC10:34
*** dmorita has joined #openstack-swift10:36
*** dmorita has quit IRC10:37
*** dmorita_ has joined #openstack-swift10:37
*** dmorita_ has quit IRC10:42
*** m_kazuhiro has quit IRC11:04
*** tqtran has joined #openstack-swift11:12
*** tqtran has quit IRC11:16
*** SkyRocknRoll has quit IRC11:16
*** hosanai has quit IRC11:19
openstackgerritzheng yin proposed openstack/swift: Use assertEqual() instead of assertDictEqual()  https://review.openstack.org/34726011:25
openstackgerritVictor Stinner proposed openstack/swift: Port hash_path() to Python 3  https://review.openstack.org/34726611:30
*** asettle has quit IRC11:45
*** NM has joined #openstack-swift11:54
*** cdelatte has joined #openstack-swift11:56
*** ppai has quit IRC12:04
tdasilvagood morning12:08
*** ppai has joined #openstack-swift12:18
*** asettle has joined #openstack-swift12:27
*** aagrawal has joined #openstack-swift12:34
*** KriskK has quit IRC12:37
*** abhinavtechie has quit IRC12:37
*** klamath has joined #openstack-swift12:43
*** klamath has joined #openstack-swift12:44
*** catintheroof has joined #openstack-swift12:46
*** siva_krish has joined #openstack-swift12:47
*** aagrawal has quit IRC12:53
openstackgerritzheng yin proposed openstack/swift: Use del replace pop  https://review.openstack.org/34735812:58
*** asettle has quit IRC13:01
*** trananhkma has quit IRC13:01
*** NM has quit IRC13:02
*** asettle has joined #openstack-swift13:02
*** psachin has quit IRC13:06
*** NM has joined #openstack-swift13:06
*** StraubTW has joined #openstack-swift13:11
*** takashi has quit IRC13:15
*** kei_yama has quit IRC13:25
*** ppai has quit IRC13:26
openstackgerritVictor Stinner proposed openstack/swift: Fix Python 3 issues in diskfile  https://review.openstack.org/34739013:38
*** links has quit IRC13:44
haypohi. does someone know if mimetools is still used in Swift?13:45
*** joelinux73 has joined #openstack-swift13:45
haypoi see monkey_patch_mimetools() in swift.common.wsgi ok, but parse_mime_headers() of swift.common.utils uses the email for example13:46
openstackgerritAlistair Coles proposed openstack/swift: Added quotes to example echo in swift-temp-url  https://review.openstack.org/34532513:48
*** aagrawal has joined #openstack-swift13:48
*** _JZ_ has joined #openstack-swift13:51
openstackgerritMerged openstack/swift: Fix X-*-Container-Update-Override-* header/footer precedence  https://review.openstack.org/33858813:55
admin6Hi there, do you know what this object reconstructor log means : Unexpected response: ":ERROR: 0 '15 seconds: /srv/node/s03z3ecd08/.lock’". I’ve plenty of them for the last added new devices in my EC ring.14:01
*** ukaynar has joined #openstack-swift14:02
*** siva_krish has quit IRC14:02
*** siva_krish has joined #openstack-swift14:04
*** diogogmt has quit IRC14:10
*** siva_krish has quit IRC14:11
*** diogogmt has joined #openstack-swift14:12
*** tqtran has joined #openstack-swift14:13
*** tqtran has quit IRC14:18
*** psachin has joined #openstack-swift14:21
*** psachin has quit IRC14:22
openstackgerritzheng yin proposed openstack/swift: Jugde container-name length  https://review.openstack.org/34480714:29
*** psachin has joined #openstack-swift14:29
*** diogogmt has quit IRC14:30
kota_admin6: IIRC, it means that the device /srv/node/s03z3ecd08/ is locked for any other process14:32
kota_admin6: probably another nodes is syncing to that path on the device14:32
kota_another node14:32
*** siva_krish has joined #openstack-swift14:34
kota_but... it should be 503 anyway?14:35
kota_interesting...14:35
openstackgerritDavid Goetz proposed openstack/swift: go: fix tests with old swift.conf  https://review.openstack.org/34690914:42
kota_hello dfg14:45
admin6kota_: ok thanks. I’m not sure why these new devices locks so often (I hav logs about every 2 seconds)14:48
kota_admin6: it could occur because the new device needs to be synced old primary nodes maybe?14:49
kota_synced from14:49
kota_admin6: but actually it might look a problem for operators so i think it's good catch anyway.14:50
*** dmorita has joined #openstack-swift14:50
kota_admin6: if you find something else, please let me know ;-)14:50
admin6kota_: these new devices have been moved from weight 1000 to 1500. so that is probably the source of these logs…14:53
*** dmorita has quit IRC14:54
openstackgerritMerged openstack/swift: Use extract_swift_bytes in override_bytes_from_content_type  https://review.openstack.org/34704315:04
*** rcernin has quit IRC15:05
*** klrmn has joined #openstack-swift15:08
*** ukaynar has quit IRC15:15
*** pgbridge has joined #openstack-swift15:25
*** ukaynar has joined #openstack-swift15:27
*** vinsh has joined #openstack-swift15:31
*** diogogmt has joined #openstack-swift15:39
*** psachin has quit IRC15:40
*** tesseract- has quit IRC15:43
*** aagrawal has quit IRC15:48
*** mmcardle has joined #openstack-swift16:05
*** asettle has quit IRC16:11
*** oshritf has quit IRC16:12
*** gyee has joined #openstack-swift16:21
*** mmcardle has quit IRC16:21
openstackgerritClay Gerrard proposed openstack/swift: Split up backend/sysmeta header/footer preference tests  https://review.openstack.org/34699216:30
openstackgerritClay Gerrard proposed openstack/swift: Use self.ts more consistently in obj.test_server  https://review.openstack.org/34699316:30
timburkekota_: yeah, anonymous access is going to be hard. i kinda wonder if it may require that we basically have a designated S3 proxy, and swift3 assumes *all* requests are for the S3 api16:32
timburkean alternative would be user-agent sniffing, but that will necessarily have some false negatives :-/16:34
notmynamewoohoo. got my laptop back from the shop today. but it was wiped, so I gotta spend all day restoring it :-(16:35
openstackgerritClay Gerrard proposed openstack/swift: Split up backend/sysmeta header/footer preference tests  https://review.openstack.org/34699216:36
openstackgerritClay Gerrard proposed openstack/swift: Use self.ts more consistently in obj.test_server  https://review.openstack.org/34699316:36
*** tqtran has joined #openstack-swift16:37
*** tqtran_ has joined #openstack-swift16:39
claygso my dependent patch merged and gerrit doesn't really have any reference to my patch anymore :'(16:39
*** tqtran has quit IRC16:41
openstackgerritlokesh s proposed openstack/swift: Py3: Fixes TypeError: keys must be a string  https://review.openstack.org/34721216:42
acolesclayg: do you mean patch 346992? did you go to top right and click Patch Sets and select latest? cos it all looks hunkydory to me16:42
patchbotacoles: https://review.openstack.org/#/c/346992/ - swift - Split up backend/sysmeta header/footer preference ...16:42
acolestdasilva: did you ever figure out how to run a single functional test via tox?16:43
*** abhitechie has joined #openstack-swift16:48
claygacoles: no i means, it looses context of "this is a follow on from xyz"16:48
openstackgerritAlistair Coles proposed openstack/swift: Mention SWIFT_TEST_DEBUG_LOGS in development guide  https://review.openstack.org/34748316:49
acolesjrichli: ^^16:49
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873616:50
*** dmorita has joined #openstack-swift16:50
acolesclayg: oic, yes because the Parent commit is not necessarily what you were originally based off.16:50
*** hseipp has quit IRC16:51
acolesclayg: hrm, so you'd need to add a change id ref in the commit message to keep that context16:51
claygacoles: yeah I think timburke has a trick where you can put "related-commit: XXX" in the commit message or something?16:52
claygyeah that is!16:52
claygidk the syntax :'(16:52
timburkeyeah, but that's just my own convention. i typically go with Related-Change:16:52
timburkegerrit should turn any change id into a link16:53
claygyou use the change id?16:53
openstackgerritClay Gerrard proposed openstack/swift: Split up backend/sysmeta header/footer preference tests  https://review.openstack.org/34699216:54
*** dmorita has quit IRC16:54
*** dmorita has joined #openstack-swift16:54
timburkeyep. i know that full commit hashes will also work, though i think it does a full-text search? might also work to have shortened commit hashes, i don't remember16:54
openstackgerritClay Gerrard proposed openstack/swift: Split up backend/sysmeta header/footer preference tests  https://review.openstack.org/34699216:55
claygBAM now that's some context - thanks acoles & timburke16:55
acolesI have used change id in commit, it gets converted to a link16:55
openstackgerritClay Gerrard proposed openstack/swift: Use self.ts more consistently in obj.test_server  https://review.openstack.org/34699316:55
tdasilvaacoles: I ended up using what you had suggested: nosetests, although I think the suggestion mahatic had should also work16:55
*** Suyi_ has joined #openstack-swift16:56
acolesclayg: I like it better than "follow up for the other patch" ;)16:56
tdasilvaacoles: ostestr --no-discover test.test_thing.TestThing.test_thing_method16:56
*** mvk has quit IRC16:57
acolestdasilva: thanks. I might just add that to the development guidelines16:57
tdasilvaacoles: I was thinking to add as comment to .functest itself16:57
tdasilvacause everything I look there to remember how .functests is working16:57
tdasilva:D16:57
tdasilvas/everthing/every time16:58
acolestdasilva:  belt and braces :)16:58
* tdasilva googles belt and braces16:58
tdasilvaccccccdkkgthgnvnifrrluchrehtjecbegiulnvkhgvl16:59
tdasilvaccccccdkkgthdgtgichginkcbfrjrlnkrgdechkcfbkj16:59
claygacoles: it seemed reasonable when the other patch was listed in the gerrit table on the right, but then today I realized it looked stupid - i'll try to use Related-Change more - it's a good trick!16:59
acolesclayg: you don't need the Related-Change prefix but its a nice convention17:00
* tdasilva needs to move his yubikey17:00
claygacoles: yah i'm sticking with it - i like it better than the change id in-line - i could use a [1] 1. <link> sotra thingy but we already have all those other named footers... idk17:00
acolestdasilva: oh that's what it is, I thought you were just falling alseep on the keyboard :P17:01
tdasilvalol17:02
openstackgerritClay Gerrard proposed openstack/swift: Use self.ts more consistently in obj.test_server  https://review.openstack.org/34699317:03
claygi'ma stick related-change on everything now!!!117:03
notmynametdasilva: any chance you use your yubikey for a password manager? I've wanted to do that, but then I can't get my passwords on my phone17:03
tdasilvanotmyname: I use yubikey for two factor auth17:06
*** ChubYann has joined #openstack-swift17:06
tdasilvanotmyname: I had not heard of using yubikey as password manager, I currently use 1password17:07
notmynameno, I mean what you said. I use 1password too. but if I use the yubikey to unlock it, then I can't unlock it on my phone17:08
tdasilvaoh, i see, unfortunately I don't even use 1password on my computer, only phone, they don't have a client for linux17:09
tdasilvaso it kinda sucks17:09
notmynameoh, right17:09
openstackgerritAlistair Coles proposed openstack/swift: Document how to run a single functional test  https://review.openstack.org/34749217:14
tdasilvahas anybody heard of crystal?? http://crystal-sds.org/17:14
acolestdasilva: if you'd like to add something in .functests to that patch then feel free ^^ more docs is better imho17:15
notmynametdasilva: oh, that's interesting. and seeing as there's a .cat domain for it, I expect to see them in barca17:17
tdasilvanotmyname: yeah, they have a preso proposal17:17
tdasilvaactually, there's some good swift talks being proposed17:17
claygaacphaphcaph tox --no-discover w/e - nosetests ftw17:17
*** abhitechie has quit IRC17:19
notmynametdasilva: "...we just have to package compression filter as a .jar file and install it as a filter in Crystal" <-- based on storlets?17:19
notmynameyes! (at least implied from the path in https://github.com/Crystal-SDS/Crystal-Filter-Samples/blob/master/Storlet_compression/src/com/urv/storlet/compress/CompressStorlet.java)17:19
*** acoles is now known as acoles_17:20
notmynametdasilva: now I just need to get a few of these http://www.techradar.com/us/news/computing-components/graphics-cards/amd-has-just-put-an-ssd-on-a-graphics-card-1325400 and then put swift/crystal/storlets on it. (why? because we can)17:21
tdasilvanotmyname: hehe, I thought they were referring to middleware as  filters17:22
tdasilvabut I guess storlets makes more sense17:22
tdasilvanotmyname: only 10K for the graphics card17:23
notmynamewhat a deal! ;-)17:24
*** Jeffrey4l has quit IRC17:24
*** rledisez has quit IRC17:25
*** asettle has joined #openstack-swift17:30
openstackgerritVictor Stinner proposed openstack/swift: Port hash_path() to Python 3  https://review.openstack.org/34726617:36
*** mmcardle has joined #openstack-swift17:38
*** ukaynar has quit IRC17:41
*** KriskK has joined #openstack-swift17:43
*** joeljwright has quit IRC17:47
*** mvk has joined #openstack-swift17:52
jrichlinotmyname: good luck with the restore.  hope you had a good backup.17:53
openstackgerritVictor Stinner proposed openstack/swift: monkey_patch_mimetools() now does nothing on py3  https://review.openstack.org/34749817:53
*** KriskK has quit IRC17:57
openstackgerritVictor Stinner proposed openstack/swift: monkey_patch_mimetools() now does nothing on py3  https://review.openstack.org/34749817:59
*** asettle has quit IRC17:59
*** chsc has joined #openstack-swift18:03
*** ukaynar has joined #openstack-swift18:05
*** mmcardle has quit IRC18:05
*** mingyu has joined #openstack-swift18:05
*** janonymous has quit IRC18:06
*** KriskK has joined #openstack-swift18:06
zaitcevSSD on a graphics card, huh18:22
zaitcevI remember a buddy of mine invited me to nVidia, "to write the OS for the GPU", and I was highly dubious about it. And now you have to have the write levelling and log-structured code residing in the GPU.18:23
notmynameI'm curious about what sort of interface they have to the storage18:24
notmynameI hope it's some API-based thing (instead of a filesystem). eg the kinetic API (or some other key-value API) would be pretty cool18:24
*** geaaru has quit IRC18:25
notmynameI'd guess that a server with several of those cards in it would be a relatively weak CPU that's used to schedule the jobs to the different cards and manage the data movement18:27
notmynamecould be an interesting way to deal with stuff like genomics or video post processing18:28
*** ukaynar has quit IRC18:34
*** KriskK_ has joined #openstack-swift18:36
*** delattec has joined #openstack-swift18:37
*** delattec has quit IRC18:39
*** KriskK has quit IRC18:39
*** KriskK_ is now known as KriskK18:39
*** delattec has joined #openstack-swift18:41
*** cdelatte has quit IRC18:41
notmynamenothing on the agenda for tomorrow's meeting yet. https://wiki.openstack.org/wiki/Meetings/Swift18:41
notmynameand if nothing is added, I propose we skip this week18:43
notmynameso I'll check on it later today18:43
*** ukaynar has joined #openstack-swift18:43
*** corvus is now known as thecount18:51
*** thecount is now known as corvus18:51
*** corvus is now known as thecount18:52
*** mingyu has quit IRC18:53
*** itlinux has joined #openstack-swift18:56
openstackgerritMerged openstack/swift: Added quotes to example echo in swift-temp-url  https://review.openstack.org/34532518:57
*** thecount is now known as corvus18:58
*** mingyu has joined #openstack-swift19:03
*** fifieldt has quit IRC19:03
*** mingyu has quit IRC19:13
*** fifieldt has joined #openstack-swift19:18
*** asettle has joined #openstack-swift19:18
*** KriskK_ has joined #openstack-swift19:20
*** KriskK has quit IRC19:22
*** KriskK_ is now known as KriskK19:22
*** dmorita has quit IRC19:23
*** asettle has quit IRC19:23
*** ukaynar has quit IRC19:24
*** KriskK has quit IRC19:27
*** gyee has quit IRC19:34
openstackgerritJanie Richling proposed openstack/swift: WIP - Enable in-process func tests to optionally use encryption  https://review.openstack.org/34710119:38
*** McMurlock1 has joined #openstack-swift19:42
*** ukaynar has joined #openstack-swift19:45
openstackgerritMichael Barton proposed openstack/swift: go: direct client concurrency  https://review.openstack.org/34163219:48
openstackgerritTim Burke proposed openstack/swift: Remove swift_bytes in slo instead of proxy-server  https://review.openstack.org/34753719:50
openstackgerritTim Burke proposed openstack/swift: Store SLO Etag in sysmeta  https://review.openstack.org/34753819:50
openstackgerritJanie Richling proposed openstack/swift: Enable in-process func tests to optionally use encryption  https://review.openstack.org/34710119:52
*** asettle has joined #openstack-swift19:58
*** asettle has quit IRC19:58
*** silor has quit IRC20:03
*** dmorita has joined #openstack-swift20:07
*** flwang1 has quit IRC20:11
openstackgerritMichael Barton proposed openstack/swift: go: get rid of BackendError  https://review.openstack.org/33465520:13
*** delattec has quit IRC20:18
*** nadeem has joined #openstack-swift20:22
*** asettle has joined #openstack-swift20:26
openstackgerritJanie Richling proposed openstack/swift: Add tests and docs for POST to DLO manifest file  https://review.openstack.org/34754520:27
*** ukaynar has quit IRC20:31
openstackgerritNandini Tata proposed openstack/swift: Moved ipv4 & ipv6 validations to the common utils  https://review.openstack.org/34754620:33
ntataHello all, the patch that I just proposed it to move ip address validations from common/ring/utils to swift/common/utils20:34
ntatait made sense to have them in the common folder as ipv6 validation is more generic than any specific for ring only..20:35
ntataplease let me know your thoughts on that.. Based on this, I can make changes to torgomatic 's swift-get-nodes patch to validate ipv6 from a common utils20:36
notmynamentata: yeah, if there's ipv6 validation happening outside of the ring code, then it makes sense to move it to swift/common/utils20:37
*** mingyu has joined #openstack-swift20:42
*** gyee has joined #openstack-swift20:43
*** mingyu has quit IRC20:47
*** cdelatte has joined #openstack-swift20:50
*** catintheroof has quit IRC20:52
*** bkeller` has quit IRC21:07
*** bkeller` has joined #openstack-swift21:09
*** cdelatte has quit IRC21:15
notmynameold computer mostly restored. will need to rebuild my SAIO, though21:19
tdasilvanotmyname: do you use vagrant-swift-all-in-one?21:20
*** StevenK has quit IRC21:25
*** NM has quit IRC21:30
notmynametdasilva: no21:31
notmynamewell, I've used it before. I could use it, I guess21:31
*** flwang1 has joined #openstack-swift21:32
claygnotmyname: try to use tdasilva's ansible/fedora one!21:33
tdasilva:)21:33
claygnotmyname: the point is... don't do it by hand21:33
notmyname:-)21:33
tdasilvaclayg, a while back I tried adding hummingbird21:34
*** McMurlock1 has quit IRC21:34
tdasilvaclayg: but I agree, haven't tried doing it by hand for a while now, plus now I use multiple VMs for different things (e.g., dev, review, clean-master)21:35
claygtdasilva: srly, i spin up vsaio's like it's going out of style - there's some aws support up in vsaio now too!21:36
claygtdasilva: also there's a vsaio hummingbird branch - patches welcome!21:36
claygredbo: ^^^ chef is annoying/stupid - but if you've ever had Vagrant & VirtualBox installed i'd love you to spin up the hummingbird branch and tell me which parts i'm doing terribly wrong (w.r.t. GOPATH etc)21:37
tdasilvaclayg: very cool! aws support == run vsaio on EC2 instance?21:37
claygtdasilva: yeah some dood pushed up a PR, I mangaged to get it working and filed some issues to improve the docs21:38
tdasilvaneat21:38
claygyou'll probably have to pull master and then go to the open issues to to see what you need to do to try it out21:38
claygtdasilva: it wasn't terrible - vagrant has some native support - so it wasn't a huge effort either21:38
tdasilvasounds like an awesome way to get app developers to try things out21:39
claygtdasilva: I've heard there's a rax cloud plugin for vagrant - trying to get that working might be a cool thing to try next!21:39
mattoliverauMorning21:39
claygtdasilva: yeah I think the guy that wanted ec2 support was developing an app against multiple cloud storage backends and wanted to do some integration testing against OpenStack Object Storage21:39
claygtdasilva: no idea how he handled keystone auth-y bits :\21:39
tdasilvaclayg: yeah, I keep wanting to add support to keystone in the ansible-saio project21:40
tdasilvawhich reminds me to ping acoles_ again, he once said he had some scripts on how to setup keystone21:40
claygtdasilva: and hisashi also has a vsaio patch that adds keystone support!21:41
claygbut he doesn't hang out anymore ;)21:41
tdasilvanice! I need to check that out21:41
notmynameclayg: the main reason I can't keep spinning up new VMs is that I only have 20GB or soemthing free on my laptop21:41
tdasilvanotmyname: I have 16GB and sometimes I have like 4 VMs running...How much ram are you assigning to your VMs?21:42
notmynametdasilva: not ram. hard drive space21:42
tdasilvaoh, lol21:42
tdasilvagot it21:43
claygnotmyname: you have too many t-shirt graphics21:43
notmynamemust be it21:43
tdasilvarofl21:43
claygnotmyname: you'd think you'd have some sort of "plan" for storage21:43
notmynamephysician, heal thyself?21:43
notmynamemy current plan is to hold my breath until new laptops are released, and then get one with 1TB of storage21:44
claygI think that joke only makes sense to the son-of-a-preacherman?21:44
notmynamelol21:44
claygyeah, i think the ssd in this laptop is only like 250GB - what a joke21:44
clayg233Gi - screw you apple21:44
notmynameyup. same here21:45
tdasilvanotmyname: next week I get a new, hopefully much lighter lenovo, so I'll be going through the same process as you21:49
*** mmcardle has joined #openstack-swift21:55
*** asettle has quit IRC21:56
mattoliverauclayg: I put some dodgy pictures and words together (very rough) to try and explain at a high level our discussions re sharing and locking the database during evening bar activities. When you have a chance can you have a quick sqiz and tell me what I left out. Again it's very high level, but the idea is for something to read to get people on the same page.22:01
mattoliverauOf, the link, it's linked on the ideas page22:01
*** darrenc is now known as darrenc_afk22:01
* mattoliverau is currently making breakfast and so on phone and doesn't have the link handy22:02
timburkehttps://docs.google.com/document/d/16rPdDrT-4G6hcen_6no8cr8KbxUqbcvsSkOfxxu0EBE/edit probably?22:02
mattoliverauProbably, and again I apologise for my bad English and diagramming skills ;)22:03
*** openstackgerrit has quit IRC22:03
*** openstackgerrit has joined #openstack-swift22:04
*** mmcardle has quit IRC22:09
*** ukaynar has joined #openstack-swift22:09
jrichlimattoliverau: you might want to put your +2 back onto patch 27272422:09
patchbotjrichli: https://review.openstack.org/#/c/272724/ - swift - Copy headers correctly when copying object22:09
jrichlilooks like that one should be ready to go soon22:10
claygnotmyname: yeah the devices are just symlinks into mounted loopback file system - it22:10
mattoliveraujrichli, kk when bfast is done :)22:10
jrichlithx!22:11
notmynameclayg: ack. thanks22:11
clayg... I've started to prefer using lvm to create a lvm pv out of a loopback device and then create "real" logical block devices that get their own files systems and mounts22:11
clayg... but I never updated the vsaio cookbooks to set that up22:11
claygnotmyname: you were just looking for any excuse that the tool won't work for you so you don't have to improve the tool :P22:13
notmynameno, not really :-)22:13
notmynameI like having "real" drives (ie passes is_mount() checks)22:15
claygyeah, me too22:15
claygi'm just saying it's only a small part of the configuration system - and it could be changed - there's little reason to prefer the way it is now - I have some other scripts that I used to test swiftstack nodes on cloud resources that do the lvm trick22:17
notmynameyeah. I'm getting brew re-set up, then i'll jump into vsaio and see what's up22:21
*** jamielennox|away is now known as jamielennox22:23
*** nadeem has quit IRC22:26
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873622:26
*** darrenc_afk is now known as darrenc22:35
claygnotmyname: here you go everything you need to know to get vsaio to use real devices!  https://github.com/swiftstack/vagrant-swift-all-in-one/issues/4322:42
notmynamesweet22:42
claygnow that I went and looked at it I really wanna see it done :D22:42
*** StraubTW has quit IRC22:44
*** openstackgerrit has quit IRC22:48
*** openstackgerrit has joined #openstack-swift22:48
*** siva_krish has quit IRC22:52
*** chsc has quit IRC22:55
*** tqtran_ has quit IRC22:57
*** tqtran has joined #openstack-swift22:57
*** ukaynar has quit IRC22:57
claygmattoliverau: oh!  new gertty!  did your fixes get merged?23:03
mattoliverauclayg: unified diff patch is in, apparently there is some unicode fixes, so hoping viewing tabs in golang code is fixed, if not I may need to patch that.23:04
claygmtreinish: god speed23:04
*** dmorita has quit IRC23:05
mtreinishclayg: ?23:06
mtreinishoh, wrong matt23:06
*** vinsh has quit IRC23:06
*** dmorita_ has joined #openstack-swift23:08
claygmtreinish: so sorry :'(23:09
mtreinishclayg: heh, it happens all the time. Although not too often with mattoliverau, most of the time mriedem and I get swapped23:10
notmynameok, it's a little disconcerting that before servicing my laptop, I had 20-30GB of free space. now, after restoring, I've got nearly 80GB free.23:13
notmynamegranted, I haven't created an SAIO yet, but I wouldn't expect that to take 50GB23:13
mattoliveraunotmyname: your obviously not testing big enough :P23:14
claygnotmyname: idk, if you use those real virtualbox disks they don't really compact on the host unless you delete them and recreate them23:14
notmynameclayg: yeah, that's probably it. they were sparsely built, but still...I'd had them a while23:15
notmynamewell now will all this space again, I can create all kinds of VMs!23:15
claygwhooooooo!!!!!23:15
*** hosanai has joined #openstack-swift23:16
*** ChanServ sets mode: +v hosanai23:16
notmynameit's hosanai! see, clayg, he didn't leave us! ;-)23:17
notmynamestill nothing has been added to the meeting agenda for tomorrow, so I'll call it off. no meeting tomorrow23:23
notmynamekota_: mattoliverau: hosanai: ^23:23
mattoliverau\o/ sleep in.. oh right I have a kid now... nevermind23:24
notmynamemattoliverau: you'll just have to take that morning walk on the beach instead23:25
mattoliverauahh, great idea ;)23:25
*** kei_yama has joined #openstack-swift23:30
*** klamath has quit IRC23:39
kota_notmyname: ok. I'll sleep well :)23:45
kota_morning23:45
kota_I'm wondering if there is volunteers who can review my pyeclib/liberasurecode patches though :P23:46
kota_In particuler, a memory leak bug is still there :/23:47
notmynameyeah, that's not good23:50
notmynamekota_: were you able to get any comment from kevin or tsg?23:51
kota_notmyname: they seems to assume it's a bug in pyeclib but on the code review, I didn't get any comment yet except "will do" :/23:53
kota_from a few conversation with them23:54
notmynamehttps://review.openstack.org/#/c/344066/ right?23:55
patchbotnotmyname: patch 344066 - pyeclib - Ref count for dict item should be Py_DECREF23:55
kota_yes, that's one23:56
claygso i'm not in love with that 'noop' jenkins check there :)23:58
claygtdasilva: ^ patch 34406623:58
patchbotclayg: https://review.openstack.org/#/c/344066/ - pyeclib - Ref count for dict item should be Py_DECREF23:58
kota_clayg: i know, i think tdasilva is working on there23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!