Friday, 2015-02-27

*** zaitcev has quit IRC00:14
*** david-lyle is now known as david-lyle_Afk00:22
*** david-lyle_Afk is now known as david-lyle_afk00:22
*** geaaru has quit IRC00:28
*** mattoliverau has quit IRC00:29
*** mattoliverau has joined #openstack-swift00:29
*** EmilienM|afk has quit IRC00:29
*** EmilienM has joined #openstack-swift00:30
openstackgerritMerged openstack/swift: fixed ugly code pattern in probe tests  https://review.openstack.org/15963000:35
*** dmorita has joined #openstack-swift00:36
*** tsg_ has quit IRC00:40
*** ChanServ sets mode: +v mattoliverau00:45
openstackgerritClay Gerrard proposed openstack/swift: Sync local regions first, and always shuffle nodes  https://review.openstack.org/15924100:53
openstackgerritClay Gerrard proposed openstack/swift: Cleanup object-replicator handoff/rebalance partition syncing  https://review.openstack.org/15892700:53
openstackgerritClay Gerrard proposed openstack/swift: Fix object replicator partition cleanup  https://review.openstack.org/15968300:53
claygpeluse: i broke out the probetests fixes to the first patch in the chain so I could get the unitests I wanted00:53
claygthe other stuff remains mostly the same00:53
*** reed has quit IRC00:55
*** shri1 has quit IRC01:00
*** km has joined #openstack-swift01:03
peluseclayg, ok will have another beer and then take a look...01:10
*** erlon_away has quit IRC01:21
*** bill_az has quit IRC01:34
*** addnull has left #openstack-swift01:47
*** tsg has joined #openstack-swift01:51
*** haomaiwang has joined #openstack-swift02:07
*** rmcall has joined #openstack-swift02:13
*** gyee has quit IRC02:31
openstackgerritClay Gerrard proposed openstack/swift: Sync local regions first, and always shuffle nodes  https://review.openstack.org/15924102:33
openstackgerritClay Gerrard proposed openstack/swift: Fix object replicator partition cleanup  https://review.openstack.org/15968302:33
openstackgerritClay Gerrard proposed openstack/swift: Cleanup object-replicator handoff/rebalance partition syncing  https://review.openstack.org/15892702:33
*** panbalag has quit IRC02:40
*** rmcall has quit IRC03:10
*** rmcall has joined #openstack-swift03:12
*** rmcall has quit IRC03:25
*** dmsimard_away is now known as dmsimard03:31
*** ppai has joined #openstack-swift04:16
*** annegentle has joined #openstack-swift04:30
*** dmsimard is now known as dmsimard_away04:34
*** mrda is now known as mrda-away04:50
*** annegentle has quit IRC04:51
*** tdasilva has quit IRC05:34
*** silor has joined #openstack-swift05:41
*** Krast has joined #openstack-swift05:52
*** abhirc has quit IRC05:55
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Imported Translations from Transifex  https://review.openstack.org/15901206:14
*** ppai has quit IRC06:19
*** ppai has joined #openstack-swift06:32
*** tsg_ has joined #openstack-swift06:56
*** tsg has quit IRC06:59
*** acoles_away has quit IRC07:17
openstackgerritClay Gerrard proposed openstack/swift: versioned writes middleware  https://review.openstack.org/13434707:46
openstackgerritClay Gerrard proposed openstack/swift: wip: fixups for thiago  https://review.openstack.org/15973907:46
*** ppai has quit IRC07:50
*** ppai has joined #openstack-swift08:03
*** rledisez has joined #openstack-swift08:07
*** tgohad has joined #openstack-swift08:13
*** tsg_ has quit IRC08:15
*** nellysmitt has joined #openstack-swift08:29
*** joeljwright has joined #openstack-swift08:39
*** chlong has quit IRC08:44
*** silor has quit IRC08:45
*** foexle has joined #openstack-swift08:46
*** jistr has joined #openstack-swift08:56
*** jordanP has joined #openstack-swift09:06
*** mmcardle has joined #openstack-swift09:28
*** acoles_ has joined #openstack-swift09:37
*** ChanServ sets mode: +v acoles_09:37
*** mmcardle1 has joined #openstack-swift09:46
*** mmcardle has quit IRC09:48
*** dmorita has quit IRC09:52
*** nonix4 has joined #openstack-swift09:55
*** haomaiwang has quit IRC10:31
*** aix has joined #openstack-swift10:52
openstackgerritMerged openstack/swift: Imported Translations from Transifex  https://review.openstack.org/15901211:10
*** foexle_ has joined #openstack-swift11:21
*** foexle has quit IRC11:24
openstackgerritMerged openstack/swift: Add tempauth back to /info  https://review.openstack.org/15959311:51
openstackgerritAlistair Coles proposed openstack/swift: Minor change to the service token sample test config  https://review.openstack.org/15980711:58
*** aix has quit IRC12:00
*** foexle_ has quit IRC12:01
*** foexle has joined #openstack-swift12:03
*** km has quit IRC12:04
*** dmsimard_away is now known as dmsimard12:17
*** mmcardle1 has quit IRC12:34
*** ppai has quit IRC12:36
*** aix has joined #openstack-swift12:55
*** tdasilva has joined #openstack-swift13:04
*** panbalag has joined #openstack-swift13:08
*** abhirc has joined #openstack-swift13:15
openstackgerritDaniel Wakefield proposed openstack/python-swiftclient: Add improvements to MD5 validation.  https://review.openstack.org/15667713:36
*** mmcardle has joined #openstack-swift13:39
openstackgerritMerged openstack/swift: Make functests retry auth immediately  https://review.openstack.org/15960013:49
*** abhirc has quit IRC13:53
*** abhirc has joined #openstack-swift14:02
*** abhirc has quit IRC14:04
tdasilvapeluse: around?14:06
acoles_yay functests shifted up a gear14:10
pelusetdasilva, yup14:18
pelusetdasilva, are you?14:19
tdasilvapeluse: hi, i'm just trying to catch up with the latest on EC. are we waiting for the probetest fix to merge master to ec?14:19
openstackgerritAlistair Coles proposed openstack/swift: Fix tempauth acl checks when simplejson has no speedups  https://review.openstack.org/15953014:19
tdasilvapeluse: I saw a patch from notmyname yesterday, but don't think that to fix the probetests, right?14:20
pelusetdasilva, not really myself or torgomatic generally do it periodically.  I susually do every Fri sometime, do you need it merged soon?14:20
pelusetdasilva, clayg has 3 patches out there, one of them fixes the probetest failures we were seeing but they havn'e landed on master yet I don't think14:21
tdasilvapeluse: hmm..oh ok, sorry wasn't aware of the schedule, but whenever we get it on ec, then we'll get acoles_ patch14:21
pelusetdasilva, have you got a second I can trial run a screen sharing conference app w/you so I know whether it will work for a possible code review later today?14:21
tdasilvaok, i'll check out clayg's patches14:21
tdasilvasure!14:22
peluseOK, try this real qucik: https://bluejeans.com/807210722514:22
peluseOK, I see you.14:23
tdasilvapeluse: any luck with the google hangout link?14:29
tdasilvalol14:29
*** logan2 has quit IRC14:32
openstackgerritStuart McLaren proposed openstack/python-swiftclient: Retry download after streaming has started  https://review.openstack.org/15920814:37
*** tgohad has quit IRC14:38
pelusetdasilva, not yet..14:39
tdasilvapeluse: ok14:39
openstackgerritAlistair Coles proposed openstack/swift: Fix tempauth acl checks when simplejson has no speedups  https://review.openstack.org/15953014:42
*** logan2 has joined #openstack-swift14:45
*** mahatic has joined #openstack-swift14:48
*** lcurtis has joined #openstack-swift14:54
lcurtisGood morning everyone...could someone recommend best web front end for swift proxy? From what I understand, built in python front end not ideal for high traffic environments?14:57
lcurtisand nginx not r ecommended since it queues everything14:58
openstackgerritStuart McLaren proposed openstack/python-swiftclient: Allow reading from object body on download  https://review.openstack.org/15529115:01
*** rdaly2 has joined #openstack-swift15:02
*** jrichli has joined #openstack-swift15:04
*** bill_az has joined #openstack-swift15:29
acoles_peluse: hi - you about?15:30
*** annegentle has joined #openstack-swift15:31
peluseacoles_, hi15:35
acoles_hi i am just looking at15:35
acoles_review 15963715:35
acoles_in get_ondisk_files, do we need to return data or durable files older than a .ts?15:36
peluseI didn't think so15:36
*** cdelatte has quit IRC15:37
acoles_ok, i'm starting from bottom up (diskfile) but i didn't think so either15:37
peluseacoles_, from what I understand in the prev code, once you find a .ts nothing in the past matters15:38
pelusethat's the trickiest function in this whole patch for sure :)15:38
peluseand I plan on doing a hangout session later today (if I can wrangle clayg) to talk through it and hash_cleanup_listdir()15:38
acoles_the loop doesn't break on finding .ts and having a data file, so it can go on looking for an older durable (and meta)15:39
*** abhirc has joined #openstack-swift15:39
*** abhirc has quit IRC15:40
acoles_i'll comment on review15:40
acoles_peluse: what time for hangout?15:40
pelusethere was a reason for that, I'll write down the sceanrios and put them in the comments but yeah that was on purpose15:40
pelusewas waiting to see when clayg was available15:40
acoles_peluse: ok. i think it will break non-EC but like you say its a tricky function!15:43
peluseacoles_, could be, I am working on more unit tests there also15:43
acoles_peluse: let me know if you want me to help with unit tests for that piece15:44
acoles_peluse: i'm familiar with it from fast-post ;)15:44
*** tsg has joined #openstack-swift15:45
*** rdaly2 has quit IRC15:45
peluseacoles_, great, thanks.  I probably will15:45
peluseacoles_, actually if you have a minue now we can talk15:47
*** SkyRocknRoll has joined #openstack-swift15:47
*** SkyRocknRoll has joined #openstack-swift15:47
*** rdaly2 has joined #openstack-swift15:48
*** SkyRocknRoll has quit IRC15:49
*** abhirc has joined #openstack-swift15:49
*** SkyRocknRoll has joined #openstack-swift15:50
*** david-lyle_afk is now known as david-lyle16:19
*** reed has joined #openstack-swift16:27
*** david-lyle is now known as david-lyle_Afk16:35
*** david-lyle_Afk is now known as david-lyle_afk16:35
*** erlon_away has joined #openstack-swift16:44
*** lcurtis has quit IRC16:46
*** gyee has joined #openstack-swift16:55
notmynamegood morning17:06
*** acoles_away has joined #openstack-swift17:08
*** acoles_away is now known as acoles17:08
*** ChanServ sets mode: +v acoles17:08
*** annegentle has quit IRC17:09
*** Anticimex has quit IRC17:10
*** rledisez has quit IRC17:11
*** Anticimex has joined #openstack-swift17:12
mahaticgood morning!17:19
*** zhill has joined #openstack-swift17:19
notmynamemahatic: I'm just going through emails, and then I was going to look at your patch. looks like cschwede added a +217:21
mahaticnotmyname, thanks. yeah, he did17:23
*** reed has quit IRC17:24
*** jistr has quit IRC17:25
notmynamemahatic: looking now17:27
mahaticcool17:27
acoles_clayg: so swift doesn't pick up from global requirements, correct?17:36
notmynameacoles_: we get the bot-submitted patches, but we don't merge them17:36
notmynameacoles_: our requirements (so far) don't conflict and the global requirements add a lot of packaging burden (that's not required) for deployers, especially on precise17:37
notmynameand cent617:37
acoles_notmyname: thx. yep, noticed those but never asked before. clayg picked me up for importing six17:37
acoles_notmyname: yeah, its a long list...17:38
openstackgerritAlistair Coles proposed openstack/swift: Fix tempauth acl checks when simplejson has no speedups  https://review.openstack.org/15953017:48
acoles_jrichli: i merged master onto feature/crypto again so you have the container update header override feature to play with17:54
mahaticnotmyname, any feedback?18:00
notmynamemahatic:ya, looking at one thing. just a final test here :-)18:00
mahaticnotmyname, oh sure :)18:00
*** stevelle has joined #openstack-swift18:01
*** annegentle has joined #openstack-swift18:02
mahaticnotmyname, i'm curious to know those tests though. last time acoles  also mentioned about nose tests18:02
stevelleanyone in this room able to speak about https://github.com/stackforge/swift3/ or is there another place I can go?18:04
*** chlong has joined #openstack-swift18:04
*** rdaly2 has quit IRC18:05
notmynamestevelle: yes, this would be the place, if any. but most of the contributors to it are based in Japan and will not be online for several more hours18:06
*** annegentle has quit IRC18:07
notmynamemahatic: ok, looking back at the tests18:07
*** annegentle has joined #openstack-swift18:07
*** rdaly2 has joined #openstack-swift18:08
mahaticnotmyname, no, I meant, are there are any other tests/checks you perform other than unittests and checking through command line (for this one)?18:09
notmynameI think the unit tests are sufficient18:09
notmynameas in you don't need to write functests or probetests for this18:10
mahaticokay, what are nose tests?18:11
*** chlong has quit IRC18:11
notmynamenose is a test runner for python. `nosetests`18:11
stevellenotmyname: thanks. may have to check back then.18:15
mahatichmm, trying look around on it18:19
*** mmcardle has quit IRC18:21
*** ihrachyshka has joined #openstack-swift18:23
notmynamemahatic: lgtm. +2/+118:24
notmynameyay!18:24
mahaticheh yup yay!18:25
mahaticnotmyname, thanks!18:25
mahaticand i learn what lgtm is today :P18:26
*** chlong has joined #openstack-swift18:28
ihrachyshkahey all. I'm a stable maintainer, and swift functional job fails in gate for icehouse. anyone wanna look, or I just disable it?18:29
ihrachyshkahttp://logs.openstack.org/53/157853/3/check/check-swift-dsvm-functional/489975b/console.html18:29
*** SkyRocknRoll has quit IRC18:32
*** david-lyle_afk is now known as david-lyle18:35
*** jordanP has quit IRC18:36
*** erlon_away is now known as erlon18:37
*** chlong has quit IRC18:38
acoles_ihrachyshka: those failures are because python-keystoneclient is required and not being found18:39
ihrachyshkaacoles_, it's not mentioned in requirements18:39
*** mahatic has quit IRC18:41
*** mahatic has joined #openstack-swift18:41
acoles_ihrachyshka: keystoneclient is not a requirement for swift but it is required for that jenkins job. i'm no expert on devstack but assume it usually gets installed in the devstack enviroment?18:43
jrichliacoles_: thank you!18:43
ihrachyshkaacoles, then we should maybe put it in test-requirements.txt?18:43
acoles_ihrachyshka: the review that those tests fail on moves the installation of openstackclient after swift, might that be the cause, idk?18:43
ihrachyshkaacoles, I saw that in other patches, let me find links18:44
ihrachyshkaacoles, https://review.openstack.org/#/c/159117/18:45
ihrachyshkaacoles, I reported a bug: https://bugs.launchpad.net/swift/+bug/142651018:45
openstackLaunchpad bug 1426510 in OpenStack Object Storage (swift) "Icehouse functional tests are broken" [Undecided,New]18:45
ihrachyshkaacoles, and sent temp disable for the job: https://review.openstack.org/#/c/159943/18:46
acoles_ihrachyshka: https://review.openstack.org/#/c/159117/ changes one line: "python-keystoneclient>=0.7.0,<=0.11.2"18:46
ihrachyshkaacoles, that's just a proper cap for the client18:47
ihrachyshkaacoles, it's not like client is missing18:47
panbalagHi...Has anyone tried executing the functional tests with swift/keystone combination?18:47
acoles_ihrachyshka: sure, but coincidental that swiftclient can't import keystoneclient18:49
ihrachyshkaacoles, ok, https://review.openstack.org/#/c/159695/18:50
ihrachyshka:)18:50
acoles_ihrachyshka: ok, well i'm out of suggestions, sorry18:52
*** reed has joined #openstack-swift18:54
panbalagI see this in the code for executing functional tests => "if 'keystoneauth' in cluster_info:  raise SkipTest". The comment says "# remove when keystoneauth supports account acls".. Any idea how to find if current version of keystone supports account acls?18:56
*** annegentle has quit IRC19:01
acoles_panbalag: keystoneauth (i.e. the swift middleware) does not support account acls19:02
panbalagacoles, ok..so only tempauth supports account acls?19:04
acoles_panbalag: yes (and maybe other thrid party auth systems outside of the swift tree, i'm not sure)19:05
*** stevelle has left #openstack-swift19:07
notmynamemahatic: sorry, had to run to a meeting19:07
notmynamemahatic: I've got an idea for a next thing that's related to what you're doing in recon19:07
mahaticnotmyname, no problem19:08
mahaticnotmyname, great!19:08
acoles_peluse: i made a start on get_ondisk_files, will pick up on monday,19:08
mahaticcan't wait to hear!19:08
peluseacoles, cool, if I can ever get off the phone I'll go add some more comments, thanks!19:08
notmynamemahatic: I'd like to see swift-recon work with other storage policies. i know there's been some work around that, but eg how can I validate the servers for a different policy? or do checks on something other than "object"19:08
notmynamemahatic: maybe that's a simple as allowing for "objects-N" to be allowed19:09
notmynamemahatic: or maybe it's more complicated19:09
notmynameI don't know19:09
*** acoles_ has quit IRC19:10
mahaticnotmyname, you mean, now it only validates for the default storage policy?19:10
notmynamemahatic: ya, AFAICT19:11
mahaticnotmyname, okay. i did not the part of checking something other than "object"?19:12
mahatici did not get*19:12
*** rdaly2 has quit IRC19:12
notmyname$ swift-recon --validate-servers objects-2   <=== gives "invalid server type"19:13
*** aix has quit IRC19:13
*** rdaly2 has joined #openstack-swift19:14
mahaticoh! I'll check19:15
notmynamemahatic: point is, how do I do *any* recon check for a different storage policy?19:16
mahaticnotmyname, oh, but how are other policies going on without a recon check? is that not important?19:17
notmynameright now, there isn't much in recon to check other policies19:17
notmynamemahatic: dmorita has started some of this. see https://review.openstack.org/#/c/138697/19:17
mahaticnotmyname, oh okay. looking19:18
notmynamemahatic: it's something that could definitely keep you busy and be really helpful for the last official week of the opw term :-)19:19
mahaticnotmyname, sure! :)19:19
*** rdaly2_ has joined #openstack-swift19:21
*** rdaly2 has quit IRC19:22
*** nellysmitt has quit IRC19:23
*** openstackgerrit has quit IRC19:24
*** openstackgerrit has joined #openstack-swift19:24
*** ihrachyshka has quit IRC19:26
pelusefor some reason I thought we had a knob/governor to control replication traffic, why am I not finding it?19:28
ctennisyou can set a bwlimit for rsync peluse19:28
notmynameand rsync mas_requests19:28
notmyname*max19:29
*** MasterPiece has joined #openstack-swift19:29
notmynamepeluse: mostly its the concurrency and run_pause settings19:29
peluseahhh, and rsync_bwlimit19:29
pelusejust found it :)19:29
pelusefor rsync at least19:29
*** MasterPiece has quit IRC19:32
*** fifieldt_ has joined #openstack-swift19:37
*** gyee has quit IRC19:38
*** fifieldt has quit IRC19:40
*** annegentle has joined #openstack-swift19:40
*** barra204 has joined #openstack-swift19:51
*** barra204 is now known as shakamunyi19:56
claygso with the speedups disabled I'm getting a bunch of unicode devices out of my ring20:06
claygwhen did we add json serialization to rings?20:06
*** annegentle has quit IRC20:07
claygapparently a long damn time ago20:08
*** annegentle has joined #openstack-swift20:08
clayganyway, acoles - i get functest failures with speedups diabled20:08
*** zaitcev has joined #openstack-swift20:13
*** ChanServ sets mode: +v zaitcev20:13
*** rdaly2_ has quit IRC20:21
*** rdaly2 has joined #openstack-swift20:25
tdasilvaclayg: thanks for the comments on obj. versioning!20:33
*** joeljwright has quit IRC20:36
*** MVenesio has joined #openstack-swift20:38
claygtdasilva: i appreciate you saying that - at somepoint I realized it was a lot of meterial - but then I went back and looked it over and was like "this is all pretty trivial stuff acctually"20:45
claygstill - not a small change - some risk - I'd like to spend more time with upgrade path today - i'll let you know!20:45
tdasilvaclayg: while trying to recreate that functional test failure you saw, I ran into another error on the same test case, had to do this to fix it: http://ur1.ca/jtdgi20:49
tdasilvaclayg: it seems strange, don't really understand why I'd get a conflict while writing the manifest file20:50
tdasilvaclayg: but once I did that, now I can also recreate the error you are seeing20:50
claygtdasilva: oh interesting... i didn't really look into that error20:54
claygI *thought* object servers only returned 409 when the ts on disk was >= the ts in the request?20:54
tdasilvai'm actually starting to think they are related. For some reason I get the conflict while trying to write the manifest (don't know why), but that's probably why when trying to check the header 'x-object-manifest' it fails. Problem is, it doesn't happen everytime...seems like there's some timing issue there20:56
*** tsg has quit IRC20:57
*** tsg has joined #openstack-swift20:58
*** tsg_ has joined #openstack-swift21:00
*** gyee has joined #openstack-swift21:02
*** jrichli has quit IRC21:02
*** tsg has quit IRC21:03
*** abhirc has quit IRC21:13
*** rdaly2 has quit IRC21:18
*** rdaly2 has joined #openstack-swift21:21
*** nellysmitt has joined #openstack-swift21:24
peluseclayg, I was going to see about an online code review of a few diskfile things in the multi FI thing but after talking to acoles I think its better to wait, I need to spec some tests more first...21:24
pelusewhich I am doing now21:24
*** nellysmitt has quit IRC21:29
*** mahatic has quit IRC21:32
*** bkopilov has quit IRC21:43
*** rmcall has joined #openstack-swift21:48
*** rdaly2 has quit IRC21:53
*** rdaly2 has joined #openstack-swift21:57
*** barra204_ has joined #openstack-swift22:02
*** shakamunyi has quit IRC22:03
*** rdaly2 has quit IRC22:06
*** barra204_ has quit IRC22:07
*** barra204_ has joined #openstack-swift22:07
*** annegentle has quit IRC22:10
*** annegentle has joined #openstack-swift22:11
*** jamielennox is now known as jamielennox|away22:23
*** MVenesio has quit IRC22:24
*** jamielennox|away is now known as jamielennox22:30
*** jamielennox is now known as jamielennox|away22:39
claygtdasilva: should I look into the 409 thing or do my upgrade testing?22:39
claygbrb22:39
*** jamielennox|away is now known as jamielennox22:40
*** abhirc has joined #openstack-swift22:51
*** annegentle has quit IRC22:56
*** barra204_ has quit IRC22:57
*** abhirc has quit IRC22:58
claygthis change should fix the partition cleanup issue with probetests on master for people running ssync with one region or rsync -> https://review.openstack.org/#/c/159683/22:59
*** nellysmitt has joined #openstack-swift23:00
openstackgerritTushar Gohad proposed openstack/swift: EC: Multi-phase commit conversation for erasure-coded PUTs  https://review.openstack.org/15384323:01
*** dmsimard is now known as dmsimard_away23:02
*** nellysmitt has quit IRC23:05
*** jamielennox is now known as jamielennox|away23:06
*** annegentle has joined #openstack-swift23:06
claygtdasilva: doh!  i was getting that x_object_manifest failure because i had my *lo's in the wrong place in the pipeline23:43
claygtdasilva: i'm not acctually sure what you were seeing the 409 stuff?23:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!