Wednesday, 2016-06-01

stewie925_the sudo command failed with that error - we can continue tomorrow?00:00
notmynamethat's got an easy fix. let me see if I can remember it00:00
notmynameoh. no that was somethign else I was thinking of00:01
notmynameit's this that you're trying to get https://pypi.python.org/pypi/bindep00:02
claygdid you try unplugging your router?00:03
notmynameclayg: that won't work. you gotta plug it back in too! ;-)00:03
clayg:D00:03
*** wasmum has joined #openstack-swift00:04
*** hosanai has joined #openstack-swift00:05
*** ChanServ sets mode: +v hosanai00:05
notmynameok, I'm taking off. I got to spend time int he swift source tree today instead of writing emails and going to meetings about it. time to call it done while it's all still good :-)00:05
*** nadeem has joined #openstack-swift00:07
stewie925_talk to you tomorrow, notmyname00:07
*** _JZ_ has quit IRC00:07
*** garthb_ has quit IRC00:23
*** nadeem has quit IRC00:36
*** suyash has quit IRC00:36
kota_good morning00:40
mattoliveraukota_: morning00:50
kota_mattoliverau: morning, it looks like a bunch of conversation at IRC yesterday while I'm asleep.00:51
mattoliveraukota_: yeah, looks like the US's long weekend is over ;)00:52
kota_mattoliverau: gotcha!00:52
*** stewie925_ has quit IRC00:54
*** sams-gleb has joined #openstack-swift00:55
*** sams-gleb has quit IRC00:59
*** asettle has joined #openstack-swift01:08
*** asettle has quit IRC01:13
*** klamath has quit IRC01:15
*** klamath has joined #openstack-swift01:16
*** DCWilliams_VA has joined #openstack-swift01:20
*** DCWilliams_VA is now known as Guest9945301:20
*** Guest99453 is now known as dcwilliams29id01:22
*** dcwilliams29id is now known as dcwilliamsva01:23
*** natarej__ has quit IRC01:28
*** natarej has joined #openstack-swift01:29
*** dcwilliamsva has quit IRC01:29
*** thumpba has joined #openstack-swift01:50
*** klamath has quit IRC01:50
*** klamath has joined #openstack-swift01:50
CarlFKwhat is the rackspace version ov         authurl='https://objects.dreamhost.com/auth',01:53
*** klamath has quit IRC01:53
*** klamath has joined #openstack-swift01:54
*** sams-gleb has joined #openstack-swift01:56
*** sams-gleb has quit IRC02:00
*** tqtran has quit IRC02:10
*** CaioBrentano has joined #openstack-swift02:13
*** hogepodge has quit IRC02:13
*** thumpba has quit IRC02:16
*** hogepodge has joined #openstack-swift02:17
*** CaioBrentano has quit IRC02:18
*** DCWilliams_VA has joined #openstack-swift02:21
*** DCWilliams_VA is now known as Guest3530702:21
*** hogepodge has quit IRC02:21
redboCarlFK: the rackspace authentication endpoint is 'https://identity.api.rackspacecloud.com/v2.0/'02:22
CarlFKredbo: thanks!  and I think I just found that here: https://github.com/rackspace/pyrax/blob/master/pyrax/identity/rax_identity.py#L14  AUTH_ENDPOINT = "https://identity.api.rackspacecloud.com/v2.0/"02:23
*** dmorita has quit IRC02:30
CarlFKredbo: I am trying these snippets http://docs.ceph.com/docs/jewel/radosgw/swift/python/02:32
CarlFKuser = 'account_name:username'02:32
CarlFKwhat's account_name?02:32
*** dmorita has joined #openstack-swift02:37
*** dmorita has quit IRC02:37
*** tanee_away is now known as tane02:42
*** tane is now known as tanee02:42
*** gyee has quit IRC02:45
*** sheel has joined #openstack-swift02:51
redboCarlFK: You know, I'm not really sure.  Actually, the only way I know of to make it work with swiftclient is to get your API key from the rackspace cloud control panel and use v1 auth.02:57
redboThen it's:  c = swiftclient.Connection(user='redbo', key='8175bce8b...', authurl='https://identity.api.rackspacecloud.com/v1.0/')02:57
openstackgerritJanie Richling proposed openstack/swift: crypto - remove version from derived iv_base  https://review.openstack.org/32363602:59
CarlFKredbo: umm... it worked \o/03:00
CarlFKwhich makes no sense given all I did was swap vars for constants...03:00
CarlFKoh... v1 vs v203:01
*** Guest35307 has quit IRC03:04
redboThat's not so great because v1 doesn't support multiple regions.  But I don't know who to be mad at.  Maybe everyone.03:05
CarlFKlol03:06
*** DCWilliams_VA has joined #openstack-swift03:12
*** DCWilliams_VA is now known as Guest5755203:13
*** Guest57552 has quit IRC03:23
*** takashi has joined #openstack-swift03:43
*** sams-gleb has joined #openstack-swift03:57
*** links has joined #openstack-swift04:00
*** sams-gleb has quit IRC04:02
*** jamielennox is now known as jamielennox|away04:08
zaitcevI thought it was something obvious like zaitcev:zaitcev and then either v1 or v204:09
*** psachin has joined #openstack-swift04:15
*** david-lyle has quit IRC04:21
*** natarej has quit IRC04:25
*** natarej has joined #openstack-swift04:25
*** natarej has quit IRC04:27
redboThat would be a reasonable thing to think.04:28
*** natarej_ has joined #openstack-swift04:29
*** nadeem has joined #openstack-swift04:32
*** psachin has quit IRC04:35
*** dmorita has joined #openstack-swift04:37
*** dmorita has quit IRC04:42
*** psachin has joined #openstack-swift04:47
redboThe problem seems to be that swiftclient blows up if you try to use auth v2 and don't specify a tenant.  Well, aside than the problems of auth being overly complicated and rackspace auth not using tenants.04:48
*** ppai has joined #openstack-swift04:52
*** natarej has joined #openstack-swift04:53
*** natarej_ has quit IRC04:54
*** nadeem has quit IRC04:56
*** tanee is now known as tanee_away04:58
*** tanee_away is now known as tanee05:00
*** tanee is now known as tanee_away05:00
*** tanee_away is now known as tanee05:00
*** tanee is now known as tanee_away05:00
*** SkyRocknRoll has joined #openstack-swift05:02
*** tanee_away is now known as tanee05:03
*** rcernin has quit IRC05:04
CarlFKlol05:09
*** ChubYann has quit IRC05:21
*** asettle has joined #openstack-swift05:24
CarlFKso this worked: o = conn.put_object('testing','upload.py',contents= hello_file.read(),content_type='text/plain')05:27
*** asettle has quit IRC05:28
CarlFKhttp://940b8df95a674fe640d8-ea6444471e13d417907e633ec9e9ff11.r89.cf2.rackcdn.com/upload.py05:37
CarlFKhow do I get that URL from my code?05:38
*** natarej_ has joined #openstack-swift05:39
*** natarej has quit IRC05:42
*** rcernin has joined #openstack-swift05:43
*** sams-gleb has joined #openstack-swift05:59
*** mvk_ has joined #openstack-swift06:00
*** sams-gleb has quit IRC06:03
*** mvk has quit IRC06:03
*** tanee is now known as tanee_away06:11
*** takashi has quit IRC06:14
*** asettle has joined #openstack-swift06:16
*** pietervanw_ has joined #openstack-swift06:18
*** asettle has quit IRC06:21
*** pietervanw_ has quit IRC06:22
*** mmuffinman has quit IRC06:29
*** hogepodge has joined #openstack-swift06:31
*** tanee_away is now known as tanee06:35
*** mmuffinman has joined #openstack-swift06:36
*** jmccarthy1 has joined #openstack-swift06:38
*** mmuffinman has quit IRC06:46
*** sams-gleb has joined #openstack-swift06:51
cschwedenotmyname: alright, thx for the heads up!06:56
cschwedewill have a look at -infra06:56
cschwedewell, i think the multinode failed due to some error unrelated to my patch…06:58
*** klrmn has quit IRC07:02
*** tesseract has joined #openstack-swift07:03
*** rledisez has joined #openstack-swift07:10
*** sams-gleb has quit IRC07:22
*** DCWilliams_VA has joined #openstack-swift07:25
*** DCWilliams_VA is now known as Guest7510107:26
*** pcaruana has joined #openstack-swift07:26
*** sams-gleb has joined #openstack-swift07:27
*** Guest75101 has quit IRC07:30
*** takashi has joined #openstack-swift07:41
*** daemontool_ has joined #openstack-swift07:42
*** ppai is now known as ppai|afk07:47
*** sams-gleb has quit IRC07:48
*** sams-gleb has joined #openstack-swift07:49
*** elambert_ has joined #openstack-swift07:55
*** tmoreira has quit IRC07:58
elambert_tdasilva: what’s the process for submitting PRs to the new liberasurecode github repo?08:00
*** tmoreira has joined #openstack-swift08:02
*** joeljwright has joined #openstack-swift08:04
*** ChanServ sets mode: +v joeljwright08:04
*** joeljwright has quit IRC08:04
*** joeljwright has joined #openstack-swift08:05
*** ChanServ sets mode: +v joeljwright08:05
*** mmcardle has joined #openstack-swift08:08
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** jordanP has joined #openstack-swift08:27
*** jordan_ has joined #openstack-swift08:27
*** mmcardle1 has joined #openstack-swift08:29
*** jmccarthy has quit IRC08:31
*** mmcardle has quit IRC08:31
*** jmccarthy has joined #openstack-swift08:31
*** dmk0202 has joined #openstack-swift08:38
*** ppai|afk is now known as ppai08:41
kota_elambert_: probably, current liberasurecode PRs will work via openstack review system.08:43
kota_elambert_: the way to propose patch will be similar with Swift, I found the docs how to propose a patch to upstream here, http://docs.openstack.org/developer/swift/first_contribution_swift.html?highlight=contribute#proposing-changes-to-swift08:44
*** kei_yama has quit IRC08:45
kota_probably, git clone http://github.com/openstack/liberasurecode.git -> make a commit -> git review will work for you.08:45
kota_it might be needed to setup your git review and creating account in the gerrit code review system though.08:46
onovyif new liberasure repo is here: https://github.com/openstack/liberasurecode why someone commited to https://bitbucket.org/tsg-/liberasurecode/commits/all?08:46
onovysomeone=Eric :]08:46
kota_onovy: yeah, he is elambert_, I think.08:46
onovyah, lol :)08:47
onovyso openstack one is official now? can i package it for debian?08:47
kota_onovy: not sure, I just saw tsg- (pyeclib, liberasurecode maintainer) said  https://github.com/openstak/liberasurecode is a current upstream repo.08:48
*** dmk0202 has quit IRC08:48
*** daemontool_ has quit IRC08:58
*** daemontool has joined #openstack-swift08:59
*** psachin_ has joined #openstack-swift09:00
*** psachin has quit IRC09:01
*** daemontool has quit IRC09:11
*** daemontool_ has joined #openstack-swift09:11
*** mvk_ has quit IRC09:14
*** asettle has joined #openstack-swift09:20
*** asettle has quit IRC09:22
*** geaaru has joined #openstack-swift09:25
*** mvk has joined #openstack-swift09:32
openstackgerritdrax proposed openstack/swift: In case the lenght of the data returned by the object service is not equal to required content length then raise exception so that client can close connection from its end. Fixes Bug 1568650  https://review.openstack.org/32375609:33
openstackbug 1568650 in OpenStack Object Storage (swift) "Connection between client and proxy service does not closes" [High,Confirmed] https://launchpad.net/bugs/1568650 - Assigned to drax (devesh-gupta)09:33
*** takashi has quit IRC09:35
openstackgerritMerged openstack/swift: add explicit HA info to the deployment guide  https://review.openstack.org/32352409:38
*** dmorita has joined #openstack-swift09:39
openstackgerritMerged openstack/swift: Don't include holes when reporting how many devices a ring has  https://review.openstack.org/32184209:41
*** asettle has joined #openstack-swift09:43
*** dmorita has quit IRC09:43
*** jamielennox|away is now known as jamielennox09:44
*** Jeffrey4l_ has quit IRC09:48
*** asettle has quit IRC09:57
*** daemontool_ has quit IRC10:00
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844110:10
*** elambert_ has quit IRC10:22
*** asettle has joined #openstack-swift10:29
*** wasmum has quit IRC10:44
*** hosanai has quit IRC10:44
openstackgerritAlistair Coles proposed openstack/swift: crypto - use random iv when wrapping body key  https://review.openstack.org/32145110:45
openstackgerritAlistair Coles proposed openstack/swift: crypto - stop using key id to derive GET path keys  https://review.openstack.org/31814811:04
*** acoles_ is now known as acoles11:05
*** raildo-afk is now known as raildo11:15
*** ppai has quit IRC11:34
*** links has quit IRC11:34
openstackgerritAlistair Coles proposed openstack/swift: crypto - add test to verify ondisk container listing  https://review.openstack.org/32335511:37
*** ppai has joined #openstack-swift11:41
*** links has joined #openstack-swift11:47
openstackgerritDoron Chen proposed openstack/swift: Added a test for delayed reap.  https://review.openstack.org/32104111:55
openstackgerritOndřej Nový proposed openstack/liberasurecode: Changed homepage to new one  https://review.openstack.org/32381911:56
tdasilvaonovy: yeah, https://github.com/openstack/liberasurecode is official now11:57
tdasilvai'm working with Tushar to change bitbucket repo to point people to github11:57
onovytdasilva: thanks! ^^ :)11:58
*** wasmum has joined #openstack-swift12:05
*** _JZ_ has joined #openstack-swift12:07
*** _JZ_ has quit IRC12:07
*** _JZ_ has joined #openstack-swift12:12
*** sams-gleb has quit IRC12:13
*** delattec has joined #openstack-swift12:15
*** openstackgerrit has quit IRC12:18
*** ppai has quit IRC12:18
*** cdelatte has quit IRC12:18
*** openstackgerrit has joined #openstack-swift12:18
*** DCWilliams_VA has joined #openstack-swift12:19
*** DCWilliams_VA is now known as Guest2973512:19
*** Guest29735 has quit IRC12:20
*** pauloewerton has joined #openstack-swift12:30
*** SkyRocknRoll has quit IRC12:48
*** delatte has joined #openstack-swift12:52
*** Jeffrey4l has joined #openstack-swift12:53
*** CaioBrentano has joined #openstack-swift12:53
*** delattec has quit IRC12:55
*** klamath has quit IRC13:00
*** klamath has joined #openstack-swift13:00
*** SkyRocknRoll has joined #openstack-swift13:03
openstackgerritMerged openstack/swift: crypto - use random iv when wrapping body key  https://review.openstack.org/32145113:05
*** mariusv has quit IRC13:10
*** mariusv has joined #openstack-swift13:11
*** sams-gleb has joined #openstack-swift13:13
*** vinsh_ is now known as Vinsh13:15
onovytdasilva: dtto for python-pyeclib repo?13:19
openstackgerritFelix Cantournet proposed openstack/swift: Fix swift-dispersion in multi-region setups  https://review.openstack.org/32282013:34
*** SkyRocknRoll has quit IRC13:34
openstackgerritFelix Cantournet proposed openstack/swift: Fix swift-dispersion in multi-region setups  https://review.openstack.org/32282013:35
acolesjrichli: mahatic : is there any reason why crypto_utils.py and crypto.py cannot be a single module? They are both small and both contain code shared between encrypter and decrypter.13:36
*** cguadall has joined #openstack-swift13:36
openstackgerritOndřej Nový proposed openstack/pyeclib: Changed liberasure URL to new one  https://review.openstack.org/32387413:40
*** dmorita has joined #openstack-swift13:40
openstackgerritAlistair Coles proposed openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/32387513:41
mahaticacoles: we could. having crypto_utils seems a bit more easier to track? other than that, don't really see much difference13:42
openstackgerritOndřej Nový proposed openstack/pyeclib: Bump liberasurecode dependency to 1.2.0 version  https://review.openstack.org/32387713:43
mahatica little more readable, than having one big file with everything in it13:43
acolesmahatic: by "easier to track" do you mean combining to crypto_utils is easier than combining into cryto?13:43
acolesmahatic: oic13:44
openstackgerritOndřej Nový proposed openstack/pyeclib: Change liberasure URL to new one  https://review.openstack.org/32387413:44
acolesmahatic: unless it's huge I find it easier not to have to switch between files13:44
*** dmorita has quit IRC13:44
*** SkyRocknRoll has joined #openstack-swift13:47
mahaticacoles: maybe. It's won't be all that huge by combining it now, but maybe for future (if/when). I remember some discussion on IRC wanting to split a file (in tests or some other module) because it's huge. But anyway, for *now* with current code, doesn't seem like a bad idea13:48
*** MikeG451 has joined #openstack-swift13:48
mahaticcombining both (crypto_utils and crypto) doesn't seem like a bad idea*13:48
*** links has quit IRC13:52
*** klamath has quit IRC13:54
*** klamath has joined #openstack-swift13:54
*** psachin_ has quit IRC13:54
*** klamath has quit IRC13:56
tdasilvaonovy: yes, same for pyeclib13:56
*** klamath has joined #openstack-swift13:57
*** ametts has joined #openstack-swift13:58
*** SkyRocknRoll has quit IRC13:58
*** StraubTW has joined #openstack-swift14:00
openstackgerritMerged openstack/swift: crypto - add test to verify ondisk container listing  https://review.openstack.org/32335514:03
onovytdasilva: cool thanks, sent few merge req with nits in liberasurecode + pyeclib14:11
*** thumpba has joined #openstack-swift14:11
*** psachin_ has joined #openstack-swift14:14
*** zul has quit IRC14:18
notmynamegood morning14:21
*** zul has joined #openstack-swift14:21
*** Raymii has quit IRC14:21
tdasilvaonovy: cool, just saw that14:22
*** thumpba has quit IRC14:25
*** d0ugal has quit IRC14:25
*** diogogmt has joined #openstack-swift14:27
*** ametts has quit IRC14:28
openstackgerritChristian Schwede proposed openstack/swift: Refactor locale tests and unicode issue  https://review.openstack.org/32394614:30
openstackgerritChristian Schwede proposed openstack/swift: Refactor locale tests and unicode issue  https://review.openstack.org/32395014:32
openstackgerritAlistair Coles proposed openstack/swift: crypto - purge crypto sysmeta from responses  https://review.openstack.org/32057914:33
*** d0ugal has joined #openstack-swift14:35
*** thumpba has joined #openstack-swift14:36
jrichliacoles mahatic: I had originally thought of crypto.py as holding the code that is tied to a cryptographic implementation.  Then the utils was used for methods related to crypto code, but still crypto alg agnostic.14:39
jrichliacoles mahatic: but, it isn't like we have a plugin option for crypto at this point.  so, I am game for whatever.14:40
*** ametts has joined #openstack-swift14:42
*** StraubTW has quit IRC14:46
openstackgerritMohit Motiani proposed openstack/swift: Add region in search-value of swift-ring-builder manpage  https://review.openstack.org/32358014:47
*** d0ugal has quit IRC14:48
*** diogogmt has quit IRC14:48
*** d0ugal has joined #openstack-swift14:48
*** d0ugal has joined #openstack-swift14:49
*** elambert_ has joined #openstack-swift14:50
*** arch-nemesis has joined #openstack-swift14:53
elambert_kota_: thanks for the pointers :-)15:00
*** diogogmt has joined #openstack-swift15:00
*** diogogmt has quit IRC15:01
*** pcaruana has quit IRC15:04
*** asettle has quit IRC15:06
openstackgerritMohit Motiani proposed openstack/swift: Adds region as a search-value in manpage  https://review.openstack.org/32358015:08
*** rcernin has quit IRC15:09
*** d0ugal has quit IRC15:10
*** StraubTW has joined #openstack-swift15:11
openstackgerritNandini Tata proposed openstack/python-swiftclient: Fixed a typo in SwiftService API doc  https://review.openstack.org/32397515:12
*** d0ugal has joined #openstack-swift15:12
*** StraubTW has quit IRC15:13
*** asettle has joined #openstack-swift15:15
*** Raymii has joined #openstack-swift15:15
openstackgerritMohit Motiani proposed openstack/swift: Add description of server options (all, main, rest) for swift-init help  https://review.openstack.org/31644815:16
*** tesseract has quit IRC15:18
*** ouchkernel has joined #openstack-swift15:20
acolesjrichli: ack. good point re leading '/'. keep it there.15:21
openstackgerritAlistair Coles proposed openstack/swift: crypto combine crypto.py with crypto_utils.py  https://review.openstack.org/32397815:23
acolesjrichli: mahatic ^^15:24
*** nadeem has joined #openstack-swift15:24
*** klrmn has joined #openstack-swift15:25
*** permalac has joined #openstack-swift15:32
*** diogogmt has joined #openstack-swift15:37
*** mmuffinman has joined #openstack-swift15:38
*** nadeem has quit IRC15:56
*** sams-gleb has quit IRC16:02
*** geaaru has quit IRC16:06
*** gyee has joined #openstack-swift16:09
openstackgerritJanie Richling proposed openstack/swift: crypto - remove version from derived iv_base  https://review.openstack.org/32363616:11
*** dmorita has joined #openstack-swift16:11
*** StraubTW has joined #openstack-swift16:13
*** StraubTW has quit IRC16:18
notmynamejoeljwright: did you notice that http://docs.openstack.org/developer/swift/ has the versions on the side now?16:19
joeljwrightnotmyname: did we abandon the client docs patch in favour of the oslosphinx patch16:20
notmynameI just did16:20
joeljwrightnotmyname: yes I did, and I got jealous that the swiftclient didn't!16:20
notmynameso I think next time the client docs are rebuilt we'll have it there too16:20
notmynameso we just need your patch to land :-)16:20
joeljwrightexcellent, I need to reply to that review with a link to the oslosphinx patch16:21
*** klrmn has quit IRC16:21
notmynameI can if you're in the middle of something16:22
notmynameI've got all the links open currently16:22
joeljwrightI'm doing it now16:22
notmynamegreat16:22
joeljwrightjust wanted to speak to you before I replied16:22
notmynametimburke: around today?16:24
*** SkyRocknRoll has joined #openstack-swift16:26
*** elambert_ has quit IRC16:26
notmynamejoeljwright: the sad part is those links don't work :-(16:30
joeljwrightdamn!16:30
joeljwrightah, yeah!16:30
joeljwrightthey don't link within the project16:31
notmynameright16:31
notmynamelooking at the code to see what to fix16:31
notmynamehref="/{{ver}}"16:31
notmynamebah16:31
joeljwrightI was doing the same thing :)16:32
notmynameneeds pathto(master_doc) I think16:32
joeljwrightyeah16:33
joeljwrightpathto(master_doc)/ver16:33
joeljwrightor something similar16:33
notmyname{{ pathto(master_doc) }}/{{ver}}16:33
notmynameright?16:33
notmyname{{ pathto(master_doc) }}/{{ ver }}16:33
notmynamefor spaces consistency16:33
joeljwrightthe latter looks more promising16:34
tdasilvaacoles, jrichli: just a quick reminder, are there specific crypto functional tests?16:34
*** nadeem has joined #openstack-swift16:34
tdasilvaor mostly unit, probe tests?16:34
joeljwrightalthough the spacing isn't exactly consistent in the 10 or so lines either side16:34
*** nadeem has quit IRC16:34
notmynamejoeljwright: no, that won't work either16:34
notmynameseems that includes "index.html"16:35
jrichlitdasilva: no functests have been added, but we do have a test_encrypter_decrypter that tests the "round_trip" cases.16:35
*** nadeem has joined #openstack-swift16:35
*** SkyRocknRoll has quit IRC16:35
notmynamejoeljwright: but master_doc = 'index' so I wonder how pathto() is defined16:36
*** jordan_ has quit IRC16:36
tdasilvajrichli: ok, thanks16:36
acolestdasilva: we add to functional tests but the additions are not crypto-specific16:37
tdasilvaacoles, jrichli: ok, was just thinking it if would make sense to add some func tests to patch 32057916:38
patchbottdasilva: https://review.openstack.org/#/c/320579/ - swift (feature/crypto) - crypto - purge crypto sysmeta from responses16:38
tdasilvathinking of the copy case, but seems like that is getting covered with unit tests???16:38
tdasilvaand it's not really crypto specific16:38
acolestdasilva: the gatekeeper would have purged those sysmeta headers anyway16:39
tdasilvaacoles: right16:39
acolestdasilva: so we're purging them mainly to deal with copy from encrypted to unencrypted which a func test could not cover16:40
acolestdasilva: but the tests we now have in test_encrypter_decrypter are pretty good for exploring those scenarions16:40
acolesscenarios*16:40
* tdasilva goes looking for test_encrypter_decrypter16:40
acolestdasilva: https://review.openstack.org/#/c/320579/6/test/unit/common/middleware/test_encrypter_decrypter.py@43116:41
patchbotacoles: patch 320579 - swift (feature/crypto) - crypto - purge crypto sysmeta from responses16:41
notmynamejoeljwright: actually I think maybe we can just drop the initial /16:42
joeljwrightnotmyname: I thought that, but if the index.html is there (or #) then the link will break16:42
tdasilvaacoles: thanks!16:42
notmynamejoeljwright: no, it will be relative to the current directory and will replace the index.html16:43
notmynamejoeljwright: which "works" because the whole site is only one level deep. no nested directories16:43
notmynamejoeljwright: except, of course, the version links. so that would probably end up with 2.7.0/2.6.0/2.5.0 etc16:44
joeljwrightnotmyname: it's worth a try!16:44
notmynamealso, it seems there needs to be a little more filtering in the tags too16:44
notmynameeg filtering out 'rc'16:45
notmynamealso, probably should make the first one a link to "current" or something16:45
joeljwrightthat would certainly make more sense16:46
notmynameok. I think that's done.16:47
notmynamenow to figure out the relative links...16:47
joeljwrightI'm hunting in the sphinx docs16:47
*** wasmum has quit IRC16:49
notmynameI don't see anywhere in conf.py (in swift or oslosphinx) where the root is set16:49
notmynameI'm afraid each one may be generated as a local whole-site thing and then simply uploaded to a subdirectory on the server16:52
joeljwrightthat would be… frustrating16:52
*** rledisez has quit IRC16:53
joeljwrightthey do use "/developer/{{ project }}" at the end of the file for page tracking...16:54
joeljwrightbut is "/developer/{{ project }}" always where the docs go for every project?16:55
notmynameoh, good call16:55
*** thumpba has quit IRC16:56
notmynamebetter than what I was thinking (some python in the template like prefix = {{pathto(master_doc)[:len(pathto(master_doc)]}}, assuming that I could even do the template expansion in the python segments16:56
joeljwright:D16:57
notmynamewell, those aren't the right slice offests, but you get the point16:57
joeljwrightyeah, I thought that probably wouldn't pass a code review :)16:57
*** gyee has quit IRC16:58
*** elambert_ has joined #openstack-swift16:59
notmynamepatch 32402416:59
patchbotnotmyname: https://review.openstack.org/#/c/324024/ - oslosphinx - fix other versions sidebar links16:59
*** thumpba has joined #openstack-swift17:01
*** links has joined #openstack-swift17:01
notmynamejoeljwright: seem reasonable to you?17:02
*** sams-gleb has joined #openstack-swift17:03
joeljwrightlooks good to me17:03
joeljwrightwill add my +117:03
joeljwrightnotmyname: just one thing - is 'Other Versions' now correct?17:04
joeljwrightSeems like it's just 'Versions' now17:05
joeljwrightand if I was being really picky, I'd want to know that 'current' means 'current HEAD'17:05
joeljwright:)17:05
*** sams-gleb has quit IRC17:07
notmynameno, current doesn't always mean HEAD17:10
joeljwrightok17:10
notmynamefor libraries it could be last released one17:10
notmynamebut for services it's current HEAD of master17:10
joeljwrightyeah, good point17:10
notmynamejust not for swift/swiftclient ;-)17:10
joeljwrightok, I'll just +1 as it is then :)17:11
joeljwrightdone17:12
*** thumpba has quit IRC17:14
*** StraubTW has joined #openstack-swift17:16
*** klrmn has joined #openstack-swift17:17
*** asettle has quit IRC17:17
*** asettle has joined #openstack-swift17:18
*** ChubYann has joined #openstack-swift17:19
*** StraubTW has quit IRC17:21
notmynameFYI https://bugs.launchpad.net/openstack-manuals/+bug/158800217:25
openstackLaunchpad bug 1588002 in openstack-manuals "Swift missing from OpenStack High Availability Guide" [Undecided,New]17:25
notmynametimburke: ^17:25
*** joeljwright has quit IRC17:33
*** thumpba has joined #openstack-swift17:34
*** SkyRocknRoll has joined #openstack-swift17:34
*** links has quit IRC17:36
*** wasmum has joined #openstack-swift17:42
*** mvk has quit IRC17:48
*** tqtran has joined #openstack-swift17:48
*** arch-nemesis has quit IRC17:50
*** suyash has joined #openstack-swift17:51
*** arch-nemesis has joined #openstack-swift17:51
*** psachin_ has quit IRC17:54
*** jmccarthy1 has quit IRC17:55
*** thumpba has quit IRC17:55
*** mmcardle1 has quit IRC17:56
*** mmcardle has joined #openstack-swift18:00
notmynameonovy: around?18:00
notmynameonovy: for when you read scollback..18:01
notmynameonovy: bad news, I'm afraid. I hadn't forgotten about your request to backport https://review.openstack.org/#/c/270233/ to juno, even though juno is EOL18:02
patchbotnotmyname: patch 270233 - swift - Fix memory/socket leak in proxy on truncated SLO/D... (MERGED)18:02
notmynameonovy: so I was just looking in to that, and, well, it's not going to happen. there's quit a bit of changes that start reaching throughout the system18:02
*** elambert_ has quit IRC18:02
notmynameonovy: it's not at all a small isolated fix, so it's not something I want to pursue further18:03
*** elambert_ has joined #openstack-swift18:04
*** thumpba has joined #openstack-swift18:15
zaitcevoi18:15
zaitcevI just noticed that we don't have an object-expirer.conf-sample18:15
timburkegood morning18:19
zaitcevYet I have a seemingly functional expirer in my cluster with a configuration that came from nowhere.18:22
*** mmcardle has quit IRC18:26
*** mvk has joined #openstack-swift18:39
*** Jeffrey4l has quit IRC18:42
*** Jeffrey4l has joined #openstack-swift18:43
*** mvk_ has joined #openstack-swift18:44
acolestdasilva: your review comment got me trying to figure how a COPY with Range succeeds on master given that the etag for the PUT will be wrong...and it turns out that (perhaps fortuitously) this line has no effect https://github.com/openstack/swift/blob/eda1b330f3cf7bf9dd643854d4a221b6f024884d/swift/common/middleware/copy.py#L477-L47718:46
timburkeacoles: i'd been wondering about that... but more in the context of flattening large objects18:47
*** mvk has quit IRC18:48
acolestdasilva: so your comment here is a valid concern, that we need to be sure not to send an etag in an override header for a ranged COPY https://review.openstack.org/#/c/320579/6/test/unit/common/middleware/test_copy.py@61018:48
patchbotacoles: patch 320579 - swift (feature/crypto) - crypto - purge crypto sysmeta from responses18:48
*** mvk has joined #openstack-swift18:48
*** mvk_ has quit IRC18:48
acolestimburke: I am sure I've seen this req.etag thing done before and we fixed it ?!?18:49
openstackgerritMerged openstack/python-swiftclient: Migrated contributing file from .md to .rst  https://review.openstack.org/31675818:50
acolestimburke: so tdasilva's review comment ^^ takes us back to whether it is safe to "copy" the override sysmeta headers or whether we should purge them on a copy? Seems like the ranged copy is a case when the override etag value will be wrong for the PUT path18:50
acolestimburke: but if that is the case it also suggests we don't have a functional test that does a copy with Range header :/ cos it would fail18:51
*** mvk_ has joined #openstack-swift18:52
* acoles back later for meeting18:53
*** acoles is now known as acoles_18:54
*** ChubYann has quit IRC18:56
*** mvk has quit IRC18:56
notmynamejrichli: the todo list on https://trello.com/b/63l5zQhq/swift-encryption is really short18:59
*** thumpba has quit IRC18:59
*** tqtran has quit IRC19:00
*** thumpba has joined #openstack-swift19:00
*** tqtran has joined #openstack-swift19:00
jrichlinotmyname : yep!  I hope clayg is getting prepared for his 2 weeks of review he spoke to me about in Bristol ;-)19:00
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925019:06
*** ChubYann has joined #openstack-swift19:09
cschwedezaitcev: i see an object-expirer.conf-sample example on master: https://github.com/openstack/swift/blob/master/etc/object-expirer.conf-sample ?19:13
*** SkyRocknRoll has quit IRC19:14
zaitcevcschwede: very mysterious19:14
zaitcevOMG19:15
zaitcevIt was a detached head. I researched something...19:15
zaitcevOh god, never again.19:15
claygjrichli: i recall nothing of the sort19:26
openstackgerritMohit Motiani proposed openstack/swift: Add region in ring structure & deployment guide  https://review.openstack.org/32014619:29
*** permalac has quit IRC19:30
*** Jeffrey4l_ has joined #openstack-swift19:31
*** Jeffrey4l has quit IRC19:34
*** djc_ has joined #openstack-swift19:37
djc_Is there an optimal number of objects per container or is it unlimited?19:37
klamathive heard 500k is a sweet spot19:38
djc_klamath: does latency increase after the 500k object?19:39
klamathperformance starts to suffer, yes19:39
klamathive found 1.7m swift really starts getting bent out of shape in a very small lab i tested on19:39
jrichliclayg: https://media.giphy.com/media/FAX99ve3Egvok/giphy.gif19:40
klamathsharding is always best19:40
djc_klamath: is that because the filesystem on the object server becomes to large?19:41
klamathnot a file system, but a sqlite DB that account/container uses19:41
djc_klamath: can you provide more details on sharding?19:42
klamathits a general idea about multiplexing your writes into multiple containers at once19:43
tdasilvaacoles_: just saw your msgs now, sounds like we missing some func tests in copy19:43
klamathif you can do multiple accounts + containers the better19:43
klamathdjc_: http://www.gossamer-threads.com/lists/openstack/dev/3382019:43
klamathdjc_: if you run your own swift cluster offloading account/container to SSD or even raid0 SSD would help speed up write operations if your going to bin pack containers19:45
*** sheel has quit IRC19:45
djc_klamath: I believe our account/container is on hybrd19:48
klamathouch19:49
djc_klamath: better than hdd (spinning disk) though. :)19:49
klamathi dont think the hybrid part will come into play at all19:50
klamathif it does it might just cause the queue to rise with random seeks as it tries to flush stuff to disk19:50
klamathas always test19:50
openstackgerritMohit Motiani proposed openstack/swift: Add region in ring structure & deployment guide  https://review.openstack.org/32014619:53
claygtorgomatic: it is *so* hard to unravl the iterators on GET these days :'(19:54
claygtorgomatic: lp bug #1568650 is legit tho19:54
openstackLaunchpad bug 1568650 in OpenStack Object Storage (swift) "Connection between client and proxy service does not closes" [High,In progress] https://launchpad.net/bugs/1568650 - Assigned to drax (devesh-gupta)19:54
claygtorgomatic: I can see now that when a backend connection just starts giving up chunks (returns '') that the proxy doesn't really realize that it hasn't given the client all the bytes it promised19:55
djc_klamath: thanks19:56
claygtorgomatic: the code all seems to assume that the backend would give us a ChunkReadTimeout before a '' - but i think if the client is reading slow enough the kernel has enough time to realize the connection is closed and shut it down so there's a clear empty read (signaling end of file) rather than a timeout19:56
claygtorgomatic: I'm pretty sure those part_iter_from_response iteration knows how big the response is going to be - so my thought is to just make the part_file that gets returned known how many bytes it should be able to read and return raise an error rather than return an empty chunk if didn't get all the expected bytes19:58
*** stewie925 has joined #openstack-swift19:58
claygtorgomatic: but I don't know which of the variable names (I guess "length"?) would be the right guy to watch bytes from?19:59
openstackgerritEric Lambert proposed openstack/liberasurecode: Fix clang compile time error  https://review.openstack.org/32408320:03
notmynameelambert_: so you're back in the swift world again?20:05
elambert_notmyname:  yeah but not as part of my day job20:05
*** david-lyle has joined #openstack-swift20:05
notmynameelambert_: ah, ok. swift-as-hobby? ;-)20:06
openstackgerritMerged openstack/python-swiftclient: Fixed a typo in SwiftService API doc  https://review.openstack.org/32397520:06
elambert_:—)20:06
stewie925hello notmyname :)20:06
* tdasilva is driving home, will be back for meeting20:09
notmynametdasilva: watch out for all that crazy traffic in westford20:09
claygnotmyname: i don't get it20:10
notmynameclayg: he said one of the greatest thigns about living there is his commute is like 5 minutes on back-country roads20:10
claygnotmyname: oh i see - so your comment was *sarcastic* - i get it now - funny20:11
claygtimburke: gd, what happened here!?  patch 28020020:30
patchbotclayg: https://review.openstack.org/#/c/280200/ - python-swiftclient - Add copy object method20:30
*** NM has joined #openstack-swift20:31
openstackgerritMerged openstack/swift: crypto - remove version from derived iv_base  https://review.openstack.org/32363620:36
openstackgerritNelson Marcos de Almeida proposed openstack/swift: Adding sorting_method to admin_guide  https://review.openstack.org/32409720:38
*** cutforth has joined #openstack-swift20:43
*** david-lyle has quit IRC20:51
claygis the swift-meeting in like 8 mins?20:52
notmynameclayg: yes20:52
claygk, might be late - ya'll have fun20:52
*** thumpba has quit IRC20:54
torgomaticclayg: oh, I see what you're saying... the object server is running along quickly, so it notices the socket write timed out and kills the connection20:56
torgomaticso then the proxy just gets empty reads on its socket... yeah, that'll goof things up20:56
torgomaticalthough wouldn't the proxy's iterator then just be finished, and all the stuff goes out of scope and gets freed? I don't see why this would cause any sort of socket leak.20:58
notmynamejust about meeting time (#openstack-meeting)20:59
*** acoles_ is now known as acoles20:59
mattoliverauMorning20:59
acolesmattoliverau: o/20:59
*** joeljwright has joined #openstack-swift21:00
*** ChanServ sets mode: +v joeljwright21:00
*** david-lyle has joined #openstack-swift21:01
*** raildo is now known as raildo-afk21:03
*** m_kazuhiro has joined #openstack-swift21:07
claygtorgomatic: right no leak, but the client doesn't realize the proxy isn't going to send more bytes21:09
torgomaticclayg: oh, right. yeah, that's not good.21:09
claygtorgomatic: so a well behaved client will hang on read - while the proxy on the otherhand is waiting on the next pipelined request21:09
openstackgerritMerged openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/32387521:11
*** CarlFK has quit IRC21:17
*** pauloewerton has quit IRC21:32
*** bill_az has joined #openstack-swift21:34
*** NM has quit IRC21:34
*** djc_ has quit IRC21:36
claygtimburke: so the regular PUT Object - Copy docs have less to say about Range headers -> http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectCOPY.html21:37
timburkeclayg: they don't support it. only upload part does. no idea why21:37
claygdoes x-amz-copy-source-range *ever* support multi-range?21:38
claygi guess it looks like it always has to be bytes=x-y - i can't even tell if they support "bytes=-y" or "bytes=x-" ???21:39
claygtimburke: GET requests seem to respect the full range specification?21:39
timburkeclayg: no, they only ever seem to support a single range. i don't remember how well they support the open-ended ranges. and yeah, GET should be able to do all the expected stuff21:40
claygtimburke: could the use-case be covered by - create a SLOrange - then COPY the SLOrange to a new object?!21:43
timburkeclayg: which use-case? probably? but it adds even more steps to the operation21:45
claygbut... on the plus side - well defined and we don't have to hi-jack any existing HTTP/WebDav symantics or invent new headers to remain un-ambiguous!21:49
notmyname ranged copy question added to next week's agenda22:00
acolesgood night22:00
*** CaioBrentano has quit IRC22:00
*** CaioBrentano has joined #openstack-swift22:01
*** acoles is now known as acoles_22:01
*** david-lyle has quit IRC22:01
torgomatichuh, I wonder if the support for x-amz-copy-source-range on S3's Upload Part request is their way of matching SLO + ranges22:01
claygnotmyname: you should tell tom to add this to a wiki page somewhere -> https://hbr.org/resources/images/article_assets/2015/11/R1512E_MEYER_COUNTERPART.png22:02
claygvery good stuff22:02
claygtorgomatic: totally!22:02
notmynameclayg: the crazy thing is that we have people from ALL FOUR quadrants!22:02
notmynamenormally in the same room at the same time22:02
notmynameit's amazing anything gets done at all ;-)22:03
claygtimburke: I've often considered if a SLO request really need be stored in swift?  DLO too?  What if you could just give swift a body defining the manifest and it responded back with the bytes!?  May lead way for a COPY request that's more POST like - you give me the read plan and I will a) give you the bytes b) store the bytes in the location of your choosing22:04
claygnotmyname: +1 it's impossible to explain22:04
notmynameclayg: and FWIW I don't think you fit the "right in the middle" model that your US-ness would indicate ;-)22:05
claygnotmyname: I want to totally cross reference comments in my reviews for upgraders downgraders now - I'm freaking out how many times kota_ has told me "I'm not sure I fully agree here" and I mis-read that like I would have wrote it instead of translating to something I would have said like "this is completly broken"22:05
timburkeclayg: that's an interesting idea...22:05
*** sams-gleb has joined #openstack-swift22:08
*** sams-gleb has quit IRC22:12
openstackgerritMerged openstack/swift: Send correct size in POST async update for EC object  https://review.openstack.org/31747522:15
notmynameyay22:15
notmynameactually, I think that's the last thing I was waiting for before doing a release22:16
notmynameI should do the authors/changelog updates22:16
*** david-lyle has joined #openstack-swift22:16
*** StraubTW has joined #openstack-swift22:19
*** m_kazuhiro has quit IRC22:22
*** StraubTW has quit IRC22:23
*** ametts has quit IRC22:30
*** darrenc is now known as darrenc_afk22:32
*** joeljwright has quit IRC22:37
*** darrenc_afk is now known as darrenc22:39
*** MikeG451 has quit IRC22:40
stewie925hi notmyname22:41
notmynamehi22:46
*** cutforth has quit IRC22:47
stewie925hi I'm trying to continue working on that https://review.openstack.org/#/c/319988/22:54
patchbotstewie925: patch 319988 - swift - get_part_nodes should raise error on invalid part22:54
stewie925to test that ValueError is raised if the 'part' value is not within range22:56
*** arch-nemesis has quit IRC22:57
stewie925two lines of code   #1   part = -1    #2 self.assertRaises(ValueError,get_part_nodes(part))22:57
notmynameok22:58
stewie925oops - got pep8 error , fixing it23:03
*** tqtran has quit IRC23:03
timburkestewie925: i think you want self.assertRaises(ValueError,get_part_nodes, part) - assertRaises expects the first arg to be an exception, the second arg to be a callable, and passes everything else to the callable; as you've got it now, it will call get_part_nodes (and presumably raise a ValueError) before ever entering assertRaises23:06
stewie925oh hi timburke, thank you!23:07
*** NM has joined #openstack-swift23:13
stewie925I have run tox -e py27 tests for my changes...   git diff in http://paste.openstack.org/show/507053/   and test results (with error) in http://paste.openstack.org/show/507052/23:26
*** fbo has quit IRC23:26
stewie925hi timburke and notmyname - your inputs are appreciated :)23:32
*** diogogmt has quit IRC23:33
openstackgerritSamuel Merritt proposed openstack/swift: Support binding to Unix domain sockets.  https://review.openstack.org/32413623:33
*** kei_yama has joined #openstack-swift23:34
notmynametorgomatic: interesting. I figured that would be a bigger patch23:34
torgomaticnotmyname: the hard work's all in eventlet23:35
torgomaticalso, you can't test it yet without my fork of eventlet, so let me go indicate that23:35
claygstewie925: it's sort of a hozer - in obj.test_reconstructor the policies get some fake rings assigned to them and the replica2part2dev tables are sort of bullshit23:38
stewie925hello clayg23:38
claygit says the intended_part_shift is 30, but then it only assins parts 0, 1, 2 - so 3 blows up23:38
*** nadeem has quit IRC23:39
stewie925oh I see23:40
claygstewie925: try this -> https://gist.github.com/clayg/500e4330362151a2fc239da4045ba9b223:44
claygstewie925: i'm not quite sure how the test_delete_policy_override_params one is related23:45
stewie925hi thank you clayg, let me apply this patch and run the test again23:46
claygstewie925: I think that second test is acctually showing you something worth thinking about - the code int he replicator that uncovered this error is sort of annoying - I think if you raised a really specific InvalidPartitionError (not inherit from ValueError) it would break out of the code path better and you could see why the dir for part "99" isn't getting cleaned up23:51
claygstewie925: but really the fix is in that block in the replicator that blowing up - it should handle the exception from get_part_nodes a little better - but i'm not even sure what the desired behavior would be?23:52
claygin the one case i know of where someone found this case in a real deployment it was a lab environment where they had some left over data on their object devices from a previous ring - and it was cirtainly correct to remove them - but I'm not sure that's generally a defnesible behavior - maybe quarantine?23:53
claygdefinately want to log a more specific error23:53
claygeither way I think it throws weight towards maybe *not* subclassing ValueError - although i'm not sure what that code path *thought* it was handling?23:54
*** _JZ_ has quit IRC23:56
*** _JZ_ has joined #openstack-swift23:57
stewie925oh I see , yikes23:57
*** _JZ_ has quit IRC23:58
*** david-lyle has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!