Friday, 2016-01-29

*** haomaiwang has quit IRC00:01
*** haomaiwa_ has joined #openstack-swift00:01
*** nadeem has joined #openstack-swift00:06
*** dmorita has quit IRC00:18
*** diogogmt has quit IRC00:21
*** kei_yama has quit IRC00:24
*** kei_yama has joined #openstack-swift00:25
*** dmorita has joined #openstack-swift00:26
*** zhill has joined #openstack-swift00:27
*** nadeem has quit IRC00:28
*** nexusz99 has quit IRC00:30
*** bill_az_ has quit IRC00:33
*** vinsh has joined #openstack-swift00:41
*** vinsh_ has quit IRC00:41
*** arch-nemesis has quit IRC00:43
*** takashi has joined #openstack-swift00:45
*** chlong has joined #openstack-swift00:49
*** m_kazuhiro has joined #openstack-swift00:50
openstackgerritReedip proposed openstack/swift-bench: TrivialFix of Import JSON  https://review.openstack.org/27339600:54
*** marcusvrn_ has quit IRC00:57
*** urth has quit IRC00:57
*** urth has joined #openstack-swift01:00
*** haomaiwa_ has quit IRC01:01
*** 6JTAABUFK has joined #openstack-swift01:01
*** zhill has quit IRC01:03
kota_good morning01:05
takashikota_: good morning01:06
*** garthb has quit IRC01:09
*** mragupat has quit IRC01:18
*** 6JTAABUFK has quit IRC01:27
*** zul has joined #openstack-swift01:30
openstackgerritJanie Richling proposed openstack/swift: Change POST-as-COPY to preserve the DLO manifest contents  https://review.openstack.org/25279101:30
*** aerwin3 has quit IRC01:31
*** yarkot has quit IRC01:32
*** aerwin3 has joined #openstack-swift01:33
*** rvasilets__ has quit IRC01:36
*** nadeem has joined #openstack-swift01:39
*** nadeem has quit IRC01:44
*** Jeffrey4l has joined #openstack-swift01:48
ZyricWhen an auditor completes a device or goes to start from an incomplete audit data needs to be stored/retrieved, but from where?01:53
*** baojg has joined #openstack-swift01:53
*** mrmoje has quit IRC02:00
*** bill_az has quit IRC02:06
*** changbl has quit IRC02:09
*** zul has quit IRC02:13
*** 18WABXJHL has joined #openstack-swift02:14
openstackgerritTakashi Kajinami proposed openstack/swift: Fix proxy-server's support for chunked transferring in GET object  https://review.openstack.org/25620102:29
*** gmmaha has quit IRC02:32
*** gmmaha has joined #openstack-swift02:32
openstackgerritClay Gerrard proposed openstack/swift: Fix rings again  https://review.openstack.org/27385002:46
clayg^ the fun never ends!02:46
claygahale: wasn't I just braging that the current placement is so %$#ing baller?  Stupid old rings are *hard*02:47
claygtorgomatic: didn't you like fuzz test the ring last go round looking for stuff like this?  surely you managed to test a ring with 3 replicas all on the same device - sigh.02:48
*** ho_ has joined #openstack-swift02:48
clayganyway - i hope no else had squirlled away a really really really bad ring because master may refuse to rebalance it (still improvement over doing it wrong?  dunno :P)02:48
*** yarkot has joined #openstack-swift02:48
*** mingdang1 has joined #openstack-swift02:49
*** okdas has quit IRC02:50
*** okdas has joined #openstack-swift02:52
*** okdas has joined #openstack-swift02:52
*** 18WABXJHL has quit IRC03:01
*** haomaiwang has joined #openstack-swift03:01
openstackgerritClay Gerrard proposed openstack/python-swiftclient: Tighten up to just rounding error  https://review.openstack.org/27385403:05
redboI think part of what ahale is seeing is that if you have one zone that's smaller than the others, it can get proportionately too many handoffs.  The ring sort of tries to put handoffs as far from the primaries as possible, even if the farthest place isn't very big.03:05
claygtimburke: OMG pach 269891 so many times - so annoying03:08
claygpatch 269891 even03:08
patchbotclayg: https://review.openstack.org/#/c/269891/ - python-swiftclient - Prevent test runs from cluttering current directory03:08
claygredbo: yeah for sure that's got to be some if - but if we work so hard to carefully distribute parts and then you have a server down causing this one node in this one zone to *also* fall over - that's pretty not great03:09
*** kei_yama has quit IRC03:11
claygredbo: not sure if that means picking handoffs needs to follow the parts and ignore the failure domains - or if it just needs to pick the possible tiers to try and "far away from the primaries" to dig into by weight?03:12
clayglike if you have a replica in z1 z2 z3 and z1 is down we go to z4 - but maybe if the first dev you try in z4 is done you try another one before going to z5?  I don't even know for sure that another device in z1 would have been so bad....03:13
claygI think gholt sort of thought about maybe handoffs could work like this and it got us this far so no one has really thought about it too much since?03:13
redboI think that's our problem, we have a smaller cluster and one zone only has one node in it, and it gets a disproportionate number of handoffs.03:15
redboPutting handoffs as far away as possible makes some sense, but maybe having a different strategy would be good in some cases.  Like skip the region and zone check?  I'm not sure if mixing different sized servers could still be a problem then.03:16
claygredbo: cool, i'm down - let me know what I can do03:20
claygredbo: you gunna make it to Bristol or are you just sending ahale !?03:20
claygho_: hey i got keystone-swift-all-in-one to finish provisioning and it even has keystone running!?03:21
redboI don't think I'm going, someone said mumble mumble budget mumble mumble.03:21
claygho_: where's my keystone.rc that I can source so I can use this bad boy!03:21
claygredbo: yeah I odn't know what joker thought it was a good idea to have our mid-cycle in another country!?  ;)03:22
*** SkyRocknRoll has joined #openstack-swift03:22
*** proteusguy_ has quit IRC03:24
mingdang1@kota_  hello, good evening03:27
*** venkat has joined #openstack-swift03:27
ho_clayg: hello, i use keystone-all command to start it (https://github.com/osanai-hisashi/vagrant-swift-all-in-one/blob/keystone-auth/cookbooks/keystone/recipes/configs.rb)03:27
venkatHi all03:27
ho_clayg: i think keystone is running. you can confirm with the script (sh /vagrant/scripts/check_with_keystone.sh)03:28
venkatI configured the  max_containers_per_account = 50  in proxy-server.conf03:28
venkatbut it is not working as expected,03:29
venkatstill I am able to create more than 50 containers03:29
claygyeah but like how do I get a export OS_AUTH_URL= blah blah blah script?03:29
venkat:Q03:29
claygvenkat: do you have the quota middlware installed?03:30
claygvenkat: do you have the container-updater running?03:30
claygvenkat: the account quota is not quite so tight as the container quota03:30
kota_mingdang1: hello03:31
claygho_: like I don't know what my username domainname passoword auth_url - any of that03:31
claygho_: i'll have to take your response async - i'm off!03:31
ho_clayg: ok, i will response later. good night!03:32
mingdang1@kota_  I have a question,how create a ring need a power ** n, how to determine the n?03:33
kota_mingdang1: depends on the number of disks you expect to extend.03:33
mingdang1@kota_  have any common rule?03:34
kota_from case stady (i forgot the reference though), it's good that a disk has more than 100 partition.03:34
*** proteusguy_ has joined #openstack-swift03:36
mingdang1ok,thanks03:36
*** trifon has joined #openstack-swift03:38
kota_mingdang1: basically too large part power wastes CPU power but too small part power causes big replication stream at once.03:38
kota_mingdang1: it's tradeoff relation.03:38
kota_assuming 1TB disk which has 100 partition, we have to move data 1/100 TB at least in rebalancing because swift control the data placement by partition.03:39
mingdang1yeah ,I understand, thank you03:41
kota_if you have large disks (e.g. 8TB?) it might be good to add more partitions for each device.03:41
kota_mingdang1: good luck :-)03:41
venkat<clayg> : container-updater is not running03:43
claygmingdang1: kota_: I think the old recommendations of "imagine how big your cluster is going to be someday" have caused folks a lot of problems - it's not what I recommend -> https://gist.github.com/clayg/687984003:43
claygvenkat: well I guess the count of *containers* is going to be up-to-date at the account layer even without the updaters03:44
venkatclayg : I have container-quotas account-quotas middleware enabled03:44
claygso - dunno03:44
claygvenkat: sorry I don't have a setup with those enabled handy - and I was going to leave like 10 mins ago anyway :P03:45
venkatyeah container-updater is required for updating object-count03:45
kota_clayg: cool03:45
venkatOk, Thanks03:45
claygkota_: try not to read the code - i suck at math - but the answer is reasonable03:46
kota_clayg: yeah, you know I tried to read :-)03:46
kota_looks like more paritions rather than 100, we need, with the tool.03:51
kota_around 5000-10000 is reasonable? not sure.03:52
claygkota_: you gotta push it a little bit when you're starting out to give you some room to grow03:52
claygand yes 5K is totally reasonable 10K is getting highish03:52
claygIME03:53
kota_clayg: gottcha, thx03:53
claygkota_: the problem with https://rackerlabs.github.io/swift-ppc/ - is that it targets 100 parts when you're at your "maximum" drives - but no one is good about picking maximum03:53
kota_clayg: exactly03:54
claygso I pick "maximum parts on your disks *NOW*" as something that will not be entirely uncomfortable and show you how far you can get with that before dispersion *might* start becoming an issue for you (depends how lumpy your dataset is)03:54
kota_yeah03:56
claygkota_: you should clean that script up and fix it so the replica count and w/e is paramaterized!03:56
claygmaybe we could even track down pandemicsyn and do a PR to https://rackerlabs.github.io/swift-ppc/ !?03:57
claygg'night03:57
kota_clayg: have a good sleep, thx :)03:58
*** haomaiwang has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
*** kei_yama has joined #openstack-swift04:02
*** trifon has quit IRC04:04
ho_takashi: one question about patch 261395. I would like to know the reason why you write v2.3 for keystonemiddleware.04:23
patchbotho_: https://review.openstack.org/#/c/261395/ - swift - Update parameters about authtoken middleware in pr...04:23
*** trifon has joined #openstack-swift04:27
takashiho_: That's because v2.3 is bundled in ubuntu OpenStack Liberty and I think we can regard it as liberty keystonemiddleware.04:27
takashiho_: As acolses_ commented, it also works with 4.1.0 . But I wonder if we should bump up for each version, and I selected to bump up for each major release in OpenStack.04:29
takashisorry for my typo :-( acoles_04:30
ho_takashi: please see https://launchpad.net/keystonemiddleware/+series04:31
takashitakashi: Oh, I understand what you want to say04:32
takashinot for me, but for ho_04:32
takashi:-(04:32
ho_takashi: i have no clear answer but i need to have consistent thought for this.04:33
ho_takashi: s/i need/we need/04:33
takashiho_: I think what we have to do now, is find information about its version in stable/liberty blanch https://github.com/openstack/keystonemiddleware/tree/stable/liberty04:37
ho_takashi: the versio of this brach is 2.3.0 right? does min version mean a version when the new format supports or stable liberty?04:41
*** trifon has quit IRC04:42
takashiho_: I still can't find any version information in stable blunch ... :-(04:47
ho_takashi: yeah, liberty cycle is started from 1.6.004:52
ho_takashi: https://launchpad.net/keystonemiddleware/liberty04:52
takashiho_: based on the release date, 2.3.1 is more appropriate for 2015.2.0 . It is the last release before Liberty release date.04:55
takashi2015.2.0 means the first Liberty release04:56
*** SkyRocknRoll has quit IRC04:57
takashiho_: 2.3.2 may be something like 2015.2.1, which is the liberty version with some fixes.04:57
venkatHi all04:58
venkatcontainer_count is not updated properly at proxy level04:58
venkathttps://github.com/openstack/swift/blob/master/swift/proxy/controllers/container.py#L15204:58
*** bill_az has joined #openstack-swift04:58
ho_takashi: yeah, is it possible to remove the version from doc? if we write version, i would like to have a min version (a version when current format support)04:58
venkatmax_containers_per_account  in /etc/swift/proxy-server.conf05:00
venkatis not working as expected..05:00
venkatwhy?05:00
*** haomaiwang has quit IRC05:01
*** haomaiwa_ has joined #openstack-swift05:01
takashiho_: I don't agree with removing version, because It help us to know in which version it is tested. It is added based on John's comment in review, and Alistair also agree with that idea.05:02
ho_takashi: i just read the comment but they didn't say libery right?05:03
ho_takashi: s/libery/liberty/05:03
takashiho_: yes. and I think you can change what version to write.05:03
takashis/you/we05:04
ho_takashi: yeah, we might have two choise  (1) check support combinations keystonemiddleware and swift for writing the version or (2) check the version when new format support05:09
ho_takashi: i prefer (2)05:10
*** chlong has quit IRC05:12
*** yatin has joined #openstack-swift05:12
takashivery difficult problem...05:15
takashiho_: I don't like (2). I'm wondering if keystone team will support that version.05:16
takashiWe had better add the supported minimum version. Kilo is going to enter into eol state in next release, and adding a Liberty version makes sense to me.05:17
ho_takashi: as for the keystoneclient (not keystonemiddleware), we support >=1.3.0 in test-requirement.txt. that means we support kilo level from swift point of view. If we choose approach (1), we have to support 2 cycles (liberty and kilo) in this case we write kilo version???05:21
ho_takashi: if we write a version of kilo for the doc, it is consistent b/w keystoneclient and keystonemiddleware.05:23
takashiho_: OK. I understand the situation.05:25
takashiho_: Could you give me a time? I'll reconsider about this again.05:26
takashiho_: And I have not so much time to do now... :-(05:28
takashiho_: Do you have any requirements about that? I know you are working about keystone stuff, RBAC.05:28
ho_takashi: np! and i have no request for this.05:29
takashiI mean, do you have any requirements about the written version.05:29
takashiho_: OK. Thanks for you comment.05:29
ho_takshi: sorry for mis-understanding. if we write a version on the doc, at least it's better to take care about kilo version. thanks for your time :-)05:31
*** chlong has joined #openstack-swift05:32
takashiho_: I see. and I'm also starting to wonder when we shoud bump up the minimum version to Libery... after Mitaka get released?05:33
takashivenkat: One small thing. Can you get the right container listing when you get the account?05:34
*** kei_yama has quit IRC05:36
*** kei_yama has joined #openstack-swift05:37
*** SkyRocknRoll has joined #openstack-swift05:40
openstackgerritMerged openstack/swift: Let equal Timestamps not be unequal  https://review.openstack.org/27367705:42
*** ppai has joined #openstack-swift05:44
*** trifon has joined #openstack-swift05:47
*** asettle has quit IRC05:47
ho_takashi: i left a comment on gerrit. thanks for your time again!05:55
*** km has quit IRC05:59
*** km has joined #openstack-swift06:00
*** haomaiwa_ has quit IRC06:01
*** haomaiwang has joined #openstack-swift06:01
*** yatin has quit IRC06:05
*** yatin has joined #openstack-swift06:06
*** yatin has quit IRC06:06
openstackgerritKota Tsuyuzaki proposed openstack/swift: Refactor versioned_writes middleware  https://review.openstack.org/20931506:10
*** ChubYann has quit IRC06:15
mattoliverauvenkat: what are you seeing?06:16
mattoliverauvenkat: I think its more of a soft limit, as account metadata is cached in the proxy, etc.06:16
*** ChanServ sets mode: +v cschwede06:16
venkat<mattoliverau> : container_count it is shwoing  wrong even though it has  more number of conatiners06:18
venkatduring the check06:18
*** chlong has quit IRC06:28
*** rcernin has quit IRC06:29
*** bkumar has joined #openstack-swift06:30
*** bill_az has quit IRC06:30
openstackgerritKota Tsuyuzaki proposed openstack/swift: CompositeRing Support  https://review.openstack.org/27192006:35
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload  https://review.openstack.org/26899306:35
*** chlong has joined #openstack-swift06:39
*** Jeffrey4l has quit IRC06:44
*** Jeffrey4l has joined #openstack-swift06:57
*** haomaiwang has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** Jeffrey4l has quit IRC07:14
*** zaitcev has quit IRC07:16
*** ntt has joined #openstack-swift07:19
*** rcernin has joined #openstack-swift07:25
*** klrmn has quit IRC07:26
*** chlong has quit IRC07:32
*** Jeffrey4l has joined #openstack-swift07:37
*** dmorita has quit IRC07:39
*** dmorita has joined #openstack-swift07:41
*** dmorita has quit IRC07:42
*** dmorita has joined #openstack-swift07:44
*** dmorita has quit IRC07:48
openstackgerritMerged openstack/python-swiftclient: mock time in unit test  https://review.openstack.org/27380107:56
*** rledisez has joined #openstack-swift07:59
*** haomaiwang has quit IRC08:01
*** arnox has joined #openstack-swift08:01
*** haomaiwang has joined #openstack-swift08:01
*** geaaru has joined #openstack-swift08:04
*** nakagawamsa has joined #openstack-swift08:33
*** bkumar has quit IRC08:35
*** cbartz has joined #openstack-swift08:51
*** venkat has quit IRC08:57
*** diogogmt has joined #openstack-swift09:00
*** zul has joined #openstack-swift09:00
*** haomaiwang has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
nttHi, I'm trying to change the proxy-storage network and storage-replication network in a running swift cluster. I'm creating a completely new ring for accounts,containers and objects with the same number of replica, partitions, regions and zones in a separate folder. Then I add disks with the same weight as the cluster in production and then I rebalance09:04
nttFinally I copy files in /etc/swift. Is this the right procedure?09:05
nttI tried this in a dev environment and all seems to work09:06
*** trifon has quit IRC09:07
nttFurthermore, I changed the bind_ip in each service (object,container,account...)09:07
*** trifon has joined #openstack-swift09:08
onovyntt: no09:18
onovyyou shouldn't replace whole ring in cluster09:18
onovyi should edit it09:18
onovyif you create completly new cluster, many (almost every?) partition will be on wrong place09:19
nttso I need to copy *.builder files in a separate folder and then work with them?09:19
*** acoles_ is now known as acoles09:23
nttonovy: How can I change networks in a running cluster without rebuild the entire ring?09:26
acolesclayg: no iff would be it=fg=f09:27
*** jistr has joined #openstack-swift09:30
acolesclayg: in case US keyboard layout is different, = is right next to backspace on mine ;)09:31
*** m_kazuhiro has quit IRC09:31
*** km has quit IRC09:32
*** venkat has joined #openstack-swift09:37
*** links has joined #openstack-swift09:38
*** links has quit IRC09:38
*** mrmoje has joined #openstack-swift09:41
acolesonovy: did you get an answer re updating metadata? basically, you got it right, if you want to change a subset of metadata but leave some in place, you need to do a COPY. POST will change the entire set of metadata.09:43
acolesonovy: (where metadata in this context == x-object-meta-*)09:43
acolesho_: takashi what did you agree about specifying keystonemiddleware versions?09:44
ho_acoles: nothing agreed b/w us but we have same understanding for writing the version :-)09:55
acolesho_: ok. thanks!09:55
*** haomaiwang has quit IRC10:01
*** haomaiwa_ has joined #openstack-swift10:01
ho_acoles: do we have clear rule for supporting version of keystonemiddleware (2 cycles)?10:07
acolesho_: no, not that I am aware of10:09
acolesho_: imho, unless there's agood reason, it's good to maintain compatibility with older versions, rather than be zealous about removing support10:10
*** jordanP has joined #openstack-swift10:11
acolesho_: so for example with your patch 201461 we do not remove support for the deprecated headers10:11
patchbotacoles: https://review.openstack.org/#/c/201461/ - swift - Improve Keystone v3 token support10:11
*** ppai has quit IRC10:12
acolesho_: but in our example config options, I do not think we need to specify deprecated options10:12
*** Razva has joined #openstack-swift10:12
RazvaThe request signature we calculated does not match the signature you provided. Check your key and signing method. < any idea of how to fix this...?10:12
acoleseven though they might still work10:12
*** mrmoje has quit IRC10:13
ho_acoles: oh, i got -1 (i have to check) yeah, your thought is simple and easy to get understanding from others10:13
Razvafrom the log: ERROR WSGI: code 400, message Bad request syntax10:13
acolesho_: yeah, sorry! the -1 is for the tests though10:14
*** mrmoje has joined #openstack-swift10:14
ho_acoles: np! thanks for the review. :-)10:14
acolesRazva: what's the context? are you attempting to use a tempurl maybe? perhaps the tempurl keys don't match or the signature has expired?10:15
Razvaacoles well here's the issue. the swift server is "functional", as you can see here: http://video.storage.provideofactory.com:8080/v1/AUTH_23eba19369104be595361d882da4d1a8/video10:20
RazvaBUT I cannot find any way to connect to it via a S3 client. I've tried even locally, with s3curl10:20
*** Jeffrey4l has quit IRC10:21
Razvaproxy-server swift3 is in proxy-server.com10:21
Razva*conf10:21
Razvaalong with use = egg:swift3#swift310:21
ho_takashi: acoles: a min version on the doc might be "version when the options support".10:22
Razvaif I connect with the "EC2" credentials (from compute) I get "The request signature we calculated does not match the signature you provided". If I connect with the "API" credentials (from security -> api) I get "Access denied".10:22
Razvawhat is wrong here...?10:22
*** ppai has joined #openstack-swift10:25
acolesRazva: sorry, I have no expereince with swift3/s3 - maybe kota_ can help if he's still around? he may have gone though10:27
acolesRazva: or ask again later when US wakes up10:28
*** haomaiwa_ has quit IRC10:33
*** venkat has quit IRC10:37
*** mingdang1 has quit IRC10:38
*** mingdang1 has joined #openstack-swift10:38
*** mingdang1 has quit IRC10:43
*** mrmoje has quit IRC10:43
*** mrmoje has joined #openstack-swift10:46
openstackgerritHisashi Osanai proposed openstack/swift: Improves RBAC related functional test  https://review.openstack.org/25337110:47
nttSomeone can help me with "swift-ring-builder set_info" command? Actually it gives me an error :"Invalid set info change value"10:56
ho_ntt: you hit this line https://github.com/openstack/swift/blob/a66e5733dd8849118474c2f35921f5e51fbdb483/swift/cli/ringbuilder.py#L356 it seems format of specified value for changing is not correct11:02
nttho_ solved (typo).11:02
nttho_: after a set_info should I do a write_ring?11:03
nttThis command generate new *.ring.gz files?11:03
*** aix has joined #openstack-swift11:04
*** Jeffrey4l has joined #openstack-swift11:06
*** Jeffrey4l has quit IRC11:06
*** Jeffrey4l has joined #openstack-swift11:06
*** asettle has joined #openstack-swift11:07
*** Jeffrey4l has quit IRC11:08
*** Jeffrey4l has joined #openstack-swift11:08
ho_ntt: you need to do write_ring and update current ring file11:10
*** asettle has quit IRC11:12
nttho_: ok... I can do write_ring in a temporary folder and then scp files over all cluster. Right?11:12
ho_ntt: i think so11:13
nttthanks11:15
*** zul has quit IRC11:15
nttho_: I tried to copy only account files, but I don't see any message in the log. Is this correct? should I restart account services?11:17
*** SkyRocknRoll has quit IRC11:20
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Fix intermiitent fail of test_delete_account  https://review.openstack.org/27401611:20
ho_ntt: i forgot time (15s) to reload a ring in a server but every 15 sec the server reload the ring.11:20
*** baojg has quit IRC11:20
nttOk, so I don't need to restart services11:20
ho_ntt: sorry, but english...11:20
ho_ntt: yep11:20
*** baojg has joined #openstack-swift11:20
ho_clayg: as for the users in keystone vsaio, there is no info about it so I will update vsaio later.11:23
*** baojg has quit IRC11:25
*** jmccarthy has quit IRC11:26
*** jmccarthy has joined #openstack-swift11:27
ho_clayg: OS_AUTH_URL=http://127.0.0.1:5000/v311:28
ho_clayg: user info for OS_USERNAME is http://paste.openstack.org/show/405097/11:28
ho_clayg: user info for OS_PASSWORD is "testingX". X is No. in the paste but there is one exception. The password of "tester" user is "testing"11:30
ho_clayg: you can see these info in /etc/swift/test.conf11:31
pdardeaugood morning11:44
*** kei_yama has quit IRC11:44
onovyacoles: thanks for reply11:50
onovyntt: you can edit devices in ring (change ip for example)11:50
nttonovy: yes.... I used set_info and then write_ring11:50
onovyyep, that's it11:51
nttno need to rebalance11:51
nttjust copy files in /etc/swift11:51
onovyyes11:51
onovyif you didn't change weight, or add/delete devices, rebalance is not needed11:51
nttFurthermore I need to restart services because I need to change ip addresses (bind param in config files)11:51
onovyyes, ideally use SIGHUP (swift-init reload)11:51
Razvaguys, I've successfully installed Swift but there's no way I can make S3 API work...I'm struggling for 3 days... :|11:52
nttok. Today I will do on production server11:52
onovygood luck11:52
RazvaI've installed the proxy, configured proxy-server.conf...nothing!11:52
nttthanks :)11:52
*** mrmoje has quit IRC12:03
*** ho_ has quit IRC12:05
pdardeauRazva: siva_krishnan has been working with swift3/s3 lately, maybe he can help when he comes online12:06
*** daemontool has joined #openstack-swift12:15
*** rcernin has quit IRC12:18
*** rcernin has joined #openstack-swift12:18
openstackgerritMerged openstack/python-swiftclient: Prevent test runs from cluttering current directory  https://review.openstack.org/26989112:26
*** d0m has joined #openstack-swift12:31
*** zul has joined #openstack-swift12:35
*** asettle has joined #openstack-swift12:36
*** d0m has quit IRC12:38
*** asettle has quit IRC12:40
openstackgerritChristopher Bartz proposed openstack/swift: tempurls with a prefix-based scope  https://review.openstack.org/27404812:42
*** trifon has quit IRC12:50
openstackgerritChristopher Bartz proposed openstack/swift: tempurls with a prefix-based scope  https://review.openstack.org/27404813:10
*** kragniz has quit IRC13:12
*** mrmoje has joined #openstack-swift13:18
*** kragniz has joined #openstack-swift13:18
*** asettle has joined #openstack-swift13:25
*** changbl has joined #openstack-swift13:27
*** daemontool has quit IRC13:29
*** mingdang1 has joined #openstack-swift13:29
*** asettle has quit IRC13:30
*** Jeffrey4l has quit IRC13:34
*** Jeffrey4l has joined #openstack-swift13:36
*** daemontool has joined #openstack-swift13:47
*** diogogmt_ has joined #openstack-swift13:47
*** diogogmt has quit IRC13:48
*** diogogmt_ is now known as diogogmt13:48
*** daemontool has quit IRC13:56
*** mrmoje has quit IRC13:56
*** daemontool has joined #openstack-swift13:57
*** ppai has quit IRC14:00
*** diogogmt has quit IRC14:06
*** baojg has joined #openstack-swift14:20
*** diogogmt has joined #openstack-swift14:21
*** baojg has quit IRC14:25
*** diogogmt has quit IRC14:25
*** ppai has joined #openstack-swift14:34
openstackgerritAlistair Coles proposed openstack/swift: Change in-process func tests to use fast-post  https://review.openstack.org/27408614:37
*** mrmoje has joined #openstack-swift14:46
*** blmartin has joined #openstack-swift14:48
acolesnotmyname: ^^ may warrant discussion at next week's meeting.14:50
acolesnotmyname: ironically, I now have a functional test that passes with fast-post but fails with post-as-copy so can't include in my fast-post patch :P14:52
*** haomaiwang has joined #openstack-swift14:55
*** haomaiwang has quit IRC15:01
*** 14WAAUYA5 has joined #openstack-swift15:01
*** bill_az has joined #openstack-swift15:01
*** fesp has joined #openstack-swift15:06
*** jaakkos has joined #openstack-swift15:08
*** fesp has quit IRC15:09
*** cbartz has left #openstack-swift15:10
*** thebloggu has joined #openstack-swift15:12
*** baojg has joined #openstack-swift15:16
*** joeljwright has joined #openstack-swift15:22
*** ChanServ sets mode: +v joeljwright15:22
RazvaI get Error: Unable to retrieve container list.15:22
Razva[filter:keystone]15:22
Razvaoperator_roles = admin, SwiftOperator15:22
*** Microwise has joined #openstack-swift15:23
Razvathe user has assigned the SwiftOperator role. I even gave him Admin but there's no way for the user to see the buckets...15:23
Razvaany hints, please?15:23
theblogguis it possible for me to choose which endpoint (I have a swift cluster running over http and https) a swiftclient.Connection should use?15:26
*** mingdang1 has quit IRC15:28
openstackgerritAlistair Coles proposed openstack/swift: Trivial fix for sphinx warnings  https://review.openstack.org/27411515:31
*** barker has joined #openstack-swift15:34
*** garthb has joined #openstack-swift15:35
acolesthebloggu: you might be able to select endpoint --os-endpoint-type option, I *think* that may select between public/internal etc. Or maybe by having endpoints in different regions and --os-region-name. I've never tried it though.15:35
RazvaHAH, I almost fixed it!!!15:35
*** mrmoje has quit IRC15:35
Razvalast issue: if I connect using the IP everything works. if I connect using the hostname it states "The request signature we calculated does not match the signature you provided. Check your key and signing method."15:36
jaakkosis the container GET (list) request complexity O(number of objects) even if filters are specified?15:37
jaakkoseg. i want to only get objects in a particular pseudo-path15:38
*** barker has quit IRC15:38
*** baojg has quit IRC15:45
*** barker has joined #openstack-swift15:46
*** mragupat has joined #openstack-swift15:47
*** bill_az_ has joined #openstack-swift15:51
theblogguacoles, ok, thanks, I think you're right15:52
*** baojg has joined #openstack-swift15:55
*** jordanP has quit IRC15:57
*** klrmn has joined #openstack-swift15:57
*** 14WAAUYA5 has quit IRC16:01
*** haomaiwang has joined #openstack-swift16:01
*** barker has quit IRC16:02
*** barker has joined #openstack-swift16:03
*** ppai has quit IRC16:09
*** barker has quit IRC16:10
*** mgarza has joined #openstack-swift16:14
*** Razva has quit IRC16:14
*** alejandrito has joined #openstack-swift16:19
*** diogogmt has joined #openstack-swift16:22
*** nadeem has joined #openstack-swift16:26
*** diogogmt has quit IRC16:26
*** rcernin has quit IRC16:27
*** Microwise has quit IRC16:30
*** esker has joined #openstack-swift16:32
*** dmorita has joined #openstack-swift16:43
*** stantonnet has joined #openstack-swift16:44
*** dmorita has quit IRC16:48
*** bjkeller has joined #openstack-swift16:49
*** nadeem has quit IRC16:50
openstackgerritAlistair Coles proposed openstack/swift: Change POST-as-COPY to preserve the DLO manifest contents  https://review.openstack.org/25279116:50
*** nadeem has joined #openstack-swift16:51
*** klrmn has quit IRC16:51
openstackgerritAlistair Coles proposed openstack/swift: Change POST-as-COPY to preserve the DLO manifest contents  https://review.openstack.org/25279116:53
*** bill_az_ has quit IRC16:55
openstackgerritAlistair Coles proposed openstack/swift: Change POST-as-COPY to preserve the DLO manifest contents  https://review.openstack.org/25279116:55
acolessorry for the noise16:55
*** garthb_ has joined #openstack-swift16:58
*** garthb has quit IRC16:59
*** arch-nemesis has joined #openstack-swift17:00
*** haomaiwang has quit IRC17:01
*** 17WABOLKW has joined #openstack-swift17:01
*** wbhuber_ is now known as wbhuber17:01
*** daemontool has quit IRC17:04
*** baojg has quit IRC17:18
*** baojg has joined #openstack-swift17:19
*** zul has quit IRC17:31
*** baojg has quit IRC17:38
*** baojg has joined #openstack-swift17:38
*** joeljwright has quit IRC17:38
*** arnox has quit IRC17:40
*** baojg has quit IRC17:42
*** baojg has joined #openstack-swift17:43
*** baojg has quit IRC17:47
*** jistr has quit IRC17:49
*** klrmn has joined #openstack-swift17:50
*** dmorita has joined #openstack-swift17:50
*** dmorita has quit IRC17:51
*** dmorita has joined #openstack-swift17:53
*** rledisez has quit IRC17:54
*** 17WABOLKW has quit IRC18:01
*** 77CAADIRQ has joined #openstack-swift18:01
*** dmorita has quit IRC18:02
*** dmorita has joined #openstack-swift18:02
*** mrmoje has joined #openstack-swift18:13
*** diogogmt has joined #openstack-swift18:21
openstackgerritAlistair Coles proposed openstack/swift: Fix inconsistent suffix hashes after ssync of tombstone  https://review.openstack.org/26778818:25
openstackgerritAlistair Coles proposed openstack/swift: Update container on fast-POST  https://review.openstack.org/13538018:25
*** diogogmt has quit IRC18:26
*** nadeem has quit IRC18:28
*** nadeem has joined #openstack-swift18:28
*** geaaru has quit IRC18:30
*** acoles is now known as acoles_18:31
*** nadeem has quit IRC18:36
openstackgerritMerged openstack/swift-bench: TrivialFix of Import JSON  https://review.openstack.org/27339618:37
*** nadeem has joined #openstack-swift18:37
*** nadeem has quit IRC18:39
*** silor has joined #openstack-swift18:40
*** baojg has joined #openstack-swift18:43
*** baojg has quit IRC18:48
claygheyoh!18:51
*** pcaruana has joined #openstack-swift18:57
*** zhill has joined #openstack-swift18:58
*** daemontool has joined #openstack-swift18:58
*** 77CAADIRQ has quit IRC19:01
*** 16WAAP054 has joined #openstack-swift19:01
claygtimburke: tdasilva: go make your Friday better by making python-swiftclient more reliable patch 274016 (just needs a +A, thanks acoles_!)19:09
patchbotclayg: https://review.openstack.org/#/c/274016/ - python-swiftclient - Fix intermiitent fail of test_delete_account19:09
*** daemontool has quit IRC19:10
claygtimburke: also see acoles_ suggested diff to make patch 273854 better19:10
patchbotclayg: https://review.openstack.org/#/c/273854/ - python-swiftclient - Tighten up to just rounding error19:10
timburkeclayg: acoles_: is that related to bug 1480223? 'cause i think that's the one i usually end up needing rechecks for...19:11
openstackbug 1480223 in python-swiftclient "test_upload_delete_dlo_segments unit test fails intermittently" [Undecided,Confirmed] https://launchpad.net/bugs/148022319:11
claygtimburke: seems pretty similar - acoles fix is great - any_order=True19:13
timburkealas, i think not quite... my bug actually loses a call somehow :(19:14
*** alalalala has joined #openstack-swift19:17
alalalalahello, is there a way to list files of all users as anadmin?19:17
alalalalaswift list -lh container only shows me files of the current user19:18
*** mrmoje has quit IRC19:22
*** pcaruana has quit IRC19:24
timburkealalalala: you've already exported some environment variables for the auth url, username, etc. right? if you also export OS_STORAGE_URL=https://some.host.name/v1/AUTH_other_account then swift list will list the containers/objects in that other account19:29
timburkeif you want a list of all the accounts in swift... i guess there's some hope in patch 269291? swift doesn't have a good way to give you that info currently19:32
patchbottimburke: https://review.openstack.org/#/c/269291/ - swift - New recon request to get account names from cluster19:32
*** Jeffrey4l_ has joined #openstack-swift19:32
*** Jeffrey4l has quit IRC19:34
*** pcaruana has joined #openstack-swift19:37
alalalalatimburke: thank you, so no easy way to list all files from all users?19:37
*** jistr has joined #openstack-swift19:37
*** fesp has joined #openstack-swift19:39
*** baojg has joined #openstack-swift19:44
*** baojg has quit IRC19:50
openstackgerritMerged openstack/swift: Fix a few English mistakes in man  https://review.openstack.org/27340719:54
*** fesp has quit IRC19:56
*** 16WAAP054 has quit IRC20:01
*** haomaiwa_ has joined #openstack-swift20:01
*** thebloggu has quit IRC20:03
ZyricGood morning20:04
*** pcaruana has quit IRC20:06
*** ChubYann has joined #openstack-swift20:08
*** esker has quit IRC20:08
*** pcaruana has joined #openstack-swift20:09
claygtimburke: have you looked at patch 269291 - I remember at the austin hack-a-thon or toyko thinking that the cardinality of accounts in even the biggest clusters should support full enumeration in swift if we put our thinking caps on (in most cases deployments are allready solving this with account tree walks a la slogging)20:10
patchbotclayg: https://review.openstack.org/#/c/269291/ - swift - New recon request to get account names from cluster20:10
claygtimburke: is the recon the way to do it!?20:11
claygtimburke: most correct design, best implementation/api?20:11
timburkeclayg: no idea. i just remembered seeing the patch. looks like onovy is similarly skeptical of recon being right, though20:13
*** alalalala has quit IRC20:16
*** silor has quit IRC20:17
claygi like that onovy20:17
*** pcaruana has quit IRC20:19
onovyclayg: you like recon/account?20:34
onovyor my opinion? :)20:34
openstackgerritMingyu Li proposed openstack/swift: A minor modification of the Deployment Guide  https://review.openstack.org/27422620:39
claygonovy: I like *YOU* :P20:45
*** mrmoje has joined #openstack-swift20:45
onovyi know it! thanks!20:45
claygonovy: FWIW i have no idea if recon is the right place to do account enumeration - i was sorta hoping someone smart (like timburke) could tell me if it was a good idea so I don't have to use my (very limitied) mental capacity on thinking about it20:46
*** baojg has joined #openstack-swift20:46
claygonovy: but timburke says you're going to be the smart person for this change - so I'm totally happy with that20:46
ahalei kinda thing its the least bad place for that if its gonna be an api'able thingy20:47
ahalethink*20:47
clayguh oh - ahale putting in 2 cents!20:47
ahalehehe20:47
*** nadeem has joined #openstack-swift20:48
claygahale: go look at the review - i would *love* to consider your feedback!20:48
ahalewell , i mean, i dont really think it should live there :) but my thoughts are more that recon really the only interface into that kind of host thing20:48
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925020:50
onovyclayg: i only have problem with recon cache for account list "filling"20:50
onovyusing some "sample" watcher20:50
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873620:50
onovyrecon is build-in, and sample watcher not20:50
onovyso recon could be fine for account list. but not by watcher20:51
*** baojg has quit IRC20:51
*** nadeem has quit IRC20:51
clayginteresting20:52
claygahale: ^^^ counter-point?20:52
*** nadeem has joined #openstack-swift20:52
ahaleone time i experimented with letting recon load arbituary plugin code, so opperators could do what they want within its structure without needing to change swift20:52
claygahale: yeah it is an api that we can sort of add stuff too that's the core storage api20:52
onovyahale: yes! i like this20:52
onovyplug-in on back side (watcher) and on recon side too20:53
claygi like it for experimentation - but I also like seeing that stuff get out in the open - or in some cases upstream - what we have now has sorta stagnated tho20:53
onovymaybe swift should implement account list without watchers20:54
Zyricclayg, onovy, ahale, I'd love to see some of this feedback make it to the patch in comments :)20:54
onovyin sqlite for example? :)20:54
onovyclayg: do you have time for small cleanup review? https://review.openstack.org/#/c/258158/20:55
claygonovy: I'm fairly warm on this approach - account-updater could be a thing20:55
claygonovy: patch 258158 is on my list but I'm still trying to get my keystone chops up to snuff - sry20:56
patchbotclayg: https://review.openstack.org/#/c/258158/ - swift - Keystone middleware deprecated option is_admin rem...20:56
onovyclayg: mkey, thanks20:56
claygonovy: if you ever see cschwede you should try him20:56
onovyok. and https://review.openstack.org/#/c/253038/ ?20:57
*** haomaiwa_ has quit IRC21:01
*** haomaiwang has joined #openstack-swift21:03
*** admin0 has joined #openstack-swift21:10
*** jistr has quit IRC21:10
*** dmorita has quit IRC21:17
onovyclayg: thanks21:19
*** dmorita has joined #openstack-swift21:26
*** nadeem has quit IRC21:32
claygpdardeau: did re-use device id's merge already?21:32
*** admin0 has quit IRC21:33
* onovy think yes21:33
*** bill_az has quit IRC21:35
*** rcernin has joined #openstack-swift21:36
*** mrmoje has quit IRC21:40
*** vinsh has quit IRC21:46
*** vinsh has joined #openstack-swift21:47
*** baojg has joined #openstack-swift21:47
openstackgerritOndřej Nový proposed openstack/swift: Renamed variable for better code readability  https://review.openstack.org/27426121:48
openstackgerritOndřej Nový proposed openstack/swift: Renamed variable for better code readability  https://review.openstack.org/27426121:49
*** rvasilets__ has joined #openstack-swift21:49
onovyclayg: ^ better? :)21:50
*** diogogmt has joined #openstack-swift21:51
*** dmorita has quit IRC21:52
*** diogogmt has quit IRC21:52
*** baojg has quit IRC21:52
*** diogogmt has joined #openstack-swift21:53
*** alejandrito has quit IRC21:54
*** dmorita has joined #openstack-swift22:00
*** haomaiwang has quit IRC22:01
*** 21WAAXZZ2 has joined #openstack-swift22:01
*** sgundur has left #openstack-swift22:08
*** changbl has quit IRC22:18
*** admin0 has joined #openstack-swift22:22
*** diogogmt has quit IRC22:25
*** blmartin has quit IRC22:31
*** mragupat has quit IRC22:34
*** trifon has joined #openstack-swift22:37
*** aix has quit IRC22:39
*** aix has joined #openstack-swift22:40
*** aix is now known as Guest96522:40
*** trifon has quit IRC22:47
*** baojg has joined #openstack-swift22:47
*** vinsh_ has joined #openstack-swift22:52
*** baojg has quit IRC22:53
*** vinsh has quit IRC22:55
*** asettle has joined #openstack-swift22:57
*** bjkeller has left #openstack-swift22:58
*** nadeem has joined #openstack-swift23:00
*** nadeem has quit IRC23:00
*** 21WAAXZZ2 has quit IRC23:01
*** alejandrito has joined #openstack-swift23:01
*** nadeem has joined #openstack-swift23:01
*** haomaiwang has joined #openstack-swift23:01
*** asettle has quit IRC23:02
claygtimburke: thanks for showing me how that works - filed lp bug #1539805 for you ;)23:06
openstackLaunchpad bug 1539805 in OpenStack Object Storage (swift) "tempurl Content-Disposition header missing from HEAD" [Wishlist,New] https://launchpad.net/bugs/153980523:06
timburkeclayg: i think you meant "ship it", but i maybe like your version better :)23:08
claygoh goodness - what did i type :\23:08
claygtimburke: too funny23:09
*** admin0 has quit IRC23:11
*** admin0 has joined #openstack-swift23:12
openstackgerritMerged openstack/swift: Add info about state of ring file to default command.  https://review.openstack.org/25303823:15
onovyclayg: i will fix set_replica detection in ^^23:16
onovybut overload can't be detected i think23:16
claygmattoliverau: OMG - Mandy was just telling me that Karen had made a onesee with a swift logo on her new t-shit printer - and I was like - "for *who*? no one is having a baby."  ?!!!!23:17
claygonovy: ok, but you know... i'm not really sure how much pain this is causing currently23:18
onovyhey! i want that tshirt too :/23:19
onovyi have only darth vader :) http://bit.ly/1nDIdPK23:19
claygonovy: unlike say how the *entire* command line parser in cli/ringbuilder is a total chore to maintain and would so much better if we ported to argparse now that we're py2.723:19
claygonovy: tooooooo cute!23:19
onovyok. time to go to bed, midnight here23:20
onovygn23:20
*** mgarza has quit IRC23:30
*** zul has joined #openstack-swift23:40
*** alejandrito has quit IRC23:41
*** baojg has joined #openstack-swift23:49
*** xiangxinyong_ has joined #openstack-swift23:56
*** baojg has quit IRC23:59
*** xiangxinyong has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!