| *** ho has joined #openstack-swift | 00:03 | |
| *** ho is now known as Guest48293 | 00:03 | |
| *** Guest48293 is now known as ho_ | 00:04 | |
| ho_ | good morning! | 00:04 |
|---|---|---|
| *** diogogmt has joined #openstack-swift | 00:14 | |
| *** dimasot has quit IRC | 00:19 | |
| *** Jeffrey4l has joined #openstack-swift | 00:31 | |
| gmmaha | notmyname: a quick update from my side.. I am being side-tracked and asked to work on an internal goal which is equally new to me as swift. My activity in swift and global cluster will slow down a lot until i am done with the other task (hopefully not more than a month's time). Thought i will update you on it.. | 00:36 |
| gmmaha | i have already spoken to peluse and him and I are on the same page on this.. | 00:36 |
| gmmaha | mattoliverau: ^^^ to you as well sir.. sorry, shouldnt have missed you | 00:37 |
| notmyname | gmmaha: ack. thanks for the info | 00:37 |
| *** tsg has quit IRC | 00:37 | |
| gmmaha | notmyname: :) thanks | 00:38 |
| gmmaha | clayg: has the fix for liberasurecode.so.1 landed in vsaio? From the chat, you seem to mention that pchng has fixed that issue? | 00:41 |
| ho_ | clayg: gmmaha: my colleague sent a pull request to vsaio. is it related? https://github.com/swiftstack/vagrant-swift-all-in-one/pull/33 | 00:44 |
| gmmaha | ho_: yes sir.. thats the same error.. | 00:44 |
| gmmaha | thats for the patch | 00:44 |
| ho_ | gmmaha: np! and i will tell it to my colleague. thanks! | 00:46 |
| gmmaha | thanks* | 00:46 |
| gmmaha | :) thats what i should have said.. | 00:46 |
| ho_ | gmmaha: :-) | 00:47 |
| *** m_kazuhiro has joined #openstack-swift | 00:53 | |
| *** diogogmt has quit IRC | 01:05 | |
| *** garthb__ has quit IRC | 01:06 | |
| ho_ | gmmaha: clayg: oh, i see. pchng's one is better. nice! | 01:07 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Remove some Python 2.6 leftovers https://review.openstack.org/267882 | 01:26 |
| zaitcev | Hmm, I could _swear_ someone else proposed an anti-py26 patch today | 01:37 |
| *** haomaiwang has joined #openstack-swift | 01:37 | |
| *** sgundur has left #openstack-swift | 01:50 | |
| *** haomaiwang has quit IRC | 02:01 | |
| *** haomaiwang has joined #openstack-swift | 02:01 | |
| *** mingdang1 has joined #openstack-swift | 02:21 | |
| openstackgerrit | Reedip proposed openstack/swift-bench: Remove support for py33/py26 https://review.openstack.org/264486 | 02:24 |
| kota_ | hello | 02:30 |
| *** diogogmt has joined #openstack-swift | 02:33 | |
| *** wanghua has joined #openstack-swift | 02:34 | |
| openstackgerrit | dangming proposed openstack/swift: Fix "--id" is used as a key https://review.openstack.org/267308 | 02:39 |
| ho_ | kota_: hi | 02:42 |
| *** forcebanana has quit IRC | 02:48 | |
| *** haomaiwang has quit IRC | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:09 | |
| *** janonymous has joined #openstack-swift | 03:10 | |
| kota_ | ho: o/ | 03:20 |
| *** janonymous has quit IRC | 03:22 | |
| *** janonymous has joined #openstack-swift | 03:22 | |
| *** dimasot has joined #openstack-swift | 03:31 | |
| *** gyee has quit IRC | 03:49 | |
| *** links has joined #openstack-swift | 03:49 | |
| *** hyakuhei has joined #openstack-swift | 03:51 | |
| *** mragupat has joined #openstack-swift | 03:55 | |
| *** mragupat has quit IRC | 03:55 | |
| *** mragupat has joined #openstack-swift | 03:56 | |
| *** links has quit IRC | 03:56 | |
| *** haomaiwang has quit IRC | 04:01 | |
| *** haomaiwa_ has joined #openstack-swift | 04:01 | |
| *** blmartin has joined #openstack-swift | 04:22 | |
| *** itlinux has joined #openstack-swift | 04:35 | |
| *** links has joined #openstack-swift | 04:40 | |
| *** lcurtis has quit IRC | 04:46 | |
| *** haomaiwa_ has quit IRC | 04:53 | |
| *** hyakuhei has quit IRC | 04:53 | |
| *** 77CAAJ1C4 has joined #openstack-swift | 04:54 | |
| Zyric | Has anyone run into an error where dependencies claim to install, but fail to import? I'm trying to run .functests and probetests but am getting ImportError: No module named pbr.version and ImportError: cannot import name viewkeys | 04:56 |
| Zyric | Pip claims both pbr and six are installed and up to date though | 04:56 |
| ho_ | Zyric: maybe sudo pip install --upgrade pbr solve your problem | 05:00 |
| *** 77CAAJ1C4 has quit IRC | 05:01 | |
| Zyric | I have updated it, running that command outputs: Requirement already up-to-date: pbr in /home/swift/python-swiftclient/pbr-1.8.1-py2.7.egg | 05:01 |
| *** haomaiwa_ has joined #openstack-swift | 05:01 | |
| Zyric | But functests still won't run, and I'm not sure why | 05:01 |
| Zyric | Everytime I try to run them it still outputs ImportError: No module named pbr.version without running any tests | 05:02 |
| ho_ | Zyric: sorry, i didn't read second line ... | 05:02 |
| *** blmartin has quit IRC | 05:02 | |
| gmmaha | Zyric: this is the same error we have been running into for a while now | 05:05 |
| gmmaha | https://review.openstack.org/#/c/207790/ | 05:06 |
| *** itlinux has quit IRC | 05:06 | |
| gmmaha | usually happens when the system has python-six package of Ubuntu 14.04 against the pip package | 05:06 |
| gmmaha | and the python-six gets picked up by default.. purging that out and isntalling the pip package works | 05:07 |
| Zyric | gmmha: Thanks you! I should have been paying more attention instead of trying to debug this by myself, I haven't had any luck. | 05:07 |
| gmmaha | Zyric: its fairly new with the latest package updates and Ubuntu14.04 | 05:07 |
| gmmaha | its good to try and debug yourself.. if you had a solution we might be able to compare notes. ;) | 05:08 |
| gmmaha | Zyric: hoping that fix works. | 05:20 |
| Zyric | It appears to be allowing me to run functests now, but they aren't passing, which could be a different issue or the same one | 05:23 |
| *** chlong has joined #openstack-swift | 05:24 | |
| gmmaha | what errors are you running into ? | 05:24 |
| gmmaha | have a feeling it has to do with liberasure code | 05:24 |
| Zyric | gmmaha: The testing hasn't completed yet, but so far every single functtest is failing. | 05:25 |
| Zyric | Oh yeah, liberasure code! I had to change a line in the swift config from jerasure_rs_vand to liberasurecode_rs_vand and I'm not sure that was correct | 05:26 |
| Zyric | I had "ERROR: Invalid Storage Policy Configuration in /etc/swift/swift.conf (Wrong ec_type jerasure_rs_vand for policy ec42, should be one of "flat_xor_hd_3, flat_xor_hd_4, liberasurecode_rs_vand")" come up. | 05:26 |
| gmmaha | hmm i have never run into that issue.. | 05:28 |
| gmmaha | the last issue if i remember, i had to isntall liberasurecode and that package was missing | 05:29 |
| Zyric | I'll let the failing functests finish and check the failure messages, I'll try installing liberasurecode too. Perhaps I should change the config back to jerasure_rs_rand in case that's causing additional issues. | 05:31 |
| *** dmorita has quit IRC | 05:33 | |
| *** dmorita has joined #openstack-swift | 05:33 | |
| *** nakagawamsa has joined #openstack-swift | 05:34 | |
| *** itlinux has joined #openstack-swift | 05:37 | |
| *** dmorita has quit IRC | 05:38 | |
| *** trifon has joined #openstack-swift | 05:38 | |
| gmmaha | that might be a good test.. sorry my SAIO is having issues.. reinstalling it now.. I can test it if it comes back up | 05:42 |
| *** wanghua has quit IRC | 05:44 | |
| gmmaha | Zyric: i think its liberasurecode-dev. Ran functests now and it worked fine for me | 05:46 |
| gmmaha | where did you say you set the ec_type. i dont think i have enabled that on my setup | 05:47 |
| Zyric | gmmaha: Neat! Great news. My tests are running super slowly at the moment but I'll report in when they're done. The error was from the policy type of policy ec42 in /etc/swift/swift.conf | 05:48 |
| gmmaha | Yup.. dont have that on my setup.. but then i havent enabled EC on my setup.. :) | 05:51 |
| gmmaha | good lukc with the test and hopefully that ends the last of your issues.. | 05:51 |
| *** haomaiwa_ has quit IRC | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:01 | |
| openstackgerrit | Merged openstack/swift: Show UTC time in swift-recon. https://review.openstack.org/251151 | 06:03 |
| *** klrmn has quit IRC | 06:18 | |
| *** ChubYann has quit IRC | 06:28 | |
| *** chlong has quit IRC | 06:40 | |
| *** silor has joined #openstack-swift | 06:54 | |
| *** haomaiwang has quit IRC | 07:01 | |
| *** 17WABJ0T0 has joined #openstack-swift | 07:01 | |
| *** zaitcev has quit IRC | 07:02 | |
| *** links has quit IRC | 07:17 | |
| *** links has joined #openstack-swift | 07:30 | |
| *** links has quit IRC | 07:39 | |
| *** SkyRocknRoll has joined #openstack-swift | 07:39 | |
| *** links has joined #openstack-swift | 07:41 | |
| *** ntt has joined #openstack-swift | 07:46 | |
| ntt | Hi, I have a problem with bulk upload: when in the list are present filenames with characters like 'àèìòù...', bulk upload fails but I cannot see any error messages. Someone can help me please? | 07:49 |
| *** jmccarthy has quit IRC | 07:49 | |
| *** jmccarthy has joined #openstack-swift | 07:51 | |
| *** mragupat has quit IRC | 07:58 | |
| *** 17WABJ0T0 has quit IRC | 08:01 | |
| *** haomaiwang has joined #openstack-swift | 08:01 | |
| *** arnox has joined #openstack-swift | 08:03 | |
| *** niya has joined #openstack-swift | 08:05 | |
| niya | timburke: I am using this response at many places in my code,setting a header wont help and the main problem is return statement. after returning the first chunk it will terminate | 08:05 |
| *** rledisez has joined #openstack-swift | 08:08 | |
| *** geaaru has joined #openstack-swift | 08:20 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 08:21 |
| openstackgerrit | ting wang proposed openstack/swift: Add debug testenv in tox https://review.openstack.org/266025 | 08:27 |
| *** daemontool has joined #openstack-swift | 08:36 | |
| *** itlinux has quit IRC | 08:49 | |
| *** JimWang has joined #openstack-swift | 09:00 | |
| *** haomaiwang has quit IRC | 09:01 | |
| *** haomaiwang has joined #openstack-swift | 09:01 | |
| *** jordanP has joined #openstack-swift | 09:22 | |
| *** jistr has joined #openstack-swift | 09:27 | |
| *** niya has quit IRC | 09:29 | |
| *** JimWang has quit IRC | 09:31 | |
| *** proteusguy has quit IRC | 09:41 | |
| *** McMurlock has joined #openstack-swift | 09:50 | |
| *** acoles_ is now known as acoles | 09:53 | |
| *** proteusguy has joined #openstack-swift | 09:54 | |
| *** m_kazuhiro has quit IRC | 09:54 | |
| *** m_kazuhiro has joined #openstack-swift | 09:55 | |
| *** haomaiwang has quit IRC | 10:01 | |
| *** haomaiwang has joined #openstack-swift | 10:01 | |
| *** klrmn has joined #openstack-swift | 10:07 | |
| ntt | Hi, I have a problem with bulk upload: when in the list are present filenames with characters like 'àèìòù...', bulk upload fails but I cannot see any error messages. Someone can help me please? I'm using the kilo release on centos7 | 10:08 |
| *** jordanP has quit IRC | 10:16 | |
| *** jordanP has joined #openstack-swift | 10:21 | |
| *** number80 has joined #openstack-swift | 10:26 | |
| *** admin0 has joined #openstack-swift | 10:33 | |
| admin0 | what is the max_file_size value ? value of one file size or the whole single object | 10:34 |
| admin0 | if its 5gb, it means largest object=5gb, or 1 chunk size is 5gb ? | 10:34 |
| admin0 | so if i use glance to use swift as backend and i need to save 20gb images, should this max_file_size be 20gb ? | 10:34 |
| *** mingdang1 has quit IRC | 10:39 | |
| *** SkyRocknRoll has quit IRC | 10:42 | |
| *** klrmn has quit IRC | 10:43 | |
| *** hseipp has joined #openstack-swift | 10:44 | |
| *** bsdkurt has quit IRC | 10:47 | |
| *** sileht has quit IRC | 10:48 | |
| *** sileht has joined #openstack-swift | 10:48 | |
| *** bsdkurt has joined #openstack-swift | 10:48 | |
| *** mrmoje has joined #openstack-swift | 10:50 | |
| openstackgerrit | Merged openstack/python-swiftclient: Fix the http request headers being overwritten in logging https://review.openstack.org/252261 | 10:52 |
| *** SkyRocknRoll has joined #openstack-swift | 10:55 | |
| *** haomaiwang has quit IRC | 11:01 | |
| *** haomaiwang has joined #openstack-swift | 11:01 | |
| *** mrmoje has quit IRC | 11:04 | |
| *** mrmoje has joined #openstack-swift | 11:05 | |
| ho_ | admin0: largest object is 5gb and glace splits 20gb file to small objects (less than 5gb) using dlo | 11:14 |
| *** Kanshi has joined #openstack-swift | 11:14 | |
| admin0 | ok | 11:15 |
| admin0 | if there are timeouts, is it from glance side or swift side ? | 11:15 |
| ho_ | admin0: i think you usually get client timeout (glance side). | 11:20 |
| admin0 | what python package gives me swift.common.ring ? | 11:20 |
| ho_ | admin0: it depends on distributions. but it should be in main swift package. | 11:22 |
| admin0 | i want to rebuild the ring on a client side computer | 11:22 |
| admin0 | i already have python-swiftcleint installed | 11:22 |
| Kanshi | Hello everybody. I'm facing a wierd bug in Swift Liberty: I upload a 2GB (20MB chunks) file with the following command line "swift upload kanshi -S 20971520 largefile.dd" and it goes fine. But when I try to download it, I always have the following error: Error downloading object 'kanshi/largefile.dd': 'Error downloading largefile.dd: read_length != content_length, 1082458112 != 1082720256'. No matter the (large) file, it alway | 11:24 |
| Kanshi | if anyone have a suggestion, I'll happy to read it :) | 11:25 |
| ho_ | admin0: https://launchpad.net/ubuntu/+source/swift | 11:26 |
| *** fbo_ has joined #openstack-swift | 11:27 | |
| *** fbo has quit IRC | 11:27 | |
| ho_ | admin0: does it fit for you? | 11:27 |
| admin0 | yes . thanks | 11:29 |
| *** ho_ has quit IRC | 11:35 | |
| *** sanchitmalhotra has quit IRC | 11:38 | |
| *** haomaiwang has quit IRC | 11:40 | |
| *** mingdang1 has joined #openstack-swift | 11:45 | |
| *** mrmoje has quit IRC | 11:45 | |
| *** hseipp has quit IRC | 11:52 | |
| *** eranrom has joined #openstack-swift | 11:56 | |
| *** km_ has quit IRC | 12:06 | |
| *** admin0 has quit IRC | 12:07 | |
| Kanshi | Hello everybody. I'm facing a wierd bug in Swift Liberty: I upload a 2GB (20MB chunks) file with the following command line "swift upload kanshi -S 20971520 largefile.dd" and it goes fine. But when I try to download it, I always have the following error: Error downloading object 'kanshi/largefile.dd': 'Error downloading largefile.dd: read_length != content_length, 1082458112 != 1082720256'. No matter the (large) file, it alway | 12:10 |
| Kanshi | if anyone have a suggestion, I'll happy to read it :) | 12:10 |
| *** admin0 has joined #openstack-swift | 12:11 | |
| *** haomaiwa_ has joined #openstack-swift | 12:19 | |
| *** haomaiwa_ has quit IRC | 12:20 | |
| *** haomaiwa_ has joined #openstack-swift | 12:31 | |
| admin0 | how do I use the ringbuilder python to rebuild the ring when adding more storage servers .. what would be the format for the ring ? | 12:31 |
| admin0 | http://docs.openstack.org/admin-guide-cloud/objectstorage_ringbuilder.html | 12:32 |
| *** cdelatte has joined #openstack-swift | 12:35 | |
| *** m_kazuhiro has quit IRC | 12:45 | |
| *** openstackgerrit has quit IRC | 12:50 | |
| *** openstackgerrit has joined #openstack-swift | 12:51 | |
| *** links has quit IRC | 12:55 | |
| *** links has joined #openstack-swift | 12:58 | |
| *** haomaiwa_ has quit IRC | 13:01 | |
| *** haomaiwang has joined #openstack-swift | 13:01 | |
| *** links has quit IRC | 13:03 | |
| *** hyakuhei has joined #openstack-swift | 13:10 | |
| *** lpabon has joined #openstack-swift | 13:14 | |
| *** dslevin has quit IRC | 13:22 | |
| admin0 | if a seed value for building an existing ring is not known, can a new value be used ? | 13:23 |
| admin0 | i am working on an existing cluster where the people who build it first left already, no documentation | 13:23 |
| *** fthiagogv has quit IRC | 13:24 | |
| *** hseipp has joined #openstack-swift | 13:27 | |
| *** joeljwright has joined #openstack-swift | 13:30 | |
| *** ChanServ sets mode: +v joeljwright | 13:30 | |
| *** cdelatte has quit IRC | 13:33 | |
| *** cdelatte has joined #openstack-swift | 13:34 | |
| *** hyakuhei has quit IRC | 13:39 | |
| *** dimasot has quit IRC | 13:41 | |
| *** mingdang1 has quit IRC | 13:56 | |
| *** haomaiwang has quit IRC | 14:01 | |
| *** haomaiwang has joined #openstack-swift | 14:01 | |
| *** Kanshi has quit IRC | 14:17 | |
| *** dimasot has joined #openstack-swift | 14:24 | |
| *** sgundur has joined #openstack-swift | 14:30 | |
| *** dmorita has joined #openstack-swift | 14:34 | |
| *** hyakuhei has joined #openstack-swift | 14:36 | |
| openstackgerrit | Mustafa ÇELİK proposed openstack/swift: X-Timestamp missing from response headers https://review.openstack.org/268163 | 14:38 |
| *** dmorita has quit IRC | 14:39 | |
| *** urth has quit IRC | 14:39 | |
| *** esker has quit IRC | 14:41 | |
| *** urth has joined #openstack-swift | 14:42 | |
| *** joker_ has quit IRC | 14:42 | |
| *** hyakuhei has quit IRC | 14:45 | |
| *** hyakuhei has joined #openstack-swift | 14:46 | |
| *** hyakuhei has quit IRC | 14:46 | |
| *** hseipp has quit IRC | 14:47 | |
| *** hyakuhei has joined #openstack-swift | 14:48 | |
| *** blmartin has joined #openstack-swift | 14:51 | |
| *** petertr7_away is now known as petertr7 | 14:51 | |
| *** admin0 has quit IRC | 14:58 | |
| *** haomaiwang has quit IRC | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** admin0 has joined #openstack-swift | 15:03 | |
| *** nadeem has joined #openstack-swift | 15:09 | |
| *** nadeem has quit IRC | 15:09 | |
| *** nadeem has joined #openstack-swift | 15:10 | |
| *** mrmoje has joined #openstack-swift | 15:15 | |
| *** daemontool has quit IRC | 15:16 | |
| admin0 | to rebalance, do I need to distribute the new account/container/object to every node int he cluster ? | 15:18 |
| *** lcurtis has joined #openstack-swift | 15:22 | |
| *** Jeffrey4l has quit IRC | 15:25 | |
| *** silor1 has joined #openstack-swift | 15:30 | |
| *** [1]eranrom has joined #openstack-swift | 15:31 | |
| *** hyakuhei has quit IRC | 15:31 | |
| *** chmouel has quit IRC | 15:32 | |
| *** silor has quit IRC | 15:32 | |
| *** silor1 is now known as silor | 15:32 | |
| *** eranrom has quit IRC | 15:33 | |
| *** aix has quit IRC | 15:33 | |
| *** [1]eranrom is now known as eranrom | 15:33 | |
| *** hyakuhei has joined #openstack-swift | 15:36 | |
| *** [1]eranrom has joined #openstack-swift | 15:37 | |
| *** jamie_h has joined #openstack-swift | 15:37 | |
| *** chmouel has joined #openstack-swift | 15:38 | |
| jamie_h | is there any way to increase the disk space limit? i'm trying to upload a 10gb DLO and it's throwing this error after 1 segment:`object-server: ERROR __call__ error with PUT /sdb1/61/AUTH_b4c305db632444acb91256fddb4f34da/test_segments/object/1452871211.8875/9137291264/2 : [Errno 28] No space left on device` | 15:38 |
| glange | jamie_h: I think that means the physical disk is full | 15:39 |
| *** eranrom has quit IRC | 15:39 | |
| *** [1]eranrom is now known as eranrom | 15:39 | |
| jamie_h | glange when i run df -h, it shows this `/dev/loop0 2.0G 1.1G 950M 54% /opt/stack/data/drives/sdb1`. devstack creates that right? | 15:39 |
| *** mragupat has joined #openstack-swift | 15:40 | |
| glange | I don't know anything about devstack, sorry | 15:40 |
| glange | this is a swift all in one? | 15:40 |
| jamie_h | it's swift on devstack | 15:40 |
| *** ho_away has joined #openstack-swift | 15:40 | |
| glange | but is it a full, mult-system cluster? | 15:41 |
| glange | or a single machine/vm ? | 15:41 |
| jamie_h | no just 1 box | 15:41 |
| glange | ok | 15:41 |
| jamie_h | 8GB ubuntu vm | 15:41 |
| glange | it sounds like wherever the object is being written to is full or isn't writable or something like that | 15:41 |
| jamie_h | either i or devstack needs to resize the filesystem where resources are being saved to. i'd rather it be the latter | 15:45 |
| glange | why do you need to write such a large object? | 15:45 |
| glange | a swift all in one is kind of a toy system that is just there so people can do development work | 15:46 |
| jamie_h | i'm testing an SDK. i've had users who need DLO support, which has a min of 5gb. i don't see 10gb as that bad tbh | 15:46 |
| jamie_h | it's just a dev box. but i have like 140gb of free disk on there | 15:46 |
| *** lcurtis has quit IRC | 15:47 | |
| glange | ok, yeah, figure out how to make the things bigger :) | 15:47 |
| glange | http://docs.openstack.org/developer/swift/development_saio.html | 15:47 |
| glange | have you seen that page? | 15:47 |
| glange | some of that stuff is what devstack is doing under the covers | 15:47 |
| glange | and it might give you a hint how to fix things | 15:47 |
| *** tsg has joined #openstack-swift | 15:50 | |
| *** diazjf has joined #openstack-swift | 15:56 | |
| hurricanerix | jamie_h: I would look at the "Using a loopback device for storage" section of the SAIO page that glange sent you, maybe the devstack thing is setting up the storage that way. which would create a 1GB file and use it for swift's storage. | 15:58 |
| *** diazjf has quit IRC | 16:00 | |
| *** haomaiwang has quit IRC | 16:01 | |
| *** aix has joined #openstack-swift | 16:01 | |
| *** CaioBren_ has joined #openstack-swift | 16:01 | |
| *** haomaiwang has joined #openstack-swift | 16:01 | |
| *** SkyRocknRoll has quit IRC | 16:03 | |
| *** diazjf has joined #openstack-swift | 16:03 | |
| *** CaioBrentano has quit IRC | 16:04 | |
| *** lcurtis has joined #openstack-swift | 16:13 | |
| *** admin0 has quit IRC | 16:15 | |
| *** klrmn has joined #openstack-swift | 16:19 | |
| *** mrmoje has quit IRC | 16:22 | |
| *** garthb__ has joined #openstack-swift | 16:25 | |
| peluse | notmyname, mattoliverau: one of the OSIC topics we've got on our list is "internal cluster network security improvements" but I can't recall if there were any old bp's or specs or anything there to flesh this out any more, anyone recall? | 16:37 |
| peluse | notmyname: mattoliverau, same thing for "Request tagging for detailed logging/tracing" | 16:38 |
| *** zaitcev has joined #openstack-swift | 16:42 | |
| *** ChanServ sets mode: +v zaitcev | 16:42 | |
| *** itlinux has joined #openstack-swift | 16:48 | |
| *** trifon has quit IRC | 17:00 | |
| *** diogogmt has quit IRC | 17:00 | |
| *** haomaiwang has quit IRC | 17:01 | |
| *** haomaiwang has joined #openstack-swift | 17:01 | |
| *** diogogmt has joined #openstack-swift | 17:02 | |
| *** arnox has quit IRC | 17:05 | |
| *** rledisez has quit IRC | 17:07 | |
| *** janonymous has quit IRC | 17:13 | |
| *** admin0 has joined #openstack-swift | 17:17 | |
| notmyname | good morning | 17:18 |
| notmyname | peluse: yes, there's an old blueprint about internal netsec | 17:18 |
| notmyname | I'll find the link | 17:18 |
| notmyname | for request tagging, I don't know of anything written up in much/any detail. just that it's something I've heard requested | 17:18 |
| *** klrmn has quit IRC | 17:19 | |
| notmyname | peluse: mattoliverau: here's the netsec writeup, such as it is https://blueprints.launchpad.net/swift/+spec/secure-internal-network-requests | 17:19 |
| *** klrmn has joined #openstack-swift | 17:19 | |
| *** klrmn has quit IRC | 17:21 | |
| *** dmsimard is now known as dmsimard|afk | 17:24 | |
| peluse | notmyname: thanks! | 17:26 |
| *** dmorita has joined #openstack-swift | 17:27 | |
| dimasot | admin0: | 17:30 |
| dimasot | admin0: yes you need to distribute it to all teh cluster, e.g. object.ring.gz should be located on all object-server nodes | 17:30 |
| dimasot | admin0: regards teh ring rebuild you need to find the ring builder object ususally it called object.builder for objects, container.builder for containers and etc | 17:32 |
| admin0 | ok | 17:32 |
| dimasot | admin0: the comand that adds the device would be: | 17:32 |
| dimasot | swift-ring-builder object.builder add r1z1-<node_ip>:6000/<device name e.g. sda> 4000 | 17:33 |
| dimasot | when r1 means region 1, and z1 zone 1 | 17:33 |
| zaitcev | I ask people to use 6200 nowadays | 17:33 |
| dimasot | if your node belongs to another region/zone the rY and zX should be set apresiative | 17:34 |
| dimasot | 6200 instead 6000? thanks zaitcev | 17:35 |
| notmyname | zaitcev: now that we've been running with required bind_ports for just a long time, we should update the docs/configs to change to something like that (6200) | 17:35 |
| *** jordanP has quit IRC | 17:35 | |
| zaitcev | People were hitting conflicts with X11 on nodes. I don't know why anyone would have graphics on nodes, but apparently they do ssh -Y or whatever. | 17:35 |
| dimasot | if you don't have the builder it is more problematic but still doable | 17:36 |
| *** admin0 has quit IRC | 17:36 | |
| zaitcev | so much for that | 17:36 |
| *** diazjf has quit IRC | 17:45 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Reclaim isolated .meta files https://review.openstack.org/268251 | 17:45 |
| *** shakamunyi has joined #openstack-swift | 17:46 | |
| acoles | clayg: ^^ follow up to your comment on patch 267788. it might make sense to squash the two, idk | 17:47 |
| patchbot | acoles: https://review.openstack.org/#/c/267788/ - Fix inconsistent suffix hashes after ssync of tomb... | 17:47 |
| *** ho_away has quit IRC | 17:51 | |
| *** jamielennox is now known as jamielennox|away | 17:52 | |
| *** acoles is now known as acoles_ | 17:52 | |
| *** jamie_h has quit IRC | 17:54 | |
| *** dimasot has quit IRC | 17:58 | |
| *** fthiagogv has joined #openstack-swift | 18:00 | |
| *** haomaiwang has quit IRC | 18:01 | |
| *** haomaiwang has joined #openstack-swift | 18:01 | |
| *** proteusguy_ has joined #openstack-swift | 18:01 | |
| *** zhill has joined #openstack-swift | 18:02 | |
| *** proteusguy has quit IRC | 18:03 | |
| *** hyakuhei has quit IRC | 18:08 | |
| *** dmorita has quit IRC | 18:13 | |
| *** dmorita has joined #openstack-swift | 18:13 | |
| *** klrmn has joined #openstack-swift | 18:16 | |
| *** forcebanana has joined #openstack-swift | 18:24 | |
| *** blmartin has quit IRC | 18:25 | |
| *** dmorita has quit IRC | 18:35 | |
| *** dmorita has joined #openstack-swift | 18:35 | |
| *** hyakuhei has joined #openstack-swift | 18:46 | |
| *** thumpba has joined #openstack-swift | 18:48 | |
| *** tsg has quit IRC | 18:48 | |
| *** joeljwright has quit IRC | 18:50 | |
| *** blmartin has joined #openstack-swift | 18:53 | |
| *** nadeem has quit IRC | 18:58 | |
| *** nadeem has joined #openstack-swift | 19:00 | |
| *** petertr7 is now known as petertr7_away | 19:00 | |
| *** haomaiwang has quit IRC | 19:01 | |
| *** haomaiwa_ has joined #openstack-swift | 19:01 | |
| *** hyakuhei has quit IRC | 19:01 | |
| *** hyakuhei has joined #openstack-swift | 19:02 | |
| *** hyakuhei has quit IRC | 19:02 | |
| *** nadeem has quit IRC | 19:05 | |
| clayg | acoles_: I'm cool with them seperate - you're awesome! | 19:08 |
| clayg | pchng: I noticed this morning your fixup for liberasure was to the vsaio/crypto and not to master! | 19:09 |
| clayg | pchng: I hope I cherry-picked correctly :P | 19:09 |
| *** fthiagogv has quit IRC | 19:10 | |
| *** dimasot has joined #openstack-swift | 19:18 | |
| *** geaaru has quit IRC | 19:37 | |
| *** jistr has quit IRC | 19:37 | |
| *** admin0 has joined #openstack-swift | 19:40 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift: add test for zero weight region get_more_nodes https://review.openstack.org/268305 | 19:44 |
| clayg | torgomatic: cschwede: thanks for patch 267273 | 19:46 |
| patchbot | clayg: https://review.openstack.org/#/c/267273/ - Speed up get_more_nodes() when there is an empty zone | 19:46 |
| clayg | torgomatic: I took a stab ad a unittest and I'm pretty happy with it! AssertionError: 5 != 3065 | 19:46 |
| clayg | timburke: you got anything I'm forgetting about? | 19:46 |
| *** dmsimard|afk is now known as dmsimard | 19:47 | |
| clayg | timburke: torgomatic: acoles has some nice fixups for suffix hashing | 19:47 |
| *** petertr7_away is now known as petertr7 | 19:52 | |
| *** hyakuhei has joined #openstack-swift | 19:56 | |
| *** haomaiwa_ has quit IRC | 20:01 | |
| *** silor has quit IRC | 20:01 | |
| *** 5EXAAQR7M has joined #openstack-swift | 20:01 | |
| *** lcurtis_ has joined #openstack-swift | 20:02 | |
| openstackgerrit | Daisuke Morita proposed openstack/swift: Move slightly_later_timestamp function to common/util https://review.openstack.org/268315 | 20:03 |
| Zyric | Good Morning | 20:05 |
| *** admin0 has quit IRC | 20:05 | |
| *** petertr7 is now known as petertr7_away | 20:07 | |
| *** aix has quit IRC | 20:08 | |
| *** esker has joined #openstack-swift | 20:09 | |
| *** esker has joined #openstack-swift | 20:12 | |
| *** dmorita has quit IRC | 20:18 | |
| *** petertr7_away is now known as petertr7 | 20:29 | |
| *** CaioBren_ has quit IRC | 20:32 | |
| notmyname | Zyric: good morning. did you figure anything out about your func/probe tests? | 20:36 |
| Zyric | notmyname: Indeed, I assumed I had been doing something wrong but turns out it was a known problem and my attempts to fix it were resulting in all the wacky extra behaviour. | 20:38 |
| Zyric | When I tried with a 14.04 VM problems became replicable so I asked on IRC and it was this: https://review.openstack.org/#/c/207790/ | 20:39 |
| *** diazjf has joined #openstack-swift | 20:39 | |
| notmyname | Zyric: ah, ok. glad it's working for you now | 20:39 |
| notmyname | Zyric: could you leave a review on that patch, please? sounds like you have direct experience with it | 20:40 |
| Zyric | notmyname: Will do. Thanks for checking in, I really should have asked about it sooner! | 20:41 |
| *** dslevin has joined #openstack-swift | 20:45 | |
| *** lcurtis_ has quit IRC | 20:52 | |
| *** dmorita has joined #openstack-swift | 20:54 | |
| *** hyakuhei has quit IRC | 20:55 | |
| lcurtis | q for all...once a new ring has been created...is it possible to halt rebalancing and revert weights in case of too much performance hit? | 21:00 |
| *** 5EXAAQR7M has quit IRC | 21:01 | |
| *** haomaiwang has joined #openstack-swift | 21:01 | |
| clayg | dimasot: ^ see not *everyone* wants to make rebalancing as fast as possible! | 21:04 |
| clayg | lcurtis: there's nothing directly available, if you just started and realized a mistake you might put the old ring back out on the nodes | 21:05 |
| clayg | grab the old builder from your backups - and try another rebalance with adding smaller weight to the new nodes | 21:05 |
| *** hyakuhei has joined #openstack-swift | 21:06 | |
| clayg | lcurtis: if you've already commited to much to the movement of data to the new nodes - you might just try to tune and throttle repliation (maybe lower rsync max_connections) or lower the concurrency setting on the replicator - kill some of them - slow them down with nice - i'm just spit ballin' here | 21:06 |
| ahale | you'd probs not wanna push that smaller change ring out until you'd replicated back the mistake partitions though | 21:06 |
| *** diazjf1 has joined #openstack-swift | 21:07 | |
| clayg | ahale: +1 - i'm not even sure trying to revert is a good idea - you would have had to have realized really quickly there was a mistake - but if you're smalled balls to the wall and it's still going to take ages you can weight the cost of the revert | 21:07 |
| *** diazjf has quit IRC | 21:07 | |
| clayg | lcurtis: it might be possible to do something more fancy with some ring surgery by hand | 21:08 |
| ahale | yeah its probably an awfuly idea :) and gets more bad the longer it takes you to act.. but i find thinking through swift disaster cases is kinda relaxing | 21:08 |
| clayg | lcurtis: stop replicators, survey partition placement, make a ring that looks like reality and deploy it | 21:08 |
| clayg | lcurtis: wait | 21:08 |
| clayg | lcurtis: use write_builder to turn the new replica2part2dev table you've made up into a builder | 21:08 |
| clayg | lcurtis: while not happy with results of rebalance: write_builder - make a small adjusetment to fix weights - and rebalance | 21:09 |
| lcurtis | this is great food for thought guys | 21:09 |
| lcurtis | about to do a huge rebalance | 21:09 |
| clayg | lcurtis: start small ;) | 21:10 |
| lcurtis | need a stiff drink | 21:10 |
| lcurtis | lol | 21:10 |
| *** cdelatte has quit IRC | 21:10 | |
| ahale | i think the best idea once you've actually pushed ot a big change is to just power though and try deal with it | 21:10 |
| clayg | GARRRHHHHHHH | 21:10 |
| ahale | yeah with that noise too, often :) | 21:12 |
| lcurtis | great idea on rsync throttling | 21:13 |
| lcurtis | although that could leave many partitions in limbo, no? | 21:15 |
| ahale | yep, lead to a longer period of data being out of place, or poor dispersion reports, or more handoff in requests, or higher utilisation of resources between repli and user reqs.. | 21:18 |
| ahale | its all realy finding a balance | 21:18 |
| *** dslevin has quit IRC | 21:19 | |
| glange | rebalancing the ring is all about finding a balance? | 21:19 |
| ahale | knowing how much weight change to make on changes before people complain its all broken, yeah :) | 21:20 |
| lcurtis | lol | 21:21 |
| *** diazjf1 has quit IRC | 21:24 | |
| *** dimasot has quit IRC | 21:28 | |
| *** daemontool has joined #openstack-swift | 21:31 | |
| *** blmartin has quit IRC | 21:35 | |
| *** thumpba has quit IRC | 21:44 | |
| *** mragupat has quit IRC | 21:52 | |
| *** jamielennox|away is now known as jamielennox | 21:54 | |
| *** cdelatte has joined #openstack-swift | 21:59 | |
| *** cdelatte has quit IRC | 22:00 | |
| *** cdelatte has joined #openstack-swift | 22:00 | |
| *** haomaiwang has quit IRC | 22:01 | |
| *** haomaiwang has joined #openstack-swift | 22:01 | |
| *** zhill has quit IRC | 22:05 | |
| *** zhill has joined #openstack-swift | 22:07 | |
| *** dslevin has joined #openstack-swift | 22:08 | |
| *** dslevin has quit IRC | 22:08 | |
| *** petertr7 is now known as petertr7_away | 22:14 | |
| *** daemontool has quit IRC | 22:24 | |
| *** daemontool has joined #openstack-swift | 22:28 | |
| *** daemontool has quit IRC | 22:37 | |
| *** mingdang1 has joined #openstack-swift | 22:42 | |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Prompt for missing password https://review.openstack.org/189387 | 22:51 |
| *** haomaiwang has quit IRC | 23:01 | |
| *** haomaiwang has joined #openstack-swift | 23:01 | |
| *** lpabon has quit IRC | 23:11 | |
| *** hyakuhei has quit IRC | 23:11 | |
| *** mingdang1 has quit IRC | 23:26 | |
| *** dmorita has quit IRC | 23:29 | |
| *** dmorita has joined #openstack-swift | 23:30 | |
| *** lcurtis has quit IRC | 23:31 | |
| openstackgerrit | Merged openstack/swift: Remove some Python 2.6 leftovers https://review.openstack.org/267882 | 23:34 |
| clayg | rg | 23:42 |
| *** garthb__ has quit IRC | 23:47 | |
| openstackgerrit | Merged openstack/swift: Drop python 2.6 support https://review.openstack.org/267688 | 23:48 |
| notmyname | wasn't there a bug that someone closed recently about printing txnids in log lines | 23:48 |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Accept token and tenant_id for authenticating against KS https://review.openstack.org/172791 | 23:53 |
| *** dimasot has joined #openstack-swift | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!