Wednesday, 2016-01-20

*** diogogmt has quit IRC00:01
openstackgerritJohn Dickinson proposed openstack/swift: authors and changelog updates for 2.6.0  https://review.openstack.org/26991100:06
*** nadeem has quit IRC00:18
*** diazjf has joined #openstack-swift00:20
*** diazjf has quit IRC00:20
*** mrmoje has quit IRC00:27
*** siva_krishnan has quit IRC00:27
*** siva_krishnan has joined #openstack-swift00:28
notmynamemattoliverau: thanks00:29
openstackgerritJohn Dickinson proposed openstack/swift: authors and changelog updates for 2.6.0  https://review.openstack.org/26991100:29
mattoliveraunotmyname: anything to distract me from presentation writing :P00:30
notmynameyeah. I need to stay up tonight to work on that00:30
*** vinsh has quit IRC00:31
*** vinsh has joined #openstack-swift00:32
*** siva_krishnan has quit IRC00:33
*** vinsh has quit IRC00:36
*** dmorita has quit IRC00:38
kota_good morning00:47
*** dmorita has joined #openstack-swift00:49
*** m_kazuhiro has joined #openstack-swift00:50
*** dmorita has quit IRC00:54
*** dmorita has joined #openstack-swift00:55
*** dmorita has quit IRC00:55
*** dmorita has joined #openstack-swift00:55
*** vinsh has joined #openstack-swift00:59
*** siva_krishnan has joined #openstack-swift01:11
mattoliveraukota_: morning01:21
*** david-lyle has quit IRC01:31
*** Jeffrey4l has joined #openstack-swift01:31
*** bill_az has quit IRC01:41
*** haomaiwang has quit IRC01:42
*** vinsh has quit IRC01:44
*** vinsh has joined #openstack-swift01:50
kota_notmyname: hmm...eventlet==0.16.1 doesn't work in my envrionment but i got another issue test_get_conns stucked long time.01:54
kota_notmyname: anyways, nosetests test/unit/common/test_memcached.py with eventlet>=0.17.1 worked for me.01:54
kota_notmyname:^^ looking at patcch 26981101:54
kota_patch 26981101:55
patchbotkota_: https://review.openstack.org/#/c/269811/ - Bump eventlet min version to 0.17.401:55
*** vinsh has quit IRC01:57
*** vinsh has joined #openstack-swift01:59
*** vinsh has quit IRC02:00
*** siva_krishnan has quit IRC02:02
*** siva_krishnan has joined #openstack-swift02:10
notmynamekota_: that means you like that patch to bump eventlet?02:13
kota_notmyname: yeah, I like the bumping, right now, I am writing my idea for the patch.02:15
notmynamethanks02:16
kota_done02:16
* notmyname will be back online later tonight02:17
kota_torgomatic: thanks to trigger my patch 255096 got merged^^ I'm happy it is uneccessary to consider such a annoying failure message w/o my bad02:22
patchbotkota_: https://review.openstack.org/#/c/255096/ - Sleep enough for trampoline (MERGED)02:22
*** siva_krishnan has quit IRC02:41
*** nakagawamsa has joined #openstack-swift02:42
*** PsionTheory has quit IRC02:47
*** mingdang1 has joined #openstack-swift02:48
*** sgundur has left #openstack-swift02:59
*** rminmin has joined #openstack-swift03:00
*** haomaiwa_ has joined #openstack-swift03:04
*** janonymous has quit IRC03:05
openstackgerritTim Burke proposed openstack/swift: Stop logging "client disconnected" for 304 / 412 responses  https://review.openstack.org/24439403:05
openstackgerritCatherine Northcott proposed openstack/swift: Let developers/operators add watchers to account audit  https://review.openstack.org/26997903:06
openstackgerritCatherine Northcott proposed openstack/swift: Let developers/operators add watchers to account audit  https://review.openstack.org/26883003:09
*** ho has joined #openstack-swift03:25
*** lpabon has quit IRC03:25
*** ho is now known as Guest6030903:25
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/17434303:28
*** Guest60309 is now known as ho_03:28
*** rminmin has quit IRC03:29
mingdang1hello,I want to debug the proxy,but I set pdb in .py file,but I run proxy-server in command,the log prompt "raise BdbQuit#012BdbQuit"03:34
mingdang1the proxy-server can't debug?03:34
mingdang1@kota_  excuse me,:)...03:35
*** venkat has joined #openstack-swift03:36
kota_mingdang1: what's up?03:41
mingdang1I want to debug the proxy-server to learn more detail,but faild03:41
mingdang1 I set pdb in .py file,but I run proxy-server in command,the log prompt "raise BdbQuit#012BdbQuit"03:42
kota_ah... i'm not sure about pdb but you could see some debug message with running up debu mode swift which configured in /etc/swift/proxy-server.conf03:42
kota_(note that i suggested another way)03:43
*** gyee has quit IRC03:44
kota_mingdang1: which command did you use?03:44
mingdang1I run '/usr/bin/python2 /usr/bin/swift-proxy-server /etc/swift/proxy-server.conf'03:45
*** dmorita has quit IRC03:46
*** janonymous has joined #openstack-swift03:46
*** mragupat has joined #openstack-swift03:48
kota_seems reasonable though, did it work w/o pdb?03:49
mingdang1if I don't set pdb in .py,it run ok .but when set pdb,it doesn't run normal03:50
mingdang1maybe it hava childer process03:50
mingdang1swift    23557 23241  5 11:47 pts/1    00:00:00 /usr/bin/python2 /usr/bin/swift-proxy-server /etc/swift/proxy-server.conf -v03:51
mingdang1swift    23566 23557  0 11:47 pts/1    00:00:00 /usr/bin/python2 /usr/bin/swift-proxy-server /etc/swift/proxy-server.conf -v03:51
mingdang1swift    23567 23557  0 11:47 pts/1    00:00:00 /usr/bin/python2 /usr/bin/swift-proxy-server /etc/swift/proxy-server.conf -v03:51
kota_ah, yeah.03:51
mingdang1how to set the process counts?03:51
kota_"workers" variable in conf file03:52
*** mragupat has quit IRC03:53
*** mragupat has joined #openstack-swift03:53
kota_mingdang1: sorry i have a meeting in 5 minutes in my company.03:56
kota_no time to think of, for now.03:57
mingdang1take you time,ok ,thanks03:57
*** links has joined #openstack-swift04:06
*** dmorita has joined #openstack-swift04:06
*** Jeffrey4l has quit IRC04:08
notmynamehello, world04:08
*** dmorita has quit IRC04:10
ho_notmyname: good evening!04:13
notmynamehello ho_. how are you?04:13
ho_notmyname: good :) (but i have a lot of meetings today)04:15
notmynameI know what that's like ;-)04:16
ho_notmyname: :-)04:16
*** mragupat has quit IRC04:21
mattoliveraunotmyname: o/04:29
notmynamemattoliverau: I'm working on my preso. how about you?04:29
notmynamewell, I did get distracted by something else, but I do have Keynote open04:30
notmynamethat counts, right?04:30
*** klrmn has quit IRC04:32
*** vinsh has joined #openstack-swift04:36
*** vinsh has quit IRC04:39
mahaticnotmyname: mattoliverau o/04:41
*** haomaiwa_ has quit IRC04:43
*** david-lyle has joined #openstack-swift04:44
*** haomaiwa_ has joined #openstack-swift04:46
*** Jeffrey4l has joined #openstack-swift04:46
*** dmorita has joined #openstack-swift04:47
*** Jeffrey4l has quit IRC04:47
*** Jeffrey4l has joined #openstack-swift04:47
*** dmorita has quit IRC04:51
*** dimasot has joined #openstack-swift05:13
*** ppai has joined #openstack-swift05:35
*** Jeffrey4l has quit IRC05:47
*** dmorita has joined #openstack-swift05:48
*** trifon has joined #openstack-swift05:49
*** dimasot has quit IRC05:52
openstackgerritHisashi Osanai proposed openstack/swift: Fix time unit of Recon's replication_time for object  https://review.openstack.org/27001405:52
*** dmorita has quit IRC05:53
*** joker_ has joined #openstack-swift05:59
*** Jeffrey4l has joined #openstack-swift06:07
mattoliveraunotmyname: I am!06:15
mattoliveraunotmyname: sorry, got sidetracked.. was debugging some sharding stuff06:15
mattoliveraumahatic: o/06:15
notmynamecertainly don't apologize for that!06:17
*** Jeffrey4l has quit IRC06:18
mattoliveraugetting it to clean up parent containers (ie delete them) after sharding, cause we only care about the leaves, and we have reclaim age + if objects get replicated in the container wont fully delete.... however, I was doing some tweaking and forgot the case of not deleted the root container when it shards. Lets just say, sharding doesn't work when you kill the root (master) container.. opps :P06:20
notmynameheh06:20
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload  https://review.openstack.org/26899306:21
*** Jeffrey4l has joined #openstack-swift06:21
*** Jeffrey4l has quit IRC06:26
*** ChubYann has quit IRC06:36
*** jamielennox is now known as jamielennox|away06:40
*** proteusguy has quit IRC06:42
*** takashi_ has joined #openstack-swift06:42
*** proteusguy has joined #openstack-swift06:42
*** balajir has quit IRC06:43
*** balajir has joined #openstack-swift06:44
*** Jeffrey4l has joined #openstack-swift06:47
*** silor has joined #openstack-swift06:51
*** silor1 has joined #openstack-swift06:57
*** haomai___ has joined #openstack-swift06:58
*** haomaiwa_ has quit IRC06:58
*** silor has quit IRC06:59
*** silor1 is now known as silor06:59
*** haomai___ has quit IRC07:01
*** 6A4ABQMYH has joined #openstack-swift07:01
*** rcernin has joined #openstack-swift07:02
*** Guest40809 has quit IRC07:07
*** km__ has joined #openstack-swift07:08
*** km__ is now known as Guest4257807:09
*** asettle_ has joined #openstack-swift07:25
*** asettle_ has quit IRC07:27
*** asettle has quit IRC07:29
kota_acoles: i found an issue for fast-post^^ (report is https://bugs.launchpad.net/swift/+bug/1536037)07:54
openstackLaunchpad bug 1536037 in OpenStack Object Storage (swift) "fast-post broken with object mem server" [Undecided,New]07:54
kota_acoles: i think it's just a bug not so big/urgent and also not affected to fast-post progress.07:55
*** arnox has joined #openstack-swift07:58
*** 6A4ABQMYH has quit IRC08:01
*** haomaiwa_ has joined #openstack-swift08:01
openstackgerritJude Augustine Job proposed openstack/python-swiftclient: Adding session to switfclient.  https://review.openstack.org/27004508:03
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix EC ring validation at ring reload  https://review.openstack.org/26899308:03
*** rledisez has joined #openstack-swift08:05
kota_acoles: i tried to take care of fast-post route on proxy-server with patch 268993, that unfortunately failed in gerrit gate :/08:05
patchbotkota_: https://review.openstack.org/#/c/268993/ - Fix EC ring validation at ring reload08:05
*** cbartz has joined #openstack-swift08:06
*** Jeffrey4l has quit IRC08:08
*** Jeffrey4l has joined #openstack-swift08:14
*** eranrom has joined #openstack-swift08:19
*** remix_tj has quit IRC08:21
*** remix_tj has joined #openstack-swift08:22
*** trifon has quit IRC08:30
*** trifon has joined #openstack-swift08:31
*** geaaru has joined #openstack-swift08:35
*** remix_tj has quit IRC08:40
*** remix_tj has joined #openstack-swift08:40
*** dmorita has joined #openstack-swift08:47
*** dmorita has quit IRC08:51
eranromHi all, Does https://review.openstack.org/#/c/269911/3 means the next release is finalyzed?08:52
*** ho_ has quit IRC08:54
*** kei_yama has quit IRC08:55
*** takashi_ has quit IRC09:00
*** haomaiwa_ has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
*** venkat has quit IRC09:05
*** dimasot has joined #openstack-swift09:11
openstackgerritBéla Vancsics proposed openstack/swift: Reduce code duplication  https://review.openstack.org/25426609:13
*** joeljwright has joined #openstack-swift09:16
*** ChanServ sets mode: +v joeljwright09:16
*** jistr has joined #openstack-swift09:16
*** venkat has joined #openstack-swift09:17
*** Jeffrey4l has quit IRC09:34
venkatHi all09:41
venkathow to use header Transfer-Encoding for object PUT api??09:42
venkatIs this header is supported only for EC?09:42
*** dimasot has quit IRC09:45
venkathi someone can answer09:52
*** aix has joined #openstack-swift09:56
*** haomaiwang has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
ahaleits supported for non-EC, it just means you dont send a content-length and instead use a chunked transfer in the client10:06
*** mariusv has quit IRC10:13
*** hyakuhei has joined #openstack-swift10:15
venkatahale:10:15
venkatI am using like this10:15
venkatcurl -i $publicURL/container/local.conf -X PUT -H "X-Auth-Token: $token" -T local.conf  -H "Transfer-Encoding : chunked"10:15
*** hyakuhei has quit IRC10:16
venkatbut its not working as expected10:16
*** tortib has joined #openstack-swift10:17
tortibSo is this channel for the Apple language Swift?10:18
ahaletortib: nope10:22
tortibok10:22
tortibhave a good day ahale10:22
*** tortib has left #openstack-swift10:22
ahaleyou too :)10:22
ahalevenkat: it should accept (my swift does), curl is a pain though sometimes, doing unexpected things10:23
*** links has quit IRC10:28
venkatahale: can we pass using python-swift-client10:29
venkatcan u give an example10:29
*** mingdang1 has quit IRC10:36
kota_eranrom: it's in working progress but i expect it will be done really soon, notmyname told in IRC, he is willing to finish up the release wednesday (maybe in PDT)10:37
kota_eranrom: for next swift release10:37
kota_eranrom: you can see the conversation in the swift IRC logs10:38
ahalevenkat: this works for me- sends a "> Transfer-Encoding: chunked" header:  "curl -v -X POST -H 'Transfer-Encoding: chunked' -H 'X-Auth-Token: TOKEN' -d @filename.txt https://swift/acc/cont/obj "10:46
*** links has joined #openstack-swift10:51
eranromkota_: Thanks! I was searching the logs. do you remeber the day by any chance?10:52
kota_eranrom: 1 sec10:52
-kota_- 16:01 (notmyname) [01:34:17] oh, for the other-side-of-the-world shift that's coming online now, likely to be a swift release in 2 days (my wednesday)10:53
-kota_- 16:01 (kota_) [01:49:55] notmyname: do we have remaining patches (likely blockers) for the next swift release?10:53
kota_maybe, yesterday or day before?10:53
eranromkota_: thanks!10:53
eranromkota_,: Found it10:53
kota_eranrom:^^10:53
eranromyep. Thanks10:53
*** gabor_antal has joined #openstack-swift10:57
*** haomaiwang has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** rcernin has quit IRC11:05
*** links has quit IRC11:05
*** rcernin has joined #openstack-swift11:07
*** rledisez has quit IRC11:09
*** rcernin is now known as rcernin|lunch11:13
joker_hi everyone, I sent code for review related with this bug(https://bugs.launchpad.net/swift/+bug/1509429):11:18
openstackLaunchpad bug 1509429 in OpenStack Object Storage (swift) "X-Timestamp missing from object PUT/COPY response headers" [Low,In progress] - Assigned to Mustafa Çelik (celikmustafa89)11:18
joker_and this one is my patch https://review.openstack.org/#/c/268163/11:19
openstackgerritBéla Vancsics proposed openstack/swift: Reduce code duplication  https://review.openstack.org/26776711:20
joker_and this one is related with the previous patch about swift api https://review.openstack.org/#/c/269680/11:20
joker_can somebody help me with code-review?11:21
*** hyakuhei has joined #openstack-swift11:21
*** daemontool has joined #openstack-swift11:21
joker_I can add you as reviewer to patch:11:21
joker_thanks11:21
*** links has joined #openstack-swift11:32
*** venkat has quit IRC11:33
*** sanchitmalhotra has quit IRC11:35
*** links has quit IRC11:38
*** hyakuhei has quit IRC11:42
*** openstackgerrit has quit IRC11:43
-openstackstatus- NOTICE: review.openstack.org is being restarted to apply patches11:44
*** ChanServ changes topic to "review.openstack.org is being restarted to apply patches"11:44
*** openstackgerrit has joined #openstack-swift11:44
*** venkat has joined #openstack-swift11:45
*** m_kazuhiro has quit IRC11:52
*** ChanServ changes topic to "Review Dashboard: https://goo.gl/mtEv1C | Hackathon: https://www.eventbrite.com/e/swift-hackathon-bristol-sponsored-by-hpe-tickets-19994495073 | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | What's going on survey: https://gist.github.com/notmyname/be49b04165928fd6662f"11:55
-openstackstatus- NOTICE: Restart done, review.openstack.org is available11:55
*** mingdang1 has joined #openstack-swift11:57
*** aix has quit IRC11:59
*** haomaiwang has quit IRC12:01
*** haomaiwang has joined #openstack-swift12:01
*** ppai has quit IRC12:06
*** mrmoje has joined #openstack-swift12:07
*** ho_away has joined #openstack-swift12:07
*** Guest42578 has quit IRC12:09
*** ppai has joined #openstack-swift12:20
*** Jeffrey4l has joined #openstack-swift12:21
*** fthiagogv has joined #openstack-swift12:21
openstackgerritMerged openstack/python-swiftclient: Get rid of FakeConn cruft  https://review.openstack.org/26939912:27
*** aix has joined #openstack-swift12:33
ho_awaytakashi: around?12:34
*** proteusguy has quit IRC12:37
*** rledisez has joined #openstack-swift12:43
*** rledisez has quit IRC12:43
*** takashi_ has joined #openstack-swift12:45
*** ppai has quit IRC12:47
*** proteusguy has joined #openstack-swift12:50
*** ppai has joined #openstack-swift12:59
*** Jeffrey4l has quit IRC12:59
*** davidhadas has joined #openstack-swift12:59
*** haomaiwang has quit IRC13:01
*** haomaiwa_ has joined #openstack-swift13:01
*** rcernin|lunch is now known as rcernin13:07
*** haomaiwa_ has quit IRC13:07
*** jmccarthy has joined #openstack-swift13:08
*** rledisez has joined #openstack-swift13:13
*** venkat has quit IRC13:14
*** Jeffrey4l has joined #openstack-swift13:17
*** daemontool has quit IRC13:18
tdasilvaonovy: hi, I think I mentioned to you before, but devconf is happening in a couple of weeks: http://devconf.cz/13:22
*** siva_krishnan has joined #openstack-swift13:23
*** marcusrafael has joined #openstack-swift13:30
onovytdasilva: yep, i have it on my backlog13:33
onovywill be there13:33
marcusrafaelGood morning guys13:33
tdasilvaonovy: cool, maybe we can meet there13:34
onovyof course13:34
marcusrafaelGuys, I'm trying to install a devstack with swift and I'm getting this error: Missing parameter(s):  Set an authentication URL, with --os-auth-url, OS_AUTH_URL or auth.auth_url13:34
marcusrafaelDo you have any idea what is happening?13:35
*** haomaiwa_ has joined #openstack-swift13:35
*** bill_az has joined #openstack-swift13:37
*** ho_away has quit IRC13:38
*** luksaur has joined #openstack-swift13:46
*** iGeek2001 has joined #openstack-swift13:46
iGeek2001Hi All13:46
*** takashi__ has joined #openstack-swift13:47
iGeek2001Would someone be able to assist with swift proxy server query13:47
iGeek2001All my swift SAIO services are starting13:47
iGeek2001however the proxy server fails13:47
iGeek2001with the following error13:48
iGeek2001ImportError: No module named catch_errors13:48
*** mahatic_ has joined #openstack-swift13:49
*** cebruns_ has joined #openstack-swift13:50
*** mingdang1 has quit IRC13:50
*** hachi-ju has joined #openstack-swift13:50
*** hachi-ju is now known as hguemar13:50
*** hguemar has quit IRC13:50
*** baffle__ has joined #openstack-swift13:51
*** dfg_ has joined #openstack-swift13:51
*** dosaboy_ has joined #openstack-swift13:51
*** lifeless_ has joined #openstack-swift13:51
*** saltsa_ has joined #openstack-swift13:51
*** remix_auei has joined #openstack-swift13:51
*** tonyb_ has joined #openstack-swift13:51
*** j_king_ has joined #openstack-swift13:51
*** hachi-ju has joined #openstack-swift13:51
*** clyps___1 has joined #openstack-swift13:52
*** timur_ has joined #openstack-swift13:52
*** number80 has quit IRC13:52
*** hachi-ju is now known as number8013:52
*** number80 has quit IRC13:53
*** number80 has joined #openstack-swift13:53
*** jlhinson_ has joined #openstack-swift13:53
*** jrichli_ has joined #openstack-swift13:54
*** coreycb` has joined #openstack-swift13:54
*** wbhuber_ has joined #openstack-swift13:54
*** raginbaj- has joined #openstack-swift13:55
*** ajiang_ has joined #openstack-swift13:55
*** hrou_ has joined #openstack-swift13:55
*** trifon has quit IRC13:56
*** takashi has quit IRC13:56
*** d0ugal has quit IRC13:56
*** saltsa has quit IRC13:56
*** wbhuber has quit IRC13:56
*** ajiang has quit IRC13:56
*** dosaboy has quit IRC13:56
*** mahatic has quit IRC13:56
*** raginbajin has quit IRC13:56
*** ahale has quit IRC13:56
*** jlhinson has quit IRC13:56
*** a1|away has quit IRC13:56
*** anteaya has quit IRC13:56
*** timur has quit IRC13:56
*** dfg has quit IRC13:56
*** coreycb has quit IRC13:56
*** remix_tj has quit IRC13:56
*** eranrom has quit IRC13:56
*** cebruns has quit IRC13:56
*** zackmdavis has quit IRC13:56
*** tonyb has quit IRC13:56
*** lifeless has quit IRC13:56
*** hrou has quit IRC13:56
*** clyps___ has quit IRC13:56
*** j_king has quit IRC13:56
*** baffle has quit IRC13:56
*** jrichli has quit IRC13:56
*** raginbaj- is now known as raginbajin13:56
*** ahale has joined #openstack-swift13:57
*** zackmdavis has joined #openstack-swift13:57
*** remix_auei is now known as remix_tj13:58
*** haomaiwa_ has quit IRC14:01
*** haomaiwang has joined #openstack-swift14:01
*** Jeffrey4l has quit IRC14:01
*** PsionTheory has joined #openstack-swift14:02
*** trifon has joined #openstack-swift14:02
*** d0ugal has joined #openstack-swift14:03
*** a1|away has joined #openstack-swift14:03
*** anteaya has joined #openstack-swift14:03
*** tonyb_ is now known as tonyb14:03
*** ho_away has joined #openstack-swift14:10
*** eranrom has joined #openstack-swift14:12
*** dslevin has joined #openstack-swift14:15
*** dslevin has quit IRC14:16
*** dslevin has joined #openstack-swift14:16
openstackgerritMahati Chamarthy proposed openstack/swift: Decrypt multipart mime doc  https://review.openstack.org/24837714:21
*** acoles_ is now known as acoles14:22
openstackgerritVictor Stinner proposed openstack/swift: py3: Use the six module in the xprofile middleware  https://review.openstack.org/23314514:24
*** takashi_ has quit IRC14:24
*** ho_away is now known as ho14:26
*** ho is now known as Guest8847914:27
*** Guest88479 is now known as ho_away14:29
*** haypo has joined #openstack-swift14:32
notmynamegood morning14:32
haypohi. i'm running "tox -e py34" on Swift, and it fails with: ERROR: unable to find suitable PyECLib type (none of ['liberasurecode_rs_vand', 'jerasure_rs_vand'] found in [])14:32
haypoi have PyEClib 1.2.014:32
notmynamemin version is 1.0.714:33
notmynameand later versions have unbundled liberasurecode14:33
hayposwift unit tests still require an external library? i doesn't include its own erasure code?14:33
notmynameso you need to install liberasurecode separately now (instead of it being bundled with pyeclib)14:33
hayponotmyname: i confirm that liberasurecode is not installed on my system :)14:33
notmyname:-)14:33
hayposorry, i forgot all detail about PyEClib :) i will install liberasurecode14:34
*** hseipp has joined #openstack-swift14:34
eranromnotmyname,: morning. Just want to make sure you saw my comment on 2.6.0 (patch 269911)14:35
patchboteranrom: https://review.openstack.org/#/c/269911/ - authors and changelog updates for 2.6.014:35
hayponotmyname: if i recall correctly, it was no mmore embedded, but then embedded again14:37
hayponotmyname: it looks like it changed a third time :)14:37
notmynameeranrom: yes, and I've got it open now14:38
notmynamehaypo: yeah. the plan is to keep it separate, and later versions now have their own simple EC alorithm (so you don't need jerasure or isa-l or anything)14:39
eranromnotmyname,: thanks! and apologies for the parallel efforts here :-)14:39
*** petertr7_away is now known as petertr714:40
openstackgerritPeter Lisák proposed openstack/swift: Unification of manpages and swift-* --help  https://review.openstack.org/25139714:44
*** sgundur has joined #openstack-swift14:46
*** ppai has quit IRC14:48
openstackgerritVictor Stinner proposed openstack/swift: Port get_hmac() and hash_path() to Python 3  https://review.openstack.org/23699814:50
openstackgerritVictor Stinner proposed openstack/swift: Port parse_mime_headers() to Python 3  https://review.openstack.org/23702714:53
*** lpabon has joined #openstack-swift14:53
haypook, you have py3 patches to review ;-) https://review.openstack.org/237027  https://review.openstack.org/236998  https://review.openstack.org/23701914:55
haypoenjoy!14:56
notmyname:-)14:56
* notmyname is about to push some patches14:59
openstackgerritJohn Dickinson proposed openstack/swift: Fix memory/socket leak in proxy on truncated SLO/DLO GET  https://review.openstack.org/27023314:59
openstackgerritJohn Dickinson proposed openstack/swift: authors and changelog updates for 2.6.0  https://review.openstack.org/26991115:00
openstackgerritJohn Dickinson proposed openstack/swift: Fix memory/socket leak in proxy on truncated SLO/DLO GET  https://review.openstack.org/27023415:00
*** haomaiwang has quit IRC15:01
*** haomaiwa_ has joined #openstack-swift15:01
*** daemontool has joined #openstack-swift15:02
notmynamenow only 22+ hours for those to get through the gate (assuming they go through the first time and there aren't spurious test failures)15:04
*** blmartin has joined #openstack-swift15:05
*** petertr7 is now known as petertr7_away15:06
*** iGeek2001 has quit IRC15:06
*** daemontool has quit IRC15:07
*** daemontool has joined #openstack-swift15:07
*** zaitcev has joined #openstack-swift15:12
*** ChanServ sets mode: +v zaitcev15:12
*** lcurtis has joined #openstack-swift15:12
*** daemontool has quit IRC15:13
notmynamefor those of you rolling your own swift packages, I'd strongly recommend deploying this patch15:14
notmynametimburke: joeljwright: https://review.openstack.org/#/c/270045/1 looks interesting15:15
notmynameeranrom: ^15:15
notmynameie something we talked about in tokyo15:16
joeljwrightinteresting… need to understand what that's doing, but it's not a big change15:17
notmynameif anyone does .NET dev work, I just saw this http://blog.veritech.io/2016/01/openstack-swift-client-for-net-core.html15:18
*** hrou_ has quit IRC15:19
*** jrichli_ has quit IRC15:19
*** jlhinson_ has quit IRC15:19
*** hrou has joined #openstack-swift15:20
eranromnotmyname: looking...15:20
notmynamejoeljwright: yeah, that's exactly what I thought15:21
*** jrichli has joined #openstack-swift15:21
onovyhmm, CVE...15:21
*** jlhinson has joined #openstack-swift15:21
joeljwrightnotmyname: first thing to work out is the spectacular test failures15:22
notmynameyeah, I think that's the pip 8 issue that was brought up on the ML yesterday. seemed to break the world15:22
notmynameor that's most likely. ie everything is breaking15:23
notmynameonovy: fun, right?15:23
onovynotmyname: yep :)15:23
joeljwrightnotmyname: tell me about it! pip 8.0.0 has been breaking our testing all day :(15:23
*** joker_ has quit IRC15:26
onovynotmyname: if i understand it correclty <= 2.2.0 is not affected?15:27
notmynameonovy: that should be true. and that's what is said by https://review.openstack.org/#/c/270241/1/ossa/OSSA-2016-004.yaml15:28
onovyperfect. no work for debian maintainer. jessie-stable = 2.2.0 :)15:29
eranromnotmyname,: I thought that we wanted to leverage sessions to somehow free the user from being aware of the protocol version. That is session plus a swift plugin to allow v1. anyway this change looks like semantics but I amprobably missing something.15:29
notmynameonovy: I'm not sure I agree with that ;-)15:29
onovynotmyname: arg!15:30
notmynameeranrom: yeah, I think you're right15:30
* onovy don't like backporting fixies to old code15:30
onovybut exactly i will need backport for 2.3.0 liberty15:30
notmynameonovy: you should be using 2.6.0 as soon as it's released (hopefully today, but tagged later this week because of gate slowness)15:30
notmynameonovy: ;-)15:30
onovynotmyname: i will!15:31
onovyit will be in debian in few minutes after your release15:31
notmynameyay15:31
onovyand few minutes later in our production15:31
onovywhy wait? :)15:31
*** mragupat has joined #openstack-swift15:32
*** cdelatte has joined #openstack-swift15:32
notmynamethe eventlet bump needs to land. the authors/changelog of course. and, if at all possible (and it's had a lot of reviews already) eranrom's container sync patch, although it's not small15:32
*** diogogmt has joined #openstack-swift15:33
eranromnotmyname,: Thanks!15:36
notmynameeranrom: so that's what I'm thinking. I do definitely want to get your container sync patch it (and so far, it's super easy to read!)15:37
notmynamethe CVE should result in a release, too15:37
*** delattec has joined #openstack-swift15:37
eranromnotmyname,: CVE?15:38
notmynamethe patches I pushed up 38 minutes ago15:38
notmynamepatch 27023315:39
patchbotnotmyname: https://review.openstack.org/#/c/270233/ - Fix memory/socket leak in proxy on truncated SLO/D...15:39
eranromnotmyname,: looking...15:39
notmynameeranrom: you really really want to deploy that patch15:39
*** cdelatte has quit IRC15:39
*** diogogmt has quit IRC15:40
notmynameeranrom: the tl;dr is "client starts to download a *LO and stops partway through. server leaks a socket fd and a small amount of memory"15:40
notmynamethe memory is actually less concerning (still important) than the socket leak. you'll run out of file descriptors before you run out of ram15:41
eranromnotmyname,: yep got that. I can help testing / reviewing this.15:41
notmynameeranrom: it's already been done when it was under embargo. and it's already been +A. just needs to go through the gate15:41
*** jordanP has joined #openstack-swift15:41
notmynameyou can see the discussion on the linked bug15:42
eranromnotmyname,: I see.15:43
*** cbartz has left #openstack-swift15:43
openstackgerritJohn Dickinson proposed openstack/swift: authors and changelog updates for 2.6.0  https://review.openstack.org/26991115:45
acolesnotmyname: it was a nit !)15:49
notmynameacoles: ;-)15:49
notmynameit's easy to iterate15:49
acolesthey're easy to iterate15:51
notmynamelol15:51
*** siva_krishnan1 has joined #openstack-swift15:57
*** siva_krishnan1 has quit IRC15:57
*** hyakuhei has joined #openstack-swift15:59
*** haomaiwa_ has quit IRC16:01
*** haomaiwa_ has joined #openstack-swift16:01
*** nadeem has joined #openstack-swift16:02
*** nadeem has quit IRC16:03
notmynameeranrom: I've looked through the patch for the core changes but not the tests yet. seems pretty straightforward and a pretty clever solution.16:04
*** nadeem has joined #openstack-swift16:04
eranromnotmyname,: Thanks!16:07
notmynameso supposed we land this and it turns out to be a terrible idea. since all you're doing here is doing some symlinks, there's not even any major concern with doing something different later16:07
eranromnotmyname,: I really^3 appreciate this16:07
eranromAgree. I can also add the following: Idea was reviewed by clayg and acoles. and when container sharding comes in, we will automatically gain spreading the sync work over all container servers free.16:09
eranroms/free/for free16:09
notmynameassuming there's a db broker for each of the shards16:10
eranromnotmyname,: Well, this was my understanding at the time. Otherwise, we should adopt container sync accordingly.16:11
acolesnotmyname: eranrom fwiw i think the biggest risk (in landing the sync patch) is that we missed a (failure) scenario which ends up with a db that should be sync'd but no symlink to it.16:11
acolesotherwise its a fairly simple (but neat) idea16:13
eranromacoles: you mean a failure scenario where e.g. the replicator will fail to fix that? Well, I guess that this is why IBM first beta this :-)16:13
eranromacoles,: BTW we are also currently building an automated system tests for the feature over two non trivial clusters16:14
eranromacoles,: I will be happy to describe in the hakathon16:14
notmynameacoles: yeah. the good news is that the simplicity of the design is that it's pretty easy to reason about those. it's updated on PUT, POST, and DELETE. there's not too many other places to worry about16:14
notmynameeranrom: you're coming to bristol, right?16:15
eranromnotmyname: yep. Got a queue of topics as well :-)16:15
notmynameheh. me too ;-)16:15
eranrom:-)16:15
acoleseranrom: i was just reflecting on what another reviewer might look out for, given that i am fallible :)16:17
zaitcevOh god, another big and important review16:18
*** joeljwright has quit IRC16:18
notmynamezaitcev: there's always another one, isn't there? ;-)16:18
eranromacoles,: well we are humans at the end of the day, but I would guess "fallibelity" is lower thn average16:20
*** diazjf has joined #openstack-swift16:22
*** ho_away has quit IRC16:22
notmynameI just got an email saying hackathon hotel block group rate is extended. that's good (for those who haven't booked yet). thanks acoles16:23
eranromnotmyname,: ^^ which remonds me I should start getting prepared...16:24
acolesnotmyname: well that's a coincidence cos I just sent a similar email :)16:24
acoleseranrom: YES16:24
*** Jeffrey4l has joined #openstack-swift16:24
*** rcernin has quit IRC16:25
*** Jeffrey4l has quit IRC16:25
*** Jeffrey4l has joined #openstack-swift16:25
*** jordanP has quit IRC16:30
*** davidhadas has quit IRC16:35
*** awelleck has joined #openstack-swift16:36
*** davidhadas_ has joined #openstack-swift16:40
ahaleI heard about the existence of a UK Openstack Swift Hackathon but didnt see it mentioned anywhere, is it private ?16:47
notmynameahale: nope. it's in the channel topic16:47
ahalewho reads topics !16:47
notmynameclearly not you!16:47
notmyname;-)16:47
ahaleclearly16:48
notmynameahale: I think it would be awesome if you were to make it to bristol16:48
mahatic_ha, and i just discovered this "what's going on survey". there should be a notification for channel topic changes ;)16:48
*** trifon has quit IRC16:49
mahatic_oh it doesn't have a gist of answers16:50
notmynameI'm still working on putting that together. I'll highlight a couple of things in today's meeting16:52
*** gabor_antal has quit IRC16:53
notmynameahale: you might be interested in the results onovy/peterlisak got from the ionice changes: https://docs.google.com/spreadsheets/d/1dzcMutNwRYcDiSMNOhKLM1tk8QX3uqFg9BJszJ6plr4/edit?usp=sharing16:53
*** haypo has left #openstack-swift16:56
*** delattec has quit IRC17:00
*** haomaiwa_ has quit IRC17:01
openstackgerritMustafa ÇELİK proposed openstack/swift: X-Timestamp missing from response headers  https://review.openstack.org/26816317:02
*** delattec has joined #openstack-swift17:03
*** jistr has quit IRC17:04
*** klrmn has joined #openstack-swift17:04
*** haomaiwa_ has joined #openstack-swift17:05
*** chsc has joined #openstack-swift17:05
*** eranrom has quit IRC17:05
*** gyee has joined #openstack-swift17:06
*** arnox has quit IRC17:08
notmynamebah, eranrom left17:08
openstackgerritMustafa ÇELİK proposed openstack/swift: Extra X-Timestamp are removed from error responses  https://review.openstack.org/26816317:08
*** klrmn has quit IRC17:11
*** ho_away has joined #openstack-swift17:23
*** dmorita has joined #openstack-swift17:26
*** dmorita has quit IRC17:27
*** ho_away has quit IRC17:27
*** dmorita has joined #openstack-swift17:31
*** daemontool has joined #openstack-swift17:34
openstackgerritJohn Dickinson proposed openstack/swift: authors and changelog updates for 2.6.0  https://review.openstack.org/26991117:35
notmynameupdated changelog to include the contaienr sync improvements ^17:35
notmynamenow it's time to commute to the office and do a bunch of meetings17:36
*** mragupat has quit IRC17:37
*** Jeffrey4l has quit IRC17:40
*** daemontool has quit IRC17:44
*** jmccarthy has quit IRC17:46
*** rledisez has quit IRC17:51
*** nadeem has quit IRC17:54
*** mragupat has joined #openstack-swift17:58
*** mragupat has quit IRC17:59
*** haomaiwa_ has quit IRC18:01
*** haomaiwang has joined #openstack-swift18:01
*** klrmn has joined #openstack-swift18:07
*** lifeless_ is now known as lifeless18:12
*** natarej_ has joined #openstack-swift18:13
*** takashi has joined #openstack-swift18:13
*** diazjf has quit IRC18:14
*** timur has joined #openstack-swift18:16
*** Zyric_ has joined #openstack-swift18:16
*** kragniz_ has joined #openstack-swift18:17
*** peluse_ has joined #openstack-swift18:18
*** wasmum- has joined #openstack-swift18:19
*** peterlisak_ has joined #openstack-swift18:20
*** eranrom has joined #openstack-swift18:20
*** diazjf has joined #openstack-swift18:21
*** ahale has quit IRC18:22
*** timur_ has quit IRC18:22
*** takashi__ has quit IRC18:22
*** marcusrafael has quit IRC18:22
*** luksaur has quit IRC18:22
*** peluse has quit IRC18:22
*** natarej has quit IRC18:22
*** peterlisak has quit IRC18:22
*** wasmum has quit IRC18:22
*** sudorandom has quit IRC18:22
*** Zyric has quit IRC18:22
*** portante has quit IRC18:22
*** pchng has quit IRC18:22
*** kragniz has quit IRC18:22
*** Zyric_ is now known as Zyric18:22
*** peterlisak_ is now known as peterlisak18:22
*** gyee has quit IRC18:22
*** gyee has joined #openstack-swift18:23
*** davidhadas_ has quit IRC18:23
*** hyakuhei has quit IRC18:23
*** ahale has joined #openstack-swift18:23
*** portante has joined #openstack-swift18:23
*** lpabon has quit IRC18:24
*** ho_away has joined #openstack-swift18:24
*** sudorandom has joined #openstack-swift18:24
*** hseipp has quit IRC18:25
*** delattec has quit IRC18:26
*** delattec has joined #openstack-swift18:27
*** luksaur has joined #openstack-swift18:28
*** marcusrafael has joined #openstack-swift18:29
*** ho_away has quit IRC18:30
*** dmorita has quit IRC18:31
*** dmorita has joined #openstack-swift18:33
*** sudorandom has quit IRC18:35
*** sudorandom has joined #openstack-swift18:37
*** pchng has joined #openstack-swift18:39
claygyay eranrom container sync!18:40
eranromclayg,: Thanks Clay! Its only the beginnig though :-)18:43
notmynameeranrom: note the inline comment on my review. there is one small follow-up that I think should happen18:46
*** sudorandom has quit IRC18:48
*** sudorandom has joined #openstack-swift18:48
*** flaper87 has quit IRC18:54
*** flaper87 has joined #openstack-swift18:54
eranromnotmyname,:looking18:56
*** cebruns_ has quit IRC18:56
*** cebruns_ has joined #openstack-swift18:56
*** hrou has quit IRC18:57
*** hrou has joined #openstack-swift18:57
*** jrichli has quit IRC18:57
*** jrichli has joined #openstack-swift18:57
*** jlhinson has quit IRC18:57
*** jlhinson has joined #openstack-swift18:57
*** awelleck has quit IRC18:58
*** awelleck has joined #openstack-swift18:58
*** sudorandom has quit IRC18:59
openstackgerritAlistair Coles proposed openstack/swift: Fix bug in mem_diskfile write_metadata method  https://review.openstack.org/27042218:59
*** wasmum- has quit IRC18:59
*** wasmum- has joined #openstack-swift18:59
*** portante has quit IRC18:59
*** portante has joined #openstack-swift18:59
acoleskota_: well that was fun :/ ^^18:59
*** pchng has quit IRC18:59
*** pchng has joined #openstack-swift18:59
acoleskota_: maybe try applying that patch to your test to see if it fixes things19:00
acoleseranrom: so, now container-sync is all done, would you like to review fast-post?? :P19:00
*** haomaiwang has quit IRC19:01
*** 17WABLM3R has joined #openstack-swift19:01
*** dmorita has quit IRC19:02
*** mragupat has joined #openstack-swift19:02
*** mragupat has quit IRC19:02
*** mragupat has joined #openstack-swift19:02
*** mragupat has quit IRC19:03
eranromacoles,: Absolutely. in fact I thought there is also come container sync coding to do there.19:03
eranromacoles: and it is totally not all done :-)19:03
acolesmattoliverau: I added dashboard links to my gerrit menu like you discovered, but they seem to open a new browser tab every time - is that what you see?19:03
*** mragupat has joined #openstack-swift19:03
acoleseranrom: true!19:04
eranromacoles: do you want to point me to a specific patch to start with?19:04
*** dmorita has joined #openstack-swift19:04
*** dmorita has quit IRC19:05
acoleseranrom: i was sort of kidding, but patch 13538019:05
patchbotacoles: https://review.openstack.org/#/c/135380/ - Update container on fast-POST19:05
acoleseranrom: could be worth reading the spec first https://specs.openstack.org/openstack/swift-specs/specs/in_progress/fastpostupdates.html19:06
eranromacoles,: I was not :-) I would also like to do the containr sync conding stuff. but first things first...19:06
acoleseranrom: caveat - we may have deviated from the spec in practice19:06
eranromacoles,: alright.19:07
acoleseranrom: thanks!19:07
acolesback later for meeting19:07
*** dmorita_ has joined #openstack-swift19:07
*** acoles is now known as acoles_19:08
*** acoles_ is now known as acoles19:09
*** acoles is now known as acoles_19:09
*** geaaru has quit IRC19:09
*** ChubYann has joined #openstack-swift19:12
*** aix has quit IRC19:16
*** zhill has joined #openstack-swift19:19
*** dmorita_ has quit IRC19:22
*** dmorita has joined #openstack-swift19:22
*** lpabon has joined #openstack-swift19:23
*** lpabon has quit IRC19:25
*** ho_away has joined #openstack-swift19:26
*** dmorita has quit IRC19:27
*** diogogmt has joined #openstack-swift19:28
*** ho_away has quit IRC19:30
*** mrmoje has quit IRC19:33
*** mrmoje has joined #openstack-swift19:33
*** diazjf has quit IRC19:35
*** diazjf has joined #openstack-swift19:47
*** dmorita has joined #openstack-swift19:49
*** silor has quit IRC19:50
jrichliyay!  container sync improvements.19:50
*** nadeem has joined #openstack-swift19:55
*** nadeem has quit IRC19:56
*** nadeem has joined #openstack-swift19:56
*** 17WABLM3R has quit IRC20:01
*** haomaiwang has joined #openstack-swift20:01
ZyricGood morning20:03
*** mragupat_ has joined #openstack-swift20:08
eranromjrichli,: Thanks! :-)20:08
*** mragupat has quit IRC20:11
*** sudorandom has joined #openstack-swift20:18
*** changbl has quit IRC20:19
*** mrmoje has quit IRC20:21
*** dmorita has quit IRC20:22
*** dmorita has joined #openstack-swift20:23
*** dmorita has quit IRC20:27
*** sudorandom has quit IRC20:28
*** diazjf1 has joined #openstack-swift20:35
*** diazjf has quit IRC20:37
*** awelleck has quit IRC20:40
mattoliveraumorning all20:40
mattoliverauThe wife has a doctors appointment this morning, so I'll do the right thing and get her to drive while I attend the meeting on my phone.. if I'm a bit slow or in and out thats why ;)20:41
eranrommattoliverau,: morning. Are you sure this is the right thing?20:41
mattoliveraueranrom: her suggestion, so I trained her right ;)20:42
eranrommattoliverau,: :-) In my case I am the one trained right I guess...20:42
*** sudorandom has joined #openstack-swift20:42
eranrommattoliverau,: depends who you ask of-corse :-)20:43
*** cbartz has joined #openstack-swift20:43
mattoliveraueranrom: lol!20:44
*** ho_away has joined #openstack-swift20:49
*** cbartz has quit IRC20:49
*** cbartz has joined #openstack-swift20:50
notmynamemattoliverau: lol20:51
*** sudorandom has quit IRC20:53
*** cbartz has quit IRC20:54
*** changbl has joined #openstack-swift20:54
*** awelleck has joined #openstack-swift20:55
*** cbartz has joined #openstack-swift20:56
*** acoles_ is now known as acoles20:57
mattoliverauacoles: mine don't open in new windows. Once I'm in front my laptop I'll take a closer look20:58
mattoliverau^^ dashboard links20:58
kota_good morning20:59
notmynamehello20:59
ho_awaygood morning!20:59
onovymorning20:59
notmynamemeeting time in #openstack-meeting20:59
acolesmattoliverau: thanks. maybe i did something wrong21:00
*** haomaiwang has quit IRC21:01
*** joeljwright has joined #openstack-swift21:01
*** ChanServ sets mode: +v joeljwright21:01
*** m_kazuhiro has joined #openstack-swift21:13
*** finisherr has joined #openstack-swift21:14
finisherrJust in case anyone is interested, the strange encoding issue I was having was coming from the boto client's s3 bridge21:14
finisherrrequets with curl did not encode colons to %3a21:14
finisherrNow, I have another issue on my hands. I have a staging cluster that was built. Getting 404s on puts (uploads)21:15
finisherranyone know off hand might cause that outside of maybe permissions ont he account or container directories?21:15
cschwedezaitcev: please have a look at patch 269811 if you want to have a look at the eventlet version bump before it get’s merged21:17
patchbotcschwede: https://review.openstack.org/#/c/269811/ - Bump eventlet min version to 0.17.421:17
zaitcevcschwede: F23 ships with eventlet-0.17.4. What is your concern?21:18
*** m_kazuhi_ has joined #openstack-swift21:19
cschwedezaitcev: no concerns from my side, i just wanted to ping you about it and check if you have any concerns ;)21:19
*** m_kazuhiro has quit IRC21:19
*** nadeem has quit IRC21:19
*** diazjf1 has quit IRC21:19
zaitcevcschwede: Thanks, I saw that patch and I don't have any issues with it.21:20
cschwedezaitcev: alright, thx! +A’ed, should be merged in 1-2 days…21:21
*** diazjf has joined #openstack-swift21:22
*** delattec has quit IRC21:28
*** m_kazuhiro has joined #openstack-swift21:33
notmynamefinisherr: good to know (where the bug is)21:33
finisherrnotmyname: right?21:33
hrouAt the account level can you get a list of which containers belong to which storage policy (I see its in the account db container table) but is there an external API way of getting at it or its not returned ?21:34
*** m_kazuhi_ has quit IRC21:34
*** m_kazuhi_ has joined #openstack-swift21:36
*** m_kazuhi_ has quit IRC21:37
clayghrou: oh bother, does it not come back in the json response?21:37
*** m_kazuhiro has quit IRC21:37
hrouclayg, I didn't think I was seeing it but maybe I was losing it ;)21:38
clayghrou: no i don't see where the select in account.backend is calling for it - so I don't see how it could make it's way into the response21:40
hrouclayg, yep: {"count": 2, "bytes": 15, "name": "cont6"}21:41
clayghrou: seems like an annoying-ish oversight - I *think* the way the account currently handles storage_policy_index is to just update the row/stats for which ever (container, policy) update came in last - so it should be trivial to add to the response21:41
hrouclayg, seems like an easy fix ? :)21:41
clayghrou: not sure if there's a api version issue with adding a new field21:41
claygquite possible when we were doing the storage policy work we tried to avoid the whole api question/debate by not adding it and no one thought to loop back around and ask if the question/debate should be raised?21:42
claygthere's always hope swift might get a new api version some day21:42
notmynamelol21:42
eranromwhat if we return this only if we have it specifically asked for in the query string?21:42
hrouclayg: there's always one day ;)21:42
claygeranrom: qs param might be a good way to go21:44
hrouclayg, awesome thanks for confirming I wasn't crazy (given there are backdoors at getting at it there's always workarounds), let me dig into the code see if it is indeed an API problem21:44
claygeranrom: or at least a way to dodge the issue21:44
eranromclayg,that is until bumping the api version :-)21:45
claygeranrom: if you keep coming up with reasonable ways to extend new features into the api without breaking backwards compat we'll *never* get a new api version21:45
hroulol21:46
notmynameis adding a key a breaking change that we can't do?21:46
eranromclayg,Any way to delete comments in IRC?21:46
claygnotmyname: not sure21:46
clayglol!21:46
* notmyname goes back to the meeting21:46
hroudarn it eranrom; just stop being so clever;  That happens a lot outside of swift too ; )21:46
*** sudorandom has joined #openstack-swift21:47
claygnotmyname: I'd guess that json clients would be fine - based on all the ways I could imagine someone might be parsing the json - maybe some new client doesn't work with some old swift cluster if they don't realize it was an *addition* to the account listing response21:47
*** cdelatte has joined #openstack-swift21:47
*** dmorita has joined #openstack-swift21:47
*** haomaiwa_ has joined #openstack-swift21:47
claygnotmyname: xml - i have no idea - there's probably schemas involved and the entire world will melt in a ball of fire21:47
notmynameas is typical for xml21:48
eranromfor the sake of large api versions I will not pose an idea how to overcome the potential xml issue.21:50
ahaleyou could maybe argue it could fit into the Accept request header21:50
*** zhill has quit IRC21:53
*** changbl has quit IRC21:55
*** cdelatte has quit IRC21:56
torgomaticonce we changed the xml output by using a real XML library instead of string concatenation... IIRC, the output was identical except for whitespace21:56
torgomaticwe had to revert it because it broke clients21:56
torgomatic"parsing"21:56
*** cdelatte has joined #openstack-swift21:58
*** bjkeller has joined #openstack-swift22:01
*** haomaiwa_ has quit IRC22:01
*** haomaiwang has joined #openstack-swift22:01
notmynameI don't like the idea of adding a storage policy in the output based on a query parameter22:02
*** cdelatte has quit IRC22:02
*** cbartz has left #openstack-swift22:03
acolesclayg: hi, got a few mins?22:03
onovyho_away: are you here?22:04
ho_awayonovy: yup22:05
onovyi want to talk about half of * servers downed22:05
onovywe are using 4 replicas :)22:05
eranromnotmyname,: Now I can sleep well knowing I did not contribute to leaving the API version as is :-) Good night and thanks again!22:05
onovyso if i understand it correctly, post/put/delete to account/container will fail?22:05
onovywhen 2 of primary replica is offline?22:05
*** cdelatte has joined #openstack-swift22:06
kota_eranrom: good night.22:06
acoleseranrom: congrats on the sync patch btw :D22:06
ho_awayonovy: as for the post account, if account servers downed, the api will be failed22:06
hroueranrom, night!22:06
eranromthanks all! good night22:07
*** eranrom has left #openstack-swift22:07
ho_awayonovy: post container is same as post container.22:07
onovyho_away: but only write operations, post/put/delete, right?22:07
onovyOR only posts are affected?22:07
ho_awayonovy: yes.22:08
onovyyes first or second one? :)22:08
ho_awayonovy: as for the put/delete container, if account servers dowend the api will be failed22:08
ho_awayonovy: first one.22:08
ho_awayonovy: replication saves the situation but api failed22:09
onovyhmm, thats critical for us22:10
ho_awayonovy: in 4 replicas case it is necessary to down two servers at one time, it's not easy :-)22:11
onovywe have georeplicated cluster. 2+222:11
onovyand we will disconnect whole datacenter22:11
*** kragniz_ is now known as kragniz22:12
ho_awayonovy: different region in rings?22:12
onovyyes22:12
onovy2 regions, 2 zones in every region. r=422:12
onovy16 a+c+o servers22:13
onovyso 4 servers / zone22:13
acoleshrou: clayg notmyname the discussion re adding storage policy to listing sounds similar to kota_'s patch to add last modified time22:13
ho_awayonovy: i see. if connection b/w regions is lost, it might happen22:13
claygacoles: sorry i missed you :'(22:14
acolesclayg: i'm still here !22:14
onovyho_away: read operations will work, right?22:14
ho_awayonovy: right! i tested with 2 replicas env.22:14
ho_awayonovy: and object related operations will work too with default config.22:15
claygacoles: oh neat!  you shouldn't be asleep tho.  you need your beauty rest before you host the hack-a-thon!22:15
clayger... should be asleep - w/e22:15
acoleshrou: clayg oops I meant to add a link there, https://review.openstack.org/#/c/198634/1422:15
onovyso writting to existing containers will work22:15
acolesclayg: you mean i don;t have enough beauty already? ;)22:16
acolesclayg: so here's my question...22:16
claygheh22:16
ho_awayonovy: i think so.22:16
*** joeljwright is now known as 17WABLOCX22:16
*** joeljwright has joined #openstack-swift22:16
acolesclayg: while fixing .meta files never getting reclaimed I discovered that .ts files *may* never get reclaimed22:16
onovyho_away: ok. thanks for information. i will test it22:17
ho_awayonovy: you are welcome! please share your results :-)22:18
acolesclayg: AFAICT reclaim only happens if the suffix is re-hashed, and that only happens if something calls an invalidate_hash for the suffix, so if nothing changes in the suffi then a .ts will never be reclained22:18
claygacoles: maybe you discovered a *new* way in which ts files may never get reclaimed?  because we already have a bug open for the inactive suffixes don't trigger reclaim thing22:18
acolesclayg: aha!22:18
claygacoles: that sounds liek the old way22:18
acolesclayg: so its a known thing22:18
*** joeljwright1 has joined #openstack-swift22:18
onovyho_away: we will know 27th - scheduled downtime for datacenter22:19
* acoles goes to look for bug22:19
*** 17WABLOCX has quit IRC22:19
claygacoles: maybe - lp bug #130172822:19
openstackLaunchpad bug 1301728 in OpenStack Object Storage (swift) "tombstone (.ts) object will never be deleted if the hash_suffix exists in the hashes.pkl " [Undecided,In progress] https://launchpad.net/bugs/1301728 - Assigned to Brian Cline (briancline)22:19
hrouacoles, thanks for that !22:20
acolesclayg: yeah that looks like it. thought I had gone insane!22:20
onovybtw: where is Swift recommendation to have even replicas count?22:20
acolesclayg: the do_listdir behavior looks wacky too but thats a different issue i think22:21
*** joeljwright has quit IRC22:21
claygonovy: I think three is a pretty popular replica count - and my understanding of number systems wouldn't classify that as even?22:21
claygonovy: that is to say - i'm not sure I"m aware of such a recommendation?22:21
onovyclayg: https://review.openstack.org/#/c/266190/22:21
onovySwift recommends number of replicas is odd number but some deployers22:21
onovyuse even number because of combination with SDS products.22:21
acolesclayg: that sounds odd :)22:21
onovydon't have even, sry :)22:21
*** nadeem has joined #openstack-swift22:22
onovyso: where is Swift recommendation to have __odd__ replicas count? :)22:23
claygonovy: we have some implementations that seem to prefer it - there's some debate if quorum on 4 is 3 or 222:23
claygwell not really *debate* - the answer according to code/implementation/tests is *3*22:23
claygbut the consequences when you have a replcia count of 2 is decidly annoying :'(22:23
onovyso event replicas count is fine?22:23
onovybecause we have 4 and need to have 4 :)22:24
claygyeah 4 is one better than 322:24
onovynot really everytime22:24
clayg2/3 => 3/4 - that's some strong data protection right there22:24
onovylook to that review22:24
claygwhich one?  ho has like a dozen22:25
onovyhttps://review.openstack.org/#/c/266190/ for example22:25
claygthat man is like timburke it's impossible to keep up22:25
onovy:)))22:25
acolesclayg: there's useful discussion on that bug report, thanks for the link. we've seen these lingering tombstones in the wild too.22:25
onovyexactly i'm really woried now22:25
*** blmartin has quit IRC22:28
*** zhill has joined #openstack-swift22:29
claygacoles: yeah I *thought* we had a plan to move forward with them but not make replication sad - but it got lost22:30
claygonovy: yeah I'm pretty sure I agree with cschwede that treating the 404's as 204 is gunna have a bad time22:31
onovyfrom production point22:31
onovy2+2 replicas (in two regions)22:31
acolesclayg: maybe I'll look at a fix. I'd also thought about having the auditor do it but it would be nice if it all got taken care of in replicator.22:31
claygonovy: I think hrou's main point was that almost everything sucks when you have two replicas22:31
onovyone region offline22:31
claygacoles: well i'm down either way22:31
claygonovy: I think metadata handling in geo clusters is sort of an orthoganal issue tho :\22:32
onovyclayg: but from this point it sucks to have 4 replicas in two region too22:32
acolesclayg: oh man, you're going to have to remind again, is 'down' positive or negative in your nation's language?22:32
claygacoles: it can go either way!22:32
notmynameacoles: it's english. don't you know that?22:33
claygacoles: in this context I meant that it was acceptable to me for either the auditor or the replicator to handle reclimation of tombstones in inactive suffixes22:33
onovyclayg: so simple question: is BAD idea to have geo cluster with 2 replica in each region?22:34
acolesclayg: lol. that's the way, spell it out nice and clear for the slow members of the team ;)22:34
claygonovy: I think it just sucks to have remote regions in the direct data path for metadata updates22:34
*** joeljwright1 has quit IRC22:34
claygacoles: hardly - language is hard - esspecially when some people don't type native 'merican!22:34
*** joeljwright has joined #openstack-swift22:34
*** ChanServ sets mode: +v joeljwright22:34
*** zhill has quit IRC22:35
claygonovy: I think that's fine for object data22:35
onovyclayg: simple question, not too simple answer :)22:35
*** joeljwright has quit IRC22:35
*** changbl has joined #openstack-swift22:36
claygonovy: but I think metadata layer is less obvious - it was one of the pain points to come up in japan from operators on geo clusters22:37
onovyif you say "metadata" you mean X-Meta headers right?22:38
notmynameno, the account and container22:39
claygonovy: no - i meant account and container storage22:39
onovyhmm22:39
claygnotmyname: you've got my saio all busted running crappy old eventlet - dork22:39
notmynameI fixed it though. patch 26981122:40
patchbotnotmyname: https://review.openstack.org/#/c/269811/ - Bump eventlet min version to 0.17.422:40
onovybut if you say "object data" is fine and container server is not, how can i combine it?22:40
notmynameclayg: or, "you're not running latest nightly code? wow."22:40
onovyi can't add any object without container server... :)22:40
claygnotmyname: :)22:41
onovyour usecase is simple: we have 2 DC for redundancy. Inside DC must be redundancy too. So 4 replicas is "ideal". 2 in every DC22:41
ho_awayonovy: clayg: i'm back. i heard if apis response with 50X, users thought the cloud downed so deployers would like to avoid the situation.22:42
claygyeah i get it - and the account & container layer is going to get on your nerves22:42
onovywe are putting images/videos/garbage inside Swift22:42
claygho_away: yup, i get it22:42
onovyclayg: ok, how to avoid it?22:42
claygjesus - I DON'T KNOW :P22:42
claygwrite better geo cluster support for the metadata layer (whatever that looks like)22:43
notmynameonovy: yeah. and you're not the only one who's done that exact setup. but with the containers, you've got 3 or 4 replicas there, and there's no concept of policies. so the replicas are spread across the ring. which means that even with a single-region policy, you might be updating a remote contianer replica22:43
onovyhey :) so how other ones do this?22:43
* clayg has ideas - but dick all for getting it done22:43
onovynotmyname: yep, i'm fine with this. latency is not a problem22:43
*** BAKfr has joined #openstack-swift22:43
claygonovy: I think "others" mostly gripe (along with us) about the existing implementation is not ideal when we get together at design summits?22:44
notmynametorgomatic has an interesting idea along these lines that involves a ring of rings22:44
onovybut if one region go offline i want to use 2 replicas inside working location and second 2 from handoff22:44
onovyso all 4 replicas will go from one location22:44
claygnotmyname: orthoganal I think22:44
notmynameif latency isn't a problem, then what's the problem? :-)22:45
onovynotmyname: availability22:45
*** acoles is now known as acoles_22:46
onovyhttps://review.openstack.org/#/c/266190/ // this review says: when one of your region will be offline (which is half of replicas) you can write22:46
onovycan't22:46
*** jamielennox|away is now known as jamielennox22:47
claygonovy: I think that's just restating what you've already pointed out22:47
notmynameyeah. I think ho_away is actually trying to quantify and solve the problem22:47
onovyclayg: yep. but john asked what's the problem22:47
*** BAKfr has quit IRC22:47
notmynameas if I know what's even going on ;-)22:48
onovyso conclusion: it's not bad setup if latency is not a problem and when ho fixies this, i'm fine22:48
onovyright? :)22:48
onovyand i will be fine event if whole region is offline22:49
onovy*even22:49
notmynameseems like the current question at hand is for us (all of us) to say if http://paste.openstack.org/show/484089/ is what's intended. and if not, then we've got the patches to fix it22:49
*** asettle has joined #openstack-swift22:51
claygnotmyname: cschwede has looked at those patches more closely than I have - but his -1's seem to read "this changes the behavior, but the consequnses are not desirable"22:52
claygi could make *every* request reutrn 2XX22:52
claygit wouldn't even that big of middleware22:52
*** diogogmt has quit IRC22:52
claygok, well good - shut that discussion right down - wtg clayg22:55
notmynameno, I just havent' looked at the patches. and I just got an interesting email reply from someone who's been doing some code analysis on swift22:57
notmynameand that distracted me22:57
*** m_kazuhiro has joined #openstack-swift22:58
ho_awayclayg: sorry i'm preparing to go office, can we share the impact of problem?22:58
*** mrmoje has joined #openstack-swift22:59
claygho_away: honestly I think the impact of the problem is understood, but cschwede's review is sound - the approach/implementation in those patches is problamatic22:59
onovysry must go sleep now. it's midnight here22:59
onovygn23:00
claygI also think the specific situation with a 2-region-4-replica ring is more interesting than 2 replica metadata rings - and we should be careful trying to trivialize them as equivilant23:00
ho_awayclays: i understand. it's same as object's behavior. is there any histrical reason why account and container don't take care of it.23:00
*** haomaiwang has quit IRC23:01
*** haomaiwa_ has joined #openstack-swift23:01
ho_awayclayg: i don't find doc but a potential deployer said there is a doc for two replica example in swiftstack.23:02
ho_awayonovy: good night!23:02
claygho_away: that's one way to say it - the storage implementation is different - and they've evolved at different rates - I would say the object server handling  for geo clusters is much more sofisticated than the metadata controllers - but the same strategies won't apply one-to-one23:02
*** bhakta has quit IRC23:03
claygho_away: that might be true, but even best practices of today may not lead to ideal results - always room to improve!23:03
*** saltsa_ has quit IRC23:04
*** joeljwright has joined #openstack-swift23:04
*** ChanServ sets mode: +v joeljwright23:04
joeljwrighttimburke: you available?23:04
timburkejoeljwright: yep23:05
*** saltsa has joined #openstack-swift23:05
joeljwrightJust wanted to revisit patch 184957 - it seems to have seen some action while I was away enjoying myself23:05
patchbotjoeljwright: https://review.openstack.org/#/c/184957/ - Add --decode-content option23:05
*** bhakta has joined #openstack-swift23:05
*** mragupat_ has quit IRC23:05
joeljwrightlast time we spoke about it you weren't convinced it was something we should merge…23:06
*** zhiyan has quit IRC23:06
ho_awayclayg: thanks for the explanation. do you have any idea to solve the situation?23:06
*** dmorita has quit IRC23:07
claygho_away: idk, your probably is specifically 2-region-4-replica yah?23:08
clayg*problem23:08
*** zhiyan has joined #openstack-swift23:08
timburkejoeljwright: well, i've tried to make sure it was always in a state where i'd be content to see it merged, but i've always been a bit skeptical that it's in-scope for swiftclient. i'd still like to know what the community thinks; notmyname seemed optimistic about it, as i recall, but more voices are better23:08
ho_awayclayg: and also 2-region-2-replica23:08
ho_awayclayg: the problem comes from 2-region-2-replica with SDS env.23:09
claygI'm not sure I understand the use-case for less than 3 replicas in the metadata layer23:09
claygthe risk cost curve doesn't make sense to me23:10
joeljwrighttimburke: maybe something to stuff under people's noses at the hackathon and extract an opinion by force?23:10
joeljwright:)23:10
timburkesounds like a plan23:11
claygtimburke: you should totally prepare a fire-side chat on "content/transfer encoding for dummies"23:12
ho_awayclayg: yeah, they would like to have same num of replica in one region because of performance (want to have same performance)23:12
joeljwrightok, I have to disappear - have a good day peeps23:13
timburkeclayg: i definitely know more about it now than i ever really cared to :P23:13
*** blair has quit IRC23:13
*** joeljwright has quit IRC23:13
timburkeclayg: though it turns out transfer-encoding isn't in the purview of WSGI filters/applications. not that i've let that stop me; i just break the spec23:14
claygtimburke: but the wsgi server could still support/handle it yeah?23:15
timburkeclayg: yeah. it'd mean some eventlet patches23:16
timburke(if we wanted to do it properly)23:16
claygtimburke: i doubt that's the case ;)23:16
*** blair has joined #openstack-swift23:17
*** km__ has joined #openstack-swift23:17
*** km__ is now known as Guest7957123:18
*** bjkeller has left #openstack-swift23:19
*** nadeem has quit IRC23:20
*** awelleck has quit IRC23:21
timburkeclayg: in that case... https://gist.github.com/tipabu/7c8ed7a713a7f51f20c2 (there's a wsgi_input hack around L286)23:21
openstackgerritJohn Dickinson proposed openstack/swift: remove unneeded duplicate dict keys  https://review.openstack.org/27052323:21
notmynametotally critical patch there ^ /s23:21
*** diazjf has quit IRC23:22
*** ho_away has quit IRC23:23
timburkenotmyname: makes me think of my recent patch 269399 and patch 26989123:23
patchbottimburke: https://review.openstack.org/#/c/269399/ - Get rid of FakeConn cruft (MERGED)23:24
patchbottimburke: https://review.openstack.org/#/c/269891/ - Prevent test runs from cluttering current directory23:24
clayglook at you two trying to make things better23:24
claygso cute23:24
*** kei_yama has joined #openstack-swift23:30
*** cdelatte has quit IRC23:32
openstackgerritCatherine Northcott proposed openstack/swift: Let developers/operators add watchers to account audit  https://review.openstack.org/26883023:42
*** dmorita has joined #openstack-swift23:46
*** BAKfr has joined #openstack-swift23:47
*** chsc has quit IRC23:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!