Friday, 2015-04-24

claygman I do *NOT* understand this deepcopy memo shizzy00:06
claygalright ok, wait hold oh, i'm getting something now, ok...00:08
claygOH-KAY!  I got it.00:10
claygwell maybe00:11
*** tsg_ has quit IRC00:11
*** annegentle has joined #openstack-swift00:15
*** annegentle has quit IRC00:20
*** Vinsh has quit IRC00:23
*** gyee has quit IRC00:29
mattoliveraulol00:31
*** kota_ has joined #openstack-swift00:32
kota_good morning00:33
*** Vinsh has joined #openstack-swift00:35
*** Vinsh has quit IRC00:36
*** vinsh has joined #openstack-swift00:39
mattoliveraukota_: morning00:43
notmynamehello mattoliverau and kota_00:43
*** atan8 has quit IRC00:47
*** atan8 has joined #openstack-swift00:51
*** esker has quit IRC00:53
*** bkopilov has quit IRC00:58
*** zhill has quit IRC01:10
*** haigang has joined #openstack-swift01:15
openstackgerritMerged openstack/swift: Fix conflict SLO reponse  https://review.openstack.org/15730501:16
*** bkopilov has joined #openstack-swift01:18
kota_Nice, the fix merged :)01:18
openstackgerritMerged openstack/python-swiftclient: Add socket-level read timeout parameter  https://review.openstack.org/16867301:18
*** atan8 has quit IRC01:23
mordredclayg: I'm happy to dig in and and patch it in to get_auth - doesn't look too hard to follow up with01:28
*** atan8 has joined #openstack-swift01:29
claygmordred: oh yeah np, that'd be cool01:30
claygmordred: I guess we have a bug for it now - so make sure you get a closes tag in there!  :D01:32
mordredwow. I get to close a swift bug?01:33
mordrednext thing you know I'm going to do something useful ...01:33
openstackgerritMonty Taylor proposed openstack/python-swiftclient: Use a socket timeout in get_auth  https://review.openstack.org/17704701:37
*** jkugel has joined #openstack-swift01:39
mattoliveraumordred: baby steps man, baby steps :P01:43
mordredmattoliverau: :)01:45
*** asettle has joined #openstack-swift01:47
asettlemattoliverau I've moved in01:48
*** atan8 has quit IRC01:48
mattoliveraunotmyname, clayg: meet asettle, she's a doc writer on my Australian rackspace team, and I've conned her into being a doc wirter specifically for upstream swift ;)01:49
notmynameyay01:49
asettleHaha01:49
mattoliverauI can't spell ^^ so obviously need her01:49
asettleo/ ola amigos01:49
notmynameasettle: nice to meet you01:49
asettlenotmyname John, we met in Auckland :p01:50
notmynameah ok :-)01:50
asettleHahaha01:50
asettleTHanks for the welcome, however.01:50
notmynamewe had someone propose a docs session for the summit. get a handle on what's going on: dev, ops, user docs and figure out how to make them better01:50
asettleWas that Lana?01:51
notmynameasettle: https://etherpad.openstack.org/p/liberty-swift-summit-topics01:51
notmynameno. donagh from hp01:51
mattoliverauasettle: so us developers have been trying hard to be good people and keep doc/souce uptodate.. I'll say sorry in advance :P01:51
mattoliveraudonagh is actually acoles_away in disguise as best I can tell.01:52
notmyname(not really, but that's what we let mattoliverau think)01:52
mattoliveraulol01:52
asettleHahaha01:53
asettlenotmyname thanks, I'll take a look through it01:53
asettleI won't be attending this summit (boooo), however I'll be attending the next. So I can try my best to keep an eye on things and help where I can01:53
asettlemattoliverau no stress, I'm sure you guys have done an awesome job :)01:53
mattoliveraufamous last words :P01:54
mattoliverauon that, I'm going back to writing/debugging a sharding daemon :)01:55
asettleHahaha thanks mattoliverau :p01:56
asettleAnyway, I gotta skip out for team lunch. I'll be back to read through all this... *waves at computer*01:56
*** asettle is now known as asettle-luncheon01:57
*** xianghuihui has joined #openstack-swift02:02
*** bkopilov has quit IRC02:03
*** xianghuihui has quit IRC02:09
*** zhill has joined #openstack-swift02:11
*** zhill has quit IRC02:16
claygtorgomatic: so i convinced myself keying "the_copy" into memo as "id(self)" is just not helpful (or useful, but I think we already knew that)02:28
claygtorgomatic: you wanna hear about it in the review, or have me push over, or +A with a dependent change and try and advocate to get it removed?02:29
*** haigang has quit IRC02:58
openstackgerritClay Gerrard proposed openstack/swift: Simplify ring.builder.RingBuilder.__deepcopy__  https://review.openstack.org/17706303:04
*** zhill has joined #openstack-swift03:12
*** zhill has quit IRC03:17
*** proteusguy has quit IRC03:35
*** xianghuihui has joined #openstack-swift03:40
*** xianghuihui has joined #openstack-swift03:41
*** esker has joined #openstack-swift03:42
*** esker has quit IRC03:47
*** tsg has joined #openstack-swift03:52
*** asettle-luncheon is now known as asettle03:54
*** breitz has quit IRC04:01
*** breitz has joined #openstack-swift04:02
*** ppai has joined #openstack-swift04:06
*** zhill has joined #openstack-swift04:12
*** zhill has quit IRC04:17
*** esker has joined #openstack-swift04:25
*** atan8 has joined #openstack-swift04:30
*** zaitcev has quit IRC04:32
*** silor has joined #openstack-swift04:37
openstackgerritMerged openstack/swift: Make RingBuilders deep-copy-able  https://review.openstack.org/17556704:38
*** bkopilov has joined #openstack-swift05:04
*** bill_az has joined #openstack-swift05:11
*** zhill has joined #openstack-swift05:13
*** SkyRocknRoll has joined #openstack-swift05:16
*** zhill has quit IRC05:18
*** SkyRocknRoll has quit IRC05:20
*** bill_az has quit IRC05:25
*** atan8 has quit IRC05:26
*** SkyRocknRoll has joined #openstack-swift05:29
*** SkyRocknRoll has joined #openstack-swift05:29
*** tsg has quit IRC05:36
*** david-ly_ has joined #openstack-swift06:01
*** david-lyle has quit IRC06:03
*** chlong has quit IRC06:39
*** haomaiwang has quit IRC06:58
*** krykowski has joined #openstack-swift07:11
*** jistr has joined #openstack-swift07:44
*** acoles_away is now known as acoles07:57
*** jistr is now known as jistr|mtg08:09
*** km has quit IRC08:31
*** kei_yama has quit IRC08:36
*** aix has joined #openstack-swift08:40
*** jordanP has joined #openstack-swift09:04
openstackgerritKota Tsuyuzaki proposed openstack/swift: Don't show the query string for inner usage  https://review.openstack.org/17713209:23
*** jistr|mtg is now known as jistr09:32
*** proteusguy has joined #openstack-swift09:40
*** haomaiwang has joined #openstack-swift09:42
*** ppai has quit IRC09:45
*** ppai has joined #openstack-swift09:59
*** Bsony has joined #openstack-swift10:20
*** jkugel has quit IRC11:47
openstackgerritKota Tsuyuzaki proposed openstack/swift: Prevent to decode with invalid ec scheme  https://review.openstack.org/17719511:53
openstackgerritKota Tsuyuzaki proposed openstack/swift: Prevent to decode with invalid ec scheme  https://review.openstack.org/17719511:59
*** EmilienM has quit IRC12:01
*** EmilienM has joined #openstack-swift12:01
*** slo_ has quit IRC12:02
*** foexle has joined #openstack-swift12:20
*** kota_ has quit IRC12:30
*** ppai has quit IRC12:33
*** geaaru has joined #openstack-swift12:40
*** dencaval has joined #openstack-swift12:41
*** proteusguy has quit IRC12:52
*** jkugel1 has joined #openstack-swift13:02
*** jbonjean has left #openstack-swift13:10
*** G________ has joined #openstack-swift13:11
*** NM has joined #openstack-swift13:17
*** esker has quit IRC13:23
*** dencaval has quit IRC13:30
*** erlon has joined #openstack-swift13:33
*** doxavore has joined #openstack-swift13:37
doxavorewhen swift-container-server/sync/replicator are at 100% CPU, and the drives they're managing are at almost no utilization (decent SSDs), is there a recommended way to improve PUT performance? Do I _need_ more container devices, or is changing the number of workers acceptable?13:38
*** proteusguy has joined #openstack-swift13:41
*** esker has joined #openstack-swift13:57
NMdoxavore: I think to try more works is a easy path that can help.14:01
NMdoxavore: do you have any idea why is that happening? Are you getting any errors during the replication? Or do you have billions of containers?14:01
* NM is ashemed. Workers are not work and it's aN easy path. :P14:03
*** jrichli has joined #openstack-swift14:04
*** G________ has quit IRC14:08
*** Guest____ has joined #openstack-swift14:17
*** esker has quit IRC14:21
*** mmcardle has quit IRC14:22
*** mmcardle has joined #openstack-swift14:22
doxavoreNM: I mostly wanted to make sure I wasn't likely to add some race issues or the like by increasing those workers that are using 1 device per server for containers. we don't have a crazy amount of containers, on the neighborhood of 10k14:24
*** vinsh has quit IRC14:25
hurricanerixmorning14:26
doxavoreI'm not seeing any errors though, just adding about 500 files/minute. container and object disk I/O are very low14:26
jrichlihurricanerix: morning14:27
NMdoxavore: Joe Arnold books suggests you start with one worker per CPU.14:30
NMdoxavore: Since there is no magic number, the best way to find out is to try differents values untill you find your 'perfect value'.14:31
*** esker has joined #openstack-swift14:32
*** egon has quit IRC14:32
*** NM has quit IRC14:32
*** egon_ has joined #openstack-swift14:38
*** foexle has quit IRC14:42
*** vinsh has joined #openstack-swift14:42
*** foexle has joined #openstack-swift14:43
doxavoreNM: it appears more workers didn't improve PUT timing, though swift-container-sync and swift-container-replicator are both still at 100% on a single process (they don't appear to fork)14:46
*** krykowski has quit IRC14:48
*** foexle has quit IRC14:49
*** kota_ has joined #openstack-swift14:55
*** imkarrer__ has quit IRC15:04
*** Bsony_ has joined #openstack-swift15:04
*** Bsony has quit IRC15:06
*** Guest____ has quit IRC15:09
*** sandywalsh has quit IRC15:10
*** imkarrer has joined #openstack-swift15:13
*** Guest____ has joined #openstack-swift15:13
openstackgerritFilippo Giunchedi proposed openstack/swift: Additional exit codes for swift-drive-audit  https://review.openstack.org/12439815:16
*** Bsony_ has quit IRC15:17
*** david-ly_ is now known as david-lyle15:22
openstackgerritKota Tsuyuzaki proposed openstack/swift: Prevent to decode with invalid ec scheme  https://review.openstack.org/17719515:28
*** kota_ has quit IRC15:34
*** foexle has joined #openstack-swift15:37
notmynamegood morning15:38
acolesnotmyname: morning!15:40
*** Bsony has joined #openstack-swift15:43
*** dencaval has joined #openstack-swift15:44
*** mmcardle has quit IRC15:45
*** Guest____ has quit IRC15:50
*** foexle has quit IRC15:50
*** jordanP has quit IRC15:55
notmynametoday I'm going to be working on setting up some testing fro EC work, then I've got some swiftstack-specific stuff to focus on. what else is going on today?15:59
* acoles has been grubbing around in reconstructor probe testing and the bowels of ssync16:00
acolesnotmyname: so did you book flights for paris yet? ;)16:04
notmynameI gotta talk to people here about it today16:05
acoles'bon chance'16:07
*** gyee has joined #openstack-swift16:09
*** thumpba has joined #openstack-swift16:12
*** sandywalsh has joined #openstack-swift16:13
*** acoles is now known as acoles_away16:19
*** SkyRocknRoll has quit IRC16:29
*** tsg_ has joined #openstack-swift16:32
*** jistr has quit IRC16:36
*** acoles_away is now known as acoles16:41
*** acoles is now known as acoles_away16:42
*** doxavore has quit IRC16:44
*** doxavore has joined #openstack-swift16:54
*** tsg_ has quit IRC17:02
*** tsg_ has joined #openstack-swift17:02
*** NM has joined #openstack-swift17:05
*** zhill has joined #openstack-swift17:06
*** tsg_ has quit IRC17:10
*** tsg_ has joined #openstack-swift17:10
*** NM1 has joined #openstack-swift17:12
*** NM has quit IRC17:14
*** NM2 has joined #openstack-swift17:14
*** NM1 has quit IRC17:16
*** vinsh has quit IRC17:31
*** zaitcev has joined #openstack-swift17:33
*** ChanServ sets mode: +v zaitcev17:33
openstackgerritDenis Cavalcante proposed openstack/swift: Add storage policy support for sorting method  https://review.openstack.org/16087717:35
*** vinsh has joined #openstack-swift17:46
*** NM2 is now known as NM17:47
*** straycat has quit IRC17:54
*** geaaru has quit IRC18:04
claygnotmyname: can you update the dashboard code to filter merged from the started by PTL section18:05
notmynameor maybe I can unstar it ;-)18:06
claygnotmyname: no not good enough - it happens all the time - you're not a robot - just fix the tool18:06
*** sandywalsh has quit IRC18:06
notmynameyeah, I'm on it. that was my "fix right now". the long term fix will take my like 7 minutes!18:06
claygnotmyname: technically the dashboard is just a link that lives on our wiki right?   Like even I could fix it?18:07
notmynameyup. if you want to see how it works, wander over to my desk18:07
notmynamethere's a tool to easily edit it18:07
*** sandywalsh has joined #openstack-swift18:08
notmynameclayg: http://goo.gl/8IUcKl18:12
notmynamewiki updated18:13
*** ChanServ changes topic to "Review Dashboard: http://goo.gl/8IUcKl | Summary Dashboard: http://goo.gl/qHus5v | Summit scheduling: https://etherpad.openstack.org/p/liberty-swift-summit-topics | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/"18:14
notmynametopic updated18:14
notmynameFYI the dashboard tool is https://github.com/stackforge/gerrit-dash-creator18:14
notmynameand my patches for the swift dashboards are at https://review.openstack.org/#/c/160556/18:15
*** mfedosin has joined #openstack-swift18:15
claygpurdy cool18:16
claygtorgomatic: zaitcev: mordred: I feel like patch 177047 might be a good place to add some unittests for the kwarg plumbing18:19
patchbotclayg: https://review.openstack.org/#/c/177047/18:19
zaitcevclayg: well yeah, but hanging this onto mordred is like the classic thing about "this your little fix would be totally great if you implement this huge new function"18:20
claygzaitcev: I totally hear you - i was hoping maybe one of you guys could bang out a test real quick - or maybe leave the review up until monday and I'll kick something out18:21
claygi should have written a unittest for the other patch when I had it checked out18:22
claygI haven't checked out and tested get_auth yet18:23
claygbut torgomatic presumably did18:23
*** tsg_ has quit IRC18:25
zaitcevI added to my todo together with missing docstring18:25
claygzaitcev: nice!18:25
zaitcevnot yet18:26
zaitcev^_^18:26
notmynamezaitcev: so you've got a follow-on patch in the works with your TODO items covered?18:26
zaitcevyes unless I get hit by a bus18:27
notmynamecool.18:27
notmynameso why not push that as a new patch set here? that way we won't get distracted and forget about it18:27
zaitcevwell, after lunch then? I have a git-review bug to fix real quick18:28
claygnotmyname: zaitcev has shit to do man, he's a busy guy18:29
zaitcevmeanie18:32
claygzaitcev: I'm not sure if you ment me or notmyname - probably both - bunch of jerks we are :\18:53
*** doxavore has quit IRC18:54
*** vinsh_ has joined #openstack-swift19:00
*** lcurtis has joined #openstack-swift19:00
*** silor has quit IRC19:02
*** vinsh has quit IRC19:02
clayggah lp bug #1424108 is really hard to duplicate!19:07
openstackLaunchpad bug 1424108 in OpenStack Object Storage (swift) "KeyError: 'storage_policy_index' in _really_merge_items swift/account/backend.py" [Critical,Confirmed] https://launchpad.net/bugs/1424108 - Assigned to clayg (clay-gerrard)19:07
*** tsg_ has joined #openstack-swift19:09
*** zhill has quit IRC19:26
*** esker has quit IRC19:29
zaitcevHmm, my house is being beaten by hail, but I still have power19:31
notmynamewow. hope your roof and car are ok19:33
*** petertr7 has joined #openstack-swift19:34
openstackgerritMerged openstack/swift: Simplify ring.builder.RingBuilder.__deepcopy__  https://review.openstack.org/17706319:37
zaitcevwell, at least my airplane is in New York right now :-)19:39
*** minwoob has joined #openstack-swift19:45
*** zhill has joined #openstack-swift19:45
*** Bsony has quit IRC19:54
*** tsg_ has quit IRC19:57
*** tsg_ has joined #openstack-swift20:02
*** lcurtis has quit IRC20:04
*** rookie109 has joined #openstack-swift20:15
*** Bsony has joined #openstack-swift20:17
rookie109hey guys - quick question - can I have a swift cluster use both v1 (tempauth on a single proxy node) and v2 (keysone on the second single proxy node) authentication?20:17
MooingLemurrookie109: I don't think that'll break anything20:19
MooingLemurbut I'm not 100% sure20:19
rookie109MooingLemur: Gonna give it a go the :)20:20
MooingLemurcan share storage accounts, but probably can't share auth tokens20:21
notmynameyes, you can run multiple auth systems in one swift cluster20:23
*** Bsony has quit IRC20:23
notmynameyou'll have all of them set up on every proxy server20:23
notmynamebut the identities (and data stored in swift for those user identities) is NOT sharable. ie you can't grant access to a user in a different auth system20:24
*** Bsony has joined #openstack-swift20:27
*** dencaval has quit IRC20:31
*** Bsony has quit IRC20:32
rookie109notmyname:  can't have 1 proxy tempauth and another use keystone independant of each other?  (no sharing of auth is needed just need a v1/tempauth proxy for a single customer)20:33
notmynameoh yes. absolutely20:34
notmynamewait. misparse on my side20:35
rookie109notmyname: awesome, thanks20:36
notmynamerookie109: any tempauth users (and data stored for them) is independent of any user in keystone (and data stored for them)20:37
*** esker has joined #openstack-swift20:40
*** egon_ is now known as egon20:47
*** gyee has quit IRC21:02
*** gyee has joined #openstack-swift21:02
*** tsg_ has quit IRC21:03
*** tsg has joined #openstack-swift21:04
*** vinsh_ has quit IRC21:22
*** rookie109 has quit IRC21:27
*** egon has quit IRC21:33
*** jkugel1 has left #openstack-swift21:47
*** egon has joined #openstack-swift21:50
*** NM has quit IRC21:53
*** zhill has quit IRC22:03
*** zhill has joined #openstack-swift22:04
*** egon has quit IRC22:13
*** jrichli has quit IRC22:19
*** foexle has joined #openstack-swift22:22
*** egon has joined #openstack-swift22:24
*** erlon has quit IRC22:41
*** esker has quit IRC22:43
openstackgerritTim Burke proposed openstack/python-swiftclient: Stop throwing UnicodeEncodeErrors when deleting  https://review.openstack.org/17694522:48
*** imkarrer has quit IRC22:53
*** NM has joined #openstack-swift23:10
*** NM has quit IRC23:14
*** imkarrer has joined #openstack-swift23:28
*** petertr7 has quit IRC23:31
*** minwoob has quit IRC23:31
*** pberis has joined #openstack-swift23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!