Tuesday, 2015-06-02

*** petertr7_away is now known as petertr700:03
*** lyrrad has quit IRC00:11
*** petertr7 is now known as petertr7_away00:13
*** HiramAbif has quit IRC00:28
*** gyee has quit IRC00:34
openstackgerritMerged openstack/swift: go: object server SYNC report newer files  https://review.openstack.org/18461700:35
homattoliverau: around?00:38
mattoliverauMorning ho, yup here00:38
homattoliverau: morning! thanks for the review. I don't understand "Since we are in the replicate function here" means. could you explain it?00:39
homattolverau: I don't think there is replicate function.00:39
homattoliverau: patch 13834200:39
patchbotho: https://review.openstack.org/#/c/138342/00:39
mattoliverauThe _replicate_object function your in is the point at which db replication call replicate object to a node. So you should always know which node failed to replicate on00:42
homattoliverau: which line num. do I  have repliacate logic?00:44
homattoliverau: sorry. I re-write. could you tell me line num of replicate logic?00:46
mattoliverauho: 53700:48
*** thurloat is now known as thurloat_isgone00:49
homattoliverau: I think the definition of replication succeed is finish "the basic replication procedure" without errors so til L564 it is difficult to decide whether it succeeded or not.00:52
homattoliverau: http://paste.openstack.org/show/180912/ (a comment on patch#7)00:52
*** thurloat_isgone is now known as thurloat00:56
*** kota_ has joined #openstack-swift01:08
kota_Good morning!01:08
hokota_: morning!01:09
mattoliverauho: well in the old code, the success and failures were incremented per node, and if your going to send to recon the nodes that have the problem, the nodes that were successful aren't problem nodes. Wont that just confuse OPs.. looking for a problem on a node that didn't have one?01:22
mattoliveraukota_: morning01:22
homattoliverau: I didn't have one. replication works per db/partition and if the old code uses, the result consists of aggregation of replications. it might look like a problem but it's kind of same with the latest code01:32
*** fthiagogv has quit IRC01:35
*** cppforlife_ has quit IRC01:36
*** nottrobin has quit IRC01:36
*** briancurtin has quit IRC01:36
*** serverascode has quit IRC01:36
*** zaitcev has quit IRC01:37
*** zaitcev has joined #openstack-swift01:38
*** ChanServ sets mode: +v zaitcev01:38
*** cppforlife_ has joined #openstack-swift01:40
kota_ho, mattoliverau: morning :)01:41
*** nottrobin has joined #openstack-swift01:42
*** briancurtin has joined #openstack-swift01:43
*** serverascode has joined #openstack-swift01:44
*** shakamunyi_ has joined #openstack-swift01:46
*** shakamunyi_ has quit IRC01:46
*** wbhuber has joined #openstack-swift02:00
*** asettle has quit IRC02:06
*** fthiagogv has joined #openstack-swift02:06
*** asettle has joined #openstack-swift02:09
*** bkopilov has quit IRC02:13
*** wbhuber has quit IRC02:17
*** shakamunyi has joined #openstack-swift02:26
*** thurloat is now known as thurloat_isgone02:27
*** asettle is now known as asettle-afk02:27
*** shakamunyi has quit IRC02:33
*** chlong has quit IRC02:39
*** lyrrad has joined #openstack-swift03:00
*** chlong has joined #openstack-swift03:22
*** asettle-afk is now known as asettle03:35
*** asettle has quit IRC03:35
*** dimasot has joined #openstack-swift03:44
*** charlesw has quit IRC04:00
*** [1]dimasot has joined #openstack-swift04:15
*** dimasot has quit IRC04:18
*** [1]dimasot is now known as dimasot04:18
*** haigang has joined #openstack-swift04:19
*** bkopilov has joined #openstack-swift04:23
*** ppai has joined #openstack-swift04:23
*** [1]dimasot has joined #openstack-swift04:23
*** david-lyle has quit IRC04:24
*** david-lyle has joined #openstack-swift04:25
*** dimasot has quit IRC04:26
*** [1]dimasot is now known as dimasot04:26
*** kota_ has quit IRC04:26
*** kota_ has joined #openstack-swift04:29
*** ktsuyuzaki has joined #openstack-swift04:32
*** zaitcev has quit IRC04:33
*** kota_ has quit IRC04:34
*** asettle has joined #openstack-swift04:34
*** kota_ has joined #openstack-swift04:36
*** ktsuyuzaki has quit IRC04:38
*** ktsuyuzaki has joined #openstack-swift04:39
*** kota_ has quit IRC04:40
*** kota_ has joined #openstack-swift04:43
*** ktsuyuzaki has quit IRC04:45
*** ktsuyuzaki has joined #openstack-swift04:46
*** 17WABZSPI has quit IRC04:46
*** 16WAA4FX8 has quit IRC04:46
*** delattec has joined #openstack-swift04:47
*** delatte has joined #openstack-swift04:47
*** kota_ has quit IRC04:48
*** kota_ has joined #openstack-swift04:51
*** ktsuyuzaki has quit IRC04:53
*** ktsuyuzaki has joined #openstack-swift04:53
*** kota_ has quit IRC04:55
*** kota_ has joined #openstack-swift04:56
openstackgerritHisashi Osanai proposed openstack/swift: Enable Object Replicator's failure count in recon  https://review.openstack.org/13834204:57
*** ktsuyuzaki has quit IRC04:57
*** ktsuyuzaki has joined #openstack-swift05:00
*** kota_ has quit IRC05:02
*** Triveni has joined #openstack-swift05:04
*** kota_ has joined #openstack-swift05:07
*** ktsuyuzaki has quit IRC05:09
*** ktsuyuza_ has joined #openstack-swift05:09
*** kota_ has quit IRC05:11
swifterdarrellcschwede: you see my comment at https://review.openstack.org/#/c/184189/ ?05:12
*** kota_ has joined #openstack-swift05:12
*** nosnos has joined #openstack-swift05:12
*** ktsuyuza_ has quit IRC05:14
*** ktsuyuzaki has joined #openstack-swift05:14
*** kota_ has quit IRC05:16
*** kota_ has joined #openstack-swift05:17
*** ktsuyuzaki has quit IRC05:19
*** ktsuyuza_ has joined #openstack-swift05:19
*** kota_ has quit IRC05:22
*** kota_ has joined #openstack-swift05:22
*** ktsuyuza_ has quit IRC05:24
*** SkyRocknRoll has joined #openstack-swift05:24
*** ktsuyuzaki has joined #openstack-swift05:24
openstackgerritKota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update  https://review.openstack.org/18673505:25
*** kota_ has quit IRC05:26
*** kota_ has joined #openstack-swift05:29
*** ktsuyuzaki has quit IRC05:31
*** ktsuyuzaki has joined #openstack-swift05:31
*** kota_ has quit IRC05:33
*** kota_ has joined #openstack-swift05:36
*** nosnos has quit IRC05:37
*** ktsuyuzaki has quit IRC05:38
*** ktsuyuzaki has joined #openstack-swift05:40
*** kota_ has quit IRC05:42
*** kota_ has joined #openstack-swift05:43
openstackgerritKota Tsuyuzaki proposed openstack/swift: Prevent to decode with invalid ec scheme  https://review.openstack.org/17719505:44
*** ktsuyuzaki has quit IRC05:44
*** ktsuyuzaki has joined #openstack-swift05:47
*** kota_ has quit IRC05:49
*** kota_ has joined #openstack-swift05:52
*** ktsuyuza_ has joined #openstack-swift05:54
*** ktsuyuzaki has quit IRC05:55
*** nadeem has joined #openstack-swift05:55
*** ktsuyuzaki has joined #openstack-swift05:57
*** kota_ has quit IRC05:57
*** ppai has quit IRC05:59
*** ktsuyuza_ has quit IRC05:59
*** kota_ has joined #openstack-swift06:00
*** ktsuyuza_ has joined #openstack-swift06:02
*** ktsuyuzaki has quit IRC06:02
cschwedeGood Morning!06:03
*** kota_ has quit IRC06:04
hocschwede: Morning!06:04
cschwedeswifterdarrell: yes, thanks a lot for the numbers! first impression is that your patch makes quite a big difference in terms of performance. that looks great!06:06
cschwedeho: Hello!06:06
*** kota_ has joined #openstack-swift06:07
*** ktsuyuza_ has quit IRC06:09
*** nadeem has quit IRC06:09
*** ktsuyuzaki has joined #openstack-swift06:09
*** kota_ has quit IRC06:11
*** kota_ has joined #openstack-swift06:12
*** ktsuyuzaki has quit IRC06:13
*** ktsuyuzaki has joined #openstack-swift06:14
*** kota_ has quit IRC06:16
*** kota_ has joined #openstack-swift06:17
*** ktsuyuzaki has quit IRC06:18
*** ktsuyuzaki has joined #openstack-swift06:19
*** kota_ has quit IRC06:21
*** kota_ has joined #openstack-swift06:22
*** ktsuyuzaki has quit IRC06:24
*** ktsuyuzaki has joined #openstack-swift06:26
mattoliveraucschwede: morning06:28
cschwedemattoliverau: Hello!06:28
*** kota_ has quit IRC06:28
*** kota_ has joined #openstack-swift06:31
*** ktsuyuza_ has joined #openstack-swift06:33
*** ktsuyuzaki has quit IRC06:34
*** kota_ has quit IRC06:35
*** kota_ has joined #openstack-swift06:36
*** ktsuyuza_ has quit IRC06:38
*** ktsuyuzaki has joined #openstack-swift06:38
*** ktsuyuza_ has joined #openstack-swift06:41
*** kota_ has quit IRC06:43
*** ktsuyuzaki has quit IRC06:43
*** ppai has joined #openstack-swift06:45
*** kota_ has joined #openstack-swift06:45
*** ktsuyuza_ has quit IRC06:47
*** ktsuyuzaki has joined #openstack-swift06:48
*** kota_ has quit IRC06:50
*** kota_ has joined #openstack-swift06:53
*** krykowski has joined #openstack-swift06:53
*** ktsuyuza_ has joined #openstack-swift06:55
*** ktsuyuzaki has quit IRC06:57
*** kota_ has quit IRC06:57
*** kota_ has joined #openstack-swift06:57
openstackgerritMerged openstack/swift: Tighten up overall metadata size tests  https://review.openstack.org/18726406:58
*** ktsuyuza_ has quit IRC07:00
*** ktsuyuzaki has joined #openstack-swift07:00
*** kota_ has quit IRC07:02
*** kota_ has joined #openstack-swift07:02
*** ktsuyuzaki has quit IRC07:05
*** krykowski has quit IRC07:05
*** ktsuyuzaki has joined #openstack-swift07:05
*** kota_ has quit IRC07:07
*** kota_ has joined #openstack-swift07:07
*** ktsuyuzaki has quit IRC07:09
*** ktsuyuzaki has joined #openstack-swift07:10
*** haigang has quit IRC07:11
*** kota_ has quit IRC07:12
*** haigang has joined #openstack-swift07:12
*** admin6 has joined #openstack-swift07:14
*** kota_ has joined #openstack-swift07:14
*** ktsuyuzaki has quit IRC07:16
*** ktsuyuzaki has joined #openstack-swift07:17
*** kota_ has quit IRC07:19
*** ktsuyuza_ has joined #openstack-swift07:19
*** ktsuyuzaki has quit IRC07:22
*** hseipp has joined #openstack-swift07:22
*** hseipp has quit IRC07:22
*** kota_ has joined #openstack-swift07:22
*** hseipp has joined #openstack-swift07:22
openstackgerritKota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update  https://review.openstack.org/18673507:23
*** ktsuyuza_ has quit IRC07:24
*** ktsuyuzaki has joined #openstack-swift07:24
*** kota_ has quit IRC07:26
*** kota_ has joined #openstack-swift07:27
*** ktsuyuzaki has quit IRC07:29
*** ktsuyuzaki has joined #openstack-swift07:29
*** kota_ has quit IRC07:31
*** kota_ has joined #openstack-swift07:32
*** ktsuyuzaki has quit IRC07:34
*** ktsuyuzaki has joined #openstack-swift07:36
*** kota_ has quit IRC07:38
*** kota_ has joined #openstack-swift07:39
*** ktsuyuzaki has quit IRC07:41
*** ktsuyuzaki has joined #openstack-swift07:41
*** kota_ has quit IRC07:43
*** silor has joined #openstack-swift07:45
*** kota_ has joined #openstack-swift07:46
*** jistr has joined #openstack-swift07:48
*** ktsuyuzaki has quit IRC07:48
*** ktsuyuzaki has joined #openstack-swift07:48
*** kota_ has quit IRC07:50
*** kota_ has joined #openstack-swift07:51
*** ktsuyuzaki has quit IRC07:53
*** ktsuyuzaki has joined #openstack-swift07:53
*** kota_ has quit IRC07:55
*** chlong has quit IRC07:56
*** kota_ has joined #openstack-swift07:56
*** ktsuyuzaki has quit IRC07:58
*** ktsuyuzaki has joined #openstack-swift07:58
*** jordanP has joined #openstack-swift08:00
*** kota_ has quit IRC08:00
*** kota_ has joined #openstack-swift08:01
*** ktsuyuzaki has quit IRC08:03
*** ktsuyuzaki has joined #openstack-swift08:03
*** kota_ has quit IRC08:06
*** ktsuyuza_ has joined #openstack-swift08:06
*** [1]dimasot has joined #openstack-swift08:07
*** ktsuyuzaki has quit IRC08:08
*** dimasot has quit IRC08:09
*** [1]dimasot is now known as dimasot08:09
*** kota_ has joined #openstack-swift08:10
*** ktsuyuza_ has quit IRC08:13
openstackgerritHisashi Osanai proposed openstack/swift: Add metadata size tests on the border  https://review.openstack.org/18748908:13
*** ktsuyuzaki has joined #openstack-swift08:13
homy review for patch #187264 didn't meet the dead line. So I added two more tests on it with above patch #187489.08:14
*** kota_ has quit IRC08:15
*** kota_ has joined #openstack-swift08:15
*** ktsuyuzaki has quit IRC08:17
*** ktsuyuzaki has joined #openstack-swift08:20
*** kota_ has quit IRC08:22
*** kota_ has joined #openstack-swift08:22
*** ktsuyuzaki has quit IRC08:25
*** ktsuyuzaki has joined #openstack-swift08:25
*** kota_ has quit IRC08:27
*** kota_ has joined #openstack-swift08:28
*** ktsuyuzaki has quit IRC08:30
*** kota_ has quit IRC08:32
*** leopoldj has joined #openstack-swift08:53
*** acoles_away is now known as acoles08:55
acolesminwoob: yes i will take a look at your review - been busy sorry!09:00
*** aix has joined #openstack-swift09:01
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Document missing functional test config option  https://review.openstack.org/18750309:17
acolestimburke: ^^ this is the one useful part of my abandoned skip-identical patch ;)09:18
*** [1]dimasot has joined #openstack-swift09:22
*** dimasot has quit IRC09:26
*** [1]dimasot is now known as dimasot09:26
*** fthiagogv has quit IRC09:38
*** aix has quit IRC09:45
*** aix has joined #openstack-swift09:45
*** ho has quit IRC09:48
*** haigang has quit IRC09:50
openstackgerritMerged openstack/swift-bench: add storage policy option  https://review.openstack.org/18459010:02
*** haigang has joined #openstack-swift10:08
dimasotHi where I can find the version of the Swift durability calculator that supports EC ? this one supports replicas only - http://enovance.github.io/swift-durability-calculator/10:13
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Document missing functional test config option  https://review.openstack.org/18750310:14
cschwededimasot: you’re looking for the fork from kota - it’s here: https://github.com/bloodeagle40234/swift-durability-calculator/tree/ec_calculator10:19
*** haigang has quit IRC10:22
*** haigang has joined #openstack-swift10:28
acolesnotmyname: i added a couple of reviews to priority reviews page that have been hanging around for ages, hope thats ok!11:19
*** delatte has quit IRC11:42
*** delattec has quit IRC11:42
*** dimasot has quit IRC11:50
*** haigang has quit IRC12:06
*** haigang has joined #openstack-swift12:07
*** cdelatte has joined #openstack-swift12:09
*** jistr is now known as jistr|class12:17
*** jistr|class is now known as jistr12:22
*** bkopilov has quit IRC12:32
*** kei_yama has quit IRC12:39
*** petertr7_away is now known as petertr713:13
*** km has quit IRC13:14
*** wbhuber has joined #openstack-swift13:22
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873613:28
*** acampbel11 has joined #openstack-swift13:29
*** acampbell has joined #openstack-swift13:29
acolesnotmyname: some other backports that never got merged: patch 13408213:30
patchbotacoles: https://review.openstack.org/#/c/134082/13:30
acolespatch 14621113:31
patchbotacoles: https://review.openstack.org/#/c/146211/13:31
openstackgerritPrashanth Pai proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692313:36
openstackgerritPrashanth Pai proposed openstack/swift: versioned writes middleware  https://review.openstack.org/13434713:36
*** SkyRocknRoll has quit IRC13:38
openstackgerritpradeep kumar singh proposed openstack/python-swiftclient: SwiftClient object upload beginning with / or "./"  https://review.openstack.org/18526913:39
*** ErickHeinrich has joined #openstack-swift13:41
*** ErickHeinrich has quit IRC13:41
*** thurloat_isgone is now known as thurloat13:43
*** Triveni has quit IRC13:48
*** blmartin has joined #openstack-swift13:49
*** ppai has quit IRC13:51
openstackgerritpradeep kumar singh proposed openstack/swift: Handle Disk IO error Exception in swift account auditor  https://review.openstack.org/18273413:51
*** annegentle has joined #openstack-swift13:59
*** mwheckmann has joined #openstack-swift14:07
*** petertr7 is now known as petertr7_away14:08
*** annegentle has quit IRC14:08
*** petertr7_away is now known as petertr714:09
*** jkugel has joined #openstack-swift14:10
*** minwoob has joined #openstack-swift14:11
*** bkopilov has joined #openstack-swift14:11
*** hugespoon has joined #openstack-swift14:13
*** charlesw has joined #openstack-swift14:15
*** annegentle has joined #openstack-swift14:15
*** mmcardle has joined #openstack-swift14:15
*** jistr is now known as jistr|mtg14:16
*** mmcardle has quit IRC14:21
*** bi_fa_fu has joined #openstack-swift14:26
dmsimardTrying to figure out at what frequency the Swift proxy servers fetch the Keystone revocation list and how to configure it but not finding anything conclusive - any hints ?14:28
*** bi_fa_fu has quit IRC14:30
*** jistr|mtg is now known as jistr14:30
*** charlesw has quit IRC14:31
*** charlesw has joined #openstack-swift14:32
*** breitz has quit IRC14:32
acolesdmsimard: that would be an authtoken middleware option i guess.14:32
acolesdmsimard: found this https://github.com/openstack/keystonemiddleware/blob/master/keystonemiddleware/auth_token/__init__.py#L285-28514:33
*** breitz has joined #openstack-swift14:33
dmsimardacoles: Interesting, that's not where I was looking - was expecting to find something in https://github.com/openstack/swift/blob/master/swift/common/middleware/keystoneauth.py14:34
mgagnedmsimard: read here https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L275-L29014:34
minwoobHi. Would it be recommendable to have an EC policy map to 2 rings, as per https://trello.com/c/QWaYXWNf/120-small-file-optimizations14:35
mgagnedmsimard: both middlewares are loaded: authtoken and keystoneauth14:37
hugespoonanyone have any thoughts about why a container updater sweep would be taking so long? i have 2 clusters, the larger/more used cluster takes about 600 seconds to complete on average, and the smaller is taking ~4000 seconds. I'm not seeing any overt errors in the logs at this point, are there some specific stats i should be looking at? both are on 2.2.2 atm14:37
acolesdmsimard: keystoneauth has no communication with keystone service - authtoken validates tokens and authenticates, keystoneauth then authorises acces based on authtoken's id output.14:38
dmsimardacoles: Makes sense, thanks14:38
*** charlesw has quit IRC14:40
*** jrichli has joined #openstack-swift14:41
*** B4rker has joined #openstack-swift14:44
*** thurloat is now known as thurloat_isgone15:00
*** acoles is now known as acoles_away15:00
*** B4rker has quit IRC15:05
*** B4rker has joined #openstack-swift15:07
*** nadeem has joined #openstack-swift15:20
*** acampbell has quit IRC15:23
*** acampbel11 has quit IRC15:23
openstackgerritMerged openstack/swift: Handle Disk IO error Exception in swift account auditor  https://review.openstack.org/18273415:23
*** B4rker has quit IRC15:23
*** B4rker has joined #openstack-swift15:24
*** lyrrad has quit IRC15:26
*** petertr7 is now known as petertr7_away15:31
*** barra204 has joined #openstack-swift15:35
*** shakamunyi has joined #openstack-swift15:35
*** petertr7_away is now known as petertr715:36
*** acampbel11 has joined #openstack-swift15:39
*** acampbell has joined #openstack-swift15:39
minwoobnotmyname: Some of us had reached a consensus regarding this last time: https://trello.com/c/0KddRS3T/104-pyeclib-investigate-python-gil-related-concerns-for-multithreading15:42
*** openstackgerrit has quit IRC15:42
*** openstackgerrit has joined #openstack-swift15:43
minwoobnotmyname: Should it be marked as closed, or are there some reasons to keep it open?15:43
*** petertr7 is now known as petertr7_away15:45
jordanPhey. Is there something wrong with check-swift-dsvm-functional ? The job seems to run 0 test15:47
jordanP"Ran 0 tests in 0.002s"15:47
*** thurloat_isgone is now known as thurloat15:49
*** admin6 has quit IRC15:50
*** lyrrad has joined #openstack-swift15:51
*** blmartin has quit IRC15:52
peluseminwoob, weve decided to no longer use trello to track EC issues/todo items (FYI).  I guess I should add a note to all open items and put them in a new column called 'archived' or something and put a note that bugs are to be used to track EC work from now on15:53
*** acampbell has quit IRC15:54
*** bi_fa_fu has joined #openstack-swift15:54
*** acampbel11 has quit IRC15:55
minwoobpeluse: I see. Will optimization-related updates also be tracked as bugs?15:55
peluseminwoob, yes or just push a patch... folks should use IRC or the email list to bring up questions/topics in this area (or updates on benchmark results)15:58
peluseminwoob, right now Intel+Swiftstack are working on baselining a few clusters w/3x (like right this minute) and once its solid we'll fire up EC and will publish configs and results probably next week.15:59
*** mmcardle has joined #openstack-swift16:00
*** jordanP has quit IRC16:01
*** nadeem has quit IRC16:01
wbhuberpeluse: will there be a dashboard specific to handle EC bugs/features, ranging from low hanging fruits to most significant ones?16:02
wbhuberpeluse: regarding clusters, we are configuring one at the moment too - 3 proxy, 3 meta and 5 storage nodes.  once it's all set up we will get the data out hopefully by end of next week16:03
pelusewbhuber, we talked about that too (dashboard) and I'm sure it can be revisted but it was decided that, to keep the dashboard from having too many project specific stuff, that for now the EC section would go away and a crypto section would go these instead16:04
pelusewbhuber, great on the clsuter info.  I meant to publish the cluster info that we (us and SwiftStack are using) last week but haven't gotten to it yet.  It will be more intersting w/results included anyways :)16:05
*** jistr has quit IRC16:05
*** proteusguy has joined #openstack-swift16:06
wbhuberpeluse: since EC section would go away from the dashboard, would there be specific tags that keep track of those under which we can work on the EC materials?16:06
pelusewbhuber, that would be a good question for notmyname as I'm not sure what the various options are but yeah I think something like makes sense at least til we hit production (just to make queries easier)16:09
*** gyee has joined #openstack-swift16:10
*** leopoldj has quit IRC16:11
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873616:12
cschwedejordanP: looking16:12
*** fthiagogv has joined #openstack-swift16:13
*** fthiagogv has quit IRC16:14
*** fthiagogv has joined #openstack-swift16:14
*** nadeem has joined #openstack-swift16:16
*** nadeem has quit IRC16:17
*** nadeem has joined #openstack-swift16:18
*** B4rker has quit IRC16:19
*** mmcardle has quit IRC16:22
*** annegentle has quit IRC16:29
*** hseipp has left #openstack-swift16:29
*** acoles_away is now known as acoles16:29
*** acampbell has joined #openstack-swift16:29
*** acampbel11 has joined #openstack-swift16:29
MooingLemurpeluse: hiya, did you catch what I mentioned into the channel yesterday for clayg? (19:09 UTC)16:31
*** B4rker has joined #openstack-swift16:33
*** lyrrad has quit IRC16:34
openstackgerritTim Burke proposed openstack/python-swiftclient: Centralize header parsing  https://review.openstack.org/18433616:34
*** mmcardle has joined #openstack-swift16:41
peluseMooingLemur, yeah and I'm puzzled :)  I have one of the SwiftStack engineers on site here this week doing perf work so haven't been able to try and make sense of it in my head.  did you see anything back yet from clayg?16:42
notmynamegood morning16:42
peluseguten morgen16:42
MooingLemurpeluse: not yet16:42
peluseMooingLemur, OK.  I'll be offline here for many hours but will check the scrollback later thia afternoon and try to jump in where I can.  Will have more time next week for regular work I hope16:44
MooingLemurpeluse: When I found what looked to be an object that had 10/12 fragments and isn't making its way to completion, that's when I decided to leave it alone and poke at it later with the guidance of someone more knowledgable about the internals of swift.  It might be a smoking gun with respect to the as yet unexplainable disappearing fragments16:45
MooingLemur(policy is 9+3)16:46
*** mmcardle has quit IRC16:46
*** acampbell111 has joined #openstack-swift16:48
*** mmcardle has joined #openstack-swift16:57
notmynamegood morning17:02
notmynameoh, I already said that ;-)17:02
*** samueldmq has joined #openstack-swift17:03
samueldmqello17:03
samueldmqhello*17:03
samueldmqcould someone with permissions to triage bugs mark this as 'invalid' for swift https://bugs.launchpad.net/swift/+bug/145894517:04
openstackLaunchpad bug 1458945 in murano "Use graduated oslo.policy instead of oslo-incubator code" [High,Confirmed] - Assigned to Ekaterina Chernova (efedorova)17:04
samueldmqmarking as invalid instead of 'no longer affects', so we can keep track of the changes on the whole openstack ecosystem :)17:04
*** B4rker has quit IRC17:05
notmynamesamueldmq: oh. sorry, just removed it right before you said that17:05
notmynamesamueldmq: how do I add it back?17:05
samueldmqnotmyname, I am re-adding , and then you mark as invalid, ok ?17:06
samueldmqnotmyname, and ideally put somethign in the description, I'd guess something like 'swift does not use policy system' should be ok17:07
*** acampbell111 has quit IRC17:08
*** mmcardle has quit IRC17:09
*** dimasot has joined #openstack-swift17:11
*** petertr7_away is now known as petertr717:21
*** thurloat is now known as thurloat_isgone17:22
*** thurloat_isgone is now known as thurloat17:31
notmynamesamueldmq: I got pulled to a meeting17:33
notmynamesamueldmq: ok, looking again now17:34
samueldmqnotmyname, re-adding now , just a few seconds17:34
notmynamethurloat: nice away nick ;-)17:34
samueldmqnotmyname, done17:34
samueldmqnotmyname, already re-added17:35
samueldmqnotmyname, thanks17:35
notmynamesamueldmq: done17:36
notmynamebah. launchpad timeout error17:37
notmynamesamueldmq: still getting timeouts from LP17:46
samueldmqnotmyname, yes, people from other projects also got that17:46
samueldmqnotmyname, I am sorry for that :(17:47
samueldmqnotmyname, I'd appreciate if you could try it later17:47
notmynamenot your fault :-)17:47
thurloatnotmyname, playing with the ring builder, and I notice that the lower the weight, the higher the balance ends up on rebalance. What does the final balance number indicate?17:53
*** aix has quit IRC17:57
*** openstackgerrit has quit IRC18:09
*** openstackgerrit has joined #openstack-swift18:10
notmynamethurloat: balance closer to 0 is better. ie 0 == balanced18:10
notmynamethurloat: positive numbers means that it's overweighted. ie it has more partitions assigned than the weight should allow, relative to the rest of the cluster18:11
notmynamenegative numbers are underweighted for the assigned weight relative to the rest of the clsuter18:11
thurloatso my existing entries were set to ~-48.5, and my two new entries were set to 1950.018:15
thurloatand the lower the weight i set on the new ones, the higher my final balance number is18:19
thurloatwouldn't the balance be lower with a lower weight? since there is less balancing to do?18:19
thurloatnotmyname, trying to better understand the net effect on the cluster if I were to deploy these new rings. and how the balance/weight plays into it18:21
*** annegentle has joined #openstack-swift18:21
thurloatit was my understanding that the lower the initial weight, the more gradual the shuffling of partitions would be.18:22
openstackgerritClint 'SpamapS' Byrum proposed openstack/python-swiftclient: Add a get_conn method to SwiftService  https://review.openstack.org/18771418:24
*** petertr7 is now known as petertr7_away18:33
*** petertr7_away is now known as petertr718:37
*** wbhuber_ has joined #openstack-swift18:37
*** wbhuber has quit IRC18:41
openstackgerritDarrell Bishop proposed openstack/swift: Allow 1+ object-servers-per-disk deployment  https://review.openstack.org/18418918:43
*** ChanServ sets mode: +v tdasilva18:46
*** tdasilva has left #openstack-swift18:50
*** tdasilva has joined #openstack-swift18:50
*** ChanServ sets mode: +v tdasilva18:50
*** silor1 has joined #openstack-swift18:53
*** dimasot has quit IRC18:54
*** silor has quit IRC18:55
*** openstackgerrit has quit IRC18:56
*** openstackgerrit has joined #openstack-swift18:56
notmynameI'd like to welcome tdasilva as a new swift core reviewer18:58
swifterdarrellnotmyname: tdasilva: woot!18:59
tdasilvaswifterdarrell, notmyname: thanks :)18:59
torgomaticnow get reviewing! /me cracks whip  ;)19:00
tdasilvahehe...the list of reviews is not that long, is it sam? ;)19:01
acolestdasilva: welcome aboard!19:07
tdasilvaacoles: thanks! :)19:08
minwoobHow would one recommend one to upload a patch set to a previous (not the current) patch set, and to do so cleanly?19:10
*** petertr7 is now known as petertr7_away19:10
minwoobIt looks like at the current state I might be uploading 74 changed files, when I only should have 2.19:10
*** petertr7_away is now known as petertr719:12
minwoob(This is for https://review.openstack.org/#/c/178317/ btw. Been trying to make sure I'm modifying patch set 3, and not the most current one).19:12
notmynameminwoob: if you check out patch set 3, make your changes, amend that commit, and push up again, that should be it.19:13
*** wbhuber__ has joined #openstack-swift19:15
*** greghaynes has joined #openstack-swift19:15
*** tellesnobrega_ has joined #openstack-swift19:16
*** wbhuber_ has quit IRC19:18
*** gyee has quit IRC19:21
acolesminwoob: what notmyname said, can be done with git review -d 178317,3   (NB ,3 at end)19:22
*** mjseger has quit IRC19:32
*** annegentle has quit IRC19:35
*** annegentle has joined #openstack-swift19:36
*** thurloat is now known as thurloat_isgone19:43
openstackgerritMinwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary.  https://review.openstack.org/17831719:44
*** annegent_ has joined #openstack-swift19:47
minwoobnotmyname acoles: Thank you!19:48
*** annegentle has quit IRC19:50
notmynameacoles: oh, cool. I didn't know about ,N19:59
jrichlitdasilva: congrats!20:03
portantetdasilva: yes, congrats!20:03
*** samueldmq has quit IRC20:05
openstackgerritAlistair Coles proposed openstack/python-swiftclient: WIP Make default get_auth timeout be None  https://review.openstack.org/18774920:05
*** openstackgerrit has quit IRC20:10
*** openstackgerrit has joined #openstack-swift20:10
*** tellesnobrega_ has quit IRC20:16
tdasilvajrichli, portante: thanks!20:19
openstackgerritChristian Schwede proposed openstack/swift: Don't skip tests if Swift is not running  https://review.openstack.org/18775420:19
notmynamecschwede: isn't this related to the in-process tests portante put together?20:20
cschwedenotmyname: not sure, but at the end the plugin seems to catch the exception, which should not happen20:21
*** cdelatte has quit IRC20:22
*** acoles is now known as acoles_away20:23
*** nadeem has quit IRC20:32
*** proteusguy has quit IRC20:35
*** lcurtis has joined #openstack-swift20:39
*** operator99 is now known as gyee20:39
lcurtiswhat is best way in swift to bring a server offline for several hours for maintenance without replicating all data20:40
notmynamelcurtis: a whole server?20:40
lcurtisnotmyname yes20:40
notmynamelcurtis: if you stop the servers (ie stop accespting swift -related connections on it, that will be fine20:41
notmynameswift won't automatically rereplicate data on a down server (just for a down drive)20:41
lcurtiswhat is the time before swift would start replicating to hand off node?20:41
notmynamethen when you bring it back online, swift will fix it all up20:41
*** fthiagogv has quit IRC20:41
notmynameit will immediately start putting new stuff on a handoff. but replication won't20:42
*** bi_fa_fu has quit IRC20:42
MooingLemurlcurtis: it's not like ceph.  There is no time frame where it will start replicating from a down server.20:42
MooingLemurlcurtis: it will only automatically increase durability for an unmounted drive with the swift server still running20:42
openstackgerritSamuel Merritt proposed openstack/swift: EC: support multiple ranges for GET requests  https://review.openstack.org/17349720:45
lcurtiswhat is mechanism if server is down longer than x hours, new replicas will be created20:45
MooingLemurlcurtis: I think you'd have to script that yourself, remove the devices from the ring or set them with zero weight, and rebalance.20:46
lcurtisMooingLemur Thanks!20:47
lcurtisman this is such a great channel..thank you folks20:47
MooingLemurunder normal circumstances, a server going down shouldn't affect durability, because in most cases the data will be fine.20:47
MooingLemuryou bring your server back up, and everything is still there20:47
lcurtisright..I was just concerned with replicas20:48
lcurtislike if server down longer than x hours, new replicas would be created20:48
MooingLemurOf course, it could affect availability if multiple servers went down.  But it's rather costly to move data around in terms of I/O and bandwidth, compared to the risk that some objects will temporarily get 404.20:49
lcurtissure20:49
lcurtismakes sense20:49
notmynamelcurtis: that's not done in swift intentionally. we don't want to have some automated cascading death spiral scenario20:49
notmynameso a server down requires an operator (or management software) to take action on if it's something more serious than "wait for it to finish rebooting" or similar20:50
glangecan somebody create a blueprint for "automated cascading death spiral scenario"? :)20:50
lcurtisnotmyname agreed...very logical in that sense20:50
minwoobAnyone have a link to a page that lists all the advantages of having an object server per disk?20:50
notmynameminwoob: best you'll find right now, AFAIK, is the gerrit review page20:51
minwoobIf no such page exists, that's fine.20:51
minwoobnotmyname: Ah, I see.20:51
minwoobnotmyname: Thanks.20:51
*** silor1 has quit IRC20:52
*** gyee has quit IRC20:53
*** gyee has joined #openstack-swift20:53
lcurtisactually...make me think...does data then get replicated back from handoff nodes once server comes back up from maintenance?20:55
*** petertr7 is now known as petertr7_away21:02
*** shakamunyi_ has joined #openstack-swift21:03
*** shakamunyi__ has joined #openstack-swift21:04
openstackgerritJanie Richling proposed openstack/swift: WIP - working on the encryption feature.  https://review.openstack.org/15790721:05
*** shakamunyi__ is now known as tylerdurden21:05
*** tylerdurden has quit IRC21:08
*** shakamunyi_ has quit IRC21:08
notmynamelcurtis: yup21:11
lcurtisexcellent...great to know...ty21:11
openstackgerritMinwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary.  https://review.openstack.org/17831721:12
*** nadeem has joined #openstack-swift21:15
*** wbhuber__ has quit IRC21:16
*** bi_fa_fu has joined #openstack-swift21:27
*** nadeem has quit IRC21:27
*** annegent_ has quit IRC21:29
*** annegentle has joined #openstack-swift21:31
mattoliverauYay! Congrats tdasilva!21:33
mattoliverauOh and good morning to all as well21:33
*** acampbell has quit IRC21:37
*** acampbel11 has quit IRC21:37
*** mwheckmann has quit IRC21:46
*** jkugel has quit IRC21:46
minwoobSo while I was looking through some unit tests while working on the hash_cleanup_listdir patch, I noticed in test.unit.obj.test_ssync_sender:TestBaseSsync._verify_diskfile_sync that it expects 'ETag' will be duplicated as 'Etag' by ssync.21:48
minwoobIs there a reason for this, or have we identified a bug?21:48
*** annegentle has quit IRC21:48
*** aix has joined #openstack-swift21:50
minwoobMoreover, I've read that ssync is used as a better alternative to rsync, but where would one find documentation that points to some of its advantages?21:51
*** bi_fa_fu has quit IRC21:51
*** bi_fa_fu has joined #openstack-swift21:51
*** bi_fa_fu is now known as bi_fa_fu_21:53
*** bi_fa_fu_ is now known as Ciipher21:59
glangeminwoob: look for ssync on this page:  http://docs.openstack.org/developer/swift/overview_replication.html22:00
glangeminwoob: ssync didn't work out for the testing we did, it was too slow22:01
*** Ciipher is now known as bi_fa_fu22:01
*** bi_fa_fu is now known as Ciipher22:02
glangeminwoob: also, you'll note that the planned index.db was never implemented -- that is where the hope for faster replication was22:03
glangehttps://review.openstack.org/#/c/44115/ <-- the author described it as "experimental" and not for use in production clusters22:04
*** cppforlife_ has quit IRC22:04
minwoobglange: Thanks. What is the plan for it then?22:07
glangethe idea behind ssync and index.db was that if swift kept track of new objects/files on disk, replication wouldn't have to walk the file system computing hashes as much22:07
glangeyou can't track what rysnc pushes really22:07
glangeI don't know what the status of it is or of the effort to improve replication22:07
glangeif there is even such an effort22:07
notmynameminwoob: ssync and rsync are good at different things. unfortunately they're also bad at different things too. ssync is chatty, so replicating a whole partition with it isn't very good. but rsync isn't all that great if there's just a few differences between two partition replicas22:11
notmynamessync has been improved somewhat since it was added to swift, and EC requires it22:11
*** annegentle has joined #openstack-swift22:12
minwoobnotmyname glange: Regarding how it duplicates 'ETag' with 'Etag', though, is that indicative of some functionality concerns?22:15
minwoobMaybe it isn't quite as stable as we'd want it to be?22:16
notmynameminwoob: I don't remember the details around that one thing, but the general idea (I think) is that the header name is case-insensitive, and that was added for some sort of compat reason22:16
*** wbhuber has joined #openstack-swift22:19
minwoobnotmyname: The test itself may be fine, but when I was stepping through it with my debugger, I do remember a header that I had temporarily added was replicated with the wrong case (like 'ETag' to 'Etag').22:20
minwoobnotmyname: If you're saying though, that ssync itself is the one that is case-insensitive about header names, then I guess there's no issue there (still wondering why that would be, though).22:24
*** annegentle has quit IRC22:29
*** cppforlife_ has joined #openstack-swift22:38
*** mmcardle has joined #openstack-swift22:40
*** jrichli has quit IRC22:40
*** kutija has joined #openstack-swift22:46
peluseminwoob, the etag duplciate thing was a bug that has since been addressed so you may still see some tests that make sure its not duplicate22:50
*** mmcardle has quit IRC22:50
peluseminwoob, it was introduced as part of the EC work.  We had a few patches that kept it from happening in a few different places, can't check now but I think they both landed22:51
peluseminwoob, and, BTW, the fix was specific to certain headers so I'm thinking you would have to change some code in order to introduce a new one that would end up getting duplicated22:52
peluseminwoob, actually one part of it not in there yet: https://review.openstack.org/#/c/173973/ the other part that is in there, which is sufficient but combo is better we think is in init() of RebuildingECDiskFileStream()22:57
*** blmartin has joined #openstack-swift22:59
*** kutija has quit IRC23:02
*** km has joined #openstack-swift23:08
*** annegentle has joined #openstack-swift23:18
*** annegentle has quit IRC23:20
*** chlong has joined #openstack-swift23:22
*** kei_yama has joined #openstack-swift23:28
*** minwoob has quit IRC23:35
*** barra204 has quit IRC23:57
*** shakamunyi has quit IRC23:57
*** ho has joined #openstack-swift23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!