Thursday, 2014-02-27

torgomaticI find I am confused about some stuff in the DB replicator00:00
torgomaticso in db_replicator.Replicator._repl_to_node, we have this "info" variable that's a dict with stuff in it00:01
torgomaticand we want to make a REPLICATE request to a remote server and have that stuff be on the other end00:02
torgomaticbut instead of sending the dict as JSON, we flatten it into an array key-by-key and then send that as JSON00:02
torgomaticso... would there be any harm in just sending the whole dict as JSON? I'm trying to add storage_policy_index to that ball of stuff, and the unpack-and-repack dance makes it harder than (IMO) it should be00:03
*** shri1 has joined #openstack-swift00:11
*** shri has quit IRC00:11
*** miurahr has joined #openstack-swift00:20
*** miurahr has left #openstack-swift00:20
*** matsuhashi has joined #openstack-swift00:23
pconstantinetorgomatic: looks like RELICATE call expects array and makes sure it's array00:26
torgomaticpconstantine: true, but I can change that too00:27
pconstantinetorgomatic: if not hasattr(args, 'pop'):00:27
pconstantine            return HTTPBadRequest(body='Invalid object type')00:27
pconstantinetorgomatic: backward compatible REST API and all that jazz00:28
pconstantinewon't be BC anymore....00:28
torgomaticoh, that array... yeah, basically instead of ['sync', 1, 2, 'blurgh'] I'd have ['sync', {'one': 1, 'two': 2, 'blah': 'blurgh'}]00:28
torgomaticit's basically [method, *args]00:28
torgomaticalso, I'm not terribly worried about compatibility for the REPLICATE verb since nobody outside the cluster uses it, and I can control the replicator code too00:28
torgomaticmight be worth keeping a little shim for one release, but it's not like I'll go breaking clients00:29
*** sungju has quit IRC00:30
*** lnxnut has joined #openstack-swift00:32
*** fifieldt_ has joined #openstack-swift00:33
*** davidhun has quit IRC00:40
acoles-pconstantine: thanks for putting your patch up, I just reviewed & left comment. sorry again for the pain this caused.00:54
*** davidhun has joined #openstack-swift01:03
*** tsg has quit IRC01:03
*** tdasilva has quit IRC01:04
*** shri1 has quit IRC01:12
*** therve has quit IRC01:15
*** therve has joined #openstack-swift01:15
*** lnxnut has quit IRC01:27
*** lnxnut has joined #openstack-swift01:27
*** lnxnut has quit IRC01:31
*** erlon has quit IRC01:32
*** fifieldt_ has quit IRC01:44
*** nosnos has joined #openstack-swift01:46
openstackgerritA change was merged to openstack/swift: Fix fd leak from get_logger() in python 2.6  https://review.openstack.org/6319501:56
*** miurahr has joined #openstack-swift02:04
*** dmorita has joined #openstack-swift02:05
*** miurahr has quit IRC02:18
*** miurahr has joined #openstack-swift02:36
portanteyeah for 6319502:40
*** foexle_ has joined #openstack-swift02:40
*** foexle has quit IRC02:44
*** miurahr has quit IRC02:47
luisbg\o/ both my help strings commits in python-swiftclient finished and approved by Jenkins02:47
*** csd has quit IRC03:25
*** sfineberg has quit IRC03:25
*** sfineberg has joined #openstack-swift03:32
*** foexle_ has quit IRC03:58
*** Dharmit has joined #openstack-swift04:23
*** lnxnut has joined #openstack-swift04:29
openstackgerritA change was merged to openstack/python-swiftclient: swift.1 manpage fix for groff warnings  https://review.openstack.org/7424904:52
openstackgerritA change was merged to openstack/python-swiftclient: Add LengthWrapper in put_object to honor content_length param  https://review.openstack.org/7610204:52
openstackgerritA change was merged to openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/7559204:53
*** matsuhashi has quit IRC05:00
*** nshaikh has joined #openstack-swift05:00
*** lnxnut has quit IRC05:02
*** madhuri has quit IRC05:06
openstackgerritEiichi Aikawa proposed a change to openstack/python-swiftclient: Fix the parameter order of assertEqual in swiftclient test  https://review.openstack.org/7646105:12
*** Anju has quit IRC05:21
openstackgerritPete Zaitcev proposed a change to openstack/swift: Pluggable Back-ends for account and container servers  https://review.openstack.org/4771305:24
*** Midnightmyth has joined #openstack-swift05:43
*** Anju has joined #openstack-swift05:49
*** zaitcev has quit IRC05:59
*** haomaiw__ has quit IRC06:41
*** haomaiwang has joined #openstack-swift06:42
*** saju_m has joined #openstack-swift06:48
*** Midnightmyth has quit IRC06:48
*** chandan_kumar has joined #openstack-swift06:54
openstackgerritEiichi Aikawa proposed a change to openstack/python-swiftclient: Fix the parameter order of assertEqual in swiftclient test  https://review.openstack.org/7646106:57
*** gyee has quit IRC07:00
*** haomaiw__ has joined #openstack-swift07:02
*** haomaiwang has quit IRC07:05
*** Dharmit has quit IRC07:26
*** csd has joined #openstack-swift07:41
*** nshaikh has left #openstack-swift07:43
*** foexle has joined #openstack-swift07:49
*** kris_ha has quit IRC07:52
*** foexle has quit IRC07:53
*** foexle has joined #openstack-swift07:55
*** csd has quit IRC07:55
*** saju_m has quit IRC08:10
*** saju_m has joined #openstack-swift08:10
*** chandan_kumar has quit IRC08:16
*** saju_m has quit IRC08:25
*** saju_m has joined #openstack-swift08:26
*** chandan_kumar has joined #openstack-swift08:29
*** chandankumar_ has joined #openstack-swift08:32
*** chandan_kumar has quit IRC08:35
*** Dharmit has joined #openstack-swift08:39
*** acoles- has quit IRC08:47
*** ppai has joined #openstack-swift08:52
*** mlipchuk has joined #openstack-swift08:52
*** saju_m has quit IRC08:52
openstackgerritYongli He proposed a change to openstack/swift: Exception message should not be localize  https://review.openstack.org/7680109:02
*** nacim has joined #openstack-swift09:05
*** Anju has quit IRC09:24
*** Anju has joined #openstack-swift09:35
*** madhuri has joined #openstack-swift09:36
*** grapsus_ has quit IRC09:38
*** grapsus_ has joined #openstack-swift09:38
*** xga has joined #openstack-swift09:53
*** grapsus_ has quit IRC09:53
*** grapsus_ has joined #openstack-swift09:53
*** xga has quit IRC10:02
*** mkollaro has joined #openstack-swift10:33
*** saju_m has joined #openstack-swift10:35
*** Trixboxer has joined #openstack-swift10:36
*** kris_h has joined #openstack-swift10:48
*** mkollaro has quit IRC10:52
*** mkollaro has joined #openstack-swift10:52
*** nosnos has quit IRC11:14
*** MessedUpHare has joined #openstack-swift11:26
MessedUpHareHi All - i'm just researching swift - and I wanted to know if there is a plugin architecture to allow a REST call to directly return the output of an executable on the storage host?11:27
MessedUpHaresearching around - i'm a bit swamped with the other openstack features11:27
ctennisby on the storage host you mean on the OS of the machine running swift vs. within the swift storage system itself?11:28
MessedUpHareeither really - just server-side instead of client-side11:28
MessedUpHarejust the ability to execute an application against an object and return the output11:29
ctennisthere's no plugin that exists currently to do so, but certainly one could be written11:29
MessedUpHarewhat is the plugin architecture called? (so i can go about trying to write one)11:29
MessedUpHare.. i'm a bit lost at where to start11:30
ctennisit's essentially WSGI middleware for python, which is just a web services library11:31
ctennisas an examply of a small contained plugin is here: https://github.com/fujita/swift3/blob/master/swift3/middleware.py11:31
MessedUpHareok - thanks :)11:31
ctenniswhich provides an S3 interface for swift in a single file11:31
ctennismight be a template to use for inspiration11:31
*** xga has joined #openstack-swift11:34
*** xga has quit IRC11:35
*** xga has joined #openstack-swift11:36
*** MessedUpHare has quit IRC11:37
*** xga has quit IRC11:39
*** xga has joined #openstack-swift11:39
*** miurahr has joined #openstack-swift11:41
*** miurahr has left #openstack-swift11:42
*** xga has quit IRC11:44
*** akscram has quit IRC11:45
*** akscram has joined #openstack-swift11:45
openstackgerritConstantine Peresypkin proposed a change to openstack/swift: fix gatekeeper response headers behavior  https://review.openstack.org/7670911:49
*** tdasilva has joined #openstack-swift12:00
*** ppai has quit IRC12:03
*** dmorita has quit IRC12:13
*** miurahr has joined #openstack-swift12:13
*** miurahr has left #openstack-swift12:14
*** ppai has joined #openstack-swift12:16
pconstantine  File "/opt/swift/swauth/swauth/swift_version.py", line 17, in parse12:25
pconstantine    major = int(parts.pop(0))12:25
pconstantineValueError: invalid literal for int() with base 10: '7d7e8e5'12:25
pconstantinewhat is that???12:25
pconstantinewhy is that???12:25
pconstantinewhy only one node has that, although other nodes have exactly the same code-base?12:25
pconstantineand ALL nodes have 7d7e8e5 in their PKG-INFO12:26
*** dmsimard has joined #openstack-swift12:28
*** fbo_away is now known as fbo12:34
*** miurahr has joined #openstack-swift12:38
*** miurahr has left #openstack-swift12:39
portantea pbr thing?12:45
portantepconstantine: swauth could be bit my the pbr work in swift12:46
portantejust a guess without looking12:46
*** xga has joined #openstack-swift12:49
*** saju_m has quit IRC12:53
*** xga has quit IRC12:58
pconstantineswauth? tell me more...13:15
portanteyour post above13:17
portanteor earlier13:18
portanteswift_version.py from /opt/swift/swauth/swauth/...13:18
portanteit might not be able to handle pbr versions13:18
portantewhen you install top-of-tree, pbr will create a version using the commit number13:18
portantepconstantine: gotta run, back in a bit13:19
*** miurahr has joined #openstack-swift13:21
pconstantineportante: very strange, this is what I have on my machine:1.12.0.114.g7d7e8e513:24
pconstantinefor the same code13:24
pconstantinewhere does it pull its version from?13:24
*** kris_h has quit IRC13:32
*** ppai has quit IRC13:42
*** kris_h has joined #openstack-swift13:45
pconstantineportante: found it, tags were not pulled in the repo13:45
pconstantineno tags - no correct version13:45
*** acoles has joined #openstack-swift13:56
*** mvenesio has joined #openstack-swift14:08
*** miurahr has quit IRC14:11
*** miurahr has joined #openstack-swift14:22
*** Dharmit has quit IRC14:44
*** Dharmit has joined #openstack-swift14:47
*** dmsimard1 has joined #openstack-swift15:13
*** davidhadas has joined #openstack-swift15:13
*** lnxnut has joined #openstack-swift15:14
*** xga has joined #openstack-swift15:15
*** foexle_ has joined #openstack-swift15:17
*** sfineberg_ has joined #openstack-swift15:20
*** swifterdarrell_ has joined #openstack-swift15:20
*** dmsimard has quit IRC15:21
*** mkollaro has quit IRC15:21
*** nacim has quit IRC15:21
*** chandankumar_ has quit IRC15:21
*** foexle has quit IRC15:21
*** sfineberg has quit IRC15:21
*** davidhadas_ has quit IRC15:21
*** swifterdarrell has quit IRC15:21
*** swifterdarrell_ is now known as swifterdarrell15:21
*** xga has quit IRC15:21
*** Midnightmyth has joined #openstack-swift15:26
*** chandankumar_ has joined #openstack-swift15:29
*** mkollaro has joined #openstack-swift15:32
*** mkollaro has quit IRC15:32
*** mkollaro has joined #openstack-swift15:32
*** nacim has joined #openstack-swift15:38
*** ChanServ sets mode: +v swifterdarrell15:41
*** dmsimard1 has quit IRC15:49
*** miurahr has quit IRC15:55
*** Midnightmyth has quit IRC15:57
*** Dharmit has quit IRC16:09
*** smcdowell has joined #openstack-swift16:12
*** smcdowell is now known as physcx16:13
*** Dharmit has joined #openstack-swift16:15
*** zaitcev has joined #openstack-swift16:32
*** ChanServ sets mode: +v zaitcev16:32
*** mkollaro has quit IRC16:42
zaitcevThe story or argument order in assertEquals sure got my day off to a good start https://review.openstack.org/76461 (wait, what) https://bugs.launchpad.net/ceilometer/+bug/1277104 (hooooly shiiit) http://bugs.python.org/issue2079816:53
zaitcevGuys you aren's some fucking cogs in a machine, use your agency for good once in a while.16:53
zaitcev(I'm amazed at number of people who went along and started filing patches like busy beavers without a second thought... and they even manhandled Dolph!!)16:54
*** tsnider has joined #openstack-swift16:58
* gholt does a spit-take17:01
gholtShouldn't it be assertEqual anyway? *ducks*17:05
*** mkollaro has joined #openstack-swift17:08
*** gdrudy1 has quit IRC17:08
*** gdrudy1 has joined #openstack-swift17:09
*** tsnider has quit IRC17:10
*** xga has joined #openstack-swift17:18
*** xga has quit IRC17:22
*** davidhun has quit IRC17:22
*** mvenesio_ has joined #openstack-swift17:23
*** Dharmit has quit IRC17:25
*** mvenesio has quit IRC17:26
*** kris_h has quit IRC17:38
pconstantine-2 ? hmm, never though about that, do some guys have -3 or -11 option?17:45
*** dtalton has joined #openstack-swift17:45
*** dtalton has left #openstack-swift17:46
*** shri has joined #openstack-swift17:59
*** shri1 has joined #openstack-swift18:02
*** shri has quit IRC18:04
*** nacim has quit IRC18:14
torgomaticit sort of boggles my mind that there's so much kerfuffle about the order of args to assertEqual, and that's mostly because == is a symmetric operator18:16
*** mlipchuk has quit IRC18:18
*** bvandenh_ has quit IRC18:29
*** krtaylor has quit IRC18:32
*** chandan_kumar has joined #openstack-swift18:35
*** saju_m has joined #openstack-swift18:37
*** saju_m has quit IRC18:41
*** mintdee has joined #openstack-swift18:41
*** mintdee has left #openstack-swift18:42
*** acoles has left #openstack-swift18:48
*** krtaylor has joined #openstack-swift18:50
*** saju_m has joined #openstack-swift18:51
*** dtalton has joined #openstack-swift18:56
*** mkollaro has quit IRC18:59
*** dtalton has quit IRC19:00
*** krtaylor has quit IRC19:15
*** krtaylor has joined #openstack-swift19:17
*** chandan_kumar has quit IRC19:24
torgomaticnotmyname: swiftclient fix landed. you should go put your PTL hat on and release swiftclient.19:29
luisbgtorgomatic, have a minute?19:31
torgomaticluisbg: sure19:31
luisbgtorgomatic, thanks for your +1 to my help strings fix19:32
torgomaticsure19:32
luisbgthe second part is approved by Jenkins now, https://review.openstack.org/#/c/76630/19:32
torgomaticso... some punctuation, whitespace, and mention a couple defaults?19:33
luisbgtorgomatic, and moving the help= to the end of a few functions, to keep the order constant19:33
torgomaticsure, why not?19:33
luisbgtorgomatic, but yes, that is the gist of it19:33
luisbgtorgomatic, heh :) I know, surface small stuff19:34
torgomaticI'm not belittling it, just making sure I understand the scope19:34
luisbgI have 4 patches waiting final review in gerrit (2 of them being these for swift), so want to get them through before I continue doing more19:35
torgomaticsometimes there's code changes in patches like this, and I want to make sure I don't miss one of those :)19:35
*** saju_m has quit IRC19:35
luisbgtorgomatic, I understand, I wasn't belittling either, I understand we all start somewhere19:35
luisbgand a completely new contributor sending big changes is going to raise some eyebrows :P19:35
luisbgtorgomatic, thanks! :) now I just need a second reviewer, will wait19:36
*** mkollaro has joined #openstack-swift19:37
*** csd has joined #openstack-swift19:39
*** chandan_kumar has joined #openstack-swift19:50
clayganyone know how to get ahold of fujita?  https://github.com/fujita/swift3/pull/6620:14
*** therve_ has joined #openstack-swift20:20
*** therve_ has quit IRC20:25
*** gyee has joined #openstack-swift20:25
*** booi has quit IRC20:40
*** nthacker has joined #openstack-swift20:41
nthackerHi All! I would like to know if there is a tool/script that I can use to test a swift multi-node deployment. The objective is to just run through a list of operations and verify compliance20:42
nthackerI'd like it to run something like that on a proxy node using the test user (system:root)20:42
nthackerdoes anyone have any ideas/suggestions?20:42
*** csd has quit IRC20:52
*** shri1 has quit IRC21:13
*** mvenesio_ has quit IRC21:28
*** csd has joined #openstack-swift21:41
*** chandan_kumar has quit IRC21:45
*** shri has joined #openstack-swift21:45
*** lnxnut has quit IRC21:51
*** lnxnut has joined #openstack-swift21:53
*** lnxnut has quit IRC21:54
*** lnxnut has joined #openstack-swift21:54
physcxAnyone here a swift tuning guru and think they can help me identify what is bottlenecking the throughput of my cluster? At this point we've tried just about everything we can find online and we still aren't sure why we are only getting a fraction of our network bandwidth available.21:55
*** Midnightmyth has joined #openstack-swift21:56
*** lnxnut_ has joined #openstack-swift21:58
*** lnxnut has quit IRC21:58
luisbgphyscx, I recommend you ask in the mailing list, people are super busy this week22:03
luisbgand the mailing list is better for long form conversations were you want input from multiple sources22:03
physcxluisbg, alright i'll try that thx22:04
luisbgphyscx, sorry I can't be of more help22:05
physcxluisbg, would the general openstack list be appropriate or is there a more specific one for swift questions?22:17
luisbgno, all questions go in the general one22:19
luisbgjust add [Swift] on the beginning of the subject22:19
*** lnxnut_ has quit IRC22:24
*** lnxnut has joined #openstack-swift22:29
*** lnxnut has quit IRC22:33
*** acoles has joined #openstack-swift22:40
*** miurahr has joined #openstack-swift22:43
*** lnxnut has joined #openstack-swift22:44
*** lnxnut has quit IRC22:48
*** Midnightmyth has quit IRC23:02
*** openstackgerrit has quit IRC23:45
*** acoles has quit IRC23:45
*** mkollaro has quit IRC23:46

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!