Friday, 2014-09-26

*** dmsimard_away is now known as dmsimard00:02
*** oomichi has joined #openstack-swift00:03
torgomaticyou know it's a good unit test when it starts with "import greenlet"00:08
*** tkay has quit IRC00:10
*** jergerber has quit IRC00:13
*** kyles_ne has quit IRC00:17
*** kyles_ne has joined #openstack-swift00:17
*** kyles_ne has quit IRC00:21
*** dmorita has joined #openstack-swift00:29
mattoliveraulol00:35
*** kota_ has joined #openstack-swift00:40
*** lcurtis has joined #openstack-swift00:58
*** dmsimard is now known as dmsimard_away01:02
*** dmsimard_away is now known as dmsimard01:08
*** clu_ has quit IRC01:11
*** addnull has joined #openstack-swift01:13
*** Edward-Zhang has joined #openstack-swift01:23
*** dmsimard is now known as dmsimard_away01:23
*** bill_az has quit IRC01:26
*** tsg has quit IRC01:27
*** nexusz99 has joined #openstack-swift01:32
*** lcurtis has quit IRC01:39
*** nexusz99 has quit IRC01:44
*** nexusz99 has joined #openstack-swift01:44
*** nosnos has joined #openstack-swift01:45
*** nexusz99 has quit IRC01:47
*** HenryG has joined #openstack-swift01:49
*** X019 has quit IRC01:51
*** X019 has joined #openstack-swift01:54
*** haomai___ has quit IRC01:56
*** nexusz99 has joined #openstack-swift01:56
*** haomaiwang has joined #openstack-swift01:57
*** kyles_ne has joined #openstack-swift02:00
*** tkay has joined #openstack-swift02:07
*** haomaiwang has quit IRC02:14
*** haomaiwang has joined #openstack-swift02:14
openstackgerritA change was merged to openstack/swift: Fix profile tests to clean up its tempdirs.  https://review.openstack.org/12349902:16
*** X019 has left #openstack-swift02:16
*** haomaiwang has quit IRC02:19
*** haomaiw__ has joined #openstack-swift02:19
*** kyles_ne has quit IRC02:32
*** haomaiwang has joined #openstack-swift02:35
*** haomaiw__ has quit IRC02:37
*** haomaiwang has quit IRC02:40
*** haomaiwang has joined #openstack-swift02:41
*** nosnos has quit IRC02:55
*** nosnos_ has joined #openstack-swift02:56
*** haomaiw__ has joined #openstack-swift02:56
*** nosnos_ has quit IRC02:57
*** nosnos has joined #openstack-swift02:57
*** haomaiwang has quit IRC02:59
*** tkay has quit IRC03:00
*** nosnos has quit IRC03:01
smart_developerWhat's the best way to tell how many Swift-related processes are running on your machine ?03:01
smart_developerMy guess would be03:02
smart_developerps aux | grep swift | wc -l03:02
smart_developerBut if you do this as root, will it be accurate?03:02
smart_developerOr is it better to log in as "swift"03:02
*** cdelatte has quit IRC03:03
smart_developerBecause for some reason, "su - swift" on the command line is returning "This account is currently not available."03:03
*** tkay has joined #openstack-swift03:03
smart_developerI was wondering if this is preventing me from gathering better statistics about the number of Swift processes running.03:04
smart_developerAnd maybe in the first place there is a more appropriate method than the "ps aux ....." utility.03:04
smart_developer??03:04
*** tkay has quit IRC03:05
*** Edward-Zhang has quit IRC03:08
*** Edward-Zhang has joined #openstack-swift03:08
zaitcevps is fine for showing running processes, in fact it's pretty much the only tool. You can do  ps ux -U swift.03:08
*** swat30 has quit IRC03:11
*** swat30 has joined #openstack-swift03:12
*** tkay has joined #openstack-swift03:14
smart_developerzaitcev : "ps ux -U swift" seems to return something completely different from "ps aux | grep swift"03:19
smart_developerWhat exactly am I seeing with "ps ux -U swift"?03:19
smart_developera LOT more entries are being outputted than running "ps aux | grep swift"03:20
*** nexusz99 has quit IRC03:23
*** nexusz99 has joined #openstack-swift03:24
*** gyee has quit IRC03:24
*** nexusz99 has quit IRC03:28
zaitcevtry  ps auxw| grep swift  :-)03:28
smart_developerzaitcev : I was just wondering what it was that you originally suggested ?03:28
zaitcevJust read  man ps03:29
smart_developerok.03:29
smart_developer:)03:29
smart_developerzaitcev : By the way, do you know if 1 worker = 1 process ?03:33
*** nexusz99 has joined #openstack-swift03:33
smart_developerzaitcev : And by worker, I mean the ones defined in the /etc/swift/*.conf files for proxy-server, account-server, container-server, and object-server.03:34
zaitcevsmart_developer: it's in swift/common/wsgi.py03:35
smart_developerOk, thank you.03:35
zaitcevas you can see, it does os.fork() for every count of worker, so at least the intent is there03:37
smart_developerzaitcev : What do you mean by "at least the intent is there" ? that there's a bug and it doesn't work as expected?03:38
*** davdunc` has joined #openstack-swift03:44
*** davdunc has quit IRC03:46
*** addnull has quit IRC03:49
smart_developerzaitcev : Let's say that in the [DEFAULT] section of your proxy-server.conf you have workers=5, and in the [DEFAULT] section of account-server.conf, container-server.conf, and object-server.conf you have workers=2.03:49
smart_developerHow would you count the number of processes for Swift that you'd expect to see ?03:50
*** nexusz99 has quit IRC03:53
*** nexusz99 has joined #openstack-swift03:54
*** zhiyan has quit IRC03:54
*** zhiyan has joined #openstack-swift03:57
*** nexusz99 has quit IRC03:58
openstackgerritOpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925003:59
openstackgerritOpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements  https://review.openstack.org/8873604:00
*** kbee has joined #openstack-swift04:00
*** tkay has joined #openstack-swift04:02
kbeetorgomatic: peluse: i see a +2 against https://review.openstack.org/#/c/123835/.. any idea who needs to approve it04:04
*** tkay has quit IRC04:04
*** haomaiw__ has quit IRC04:10
*** haomaiwa_ has joined #openstack-swift04:10
*** jyoti-ranjan has joined #openstack-swift04:10
openstackgerritKeshava Bharadwaj proposed a change to openstack/swift: Provides proper error handling on builder unpickle  https://review.openstack.org/12222504:15
redbokbee: it's been approved, it'll be automatically merged.  it can take a little while.04:18
*** haomaiw__ has joined #openstack-swift04:18
redbosmart_developer: most of the servers will have workers+1 processes.  The extra process just sits and waits for signals and kills the children, I think.04:20
kbeeredbo: Thnx.. I though its 2 +2s and +workflow.. but no one has approved..04:21
redbo"workflow" the approved flag04:22
*** haomaiwa_ has quit IRC04:22
redbo           ^is04:22
kbeeredbo: awww.. thnx..04:23
*** exploreshaifali has joined #openstack-swift04:25
*** nosnos has joined #openstack-swift04:28
*** nexusz99 has joined #openstack-swift04:28
smart_developerredbo : What do you mean by "children" ?04:31
redbothe workers04:31
smart_developerredbo : Why would it kill any of the workers ?04:32
redboif you want to stop or restart the service04:33
*** tkay has joined #openstack-swift04:33
smart_developerredbo -- I didn't know that you would need an entire process dedicated, per service, for that.04:34
smart_developerredbo -- was there no other way to make it more efficient?04:34
smart_developerThat may be a difficult question to answer.04:36
redboI don't think it's been a priority.  A process that's just sitting there isn't that big a cost.04:36
smart_developerSo I have workers=3 in [DEFAULT] for object-server.conf04:36
smart_developerAnd I see 4 swift-object-server processes, which is expected according to what you've outlined.04:37
smart_developerBut this is where it gets tricky.04:37
smart_developerI see just 1 swift-object-updater, and 1 swift-object-replicator, but 3 swift-object-auditors04:37
smart_developerredbo -- do you know what the logic/reasoning behind that, is?04:38
smart_developerFor swift-container-auditor I only see 1, and only 1 for swift-account-auditor, as well.04:39
redbothere are 2 object auditor worker processes04:39
*** addnull has joined #openstack-swift04:39
*** addnull has quit IRC04:40
*** addnull has joined #openstack-swift04:40
*** addnull has joined #openstack-swift04:40
smart_developerredbo -- but why??04:40
smart_developerand why only 1 for everything else04:41
redbobecause they check different things04:44
smart_developerSo if seeing 3 swift-object-auditors means there are 2 object auditor worker processes, that means the 3rd process is the one that is set aside for stopping the service?04:44
smart_developerredbo -- And if we see only 1 swift-container-auditor, or just 1 swift-object-replicator, does that mean that there are actually 0 container auditor workers and 0 object replicators ?04:46
smart_developer(if you're consistent with the n-1 processes actually being used for workers, as in the object auditor scenario).04:46
redbowell, it also re-launches any children that die.  those other services just don't use a worker/controller process.04:46
*** exploreshaifali has quit IRC04:48
smart_developerredbo : So the fact that there are 3 object auditor processes (2 workers, 1 extra) -- that is not something that is set by default by the Swift core code itself, instead of the .conf files?04:50
smart_developeris that correct/incorrect?04:50
smart_developersorry, meant that is*, instead of that is not04:50
smart_developermeant to ask: So the fact that there are 3 object auditor processes (2 workers, 1 extra) : that -is- something that is set by default by the Swift core code itself, instead of the .conf files?04:51
smart_developerinitially04:51
redbothat sounds correct04:51
smart_developerredbo : Okay -- Is there a way to set it through the .conf files as well?04:52
redboyou can turn off one of the scans04:52
smart_developerhow?04:52
*** kyles_ne has joined #openstack-swift04:53
redboif you set zero_byte_fps to 0 in the auditor config, it doesn't run the zero byte scan.  which is a subset of the main audit scan.  You can also set "concurrency" in the auditor conf, which creates more workers of the main audit.04:54
smart_developerredbo : Does the concurrency # = # of workers for the auditor, then ?04:55
smart_developerthe concurrency # that you set04:55
redboyes04:56
*** nexusz99 has quit IRC04:56
smart_developerOkay thank you!04:56
smart_developerBtw, what exactly does setting workers = (some number) in the [DEFAULT] section of your .conf files mean, then?04:57
smart_developerWhat exactly does that specify/set ?04:57
redbohow many worker processes should be created for the server.  concurrency is only used in the auditor config.04:58
smart_developerredbo : What's used for the updaters and replicators, then ?04:58
smart_developerthe other consistency services.04:58
smart_developeror even the middleware, as well.04:58
redboI think most or all of the consistency services support a "concurrency" setting, but they use threads instead of processes.04:59
smart_developerredbo : Oh, so then the concurrency # that you set in the .conf files actually means # of threads ?05:00
smart_developer(and not # of processes?)05:00
smart_developerjust wanted to make sure.05:00
redbofor the replicators and updaters, yes05:00
smart_developerbut for auditor it's the # of processes, and not # of threads ?05:00
zaitcev[zaitcev@guren swift-tip]$ find swift -name '*rep*.py'| xargs grep concurrency05:01
zaitcevswift/common/db_replicator.py:        self.cpool = GreenPool(size=concurrency)05:01
redboyep05:01
smart_developerWhy do they flip-flop it that way ?05:01
smart_developerWhy not stay consistent to one indicator/method ?05:01
*** addnull has quit IRC05:02
redboI think it's just been a "right tool for the job" thing.  Some services need to scale beyond one CPU, so they get extra processes.  Threads are kind of easier (so long as they don't share state).05:03
smart_developerzaitcev : What in the world did you just share ?05:06
smart_developerredbo : Thanks for the info. It was very helpful.05:06
smart_developerWhen do you normally sign on, btw?05:06
redbomy schedule isn't very regular05:07
zaitcevsmart_developer: well, you wanted to know how the "concurrency" flag is used05:08
smart_developerredbo How do you check how many threads are being allocated on your node to running Swift ?05:08
smart_developer(and zaitcev )05:08
zaitcevI think we only use processes and greentreads, so you should not actually need to examine os-level threads05:08
zaitcevYou may though... ps has options for that (man ps).05:09
zaitcevAs far as greenthreads go, they are unfortunately invisible.05:09
zaitcevI mean, without code embedded ahead of time05:09
zaitcevI had a patch that dumped greenthreads at some point...05:10
zaitcevhttps://review.openstack.org/7051305:10
zaitcevYou know what a green tread is, right? Just asking, sorry.05:11
smart_developerzaitcev : Not really XD05:12
zaitcevokay05:13
zaitcevIt's a type of threading that's invisible to the OS and imitated entirely inside an OS-level thread or process.05:13
smart_developerredbo : Where did you learn all the information that we went over today -- is there a place that has good documentation about these details, or do you always end up having to look through the core Swift code ?05:13
zaitcevhe wrote it all05:13
zaitcevto begin with05:13
redbohaha.. yeah, some of it.  And I just watch what changes.  I think you might need to read the code to get a lot of that stuff.05:14
zaitcevI'm trying to hint that reading the code is easy and profitable05:15
smart_developerredbo zaitcev Are you both core Swift developers ?05:15
zaitcevwell, I still grep through it with xargs05:15
smart_developerjust wondering05:15
redboyeah05:15
zaitcevyes. But I joined only recently, when Swift already was a fully developed project and product.05:15
zaitcevSo I do not know a lot of history.05:16
zaitcevFor example... why indeed replicators are in once process, huh? Obviously it has a side effect of crude load control... But was it intentional?05:17
smart_developercrude load control ?05:17
zaitcevWell yeah. It won't eat more than 1 CPU even if concurrency is upped.05:17
redboI guess nobody's ever needed more than 1 CPU worth of container replication05:18
smart_developerIt also seems that object replicators are using only 1 CPU.05:19
smart_developer(in observation of redbo 's comment)05:19
zaitcevhmm... swift/common/db_replicator.py is the only places that subclasses run_forever05:20
*** fifieldt has joined #openstack-swift05:21
zaitcevsorry, that was false05:21
*** kopparam has joined #openstack-swift05:21
smart_developerzaitcev : Along the lines of Swift using greenthreads and not actual OS threads, what's the advantage for Swift using greenthreads ?05:21
smart_developerzaitcev : Basically, why did the developers decide to do that ?05:22
zaitcevsmart_developer: I just told you that I'm not the right guy to ask historical questions. But in most other projects greenthreads used for ease of locking. You don't need to worry about all your lists getting corrupted (much).05:23
smart_developerWhat lists ?05:24
zaitcev*headdesk*05:24
redboI don't know that there's an advantage in every case.  but threads in python can perform horribly, especially if you're doing a lot of stuff over the network.05:24
smart_developerredbo zaitcev By the way, I just did a "ps -eLf | grep swift" on one of my Swift nodes, and it seems to list over 100 Swift-related threads that are currently running.05:28
smart_developerSo that means that Swift is using both greenthreads, and OS threads ?05:28
smart_developerSo in reality there could potentially be way more threads than what I see here in "ps -eLf | grep swift" ?05:29
redboyes.. it gets a little complicated :)  it allocates some OS threads to make certain function calls.  Normally 20 threads per process.05:29
zaitcevGood for running that experiment. Personally I suspect those a library threads that we do not consciously create. Keep in mind though, there's 1 thread per each process minimum.05:29
zaitcevWait, really? In what place?05:30
smart_developer(because that command only shows the OS-level threads, I'm assuming -- but this assumption might not be correct in itself).05:30
redboeventlet's tpool creates 20 threads right off the bat05:30
zaitcevoh05:30
smart_developerredbo : eventlet's tpool creates 20 threads right off the bat -- for each service ? process? or what?05:30
redboeach process that uses tpools, which is probably most of them05:31
redbothen threads_per_disk in object server creates N threads per drive per worker.  We turned that on on a server with a bunch of drives and a bunch of workers today and hit some system limit on the number of threads :)05:32
smart_developerDoes the Swift administrator get to control how many eventlet threads get produced per process ?05:32
redbothere's some environment variable you can set05:33
redboEVENTLET_THREADPOOL_SIZE05:33
smart_developerand that's *not* specified in the /etc/swift/*.conf files ?05:34
redbonope05:34
smart_developerDoes your Swift service / Swift cluster stop working correctly if you set the system ulimit/nproc to a number that's less than all the OS threads that Swift needs ?05:36
smart_developerI am running some workloads against my cluster right now, and I see that there are a little over 100 OS threads running for Swift, currently.05:37
smart_developerBut if I set the system ulimit/nproc to, say, 9905:37
smart_developerwill that cause any functions of my Swift cluster/service to not work correctly ?05:37
smart_developer(ulimit/nproc can be set by either "ulimit -u 99" or in /etc/security/limits.conf )05:38
*** nexusz99 has joined #openstack-swift05:39
zaitcevmost of daemons try to respawn, so this will cause them to loop05:39
redboyes, I think that would cause workers to not start05:39
redbooh yeah, that would be hilarious.  I mean unless it happened to me.05:39
smart_developerBut you would just have fewer workers05:39
smart_developerDoes that necessarily mean the user of your Swift cluster would notice any difference (other than maybe performance differences).05:39
smart_developerSo, functionality-wise, can it still be okay ?05:40
redboyeah, but the controller process would be trying to restart them constantly05:40
*** addnull has joined #openstack-swift05:41
smart_developerredbo : So you're saying that it might still be a fully-functioning Swift cluster/services, but there could be a significant performance degradation ?05:42
*** ppai has joined #openstack-swift05:42
redboyes05:43
smart_developerzaitcev : That doesn't necessarily mean the entire Swift system itself gets stuck and hangs though, does it ?05:43
redbomaybe we should put a little sleep in there where it spawns workers05:44
smart_developerredbo : I imagine that would have its own advantages / drawbacks though, right ?05:44
smart_developerAnd also, isn't it good to set some kind of reasonable limit for the ulimit/nproc, since you want to prevent a forkbomb from using up all of your system resources, right ?05:45
redboI don't think it'd hurt anything.  workers don't usually die anyway.05:45
smart_developerFor instance, I ran into an issue where the object-auditor started fork bombing.05:45
smart_developerAnd it went took up all the ulimit/nproc # of processes that the OS would allow it to utilize.05:46
redbodoesn't sound like a terrible idea.  but you'd have to set it higher than what it normally uses.  which, once it's been running for a bit, it doesn't really create new threads, so that number should be easy to pin down.05:47
smart_developerredbo : Why do you have to set it higher than what it normally uses ?05:47
redboso you don't hit it during normal operations?05:48
smart_developerredbo : Why not set it at exactly what it normally uses ?05:50
*** tkay has quit IRC05:50
*** kopparam has quit IRC05:51
*** kopparam has joined #openstack-swift05:51
redbowell like the replicator needs to launch rsyncs.  it might launch other transient processes or threads I can't think of.05:51
smart_developerAh, I see!05:52
smart_developerok.05:52
smart_developerredbo : Can you do "ps -eLf | grep swift | wc -l" on some of your nodes, and let me know how many threads there tend to be ?05:53
smart_developerI'm getting around 110.05:54
smart_developerA little different for each node (by 1, or 2).05:54
smart_developerA little different for each node (by 1 or 2).05:54
*** kopparam has quit IRC05:56
redborandomly chosen server says 965.  But that's a big server with a lot of workers.05:57
*** kyles_ne has quit IRC05:57
*** tkay has joined #openstack-swift05:57
*** tsg has joined #openstack-swift05:57
smart_developerredbo : Is it a similar number on another server with similar specs ?05:58
*** kyles_ne has joined #openstack-swift05:58
smart_developerredbo : Moreover, should one expect it to be similar ?05:59
*** addnull has quit IRC05:59
redbowell these others are all coming in at 740-750.  I think the first one also happened to be running container servers, and these are pure object nodes.06:00
smart_developerredbo : Why would there be more for container servers, compared to object servers ?06:01
*** Manish_ has joined #openstack-swift06:01
redboit's running both06:01
Manish_clayg: Hi...Hope you are doing well06:01
Manish_clayg: I have one query related to permissable limit of Container/Account metadata size06:02
smart_developerredbo : But if one had pure container servers, and a different server had pure object servers, which one would be expected to have more threads running on them ?06:02
*** kyles_ne has quit IRC06:02
smart_developerredbo : Comparing two hypothetical servers06:02
smart_developerredbo : I guess we could also throw in a pure account server in this scenario, as well, for comparison.06:02
openstackgerritYuan Zhou proposed a change to openstack/swift-specs: Initial draft for high level EC Get flow  https://review.openstack.org/11749206:03
Manish_clayg: SWIFT documentation says that "max_meta_overall_size" is 4096 bytes, does it includes ACL related information(X-Container-Read, X-Container-Write) as well, which is basically also a metadata...06:04
redboit's just a function of how many workers you have.  21 for each worker, plus probably 21 for each consistency service process you have running, plus whatever for rsync.06:04
*** kopparam has joined #openstack-swift06:04
redbothen if you run threads_per_disk on object servers, you get N threads for each disk.06:05
smart_developer"then if you run threads_per_disk on object servers, you get N threads for each disk." -- is in addition to --- "it's just a function of how many workers you have.  21 for each worker, plus probably 21 for each consistency service process you have running, plus whatever for rsync", correct ?06:06
smart_developer(on top of that)06:06
redboyes, I think so.  those 20 threads get created when you import tpool, which still happens even if you set threads_per_disk.06:07
redbooh that's a lie, they're created the first time you execute something in a thread pool.  so maybe they aren't created.06:07
smart_developerI thought tpool was for greenthreads, though ?06:08
smart_developer(greenthreads is for eventlet, right?)06:08
redbotpool is the 20 system threads that it can send work over to06:08
openstackgerritOpenStack Proposal Bot proposed a change to openstack/swift: Imported Translations from Transifex  https://review.openstack.org/12429006:09
smart_developerOk then how do you know how many threads, and how many processes, are created for rsync ?06:09
redboumm... it should launch a maximum of the concurrency of the replicator06:10
*** addnull has joined #openstack-swift06:12
smart_developerthreads or processes ?06:12
redborsyncs are processes06:12
*** astellwag has quit IRC06:13
smart_developerso, replicators are threads (as mentioned earlier), but rsyncs are processes ?06:13
smart_developerwell, you just confirmed for the rsync part, but could we confirm on the replicators-being-defined-as-threads, part ?06:13
redbothe object replicator uses worker processes, the container replicator uses green threads/probably real threads, and they both can execute [concurrency] rsync processes.06:15
*** nshaikh has joined #openstack-swift06:21
Manish_any one who can resolve my query?06:24
*** dvorkbjel has quit IRC06:29
redboManish_: only things that start with x-container-meta count towards max_meta_overall_size for containers, so x-container-read and write won't.  even though they're treated a lot like meta values.06:29
*** swat30 has quit IRC06:29
*** dvorkbjel has joined #openstack-swift06:32
*** mahatic has quit IRC06:32
*** addnull has quit IRC06:34
*** nexusz99 has quit IRC06:37
*** nexusz99 has joined #openstack-swift06:37
*** k4n0 has joined #openstack-swift06:37
*** zaitcev has quit IRC06:39
*** addnull has joined #openstack-swift06:40
*** swat30 has joined #openstack-swift06:40
Manish_redbo: Thanks for the information. Do you know, if there is any limitation about maximum number of users to whom read/write ACL can be provided at a time?06:40
*** tkay has quit IRC06:41
*** tkay has joined #openstack-swift06:46
Manish_redbo: I mean if i need to provide write ACL on any container, to 500 users out of 1000 users, so can i do this by setting their name in X-Container-Read? Or is there any support for userGroup in SWIFT?06:47
smart_developerredbo zaitcev : Thank you very much for your time. Hope you guys have a good one!06:49
redboI think that's going to depend on the auth system.  I know we can do access by roles, I'd guess keystone has something similar.  There's no specific limit on number of users in an ACL, but we do limit all headers to 8192 bytes, so that might be pushing it.06:49
smart_developerredbo zaitcev : Thank you.06:49
redbonp, laters06:49
*** mahatic has joined #openstack-swift06:50
*** tkay has quit IRC06:51
*** tkay has joined #openstack-swift06:51
redboManish_: I don't know, you'll have to find someone who knows auth stuff better.  I think you could create a role and give access to it with the acl and assign that role to the users, but my knowledge of that isn't very deep.06:55
openstackgerritMatthew Oliver proposed a change to openstack/swift: Add sort option to container listings  https://review.openstack.org/12127806:56
openstackgerritMatthew Oliver proposed a change to openstack/swift: Add container reverse listings  https://review.openstack.org/12070906:56
*** tkay has quit IRC07:00
*** Edward-Zhang has quit IRC07:06
*** tgohad has joined #openstack-swift07:10
*** BAKfr has joined #openstack-swift07:11
*** tsg has quit IRC07:13
*** tkay has joined #openstack-swift07:15
*** kopparam has quit IRC07:15
*** dvorkbjel has quit IRC07:15
*** dvorkbjel has joined #openstack-swift07:17
*** mahatic has quit IRC07:28
*** haomaiw__ has quit IRC07:33
*** haomaiwang has joined #openstack-swift07:34
*** tgohad__ has joined #openstack-swift07:48
*** kopparam has joined #openstack-swift07:50
*** tkay has quit IRC07:51
*** tgohad has quit IRC07:52
*** haomaiw__ has joined #openstack-swift07:53
*** haomaiwang has quit IRC07:54
*** haomaiw__ has quit IRC07:59
*** haomaiwang has joined #openstack-swift08:00
acolestorgomatic: thanks for your replies on the zero-copy patch.08:01
*** kota_ has quit IRC08:02
*** foexle has joined #openstack-swift08:08
*** oomichi has quit IRC08:11
*** haomaiw__ has joined #openstack-swift08:16
*** haomaiwang has quit IRC08:18
*** ppai has quit IRC08:29
acolestorgomatic: curious about autogenerated config, as far as i can see gate-swift-docs just builds the rst08:31
acolesso, the rate_limit_ options are still in the proxy section of the deployment guide, but got removed from sample config a while back08:32
*** joeljwright has joined #openstack-swift08:40
*** ppai has joined #openstack-swift08:42
*** nshaikh has quit IRC08:47
*** aix has joined #openstack-swift08:49
*** nshaikh has joined #openstack-swift08:51
*** tgohad__ has quit IRC08:58
*** a1|away_ is now known as AbyssOne09:06
*** Dafna has joined #openstack-swift09:07
*** X019 has joined #openstack-swift09:26
*** dmorita has quit IRC09:34
Manish_redbo:  metadata limit of 4096 bytes is per request limitation, or taoll size of metadata which can be associated with any container/account?09:46
*** exploreshaifali has joined #openstack-swift10:00
*** nosnos has quit IRC10:09
*** nosnos has joined #openstack-swift10:09
*** kopparam has quit IRC10:10
*** kopparam has joined #openstack-swift10:18
*** kopparam has quit IRC10:20
*** kopparam has joined #openstack-swift10:21
*** nshaikh has quit IRC10:24
*** nshaikh has joined #openstack-swift10:25
*** tdasilva has quit IRC10:35
*** jamiehannaford has joined #openstack-swift10:35
*** haomaiw__ has quit IRC10:47
*** kbee has quit IRC10:48
*** addnull has quit IRC10:55
*** nexusz99 has quit IRC10:56
*** cdelatte has joined #openstack-swift11:09
*** davdunc` has quit IRC11:31
*** tdasilva has joined #openstack-swift11:33
*** ppai has quit IRC11:38
*** k4n0 has quit IRC11:46
*** joeljwright has quit IRC11:47
*** ppai has joined #openstack-swift11:51
*** kopparam has quit IRC11:51
*** kopparam has joined #openstack-swift11:52
*** kopparam has quit IRC11:57
*** sandywalsh has quit IRC12:01
*** ppai has quit IRC12:03
*** kopparam has joined #openstack-swift12:06
*** kopparam_ has joined #openstack-swift12:09
*** kopparam has quit IRC12:11
*** geaaru has joined #openstack-swift12:13
*** kopparam_ has quit IRC12:14
*** nosnos has quit IRC12:24
*** nosnos has joined #openstack-swift12:24
*** nosnos has quit IRC12:29
*** kopparam has joined #openstack-swift12:38
*** dmsimard_away is now known as dmsimard12:39
*** kopparam has quit IRC12:43
*** tsg has joined #openstack-swift12:56
*** dmsimard is now known as dmsimard_away13:02
*** occupant has quit IRC13:03
*** occupant has joined #openstack-swift13:03
*** X019 has quit IRC13:04
*** mahatic has joined #openstack-swift13:06
*** nshaikh has quit IRC13:12
*** lcurtis has joined #openstack-swift13:12
*** X019 has joined #openstack-swift13:16
*** bill_az has joined #openstack-swift13:28
*** Manish_ has quit IRC13:30
*** mrsnivvel has quit IRC13:34
*** davdunc` has joined #openstack-swift13:34
*** davdunc` is now known as davdunc13:35
*** davdunc has quit IRC13:35
*** davdunc has joined #openstack-swift13:35
*** dmsimard_away is now known as dmsimard13:36
openstackgerritA change was merged to openstack/swift-specs: Initial draft for high level EC Get flow  https://review.openstack.org/11749213:36
openstackgerritFilippo Giunchedi proposed a change to openstack/swift: Additional exit codes for swift-drive-audit  https://review.openstack.org/12439813:40
*** X019 has left #openstack-swift13:41
*** tdasilva has quit IRC14:00
*** kbee has joined #openstack-swift14:00
*** exploreshaifali has quit IRC14:15
openstackgerritSimon Lorenz proposed a change to openstack/swift: Added flag to create unique tmp dir per strg node  https://review.openstack.org/12408814:19
*** kbee has quit IRC14:22
*** kbee has joined #openstack-swift14:23
*** nexusz99 has joined #openstack-swift14:41
*** annegent_ has joined #openstack-swift14:44
*** tsg has quit IRC14:46
*** tsg has joined #openstack-swift14:57
*** bill_az has quit IRC15:08
*** kenhui has joined #openstack-swift15:12
*** annegent_ has quit IRC15:15
*** jyoti-ranjan has quit IRC15:16
*** jyoti-ranjan has joined #openstack-swift15:16
*** annegent_ has joined #openstack-swift15:19
*** anteaya has quit IRC15:23
*** zacksh has quit IRC15:24
*** zacksh has joined #openstack-swift15:25
*** jyoti-ranjan has quit IRC15:26
mahatichi, is there any specific doc on swift-recon? I only see it's references, but nowhere a manual/doc on it. Can someone please point me to it?15:32
mahaticI already went through this swift-recon part here: https://swiftstack.com/blog/2012/04/11/swift-monitoring-with-statsd/15:32
acolesmahatic: http://docs.openstack.org/developer/swift/admin_guide.html#cluster-telemetry-and-monitoring15:34
mahaticacoles, oh i did go through that as well. It talks about how to use/config swift-recon15:35
*** tsg has quit IRC15:37
acolesmahatic: ah, ok. sorry i don't have any other links15:37
mahaticacoles, np. thanks for the link15:38
*** annegent_ has quit IRC15:40
*** BAKfr has quit IRC15:42
*** mrsnivvel has joined #openstack-swift15:43
*** annegent_ has joined #openstack-swift15:45
notmynamegood morning15:46
notmynamemahatic: also look at the help messages for swift-recon. and I think there is a man page15:46
mahaticgood morning15:46
mahaticoh okay15:47
mahaticnotmyname, also, while i will continue to get familiarized with the project, we/you would still be waiting for app process to go through, correct?15:48
openstackgerritA change was merged to openstack/swift: Zero-copy object-server GET responses with splice()  https://review.openstack.org/10260915:48
mahaticIn that case, can you as well point me to some bugs that i could work on meanwhile? or should i just look them up on launchpad?15:48
openstackgerritA change was merged to openstack/python-swiftclient: Fix unit tests failing when OS_ env vars are set  https://review.openstack.org/12400915:48
*** mrsnivvel has quit IRC15:48
notmynamewoohoo! zerocopy GET landed15:49
notmynamehang on. gotta restart. brb15:49
mahaticokay15:50
notmynameback15:52
notmynameacoles: looks like probably at least another hour for https://review.openstack.org/#/c/123975/ to land15:52
*** kyles_ne has joined #openstack-swift15:54
acolesnotmyname: :( it could yet fail...15:56
notmyname"at least" ;-)15:56
notmynameinteresting. cinder and triple-o are the only 2 projects that have more than one person running for ptl16:02
notmynamehttps://wiki.openstack.org/wiki/PTL_Elections_September/October_201416:02
*** mrsnivvel has joined #openstack-swift16:02
acolesnotmyname: torgomatic: i have 'no more copies anymore' in my head to this tune https://www.youtube.com/watch?v=g6yTRq_rJg416:03
acolesi have no idea if that spans continents/generations !16:03
*** gyee has joined #openstack-swift16:03
notmyname-)16:04
*** tsg has joined #openstack-swift16:05
notmynametsg: good morning16:06
notmynamemahatic: so you were wondering about....?16:06
mahaticnotmyname, okay you remember :D I was wondering (again) if i should have ideally posted in the opw channel16:07
notmynamemahatic: if it's about swift, here is better16:07
mahaticbut here it is: just to clarify/confirm - while i continue to get familiarized with the project, we/you would still be waiting for app process to go through, correct?16:07
mahaticIn that case, can you as well point me to some bugs that i could work on meanwhile? or should i just look them up on launchpad?16:07
mahaticit's about partly both16:08
hurricanerixIs anybody going to the hackathon interested in playing board/card games one night?  I am considering packing some, but if nobody would be interested then I wont.16:09
notmynamehurricanerix: nice!16:10
*** haomaiwang has joined #openstack-swift16:10
*** annegent_ has quit IRC16:11
notmynamemahatic: I'm not specifically waiting on anything from opw. from my reading of it, it's more of "do various things to get involved" rather than "here's one big three month project".16:11
notmynamemahatic: and also, what's needed today won't necessarily be the same by the time opw officially kicks off16:11
hurricanerixnotmyname: I guess I will take that as a yes. =)16:11
notmynamehurricanerix: well, at least one yes.16:12
notmynamemahatic: therefore, I don't think there's any reason to wait on opw eg to do the recon checker thing16:12
*** pberis has quit IRC16:13
mahaticnotmyname, sure. Also, I will have to do a small write up on what I would be working on in those 3 months, after discussing with the mentor16:13
mahaticthat's a part of the process16:13
*** mrsnivvel has quit IRC16:13
mahaticnotmyname, like you said, if not exactly. probably an idea would help i guess16:14
notmynamemahatic: going through https://bugs.launchpad.net/swift to see what pain points people currently have in swift is always valuable as well.16:19
*** bkopilov has quit IRC16:19
mahaticnotmyname, sure16:21
notmynamein python when will [int] > [str]?16:28
*** haomaiwang has quit IRC16:29
notmynameah ok. "never" http://stackoverflow.com/questions/3270680/how-does-python-compare-string-and-int16:31
notmynameacoles: is HP still using the name_check middleware?16:31
notmynamebecause it looks like it is (and always has been) pretty broken https://bugs.launchpad.net/swift/+bug/137239716:33
notmynamemahatic: not sure if Madhuri is working on that or not, but that's a pretty simple bug to fix16:33
*** anteaya has joined #openstack-swift16:34
mahaticnotmyname, oh looking into it16:36
acolesnotmyname: believe so, will ping otoolee16:37
kbeenotmyname: i see a 2 +2s and +workflow against https://review.openstack.org/#/c/123835/.. any idea who nneds to approve it..16:37
mahaticnotmyname, maybe I will check with madhuri when she is in16:38
mahaticoh the bug is also reported by her and assigned to herself16:39
notmynamekbee: http://status.openstack.org/zuul/ <-- things take a _long_ time to land in openstack...16:39
notmynamekbee: the integrated gate queue (where swift patches go to land in swift) is currently over 15 hours long16:40
kbeenotmyname: Thanks.. if i remeber.. one needs to approve also even after +2 right.. i didnot see any mail that it was approved.. hence asked..16:40
notmynamekbee: you've got a green check in the workflow column. that's what it needs16:41
kbeenotmyname: awesome.. thanks16:41
*** annegent_ has joined #openstack-swift16:41
notmynamekbee: but, zuul says that patch is "skipped". I have no idea why. so it still may take a while to land. maybe it doesn't rebase cleanly on top of master any more16:41
notmynamedfg: are you (or anyone at RAX) working on https://bugs.launchpad.net/swift/+bug/1366090 ?16:43
*** annegent_ has quit IRC16:46
kbeenotmyname: should i rebase and resubmit ot what needs to be done now16:47
*** mkollaro has quit IRC16:47
notmynamekbee: what have you checked?16:47
kbeenotmyname: https://review.openstack.org/#/c/123835/.16:48
notmynamekbee: no, I mean why do you think you need to do something other than wait?16:49
*** sandywalsh has joined #openstack-swift16:49
kbeenotmyname: rebase and push code for review ?16:50
notmynamekbee: why do you want to do that? what problem are you trying to solve by doing that?16:50
kbeenotmyname: I'm not sure.. jsut asked since you said that " I have no idea why. so it still may take a while to land. maybe it doesn't rebase cleanly on top of master any more"16:51
notmynamekbee: ok, so figure out if there is a problem or not first. and if there is, then you'll have a path forward.16:52
*** Dafna has quit IRC16:53
notmynamekbee: all I'm saying is that it take a while to get patches though the gate. maybe there's an issue. maybe not. I haven't looked16:53
kbeenotmyname: ok..thnx.. got it.. i'll look into it..16:53
*** dencaval has joined #openstack-swift16:54
notmynamefifieldt: cool! joanna is working on https://bugs.launchpad.net/swift/+bug/1364735 ?16:56
notmynamemahatic: that's another pretty easy one, but I'd want to hear from fifieldt first to see if joanna is working on it16:56
mahaticnotmyname, oh sure. I actually came across it just a while ago. In lowhangingfruit tag i guess16:59
notmynameyeah, that's a good tag to search on16:59
dfgnotmyname: no. patches welcome :)17:01
tsgnotmyname: morning, missed your message earlier17:01
*** annegent_ has joined #openstack-swift17:01
notmynamedfg: kk. I'm going throuh bug reports this morning17:01
notmynamedfg: I added a comment based on a stupid simple test on my saio17:02
dfgnotmyname: i'll fix that sos pull that you did with the conflicts- i was just busy that day17:02
notmynamedfg: heh, no worries (but I think it would be cool)17:02
notmynamedfg: I didn't realize it had conficts now17:02
dfgi merged a separate pull req. anyway- not a big deal17:03
notmynamedfg: thanks17:03
*** acoles is now known as acoles_away17:04
*** smart_developer has quit IRC17:06
*** smart_developer has joined #openstack-swift17:11
kbeenotmyname: just out of curiosity, whats the importance you would tag https://bugs.launchpad.net/swift/+bug/137068017:12
notmynamekbee: low. swift-ring-builder isn't in the read/write data path17:13
notmynamekbee: certainly a way to make things better, though. thanks for working on it17:13
kbeenotmyname: ok :).. on https://review.openstack.org/#/c/123835/, found there was a rebase problem.. have rebased and pushed again for review..17:14
*** annegent_ has quit IRC17:14
*** haomaiwang has joined #openstack-swift17:14
imkarrerGood after noon.  I am using the Tempest tests for Swift and have a few questions about the expected authentication method used when creating a new user during test setUp for the test contained in test_container_acl.py and test_account_quotas.py.  First, am I in the right place or should I place this question in the Openstack Tempest channel?17:15
notmynameimkarrer: not sure. you won't find a lot of tempest-specific help in here (try #openstack-qa for that), but we can help if you have auth questions around swift17:17
claygohai17:17
openstackgerritKeshava Bharadwaj proposed a change to openstack/swift: Fixes unit tests to clean up temporary directories  https://review.openstack.org/12383517:18
*** haomaiwang has quit IRC17:19
kbeetorgomatic: peluse there was a rebase problem on https://review.openstack.org/#/c/123835/ and hence was not merged.. i've rebased and resubmitted..17:20
*** imkarrer has quit IRC17:21
*** imkarrer has joined #openstack-swift17:21
*** kyles_ne has quit IRC17:33
* kbee is logging off for the day17:33
*** kyles_ne has joined #openstack-swift17:33
*** tdasilva has joined #openstack-swift17:35
*** nexusz99 has quit IRC17:36
*** kbee has quit IRC17:37
*** kyles_ne has quit IRC17:38
*** foexle has quit IRC17:39
*** geaaru has quit IRC17:42
notmynamemahatic: here's another small one to look at https://bugs.launchpad.net/swift/+bug/124450617:48
mahaticnotmyname, okay. This one: https://review.openstack.org/#/c/69576/17:49
*** exploreshaifali has joined #openstack-swift17:49
mahaticI was looking at that one17:50
mahaticI just assigned myself to the link you just gave17:53
mahaticand "You may only assign yourself because you are not affiliated with this project and do not have any team memberships." this is confusing17:53
*** tkay has joined #openstack-swift17:53
*** jamiehannaford has quit IRC17:54
notmynamemahatic: yes. that is confusing. I wonder what it means17:55
mahaticnotmyname, heh yeah17:56
*** kyles_ne has joined #openstack-swift18:04
*** kyles_ne has quit IRC18:06
*** kyles_ne has joined #openstack-swift18:06
exploreshaifalinotmyname, I am trying to configure swift in my VM, there is no opt/stack/swift folder in VM18:07
exploreshaifaliI am following devstack guide for swift18:08
notmynameexploreshaifali: you're setting up a swift dev environment?18:08
exploreshaifaliyes18:08
exploreshaifalihttp://devstack.org/configuration.html18:08
openstackgerritAlan Erwin proposed a change to openstack/swift: Adding object partition check  https://review.openstack.org/12219418:08
notmynameexploreshaifali: don't use devstack18:08
exploreshaifaliok18:08
exploreshaifalithan?18:08
notmynameexploreshaifali: https://github.com/swiftstack/vagrant-swift-all-in-one is the fast way18:09
notmynameexploreshaifali: and that's an automated version of http://docs.openstack.org/developer/swift/development_saio.html18:09
exploreshaifaliyeah, I was about to ask for same18:10
exploreshaifali:)18:10
exploreshaifalialso please can you provide any link for swift cLI18:10
exploreshaifali*CLI18:10
notmyname?18:10
notmynamewhat doe you mean?18:10
notmynamethat's the python-swiftclient project (it provides a CLI and SDK)18:11
exploreshaifalinotmyname, this bug https://bugs.launchpad.net/python-swiftclient/+bug/137165018:11
exploreshaifaliis related to swift CLI so I asked for it18:11
notmynameexploreshaifali: oh. dev work on swiftclient would need a swift cluster to talk to, but you can dev wherever you want for tht18:11
exploreshaifaliok18:11
exploreshaifalicool :)18:12
exploreshaifaliThanks!18:12
*** NM1 has joined #openstack-swift18:14
NM1Hi guys! Did anyone run any tests concerning the new bash bug?18:15
*** NM1 has left #openstack-swift18:17
*** NM1 has joined #openstack-swift18:17
*** tsg has quit IRC18:17
*** tsg has joined #openstack-swift18:18
glange_what sort of tests?18:23
NM1I see some blog post talking about executing arbitrary commands, just by setting specific header on the http request.18:28
glange_true, but are worried about that affecting swift?18:28
*** annegent_ has joined #openstack-swift18:31
glange_I thought that was a bash security problem and didn't have anything to do with http18:31
NM1Just wondering. I supposed that most of the users start swift by using bash as shell18:31
notmynamecertainly don't consider this an exhaustive pen-test, but I send the exploit over the content-type and referer headers and didn't see any issues. swift doesn't set the environment variables and call out to a shell (on the read/write data path)18:31
NM1notmyname: I also tried it here with the same results.18:32
notmynameglange_: yeah, but if you've got a server process that takes the user input and uses it to populate env vars then call a shell, you're doomed18:32
notmynameglange_: and the first easy example was with cgi things18:32
glange_oh, like a sql injection?18:32
notmynameglange_: but I've also see a demo of doing it via dhcp18:32
notmynamesortof. but in this case it's shell functions, not sql18:33
glange_yeah18:33
glange_"like" :)18:34
NM1People running swift behind an apache http server could have some problems. But of course that would be an apache issue, not swift.18:34
notmynameglange_: like a sports metaphor18:35
glange_exactly18:35
notmynameNM1: ya maybe. don't know18:35
*** annegent_ has quit IRC18:36
*** annegent_ has joined #openstack-swift18:36
*** tsg has quit IRC18:48
*** tsg has joined #openstack-swift18:50
*** kyles_ne has quit IRC18:51
*** tkay has quit IRC18:52
ahaleyeah i had a quick poke around swift earlier and decided only place it shells out is replicators calling rsync and its fine, though didn't do exhaustive check on libs18:55
*** tkay has joined #openstack-swift18:56
notmynameahale: yeah. that18:56
mahaticnotmyname, I can't quite figure out which file is generating the exception? I did look into (multithreading.py). but other than that, Could you point me in some direction please?18:59
mahatichttps://bugs.launchpad.net/swift/+bug/124450618:59
notmyname"JSONx is an IBM® standard format to represent JSON as XML."   but....why?19:01
notmynamemahatic: you've got the swift client locally?19:02
mahaticyeah19:02
swifterdarrellnotmyname: well, you've got Java in hand and all those "web 2.0" jerks keep insisting on JSON...19:02
mahaticnotmyname, that's where i found the file /python-swiftclient/swiftclient/19:03
swifterdarrellnotmyname: if you've got a ton of XML tooling, it's gotta be annoying to deal with JSON19:03
notmynamemahatic: and if you upload something and set the segment size to some non-integer, do you see a traceback19:03
notmynameswifterdarrell: sure, of course :-)19:04
notmynameswifterdarrell: as I saw elsewhere, all these people say that they have enterprise experience, but I don't think they've spent a single day on a starship19:04
swifterdarrellnotmyname: ++19:05
*** NM1 has left #openstack-swift19:08
*** NM1 has joined #openstack-swift19:08
Tyger_notmyname: The problem with that is the starship Enterprise was named after a US Navy vessel. (Quite a few of them, actually.)19:08
*** Tyger_ is now known as Tyger19:09
*** tsg has quit IRC19:10
notmynamemahatic: basically, recreate it locally. that is, get the traceback yourself, and then let's work from there19:19
mahaticnotmyname, sorry. was trying out that took me to another trace back. :D trying to resolve it. will ping back19:20
mahaticand that toook*19:20
*** kyles_ne has joined #openstack-swift19:22
*** tkay has quit IRC19:24
*** kyles_ne has quit IRC19:26
mahaticnotmyname, swift upload -A http://127.0.0.1:8080/auth/v1.0 -U test:tester -K testing v1 /home/mahatic/myswiftfile19:27
notmynamemahatic: and that should work, right?19:28
mahaticgives me "HTTPConnectionPool(host='127.0.0.1', port=8080): Max retries exceeded with url: "19:28
notmynameah that's something different than the bug report19:28
mahaticor "Account not found"19:28
mahaticnotmyname, yeah. But last i tried, i did upload a file. Does that error mean something obvious? am i missing something here?19:29
notmynamemahatic: how'd you set up your swift cluster? is it following the SAIO instructions? using something else?19:30
mahaticnotmyname, SAIO instructions19:30
notmynameok19:31
*** zohar has joined #openstack-swift19:31
zoharHi all!19:32
mahaticnotmyname, might be very basic, but startmain script has to be run only initially?19:32
zoharI have a newbie question please19:33
notmynamemahatic: that basically "turns on" the main parts of swift. if you ever stop them, you'd run start main again19:33
notmynamemahatic: eg I run `resetswift` and `startmain` a dozen times a day19:33
mahaticnotmyname, and that gives me: "IOError: [Errno 13] Permission denied: '/var/run/swift/proxy-server.pid' "19:33
notmynamezohar: don't ask to ask! just ask! :-)19:33
mahaticnotmyname, correct. that's what i was looking at it as19:34
zoharjust generally, if i clone github.com/openstack/swift and i just want to run the .functests there, on a single node setup, what preperation do i need?19:34
notmynamezohar: you can run the functional tests against any swift endpoint, including those from public providers19:34
zoharyes that makes sense19:35
zoharso say the endpoint exists already19:35
notmynamezohar: you've got your own clone of the repo and want to install it and run functests?19:35
zoharbut nothing else does19:35
zoharyes basically19:35
notmynamezohar: oh, so you've already got a swift cluster somewhere else?19:35
notmynamezohar: I gues I'm wondering if you're trying to change swift and test it or just test some other swift endpoint19:35
zoharyes, but not exactly19:36
zoharyes19:36
zohartesting changed swift on some endpoint19:36
zoharall that endpoint has is swift-like object storage19:36
notmynamezohar: oh19:36
zohari want to create everything else necessary to run those tests19:36
mahaticnotmyname, I will have to be on branch "master"?19:37
notmynamezohar: the functests use the test.conf https://github.com/openstack/swift/blob/master/test/sample.conf19:37
*** tkay has joined #openstack-swift19:37
notmynamezohar: let me see where that comes from19:38
zoharok19:39
notmynamezohar: it's loaded from the value set in SWIFT_TEST_CONFIG_FILE env var or from /etc/swift/test.conf19:40
notmynamezohar: so make a test config file and reference it when calling ./.functests in the root of the source tree19:41
notmynamezohar: that shoudl be it19:41
notmynamemahatic: shouldn't matter.19:41
zoharso on a fresh ubuntu14, i clone this repo, install keystone, i export some env variables like: OS_USERNAME,TENANT,PASSWOD, and OS_AUTH_URL=http://127.0.0.1:35357/v2.0 and then try keystone tenant-list, im obviously missing some stuff, i would like to know what19:42
notmynamezohar: is your "swift" endpoint using keystone creds or keystone-style auth?19:42
zoharkeystone-style auth19:43
zoharbut im not even at the point of reaching that endpoint yet19:43
zohari just want a most minimal "openstack" distro on this node, which I will point to my "swift-like" node19:43
zoharby creating a service and endpoint19:44
zoharbut im not even at that step yet19:44
zoharwill of course add my local tenants to the remote "swift" too, once i am able to create tenants here19:45
notmynamezohar: you don't need anything locally. ie where you are running the test from19:46
zoharoh really19:46
notmynamezohar: you're only adding creds into the config file. those will need to be valid in the target swift cluster19:46
notmynamezohar: which also means that if you're using some non-keystone auth system, that's ok as long as it understands the v1, v2, v3 auth protocols19:47
*** annegent_ has quit IRC19:48
notmynamezohar: eg I've got customers not using keystone but using swift with ldap or ad. so the creds would match their ldap creds. and the swift cluster knows how to translate it (which it does with my company's prouct)19:49
notmynamezohar: that's only an example. I don't want to add complexity to my answers and confuse anything :-)19:49
zoharyes thank you :)19:50
zoharso im tryin to recreate this test setup made by another person19:50
zoharin their setup, keystone is functioning on the test node19:50
zoharit allows me to keystone list-tenants etc..19:50
notmynamezohar: so how do you do auth in your "swift" cluster? can you pass in the X-Auth-User and X-Auth-Key headers and get back an X-Storage-Url endpoint? (that's the v1 style)19:50
notmynameah ok19:50
mahaticnotmyname, okay. Any guesses about the IOError? -> "IOError: [Errno 13] Permission denied: '/var/run/swift/proxy-server.pid' "19:51
zoharusing normal keystone19:51
notmynamemahatic: yeah. permissions issues :-)19:51
mahaticnotmyname, there is no proxy-server.pid there19:51
zoharso on the cluster end, we have normal keystone tenants too19:51
mahaticnotmyname, :) I did try as root. But i don't see any proxy-server.pid in that path. Am i not supposed to?19:52
notmynamemahatic: if it's not running, there shouldn't be anything there19:52
mahaticnotmyname, okay19:53
*** tkay has quit IRC19:53
openstackgerritpaul luse proposed a change to openstack/swift: Merge master to feature/ec  https://review.openstack.org/12450319:53
zoharbasically, what i want is to make a service endpoint on my test node pointing to the cluster, and add relevant auth tenants to it too19:54
*** zaitcev has joined #openstack-swift19:54
*** ChanServ sets mode: +v zaitcev19:54
notmynamezohar: you want to add creds to your keystone instance which point to your swift cluster. then you add those creds to the test.conf file19:54
notmynameright?19:55
*** kyles_ne has joined #openstack-swift19:55
zoharhonestly i have no idea about the test.conf file19:55
zohari dont think it was even used (at least that sample.conf one) on the other setup im trying to recreate19:55
notmynamezohar: it's used for running the functional tests that are part of the swift codebase19:56
zoharhmm well i think the default values are fine19:57
zoharthe auth_host should be the test node19:57
notmynameI've got to get on a phone call19:58
notmynamezohar: auth_host points to whatever the auth (keystone) endpoint is19:59
notmynameI don't know what your test node is19:59
zoharyes19:59
zoharok19:59
zoharso on the remote "cluster" i only have basic object storage19:59
zoharnothing else19:59
zohari want everything else (including keystone) on the test node19:59
zohareverything else that is necessary for running whatever tests between this node and the storage cluster through swift api20:00
notmynamezohar: ok, that makes sense20:00
notmynamezohar: what's required depends on what your auth integration is in your swift cluster20:00
zoharshould be /v2.0/20:00
notmynamezohar: if it's keystone, then run keystone on your test node20:00
notmynamezohar: right, so it sounds like you're on the right path20:01
zoharive installed python-keystoneclient on the test node20:01
zoharim supposing i need a server20:01
notmynameyeah20:01
*** exploreshaifali has quit IRC20:01
zoharoh so that was my mistake20:01
zoharanything besides keystone that i need?20:02
zohar(ive totally missed it, did apt-get install keystone, and just went with the first renamed recommendation it game me...)20:02
notmyname...phone call...20:03
zoharno problem thanks for the help man, dont let me keep you from your call20:03
zoharalso yeah i got the apt package name for keystone client from trying to run keystone and getting recommended package to install, while actually FORGETTING to install keystone...20:04
*** annegent_ has joined #openstack-swift20:04
zoharnow i have this process running: /usr/bin/python /usr/bin/keystone-all20:05
*** kenhui has quit IRC20:05
zoharkeystone tenant-list returns: The request you have made requires authentication. (HTTP 401)20:06
zohari have: OS_AUTH_URL=http://127.0.0.1:35357/v2.0/20:06
*** mrsnivvel has joined #openstack-swift20:07
*** jergerber has joined #openstack-swift20:07
mahaticnotmyname, now when the permissions are alright startmain is throwing this: "Exception: Could not bind to 0.0.0.0:8080 after trying for 30 seconds"20:07
zohari think i need an apache server running too, ive updated the /etc/keystone/keystone.conf and now keystone command is returning: Authorization Failed: Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens20:11
zoharwhat specifically do i need to install for this?20:12
NM1mahatic: I should be running anotther app on the same port20:12
NM1mahatic: Are you running linux?20:12
mahaticNM1, yeah20:13
mahaticNM1, netstat -plnt -> http://paste.openstack.org/show/115702/20:14
NM1mahatic: try run netstat -nlpt|grep 8080  and see if there is any application running20:14
mahaticpython i guess20:14
NM1mahatic: ps -ef|grep 2769120:15
mahaticNM1, http://paste.openstack.org/show/115703/20:16
NM1It seens your proxy server is already running20:16
mahaticNM1, but i did do a resetswift and then did startmain20:17
mahaticNM1, oh and also, now it is showing because i didnt do a resetswift yet after running startmain20:18
mahaticmy startmain output looks like this: http://paste.openstack.org/show/115704/20:18
NM1Can you share the 'stop' command?20:20
*** aix has quit IRC20:21
*** annegent_ has quit IRC20:26
mahaticNM1, stop command?20:27
*** annegent_ has joined #openstack-swift20:27
NM1mahatic: it looks like you proxy is not stopping.20:27
NM1mahatic: *your20:27
mahaticNM1, okay. im not aware of a stop command. can you please tell me the command?20:28
notmyname`swift-init all stop`20:28
notmynameor just `swift-init proxy stop`20:28
mahaticfor the latter, "no proxy-server running"20:29
mahaticmaybe i could just allocate another port to proxy? other than 8080?20:30
notmynamephone call done, but now I've got to run some errands20:30
notmynamemahatic: https://github.com/swiftstack/vagrant-swift-all-in-one is a very simple way to get a SAIO up and running20:30
notmynamemahatic: yes, it's important to figure out why you are having permissions/port issues, using that will get you going quickly20:31
mahaticnotmyname, alright20:31
notmynamezohar: you probably won't find too many hints in this channel about how to get keystone up and running (many of us don't use keystone day-to-day). #openstack-keystone would be a good place to start.20:32
openstackgerritDoug Hellmann proposed a change to openstack/swift-specs: Use the current date for the copyright statement  https://review.openstack.org/12054620:32
openstackgerritDoug Hellmann proposed a change to openstack/swift-specs: Remove templates from toctrees  https://review.openstack.org/12054520:32
openstackgerritDoug Hellmann proposed a change to openstack/swift-specs: Add RSS feed  https://review.openstack.org/12054420:32
notmynamezohar: however, once you have it configured, then this is definitely the place to ask about getting the functests running against your endpoint20:32
zoharnotmyname, thank you very much!20:32
mahaticnotmyname, sure. I will definitely do that. Will try about the port a lil more and then jump onto that20:32
*** morganfainberg is now known as morgan20:36
*** morgan is now known as morganfainberg20:37
mahaticNM1, http://paste.openstack.org/show/115719/ -> can i just not assign python some other port? would it be any problem?20:43
smart_developerHi everyone, quick question : For what functions does Swift utilize memcached ?20:46
smart_developerFor everything you can think of, or for only certain parts ?20:46
NM1mahatic: Is it a test server?20:48
*** annegent_ has quit IRC20:49
mahaticNM1, I just changed the port for proxy20:49
mahaticit seems to be working alright20:49
NM1mahatic: ok. I'm just afraid you have to do that again.20:50
mahaticNM1, http://paste.openstack.org/show/115725/ that's the output20:50
mahaticNM1, again? why would that be?20:50
*** tdasilva has quit IRC20:50
NM1mahatic: What command are you using to start swift?20:52
mahatici did a startmain20:52
mahaticthe script20:52
NM1mahatic: do you have something like restartmain ?20:53
mahaticNM1, there is a reset20:53
mahaticresetswift20:53
mahaticNM1, oh you mean, everytime i reset, it would go back to port 8080?20:53
mahaticNM1, i just did that. it didn't happen.20:54
NM1mahatic: Humm. I'm just wondering why the proxy server running on port 8080 didn't stop.20:55
mahaticNM1, it indicated there was no proxy-server running when i gave this command: 'swift-init proxy stop'20:56
mahaticNM1, i'm thinking it is only because the port was occupied20:56
NM1mahatic: I think it didn't find the pid file. I'd kill the process using kill PID20:57
mahaticNM1, oh. but notmyname was suggesting that there wouldn't be a pid if there was no proxy-server running21:00
NM1mahatic: Yes but in your case you have a proxy-server running.21:02
mahaticNM1, no right, 'swift-init proxy stop' gave 'no proxy-server running' output21:03
mahaticNM1, I actually went to the folder and checked. PID was not there. Now it is there.21:04
NM1mahatic: for me it looks like the proxy server started and couldn't right the pid file for some reason. Without the pidfile swift-init can stop the process. However it was running.21:05
NM1mahatic:  According with this http://paste.openstack.org/show/115703/, for me it was running.21:06
NM1right = write21:08
*** mahatic_ has joined #openstack-swift21:08
mahatic_NM1, oh. hmm21:09
NM1mahatic:  if it's running and ok, nevermind :)21:10
*** mahatic has quit IRC21:10
*** tkay has joined #openstack-swift21:13
mahatic_NM1, yeah. But i would also want to know how to stop a pid? And how does it affect in anyway if i use a diff port?21:13
*** tkay has quit IRC21:15
NM1mahatic_: If the process don't have a pid file you can just run kill pid_number21:18
NM1mahatic_: if that doesn't work you can try kill -9 pid_number21:18
mahatic_NM1, ah okay.21:19
*** pberis has joined #openstack-swift21:37
*** shri has joined #openstack-swift21:40
*** swat30 has quit IRC21:40
*** thurloat has quit IRC21:42
*** thurloat has joined #openstack-swift21:44
*** swat30 has joined #openstack-swift21:46
*** swat30 has quit IRC21:54
*** thurloat has quit IRC21:55
*** tkay has joined #openstack-swift21:55
*** swat30 has joined #openstack-swift22:01
*** tkay has quit IRC22:02
*** thurloat has joined #openstack-swift22:02
*** imkarrer has quit IRC22:02
*** imkarrer has joined #openstack-swift22:02
*** jergerber has quit IRC22:13
*** IRTermite has quit IRC22:13
*** NM1 has quit IRC22:14
*** kyles_ne has quit IRC22:16
*** kyles_ne has joined #openstack-swift22:17
*** thurloat has quit IRC22:17
*** thurloat has joined #openstack-swift22:18
*** dmsimard is now known as dmsimard_away22:18
openstackgerritA change was merged to openstack/python-swiftclient: Remove a debugging print statement  https://review.openstack.org/12397522:35
*** NM1 has joined #openstack-swift22:40
*** lcurtis has quit IRC22:43
clayg^ oh no i needed that!?22:47
*** kyles_ne has quit IRC22:47
claygon nm, that was a different debug print statement22:48
*** kyles_ne has joined #openstack-swift22:48
mattoliverauLol, you can always as more :p22:57
mattoliverau*print22:57
morganfainbergnotmyname or anyone else: https://bugs.launchpad.net/keystone/+bug/1299146 this doesn't look like we have anything to do on the keystone side.23:05
morganfainbergam I correct?23:06
*** bill_az has joined #openstack-swift23:13
*** kyles_ne has quit IRC23:23
*** kyles_ne has joined #openstack-swift23:24
brianclineis there currently a way at the proxy level to put a max time limit on keepalives?23:28
* briancline dug around quite a bit but didn't see anything code/doc wise23:29
*** kyles_ne has quit IRC23:31
*** kyles_ne has joined #openstack-swift23:31
*** NM1 has quit IRC23:37
*** bill_az has quit IRC23:40
notmynamemorganfainberg: I think you can drop keystone from that. IIRC the only questions were around the guarantees of uniqueness for certain names and ids. https://bugs.launchpad.net/keystone/+bug/1299146/comments/1023:49
morganfainbergnotmyname, cool ty23:49
*** jeblair is now known as corvus23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!