Friday, 2014-04-25

*** shri has quit IRC00:18
*** changbl has joined #openstack-swift00:25
*** dmorita has joined #openstack-swift00:43
*** Alex_Gaynor_ has joined #openstack-swift00:44
anticwcreiht: aiui temptest does some keystone centric stuff which breaks00:45
anticwi was asking how people deal00:45
*** swills` has joined #openstack-swift00:47
*** swills has quit IRC00:48
*** Alex_Gaynor has quit IRC00:48
*** Alex_Gaynor_ is now known as Alex_Gaynor00:48
*** nosnos has joined #openstack-swift01:33
*** 6JTAAF6H4 has joined #openstack-swift01:35
*** swills` is now known as swills01:36
*** saschpe has quit IRC01:36
*** saschpe- has joined #openstack-swift01:36
*** mkollaro has quit IRC02:08
*** mkollaro has joined #openstack-swift02:09
*** bill_az has quit IRC02:12
*** mkollaro has quit IRC02:18
*** bill_az has joined #openstack-swift02:18
*** tdasilva has left #openstack-swift02:23
*** russell_h has joined #openstack-swift02:25
russell_hso swift seems to have done some neat work around instrumentation, specifically with statsd02:26
russell_hhas anyone made an effort to get this into oslo?02:26
*** early has quit IRC02:26
*** early has joined #openstack-swift02:31
*** zhiyan_ is now known as zhiyan02:33
*** bill_az has quit IRC02:40
*** haomai___ has quit IRC02:42
*** haomaiwang has joined #openstack-swift02:43
*** praveenkumar has joined #openstack-swift03:05
*** shakamunyi has joined #openstack-swift03:27
*** nosnos has quit IRC03:45
zaitcevNot that I know of.04:09
zaitcevDarrell is the guy to ask04:09
*** haomaiw__ has joined #openstack-swift04:13
*** haomaiwang has quit IRC04:16
*** chandan_kumar has joined #openstack-swift04:21
*** 6JTAAF6H4 has quit IRC04:29
*** nosnos has joined #openstack-swift04:53
*** matsuhashi has joined #openstack-swift04:54
*** bvandenh has joined #openstack-swift04:57
*** ppai has joined #openstack-swift05:02
openstackgerritZhang Hua proposed a change to openstack/swift: Add profiling middleware in Swift  https://review.openstack.org/5327005:05
*** zaitcev has quit IRC05:07
*** matsuhashi has quit IRC05:24
*** Honghui_ has joined #openstack-swift05:31
*** ppai has quit IRC05:34
*** matsuhashi has joined #openstack-swift05:40
openstackgerritClay Gerrard proposed a change to openstack/swift: Container Reconciler  https://review.openstack.org/9001905:45
*** haomaiw__ has quit IRC05:47
*** bvandenh has quit IRC05:48
*** haomaiwang has joined #openstack-swift05:48
*** bvandenh has joined #openstack-swift05:48
*** ppai has joined #openstack-swift05:52
*** Dharmit has joined #openstack-swift06:06
*** matsuhashi has quit IRC06:14
*** matsuhashi has joined #openstack-swift06:24
*** shakamunyi has quit IRC06:36
*** cheri has joined #openstack-swift06:38
*** psharma has joined #openstack-swift06:41
*** nshaikh has joined #openstack-swift06:46
*** Dharmit has quit IRC06:48
*** foexle has joined #openstack-swift06:59
*** nosnos has quit IRC07:02
*** matsuhashi has quit IRC07:15
*** matsuhashi has joined #openstack-swift07:15
*** haomaiw__ has joined #openstack-swift07:20
*** haomaiwang has quit IRC07:23
*** matsuhashi has quit IRC07:28
*** matsuhashi has joined #openstack-swift07:29
*** shakamunyi has joined #openstack-swift07:33
*** shakamunyi has quit IRC07:38
*** ppai has quit IRC07:38
*** shakamunyi has joined #openstack-swift07:39
*** shakamunyi has quit IRC07:44
*** ppai has joined #openstack-swift07:51
*** nacim has joined #openstack-swift07:53
openstackgerritChristian Schwede proposed a change to openstack/python-swiftclient: Add some bash helpers for auth stuff  https://review.openstack.org/8622407:55
*** Honghui_ has quit IRC07:57
*** mkerrin has quit IRC07:59
*** matsuhashi has quit IRC08:06
*** mkerrin has joined #openstack-swift08:06
*** matsuhashi has joined #openstack-swift08:07
*** anticw has quit IRC08:11
*** nosnos has joined #openstack-swift08:11
*** cheri has quit IRC08:22
*** ppai has quit IRC08:23
*** Dharmit has joined #openstack-swift08:23
*** Dharmit has quit IRC08:24
*** Dharmit has joined #openstack-swift08:24
*** foexle has quit IRC08:25
*** foexle has joined #openstack-swift08:25
*** Honghui_ has joined #openstack-swift08:25
*** Dharmit has quit IRC08:25
*** Dharmit has joined #openstack-swift08:25
*** anticw has joined #openstack-swift08:34
*** cheri has joined #openstack-swift08:35
*** matsuhashi has quit IRC08:36
*** judd7 has quit IRC08:36
*** Honghui__ has joined #openstack-swift08:38
*** Honghui_ has quit IRC08:39
*** shakamunyi has joined #openstack-swift08:40
*** ppai has joined #openstack-swift08:40
*** cheri has quit IRC08:43
*** mmcardle has joined #openstack-swift08:43
openstackgerritChmouel Boudjnah proposed a change to openstack/python-swiftclient: Mock auth_end_time in test_shell.test_download  https://review.openstack.org/9002608:44
*** shakamunyi has quit IRC08:45
*** ccorrigan has quit IRC08:45
*** nosnos has quit IRC08:46
*** foexle_ has joined #openstack-swift08:51
*** ppai has quit IRC08:51
*** foexle has quit IRC08:54
*** cheri has joined #openstack-swift08:56
*** ppai has joined #openstack-swift09:04
*** zhiyan is now known as zhiyan_09:14
*** mkollaro has joined #openstack-swift09:22
*** shakamunyi has joined #openstack-swift09:41
*** shakamunyi has quit IRC09:46
*** matsuhashi has joined #openstack-swift09:47
*** haomaiw__ has quit IRC09:49
*** Honghui__ has quit IRC09:51
*** nosnos_ has joined #openstack-swift09:52
*** Honghui_ has joined #openstack-swift09:54
*** mkollaro has quit IRC10:00
*** matsuhashi has quit IRC10:11
openstackgerritAlistair Coles proposed a change to openstack/swift: Restrict keystone cross-tenant ACLs to IDs  https://review.openstack.org/8643010:12
*** matsuhas_ has joined #openstack-swift10:14
openstackgerritA change was merged to openstack/python-swiftclient: Don't utf8 encode urls.  https://review.openstack.org/9010810:16
*** matsuhas_ has quit IRC10:30
*** shakamunyi has joined #openstack-swift10:41
*** matsuhashi has joined #openstack-swift10:42
*** matsuhashi has quit IRC10:43
openstackgerritA change was merged to openstack/swift: Fix error log of proxy-server when cache middleware is disabled  https://review.openstack.org/8948810:43
*** waterkinfe has joined #openstack-swift10:44
portanteFolks, why are we accepting code changes without unit tests?  See: https://review.openstack.org/8948810:45
*** shakamunyi has quit IRC10:46
portanteIt seems that folks have been concerned in the past about the stability of the code base, so why would we not want to have unit tests for code changes to help us avoid such problems?10:46
portanteIn the above case, this is in the logging code, which is pretty fundamental10:47
*** jamie_h has joined #openstack-swift10:48
*** Honghui_ has quit IRC10:54
*** nosnos_ has quit IRC11:03
*** mkollaro has joined #openstack-swift11:14
*** sasi has joined #openstack-swift11:17
*** nacim has quit IRC11:19
*** sasi has quit IRC11:19
openstackgerritOpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925011:23
openstackgerritOpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements  https://review.openstack.org/8873611:24
*** cheri has quit IRC11:26
*** psharma has quit IRC11:31
*** shakamunyi has joined #openstack-swift11:42
*** shakamunyi has quit IRC11:47
*** dmorita has quit IRC12:02
openstackgerritChristian Schwede proposed a change to openstack/python-swiftclient: Mock auth_end_time in test_shell.test_download  https://review.openstack.org/9002612:11
*** fifieldt has quit IRC12:12
*** Trixboxer has joined #openstack-swift12:13
*** psharma has joined #openstack-swift12:17
acolesportante: hi. fair point, noted12:23
*** shakamunyi has joined #openstack-swift12:43
*** tdasilva has joined #openstack-swift12:45
*** shakamunyi has quit IRC12:48
chmouelportante: +112:54
*** ppai has quit IRC12:58
*** nacim has joined #openstack-swift13:00
openstackgerritChmouel Boudjnah proposed a change to openstack/python-swiftclient: Only encode metadata for user customed headers  https://review.openstack.org/8835113:03
*** mmcardle has quit IRC13:03
*** mmcardle has joined #openstack-swift13:03
*** mmcardle has quit IRC13:07
*** mmcardle has joined #openstack-swift13:19
*** psharma has quit IRC13:23
*** nshaikh has quit IRC13:23
*** mkerrin has quit IRC13:28
*** waterkinfe has quit IRC13:28
openstackgerritPeter Portante proposed a change to openstack/swift: In-process swift server for functional tests  https://review.openstack.org/6610813:39
portantetdasilva: I believe the above should fix what you are seeing, thanks for catching that13:40
portantecreiht: ^^^13:40
tdasilvaportante: yw, will check again13:41
portantethanks13:41
*** shakamunyi has joined #openstack-swift13:44
*** shakamunyi has quit IRC13:48
tdasilvaportante: now it's not running any tests :P13:49
tdasilvaportante: fyi: i started by "unsetting" the env. variable13:49
tdasilvaand running just tox -e func13:50
portantehmmm13:55
portantetdasilva: I think I see why14:00
portantesec14:00
tdasilvaif i set SWIFT_TEST_IN_PROCESS=true it works14:00
tdasilvasetting to false, it does not run any tests14:00
portanteDo you have an /etc/swift/test.conf file?14:01
portantetdasilva: ^^^14:02
tdasilvaportante: yes\14:05
openstackgerritPeter Portante proposed a change to openstack/swift: In-process swift server for functional tests  https://review.openstack.org/6610814:07
portantetdasilva: okay, try that in your environment14:07
portanteI think I have the logic right now14:07
*** pconstantine_ has joined #openstack-swift14:07
tdasilvaone sec14:08
openstackgerritAlistair Coles proposed a change to openstack/swift: Unit test for common.utils.cache_from_env  https://review.openstack.org/9038014:12
tdasilvaportante: all good now14:13
*** chandan_kumar has quit IRC14:13
portantegreat, thanks14:14
tdasilvaportante: just fyi; also tested removing test.conf now, and it worked as expected14:17
creihtanticw: not sure, but maybe you could ask the infra people about it?  Sorry, I don't have any experience with the tempest stuff14:19
creihtrussell_h: Not that I know of14:21
creihtportante: ok will try to take a look14:21
portantethanks14:21
*** Longgeek_ has joined #openstack-swift14:23
*** shakamunyi has joined #openstack-swift14:27
*** ccorrigan has joined #openstack-swift14:31
*** mjfork has joined #openstack-swift14:35
mjforkIs it possible to get swift CLI to print out the transaction ID?14:35
creihtmjfork: yes14:39
*** Longgeek_ has quit IRC14:39
creihtwell let me check14:39
creihtsupport to get extended info was added to the library but not the command line it seems14:40
creihtI think it will show all the headers if you run in verbose mode14:40
creihtif you are just debugging14:40
mjforkcreiht: i tried --verbose but nothing new appears on CLI14:43
creihtmjfork: --debug14:44
creihtsorry14:44
creihtYou will see a HEADERS: log14:45
creihtand look for the x-trans-id header14:45
*** shakamunyi has quit IRC14:46
*** shakamunyi has joined #openstack-swift15:00
*** zhiyan_ is now known as zhiyan15:05
*** foexle_ has quit IRC15:06
*** zhiyan is now known as zhiyan_15:07
*** kevinc_ has joined #openstack-swift15:08
openstackgerritLuis de Bethencourt proposed a change to openstack/swift: Sort the log file dates in reverse order  https://review.openstack.org/9010315:15
*** gyee has joined #openstack-swift15:17
*** omame has quit IRC15:36
*** praveenkumar has quit IRC15:39
*** bach has joined #openstack-swift15:40
*** bach has quit IRC15:41
*** bach has joined #openstack-swift15:41
openstackgerritClay Gerrard proposed a change to openstack/swift: Container Reconciler  https://review.openstack.org/9001915:42
*** physcx has quit IRC15:42
*** omame has joined #openstack-swift15:46
mjforklooking for help with transaction IDs in swift - specifically the signifigance of what follows the -?15:47
portantemjfork: so you are looking at the log files and what to know what they mean?15:48
creihtmjfork: the timestamp is stored after the -15:48
creihtin hex I think15:49
portanteand a dash ("-") just means a value for a field was not present15:49
*** Honghui has joined #openstack-swift15:50
creihtportante: I think he's asking about the txid15:51
portanteah, in a txid you mean15:51
creihtportante: aren't you supposed to be on vacation? :)15:51
*** bach has quit IRC15:53
mjforkportante: creiht: so looking at txd313bbe8ce1345ddb4c2f-00535a807515:53
mjforkwhat is after the - is just the timestamp?15:53
mjforkthis is client side header output15:53
creihtyes15:53
creihttimestamp when the request happened15:54
creihtin hex15:54
portantetime.time() formated as %010x15:54
portanteso the floating point timestamp as a hex value15:54
creihtmjfork: https://gist.github.com/creiht/1088466815:54
creihtThat way when a customer hands us a random txid we can figure out when it occured so that we can track down the log15:55
*** bach has joined #openstack-swift15:55
creihtthat gist also assumes that you are logging in UTC15:55
mjforkmakes sense15:55
creihtor your systems are UTC15:55
portantethe timestamp is from the time of the call the catch_errors gets the request15:55
portantebut it is not the exact same timestamp as a PUT-Timestamp or X-Timestamp15:55
portanteunfortunately15:55
anticwcreiht: when/if you hack on things, do you go beyond the tests in the main swift repo?15:56
creihtportante: yeah it is just there to help track down the request in the logs15:56
creihtanticw: not usually15:56
creihtwe do have our own set of tests15:56
*** mwstorer has joined #openstack-swift15:57
creihtthat may or may not be in process of adding to tempest15:57
creihtI haven't checked on that in a while15:57
portantecreiht: it would be nice if we reduced the number of times time.time() is called in the code so that it becomes a bit easier to correlate behaviors15:57
creihtportante: sure15:58
* portante heads out, away from the keyboard, for the day 15:59
creihthehe15:59
*** zhiyan_ is now known as zhiyan16:08
*** Honghui has quit IRC16:12
*** zhiyan is now known as zhiyan_16:14
*** chandan_kumar has joined #openstack-swift16:15
*** bill_az has joined #openstack-swift16:20
*** nacim has quit IRC16:21
*** kevinc_ has quit IRC16:25
*** kevinc_ has joined #openstack-swift16:28
*** bach has quit IRC16:32
*** bach has joined #openstack-swift16:32
*** mkerrin has joined #openstack-swift16:48
*** mmcardle has quit IRC16:48
*** chandan_kumar has quit IRC16:54
*** bach has quit IRC16:56
*** igor has joined #openstack-swift16:59
*** igor__ has quit IRC17:00
*** bada has quit IRC17:02
*** mkollaro has quit IRC17:02
*** Dharmit has quit IRC17:07
*** jamie_h has quit IRC17:07
*** openstackstatus has quit IRC17:07
*** openstackstatus has joined #openstack-swift17:09
*** acoles is now known as acoles_away17:11
*** joeljwright has joined #openstack-swift17:19
*** shri has joined #openstack-swift17:19
*** mmcardle has joined #openstack-swift17:24
*** Trixboxer has quit IRC17:24
*** Trixboxer has joined #openstack-swift17:24
*** russellb is now known as rustlebee17:28
*** joeljwright has quit IRC17:28
*** shri has quit IRC17:29
*** rcleere has joined #openstack-swift17:49
*** zaitcev has joined #openstack-swift17:55
*** ChanServ sets mode: +v zaitcev17:55
*** kevinc_ has quit IRC17:58
*** bach has joined #openstack-swift18:06
*** kevinc_ has joined #openstack-swift18:08
*** bach has quit IRC18:12
*** bach has joined #openstack-swift18:15
*** joeljwright has joined #openstack-swift18:23
openstackgerritAlex Gaynor proposed a change to openstack/python-swiftclient: Removed a duplicate word in a dostring  https://review.openstack.org/9044018:26
*** rcleere has quit IRC18:26
*** joeljwright has quit IRC18:31
luisbgAlex_Gaynor, :)18:46
*** rcleere has joined #openstack-swift18:55
*** rcleere has quit IRC18:57
*** rcleere has joined #openstack-swift18:57
*** bvandenh has quit IRC19:04
*** mmcardle has quit IRC19:10
*** joeljwright has joined #openstack-swift19:28
*** joeljwright has quit IRC19:33
*** igor has quit IRC19:36
*** shri has joined #openstack-swift19:45
*** shakamunyi has quit IRC19:50
mjforkin an environment with a lot of small, short transactions (i.e. small reads / writes) is there a recommendation on # of proxy servers per request per second?19:59
creihtLast time I did benchmarking, you could get around 2000 put/sec on a properly tuned proxy20:05
creihtwith 4 storage nodes behind it20:05
creihtfor very small objects20:06
creihtmjfork: how much do you need?20:06
mjforkok, 2000 is plenty :-)20:09
*** kevinc_ has quit IRC20:10
mjforkwhat about a mix of put / delete / update / read - same roughly 200020:10
creihtdeletes will be a similar order of magnitude as puts20:11
creihtgets are usually 2-4x puts20:11
creihtthat was also a while ago20:12
creihtbut you should be able to get >1000/s pretty easily20:12
creihtalso depends on things like tuning, networking, etc20:12
mjforkcreiht: thank you, this helps.20:13
mjforkis there any good docs to "properly tune"?20:13
creihtwell there's http://docs.openstack.org/developer/swift/deployment_guide.html20:14
creihtbut a lot of it is set things up20:14
creihtrun benchmarks20:14
creihtsee where the bottleneck is20:14
creihtchange settings20:15
creihtrinse and repeat20:15
creihtmostly making sure you have the right number of workers20:15
creihtthat you aren't maxing out on cpu20:15
creihtnetwork bandwidth20:15
creihtetc20:15
mjforkcreiht: thanks for the link, this helps.20:16
creihtnp20:17
*** bach has quit IRC20:17
creihtyou will also likely have to tune the os as well20:17
*** joeljwright has joined #openstack-swift20:20
*** joeljwright has quit IRC20:24
*** igor has joined #openstack-swift20:30
*** igor has quit IRC20:34
*** openstackstatus has quit IRC20:45
*** openstackstatus has joined #openstack-swift20:47
*** openstackstatus has quit IRC20:50
*** openstackstatus has joined #openstack-swift20:52
*** kevinc_ has joined #openstack-swift20:55
*** ChanServ sets mode: +v openstackstatus20:56
-openstackstatus- NOTICE: Gerrit will be unavailable for a few hours starting at 1600 UTC on Monday April 28th for an upgrade. See https://wiki.openstack.org/wiki/GerritUpgrade20:59
*** bach has joined #openstack-swift21:08
*** bach has quit IRC21:08
*** pberis has quit IRC21:25
*** igor has joined #openstack-swift21:30
*** igor has quit IRC21:35
*** kevinc_ has quit IRC21:39
*** kevinc_ has joined #openstack-swift21:40
*** joeljwright has joined #openstack-swift21:42
*** joeljwright has quit IRC21:42
*** rcleere has quit IRC21:43
*** bach has joined #openstack-swift21:53
*** Trixboxer has quit IRC22:10
openstackgerritA change was merged to openstack/python-swiftclient: Removed a duplicate word in a dostring  https://review.openstack.org/9044022:24
*** igor_ has joined #openstack-swift22:30
openstackgerritPete Zaitcev proposed a change to openstack/swift: Plumb insecure flag to functests  https://review.openstack.org/8843822:32
*** igor_ has quit IRC22:34
Madkissso22:36
Madkisshttps://github.com/stackforge/puppet-swift/ -- this one ... I don't see any code in it that would add newly created devices to the rings?22:36
zaitcevMadkiss: ask cwolferh22:53
*** kevinc_ has quit IRC22:53
*** kevinc_ has joined #openstack-swift22:58
*** bach has quit IRC23:06
*** bach has joined #openstack-swift23:13
*** bach has quit IRC23:23
*** kevinc_ has quit IRC23:25
*** igor has joined #openstack-swift23:30
*** igor has quit IRC23:35
*** shakamunyi has joined #openstack-swift23:55
*** kevinc_ has joined #openstack-swift23:56
Madkisszaitcev: is he here from time to time? :)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!