Monday, 2017-07-17

*** frank_young has joined #openstack-swift00:20
*** frank_young has quit IRC00:24
*** tovin07_ has joined #openstack-swift00:33
*** kiennt has joined #openstack-swift00:35
*** frank_young has joined #openstack-swift01:33
*** frank_young has quit IRC01:36
*** frank_young has joined #openstack-swift01:36
*** itlinux_ has quit IRC02:00
*** tovin07__ has joined #openstack-swift02:04
*** tovin07_ has quit IRC02:06
*** kiennt has quit IRC02:07
*** itlinux has joined #openstack-swift02:10
*** OrionX has joined #openstack-swift02:25
*** OrionX has quit IRC02:39
mattoliverauMorning02:39
openstackgerritTovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift  https://review.openstack.org/46831602:40
*** OrionX has joined #openstack-swift02:49
*** RayLei has joined #openstack-swift03:05
*** RayLei has quit IRC03:05
*** OrionX has quit IRC03:06
*** tovin07 has joined #openstack-swift03:11
*** tovin07__ has quit IRC03:13
*** kiennt has joined #openstack-swift03:18
*** Sukhdev has quit IRC03:20
*** itlinux has quit IRC03:23
*** itlinux has joined #openstack-swift03:30
*** RayLei has joined #openstack-swift03:32
*** gkadam has joined #openstack-swift03:39
mahaticgood morning03:40
mahaticmattoliverau: o/03:40
*** links has joined #openstack-swift03:44
*** kiennt has quit IRC03:52
*** kiennt has joined #openstack-swift03:59
*** klrmn has quit IRC04:00
*** ChubYann has quit IRC04:04
*** hoonetorg has quit IRC04:05
RayLeiSwauth how to get token from memcached? I do `memcached-tool 127.0.0.1: 11211 dump` seems not to see my token, but can be seen using temauth04:11
RayLeigood morning04:12
*** ChubYann has joined #openstack-swift04:17
*** psachin has joined #openstack-swift04:18
*** Dinesh_Bhor has joined #openstack-swift04:46
*** Sukhdev has joined #openstack-swift04:48
*** frank_young has quit IRC05:03
*** frank_young has joined #openstack-swift05:03
*** OrionX has joined #openstack-swift05:06
*** tonanhngo has quit IRC05:10
*** OrionX has quit IRC05:10
*** tonanhngo has joined #openstack-swift05:16
*** frank_young has quit IRC05:18
*** frank_young has joined #openstack-swift05:28
*** tonanhngo has quit IRC05:30
*** frank_young has quit IRC05:33
*** cshastri has joined #openstack-swift05:37
*** frank_young has joined #openstack-swift05:43
*** kiennt has quit IRC05:45
*** winggundamth has joined #openstack-swift05:53
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48425405:54
openstackgerritClay Gerrard proposed openstack/swift master: Add multiple worker processes strategy to reconstructor  https://review.openstack.org/47841605:54
*** rcernin_ has joined #openstack-swift06:00
*** kiennt has joined #openstack-swift06:03
openstackgerritClay Gerrard proposed openstack/swift master: Add multiple worker processes strategy to reconstructor  https://review.openstack.org/47841606:07
*** kiennt_ has joined #openstack-swift06:17
*** kiennt has quit IRC06:17
*** SkyRocknRoll has joined #openstack-swift06:22
*** cschwede_ has joined #openstack-swift06:23
*** ChubYann has quit IRC06:24
*** Sukhdev has quit IRC06:50
*** itlinux has quit IRC06:59
*** itlinux has joined #openstack-swift07:00
*** tonanhngo has joined #openstack-swift07:02
*** tonanhngo has quit IRC07:03
*** itlinux has quit IRC07:08
*** dhellmann has quit IRC07:16
*** dhellmann has joined #openstack-swift07:17
*** geaaru has joined #openstack-swift07:30
*** oshritf has joined #openstack-swift07:30
*** tesseract has joined #openstack-swift07:32
*** cbartz has joined #openstack-swift07:36
acolesgood morning07:49
acoleskota_: cschwede_ if you have chance to review patch 477000 I would really appreciate your feedback07:53
patchbothttps://review.openstack.org/#/c/477000/ - swift - Ring rebalance respects co-builders' last_part_moves07:53
*** cbartz has quit IRC07:54
acolesI'm looking at patch 478416 today08:03
patchbothttps://review.openstack.org/#/c/478416/ - swift - Add multiple worker processes strategy to reconstr...08:03
cschwede_acoles: alright, will review it today08:22
acolescschwede_: thanks08:27
*** tesseract has quit IRC08:50
*** tesseract has joined #openstack-swift08:53
*** oshritf has quit IRC08:56
kiennt_cschwede_: Hi, i want to ask about multinode gate job for rolling upgrade. I asked in channel last week and they said I should ask you.09:00
kiennt_Thank you09:00
cschwede_kiennt_: Hi! how can i help?09:05
kiennt_cschwede_: hi, i am working on Heat rolling upgrade and Heat core team asked me setup multinode gate job for rolling-upgrade testing.09:06
kiennt_Could you help me to find how to setup it? Because Swift already has assert:support-rolling-upgrade09:08
kiennt_How Swift setup multinode gate?09:08
cschwede_kiennt_: I'm not sure about the criteria for that flag. Swift rolling upgrades are not tested yet in the gate, but Swift supports that since the beginning (afaict)09:11
cschwede_kiennt_: I proposed a patch for the gate sometime ago: https://review.openstack.org/#/c/304465/09:11
patchbotpatch 304465 - openstack-infra/devstack-gate - Use subnodes for Swift storage nodes in a multinod...09:11
cschwede_kiennt_: but there was not that much feedback, so i stopped working on that09:12
kiennt_cschwede_: Oh I see, thanks for your help (and your patch too). Very helpful info :0-09:15
kiennt_:)09:15
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48425409:22
openstackgerritjunbo.li proposed openstack/swift master: Docs migration from openstack-manuals  https://review.openstack.org/48418209:33
*** oshritf has joined #openstack-swift09:46
*** tovin07 has quit IRC09:52
*** cbartz has joined #openstack-swift10:08
*** jistr is now known as jistr|afk10:09
*** d0ugal has joined #openstack-swift10:13
*** d0ugal has quit IRC10:19
*** mvk has quit IRC10:33
*** kiennt_ has quit IRC10:37
*** logan- has left #openstack-swift10:53
*** frank_young has quit IRC10:58
*** mvk has joined #openstack-swift11:00
*** tonanhngo has joined #openstack-swift11:04
*** tonanhngo has quit IRC11:05
*** frank_young has joined #openstack-swift11:08
*** frank_young has quit IRC11:13
*** frank_young has joined #openstack-swift11:24
*** hoonetorg has joined #openstack-swift11:32
*** logan- has joined #openstack-swift11:40
*** Guest7927 has joined #openstack-swift11:43
Guest7927Hi11:43
Guest7927Is there any other caching service Swift uses, except for memcached?11:45
*** logan- has left #openstack-swift12:00
*** OrionX has joined #openstack-swift12:07
*** OrionX has quit IRC12:12
*** jistr|afk is now known as jistr12:17
*** MVenesio has joined #openstack-swift12:28
RayLeiSwauth how to get token from memcached? I do `memcached-tool 127.0.0.1: 11211 dump` seems not to see my token, but can be seen using temauth12:33
cbartzHave you already used your token in a request? It gets stored the first time used.12:37
RayLeiYes, and how long will it last in memcache? How can I see it?12:39
RayLeiI know that if the first time to do the authentication user's request, it will only store the token inside the cluster, with token to request the cluster when the resource will be stored in memcache token, but I did not find it12:42
cbartzTime of the token. If not set explicitly, its 86400 seconds12:42
RayLeiBut I have never seen it in a  token_life time12:43
RayLeiwith `memcached-tool localhost:11211 dump` or swift.common.memcached.MemcacheRing('127.0.0.1:11211').get('AUTH_/user/myaccount:myuser') ,do not see the token12:46
cbartzmemcache_key should be:  '%s/auth/%s' % (self.reseller_prefix, token)12:48
RayLeiyou can see here12:50
RayLei swift auth export OS_STORAGE_URL=http://192.168.2.133:8080/v1/AUTH_71743be6-f7e8-408e-97e8-5e85d139f639 export OS_AUTH_TOKEN=AUTH_tk1ef0e8d499724897b957e77379133aaf12:50
*** catintheroof has joined #openstack-swift12:51
RayLei swift auth; export OS_STORAGE_URL=http://192.168.2.133:8080/v1/AUTH_71743be6-f7e8-408e-97e8-5e85d139f639 ;export OS_AUTH_TOKEN=AUTH_tk1ef0e8d499724897b957e77379133aaf12:51
RayLei>>> print mem.get('AUTH_/token/AUTH_tk1ef0e8d499724897b957e77379133aaf')12:51
RayLeiThe result is NONE12:52
cbartzTry: print mem.get('AUTH_/auth/AUTH_tk1ef0e8d499724897b957e77379133aaf')12:54
RayLei>>> print mem.get('AUTH_/auth/AUTH_tk1ef0e8d499724897b957e77379133aaf')12:57
RayLei[1500344226, u'test:tester,test,AUTH_71743be6-f7e8-408e-97e8-5e85d139f639']12:57
RayLeicool12:58
cbartzYeah. You see. You used the wrong memcache key, the one tempauth uses12:58
RayLeiVery strange, has not been before, I also used the correct key, now have, interesting12:59
RayLeiIn short, thank you for your reply13:03
cbartzYour welcome.13:05
*** honga has quit IRC13:06
*** RayLei has quit IRC13:20
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48437113:25
*** gkadam has quit IRC13:26
*** SkyRocknRoll has quit IRC13:27
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48437113:30
openstackgerritjunbo.li proposed openstack/swift master: [Api-ref] fix response status  https://review.openstack.org/48437113:32
*** klamath has joined #openstack-swift13:36
*** links has quit IRC13:37
*** frank_young has quit IRC13:38
openstackgerritAlistair Coles proposed openstack/swift master: Make dict deletion idempotent in dump_recon_cache  https://review.openstack.org/48437513:40
*** klamath has quit IRC13:58
*** klamath has joined #openstack-swift13:58
*** tonanhngo has joined #openstack-swift14:01
*** tonanhngo has quit IRC14:02
*** chlong has joined #openstack-swift14:05
*** lucasxu has joined #openstack-swift14:06
*** winggundamth has quit IRC14:08
*** oshritf has quit IRC14:09
*** chlong has quit IRC14:10
*** gyee has joined #openstack-swift14:37
*** cshastri has quit IRC14:41
*** psachin has quit IRC14:48
*** oshritf has joined #openstack-swift14:48
*** klrmn has joined #openstack-swift14:50
*** lucasxu has quit IRC15:00
*** gyee has quit IRC15:06
*** OrionX has joined #openstack-swift15:06
*** gyee has joined #openstack-swift15:08
*** lucasxu has joined #openstack-swift15:27
*** oshritf has quit IRC15:30
*** chlong has joined #openstack-swift15:36
*** chlong has quit IRC15:38
*** MVenesio has quit IRC15:42
*** chlong has joined #openstack-swift15:45
*** hoonetorg has quit IRC15:57
*** cbartz has quit IRC16:08
*** klrmn has quit IRC16:11
*** rcernin_ has quit IRC16:19
*** JimCheung has joined #openstack-swift16:30
*** hoonetorg has joined #openstack-swift16:40
*** spotz has quit IRC16:42
*** nadeem has quit IRC16:43
*** nadeem has joined #openstack-swift16:43
*** spotz has joined #openstack-swift16:45
*** ChubYann has joined #openstack-swift16:47
openstackgerritTim Burke proposed openstack/swift master: Remove unnecessary exception handling  https://review.openstack.org/48442816:54
*** hoonetorg has quit IRC16:54
*** frank_young has joined #openstack-swift16:59
*** hoonetorg has joined #openstack-swift17:03
*** chlong has quit IRC17:03
*** frank_young has quit IRC17:04
*** mvk has quit IRC17:06
*** klrmn has joined #openstack-swift17:08
*** mattoliverau has quit IRC17:11
*** chlong has joined #openstack-swift17:19
*** mattoliverau has joined #openstack-swift17:19
*** ChanServ sets mode: +v mattoliverau17:19
*** tonanhngo has joined #openstack-swift17:28
*** tonanhngo has quit IRC17:32
*** hoonetorg has quit IRC17:34
*** mvk has joined #openstack-swift17:37
*** frank_young has joined #openstack-swift17:37
*** tonanhngo has joined #openstack-swift17:38
*** MVenesio has joined #openstack-swift17:39
*** frank_young has quit IRC17:42
*** SkyRocknRoll has joined #openstack-swift17:53
*** hoonetorg has joined #openstack-swift17:54
*** hoonetorg has quit IRC17:59
*** tesseract has quit IRC18:01
*** geaaru has quit IRC18:21
*** Sukhdev has joined #openstack-swift18:24
*** rcernin has joined #openstack-swift18:26
openstackgerritAlistair Coles proposed openstack/swift master: Avoid deleting new per disk reconstructor stats when aggregating  https://review.openstack.org/48444818:34
notmynamegood morning18:35
*** JimCheung has quit IRC18:45
*** JimCheung has joined #openstack-swift18:45
*** Guest7927 has quit IRC18:52
*** SkyRocknRoll has quit IRC19:02
openstackgerritTim Burke proposed openstack/swift master: Remove unnecessary exception handling  https://review.openstack.org/48442819:05
*** frank_young has joined #openstack-swift19:06
*** Nathaniel has joined #openstack-swift19:07
*** Nathaniel is now known as Guest9004219:07
Guest90042Why swift use memcached?19:07
*** klamath has quit IRC19:07
*** klamath has joined #openstack-swift19:08
*** klamath has quit IRC19:09
*** klamath has joined #openstack-swift19:09
*** frank_young has quit IRC19:11
*** JimCheung has quit IRC19:12
*** JimCheung has joined #openstack-swift19:12
claygacoles: so i have this bug -> https://bugs.launchpad.net/swift/+bug/170485819:28
openstackLaunchpad bug 1704858 in OpenStack Object Storage (swift) "auditor recon dump is not consistent on new nodes" [Low,New]19:28
claygbut your fix doesn't really close that bug - since all it does is just make the key not ever show up19:28
claygwhich is a useful behavior for the related change - but it means your "fix" isn't any more "obvious"19:28
claygin this case the question is "*why* are we deleting these keys" in my change the reason *why* is obvious; leaving only the question of "why is the *interface* for deleting keys so bloody strange?"19:31
*** OrionX has quit IRC19:31
claygand the answer is, it doesn't need be, the interface is just wrong - and fixing the interface (while not fixing the answering the issue in the auditor) won't make anything wrose!19:31
*** JimCheung has quit IRC19:33
*** JimCheung has joined #openstack-swift19:33
openstackgerritAlistair Coles proposed openstack/swift master: Make dict deletion idempotent in dump_recon_cache  https://review.openstack.org/48437519:37
acolesclayg: ok ^^ I tried to make the commit message explain why i wasn't fixing the bug per se, because the intent is to fix the utils helper, not to fix weird auditor behavior.19:38
*** JimCheung has quit IRC19:38
*** Guest90042 has quit IRC19:40
*** JimCheung has joined #openstack-swift19:45
*** frank_young has joined #openstack-swift19:46
claygso this is the patch 48444819:46
patchbothttps://review.openstack.org/#/c/484448/ - swift - Avoid deleting new per disk reconstructor stats wh...19:46
acolesclayg: https://review.openstack.org/#/c/48437519:46
patchbotpatch 484375 - swift - Make dict deletion idempotent in dump_recon_cache19:46
openstackgerritAlistair Coles proposed openstack/swift master: Make dict deletion idempotent in dump_recon_cache  https://review.openstack.org/48437519:47
*** JimCheung has quit IRC19:49
*** frank_young has quit IRC19:50
claygacoles: ok, i have +2'd patch 48437519:52
patchbothttps://review.openstack.org/#/c/484375/ - swift - Make dict deletion idempotent in dump_recon_cache19:52
claygi think it's obviously correct and makes swift slightly (but measurably non-zero) better19:53
claygI'm going to rebase my multi-worker reconstructor work on top of that - and hopefully we can get that fix in w/o too much fuss so I can make use of that interface w/o having to add a bunch of weird work-arounds or unrelated test code19:53
claygcool cool19:53
acolesclayg: +1 I like not having weird test assertions19:54
claygacoles: this patch should be squahed patched 48437519:56
acolesyes19:56
*** aj701 has quit IRC19:59
*** JimCheung has joined #openstack-swift20:01
*** aj701 has joined #openstack-swift20:04
*** JimCheung has quit IRC20:05
*** cschwede_ has quit IRC20:15
*** OrionX has joined #openstack-swift20:16
*** chlong has quit IRC20:27
*** chlong has joined #openstack-swift20:32
*** vint_bra has joined #openstack-swift20:54
*** JimCheung has joined #openstack-swift20:56
*** lucasxu has quit IRC21:01
*** MVenesio has quit IRC21:12
*** Sukhdev has quit IRC21:26
*** chlong has quit IRC21:26
*** logan- has joined #openstack-swift21:32
*** JimCheung has quit IRC21:32
tdasilvazaitcev: do you remember what cause this error: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/%23openstack-swift.2017-05-22.log.html#t2017-05-22T21:02:3221:33
*** logan- has left #openstack-swift21:33
*** rcernin has quit IRC21:33
openstackgerritMerged openstack/swift master: Fix redundant UTF-8 check  https://review.openstack.org/48410721:34
zaitcevtdasilva: in my case it was caused by building the stock 1.4.0 at an Intel CPU, and then trying to run the resulting RPM on an AMD CPU.21:34
zaitcevtdasilva: IIRC we merged a fix for that upstream.21:35
tdasilvaok21:35
zaitcevActually, we merged 221:35
tdasilvazaitcev: vint_bra is running into this issue21:35
tdasilvazaitcev: and that was released in 1.5.0?21:35
timburkehttps://github.com/openstack/liberasurecode/commit/960cdd0 and https://github.com/openstack/liberasurecode/commit/096214421:36
zaitcevFix #1 is to stop using <math.h>. As long as you aren't using floating point, gcc isn't over-optimizing and then we're good21:36
zaitcevFix #2 is to allow RPM to override CPU detection and force gcc to build a portable code (which is slower, yes).21:36
zaitcevtdasilva: IIRC released in 1.5.021:37
tdasilvavint_bra: sounds like the ideal would be for you guys to upgrade to 1.5.021:38
*** caiobrentano has joined #openstack-swift21:42
*** frank_young has joined #openstack-swift21:44
*** JimCheung has joined #openstack-swift21:48
*** frank_young has quit IRC21:48
vint_bratdasilva: Great! It works! :)21:50
tdasilvavint_bra: did you upgrade both to 1.5?21:50
vint_brayes21:51
tdasilvavint_bra: nice!21:51
vint_bratdasilva: Thanks for everything!21:52
vint_brazaitcev: Thanks my friend21:52
*** itlinux_ has joined #openstack-swift21:52
tdasilvavint_bra:  :)21:53
*** caiobrentano has quit IRC21:55
*** caiobrentano has joined #openstack-swift21:56
*** JimCheung has joined #openstack-swift21:59
*** caiobrentano has quit IRC22:01
*** OrionX_ has joined #openstack-swift22:10
*** vint_bra has quit IRC22:13
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873622:13
*** OrionX has quit IRC22:14
*** OrionX_ has quit IRC22:14
*** tonanhngo has quit IRC22:20
*** tonanhngo has joined #openstack-swift22:22
*** tonanhngo_ has joined #openstack-swift22:26
*** tonanhngo has quit IRC22:26
*** tonanhngo_ has quit IRC22:30
*** Nathaniel has joined #openstack-swift22:31
NathanielCan I use Swift without memcached?22:31
*** Nathaniel is now known as Guest804122:31
notmynameprobably (depending on the auth system you're using), but it's not recommended22:32
claygNathaniel it depends on the auth system, but generally yet, only you don't want to because of info checks22:32
claygtimburke: thanks for looking at patch 48437522:34
patchbothttps://review.openstack.org/#/c/484375/ - swift - Make dict deletion idempotent in dump_recon_cache22:34
claygthat has got to be the quickest turn around on a cleanup fix up ever!22:34
Guest8041If so, is there any other auth system that does not use memcached provided by swift?22:35
notmynameGuest8041: I don't want to out-of-hand tell you "just use memcache", but may I ask why using or not is such a big question?22:36
notmynamebeyond auth, as clayg said, memcache is very important for caching account and container stats. it vastly improves the speed of all requests in the cluster22:37
claygit's required - just run it22:37
Guest8041but memcached causes data duplication between main memory and storage memory.22:38
Guest8041I'm considering to use swift with non-volatile-memory22:38
Guest8041so I just wonder that22:38
Guest8041thank you for answer :)22:40
claygnone of the object data is kept in memcache22:41
claygit's just for stuff like auth tokens, or the account/container stats tables22:41
claygthe auth token would have to be durable in a auth-database db somewhere (but they probably will need to cache it if you're asking about it every request)22:41
*** itlinux_ has quit IRC22:42
Guest8041There was a part that I misunderstood. thank you.22:42
claygthe account/container stats tables are durable on disk - but it can be annoying to keep them in the page cache on all the nodes all the time for the entire working set of containers - normally better to warm it up in the memory in the proxy tier - but YMMV22:43
Guest8041oh.. I see22:43
* clayg shrugs22:43
*** Guest8041 has quit IRC22:56
notmynamedoh! he left22:57
notmynameI was going to suggest that if he's got nvram available, using something like Intel's CAS on the object server can provide some nice performance benefit22:58
*** JimCheung has quit IRC22:59
*** JimCheung has joined #openstack-swift23:00
*** OrionX has joined #openstack-swift23:00
*** frank_young has joined #openstack-swift23:03
*** OrionX has quit IRC23:04
*** catintheroof has quit IRC23:07
*** frank_young has quit IRC23:07
*** chlong has joined #openstack-swift23:24
*** kei_yama has joined #openstack-swift23:26
*** kei_yama has quit IRC23:48
*** kei_yama has joined #openstack-swift23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!