Friday, 2017-04-28

*** mannamne has joined #openstack-telemetry00:00
*** mannamne has quit IRC00:02
*** lamt has joined #openstack-telemetry00:08
*** vint_bra has joined #openstack-telemetry00:28
*** g3ek has quit IRC00:37
*** g3ek has joined #openstack-telemetry00:46
*** jmlowe has joined #openstack-telemetry00:49
*** donghao has joined #openstack-telemetry00:51
*** donghao has quit IRC00:55
*** vint_bra has quit IRC00:58
*** dixiaoli has joined #openstack-telemetry01:00
*** liusheng has quit IRC01:03
*** vint_bra has joined #openstack-telemetry01:12
*** hoonetorg has quit IRC01:15
*** hoonetorg has joined #openstack-telemetry01:20
*** liusheng has joined #openstack-telemetry01:20
*** rbak has joined #openstack-telemetry01:26
*** zhangguoqing has joined #openstack-telemetry01:30
*** vint_bra has quit IRC01:35
*** lhx_ has joined #openstack-telemetry01:45
*** youzp has joined #openstack-telemetry01:57
*** zhurong has joined #openstack-telemetry02:05
*** rbak has quit IRC02:09
*** rbak has joined #openstack-telemetry02:12
*** dave-mccowan has quit IRC02:27
*** rbak has quit IRC02:30
*** rbak has joined #openstack-telemetry02:31
*** rbak has quit IRC02:35
*** thorst has quit IRC02:36
*** donghao has joined #openstack-telemetry02:53
*** donghao has quit IRC02:57
*** hoonetorg has quit IRC02:59
*** thorst has joined #openstack-telemetry03:07
*** thorst has quit IRC03:11
*** hoonetorg has joined #openstack-telemetry03:15
*** vint_bra has joined #openstack-telemetry03:17
*** vint_bra has quit IRC03:37
*** thorst has joined #openstack-telemetry03:38
*** zhurong has quit IRC03:38
*** thorst has quit IRC03:45
*** gkadam has joined #openstack-telemetry03:51
*** ddyer has quit IRC04:01
*** lhx_ has quit IRC04:16
*** Tamayo has joined #openstack-telemetry04:18
openstackgerritzhangguoqing proposed openstack/panko master: Delete unused local variable apache_version in devstack  https://review.openstack.org/46082404:40
*** thorst has joined #openstack-telemetry04:41
*** thorst has quit IRC04:45
*** gkadam__ has joined #openstack-telemetry04:48
*** gkadam has quit IRC04:49
*** gkadam__ is now known as regain04:49
*** regain is now known as gkadam04:49
*** jojden has quit IRC04:50
*** gkadam has quit IRC04:50
*** gkadam has joined #openstack-telemetry04:51
*** zhangguoqing has quit IRC04:53
*** flwang1 has quit IRC04:53
*** zhurong has joined #openstack-telemetry05:01
*** dixiaoli has quit IRC05:06
*** dixiaoli has joined #openstack-telemetry05:11
*** lhx_ has joined #openstack-telemetry05:17
*** lhx_ has quit IRC05:26
*** zhangguoqing has joined #openstack-telemetry05:27
*** lamt has quit IRC05:56
*** zhurong has quit IRC06:04
*** lhx_ has joined #openstack-telemetry06:05
*** zhurong has joined #openstack-telemetry06:12
*** yprokule has joined #openstack-telemetry06:21
*** zhurong has quit IRC06:23
*** dixiaoli has quit IRC06:31
*** dixiaoli has joined #openstack-telemetry06:34
*** pcaruana has joined #openstack-telemetry06:36
*** thorst has joined #openstack-telemetry06:42
*** thorst has quit IRC06:46
*** lhx_ has quit IRC06:49
*** dixiaoli has quit IRC06:53
*** dixiaoli has joined #openstack-telemetry06:54
*** lhx_ has joined #openstack-telemetry06:54
*** donghao has joined #openstack-telemetry06:56
*** shardy has joined #openstack-telemetry06:56
*** donghao has quit IRC07:02
*** tesseract has joined #openstack-telemetry07:05
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: more live verification  https://review.openstack.org/46056807:20
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: fix search by user_id/project_id  https://review.openstack.org/46086007:20
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: rest: Extends metric list filters  https://review.openstack.org/46086107:20
*** g3ek has quit IRC07:38
*** thorst has joined #openstack-telemetry07:43
*** g3ek has joined #openstack-telemetry07:46
openstackgerritMerged openstack/python-gnocchiclient master: Remove repository content and add new URL  https://review.openstack.org/45974607:57
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: more live verification  https://review.openstack.org/46056808:01
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: rest: Extends metric list filters  https://review.openstack.org/46086108:01
*** andreaf has quit IRC08:02
*** thorst has quit IRC08:02
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: more live verification  https://review.openstack.org/46056808:04
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: fix search by user_id/project_id  https://review.openstack.org/46086008:04
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: rest: Extends metric list filters  https://review.openstack.org/46086108:04
*** andreaf has joined #openstack-telemetry08:04
*** donghao has joined #openstack-telemetry08:51
*** donghao has quit IRC08:55
*** mannamne has joined #openstack-telemetry08:56
*** thorst has joined #openstack-telemetry08:59
*** dewanee has joined #openstack-telemetry09:04
*** liusheng has quit IRC09:09
*** liusheng has joined #openstack-telemetry09:09
*** thorst has quit IRC09:10
*** cdent has joined #openstack-telemetry09:14
*** purplerbot has joined #openstack-telemetry09:16
*** dixiaoli has quit IRC09:17
*** mannamne has quit IRC09:22
*** adriant_ has quit IRC09:23
*** flwang1 has joined #openstack-telemetry09:28
*** youzp has quit IRC09:50
*** youzp has joined #openstack-telemetry09:51
*** lhx_ has quit IRC09:53
*** lhx_ has joined #openstack-telemetry09:53
*** youzp has quit IRC09:56
*** tesseract has quit IRC10:04
*** thorst has joined #openstack-telemetry10:07
*** tesseract has joined #openstack-telemetry10:08
*** thorst has quit IRC10:11
*** zhangguoqing has quit IRC10:31
*** zhangguoqing has joined #openstack-telemetry10:31
*** zhangguoqing has quit IRC10:43
*** youzp has joined #openstack-telemetry10:46
*** youzp has quit IRC10:48
*** youzp has joined #openstack-telemetry10:48
*** youzp has quit IRC10:48
*** donghao has joined #openstack-telemetry10:52
*** donghao has quit IRC10:56
*** cdent has quit IRC10:58
*** zhangguoqing has joined #openstack-telemetry11:08
*** shardy is now known as shardy_lunch11:22
*** gkadam has quit IRC11:29
*** cdent has joined #openstack-telemetry11:35
*** thorst has joined #openstack-telemetry11:44
*** gordc has joined #openstack-telemetry11:49
*** tesseract has quit IRC11:50
*** shardy_lunch is now known as shardy11:55
*** dave-mccowan has joined #openstack-telemetry11:56
openstackgerritgordon chung proposed openstack/gnocchi master: test why gate fails  https://review.openstack.org/45641311:57
*** zhenguo has quit IRC12:02
*** tesseract has joined #openstack-telemetry12:06
*** g3ek has quit IRC12:10
openstackgerritThomas Herve proposed openstack/ceilometer master: Adds a Zaqar publisher  https://review.openstack.org/45972612:13
*** chlong has quit IRC12:21
*** Kevin_Zheng has quit IRC12:27
*** leitan has joined #openstack-telemetry12:27
*** leitan_ has joined #openstack-telemetry12:35
*** leitan has quit IRC12:38
*** leitan has joined #openstack-telemetry12:40
*** leitan_ has quit IRC12:44
openstackgerritMerged openstack/panko master: Delete unused local variable apache_version in devstack  https://review.openstack.org/46082412:48
*** lhx_ has quit IRC12:52
*** donghao has joined #openstack-telemetry12:54
*** leitan_ has joined #openstack-telemetry12:55
*** leitan has quit IRC12:58
*** donghao has quit IRC12:58
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: Remove deprecated oslo.config messages.  https://review.openstack.org/46048612:58
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: fix MultiStrOpt value  https://review.openstack.org/46102212:58
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: simplify tox config  https://review.openstack.org/46102312:58
*** catintheroof has joined #openstack-telemetry13:01
silehtthe aodh gate fix: https://review.openstack.org/#/c/461022/13:01
silehtjd_, gordc ^13:01
jd_amen sileht13:02
gordcsileht: the fix was easier than i thought.lol13:03
*** catintheroof has quit IRC13:04
*** catintheroof has joined #openstack-telemetry13:04
*** lamt has joined #openstack-telemetry13:04
*** lamt has quit IRC13:09
*** jmlowe has quit IRC13:12
silehtjd_, can you check https://github.com/jd/pifpaf/pull/5813:14
*** lamt has joined #openstack-telemetry13:14
silehtjd_, I will drop dsvm job from aodh like Gnocchi13:14
silehtjd_, it's easier to debug locally than with devstack13:15
*** catinthe_ has joined #openstack-telemetry13:18
jd_"we don't use bp in telemetry projects. we talk on irc and mailing list" – f***** rebels13:20
jd_sileht: 200% agree13:21
*** catintheroof has quit IRC13:21
*** zhangguoqing has quit IRC13:34
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: rework functional live tests  https://review.openstack.org/46103313:42
gordcjd_: i typed that while listening to gangster rap.13:46
*** lamt has quit IRC13:49
*** lamt has joined #openstack-telemetry13:50
*** chlong has joined #openstack-telemetry13:52
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: rework functional live tests  https://review.openstack.org/46103313:53
*** jmlowe has joined #openstack-telemetry13:53
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: rework functional live tests  https://review.openstack.org/46103313:57
*** ddyer has joined #openstack-telemetry14:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: rework functional live tests  https://review.openstack.org/46103314:02
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: simplify tox config  https://review.openstack.org/46102314:02
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: storage: Ensure pymysql is prefered  https://review.openstack.org/46104714:02
*** jmlowe has quit IRC14:04
*** jmlowe has joined #openstack-telemetry14:04
*** donghao has joined #openstack-telemetry14:05
*** cdent has quit IRC14:05
*** chlong has quit IRC14:07
*** zhangguoqing has joined #openstack-telemetry14:07
*** rbak has joined #openstack-telemetry14:10
*** chlong has joined #openstack-telemetry14:20
*** vint_bra has joined #openstack-telemetry14:35
*** cdent has joined #openstack-telemetry14:52
*** jmlowe has quit IRC14:58
*** jmlowe has joined #openstack-telemetry14:58
openstackgerritMerged openstack/aodh master: tests: fix MultiStrOpt value  https://review.openstack.org/46102214:58
*** yprokule has quit IRC15:07
bretongordc: hey. We talked yesterday about syncronous events processing and you said that "the notification agent is actually single threaded when it gets to publisher". How does it handle multiple events when they come asynchroniuosly? Multiprocessing?15:16
*** openstackgerrit has quit IRC15:17
gordcbreton: multiple events on the same queue?15:18
bretongordc: i'm not sure. Are compute.instance.create.start and compute.instance.shutdown.start, for example, on the same queue?15:19
gordci'm not sure what oslo.messaging uses. futures lib maybe? basically, a listener (with 64 threads default) pulls each pull a single message from queue and in coordinated mode, normalise message and push to an internal queue based on resource.15:20
gordcyes, they'd be on same queue.15:20
gordcif you're using .create and .shutdown, i imagine your system will always process them sequentially given how space'd out they be15:22
bretonthat's the problem, these events are processed async15:22
breton.shutdown begins to be processed before .create (well, .start actually) is finished15:23
*** openstackgerrit has joined #openstack-telemetry15:24
openstackgerritMerged openstack/aodh master: Remove deprecated oslo.config messages.  https://review.openstack.org/46048615:24
gordc... yeah, i don't know how that'd ever happen. unless you have only one vm and your notification agent is down for the entire lifespan of vm15:24
*** lrensing has joined #openstack-telemetry15:25
gordcyour .shutdown event i would think would be at least be minutes after your .start... the processing should take seconds if not less15:25
bretonwell, for a single vm it's not important15:26
bretonthe problem happens when there are many starts and finishes15:27
gordcbreton: are you not matching .start and .shutdown events by resource?15:28
bretoneach start and finish deduct some money from a project15:28
bretongordc: nope15:28
*** pcaruana has quit IRC15:28
bretoni have a feeling that notifications are pushed to publishers by several threads15:29
bretonlet me check that now...15:29
bretontrying with "logger.info('PID: {}, TID: {}'.format(os.getpid(), threading.get_ident()))"15:32
*** chlong has quit IRC15:34
bretonget_ident is py3 :(15:34
gordcbreton:  this is the single-thread part https://github.com/openstack/ceilometer/blob/master/ceilometer/notification.py#L317-L31915:37
gordcthis is the part that grabs from nova/cinder/etc queues which isn't single threaded https://github.com/openstack/ceilometer/blob/master/ceilometer/notification.py#L257-L26515:38
bretonhttp://paste.openstack.org/show/608345/15:38
breton(and "Processing <...>" is just the first message from processing, after that a lot more is done\)15:40
gordcyou're going to have sequential issues regardless because the whole process always contains either contains multiple threads or multiple queues. you'll need to create your own single threaded listener i think15:40
gordcand in that case, you're going to have some serious scaling issues i'd think.15:41
bretonyes, that's why i don't want that :p15:41
gordcbreton: can you do whatever you need to do post storage. it seems streaming isn't gonig to work for you.15:42
bretonor maybe i could just lock everything with oslo_concurrency and hope for the best :p15:43
bretoni need to lock on project_id, maybe it won't be too bad15:44
gordcuh... good luck with that. :P15:47
*** zhangguoqing has quit IRC15:51
*** zhangguoqing has joined #openstack-telemetry15:51
bretonactually, all 64 threads can easily get locked up on that.15:52
*** zhangguoqing has quit IRC15:55
*** g3ek has joined #openstack-telemetry16:04
*** jmlowe has quit IRC16:04
*** jmlowe has joined #openstack-telemetry16:04
*** jmlowe has quit IRC16:09
*** jmlowe has joined #openstack-telemetry16:10
*** shardy has quit IRC16:14
openstackgerritMerged openstack/aodh master: storage: Ensure pymysql is prefered  https://review.openstack.org/46104716:15
*** chlong has joined #openstack-telemetry16:16
*** lrensing has quit IRC16:22
*** lrensing has joined #openstack-telemetry16:23
*** cdent has quit IRC16:29
*** xiaofandh12 has joined #openstack-telemetry16:30
*** donghao has quit IRC16:33
*** jmlowe has quit IRC16:33
*** jmlowe has joined #openstack-telemetry16:34
*** dave-mccowan has quit IRC16:36
*** tesseract has quit IRC16:45
openstackgerritgordon chung proposed openstack/gnocchi master: implement hashring partitioning  https://review.openstack.org/45809816:45
openstackgerritgordon chung proposed openstack/gnocchi master: sack-changer cli  https://review.openstack.org/45987316:45
openstackgerritgordon chung proposed openstack/gnocchi master: configurable hashring replicas  https://review.openstack.org/45811116:45
openstackgerritgordon chung proposed openstack/gnocchi master: configurable sacks framework  https://review.openstack.org/45865916:45
*** ildikov is now known as coffee_cat16:47
*** xiaofandh12 has quit IRC16:49
*** donghao has joined #openstack-telemetry16:59
*** dave-mccowan has joined #openstack-telemetry16:59
*** thorst has quit IRC17:01
openstackgerritgordon chung proposed openstack/gnocchi master: sack-changer cli  https://review.openstack.org/45987317:04
openstackgerritMerged openstack/aodh master: Imported Translations from Zanata  https://review.openstack.org/46005217:05
*** harlowja has quit IRC17:06
*** thorst has joined #openstack-telemetry17:11
*** leitan_ has quit IRC17:30
*** jmlowe has quit IRC17:36
*** jmlowe has joined #openstack-telemetry17:36
*** thorst has quit IRC17:41
*** jmlowe has quit IRC17:46
*** jmlowe has joined #openstack-telemetry17:46
*** jmlowe has quit IRC17:50
*** jmlowe has joined #openstack-telemetry17:50
*** thorst has joined #openstack-telemetry18:03
*** catintheroof has joined #openstack-telemetry18:04
*** Guest96685 has quit IRC18:07
*** catinthe_ has quit IRC18:08
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: rework functional live tests  https://review.openstack.org/46103318:08
openstackgerritMehdi Abaakouk (sileht) proposed openstack/aodh master: tests: simplify tox config  https://review.openstack.org/46102318:08
*** Guest96685 has joined #openstack-telemetry18:13
openstackgerritMerged openstack/aodh master: Remove sqlalchemy upper constraints  https://review.openstack.org/46025618:13
*** gordc has quit IRC18:33
*** gordc has joined #openstack-telemetry18:33
*** gordc has quit IRC18:34
*** gordc has joined #openstack-telemetry18:36
*** gordc has quit IRC18:36
*** gordc has joined #openstack-telemetry18:36
*** harlowja has joined #openstack-telemetry18:38
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: more live verification  https://review.openstack.org/46056818:54
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: fix search by user_id/project_id  https://review.openstack.org/46086018:54
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: rest: Extends metric list filters  https://review.openstack.org/46086118:54
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer master: PoC: tempest: Use primary user token  https://review.openstack.org/45965918:57
*** g3ek has quit IRC19:33
*** g3ek has joined #openstack-telemetry19:40
*** thorst has quit IRC19:49
*** thorst has joined #openstack-telemetry19:50
*** thorst_ has joined #openstack-telemetry19:51
*** thorst has quit IRC19:54
*** thorst_ has quit IRC19:56
openstackgerritOctave Orgeron proposed openstack/gnocchi master: Enables MySQL Cluster Support for Gnocchi  https://review.openstack.org/46113919:57
*** jmlowe has quit IRC19:58
*** jmlowe has joined #openstack-telemetry19:58
*** thorst has joined #openstack-telemetry20:07
*** dave-mccowan has quit IRC20:10
*** donghao has quit IRC20:17
*** jmlowe has quit IRC20:29
*** jmlowe has joined #openstack-telemetry20:29
*** gordc has quit IRC20:43
*** donghao has joined #openstack-telemetry21:05
*** thorst_ has joined #openstack-telemetry21:08
*** donghao has quit IRC21:09
*** thorst has quit IRC21:09
*** jmlowe has quit IRC21:12
*** thorst_ has quit IRC21:12
*** jmlowe has joined #openstack-telemetry21:13
*** catintheroof has quit IRC21:14
*** harlowja has quit IRC21:17
*** harlowja has joined #openstack-telemetry21:17
*** thorst has joined #openstack-telemetry21:29
*** thorst has quit IRC21:33
*** harlowja has quit IRC21:36
*** chlong has quit IRC21:39
*** jmlowe has quit IRC21:43
*** jmlowe has joined #openstack-telemetry21:59
*** agatea has joined #openstack-telemetry22:00
*** jmlowe has quit IRC22:04
*** thorst has joined #openstack-telemetry22:11
*** thorst has quit IRC22:12
*** catintheroof has joined #openstack-telemetry22:17
*** thorst has joined #openstack-telemetry22:43
*** jmlowe has joined #openstack-telemetry22:49
*** vint_bra has quit IRC22:56
*** thorst has quit IRC22:59
*** lamt has quit IRC23:01
*** lamt has joined #openstack-telemetry23:02
*** lamt has quit IRC23:08
*** donghao has joined #openstack-telemetry23:11
*** catintheroof has quit IRC23:11
*** donghao has quit IRC23:16
*** Guest96685 has quit IRC23:27
*** harlowja has joined #openstack-telemetry23:30
*** harlowja has quit IRC23:55
*** thorst has joined #openstack-telemetry23:56
*** harlowja has joined #openstack-telemetry23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!