Tuesday, 2016-09-06

*** markvoelker has joined #openstack-performance00:53
*** rfolco has quit IRC02:18
*** markvoelker has quit IRC02:53
*** fredli has joined #openstack-performance03:21
*** Weiming has quit IRC03:34
*** jamesd has joined #openstack-performance04:33
*** harlowja_at_home has joined #openstack-performance04:42
*** harlowja_at_home has quit IRC04:47
*** ilyashakhat_mobi has joined #openstack-performance05:12
*** ilyashakhat_mobi has quit IRC05:43
*** fredli has quit IRC05:50
*** msimonin has joined #openstack-performance05:52
*** msimonin has quit IRC05:52
*** ilyashakhat_mobi has joined #openstack-performance06:02
*** ilyashakhat_mobi has quit IRC06:19
*** dimtruck is now known as zz_dimtruck06:27
*** claudiub|2 has joined #openstack-performance06:29
*** claudiub has joined #openstack-performance06:31
*** claudiub|2 has quit IRC06:34
*** zz_dimtruck is now known as dimtruck06:48
*** pcaruana has joined #openstack-performance06:48
*** markvoelker has joined #openstack-performance06:54
*** dimtruck is now known as zz_dimtruck06:58
*** markvoelker has quit IRC06:59
*** zz_dimtruck is now known as dimtruck07:00
*** ad_rien_ has joined #openstack-performance07:00
*** dimtruck is now known as zz_dimtruck07:10
*** msimonin has joined #openstack-performance07:23
*** markvoelker has joined #openstack-performance08:19
*** markvoelker has quit IRC08:24
*** bogdando has quit IRC08:24
*** bogdando has joined #openstack-performance08:24
*** zz_dimtruck is now known as dimtruck09:01
*** dimtruck is now known as zz_dimtruck09:10
*** zz_dimtruck is now known as dimtruck10:06
*** HenryG_ is now known as HenryG10:46
*** rfolco has joined #openstack-performance12:09
*** furlongm_ is now known as furlongm12:48
*** pcaruana has quit IRC12:50
*** msimonin has quit IRC13:06
*** msimonin has joined #openstack-performance13:08
*** ad_rien_ has quit IRC13:29
*** markvoelker has joined #openstack-performance13:36
*** dimtruck is now known as zz_dimtruck13:47
*** msimonin has quit IRC14:08
*** msimonin has joined #openstack-performance14:28
*** zz_dimtruck is now known as dimtruck14:29
*** msimonin has quit IRC14:29
*** msimonin has joined #openstack-performance14:38
*** klindgren has joined #openstack-performance14:40
*** claudiub has quit IRC14:44
*** rmart04_ has joined #openstack-performance15:06
*** rohanion has joined #openstack-performance15:08
openstackgerritMerged openstack/performance-docs: Add results for 400 nodes control plane testing  https://review.openstack.org/36224615:11
*** rcherrueau has joined #openstack-performance15:24
*** JCardoso has joined #openstack-performance15:27
*** JCardoso has left #openstack-performance15:27
*** JorgeCardoso has joined #openstack-performance15:28
*** gokrokve has joined #openstack-performance15:28
*** AugieMena has joined #openstack-performance15:29
DinaBelova#startmeeting Performance Team15:30
openstackMeeting started Tue Sep  6 15:30:02 2016 UTC and is due to finish in 60 minutes.  The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot.15:30
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:30
openstackThe meeting name has been set to 'performance_team'15:30
DinaBelovahey folks :)15:30
DinaBelovalet's see who's around :)15:30
gokrokveo/15:30
DinaBelovarcherrueau, rohanion ? :)15:30
DinaBelovagokrokve o/15:30
rcherrueauhello15:30
DinaBelovarcherrueau o/15:30
ilyashakhathi!15:30
DinaBelovamsimonin o/15:30
DinaBelovailyashakhat wow15:30
DinaBelovailyashakhat really glad to see you :)15:31
JorgeCardosohi all15:31
rohanionyep!15:31
gokrokvehi15:31
msimoninHey DinaBelova, I can't attend today :(15:31
msimoninBut rcherrueau is here :)15:31
DinaBelovaJorgeCardoso o/ would you like to present yourself yo the audience?15:31
DinaBelovamsimonin ck15:31
*** msimonin has left #openstack-performance15:32
JorgeCardosoyes15:32
DinaBelovato the audience*** :) sorry15:32
JorgeCardosoMy name is Jorge Cardoso.15:32
DinaBelovaplease go ahead15:32
JorgeCardosoI am Chief Architect at Huawei Research and working on CLoud Reliability and Resiliency15:33
JorgeCardosoI am currently workign in a project with Deutsche Telekom on OpenStack Reliability15:33
*** rmart04_ has quit IRC15:33
gokrokveVery nice to meet you!15:34
JorgeCardosoYou can find more about my interests on reliability at: http://jorge-cardoso.github.io/research/15:34
DinaBelovaJorgeCardoso nice to see you here :) do you have something to share regarding this activity? We're really interested in OpenStack15:34
JorgeCardosoLike wise!15:34
DinaBelovareliability15:34
DinaBelovaJorgeCardoso indeed :)15:34
DinaBelova#info JorgeCardoso 's research regarding reliability at: http://jorge-cardoso.github.io/research/15:35
DinaBelovaJorgeCardoso I'll definitely take a look on this15:35
DinaBelovathank you so much15:35
DinaBelovaok, so it looks like we may jump to the agenda15:35
JorgeCardosoWe are looking into Chaos Engineering and Google SRE to udnerstadn how a Fault Injection framework would look like for openstack15:36
DinaBelova#link https://wiki.openstack.org/wiki/Meetings/Performance#Agenda_for_next_meeting15:36
DinaBelovaJorgeCardoso I think you may also speak to ilyashakhat15:36
*** rmart04 has joined #openstack-performance15:36
DinaBelovaas we re working on the same thing right now - and we came up with rally+os-faults library15:36
DinaBelova#link https://github.com/openstack/os-faults15:37
ilyashakhatright now we mostly interested in investigating how particular operations survive the single fault15:37
JorgeCardosoI looked at it, and it is a good starting point IMHO15:37
DinaBelovaJorgeCardoso ok, thanks for the feedback, lemme take a look on your points described in doc, it looks like we can somehow merge our efforts on this15:38
DinaBelovaso we can jump to current progress on the planned tests15:39
DinaBelova#topic Current progress on the planned tests15:39
DinaBelovarcherrueau would you like to start?15:40
rcherrueauyes15:40
rcherrueauso we continue on the 1000 node experiment15:40
rcherrueauThere is a pad with our roadmap15:40
rcherrueau #link https://pad.inria.fr/p/FK18ZSyjFyLPITfE15:40
rcherrueauwe curently collect a lot of information15:41
DinaBelovarcherrueau it looks like you had several runs15:41
rcherrueauresult of rally / network traffic / cpu & me usage / memcache usage ...15:41
DinaBelovaseveral timeouts were observed?15:42
*** pcaruana has joined #openstack-performance15:42
rcherrueauDinaBelova several runs ?15:42
DinaBelovarcherrueau I see pass #1, pass #2, etc15:42
*** rmart04 has quit IRC15:42
DinaBelovain the doc :)15:42
rcherrueauOh yes, you should look at ligne 16915:42
rcherrueau163 sorry15:43
rcherrueauline*15:43
DinaBelovarcherrueau ack, thanks15:43
DinaBelovarcherrueau any issues / interesting results observed so far?15:43
rcherrueaunothing special, so far we mainly spend time on developing our framework to run test and collect information15:44
rcherrueaunow we have to interpret results of these experimentations15:44
DinaBelovarcherrueau ack15:45
DinaBelovarcherrueau btw do you have any monitoring for the containers?15:45
rcherrueauyes15:45
DinaBelovarcherrueau what are you using for this purpose?15:45
DinaBelovawhat kind of tool?15:45
rcherrueauwe go with cadvisor15:46
rcherrueauwe also use some plugins from collectd15:46
DinaBelovarcherrueau ack, I'm asking as I was experimenting with various pods / containers monitoring for openstack on top of k8s deployments15:46
gokrokveDid you integrate cadvisor with InfluxDB+Graphana?15:46
rcherrueauespecially to monitor rabbitmq and mariadb15:46
rcherrueaugokrokve yes15:47
gokrokveThat what we did in our 1000 nodes experiments15:47
rcherrueauthe same for collectd15:47
DinaBelovarcherrueau and frankly speaking monitoring of ALL containers for all OpenStack services looks a bit overkill sometimes15:47
gokrokveDid you see problems with InfluxDB slowness?15:47
rcherrueauno not me, but I will ask to msimonin tomorrow15:48
gokrokveWhen we used grafana sometimes Influx used 100 CPU and was not very responsive.15:48
DinaBelovarcherrueau I can confirm15:49
rcherrueauI'm sure msimonin tune grafana is such manner that there isn't too much writing into the database15:49
gokrokveThat is cool.15:49
DinaBelovarcherrueau ok, probably it'll be nice to include this information (about what monitoring tools were used and ho tuned) to this documnet15:49
DinaBelovaprobably at the very end of it, just for information15:49
gokrokveWe did just dirty wiring to have some graphs.15:49
rcherrueauDinaBelova yes you'r right15:50
DinaBelovarcherrueau I'll add an action item15:50
DinaBelova#action rcherrueau msimonin add information about what monitoring tools were used to the https://pad.inria.fr/p/FK18ZSyjFyLPITfE15:51
DinaBelovarcherrueau thank you for sharing this15:51
rcherrueauyou are welcome15:51
DinaBelovafrom our side: we have merged 400 nodes baseline testing results to the performance docs15:52
DinaBelova#link http://docs.openstack.org/developer/performance-docs/test_results/control_plane_400_nodes/index.html15:52
DinaBelovadataplane and Neutron testing results are under construction15:52
DinaBelovato get published15:52
DinaBelovaprobably some first part of them will be shared before next meeting15:52
DinaBelovawe're having the plans to start fuel-ccp (containerized control plane) + k8s scale testing this week15:53
DinaBelovalet's see how it'll go15:53
DinaBelovajfyi: I'm visiting k8s Scale Special Interest Group meetings15:54
DinaBelovato understand how k8s itself as a basement for OpenStack deployments can scale and what kind of performance to support15:55
DinaBelovaso if anyone is interested in that kind of information, I really advice you to attend these meetings - they are quite interesting15:55
DinaBelovaalso reliability tests with os-faults library are coming soon15:56
DinaBelovaso I think that's all from our side right now15:56
DinaBelovalet's proceed to the osprofiler15:56
DinaBelova#topic OSProfiler weekly update15:57
DinaBelovawe have several new interesting changes on review15:57
DinaBelova#info new Redis-based driver for OSprofiler among them15:57
DinaBelova#link https://review.openstack.org/#/c/364487/15:57
DinaBelovafrankly speaking did not have chance to try it yet on the test env, I'm having it in my todo list for this wee15:58
DinaBelovakweek*15:58
DinaBelova#info ElasticSearch driver still under development https://review.openstack.org/#/c/340936/15:58
*** JorgeCardoso has quit IRC15:59
DinaBelovaafaik rohanion you did not have a chance to publish your script for enabling profiling on vanilla OpenStack yet?15:59
*** claudiub has joined #openstack-performance16:00
*** JorgeCardoso has joined #openstack-performance16:00
DinaBelovarohanion ? :)16:00
rohanionactually, there are 2 scripts16:00
rohaniona script that patches conf files16:00
rohanionand a script that restarts the services16:01
rohanionthe latter requires Fuel16:01
DinaBelovarohanion well yeah, that is the deployment-specific thing16:01
rohanionthe first just hacks the config files so I can publish it somewhere16:01
DinaBelovarohanion yes please, this will be useful16:01
rohanionit's really short btw16:01
DinaBelovarohanion I believe it should :)16:02
rohanion#action @rohanion publish osprofiler config patcher16:02
DinaBelovaok, so it looks like that's all regarding the profiler16:02
DinaBelovafor today we did not more specific items in agenda16:03
DinaBelova#topic Open Discussion16:03
DinaBelovaanything to share, folks?16:03
DinaBelovait looks like nope16:04
DinaBelovaso thanks everyone for coming, have a nice day/evening16:04
DinaBelova#endmeeting16:04
openstackMeeting ended Tue Sep  6 16:04:22 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:04
openstackMinutes:        http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-06-15.30.html16:04
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-06-15.30.txt16:04
openstackLog:            http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-09-06-15.30.log.html16:04
ilyashakhatbye!16:04
rcherrueaubye16:04
*** rohanion has quit IRC16:04
gokrokvebye!16:04
*** gokrokve has quit IRC16:05
*** rcherrueau has quit IRC16:05
*** AugieMena has quit IRC16:07
*** ad_rien_ has joined #openstack-performance16:17
*** ad_rien_ has quit IRC16:22
*** JorgeCardoso has quit IRC16:22
*** ad_rien_ has joined #openstack-performance16:31
*** ad_rien_ has quit IRC16:44
*** AnarchyAo has joined #openstack-performance17:06
*** ad_rien_ has joined #openstack-performance17:15
*** ad_rien_ has quit IRC17:32
*** harlowja has joined #openstack-performance17:38
*** ad_rien_ has joined #openstack-performance18:22
*** ad_rien_ has quit IRC18:31
*** pcaruana has quit IRC19:11
*** rmart04 has joined #openstack-performance19:24
*** ilyashakhat_mobi has joined #openstack-performance19:27
*** claudiub has quit IRC19:34
*** rmart04 has quit IRC19:35
*** ilyashakhat_mobi has quit IRC19:39
*** ilyashakhat_mobi has joined #openstack-performance19:46
*** ilyashakhat_mobi has quit IRC19:50
*** AnarchyAo has quit IRC19:58
*** ilyashakhat_mobi has joined #openstack-performance20:02
*** AnarchyAo has joined #openstack-performance20:04
*** ilyashakhat_mobi has quit IRC20:25
*** dewanee has quit IRC21:03
*** odoylero0lz has joined #openstack-performance21:09
*** odoylero0lz has quit IRC21:23
*** dimtruck is now known as zz_dimtruck21:23
*** rmart04 has joined #openstack-performance21:26
*** rfolco has quit IRC21:32
*** rmart04 has left #openstack-performance21:34
*** zz_dimtruck is now known as dimtruck22:02
*** dimtruck is now known as zz_dimtruck22:34
*** zz_dimtruck is now known as dimtruck22:47
*** markvoelker has quit IRC23:19
*** dimtruck is now known as zz_dimtruck23:32
*** bapalm has quit IRC23:35
*** bapalm has joined #openstack-performance23:41
*** zz_dimtruck is now known as dimtruck23:46
*** markvoelker has joined #openstack-performance23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!