Tuesday, 2016-07-26

*** furlongm has quit IRC00:05
*** furlongm has joined #openstack-performance00:05
*** rfolco has quit IRC00:14
*** bsilverman has quit IRC00:24
*** arnoldje has quit IRC00:46
*** rfolco has joined #openstack-performance01:18
*** rfolco has quit IRC01:39
*** catintheroof has quit IRC02:06
*** arnoldje has joined #openstack-performance02:41
*** rfolco has joined #openstack-performance03:23
*** rfolco has quit IRC03:47
*** harlowja_at_home has joined #openstack-performance04:33
*** pcaruana has quit IRC04:34
*** harlowja_at_home has quit IRC05:01
*** linuxaddicts has joined #openstack-performance05:07
*** arnoldje has quit IRC05:22
*** dimtruck is now known as zz_dimtruck05:52
*** msimonin2 has quit IRC06:12
*** pcaruana has joined #openstack-performance06:55
*** msimonin has joined #openstack-performance07:00
*** msimonin has quit IRC07:02
*** msimonin has joined #openstack-performance07:22
*** Deng has joined #openstack-performance10:14
*** msimonin has quit IRC11:48
*** msimonin has joined #openstack-performance11:48
*** rfolco has joined #openstack-performance11:56
*** linuxaddicts has quit IRC12:22
*** catintheroof has joined #openstack-performance12:46
*** zz_dimtruck is now known as dimtruck12:53
*** linuxaddicts has joined #openstack-performance12:59
*** linuxgeek_ has joined #openstack-performance13:03
*** v12aml has quit IRC13:05
*** linuxaddicts has quit IRC13:07
*** v12aml has joined #openstack-performance13:07
*** v12aml has quit IRC13:10
*** v12aml has joined #openstack-performance13:12
*** v12aml has quit IRC13:12
*** v12aml has joined #openstack-performance13:17
*** v12aml has quit IRC13:18
*** v12aml has joined #openstack-performance13:20
*** v12aml has quit IRC13:21
*** v12aml has joined #openstack-performance13:22
*** v12aml has quit IRC13:25
*** v12aml has joined #openstack-performance13:26
*** rook has quit IRC13:27
*** v12aml has quit IRC13:47
*** v12aml has joined #openstack-performance13:49
CassowaryDinaBelova: I have plotted two graphs.13:50
Cassowaryhttps://www.dropbox.com/s/5e8xrrctu0rcwx3/CPU%20scaling%20%20-%20continuous%20vs%20increasing%20from%201.png?dl=013:50
Cassowaryhttps://www.dropbox.com/s/txpkb8k6mpyexv8/CPU%20scaling%20-%20increase%20from%201.png?dl=013:50
CassowaryThe first graph shows the VM CPU resize time (y axis) vs number of vCPUs (x axis) of continuous (blue) and resize from a VM with 1 vCPU (green) scenarios.13:50
CassowaryThe second graph shows the VM CPU resize time (y axis) vs number of vCPUs (x axis), when resized from a VM with 1 vCPU at each step (The green line in first graph).13:50
CassowaryThe error bars show the standard error of the gathered values at each step, as I did resize multiple times to get a mean value.13:50
*** dimtruck is now known as zz_dimtruck13:54
*** msimonin1 has joined #openstack-performance13:56
*** msimonin has quit IRC13:56
*** zz_dimtruck is now known as dimtruck14:13
*** arnoldje has joined #openstack-performance14:31
*** Guest51132 is now known as med_15:23
*** med_ has quit IRC15:24
*** med_ has joined #openstack-performance15:24
*** linuxgeek_ has quit IRC15:32
DinaBelovaCassowary ack, interesting..15:39
*** linuxaddicts has joined #openstack-performance15:39
*** msimonin1 has quit IRC15:43
*** rcherrueau has joined #openstack-performance15:55
*** victorhe has joined #openstack-performance15:57
DinaBelova#startmeeting Performance Team16:00
openstackMeeting started Tue Jul 26 16:00:07 2016 UTC and is due to finish in 60 minutes.  The chair is DinaBelova. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
openstackThe meeting name has been set to 'performance_team'16:00
DinaBelovahey folks!16:00
DinaBelovaare people around?16:01
DinaBelova^)16:01
DinaBelova:)16:01
*** rohanion has joined #openstack-performance16:01
DinaBelovarohanion o/16:01
rcherrueauo/16:01
rcherrueau16:01
*** AugieMena has joined #openstack-performance16:01
rohanionHi!16:01
DinaBelovarcherrueau hello :)16:01
DinaBelovaAugieMena o/16:01
AugieMenao/16:01
*** luzC has joined #openstack-performance16:02
rcherrueauLast week I didn't introduce myself, but I work with msimonin.16:02
DinaBelovaok. let's wait for a couple of moments to see if others are around16:02
luzCo/16:02
DinaBelovarcherrueau I believe msimonin mentioned you some time, I was sure you are :)16:02
DinaBelovalezbar__ ?16:02
rcherrueauOK great16:02
DinaBelovaluzC o/16:02
rcherrueaumsimonin could not be here btw16:03
DinaBelovarcherrueau ack16:03
DinaBelovaok, so let's get started and let's hope lezbar__ will be here as well :)16:03
DinaBelova#topic Summit stuff16:04
lezbar__hi, sorry, I'm here but will have to leave early16:04
DinaBelova#info first of all, big news - voting for summit presentations has been started!16:04
DinaBelovalezbar__ ack16:04
DinaBelova#link https://www.openstack.org/summit/barcelona-2016/vote-for-speakers16:04
DinaBelovaI just wonna to share ways to find performance/scale related talks I'm aware about :)16:05
DinaBelovathis summit direct links to the submissions are not working :) so the only way to find these talks will be to search them16:06
DinaBelovaeither by person or talk name16:06
DinaBelovalemme share talks names one more time :)16:06
DinaBelova#info Let's Oversubscribe the OpenStack environment and try to find the weaknesses and improvements. - talk #116:06
DinaBelova#info Chasing 1000 nodes scale - talk #216:06
DinaBelova#info OSIC Enables the SDN Sale: Testing MidoNet with Neutron at Scale - talk #316:07
DinaBelova#info MidoNet Scalability Testing with Neutron in AWS to 1000 nodes - talk #416:07
DinaBelova#info Evaluating OpenStack Performance with the SPEC Cloud (TM) IaaS 2016 Benchmark - talk #516:07
DinaBelovalezbar__, I believe #3 and #4 are yours :)16:07
lezbar__yup :)16:07
DinaBelovaare you still planning to push the results to performance-docs prior the summit? :)16:08
lezbar__of course!16:08
DinaBelovayay :)16:08
*** sai has joined #openstack-performance16:08
DinaBelovanice to read this, /me is really happy :)16:08
DinaBelovaI'm pretty sure there are more interesting stuff in the voting process, but I did not have a chance yet to search the vote-for-speakers much16:09
DinaBelovaif I'll find something interesting I'll just publish names of the sessions here16:09
DinaBelovaif someone knows something interesting about more interesting sessions - jump in, it's just the right time :)16:10
DinaBelovait looks like nope, ok16:11
DinaBelovatoday I have only one more agenda item to cover, so let's proceed with osprofiler weekly update16:11
DinaBelova#topic OSProfiler weekly update16:11
DinaBelovarohanion ?16:11
rohanionHi guys16:12
rohanionI've been working on patching neutron and keystone for the last two days16:12
DinaBelovarohanion with new osprofiler drivers usage?16:13
rohanionOf course16:13
rohanionAlex Ignatyev is on vacation so I'm finishing his tasks16:13
DinaBelovaack16:14
rohanionnothing more special16:14
DinaBelovarohanion ack, thanks for the update)16:15
DinaBelovain fact I have no news so far as well16:15
DinaBelovalast week I was busy with relocation stuff, so /me is fully back to work only now :)16:15
DinaBelovahope to finalize my changes regarding osprofiler this week + help rohanion with osprofiler+sahara integratino16:16
DinaBelovaintegration*16:16
rohanionthat would be awesome :)16:16
DinaBelovarohanion really think I can try to do it :)16:16
DinaBelova#topic Open Discussion16:16
DinaBelovado we have something else to cover or we have really quick meeting today?  :)16:17
DinaBelovarohanion, rook_, lezbar__, AugieMena, rcherrueau, luzC ?16:17
AugieMenanothing else... voting on interesting summit talks :)16:17
rcherrueauJust for your information, We are working on the deployment script (using kolla) for the 1000 node experiment16:18
rcherrueau We plan to have something that works on our infrastructure for the end of the week16:18
DinaBelovarcherrueau are you planning to share this script?16:18
rohanionNothing else from me :(16:18
rcherrueauyes16:18
DinaBelovarcherrueau cool, please keep us updated :)16:18
rcherrueauWhen this will fully work16:19
rcherrueauOK16:19
DinaBelovarcherrueau true :D16:19
DinaBelovaok, it looks like nothing more for today16:19
DinaBelovathanks everyone for coming16:19
DinaBelovabye!16:20
lezbar__thnx bye!16:20
AugieMenabye16:20
rcherrueaubye!16:20
DinaBelova#endmeeting16:20
openstackMeeting ended Tue Jul 26 16:20:12 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:20
openstackMinutes:        http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-07-26-16.00.html16:20
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-07-26-16.00.txt16:20
openstackLog:            http://eavesdrop.openstack.org/meetings/performance_team/2016/performance_team.2016-07-26-16.00.log.html16:20
*** rcherrueau has quit IRC16:20
*** rohanion has quit IRC16:31
CassowaryDinaBelova: any idea what this could be?16:35
*** msimonin has joined #openstack-performance16:56
*** AugieMena has quit IRC17:01
*** victorhe has left #openstack-performance17:05
DinaBelovaCassowary nope so far, this looks really suspicious :D17:41
doffmDinaBelova: I'm going to rebase https://review.openstack.org/#/c/254703/ if that is OK.17:42
doffmWe need to merge to master internally, so might as well rebase upstream.17:42
DinaBelovadoffm yep, thank you sir for the help!17:42
doffmI may get the time to address some of the issues in the reviews at some point, but for now just a rebase.17:42
DinaBelovadoffm ack, thanks17:42
DinaBelovaI had really hard months - so lots of my changes are really not up to date17:43
doffmhttps://review.openstack.org/#/c/254703/ rebased.18:37
*** msimonin has quit IRC19:01
*** msimonin1 has joined #openstack-performance19:01
*** msimonin1 has quit IRC19:12
*** msimonin has joined #openstack-performance19:12
*** msimonin has quit IRC19:31
doffmDinaBelova: Is there any reason https://review.openstack.org/#/c/310530/ hasn't merged yet? Does it just need another core review and workflow?20:18
DinaBelovadoffm yep, I wonna either boris-42 or harlowja to take a look on this20:18
harlowjahuh20:19
DinaBelovain fact I'm almost out of patience and I guess if none of them will comment, I'll merge it tomorrow20:19
harlowjawho's dina20:19
harlowjalol20:19
DinaBelovaЖВ20:19
DinaBelova:D20:19
harlowjawhy is DinaBelova chatting at this time20:19
harlowjalol20:19
harlowjago to sleep20:19
harlowjalol20:19
DinaBelovaharlowja :D heh, you forgot I've relocated? :)20:19
harlowjaoh ya20:19
harlowjathat happened?20:19
harlowjadone?20:19
DinaBelovayep :D20:19
harlowjauh oh20:19
harlowjathe party starts now20:19
harlowjalol20:19
DinaBelova:D so you need to listen to me now :D i'm in your tz :D20:20
DinaBelovareview! https://review.openstack.org/#/c/310530/20:20
harlowja:(20:20
harlowjahaha20:20
harlowjayes ma'm20:20
DinaBelova:D20:20
harlowjamongo20:20
harlowjaeck20:20
harlowjalol20:20
harlowjatry:20:20
harlowja            from pymongo import MongoClient20:20
doffmSo, we have a guy internally, Mahesh. He has been doing some work on osprofiler, part of which was to look at overhead differences between ceilometer and mongo.20:20
harlowjai hate that stuff, ha20:20
harlowjadoing imports in __init__ to detect that a module can't be used feels totally messed up to me :-P20:21
DinaBelovaharlowja and https://review.openstack.org/#/c/251343/ is really needed as well btw. so if you don't have very specific comments for now..20:21
harlowjadamn, u in my TZ now20:21
harlowjacan't ignore, ha20:21
DinaBelova:D20:21
DinaBelovaahaha, true20:21
DinaBelovadoffm ack20:21
doffmI'll just type the results: Scenario, unspecified number of nova boots.20:21
harlowjai mean, ummm, not ignore20:22
harlowjai never ignore20:22
harlowjalol20:22
doffmNo profiling avg time for boot: 9.18s20:22
doffmProfiling with ceilometer avg time for boot: 35.7s20:22
doffmProfiling with mongodb avg time for boot: 10.75s20:22
doffmHe was using the same rabbitmq server for notifications and messages. Which probably isn't the right thing to do now that we can split them.20:23
doffmAnd I don't know how big the rabbit server he was using was.20:23
harlowjaweird20:23
harlowjawhy is boot time affected like that20:23
harlowjaseems messed up20:23
harlowjaprofiling isn't supposed to add 25 seconds on, lol20:23
doffmI'm guessing an overloaded rabbit server, doing lots of parallel boots.20:23
doffmAlot of extra rabbit traffic for the notifications.20:24
harlowjaya, weird20:24
DinaBelovadoffm probably this might be a reason in case of ceilometer, yep... harlowja - ceilo is really loading cloud controllers, esp. if mongo is located on the same nodes20:24
harlowjamakes it hard to get useful profiling if the profiling system itself adds on so much20:24
DinaBelovadoffm in fact I would say you need to try set mongo and rabbit mq on separated nodes for ceilo case20:24
harlowjadef20:24
doffmI think this could be mitiaged by using a separate rabbitmq for notifications.20:24
harlowjai wouldn't colocate the rabbits20:24
harlowja*couse the rabbits20:24
harlowjaco-use-the-same-rabbit-hole20:25
harlowjaidk, i'm not a rabbbit20:25
DinaBelovaand (again) please check mongo, it has its own troughput affecting everything else of the controllers20:25
DinaBelovaif it's located there20:25
harlowjaweird seeing DinaBelova type so much20:25
harlowjalol20:25
DinaBelovaharlowja :D20:25
DinaBelovadeal with it :D20:25
harlowja:-P20:25
doffmDinaBelova: Are you located in the USA?20:26
DinaBelovadoffm yep, CA20:27
DinaBelovafor a week or so :D20:27
harlowjaha20:27
DinaBelovaI mean I've relocated a week ago :)20:27
harlowjaimmigrants20:27
DinaBelovaharlowja ahaha20:27
DinaBelovait's much easier to influence on you here :D20:27
harlowjalol20:27
harlowjawell now u can walk over and find me20:28
harlowjawhich is scary!20:28
harlowjalol20:28
DinaBelovalol20:28
dims_run and hide harlowja ~20:28
harlowjai'm trying20:28
harlowjalol20:28
doffmSo... The novaclient patch is essentially enabled by importing osprofiler.web. Since rally uses novaclient...20:41
doffmAll I have to to is make sure osprofiler.web is in the path. Use a patched novaclient and rally should send out osprofiler enabled requests.20:42
doffmYeah, that will totally work. *crosses fingers*20:42
*** catintheroof has quit IRC20:52
harlowjaDinaBelova sooooo klindgren i think wants to get back into the perf stuff (volunteered, hahaha) anything he can do ;)20:52
harlowja:-P20:53
harlowjaright kris20:53
harlowjalol20:53
DinaBelovaharlowja klindgren heh, ack, good to know :)20:57
klindgren>_>20:57
klindgren<_<20:57
DinaBelovasorry, need to go afk for ~1 hour20:57
klindgrenDo have a lovely stories about keepalives - and terribleness20:58
harlowjathat one sounds like a good one for the campfire21:00
harlowjalol21:00
*** rfolco has quit IRC21:12
*** linuxaddicts has quit IRC21:33
*** linuxaddicts has joined #openstack-performance21:36
*** msimonin has joined #openstack-performance21:40
*** openstackgerrit has quit IRC22:03
*** openstackgerrit has joined #openstack-performance22:04
*** arnoldje has quit IRC22:07
*** msimonin has quit IRC22:27
*** openstackgerrit has quit IRC22:48
*** openstackgerrit has joined #openstack-performance22:48
*** dimtruck is now known as zz_dimtruck22:51
*** zz_dimtruck is now known as dimtruck23:40

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!