Wednesday, 2015-04-22

*** markvoelker has joined #openstack-meeting-400:02
*** BjoernT has quit IRC00:04
*** markvoelker has quit IRC00:08
*** xingchao has quit IRC00:10
*** sarob has joined #openstack-meeting-400:14
*** VW_ has joined #openstack-meeting-400:21
*** david-lyle has quit IRC00:24
*** VW_ has quit IRC00:26
*** igordcard has quit IRC00:27
*** david-lyle has joined #openstack-meeting-400:27
*** vishwana_ has quit IRC00:28
*** vishwanathj has joined #openstack-meeting-400:28
*** vishwanathj has quit IRC00:33
*** emagana has quit IRC00:36
*** xingchao has joined #openstack-meeting-400:39
*** xingchao has quit IRC00:39
*** xingchao has joined #openstack-meeting-400:40
*** armax has quit IRC00:41
*** dannywilson has quit IRC00:43
*** dannywilson has joined #openstack-meeting-400:44
*** xingchao has quit IRC00:48
*** vishwanathj has joined #openstack-meeting-400:52
*** dannywilson has quit IRC01:00
*** fnaval has quit IRC01:09
*** sarob has quit IRC01:15
*** sarob has joined #openstack-meeting-401:16
*** eghobo has joined #openstack-meeting-401:18
*** eghobo_ has joined #openstack-meeting-401:20
*** sarob has quit IRC01:21
*** eghobo has quit IRC01:23
*** fnaval has joined #openstack-meeting-401:24
*** asselin_ has joined #openstack-meeting-401:30
*** ajmiller has joined #openstack-meeting-401:41
*** vishwanathj has quit IRC01:44
*** xingchao has joined #openstack-meeting-401:48
*** VW_ has joined #openstack-meeting-401:48
*** VW_ has quit IRC01:50
*** VW_ has joined #openstack-meeting-401:50
*** xingchao has quit IRC01:52
*** jamesllondon has quit IRC01:53
*** jamesllondon has joined #openstack-meeting-401:54
*** markvoelker has joined #openstack-meeting-402:01
*** ChuckC has joined #openstack-meeting-402:29
*** Swami_ has joined #openstack-meeting-402:36
*** Swami has quit IRC02:37
*** eghobo_ has quit IRC02:46
*** galstrom_zzz is now known as galstrom02:47
*** VW_ has quit IRC02:48
*** ibiris is now known as ibiris_away02:48
*** sacharya has joined #openstack-meeting-402:49
*** ivar-laz_ has joined #openstack-meeting-402:50
*** ivar-lazzaro has quit IRC02:51
*** ivar-laz_ has quit IRC02:53
*** VW_ has joined #openstack-meeting-402:58
*** VW__ has joined #openstack-meeting-402:59
*** VW__ has quit IRC03:00
*** VW_ has quit IRC03:00
*** VW_ has joined #openstack-meeting-403:00
*** carl_baldwin has joined #openstack-meeting-403:03
*** asselin__ has joined #openstack-meeting-403:09
*** praveens has joined #openstack-meeting-403:09
*** asselin_ has quit IRC03:11
*** praveens has quit IRC03:14
*** galstrom is now known as galstrom_zzz03:15
*** galstrom_zzz is now known as galstrom03:17
*** galstrom is now known as galstrom_zzz03:43
*** galstrom_zzz is now known as galstrom03:44
*** Swami_ has quit IRC03:48
*** asselin__ has quit IRC03:50
*** ajmiller has quit IRC03:57
*** eghobo has joined #openstack-meeting-403:58
*** asselin_ has joined #openstack-meeting-404:00
krtaylor#startmeeting third-party04:00
openstackMeeting started Wed Apr 22 04:00:35 2015 UTC and is due to finish in 60 minutes.  The chair is krtaylor. Information about MeetBot at http://wiki.debian.org/MeetBot.04:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.04:00
*** openstack changes topic to " (Meeting topic: third-party)"04:00
openstackThe meeting name has been set to 'third_party'04:00
krtayloranyone here for third party ci working group meeting?04:00
*** sacharya1 has joined #openstack-meeting-404:01
*** dannywilson has joined #openstack-meeting-404:01
asselin_hi04:01
krtaylorhi asselin_04:01
asselin_hi krtaylor04:01
*** VW__ has joined #openstack-meeting-404:02
*** sacharya has quit IRC04:02
*** sacharya has joined #openstack-meeting-404:04
asselin_i guess it's just us?04:05
*** sacharya1 has quit IRC04:05
*** VW_ has quit IRC04:05
*** krtaylor has quit IRC04:06
*** dannywilson has quit IRC04:06
*** krtaylor has joined #openstack-meeting-404:11
krtaylorasselin_, ?04:11
asselin_krtaylor, hi04:12
krtaylorwhat did you miss? what  was the last I said?04:12
asselin_<krtaylor> hi asselin_04:12
krtaylorwow04:12
asselin_I guess I missed everything04:12
krtaylorI'd really like to figure out who is kicking me right when I have a meeting04:12
krtaylorI never have a problem with openstack meetings until its my turn04:13
krtaylorI didn't lose my network connection, just with freenode #openstack-meeting-404:14
* asselin_ wonders if the bot 'heard' anything04:14
krtaylorwhatever04:14
krtaylorok, replay04:14
krtaylorwell this might be a short meeting, since we are lacking a quorum form non-US timezones once again04:14
krtaylorafter summit we should re-examine all the different third party meetings and times04:14
asselin_agree04:14
*** jckasper has joined #openstack-meeting-404:15
krtaylorthanks for your reviews to https://review.openstack.org/#/c/17552004:15
krtaylorI am excited to get the repo in place04:15
krtaylorwe have 4 or 5 different tools that we'll push (IBM PowerKVM)04:15
*** VW__ has quit IRC04:15
krtaylorasselin_, did you have anything you wanted to bring up?04:15
*** patrickeast has joined #openstack-meeting-404:15
asselin_yes, looking forward to check that out04:15
patrickeasthi, sorry im late04:16
asselin_nothing since the last 3rd party meeting :)04:16
krtaylorhi patrickeast04:16
asselin_we do have a zuul refactor patch up04:16
asselin_up patrickeast04:16
krtaylorI got kicked again, you didnt miss much  :)04:16
asselin_#link https://review.openstack.org/#/c/175970/04:16
asselin_need to figure out the best way to test these changes04:17
asselin_automated test I mean04:17
patrickeastare there frameworks for puppet script testing kind of things?04:18
asselin_yes, but clarkb doesn't like them b/c they basically make you rewrite the entire puppet script in another file04:18
asselin_nibalizer's looking into envassert.04:18
patrickeastew yea if you have to rewrite the whole thing that sucks04:19
asselin_I don't know the full details...I think he had mixed feelings about it04:19
asselin_my approach is more functional, via bash script https://review.openstack.org/#/c/169117/04:19
asselin_clarkb likes it04:20
asselin_but it needs to be refined a bit to simplify and be more reusable04:20
*** galstrom is now known as galstrom_zzz04:20
patrickeastinteresting04:20
patrickeastthat looks like it would work pretty well04:20
krtaylornice04:20
patrickeastthat envassert module looks pretty nifty too04:21
patrickeastso it looks like we have some options then04:22
asselin_I didn't get a chance to look at it, but it would simplify a lot of verification04:22
asselin_sorry need to step away for 1-2 minutes04:22
krtaylornp, not much happening this meeting04:23
krtaylorpatrickeast, did you have anything you needed to discuss?04:23
patrickeastnope, nothing new from me04:23
patrickeastday job takes most of my time from thirdparty stuff :(04:24
*** sacharya has quit IRC04:24
patrickeastand chasing ghosts with our ci system04:24
krtayloryeah, tell me about it04:24
patrickeastsomething wrong with our networking or openvswitch config04:24
krtayloroh04:24
asselin_i'm back04:24
patrickeastevery once and a while the tests just can’t ssh into an instance04:24
patrickeastbut no errors in any log that i’ve found yet04:24
patrickeastjust a fixture timeout and test failure04:25
patrickeasthaven’t been able to reproduce it with a node that i have held onto yet either04:25
krtaylorheld onto?04:26
asselin_nodepool hold04:26
krtaylorah, right04:26
patrickeastyea keep the vm around so nodepool doesn’t recycle it04:26
patrickeastit started happening when we switched our providers public network from vxlan to flat04:27
patrickeastthats the only thing thats new04:27
patrickeastunless its a new bug in openstack somewhere04:27
krtaylorpossible, we try to find any new problems in our development environment before we roll them out to production04:28
patrickeastsame here04:28
patrickeastdoesn’t happen frequently enough that we saw it until it was too late04:28
krtaylorbut our test targets are different04:28
*** sdake has joined #openstack-meeting-404:29
patrickeasti recently added additional test configurations so we have 3x the number of runs to smoke it out for each patchset04:29
patrickeastsoon to be 5x when we get our fc stuff underway04:29
patrickeastso i have hope to piece together whats going on eventually04:29
krtayloryou are running 3x on each patch? wow04:30
patrickeastyea, one normal, one with multipath enabled, and one with CHAP authentication enabled04:30
patrickeastdifferent enough code paths in cinder that it can pass on one and fail the others04:30
patrickeasthad a bug that almost didn’t make it into kilo because we weren’t testing them all04:30
*** eghobo has quit IRC04:31
asselin_we need to start testing with chap04:31
asselin_but honestly the issue we have is that it doesn't scale04:31
patrickeastyea scaling them is a pain04:32
patrickeastsuch a big test matrix with all the config options04:32
*** sdake_ has joined #openstack-meeting-404:32
patrickeasttoss in a handful of hypervisors and os targets…04:32
asselin_ideally, all those paths would be in one job04:32
asselin_b/c a lot of time is spent on setup04:32
patrickeasthmm thats something worth looking into04:32
patrickeastset up devstack gate, run one, reconfigure, run again, repeat04:33
*** sdake has quit IRC04:33
asselin_yes04:33
patrickeastwould definitely cut down the time quite a bit04:33
patrickeastlike 15 min per run04:33
patrickeastper job*04:33
asselin_yeah...for some reason our job times are back to over 1 hour. they used to be 30 minutes....04:34
asselin_that's another issue we should add to the summit04:34
asselin_1. multiple test configurations in a single run04:35
patrickeasti recently cut out the boto tests from ours and it helped reduce the time04:35
patrickeastbut i think you already skip them, right?04:35
krtaylorhm, ours have been dropping04:35
asselin_2. profiling ci jobs04:35
krtaylor++04:35
asselin_patrickeast, yes, we're skipping. they fail anyways...not sure why, and not sure how important they are04:36
patrickeastyea they were very prone to failing with the timeouts i’ve seen in our system04:36
patrickeasti too am unsure how important they are04:36
patrickeastmy understanding is there is some compatibility layer so you can do openstack stuff via a boto interface04:37
patrickeastbut it looks like they end up just creating volumes/instances and what not like any of the other tests04:38
*** jckasper has quit IRC04:40
asselin_I think the boto service is just not comming up /accessible in our case. but I need to take another look to see what's really going on.04:40
asselin_but I have more important things to do...so skipping04:40
krtaylorasselin_,  do you know if there is a cinder ci testing session proposed?04:41
asselin_I added those 2 items to the etherpad04:41
patrickeasthaha yea… its on my backlog somewhere04:41
asselin_krtaylor, I don't think so.....but could be wrong04:41
patrickeasti don’t remember seeing one on the etherpad04:41
asselin_I know there's a manila one04:41
*** eghobo has joined #openstack-meeting-404:42
krtaylorso I guess we could discuss at the cross-project proposed session04:42
krtaylornot sure if we'll get that and the infra session, but we'll see04:42
krtaylorhehheh, so much for a short meeting  :)04:43
*** ibiris_away is now known as ibiris04:43
krtaylorwell, the only topics for discussion were topics for summit04:44
krtaylorand the repo patchset04:44
krtaylor#link https://review.openstack.org/#/c/17552004:45
krtaylorthanks for your reviews04:45
*** carl_baldwin has quit IRC04:45
patrickeastlooks like it is pretty much ready to go now, yea?04:46
krtaylorI hope so, I can't imagine any more typos :)04:46
patrickeastlol04:47
krtayloranything else to discuss asselin_  or patrickeast ?04:49
asselin_that's it from me04:49
patrickeastnothin else here04:49
krtaylorok, thanks everyone, I'll shut this down then04:50
krtaylor#endmeeting04:51
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"04:51
openstackMeeting ended Wed Apr 22 04:51:40 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)04:51
openstackMinutes:        http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-04-22-04.00.html04:51
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-04-22-04.00.txt04:51
openstackLog:            http://eavesdrop.openstack.org/meetings/third_party/2015/third_party.2015-04-22-04.00.log.html04:51
*** simon-AS559 has joined #openstack-meeting-404:54
*** simon-AS5591 has joined #openstack-meeting-404:55
*** asselin_ has quit IRC04:56
*** sarob has joined #openstack-meeting-404:56
*** simon-AS559 has quit IRC04:58
*** sarob has quit IRC05:01
*** patrickeast has quit IRC05:01
*** simon-AS5591 has quit IRC05:05
*** ibiris is now known as ibiris_away05:06
*** galstrom_zzz is now known as galstrom05:09
*** galstrom is now known as galstrom_zzz05:15
*** nkrinner has joined #openstack-meeting-405:20
*** emagana has joined #openstack-meeting-405:20
*** fnaval has quit IRC05:28
*** yamahata has joined #openstack-meeting-405:30
*** bharath has joined #openstack-meeting-405:32
*** sdake_ has quit IRC05:42
*** dannywilson has joined #openstack-meeting-405:50
*** ajayaa has joined #openstack-meeting-405:52
*** markvoelker has quit IRC06:10
*** jamesllondon has quit IRC06:10
*** numan has joined #openstack-meeting-406:20
*** eghobo has quit IRC06:33
*** buchi has joined #openstack-meeting-406:34
*** sdake has joined #openstack-meeting-406:34
*** numan has quit IRC06:37
*** markvoelker has joined #openstack-meeting-406:40
*** markvoelker has quit IRC06:45
*** sarob has joined #openstack-meeting-406:45
*** numan has joined #openstack-meeting-406:49
*** sarob has quit IRC06:49
*** wojdev has joined #openstack-meeting-406:51
*** blogan has quit IRC06:52
*** ptoohill has quit IRC06:53
*** emagana has quit IRC06:53
*** blogan has joined #openstack-meeting-406:56
*** ptoohill has joined #openstack-meeting-406:57
*** kobis has joined #openstack-meeting-407:07
*** kobis has quit IRC07:09
*** kobis has joined #openstack-meeting-407:10
*** wojdev_ has joined #openstack-meeting-407:17
*** wojdev has quit IRC07:19
*** wojdev_ is now known as wojdev07:19
*** mattt has left #openstack-meeting-407:23
*** sdake has quit IRC07:35
*** markvoelker has joined #openstack-meeting-407:41
*** kobis has quit IRC07:44
*** markvoelker has quit IRC07:46
*** sdake has joined #openstack-meeting-407:48
*** kobis has joined #openstack-meeting-407:52
*** kobis has quit IRC07:57
*** bharath has quit IRC07:59
*** sdake has quit IRC08:00
*** yamahata has quit IRC08:04
*** matrohon has joined #openstack-meeting-408:06
*** matrohon has quit IRC08:06
*** matrohon has joined #openstack-meeting-408:06
*** ibiris_away is now known as ibiris08:10
*** kobis has joined #openstack-meeting-408:16
*** ajo has joined #openstack-meeting-408:18
*** simon-AS559 has joined #openstack-meeting-408:19
*** kobis has quit IRC08:24
*** kobis has joined #openstack-meeting-408:27
*** krtaylor has quit IRC08:29
*** krtaylor has joined #openstack-meeting-408:34
*** markvoelker has joined #openstack-meeting-408:42
*** dannywilson has quit IRC08:45
*** dannywilson has joined #openstack-meeting-408:46
*** markvoelker has quit IRC08:47
*** wojdev has quit IRC08:47
*** dannywilson has quit IRC08:50
*** wojdev has joined #openstack-meeting-408:52
*** xingchao has joined #openstack-meeting-409:04
*** igordcard has joined #openstack-meeting-409:05
*** nkrinner has quit IRC09:07
*** xingchao has quit IRC09:09
*** nkrinner has joined #openstack-meeting-409:09
*** wojdev has quit IRC09:11
*** simon-AS559 has quit IRC09:36
*** ajo has quit IRC09:41
*** markvoelker has joined #openstack-meeting-409:43
*** ajo has joined #openstack-meeting-409:46
*** markvoelker has quit IRC09:47
*** wojdev has joined #openstack-meeting-409:51
*** ajo has quit IRC09:58
*** simon-AS559 has joined #openstack-meeting-409:58
*** garyk has joined #openstack-meeting-410:06
garykanyone around for the vmware meeting?10:06
*** ajo has joined #openstack-meeting-410:15
*** vishwanathj has joined #openstack-meeting-410:18
*** sarob has joined #openstack-meeting-410:23
*** sarob has quit IRC10:28
*** daneyon_ has joined #openstack-meeting-410:34
*** daneyon has quit IRC10:35
*** markvoelker has joined #openstack-meeting-410:43
*** markvoelker has quit IRC10:48
*** wojdev has quit IRC10:50
*** simon-AS559 has quit IRC10:58
*** simon-AS559 has joined #openstack-meeting-411:01
*** wojdev has joined #openstack-meeting-411:32
*** bknudson has quit IRC11:40
*** simon-AS559 has quit IRC11:42
*** markvoelker has joined #openstack-meeting-411:44
*** markvoelker has quit IRC11:45
*** markvoelker has joined #openstack-meeting-411:45
*** simon-AS559 has joined #openstack-meeting-411:49
*** simon-AS559 has quit IRC11:54
*** simon-AS559 has joined #openstack-meeting-411:55
*** jckasper has joined #openstack-meeting-411:59
*** mmedvede has quit IRC12:04
*** ajayaa has quit IRC12:07
*** VW_ has joined #openstack-meeting-412:12
*** sarob has joined #openstack-meeting-412:12
*** mmedvede has joined #openstack-meeting-412:14
*** VW_ has quit IRC12:17
*** sarob has quit IRC12:18
*** rfolco has joined #openstack-meeting-412:19
*** buchi has quit IRC12:31
*** bknudson has joined #openstack-meeting-412:43
*** dannywilson has joined #openstack-meeting-412:46
*** dannywilson has quit IRC12:50
*** galstrom_zzz is now known as galstrom12:50
*** galstrom is now known as galstrom_zzz12:54
*** klamath has joined #openstack-meeting-412:59
*** klamath has quit IRC13:00
*** klamath has joined #openstack-meeting-413:00
*** igordcard has quit IRC13:07
*** galstrom_zzz is now known as galstrom13:12
*** jckasper has quit IRC13:12
*** simon-AS559 has quit IRC13:15
*** galstrom is now known as galstrom_zzz13:19
*** yamahata has joined #openstack-meeting-413:19
*** ajayaa has joined #openstack-meeting-413:22
*** jckasper has joined #openstack-meeting-413:23
*** VW_ has joined #openstack-meeting-413:26
*** simon-AS5591 has joined #openstack-meeting-413:26
*** sarob has joined #openstack-meeting-413:45
*** simon-AS5591 has left #openstack-meeting-413:47
*** sarob has quit IRC13:49
*** nkrinner has quit IRC14:01
*** fnaval has joined #openstack-meeting-414:04
*** sigmavirus24_awa is now known as sigmavirus2414:05
*** xingchao has joined #openstack-meeting-414:06
*** aventerav has joined #openstack-meeting-414:07
*** erikmwilson is now known as Guest9565814:11
*** Guest95658 has quit IRC14:11
*** erikmwilson has joined #openstack-meeting-414:11
*** erikmwilson_ has joined #openstack-meeting-414:11
*** salv-orlando has quit IRC14:18
*** ChuckC has quit IRC14:19
*** xingchao has quit IRC14:29
*** wojdev has quit IRC14:37
*** Bjoern___ has joined #openstack-meeting-414:41
*** asselin_ has joined #openstack-meeting-414:42
*** kobis has quit IRC14:43
*** sdake has joined #openstack-meeting-414:43
*** xingchao has joined #openstack-meeting-414:43
*** yamahata has quit IRC14:43
*** yamahata has joined #openstack-meeting-414:44
*** sdake_ has joined #openstack-meeting-414:44
*** sdake has quit IRC14:48
*** xingchao has quit IRC14:52
*** ajayaa has quit IRC14:55
*** xingchao has joined #openstack-meeting-414:58
*** ajayaa has joined #openstack-meeting-414:58
*** galstrom_zzz is now known as galstrom14:58
*** galstrom is now known as galstrom_zzz15:08
*** numan has quit IRC15:16
*** numan has joined #openstack-meeting-415:19
*** xingchao has quit IRC15:21
*** carl_baldwin has joined #openstack-meeting-415:23
*** carl_baldwin_ has joined #openstack-meeting-415:23
*** armax has joined #openstack-meeting-415:26
*** asselin_ has quit IRC15:38
*** sacharya has joined #openstack-meeting-415:39
*** Sukhdev has joined #openstack-meeting-415:40
*** yamahata has quit IRC15:43
*** sdake_ has quit IRC15:48
*** eghobo has joined #openstack-meeting-415:49
*** spredzy is now known as spredzy|afk15:49
*** kobis has joined #openstack-meeting-415:50
*** tholtzen has joined #openstack-meeting-416:01
*** kobis has quit IRC16:03
*** kobis has joined #openstack-meeting-416:03
*** matrohon has quit IRC16:07
*** erikmwilson has quit IRC16:11
*** nlahouti has joined #openstack-meeting-416:11
*** nlahouti has left #openstack-meeting-416:11
*** erikmwilson has joined #openstack-meeting-416:11
*** erikmwilson has quit IRC16:13
*** erikmwilson has joined #openstack-meeting-416:13
*** claired has joined #openstack-meeting-416:13
*** tholtzen has quit IRC16:14
*** claired has quit IRC16:20
*** xingchao has joined #openstack-meeting-416:21
*** aduarte has joined #openstack-meeting-416:25
*** xingchao has quit IRC16:26
*** ajmiller has joined #openstack-meeting-416:26
*** Swami has joined #openstack-meeting-416:28
*** dannywilson has joined #openstack-meeting-416:34
*** Bjoern___ is now known as BjoernT16:43
*** dannywilson has quit IRC16:48
*** pkoniszewski has joined #openstack-meeting-416:52
*** numan has quit IRC16:52
*** vishwanathj has quit IRC17:02
*** kobis has quit IRC17:03
*** salv-orlando has joined #openstack-meeting-417:07
*** pkoniszewski has quit IRC17:11
*** vishwanathj has joined #openstack-meeting-417:14
*** VW_ has quit IRC17:23
*** sdake has joined #openstack-meeting-417:24
*** ChuckC has joined #openstack-meeting-417:26
*** sbalukoff has quit IRC17:27
*** sdake has quit IRC17:29
*** sdake has joined #openstack-meeting-417:30
*** rlpple has joined #openstack-meeting-417:31
-openstackstatus- NOTICE: gerrit is restarting to clear hung stream-events tasks. any review events between 16:48 and 17:32 utc will need to be rechecked or have their approval votes reapplied to trigger testing in zuul17:32
rlppleGuess I missed operators meeting??17:33
*** IlyaG has joined #openstack-meeting-417:35
*** woodard has joined #openstack-meeting-417:35
*** bharath has joined #openstack-meeting-417:36
*** Sukhdev has quit IRC17:40
*** david-lyle has quit IRC17:42
*** ivar-lazzaro has joined #openstack-meeting-417:43
*** woodard_ has joined #openstack-meeting-417:50
*** woodard has quit IRC17:50
*** yamahata has joined #openstack-meeting-417:50
*** rlpple has quit IRC17:52
*** sarob has joined #openstack-meeting-417:57
*** woodard has joined #openstack-meeting-417:58
*** woodard_ has quit IRC17:59
*** vishwanathj has quit IRC18:00
*** vishwanathj has joined #openstack-meeting-418:00
*** yamahata has quit IRC18:03
*** vishwanathj has quit IRC18:05
*** vishwanathj has joined #openstack-meeting-418:09
*** vishwanathj has quit IRC18:14
*** vishwanathj has joined #openstack-meeting-418:14
*** vishwana_ has joined #openstack-meeting-418:16
*** vishwanathj has quit IRC18:17
*** garyk has quit IRC18:21
*** SumitNaiksatam has joined #openstack-meeting-418:21
*** yamahata has joined #openstack-meeting-418:33
*** VW_ has joined #openstack-meeting-418:34
*** sarob has quit IRC18:35
*** sbalukoff has joined #openstack-meeting-418:35
*** s3wong has joined #openstack-meeting-418:39
*** yamahata has quit IRC18:40
*** carl_baldwin has quit IRC18:50
*** carl_baldwin_ has quit IRC18:50
*** carl_baldwin has joined #openstack-meeting-418:51
*** carl_baldwin_ has joined #openstack-meeting-418:51
*** aventerav has quit IRC19:05
*** zz_zz_ja is now known as zz_zz_zz_ja19:09
*** sarob has joined #openstack-meeting-419:11
*** sarob has quit IRC19:12
*** vishwana_ has quit IRC19:16
*** vishwanathj has joined #openstack-meeting-419:16
*** vishwanathj has quit IRC19:18
*** vishwanathj has joined #openstack-meeting-419:19
*** VW_ has quit IRC19:23
*** woodard has left #openstack-meeting-419:27
*** VW_ has joined #openstack-meeting-419:30
*** sarob has joined #openstack-meeting-419:33
*** vishwanathj has quit IRC19:36
*** vishwanathj has joined #openstack-meeting-419:37
*** nkrinner has joined #openstack-meeting-419:37
*** vishwanathj has quit IRC19:41
*** mmedvede has quit IRC19:43
*** sarob_ has joined #openstack-meeting-419:44
*** sarob has quit IRC19:47
*** sarob_ is now known as sarob19:47
*** aventerav has joined #openstack-meeting-419:48
*** mwang2 has joined #openstack-meeting-419:54
*** mmedvede has joined #openstack-meeting-419:55
*** ibiris is now known as ibiris_away19:57
*** Rockyg has joined #openstack-meeting-419:59
Rockygo/20:00
nkrinnerhi20:00
Rockygkewl.  new guy.20:00
*** banix has joined #openstack-meeting-420:01
jokke_o/20:01
RockygWell, let's kick this off20:01
Rockyg#startmeeting log_wg20:01
openstackMeeting started Wed Apr 22 20:01:55 2015 UTC and is due to finish in 60 minutes.  The chair is Rockyg. Information about MeetBot at http://wiki.debian.org/MeetBot.20:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:01
*** openstack changes topic to " (Meeting topic: log_wg)"20:01
openstackThe meeting name has been set to 'log_wg'20:02
RockygNow, the question:  do we have anything people want to discuss?  The table is open for new discussions20:02
*** rhe00 is now known as rhedlind20:03
nkrinnernot sure if this is worth discussing, but this crossed my mind recently20:03
jokke_I really have nothing for  today20:03
Rockygnkrinner: well, better than napping -- go for it20:04
RockygAlso, abviously, I have not gotten the next draft of error codes out yet.  FYI.20:04
nkrinnerfor bugs we have the tag docimpact tag, which automatically notifies the doc team about changes that might affect them. do we want something like this for logs too?20:05
RockygOh, yes, please!  I started it, but going project by project, finding a bug that could use the tag, and adding it, was taking lots of time20:05
RockygIf there's a more straightforward way, I'm all for it.20:06
nkrinneri was just browsing the code to see how and where to implement that. also trying to find out with who to talk about this.20:06
nkrinnerso i suggest i will continue investigating this and report on it next week?20:06
RockygSounds great20:07
jokke_sounds good20:07
nkrinnerso next week we hopefully see if it is worth the effort then. :-)20:07
RockygI think I was going the easy route with the tag "log"20:08
Rockygnkrinner: I think it will be.  Once it's available for ops folks, I think they will use it.  Of course, that's also after educating them.20:08
jokke_:)20:08
nkrinneryeah :-)20:09
RockygBut, summit is soon.  Wondering -- would it make sense to have a working session with ops folks just identifying, tagging and escalating log bugs?  Sort of a log bug triage session?20:10
*** matrohon has joined #openstack-meeting-420:11
RockygI also find it difficult to find "log" bugs because yuu can't do a cross-project search for key words20:11
jokke_++20:11
nkrinnersadly i can't make it to vancouver20:11
RockygDarn!20:12
RockygIf you ever make it to San Jose, I'll buy you a beer.20:12
nkrinner:-)20:12
RockygFYI.  some infra and other folks are looking at phabricator as a possible replacement for storyboard/launchpad.  Take a look and see if it is better20:13
Rockyg#topic Rambling20:14
*** openstack changes topic to "Rambling (Meeting topic: log_wg)"20:14
nkrinnerthanks, will take a look20:14
RockygJust wanted to get in that ...20:14
*** mwang2 has quit IRC20:14
RockygSome more rambling.  We have "log files" scattered across the cloud.  some log "log messages", some log error output, some log HTTP stuff.20:15
RockygI''ve got a list.  I want to make it a matrix.20:15
Rockygdefault log name, location, type of messages logged, audience (ops, tenant ops, app admin, etc), etc20:16
jokke_ok20:16
RockygI'm thinking this could help clarify the differences between the various messages for one20:16
RockygIt could also provide a checklist for devs as to what type of message they really want to generate based on classification20:17
jokke_yeah I think that would be a good idea20:18
RockygIt would aid everyone from dev to enduser in tracking down information20:18
nkrinnerit would help making developers more aware about other peoples log needs20:18
RockygLet's brainstorm on what the columns should be.  Of course the first one is the log file itself.  /there are about 80? I think.20:19
RockygAnd location seems to be good for the second20:19
nkrinnerproject/service the log belongs to20:20
nkrinnermaybe20:20
Rockyghttps://docs.google.com/spreadsheets/d/1XTncfK_droY8E-Uy2icVuU-z9ya38ZBK_ZIRvGfPOXc/edit?usp=sharing20:20
Rockyg#link https://docs.google.com/spreadsheets/d/1XTncfK_droY8E-Uy2icVuU-z9ya38ZBK_ZIRvGfPOXc/edit?usp=sharing20:22
Rockygviewable by?20:22
nkrinneri think that is the most important information20:22
RockygAudience?20:22
jokke_I can see it at least20:23
nkrinneri think everything is only visible to admins?20:23
RockygOps/Domain Ops/Tenant?20:23
RockygWell, all the vm log files are available to the tenant who spins up the vm20:23
nkrinnertrue20:24
RockygAnd if you have nested clouds, then the guy who controls the top of the provisioned cloud owns those cloud files20:24
RockygAnd who is supposed to use them, versus who can see them is where security issues happen20:25
nkrinnercloud users can do whatever they want with the logs they created i guess20:27
RockygSomewhere I had found a list that infra put together.  Tryng to find it now.20:27
RockygRight.  so it's a matter of what they have permission to create.  It's the whole role thing.  So I guess the question is:  What is the scope of the Role?20:28
nkrinneri as a developer am mostly interested in what helps me debug issues with services and find all the infos i need in the log files. i have not really thought about user needs so far20:30
*** VW_ has quit IRC20:30
RockygTure.  Devs think about what they need to develop and Ops/End Users think about what they need to check on health.  and hackers think of what info can be used to break in.20:31
RockygSo, Purpose of the log is a good thing to know.  It helps to inform us who the users will be.20:32
nkrinneri see20:32
nkrinnerpurpose alse depends a lot on the log level i guess20:33
RockygYes.  Not all logs are for log messages.  Some are for notifications, the housekeeping on RESTful APIs, tracebacks, etc.20:34
*** dannywilson has joined #openstack-meeting-420:35
RockygSo, for instance, the Apache logs would get most/all API message logs, but then some of the project logs would also capture a log after processing the API response.20:35
jokke_yeah and all the wsgi servers should log each request once to the service logs20:36
*** vishwanathj has joined #openstack-meeting-420:37
RockygSo what jokke_ just said leads me to think we should add a field for message type, like wsgi notifications, HTTP, etc?20:38
nkrinnerok20:39
nkrinnerto be honest that is all valuable information i can currently imagine. what else woulde we need to know? maybe a general 'does its job'/'doesn't do its job' rating?20:40
jokke_that could work20:40
nkrinnerfor example i am not so happy with some of the logs i have had to look at, but it might be it was only because it were log files of services i am not familiar with20:41
RockygThat's a good idea.  Rating its usefulness20:41
nkrinneri think keystone had some quite ugly logs, but then i usually don't touch keystone, so maybe i was simply not educated enought to read them20:42
*** vishwanathj has quit IRC20:42
jokke_nkrinner: make a note for us somewhere, example could be good idea20:42
*** dannywilson has quit IRC20:42
Rockygnkrinner: you can put a comment or note on the spreadsheet, or add to the note I put on it.20:43
nkrinnerjokke_: true. this is what i remember vaguely20:43
*** dannywilson has joined #openstack-meeting-420:43
jokke_because if the logs on some specific services looks non intuitive, that's perhaps something we could affect20:44
*** ajayaa has quit IRC20:44
nkrinneri have to look at it again, maybe i blamed the wrong service :-/20:44
RockygPrecisely.  Or, more to the point, get them to be more precise;-)20:45
RockygSo, I think getting this started is a good thing.  Let me see if I can find that list of log files again to propagate the first column.  Once we have that, we can announce to the ml for comments, concerns, help filling in.20:47
nkrinneryes, i think it is a good start20:48
*** matrohon has quit IRC20:48
RockygI think I'm also going to add a earliest release column for when the file first appears in OpenStack..  Optional, so last.20:49
RockygGee.  anything to get out of editing that feakin' spec ;-)20:49
RockygJeez, just thought of another tool that ops guys would love for OpenStack.  A log registry.  If a new log is spun up, oslo has a library call that registers the log in a db or some such.20:51
nkrinneri think logs should be known and collected automatically anyway20:52
jokke_Rockyg: automatic log finder would probably not work with syslog20:53
Rockygnkrinner: you would think, but right now, it doesn't happen.  Each project generates what it thinks it needs in the places it has decided upon.  Wouldn't it be nice to have a central registry?20:53
Rockygjokke_ don't want a finder, want a register20:54
Rockygthen devs could find logs they need, too.20:54
nkrinnerhm. i think we have a tool for that already, let me check20:54
RockygKind of like the murano app catalog, but for logs20:54
nkrinnerit is a custom bash script, i think it is maintained manually20:56
Rockygthen that could be fed into logstash or whatever, with rules and create a customized best of collection of the distributed log files.20:56
RockygAnd if we know the type of log, that could help us determine how persistent it needs to be, also.20:57
RockygSome interesting thoughts.  But that said, we're near the end.20:57
Rockyg#action nkrinner to look into tagging bugs.20:57
jokke_yeah ... I've been thinking also, should we start log aggregator project to the OS or is there something doing that already20:58
*** vishwanathj has joined #openstack-meeting-420:58
nkrinneri know someone working on a logstash implementation afaik. maybe i have some news next week20:58
*** russellb has joined #openstack-meeting-420:58
jokke_nkrinner: sounds good, keep us posted20:58
RockygI found a launchpac query for log bugs from Tom Fifield: https://bugs.launchpad.net/openstack/+bugs?field.searchtext=&orderby=-importance&field.status%3Alist=NEW&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=FIXCOMMITTED&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE&assignee_option=any&field.assignee=&field.bug_reporter=&field.20:58
Rockygbug_commenter=&field.subscriber=&field.structural_subscriber=&field.tag=log&field.tags_combinator=ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on&search=Search20:58
RockygIt's supposed to find any bug tagged with "log" ?20:59
jokke_ouch20:59
RockygYeah.  But, you work with whatch got.20:59
RockygIt's a start.20:59
Rockygso, Thanks everyone.  a working session is a good session.20:59
Rockyg3endmeeting21:00
jokke_yeah, and it's time ... thanks both of you ... good discussion today21:00
Rockyg#endmeeting21:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"21:00
openstackMeeting ended Wed Apr 22 21:00:07 2015 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-04-22-20.01.html21:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-04-22-20.01.txt21:00
openstackLog:            http://eavesdrop.openstack.org/meetings/log_wg/2015/log_wg.2015-04-22-20.01.log.html21:00
nkrinnercool thanks, see you next week21:00
jokke_nite21:00
RockygPleasant dreams!21:00
nkrinnersee you21:00
*** nkrinner has quit IRC21:00
Rockygnext week! same bat time. same bat station21:00
*** fnaval has quit IRC21:00
*** xingchao has joined #openstack-meeting-421:01
*** VW_ has joined #openstack-meeting-421:03
*** xingchao has quit IRC21:05
*** fnaval has joined #openstack-meeting-421:08
*** ivar-laz_ has joined #openstack-meeting-421:08
*** erikmwilson has quit IRC21:11
*** ivar-lazzaro has quit IRC21:11
*** fnaval has quit IRC21:13
*** fnaval_ has joined #openstack-meeting-421:13
*** sarob has quit IRC21:25
*** sarob has joined #openstack-meeting-421:31
*** Rockyg has quit IRC21:32
*** yamahata has joined #openstack-meeting-421:34
*** igordcard has joined #openstack-meeting-421:37
*** sacharya has quit IRC21:38
*** banix has quit IRC21:41
*** banix has joined #openstack-meeting-421:42
*** sdake has quit IRC21:44
*** ivar-laz_ has quit IRC21:45
*** ivar-lazzaro has joined #openstack-meeting-421:45
*** yamahata has quit IRC21:46
*** bknudson has quit IRC21:46
*** ivar-laz_ has joined #openstack-meeting-421:58
*** aduarte has quit IRC22:00
*** ivar-lazzaro has quit IRC22:01
*** banix has quit IRC22:02
*** vishwanathj has quit IRC22:02
*** vishwanathj has joined #openstack-meeting-422:03
*** Swami has quit IRC22:04
*** bknudson has joined #openstack-meeting-422:05
*** klamath has quit IRC22:06
*** vishwanathj has quit IRC22:08
*** ivar-laz_ has quit IRC22:19
*** ivar-lazzaro has joined #openstack-meeting-422:19
*** VW_ has quit IRC22:24
*** banix has joined #openstack-meeting-422:25
*** VW_ has joined #openstack-meeting-422:28
*** sdake has joined #openstack-meeting-422:31
*** Swami has joined #openstack-meeting-422:46
*** bharath has quit IRC22:47
*** Swami has quit IRC22:52
*** bharath has joined #openstack-meeting-422:54
*** Rockyg has joined #openstack-meeting-422:58
*** eghobo_ has joined #openstack-meeting-423:00
*** ChuckC has quit IRC23:00
*** eghobo has quit IRC23:02
*** vishwanathj has joined #openstack-meeting-423:03
*** aventerav has quit IRC23:04
*** vishwanathj has quit IRC23:08
*** vishwanathj has joined #openstack-meeting-423:09
*** vishwanathj has quit IRC23:09
*** vishwanathj has joined #openstack-meeting-423:09
*** ajo has quit IRC23:10
*** VW_ has quit IRC23:12
*** vishwanathj has quit IRC23:14
*** BjoernT has quit IRC23:15
*** bharath has quit IRC23:16
*** eghobo_ has quit IRC23:18
*** carl_baldwin_ has quit IRC23:20
*** ChuckC has joined #openstack-meeting-423:21
*** vishwanathj has joined #openstack-meeting-423:22
*** carl_baldwin has quit IRC23:22
*** david-lyle has joined #openstack-meeting-423:24
*** ChuckC has quit IRC23:25
*** Rockyg has quit IRC23:25
*** ChuckC has joined #openstack-meeting-423:25
*** markvoelker has quit IRC23:26
*** bharath has joined #openstack-meeting-423:26
*** sigmavirus24 is now known as sigmavirus24_awa23:27
*** eghobo has joined #openstack-meeting-423:29
*** vishwanathj has quit IRC23:32
*** vishwanathj has joined #openstack-meeting-423:32
*** xingchao has joined #openstack-meeting-423:33
*** vishwanathj has quit IRC23:37
*** sdake has quit IRC23:39
*** banix has quit IRC23:39
*** dannywilson has quit IRC23:39
*** eghobo has quit IRC23:41
*** eghobo has joined #openstack-meeting-423:46
*** buchi has joined #openstack-meeting-423:47
*** bharath has quit IRC23:47
*** bharath_ has joined #openstack-meeting-423:47
*** ajmiller has quit IRC23:51
*** banix has joined #openstack-meeting-423:54
*** bharath_ has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!