Thursday, 2012-06-21

*** jakedahn is now known as jakedahn_zz00:00
*** jakedahn_zz is now known as jakedahn00:02
*** jog0 has quit IRC00:19
*** littleidea has joined #openstack-meeting00:21
*** johnpostlethwait has quit IRC00:22
*** johnpostlethwait has joined #openstack-meeting00:23
*** littleidea has quit IRC00:25
*** joearnold has quit IRC00:25
*** joearnold has joined #openstack-meeting00:26
*** littleidea has joined #openstack-meeting00:27
*** dolphm has joined #openstack-meeting00:36
*** joearnold has quit IRC00:38
*** ryanpetr_ has joined #openstack-meeting00:38
*** nati_uen_ has quit IRC00:38
*** nati_ueno has joined #openstack-meeting00:39
*** johnpostlethwait has quit IRC00:41
*** ryanpetrello has quit IRC00:41
*** matwood has joined #openstack-meeting00:43
*** blamar has quit IRC00:45
*** s0mik has quit IRC00:45
*** zul has joined #openstack-meeting00:45
*** littleidea has quit IRC00:46
*** edygarcia has quit IRC00:46
*** ryanpetr_ has quit IRC00:48
*** ryanpetrello has joined #openstack-meeting00:49
*** ryanpetrello has quit IRC00:53
*** edygarcia has joined #openstack-meeting00:57
*** ryanpetrello has joined #openstack-meeting00:58
*** dwcramer has joined #openstack-meeting01:03
*** ayoung has quit IRC01:05
*** matwood has quit IRC01:06
*** ozstacker has quit IRC01:07
*** rnirmal has joined #openstack-meeting01:17
*** matwood has joined #openstack-meeting01:19
*** ryanpetrello has quit IRC01:21
*** anotherjesse is now known as anotherjesse_zz01:22
*** edygarcia has quit IRC01:23
*** nati_ueno has quit IRC01:29
*** reed has quit IRC01:31
*** PotHix has quit IRC01:42
*** nyov has quit IRC01:55
*** nyov has joined #openstack-meeting01:56
*** dolphm has quit IRC01:58
*** dolphm has joined #openstack-meeting02:01
*** dolphm has quit IRC02:04
*** Mandell has quit IRC02:18
*** novas0x2a|laptop has quit IRC02:19
*** Mandell has joined #openstack-meeting02:28
*** reed has joined #openstack-meeting02:38
*** markmcclain has joined #openstack-meeting02:38
*** Mandell has quit IRC02:50
*** ryanpetrello has joined #openstack-meeting02:54
*** ozstacker has joined #openstack-meeting03:07
*** rnirmal has quit IRC03:10
*** dwcramer has quit IRC03:18
*** s0mik has joined #openstack-meeting03:19
*** zigo has joined #openstack-meeting03:30
*** anderstj has joined #openstack-meeting03:32
*** novas0x2a|laptop has joined #openstack-meeting03:39
*** zigo has quit IRC03:41
*** dwcramer has joined #openstack-meeting03:57
*** s0mik has quit IRC03:58
*** edygarcia has joined #openstack-meeting04:13
*** mdomsch has joined #openstack-meeting04:20
*** s0mik has joined #openstack-meeting04:23
*** zigo has joined #openstack-meeting04:25
*** clayg has left #openstack-meeting04:25
*** markmcclain has quit IRC04:26
*** dwcramer has quit IRC04:28
*** dtroyer is now known as dtroyer_zzz04:37
*** matwood has quit IRC04:38
*** garyk has quit IRC04:39
*** dwcramer has joined #openstack-meeting04:41
*** Mandell has joined #openstack-meeting04:57
*** anotherjesse_zz is now known as anotherjesse05:02
*** s0mik has quit IRC05:07
*** ravi has joined #openstack-meeting05:13
*** ravi has left #openstack-meeting05:13
*** ryanpetrello has quit IRC05:15
*** sleepsonthefloor is now known as sleepsonzzz05:43
*** shang has joined #openstack-meeting05:55
*** danwent has joined #openstack-meeting05:58
*** garyk has joined #openstack-meeting06:00
*** shang has quit IRC06:03
*** anderstj has quit IRC06:12
*** shang has joined #openstack-meeting06:26
*** edygarcia has quit IRC06:27
*** danwent has quit IRC06:30
*** danwent has joined #openstack-meeting06:39
*** zigo has quit IRC07:07
*** anotherjesse is now known as anotherjesse_zz07:25
*** anotherjesse_zz is now known as anotherjesse07:25
*** anotherjesse is now known as anotherjesse_zz07:27
*** ttrifonov_zZzz is now known as ttrifonov07:34
*** dwcramer has quit IRC07:50
*** darraghb has joined #openstack-meeting08:06
*** danwent has quit IRC08:09
*** danwent has joined #openstack-meeting08:43
*** matwood has joined #openstack-meeting09:03
*** zigo has joined #openstack-meeting09:53
*** danwent_ has joined #openstack-meeting10:06
*** danwent has quit IRC10:06
*** danwent_ is now known as danwent10:06
*** Mandell has quit IRC10:08
*** matwood has quit IRC10:10
*** ncode has joined #openstack-meeting10:24
*** ncode has quit IRC10:35
*** GheRivero has quit IRC11:09
*** GheRivero has joined #openstack-meeting11:09
*** sandywalsh has quit IRC11:27
*** dwcramer has joined #openstack-meeting11:51
*** markvoelker has joined #openstack-meeting11:52
*** ryanpetrello has joined #openstack-meeting12:33
*** nati_ueno has joined #openstack-meeting12:36
*** nati_ueno has quit IRC12:40
*** hggdh has quit IRC12:45
*** hggdh has joined #openstack-meeting12:48
*** janisg has joined #openstack-meeting12:49
*** GheRivero has quit IRC12:51
*** joearnold has joined #openstack-meeting12:58
*** dwcramer has quit IRC12:58
*** ryanpetrello has quit IRC13:02
*** gholt has joined #openstack-meeting13:11
*** hggdh has quit IRC13:17
*** hggdh has joined #openstack-meeting13:17
*** dprince has joined #openstack-meeting13:24
*** danwent has quit IRC13:25
*** joearnold has quit IRC13:25
*** jaypipes has joined #openstack-meeting13:28
*** danwent has joined #openstack-meeting13:31
*** danwent has quit IRC13:32
*** ayoung has joined #openstack-meeting13:37
*** markmcclain has joined #openstack-meeting13:45
*** markmcclain has joined #openstack-meeting13:45
*** dwcramer has joined #openstack-meeting13:46
*** dtroyer_zzz is now known as dtroyer13:48
*** joesavak has joined #openstack-meeting13:50
*** dolphm has joined #openstack-meeting13:53
*** mattray has joined #openstack-meeting13:57
*** GheRivero has joined #openstack-meeting13:57
*** mnaser has quit IRC13:58
*** edygarcia_ has joined #openstack-meeting14:00
*** danwent has joined #openstack-meeting14:14
*** Mandell has joined #openstack-meeting14:15
*** danwent_ has joined #openstack-meeting14:17
*** danwent has quit IRC14:17
*** danwent_ is now known as danwent14:17
*** ryanpetrello has joined #openstack-meeting14:30
*** nati_ueno has joined #openstack-meeting14:31
*** ryanpetrello has joined #openstack-meeting14:34
*** matwood has joined #openstack-meeting14:35
*** mnaser has joined #openstack-meeting14:39
*** zigo has quit IRC14:43
*** sandywalsh has joined #openstack-meeting14:45
*** Mandell has quit IRC14:45
*** rnirmal has joined #openstack-meeting14:53
*** metral has joined #openstack-meeting14:56
*** sleepsonzzz is now known as sleepsonthefloor15:01
*** reed has quit IRC15:08
*** nati_ueno has quit IRC15:08
*** nati_ueno has joined #openstack-meeting15:12
*** nati_ueno has quit IRC15:14
*** zigo has joined #openstack-meeting15:27
*** mdomsch has quit IRC15:30
*** ryanpetrello has quit IRC15:32
*** joearnold has joined #openstack-meeting15:33
*** markmcclain has quit IRC15:34
*** joearnold has quit IRC15:44
*** garyk has quit IRC15:46
*** nati_ueno has joined #openstack-meeting15:48
*** sandywalsh has quit IRC15:56
nijabao/15:58
*** blamar has joined #openstack-meeting15:59
nijaba#startmeeting16:00
nijaba#meetingtopic Ceilometer16:00
nijaba#chair nijaba16:00
nijaba#link http://wiki.openstack.org/Meetings/MeteringAgenda16:00
openstackMeeting started Thu Jun 21 16:00:03 2012 UTC.  The chair is nijaba. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: Ceilometer)"16:00
openstackCurrent chairs: nijaba16:00
dhellmannpresent16:00
nijaba#info dachary will unfortunately not be able to join us this week for work related reasons, he asked me to present his excuses.16:00
nijabajd___: around?16:00
nijabaanyone else?16:00
jd___i'm here16:00
*** flacoste has joined #openstack-meeting16:00
nijaba#topic actions from previous meetings16:01
*** openstack changes topic to "actions from previous meetings (Meeting topic: Ceilometer)"16:01
nijaba#topic  nijaba: to point to the calculator in the blueprint16:01
nijabathis is done.  Available at16:01
nijaba#link http://wiki.openstack.org/EfficientMetering#Volume_of_data16:01
*** openstack changes topic to "nijaba: to point to the calculator in the blueprint (Meeting topic: Ceilometer)"16:01
nijabaany comments on this?16:01
jd___nope16:01
nijaba#topic dhellmann: start mapping API queries to database engine methods16:01
*** openstack changes topic to "dhellmann: start mapping API queries to database engine methods (Meeting topic: Ceilometer)"16:01
dhellmannwe ran a few different numbers through the calculator. it's a good tool for estimating for us.16:02
nijabathanks dhellmann :)16:02
dhellmannI posted a proposed API to the list but haven't seen any feedback. Did anyone have a chance to review it?16:02
nijabadhellmann: I did, and I am quite happy with your proposal.  I don;t have any clean solution for the problem you stated though16:02
dhellmannmaybe when we start the implementation the solution will become more clear16:03
* nijaba crosses his fingers16:03
jd___dhellmann: probably16:03
nijabaok, moving on then :)16:04
nijaba#topic dhellmann: look at existing plugins and pick one of each for examples in docs and email info on examples to nijaba16:04
nijabaI can confirm this was done and I received dhellmann's email16:04
jd___dhellmann: that seems at least as a good boilerplate16:04
*** openstack changes topic to "dhellmann: look at existing plugins and pick one of each for examples in docs and email info on examples to nijaba (Meeting topic: Ceilometer)"16:04
nijabathanks for this dhellmann16:04
dhellmannthank you for volunteering to bootstrap the documentation :-)16:05
flacostedhellmann: why don't you want to make the two parameters optionals and add an assert at the start of the method?16:05
dhellmannflacoste, because then the user of the API has to know about the internal rules16:05
flacostethere is another possibility16:06
*** joearnold has joined #openstack-meeting16:06
flacostehave DB.get_raw_events_by_user() and DB.get_raw_events_by_project() be thin wrapper around DB._internal_get_raw_events(project, user)16:06
dhellmannflacoste, yes, we could implement it that way. Whether or not that makes sense is left up to the engine author. I was trying to create an API  that was consistent from the outside perspective without considering implementation details.16:07
nijabadhellmann: and I think you achieved this goal quite well16:08
flacostedhellmann: then what you have is probably good enough16:08
nijabashould we move on?16:08
dhellmannwe'll implement one or two and see if we can improve on the API after that16:09
dhellmannyes16:09
nijaba#topic nijaba: to prime the doc once info received from dhellmann16:09
nijabaI unfortunately did not have time to complete this task.  Reassigning to next week16:09
nijaba#action nijaba: to prime the doc on plugins16:09
*** openstack changes topic to "nijaba: to prime the doc once info received from dhellmann (Meeting topic: Ceilometer)"16:09
nijabasorry, did have to cover an event this week, which hate a lot of my time16:09
jd___s/hate/ate/ I hope16:09
nijabarighhhhhtttt16:09
jd___;-)16:10
dhellmanndepends on the event :-)16:10
nijabahehe16:10
nijabamoving on16:10
*** joearnold has quit IRC16:10
nijaba#topic nijaba: to prepare incubation application for review at the next meeting16:10
nijabaso I did prepare this, you can review my work at:16:10
nijaba#link http://wiki.openstack.org/Projects/IncubatorApplicationCeilometer16:10
nijabaany comments, suggestions or remarks?16:10
*** openstack changes topic to "nijaba: to prepare incubation application for review at the next meeting (Meeting topic: Ceilometer)"16:10
dhellmannI haven't had a chance to review it, yet. I will try to do that this week.16:10
nijabaso I am going to give you a few minutes so that you have time to read16:10
*** joearnold has joined #openstack-meeting16:11
nijabaor should we mark it as an action for next week?16:11
dhellmanncan we discuss next week? or do we need to submit it before then?16:11
nijabanope, no hurry I think16:11
nijaba#action during next week meeting we will vote on the Incubation application16:12
nijaba#topic dachary: talk to Dragon about SystemData / ceilometer and try to create cooperation16:13
nijabadachary not beeing around I'll push this to next week's meeting16:13
*** openstack changes topic to "dachary: talk to Dragon about SystemData / ceilometer and try to create cooperation (Meeting topic: Ceilometer)"16:13
*** garyk has joined #openstack-meeting16:13
nijaba#action dachary: talk to Dragon about SystemData / ceilometer and try to create cooperation16:13
nijaba#topic dhellmann: to talk to Quantum devs about integration with ceilometer16:13
*** openstack changes topic to "dhellmann: to talk to Quantum devs about integration with ceilometer (Meeting topic: Ceilometer)"16:13
dhellmannI have discussed this with my coworker privately, but have not approached the Quantum devs publicly, yet.16:14
dhellmann#action dhellmann: talk to Quantum devs about integration with ceilometer16:14
*** jmckenty has joined #openstack-meeting16:14
nijaba#topic dachary: to talk to swift devs about integration with ceilometer16:14
nijabadachary not beeing around I'll push this to next week's meeting16:14
*** openstack changes topic to "dachary: to talk to swift devs about integration with ceilometer (Meeting topic: Ceilometer)"16:14
nijaba#action  dachary: to talk to swift devs about integration with ceilometer16:14
nijaba#topic nijaba: to talk to cinder devs about integration with ceilometer16:14
nijabaI did start the discussion with them on the ML.  jgriffith said he would be joining the meeting today to start discussing16:14
*** openstack changes topic to "nijaba: to talk to cinder devs about integration with ceilometer (Meeting topic: Ceilometer)"16:14
*** winston-d has joined #openstack-meeting16:15
nijabajgriffith: ping?16:15
nijabaok, it seems that he is not around atm.  We'll come back to it eventually16:16
nijaba#topic jd___: to talk to glance devs about integration with ceilometer16:16
*** openstack changes topic to "jd___: to talk to glance devs about integration with ceilometer (Meeting topic: Ceilometer)"16:16
jd___I did it at https://lists.launchpad.net/openstack/msg13331.html16:17
jd___conclusion is that we seem to doing the right thing so far :)16:17
nijabayes, I saw that.  Thank for the email template I reused for initiating the conversion with cinder, btw ;)16:17
jd___hehe I saw that too :-)16:17
nijabaany comments on this?16:18
dhellmanndid I see someone suggest tying in via the client library? or did I misunderstand a response?16:18
*** nati_uen_ has joined #openstack-meeting16:18
nijabadhellmann: that was about cinder I believe16:18
dhellmannah, ok16:19
dhellmannI've been dealing with some local issues, so I'm a little behind on email. Did you explain why that wouldn't work?16:19
nijabadhellmann: we could poll cinder via the client library, but volume creations/del could be nice events to catch16:19
dhellmannah, polling via the client does make some sense, if it gives the data we need16:20
nijabawe just need to check that the client lib does have the requested data ;)16:20
*** nati_ueno has quit IRC16:20
dhellmannok, it sounds like things are moving in the right direction. -- true :-)16:21
nijabaI would agree16:21
nijaba#topic Status of the essex compatibility effort that jd is leading16:21
*** openstack changes topic to "Status of the essex compatibility effort that jd is leading (Meeting topic: Ceilometer)"16:21
jgriffithnijaba: sorry, was stuck in a meeting16:22
dhellmannthat may get easier, once we move to the openstack.common RPC libraries (in addition to the other parts of common we're already using)16:22
nijabajgriffith: np.  Let's finish on this topic and we'll come back to you in a sec16:22
*** AlanClark has joined #openstack-meeting16:23
nijabajd___: do you have an update about essex compat?16:23
jd___yeah, my patches for testing have been merged16:24
jd___but i'm not sure they are set up in the real jenkins yet16:24
nijabacool! any blockers found?16:24
jd___not so far, for the part being tested at least :)16:24
nijabaany action on that topic for next week?16:25
jd___we should add some more tests, at least simulating the daemon launch because I know this is going to fail on essex16:25
jd___and checks that my openstack-ci stuff are working :)16:26
nijabajd___: Feel free to add  #action for this :)16:26
dhellmannjd___ can we crib test infrastructure from the nova tests for Service?16:26
jd___dhellmann: I hope so!16:26
dhellmann :-)16:26
jd___#action jd___ check that openstack-ci runs the tests for Essex16:27
jd___#action jd___ add some tests on daemon launching16:27
nijabathanks.  Shall we get back to cinder?16:27
jd___yep16:27
nijaba#topic discussion about cinder integration16:27
*** openstack changes topic to "discussion about cinder integration (Meeting topic: Ceilometer)"16:27
nijabajgriffith: thanks for joining!16:27
jgriffithSure... sorry I was late16:28
nijabajgriffith: so, we think we could build a ceilmoter agent that would poll the cinder client for volume usage per user16:28
nijabajgriffith: any pointer on what call we should make?16:29
jgriffithSo I think that would be doable in terms of the client.  We might want to just implement a specific call via extension?16:29
*** markmcclain has joined #openstack-meeting16:29
*** ayoung has quit IRC16:29
jgriffithThat way providers that are worried about security etc can choose to not load16:29
nijabaoh, you mean that the call would be open to anyone?16:30
*** oubiwann1 has joined #openstack-meeting16:30
jgriffithYeah, probably...not sure how else to implement it16:30
dhellmannthis is more of an "admin" feature for internal use, although I can see the information being useful to end-users if they are restricted to asking about their own account(s)16:30
nijabaI would rather find something that would not expose this data by default to somthing else than ceilometer16:30
jgriffithdhellmann: got ya, but not sure how you'd limit that, unless you do it via the context?16:31
dhellmannjgriffith, we're getting into an area of OS I16:31
dhellmann'm not familiar with16:31
jgriffithnijaba: I would prefer that as well16:31
dhellmannI know there is a way to separate the public and admin APIs, but I don't know how16:31
jd___jgriffith: context is probably fine, you use a policy engine too?16:31
jgriffithdhellmann: Ok, I can look into that16:31
jgriffithjd___: Yes, we could set that up as well.16:32
jgriffithmight be best to get some input from folks on the best way to coordinate and make this happen16:32
jgriffithalso, need to be honest about resources on the cinder team... they're a bit thin16:32
nijabaI guess the ml would be the best place to ask for this?16:32
jgriffithSo depending on how heavy a lift we're looking at on the cinder side it could dictate timelines16:32
jgriffithnijaba: Yes, I think it's best to get it out on the ML16:33
dhellmannjgriffith, I'm sure we could contribute resources for implementation if it comes down to that16:33
jgriffithnijaba: It's painful at first with all of the feedback but it should give us some good direction16:33
jgriffithdhellmann: excellent16:33
dhellmann we're expecting to do that for all of the integration work, to varying degrees16:33
nijabawho wants to take the action to bring the question to the ml?16:34
nijabaok, I guess it will be me then?16:34
dhellmannunless jgriffith can do it?16:34
nijaba#action nijaba to question best method to authenticate admin client calls from ceilometer to cinder (and other projects)16:36
nijabajgriffith: another point that we could want to capture are volume events, such as creation/deletion etc...  do you publish them currently somewhere?16:37
jgriffithnijaba: No, we don't16:37
*** gyee has joined #openstack-meeting16:37
jgriffithSo we keep things in the db like creation/deletion time but don't actually capture the events anywhere that I'm aware of16:38
nijabaok, so that would be something else we would have to look into16:38
dhellmannis that a conscious decision, or something you just haven't gotten to yet?16:38
dhellmannIOW, if we contributed some patches to emit notifications, would that be OK?16:38
*** joearnold has quit IRC16:38
*** ryanpetrello has joined #openstack-meeting16:39
*** anderstj has joined #openstack-meeting16:40
nijabajgriffith: would you like us to join one of your meeting to discuss this further?16:40
*** littleidea has joined #openstack-meeting16:41
*** Mike66 has joined #openstack-meeting16:42
nijabaok, I think jgriffithmaybe experiencing some technical difficulties16:42
*** littleidea has quit IRC16:42
nijabashould we tab this and move it to the ml as well?16:42
dhellmannyes16:43
flacoste+116:43
nijaba#action nijaba to include adding events to cinder to previous action16:43
jgriffithsorry... booted out16:43
*** lloydde has joined #openstack-meeting16:43
jgriffithnijaba: Maybe next wed, let's talk offline between now and then and have a game plan though16:44
*** littleidea has joined #openstack-meeting16:44
nijabajgriffith: sounds good to me.16:44
jgriffithnijaba: great16:44
nijabajgriffith: when is your meeting on wed?16:44
*** s0mik has joined #openstack-meeting16:45
*** mnaser has quit IRC16:45
nijaba#link http://wiki.openstack.org/NovaVolumeMeetings16:46
nijabaso same time as ours, but on wed16:46
nijabawho will be able to join?16:46
dhellmannI should be able to join a little late16:47
nijabaok great.  I'll be there too16:47
nijabalet's move on to Open Discussion16:47
nijaba#topic open discussion16:47
*** openstack changes topic to "open discussion (Meeting topic: Ceilometer)"16:47
nijabaanything else someone wants to bring up?16:48
*** jmckenty has quit IRC16:48
jd___nope16:48
jgriffithnijaba: 1600 UTC16:48
*** mnaser has joined #openstack-meeting16:48
dhellmannjd___, how goes the pep8 / conf patch work?16:48
jd___dhellmann: did not check yet :(16:49
dhellmannok16:49
jd___I need to upgrade pep816:49
jd___and for whatever reason my pip fails!16:49
nijabajgriffith: great, so dhellmann and I will be joining and I'll initiate a private thread between the 3 of us. thanks16:49
nijaba#action  dhellmann and nijba will be joining and nijaba will initiate a private thread with jgriffith16:51
nijabaok, looks like we are done with the agenda for today16:51
nijabathanks everyone for joining!16:51
dhellmanngood meeting, we ended early :-)16:52
nijaba#endmeeting16:52
*** openstack changes topic to "OpenStack meeting channel. See http://wiki.openstack.org/Meetings for schedule and http://eavesdrop.openstack.org/meetings/openstack-meeting/ for meeting logs"16:52
openstackMeeting ended Thu Jun 21 16:52:14 2012 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:52
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-16.00.html16:52
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-16.00.txt16:52
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-16.00.log.html16:52
*** flacoste has left #openstack-meeting16:53
*** donaldngo has joined #openstack-meeting16:55
*** JoseSwiftQE has joined #openstack-meeting16:59
*** rohitk has joined #openstack-meeting16:59
jaypipeshey y'all17:00
jaypipes#startmeeting17:00
openstackMeeting started Thu Jun 21 17:00:25 2012 UTC.  The chair is jaypipes. Information about MeetBot at http://wiki.debian.org/MeetBot.17:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:00
JoseSwiftQEhi!17:00
rohitkHello!17:00
jaypipesdavidkranz_: around?17:01
davidkranz_Here now.17:01
*** davidkranz_ is now known as davidkranz17:01
jaypipesheya17:02
davidkranzjaypipes: You saw that Daryl can't make it, right?17:02
jaypipesyeah17:02
JoseSwiftQEWe're pretty much all bowing out this week, meeting conflicts and the like.17:02
jaypipesso I'm getting increasingly more frustrated with running tempest with multiple parallel processes...17:02
davidkranzjaypipes: Anything I could help with?17:03
jaypipestrying to diagnose Nova timeouts is getting very annoying.17:03
*** PotHix has joined #openstack-meeting17:03
jaypipesdavidkranz: I'm not sure :(17:03
*** gyee has quit IRC17:03
jaypipesdavidkranz: the problem is that when I run the tests without --processes, it takes a while but eventually completes. If I run with --processes=8 (my box is a 12-core machine), after a while I start seeing RPC timeouts in networking. and then shit starts snowballing after that.17:04
davidkranzjaypipes: Hmm.17:05
*** JoseSwiftQE has left #openstack-meeting17:05
jaypipesdavidkranz: and it's not an issue with quotas, because I've made the base compute test class create its own tenant/user for its testing.17:05
jaypipesdavidkranz: I'm wondering if Nova just can't keep up with it.17:05
davidkranzjaypipes: That's what I was thinking. Are you using a single devstack node?17:05
jaypipesdavidkranz: so I will reset my env (yet again) and try with processes=2 instead, and see if things work better.17:05
jaypipesdavidkranz: yup, but frankly, the box has 12 cores and 24G of memory... should NOT be an issue17:06
davidkranzjaypipes: We need to separate nova stress issues from tempest paralleliaztion issues.17:06
jaypipesdavidkranz: I'm actually not trying to stress Nova! :) Just trying to run the tempest test suite in a shorter amount of time with parallel processes17:07
davidkranzjaypipes: The number of cores might not matter if there is only one api server or nova-network server.17:07
jaypipesdavidkranz: right.17:07
*** JoseSwiftQE has joined #openstack-meeting17:07
davidkranzjaypipes: You may not be trying to stress, but if you are running 8 copies of tempest then you are!17:07
*** Carlos_Swift_QE has joined #openstack-meeting17:07
jaypipesdavidkranz: here's the kicker, though: when tempest starts crawling (after these RPC timeouts), doing a virsh list --all hangs indefinitely. So I think this may actually be a libvirt issue./17:08
jaypipesdavidkranz: not running 8 copies of tempest... just oine copy of tempest, with all the tests split across 8 processes.17:08
davidkranzjaypipes: I will take a try running against a multi-node system with nova-network running on all compute nodes.17:08
jaypipesdavidkranz: k, I will push my code then for you to pull.17:09
davidkranzjaypipes: 8 copies of one with 8 processes still puts the same amount of transient stress, just for shorter duratino overall17:10
davidkranzjaypipes: I meant "or" one with 8 processes.17:10
jaypipessure17:10
jaypipesbut that doesn't explain libvirt/QEMU hanging. :(17:10
jaypipesI'm going to chat with vish about the libvirt non-blocking mode patch that is currently in the queue to see if that might help17:11
davidkranzjaypipes: It is also possible this is a result of some post-essex regression.17:11
jaypipesyeah17:12
davidkranzjaypipes: I think I should work on getting some version of the stress tests into a job that runs every night.17:12
*** joearnold has joined #openstack-meeting17:12
*** Mandell has joined #openstack-meeting17:12
jaypipesdavidkranz: that would be good, yes.17:13
jaypipesdavidkranz: problem is, running stress tests on a 4G VM in the CI environment isn't particularly useful in reporting real errors...17:13
davidkranzjaypipes: Yes, we need a real cluster for that. We will also need a real cluster when there are real performance tests.17:13
jaypipesindeed17:14
jaypipeswell, besides me bitching about this, are there particular topics we need to discuss this week?17:14
davidkranzjaypipes: Just what we should do about the resource thing.17:15
*** ayoung has joined #openstack-meeting17:15
davidkranzjaypipes: Daryl seemed to think it was related to something you were working on.17:15
jaypipesdavidkranz: well, the original patch I put together for the refactoring of smoke tests did have a resource manager in the base test classes.17:16
jaypipesI believe that is what he means17:16
*** reed has joined #openstack-meeting17:16
davidkranzjaypipes: OK. Perhaps you can comment on the email I sent outlining my "counter-proposal".17:16
jaypipesdavidkranz: I will, yes17:17
davidkranzjaypipes: Great.17:17
rohitkjaypipes: Are we taking a direction on the negative tests re-factor? I've submitted a lot of negative tests, how can I help?17:17
davidkranzjaypipes: Nothing else that I know of at the moment.17:17
rohitk1. Identifying overlaps in unit tests17:18
jaypipesrohitk: we are not adding any more negative tests at this point. Instead, we are looking at using a grammar-based fuzz testing tool like randgen to do negative API testing17:18
rohitkjaypipes: hmmm17:18
rohitkjaypipes: The randgen would do negative API (blackbox) testing17:19
jaypipesrohitk: correct.17:19
jaypipesrohitk: although so do the unit tests mostly.17:19
rohitkjaypipes: I think that would depend on the FuzzClientManager17:19
rohitk?17:19
jaypipesyes.17:20
rohitkjaypipes: ok, I'll look up the randgen LP link that you put up in the e-mail17:20
rohitkthanks!17:20
jaypipesrohitk: basically, the recent addition of so many negative test cases have made tempest run about 200% longer than before, and we need to find a better, faster strategy instead of adding a test method for every possible negative iteration17:20
rohitkjapypipes: totally agree, there is little value in making tests unnecessarily run longer17:21
davidkranzjaypipes: As soon as you push your code I will give it a try.17:22
jaypipesdavidkranz: k, thx17:22
*** zigo has quit IRC17:22
* jaypipes wishes there were 30 hours in a day... :(17:23
jaypipesalright... JoseSwiftQE, any update on swift?17:23
rohitkjaypipes: I've also tracked updates on the Bugs filed for the Skipped tests, i'll wear the SkipCaptain hat for cleaning those up17:25
vishyjaypipes: libvirt hang: is it on oneiric?17:25
jaypipesvishy: yep17:25
*** jeblair has quit IRC17:25
JoseSwiftQEjaypipes:  No changes since last meeting.  Just waiting for reviews.17:25
jaypipesrohitk: thx. where are you keeping track of that stuff?17:25
jaypipesJoseSwiftQE: k, thx17:26
vishyjaypipes: it is a libvirt bug that has been discussed on the ml17:26
rohitki saw updates on many of the keystone bugs filed by myself, have'nt tracked them at a place yet,17:26
rohitkjaypipes: but will do17:26
jaypipesvishy: it's that RPC timeout thing... it's back. Whenever I run with --processes=X where X is >117:26
vishyjaypipes: oh nm then17:26
jaypipesvishy: and libvirt just seems to hang and ERROR builds just pile up.17:26
*** mnaser has quit IRC17:27
*** GheRivero has quit IRC17:27
vishyjaypipes: oh i have a good idea about that17:27
jaypipesvishy: do tell!17:27
vishyjaypipes: are you sure it is libvirt that is hanging?17:27
*** gyee has joined #openstack-meeting17:28
jaypipesvishy: if I do a virsh list --all, it hangs. doign ps aux |grep kvm shows a bunch of instances17:28
vishyjaypipes: it is probably this: http://www.gossamer-threads.com/lists/openstack/dev/8808?do=post_view_threaded#880817:28
*** fattarsi has joined #openstack-meeting17:28
vishyjaypipes: solution: use precise :)17:28
*** jeblair has joined #openstack-meeting17:29
*** mnaser has joined #openstack-meeting17:29
jaypipesvishy: heh.17:29
*** winston-d has quit IRC17:30
davidkranzjaypipes: I think that explains it. Notice the comment from me in that thread. I have been using precise since April...17:30
jaypipesdavidkranz: k.17:30
jaypipesI will try installing 12.04 then17:30
jaypipesdist-upgrade from oneric to precise is a complete FAIL.17:31
davidkranzjaypipes: Good idea. Just beware that there are some incompatibilities with glance I ran into,.17:31
jaypipesI'll pull another 12.04 iso and reinstall everything... ugh.17:31
rohitkjaypipes: ++17:31
jaypipesdavidkranz: what incompats?17:31
*** dhellmann_ has joined #openstack-meeting17:31
davidkranzjaypipes: It had to do with resyncing the database.17:32
davidkranzI don't remember the details. It was a while ago.17:32
jaypipesdavidkranz: oh, k\17:32
davidkranzjaypipes: And they may have been fixed. I was a guinea pig for 12.04 with Adam G.17:32
jaypipesheh17:32
*** dhellmann has quit IRC17:33
jaypipesalright y'all, I'm going to head out and install 12.04. davidkranz could you type up a very brief summary to the ML?17:34
jaypipes#endmeeting17:34
*** openstack changes topic to "OpenStack meeting channel. See http://wiki.openstack.org/Meetings for schedule and http://eavesdrop.openstack.org/meetings/openstack-meeting/ for meeting logs"17:34
openstackMeeting ended Thu Jun 21 17:34:14 2012 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:34
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-17.00.html17:34
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-17.00.txt17:34
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-21-17.00.log.html17:34
davidkranzjaypipes: Sure.17:34
*** Carlos_Swift_QE has quit IRC17:34
jaypipescya17:34
*** jaypipes has quit IRC17:34
rohitkthanks!17:34
*** gyee has quit IRC17:34
*** dhellmann_ has quit IRC17:36
*** littleidea has quit IRC17:38
*** littleidea has joined #openstack-meeting17:40
*** mnaser has quit IRC17:40
*** Mike66 has left #openstack-meeting17:41
*** danwent has quit IRC17:42
*** danwent has joined #openstack-meeting17:42
*** mnaser has joined #openstack-meeting17:42
*** adjohn has joined #openstack-meeting17:44
*** donaldngo has quit IRC17:44
*** rohitk has quit IRC17:47
*** jsavak has joined #openstack-meeting17:56
*** joearnold has quit IRC17:56
*** mnaser has quit IRC17:58
*** joesavak has quit IRC17:59
*** mnaser has joined #openstack-meeting17:59
*** joesavak has joined #openstack-meeting17:59
*** jsavak has quit IRC18:01
*** littleidea has quit IRC18:02
*** mnaser has quit IRC18:06
*** mnaser has joined #openstack-meeting18:06
*** littleidea has joined #openstack-meeting18:07
*** ryanpetrello has quit IRC18:11
*** joearnold has joined #openstack-meeting18:12
*** edygarcia_ has quit IRC18:12
*** JoseSwiftQE has left #openstack-meeting18:12
*** gyee has joined #openstack-meeting18:13
*** ryanpetrello has joined #openstack-meeting18:13
*** jakedahn is now known as jakedahn_zz18:16
*** darraghb has left #openstack-meeting18:16
*** matwood is now known as matwood-lunch18:18
*** johnpostlethwait has joined #openstack-meeting18:24
*** dwcramer has quit IRC18:25
*** littleidea has quit IRC18:31
*** gyee has quit IRC18:31
*** littleidea has joined #openstack-meeting18:33
*** sandywalsh has joined #openstack-meeting18:34
*** GheRivero has joined #openstack-meeting18:35
*** mdomsch has joined #openstack-meeting18:36
*** mnaser has quit IRC18:41
*** nati_uen_ has quit IRC18:42
*** nati_ueno has joined #openstack-meeting18:42
*** mnaser has joined #openstack-meeting18:43
*** sandywalsh has quit IRC18:45
*** joesavak has quit IRC18:45
*** joesavak has joined #openstack-meeting18:46
*** nati_ueno has quit IRC18:47
*** sandywalsh has joined #openstack-meeting18:47
*** adjohn has quit IRC18:49
*** jog0 has joined #openstack-meeting18:49
*** jakedahn_zz is now known as jakedahn18:52
*** mattray1 has joined #openstack-meeting18:52
*** mattray has quit IRC18:53
*** mattray1 is now known as mattray18:53
*** mattray has joined #openstack-meeting18:53
*** gholt has quit IRC18:53
*** s0mik has quit IRC18:55
*** gholt has joined #openstack-meeting18:55
*** jaypipes has joined #openstack-meeting18:58
*** s0mik has joined #openstack-meeting18:59
*** rnirmal_ has joined #openstack-meeting19:00
*** dwcramer has joined #openstack-meeting19:00
*** dolphm has quit IRC19:00
*** rnirmal_ has quit IRC19:01
*** nati_ueno has joined #openstack-meeting19:01
*** GheRivero has quit IRC19:02
*** rnirmal has quit IRC19:04
*** kindaopsdevy has joined #openstack-meeting19:05
*** littleidea has quit IRC19:10
*** jaypipes has quit IRC19:12
*** novas0x2a|laptop has quit IRC19:13
*** jaypipes has joined #openstack-meeting19:16
*** dolphm has joined #openstack-meeting19:22
*** dolphm_ has joined #openstack-meeting19:24
*** sandywalsh has quit IRC19:26
*** dolphm has quit IRC19:27
*** mattray has quit IRC19:40
*** novas0x2a|laptop has joined #openstack-meeting19:40
*** edygarcia has joined #openstack-meeting19:50
*** maoy has joined #openstack-meeting19:56
*** n0ano has joined #openstack-meeting19:58
*** dhellmann has joined #openstack-meeting20:01
maoyn0ano: hello20:01
n0anomaoy, hello20:01
n0anois it just you & I today?20:02
maoyn0ano: no idea. I just hang around..20:02
n0anolet's wait a few and see if anyone else joins20:03
n0anolooks like it's just us, have you gotten any feedback on your patch/proposal?20:06
maoyit's making good progress20:10
maoyn0nao: i'm fixing vm state machine right now. hopefully soon to move back to orchestration20:11
maoyn0ano: ^20:11
maoyn0ano: they are related anyway.. have to fix one before the other20:11
n0anosounds good, do we have anything to discuss today, looks like you're in the middle of implementation/debug for now.20:12
maoyyes20:12
maoynot much to discuss20:12
maoyhow's your trusted computing patch?20:12
*** krtaylor has quit IRC20:13
n0anoaccepted and I'm getting emails from people trying to use it so it's clearly getting some use, makes me happy20:14
maoycongrats20:14
maoyeurocup time is no good for any meetings I guess.20:15
n0anotnx (it only took 14 revisions of the patch :-)20:15
*** dolphm_ has quit IRC20:17
n0anogot to run, we'll catch up again next week.20:19
*** jsavak has joined #openstack-meeting20:20
maoybye20:21
*** dwcramer has quit IRC20:22
*** dolphm has joined #openstack-meeting20:23
*** joesavak has quit IRC20:24
*** jsavak has quit IRC20:24
*** mattray has joined #openstack-meeting20:28
*** markvoelker has quit IRC20:34
*** novas0x2a|lapto1 has joined #openstack-meeting20:35
*** novas0x2a|laptop has quit IRC20:36
*** dolphm has quit IRC20:36
*** dwcramer has joined #openstack-meeting20:37
*** markvoelker has joined #openstack-meeting20:38
*** joesavak has joined #openstack-meeting20:41
*** dwcramer has quit IRC20:42
*** littleidea has joined #openstack-meeting20:48
*** joesavak has quit IRC20:51
*** edygarcia has quit IRC20:53
*** dprince has quit IRC21:01
*** dprince has joined #openstack-meeting21:03
*** markvoelker has quit IRC21:05
*** maoy has quit IRC21:08
*** reed has quit IRC21:20
*** adjohn has joined #openstack-meeting21:26
*** adjohn has quit IRC21:27
*** oubiwann1 has quit IRC21:31
*** dhellmann has quit IRC21:34
*** ryanpetrello has quit IRC21:35
*** markmcclain has quit IRC21:37
*** dwcramer has joined #openstack-meeting21:44
*** matwood-lunch is now known as matwood21:54
*** dtroyer is now known as dtroyer_zzz21:59
*** blamar has quit IRC21:59
*** blamar has joined #openstack-meeting22:00
*** markmcclain has joined #openstack-meeting22:04
*** oubiwann1 has joined #openstack-meeting22:05
*** dhellmann has joined #openstack-meeting22:05
*** edygarcia has joined #openstack-meeting22:06
*** kindaopsdevy has quit IRC22:15
*** ryanpetrello has joined #openstack-meeting22:16
*** ryanpetrello has quit IRC22:23
*** littleidea has quit IRC22:24
*** joesavak has joined #openstack-meeting22:24
*** littleidea has joined #openstack-meeting22:25
*** ewindisch has quit IRC22:26
*** ewindisch has joined #openstack-meeting22:26
*** gholt has quit IRC22:26
*** ewindisch has quit IRC22:28
*** ewindisch has joined #openstack-meeting22:31
*** joesavak has quit IRC22:32
*** mdomsch has quit IRC22:34
*** jakedahn is now known as jakedahn_zz22:38
*** nati_uen_ has joined #openstack-meeting22:38
*** nati_ueno has quit IRC22:40
*** dtroyer_zzz is now known as dtroyer22:40
*** nati_ueno has joined #openstack-meeting22:41
*** mnaser has quit IRC22:43
*** nati_uen_ has quit IRC22:44
*** mnaser has joined #openstack-meeting22:45
*** mnaser has joined #openstack-meeting22:45
*** gholt has joined #openstack-meeting22:46
*** nati_uen_ has joined #openstack-meeting22:49
*** nati_ueno has quit IRC22:49
*** dwcramer has quit IRC22:55
*** dhellmann has quit IRC22:58
*** joearnold has quit IRC22:59
*** dhellmann has joined #openstack-meeting23:00
*** anderstj has quit IRC23:02
*** joearnold has joined #openstack-meeting23:02
*** edygarcia has quit IRC23:03
*** mattray has quit IRC23:04
*** ijw has quit IRC23:19
*** ryanpetrello has joined #openstack-meeting23:20
*** dtroyer is now known as dtroyer_zzz23:22
*** jakedahn_zz is now known as jakedahn23:31
*** ijw has joined #openstack-meeting23:33
*** ryanpetrello has quit IRC23:34
*** nati_ueno has joined #openstack-meeting23:34
*** anderstj has joined #openstack-meeting23:35
*** nati_uen_ has quit IRC23:36
*** joearnold has joined #openstack-meeting23:38
*** anderstj has quit IRC23:39
*** ijw has quit IRC23:40
*** ijw has joined #openstack-meeting23:40
*** dhellmann has quit IRC23:43
*** sdake__ has joined #openstack-meeting23:43
*** sdake has quit IRC23:47
*** sdake__ is now known as sdake23:47
*** markmcclain has quit IRC23:49
*** markmcclain has joined #openstack-meeting23:50
*** joearnol_ has joined #openstack-meeting23:53
*** joearnold has quit IRC23:53
*** dhellmann has joined #openstack-meeting23:54
*** joearnol_ has quit IRC23:55
*** dhellmann has quit IRC23:57
*** ryanpetrello has joined #openstack-meeting23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!