22:11:11 #startmeeting db 22:11:12 Meeting started Thu Nov 29 22:11:11 2012 UTC. The chair is jog0. Information about MeetBot at http://wiki.debian.org/MeetBot. 22:11:13 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 22:11:15 The meeting name has been set to 'db' 22:11:23 jkyle: very top of that wiki page 22:11:37 I am sitting in for devananda who is on a plane 22:11:59 * jkyle got it 22:12:04 who's here? 22:12:16 \o sorta 22:12:42 here 22:14:16 #link http://wiki.openstack.org/Meetings/DBTeamMeeting 22:14:26 thats the agenda 22:14:32 lets start with last weeks action items 22:15:38 were any of the HP guys able to release the db-archive code for mysql? 22:15:59 dripton_: ? 22:16:14 I didn't hear anything from devananda about that. 22:16:29 ok, we will put that back up for next week 22:16:45 #action devananda to find and post existing db-archive code for MySQL 22:17:03 russellb: it looks like you had some more blueprints to create 22:17:24 orly 22:17:34 db blueprints #8 and 9 it looks like :) 22:17:48 oh yes 22:17:52 and in fact the patch already went in 22:17:54 sooooo 22:18:01 comstud wrote it and i think it's merged 22:18:25 link to the merge? 22:18:31 looking 22:18:54 https://review.openstack.org/#/c/16596/ 22:19:15 excellent 22:19:50 #topic thread pool 22:20:03 done! \o/ 22:20:05 #link https://review.openstack.org/#/c/16596/ 22:20:08 so yeah, i'll put a blueprint up for it 22:20:11 so it's on the record 22:20:17 #info done! 22:20:33 #action russellb put up blueprint for record keeping 22:20:54 #topic db-unique-key 22:21:02 you had this blueprint creation as well 22:21:19 that's devananda's BP, right? 22:21:43 I think so, but russellb volunteered to create it 22:21:56 i did? 22:21:59 * russellb doesn't know what that is 22:22:22 I thought devananda volunteered to create it. 22:22:24 * jog0 going over http://eavesdrop.openstack.org/meetings/db/2012/db.2012-11-15-22.05.log.html again 22:22:49 ohh my mistake 22:23:06 btw, link to non-blocking-db blueprint - https://blueprints.launchpad.net/nova/+spec/non-blocking-db 22:23:07 #action devananda to post db-unique-key blueprint 22:23:13 so the existing db-unique-key review I've seen has issues - https://review.openstack.org/#/c/16940/ because mysql is sloppy :) 22:23:21 but postgresql isn't 22:24:11 deleted=False is a type error in postgresql unless the column is a boolean 22:24:25 #link https://blueprints.launchpad.net/nova/+spec/non-blocking-db 22:25:17 So that non-blocking-db blueprint is only for mysql. Do we need to add a parallel one for postgres? 22:25:24 ahh devananda did create the blueprint, just hasn't been approved 22:26:46 dripton: lets come back to that in a minute, and finish unique-keys first 22:27:57 sdague: it sounds like we need to keep working on this one 22:28:14 sdague: https://blueprints.launchpad.net/nova/+spec/db-unique-keys has no assignee, do you want to take it on? 22:28:30 it also needs approval, russellb 22:28:34 jog0: yeh, the reality is that False != 0 thing actually caught us other places in tempest trying to get postgresql up 22:28:42 jog0: ack 22:28:58 jog0: I wasn't actually trying to take it on, I was hoping who ever was working the review would be on so I could help explain things 22:29:20 thoughts on the priority? 22:29:40 it's a prereq for db-archiving, so fairly high priority 22:30:03 grizzly-2? 22:30:10 dripton: I thought doing the unique delete column gets around the prereq part 22:30:42 jog0: ok, I must be mixing up the blueprints 22:30:57 dripton: I may be as well, we do have something like 9 bps now 22:31:40 sdague: do know if boris is around? 22:31:45 I do not 22:32:24 so should we just give him the bp anyay? 22:32:29 I agree with jog0; db-unique-keys is no longer a prereq for db-archiving. 22:33:31 so Devananda, has the bp for now. Lets move on… or rather back to db pool 22:33:40 #topic db pool 22:33:56 dripton: you pointed out the current patch only works for mysql 22:34:06 so do we still need a postrgres solution? 22:34:16 The current blueprint only mentions mysql. I haven't tested the patch on postgres. 22:34:28 i looked at the patch, it is indeed mysql specific 22:35:06 would a postgres solution be completely different or can it reuse part of the code? 22:36:46 I think at this point as long as we don't break postgresql it's ok, people that care can optimize there 22:37:02 sdague: works for me 22:37:49 ok, I'll take a look at whether it's easy to port to postgres 22:38:05 It's hacking around in the mysql driver, and it's possible that the parallel hack is possible in psycopg2 22:38:12 #action dripton explore dbp pool for postgres 22:38:39 if you want to pursue that option we can just generalize the current blueprint to cover postgres as well 22:38:50 moving on ... 22:38:58 Let me look first, and if it's practical we can edit the BP 22:39:06 anyone here from db-common? 22:39:38 ewindisch: ? 22:40:24 #topic no-db-compute 22:40:32 russellb: it looks like things are moving along nicely 22:40:46 yes 22:41:00 making good progress, hard to say what percentage we're at 22:41:15 we've started moving things to nova-conductor, and we're exposing some issues here and there along the way 22:41:28 hopefully it will speed up once we understand the types of issues we're going to hit while doing it 22:41:58 we need to be on the lookout for property-style access for db models in the compute code 22:42:01 i know there's more still in there 22:42:14 yeah, I am working on attribute access for my bp as well 22:42:15 and they're going to turn into bugs either when we move db access, or you stop model leaks 22:42:24 yeah, saw a patch for that 22:42:44 i guess we just hope for good test coverage to expose it 22:43:06 I am using my PoC no sqlalchemy leaks to detect the attribute accesses 22:43:15 cool 22:43:37 very helpful 22:43:51 I have another patch I am working right now 22:44:23 what happens to nova-conductor if its not finished by Grizzly release? 22:44:32 as in still db writes from nova-compute? 22:45:03 depends how far along we are 22:45:13 if we stopped right where we are today 22:45:24 we'd probably just change the default config so [conductor] use_local=True is the default 22:45:38 which would make it so you don't have to run nova-conductor 22:45:43 cool 22:45:45 since it wouldn't provide much value 22:46:01 with 15 min to go we have a bunch of BPs to cover so lets move on 22:46:06 ack 22:46:12 #topic db-api-cleanup 22:46:22 as I just said, this one is moving along nicely 22:46:58 hope to have the whole thing done by g3 but targeting nova.db.api only returning primitives by Grizzly-2 22:47:12 leaving db.api consolidation for G3 22:47:29 #topic db-archive 22:47:39 dripton: take it away 22:47:39 Not started on db-archive yet. 22:47:47 I'll have something for you next week 22:47:54 can you target it to a milestone 22:47:59 is this G2 or G3? 22:48:34 G3 is safer for now. I think it's easy enough that we'll probably hit G2, but I don't want to promise yet. 22:49:05 sounds good 22:49:22 #action dripton target db-archive for G3, with goal of hitting G2 22:49:39 #topic db-reconnect 22:49:48 it looks like this one hasn't been started either 22:50:03 #action devananda target db-reconnect 22:50:31 #topic db-session-cleanup 22:50:53 looks like this one is moving along nicely, anyone have any comments? 22:51:19 #action devananda target db-session-cleanup to milestone 22:51:40 #topic backportable-db-migrations 22:51:51 dripton: any comments on this one 22:52:13 you talked about working on it and alembic last time 22:52:16 I have a work in progress alembic conversion but have not submitted to the dev list yet. 22:52:29 I want to make sure it passes all tests first since it will be controversial. 22:52:49 It's currently failing a couple. When it works I will send mail to openstack-dev asking for comments. 22:52:54 ETA on that? 22:53:01 Monday of next week 22:53:29 #action dripton prepare alembic patch to discuss on openstack-dev 22:55:01 I think that brings us to the end 22:55:04 #open discussion 22:55:12 #action open discussion 22:55:17 #undo 22:55:18 Removing item from minutes: 22:55:25 #topic open discussion 22:55:28 anything else? 22:57:05 I guess we're done. 22:57:08 thank you everyone 22:57:17 thanks dog0 22:57:20 jog0 22:57:24 #endmeeting