| *** baoli has quit IRC | 00:00 | |
| *** gatuus has joined #openstack-nova | 00:01 | |
| *** unicell has quit IRC | 00:07 | |
| *** wasmum has joined #openstack-nova | 00:07 | |
| *** diga has joined #openstack-nova | 00:08 | |
| *** takashin has joined #openstack-nova | 00:13 | |
| *** READ10 has joined #openstack-nova | 00:16 | |
| *** mriedem has joined #openstack-nova | 00:16 | |
| *** unicell has joined #openstack-nova | 00:19 | |
| *** hongbin has quit IRC | 00:19 | |
| *** Swami_ has joined #openstack-nova | 00:20 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova: Don't delete neutron port when attach failed https://review.openstack.org/403568 | 00:20 |
|---|---|---|
| *** dtp has quit IRC | 00:22 | |
| *** tbachman has joined #openstack-nova | 00:29 | |
| *** mtanino_ has joined #openstack-nova | 00:29 | |
| *** unicell has quit IRC | 00:29 | |
| *** jose-phillips has quit IRC | 00:29 | |
| *** mtanino has quit IRC | 00:30 | |
| *** jose-phillips has joined #openstack-nova | 00:30 | |
| *** haplo37 has quit IRC | 00:32 | |
| *** haplo37 has joined #openstack-nova | 00:33 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: Fix tag attribute disappearing in 2.33 and 2.37 https://review.openstack.org/424759 | 00:34 |
| openstackgerrit | Matt Riedemann proposed openstack/nova: Fix tag attribute disappearing in 2.33 and 2.37 https://review.openstack.org/424759 | 00:39 |
| openstackgerrit | Matt Riedemann proposed openstack/nova: Pass APIVersionRequest to extensions https://review.openstack.org/425876 | 00:40 |
| mriedem | artom: i cleaned up the bottom change, +2 on that one now | 00:43 |
| mriedem | dansmith: ^ | 00:43 |
| *** jamesdenton has quit IRC | 00:47 | |
| *** gouthamr has joined #openstack-nova | 00:49 | |
| *** unicell has joined #openstack-nova | 00:52 | |
| mriedem | jesus is this normal http://logs.openstack.org/06/425806/8/gate/gate-tempest-dsvm-cells-ubuntu-xenial/344170a/logs/screen-n-api.txt.gz?level=TRACE ? | 00:54 |
| *** READ10 has quit IRC | 00:57 | |
| *** jamielennox is now known as jamielennox|away | 00:58 | |
| *** baoli has joined #openstack-nova | 01:02 | |
| *** catintheroof has quit IRC | 01:02 | |
| *** baoli has quit IRC | 01:02 | |
| *** jamesdenton has joined #openstack-nova | 01:03 | |
| *** unicell has quit IRC | 01:07 | |
| *** gatuus has quit IRC | 01:07 | |
| *** yamahata has quit IRC | 01:11 | |
| *** unicell has joined #openstack-nova | 01:11 | |
| *** chyka has quit IRC | 01:11 | |
| *** jamielennox|away is now known as jamielennox | 01:12 | |
| *** thorst_ has joined #openstack-nova | 01:16 | |
| *** jaosorior has quit IRC | 01:17 | |
| artom | mriedem, ah, much thanks! | 01:21 |
| artom | I got your review but was busy with offsprings | 01:21 |
| mriedem | artom: i'll have the tempest patch up shortly | 01:21 |
| artom | All sleeping now, but you got ahead of me ^_^ | 01:21 |
| mriedem | i'll have to deal with offspring in a bit | 01:21 |
| mriedem | dreaded reading homework, the bane of my existence | 01:22 |
| *** ducttape_ has joined #openstack-nova | 01:22 | |
| artom | For what it's worth, I kept the single device_tags in parameters.yaml because, if we can't min/max/min on them, I saw no point in splitting them up | 01:23 |
| mriedem | the point in splitting them up was to keep a bit more specific description for each parameter | 01:24 |
| mriedem | so we didn't have to cram either/or type wording into a single description | 01:25 |
| mriedem | https://review.openstack.org/#/c/426991/ is the tempest change | 01:25 |
| artom | mriedem, hrmm, looks like I didn't completely grok it then | 01:26 |
| *** tbachman has quit IRC | 01:27 | |
| artom | Oh, duh, I get the point of splitting them | 01:29 |
| artom | mriedem, is there the same rc1 deadline on the novaclient bug? | 01:33 |
| mriedem | artom: novaclient is frozen for ocata | 01:33 |
| mriedem | we can backport https://review.openstack.org/#/c/424745/ though | 01:33 |
| mriedem | later | 01:33 |
| artom | Aha, right | 01:34 |
| *** dims has quit IRC | 01:35 | |
| *** dims_ has joined #openstack-nova | 01:35 | |
| gmann | artom: nova patch looks good | 01:35 |
| *** mlavalle has quit IRC | 01:35 | |
| artom | gmann, wootness, thanks for following up :) | 01:35 |
| *** crushil has joined #openstack-nova | 01:36 | |
| gmann | mriedem: thanks for tempest tests, ll check today | 01:37 |
| *** catintheroof has joined #openstack-nova | 01:37 | |
| *** catintheroof has quit IRC | 01:37 | |
| *** catintheroof has joined #openstack-nova | 01:37 | |
| * artom thinks he'll go to sleep early at this point, because offspring #1 went to sleep with a fever, and will probably wake him up during the night | 01:38 | |
| *** baoli has joined #openstack-nova | 01:38 | |
| gmann | mriedem: on all_tenant policy thing - https://review.openstack.org/#/q/topic:bp/add-whitelist-for-server-list-filter-sort-parameters | 01:40 |
| gmann | mriedem: if we are deferring that to pike i can update doc patch of sort/ filter (removing the policy bits) | 01:41 |
| gmann | mriedem: we need to get release notes/docs for sort/filter in | 01:41 |
| mriedem | gmann: yes we're deferring the policy changes to pike | 01:41 |
| mriedem | so we can discuss at the PTG | 01:41 |
| mriedem | and yeah i have the sort/filter reno patch in our ocata rc1 todo etherpad | 01:42 |
| *** rfolco has quit IRC | 01:42 | |
| gmann | mriedem: cool. ll update doc one quickly | 01:42 |
| *** tbachman has joined #openstack-nova | 01:42 | |
| *** dims_ has quit IRC | 01:42 | |
| *** baoli has quit IRC | 01:42 | |
| *** dims has joined #openstack-nova | 01:42 | |
| *** edmondsw has joined #openstack-nova | 01:43 | |
| *** edmondsw has quit IRC | 01:43 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova: Add release note and docs for filter/sort whitelist https://review.openstack.org/421760 | 01:43 |
| *** edmondsw has joined #openstack-nova | 01:43 | |
| gmann | mriedem: ^^ | 01:43 |
| *** jamesdenton has quit IRC | 01:46 | |
| mriedem | gmann: thanks. i probably won't get to that until tomorrow at this rate. | 01:47 |
| gmann | mriedem: sure. | 01:47 |
| *** edmondsw has quit IRC | 01:47 | |
| mriedem | my wife has decided that simply because she has to get up at 4am, she wants to get some sleep and therefore i need to finish the parenting duties for the evening. | 01:47 |
| gmann | mriedem: cool. spend some good time with your kids | 01:48 |
| gmann | i have oomichi in japan today. ll catch him too :) | 01:48 |
| *** rfolco has joined #openstack-nova | 01:49 | |
| *** rfolco has quit IRC | 01:49 | |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 map_cell_and_hosts https://review.openstack.org/421420 | 01:49 |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 verify_instance https://review.openstack.org/421436 | 01:49 |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 delete_cell https://review.openstack.org/421459 | 01:49 |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 discover_hosts https://review.openstack.org/421442 | 01:49 |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 list_cells https://review.openstack.org/421458 | 01:49 |
| openstackgerrit | Diana Clarke proposed openstack/nova: nova-manage docs: cell_v2 create_cell https://review.openstack.org/421444 | 01:49 |
| *** masber has quit IRC | 01:52 | |
| *** edmondsw has joined #openstack-nova | 01:52 | |
| *** tbachman has quit IRC | 01:52 | |
| diana_clarke | Now I need to switch to a GitHub workflow. I've grown to really like Gerrit. | 01:53 |
| *** raunak has quit IRC | 01:53 | |
| artom | diana_clarke, gerrithub? | 01:55 |
| diana_clarke | artom: is that a thing... off to google it | 01:56 |
| melwitt | mriedem: I just looked at the cells v1 job "Failed to get metadata for IP 10.1.3.255: no metadata" in n-api logs and I think it's normal in that, the error means it couldn't lookup a FixedIP by address. and in cells v1 fixed_ips are populated only in the child cell database, so any reads from the api cell will yield not found | 01:59 |
| *** browne has quit IRC | 01:59 | |
| *** edmondsw has quit IRC | 02:04 | |
| *** edmondsw has joined #openstack-nova | 02:05 | |
| mriedem | melwitt: should that be an ERROR though? | 02:06 |
| *** ducttape_ has quit IRC | 02:06 | |
| mriedem | plus, has that changed recently? | 02:06 |
| mriedem | i don't remember seeing that before | 02:06 |
| melwitt | for non cells v1, yes | 02:06 |
| melwitt | and agreed I don't remember seeing it repeatedly. I thought it used to only show it once. so I'm not sure what changed | 02:06 |
| *** ijw has quit IRC | 02:08 | |
| *** edmondsw has quit IRC | 02:09 | |
| openstackgerrit | ChangBo Guo(gcb) proposed openstack/nova: rbd: Remove unnecessary 'encode' calls https://review.openstack.org/412356 | 02:10 |
| *** diga has quit IRC | 02:15 | |
| *** mtanino has joined #openstack-nova | 02:17 | |
| *** mtanino_ has quit IRC | 02:19 | |
| *** owalsh is now known as owalsh-afk | 02:19 | |
| *** baoli has joined #openstack-nova | 02:20 | |
| *** armax has quit IRC | 02:22 | |
| *** unicell has quit IRC | 02:22 | |
| *** Apoorva has quit IRC | 02:26 | |
| *** Sukhdev has quit IRC | 02:27 | |
| *** ducttape_ has joined #openstack-nova | 02:33 | |
| *** edmondsw has joined #openstack-nova | 02:33 | |
| *** mtanino has quit IRC | 02:34 | |
| *** rfolco has joined #openstack-nova | 02:35 | |
| *** rfolco has quit IRC | 02:35 | |
| *** rfolco has joined #openstack-nova | 02:35 | |
| *** rfolco has quit IRC | 02:36 | |
| *** rfolco has joined #openstack-nova | 02:36 | |
| *** rfolco has quit IRC | 02:37 | |
| *** rfolco has joined #openstack-nova | 02:37 | |
| *** rfolco has quit IRC | 02:38 | |
| *** zerda3 has quit IRC | 02:39 | |
| *** thorst_ has quit IRC | 02:39 | |
| *** browne has joined #openstack-nova | 02:40 | |
| *** rfolco has joined #openstack-nova | 02:41 | |
| *** rfolco has quit IRC | 02:41 | |
| *** rfolco has joined #openstack-nova | 02:41 | |
| *** rfolco has quit IRC | 02:42 | |
| *** browne has quit IRC | 02:42 | |
| *** Apoorva has joined #openstack-nova | 02:42 | |
| *** jamesdenton has joined #openstack-nova | 02:43 | |
| *** marst has joined #openstack-nova | 02:47 | |
| *** masayukig has quit IRC | 02:47 | |
| *** zerda3 has joined #openstack-nova | 02:49 | |
| *** zerda3 has quit IRC | 02:50 | |
| *** Apoorva has quit IRC | 02:52 | |
| *** kaisers_ has joined #openstack-nova | 02:55 | |
| *** zz_dimtruck is now known as dimtruck | 02:55 | |
| *** hongbin has joined #openstack-nova | 02:55 | |
| *** Swami_ has quit IRC | 02:56 | |
| *** kaisers has quit IRC | 02:58 | |
| *** Swami_ has joined #openstack-nova | 02:59 | |
| *** ijw has joined #openstack-nova | 03:00 | |
| *** Swami__ has quit IRC | 03:03 | |
| *** Swami has quit IRC | 03:03 | |
| *** Swami_ has quit IRC | 03:03 | |
| *** nic has quit IRC | 03:03 | |
| *** ijw has quit IRC | 03:04 | |
| *** sudswas__ has joined #openstack-nova | 03:06 | |
| *** sudipto_ has joined #openstack-nova | 03:06 | |
| mriedem | so, bauzas' scheduler change has failed in the gate twice in the cells v1 job on the volume swap test... | 03:06 |
| mriedem | and https://review.openstack.org/#/c/399735/ merged today | 03:07 |
| mriedem | and we don't run the cells v1 job on the check queue for devstack, which re-enabled the test | 03:08 |
| mriedem | https://review.openstack.org/#/c/374373/ | 03:08 |
| mriedem | but i'm pretty sure that just introduced some kind of weird race failure | 03:08 |
| mriedem | lyarwood: ^ | 03:08 |
| *** catintheroof has quit IRC | 03:09 | |
| *** catintheroof has joined #openstack-nova | 03:11 | |
| mriedem | mdbooth: ^ | 03:11 |
| mriedem | looks like it's also killing the ceph job | 03:12 |
| *** zzzeek has quit IRC | 03:13 | |
| *** zzzeek has joined #openstack-nova | 03:15 | |
| *** catintheroof has quit IRC | 03:15 | |
| mriedem | i'm assuming this is probably just something to do with cells v1 not supporting the swap volume API | 03:16 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1660511/ | 03:17 |
| openstack | Launchpad bug 1660511 in OpenStack Compute (nova) "TestVolumeSwap.test_volume_swap fails in cells v1 job waiting for first volume to detach" [High,Confirmed] | 03:17 |
| *** tbachman has joined #openstack-nova | 03:18 | |
| mriedem | melwitt: if cells v1 doesn't support the swap volume API, shouldn't it fail in some kind of spectacular way? | 03:18 |
| melwitt | mriedem: cells v1 non support usually fails in subtle crappy ways, in my experience | 03:19 |
| *** raunak has joined #openstack-nova | 03:20 | |
| mriedem | yeah that seems to be the case here | 03:20 |
| mriedem | i was looking at the requests in a failed job earlier and at some point it looked like something just didn't happen, | 03:20 |
| mriedem | like one of the requests just stopped | 03:20 |
| melwitt | is this a new test, i.e. something that needs to be added to the blacklist? | 03:20 |
| mriedem | it's a newly enabled test as of today | 03:21 |
| mriedem | based on tempest config | 03:21 |
| melwitt | ah | 03:21 |
| mriedem | so i'm going to disable it for cells v1 in devstack | 03:21 |
| mriedem | we could also blacklist it in nova, | 03:21 |
| mriedem | which would probably actually make this go faster since we can fast approve it and not wait for devstack cores | 03:21 |
| mriedem | mtreinish: are you around? | 03:21 |
| melwitt | oh, disable the tempest conf option if cells v1 in devstack | 03:21 |
| *** alexpilotti has joined #openstack-nova | 03:22 | |
| mriedem | yeah | 03:22 |
| mriedem | i'm doing that now | 03:22 |
| *** ducttape_ has quit IRC | 03:23 | |
| *** bkopilov has quit IRC | 03:24 | |
| mriedem | https://review.openstack.org/427009 | 03:24 |
| mriedem | if i don't get a quick ack from the cores i've pinged, i'll push up a blacklist patch in nova and just move forward that way | 03:26 |
| *** alexpilotti has quit IRC | 03:26 | |
| melwitt | okay | 03:27 |
| openstackgerrit | Matt Riedemann proposed openstack/nova: Blacklist test_volume_swap from cells v1 testing https://review.openstack.org/427013 | 03:30 |
| *** amotoki has joined #openstack-nova | 03:30 | |
| *** ijw has joined #openstack-nova | 03:31 | |
| *** ijw has quit IRC | 03:31 | |
| *** ijw has joined #openstack-nova | 03:31 | |
| *** ijw has quit IRC | 03:32 | |
| *** tbachman has quit IRC | 03:34 | |
| *** mtanino has joined #openstack-nova | 03:35 | |
| *** vladikr has quit IRC | 03:40 | |
| *** Apoorva has joined #openstack-nova | 03:40 | |
| *** mdnadeem has joined #openstack-nova | 03:47 | |
| *** nicolasbock has quit IRC | 03:50 | |
| *** psachin has joined #openstack-nova | 03:55 | |
| *** owalsh-afk has quit IRC | 03:59 | |
| *** owalsh has joined #openstack-nova | 04:05 | |
| *** gouthamr has quit IRC | 04:07 | |
| *** hongbin has quit IRC | 04:08 | |
| *** ducttape_ has joined #openstack-nova | 04:13 | |
| *** mtanino has quit IRC | 04:19 | |
| *** jose-phillips has quit IRC | 04:19 | |
| *** edmondsw has quit IRC | 04:19 | |
| *** yamahata has joined #openstack-nova | 04:21 | |
| *** diana_clarke has quit IRC | 04:25 | |
| *** jamesdenton has quit IRC | 04:25 | |
| *** dave-mccowan has quit IRC | 04:26 | |
| *** raunak has quit IRC | 04:27 | |
| *** pbandark has joined #openstack-nova | 04:30 | |
| *** tlian has quit IRC | 04:31 | |
| *** ducttape_ has quit IRC | 04:33 | |
| *** edmondsw has joined #openstack-nova | 04:34 | |
| *** baoli has quit IRC | 04:36 | |
| *** ayogi has joined #openstack-nova | 04:37 | |
| *** adisky_ has joined #openstack-nova | 04:38 | |
| *** thorst_ has joined #openstack-nova | 04:40 | |
| *** thorst_ has quit IRC | 04:45 | |
| *** bkopilov has joined #openstack-nova | 04:47 | |
| *** dimtruck is now known as zz_dimtruck | 04:48 | |
| abhishekk | is there any provision in nova to restrict users from addind certain metadata to server? | 04:48 |
| *** udesale has joined #openstack-nova | 04:48 | |
| mriedem | here is the not-so-subtle error http://logs.openstack.org/06/425806/8/check/gate-tempest-dsvm-cells-ubuntu-xenial/ab0bba2/logs/screen-n-cell-child.txt.gz?level=TRACE#_2017-01-31_01_25_10_115 | 04:49 |
| *** Sukhdev has joined #openstack-nova | 04:50 | |
| *** ayogi has quit IRC | 04:50 | |
| *** ayogi has joined #openstack-nova | 04:51 | |
| *** masayukig has joined #openstack-nova | 04:57 | |
| *** ratailor has joined #openstack-nova | 05:01 | |
| *** prateek has joined #openstack-nova | 05:06 | |
| *** unicell has joined #openstack-nova | 05:10 | |
| *** dikonoor has joined #openstack-nova | 05:11 | |
| *** raunak has joined #openstack-nova | 05:14 | |
| *** raunak has quit IRC | 05:16 | |
| *** unicell has quit IRC | 05:21 | |
| *** unicell has joined #openstack-nova | 05:21 | |
| *** nkrinner_afk is now known as nkrinner | 05:31 | |
| *** ducttape_ has joined #openstack-nova | 05:35 | |
| *** zz_dimtruck is now known as dimtruck | 05:39 | |
| *** ducttape_ has quit IRC | 05:41 | |
| *** jose-phillips has joined #openstack-nova | 05:42 | |
| *** dimtruck is now known as zz_dimtruck | 05:49 | |
| *** zz_dimtruck is now known as dimtruck | 05:50 | |
| *** udesale__ has joined #openstack-nova | 05:51 | |
| *** udesale has quit IRC | 05:54 | |
| *** dimtruck is now known as zz_dimtruck | 06:00 | |
| *** raunak has joined #openstack-nova | 06:00 | |
| *** sree_ has joined #openstack-nova | 06:01 | |
| *** sree_ is now known as Guest23175 | 06:01 | |
| *** satyar has joined #openstack-nova | 06:07 | |
| *** claudiub has joined #openstack-nova | 06:11 | |
| *** amotoki has quit IRC | 06:12 | |
| *** amotoki has joined #openstack-nova | 06:13 | |
| *** Jack_I has joined #openstack-nova | 06:13 | |
| *** diga has joined #openstack-nova | 06:19 | |
| *** vsaienko has joined #openstack-nova | 06:19 | |
| *** crushil has quit IRC | 06:28 | |
| *** udesale__ has quit IRC | 06:34 | |
| *** udesale has joined #openstack-nova | 06:34 | |
| *** lpetrut has joined #openstack-nova | 06:38 | |
| *** edmondsw has quit IRC | 06:39 | |
| *** vsaienko has quit IRC | 06:39 | |
| *** Guest23175 has quit IRC | 06:40 | |
| *** thorst_ has joined #openstack-nova | 06:41 | |
| *** sree_ has joined #openstack-nova | 06:42 | |
| *** sree_ is now known as Guest33716 | 06:43 | |
| *** Guest33716 has quit IRC | 06:44 | |
| *** wsl has joined #openstack-nova | 06:44 | |
| *** wsl has left #openstack-nova | 06:45 | |
| *** thorst_ has quit IRC | 06:46 | |
| *** Sukhdev has quit IRC | 06:49 | |
| *** raunak has quit IRC | 06:50 | |
| *** zz_dimtruck is now known as dimtruck | 06:51 | |
| openstackgerrit | Dinesh Bhor proposed openstack/nova: Remove unused exceptions from nova.exception https://review.openstack.org/427041 | 06:59 |
| *** sridharg has joined #openstack-nova | 07:00 | |
| *** dimtruck is now known as zz_dimtruck | 07:01 | |
| *** ducttape_ has joined #openstack-nova | 07:06 | |
| *** ekuris__ has joined #openstack-nova | 07:09 | |
| *** ducttape_ has quit IRC | 07:11 | |
| *** rcernin has joined #openstack-nova | 07:12 | |
| *** zz_dimtruck is now known as dimtruck | 07:12 | |
| *** markus_z has joined #openstack-nova | 07:14 | |
| *** lpetrut has quit IRC | 07:20 | |
| *** Oku_OS-away is now known as Oku_OS | 07:22 | |
| *** dimtruck is now known as zz_dimtruck | 07:22 | |
| *** ayogi has quit IRC | 07:26 | |
| *** ayogi has joined #openstack-nova | 07:26 | |
| *** Apoorva has quit IRC | 07:29 | |
| *** lpetrut has joined #openstack-nova | 07:30 | |
| *** andreas_s has joined #openstack-nova | 07:36 | |
| *** BobBall has quit IRC | 07:44 | |
| *** abalutoiu has quit IRC | 07:47 | |
| *** edand has joined #openstack-nova | 07:50 | |
| *** yamahata has quit IRC | 07:50 | |
| *** tesseract has joined #openstack-nova | 07:54 | |
| *** unicell has quit IRC | 07:59 | |
| *** abalutoiu has joined #openstack-nova | 08:05 | |
| *** sixdoublefive321 has joined #openstack-nova | 08:05 | |
| *** udesale__ has joined #openstack-nova | 08:06 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova: reno for notification-transformation-ocata https://review.openstack.org/426810 | 08:06 |
| *** mjura has joined #openstack-nova | 08:08 | |
| *** udesale has quit IRC | 08:08 | |
| *** zz_dimtruck is now known as dimtruck | 08:13 | |
| *** dimtruck is now known as zz_dimtruck | 08:23 | |
| *** ralonsoh has joined #openstack-nova | 08:23 | |
| *** aloga has quit IRC | 08:27 | |
| *** Apoorva has joined #openstack-nova | 08:30 | |
| *** vsaienko has joined #openstack-nova | 08:30 | |
| *** hfu has quit IRC | 08:36 | |
| *** jpena|off is now known as jpena | 08:36 | |
| *** hfu has joined #openstack-nova | 08:39 | |
| *** sree has joined #openstack-nova | 08:40 | |
| *** sixdoublefive321 has quit IRC | 08:40 | |
| *** thorst_ has joined #openstack-nova | 08:42 | |
| *** Apoorva has quit IRC | 08:43 | |
| *** pbandark has quit IRC | 08:44 | |
| *** Apoorva has joined #openstack-nova | 08:44 | |
| *** foexle has joined #openstack-nova | 08:47 | |
| *** thorst_ has quit IRC | 08:48 | |
| *** jpena is now known as jpena|off | 08:49 | |
| *** hfu has quit IRC | 08:53 | |
| *** karimb has joined #openstack-nova | 08:53 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs: List/show all server migration types https://review.openstack.org/407237 | 08:54 |
| *** hfu has joined #openstack-nova | 08:55 | |
| *** hfu has quit IRC | 08:55 | |
| *** hfu has joined #openstack-nova | 08:55 | |
| *** rmart04 has joined #openstack-nova | 08:56 | |
| *** hfu has quit IRC | 08:56 | |
| tdurakov | pkoniszewski:hi, left several comments on liv-mig claim patch, could discuss them on irc if you want | 08:56 |
| *** hfu has joined #openstack-nova | 08:56 | |
| *** hfu has quit IRC | 08:57 | |
| *** Apoorva has quit IRC | 08:57 | |
| *** lpetrut has quit IRC | 08:57 | |
| *** jpena|off is now known as jpena | 08:57 | |
| *** Apoorva has joined #openstack-nova | 08:58 | |
| *** karimb has quit IRC | 08:59 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** rmart04 has quit IRC | 09:01 | |
| *** rmart04_ has joined #openstack-nova | 09:01 | |
| *** zzzeek has joined #openstack-nova | 09:01 | |
| *** aloga has joined #openstack-nova | 09:04 | |
| *** romainh has joined #openstack-nova | 09:05 | |
| *** Apoorva has quit IRC | 09:06 | |
| *** Apoorva has joined #openstack-nova | 09:07 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs: Fix formatting errors and warnings https://review.openstack.org/407364 | 09:08 |
| *** vsaienko has quit IRC | 09:09 | |
| *** udesale has joined #openstack-nova | 09:09 | |
| *** vsaienko has joined #openstack-nova | 09:09 | |
| openstackgerrit | sahid proposed openstack/nova-specs: Libvirt driver emulator threads placement policy https://review.openstack.org/427066 | 09:10 |
| *** udesale__ has quit IRC | 09:10 | |
| *** sudipto has joined #openstack-nova | 09:12 | |
| *** sudipto_ has quit IRC | 09:12 | |
| *** sudipto_ has joined #openstack-nova | 09:13 | |
| *** zz_dimtruck is now known as dimtruck | 09:14 | |
| *** sudswas__ has quit IRC | 09:14 | |
| *** Apoorva has quit IRC | 09:21 | |
| *** karimb has joined #openstack-nova | 09:21 | |
| *** romainh1 has joined #openstack-nova | 09:21 | |
| *** romainh has quit IRC | 09:22 | |
| *** dimtruck is now known as zz_dimtruck | 09:23 | |
| *** mvk has quit IRC | 09:24 | |
| *** Apoorva has joined #openstack-nova | 09:26 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova: Avoid forcing translation on logging calls https://review.openstack.org/413876 | 09:26 |
| *** efoley_ has joined #openstack-nova | 09:30 | |
| *** sree has quit IRC | 09:32 | |
| *** efoley__ has joined #openstack-nova | 09:32 | |
| *** udesale__ has joined #openstack-nova | 09:32 | |
| *** hshiina has joined #openstack-nova | 09:32 | |
| *** BobBall has joined #openstack-nova | 09:33 | |
| *** vsaienko has quit IRC | 09:34 | |
| *** yassine has joined #openstack-nova | 09:34 | |
| *** udesale has quit IRC | 09:34 | |
| *** yassine is now known as Guest15362 | 09:34 | |
| *** dikonoor has quit IRC | 09:34 | |
| *** efoley_ has quit IRC | 09:35 | |
| *** karimb has quit IRC | 09:37 | |
| *** rmart04_ has quit IRC | 09:37 | |
| *** Apoorva has quit IRC | 09:39 | |
| openstackgerrit | Jordan Pittier proposed openstack/nova: Fix unspecified bahavior on GET /servers/detail?tenant_id=X as admin https://review.openstack.org/426259 | 09:42 |
| *** lucas-afk is now known as lucasagomes | 09:44 | |
| *** Apoorva has joined #openstack-nova | 09:44 | |
| abhishekk | hi all, is there any provision in nova to restrict users from adding certain metadata to server? | 09:45 |
| *** udesale__ has quit IRC | 09:48 | |
| *** gcb has joined #openstack-nova | 09:52 | |
| *** karimb has joined #openstack-nova | 09:53 | |
| *** mvk has joined #openstack-nova | 09:55 | |
| *** Apoorva has quit IRC | 09:57 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova: Refactor a test method including 3 test cases https://review.openstack.org/394738 | 09:59 |
| openstackgerrit | John Garbutt proposed openstack/nova: DNM: hack ironic with resource providers https://review.openstack.org/426296 | 10:01 |
| *** lennyb has quit IRC | 10:02 | |
| *** Apoorva has joined #openstack-nova | 10:02 | |
| *** lennyb has joined #openstack-nova | 10:03 | |
| *** lpetrut has joined #openstack-nova | 10:04 | |
| *** derekh has joined #openstack-nova | 10:06 | |
| *** ducttape_ has joined #openstack-nova | 10:07 | |
| *** satyar has quit IRC | 10:12 | |
| *** ducttape_ has quit IRC | 10:12 | |
| *** sambetts|afk is now known as sambetts | 10:12 | |
| johnthetubaguy | bauzas: are you around by any chance, and do you have the context around the ironic changes? | 10:13 |
| *** zz_dimtruck is now known as dimtruck | 10:14 | |
| *** efried has quit IRC | 10:15 | |
| bauzas | johnthetubaguy: I'm here yup | 10:21 |
| johnthetubaguy | bauzas: I wondered if you could check my comments on this patch: https://review.openstack.org/#/c/404472 | 10:22 |
| johnthetubaguy | not sure if I am talking nonsense or sense | 10:22 |
| * bauzas looking | 10:22 | |
| andymccr | morning all - im having a few issues with the placement service, was hoping for a bit of guidance. The first is that it seems you can't define which endpoint interface compute connects to placement on. (I put a PR in for that which worked for me but I may be way off the mark: https://review.openstack.org/#/c/426163/ ) | 10:23 |
| openstackgerrit | Alex Szarka proposed openstack/nova: Transform instance.add_fixed_ip notification https://review.openstack.org/332876 | 10:23 |
| *** dimtruck is now known as zz_dimtruck | 10:24 | |
| *** efried has joined #openstack-nova | 10:24 | |
| andymccr | secondly, i get a 409 on the first PUT from the compute host, 200 on all GETs but then 400's on subsequent PUTs. The errors are vague though - I'm not too sure what steps I can take to debug that further. | 10:25 |
| *** Apoorva has quit IRC | 10:25 | |
| johnthetubaguy | andymccr: hmm, interesting | 10:29 |
| johnthetubaguy | andymccr: the endpoint is picked using the keystone service catalog | 10:29 |
| johnthetubaguy | (or should be) | 10:30 |
| *** Apoorva has joined #openstack-nova | 10:30 | |
| johnthetubaguy | andymccr: oh, the interface | 10:30 |
| andymccr | johnthetubaguy: yeah it is, but it forces "public" afaict because the keystoneauth endpoint_filter doesnt include an interface option when passed by nova | 10:30 |
| johnthetubaguy | should we really default to private? | 10:30 |
| andymccr | my pr defaults it to public - so in essence, no change if you don't set it | 10:31 |
| andymccr | internal works for my usecase, but not sure it'd work for everybody - so figured its best to not change things like that midway :) rather make them changeable. | 10:31 |
| andymccr | i imagine in things like role gates/devstack it makes no difference since the endpoints are probably all the same regardless of internal/public | 10:32 |
| johnthetubaguy | its an admin only API (at least by design) so its probably a mute point | 10:32 |
| andymccr | if its admin only perhaps it should default to admin instead? | 10:33 |
| andymccr | from my pov, i need it to not be public or else i have to do some munging when i create endpoints to ensure the public endpoint is created differently to all other public endpoints and uses the internal ip | 10:33 |
| *** pbandark has joined #openstack-nova | 10:34 | |
| johnthetubaguy | oh, possibly, yeah, default to admin makes more snese | 10:34 |
| johnthetubaguy | in theory non admin users would just get 403 errors I think, but its good to message that better | 10:35 |
| johnthetubaguy | bauzas: cdent: do you have better context on the intended deployment stuff, for our OSA friends? | 10:36 |
| bauzas | johnthetubaguy: sorry, I had an internal problem | 10:37 |
| bauzas | and I'm very busy, so could you please explain me the issue ? | 10:37 |
| johnthetubaguy | bauzas: service catalog, we default to accessing the "public" URL for placement | 10:37 |
| johnthetubaguy | that seems odd, given its an admin only API | 10:38 |
| andymccr | (and you can't override it afaict) | 10:38 |
| bauzas | lemme verify something | 10:38 |
| bauzas | I think nova just doesn't use the public field | 10:38 |
| johnthetubaguy | it seems to, because of how keystone auth works | 10:39 |
| johnthetubaguy | infact it only uses the public field, if I am remembering correctly | 10:39 |
| *** Apoorva has quit IRC | 10:39 | |
| bauzas | :/ | 10:39 |
| toabctl | mriedem, hey. anything I can do to push https://review.openstack.org/#/c/402318/ ? | 10:41 |
| bauzas | johnthetubaguy: AFAIK, we don't have yet policies | 10:41 |
| johnthetubaguy | bauzas: I was wondering about that... uh, oh | 10:42 |
| *** alexpilotti has joined #openstack-nova | 10:42 | |
| *** thorst_ has joined #openstack-nova | 10:44 | |
| *** alexpilotti has quit IRC | 10:44 | |
| *** alexpilotti has joined #openstack-nova | 10:45 | |
| *** efried has quit IRC | 10:45 | |
| *** hfu has joined #openstack-nova | 10:45 | |
| johnthetubaguy | I think we are OK for policy, looking at this: https://github.com/openstack/nova/blob/a0100d61a9531a3e32f2c72eab54157c32114f5b/nova/api/openstack/placement/handler.py#L175 | 10:47 |
| bauzas | agreed | 10:48 |
| *** thorst_ has quit IRC | 10:49 | |
| gmann | johnthetubaguy: can you look into release notes patch of sort/filter things - https://review.openstack.org/#/c/421760/ | 10:50 |
| gmann | johnthetubaguy: i have removed the all_tenant policy bits from there | 10:50 |
| bauzas | johnthetubaguy: when I wrote the PlacementFixture, I saw that it was returning 401s if I wasn't auth'd | 10:50 |
| johnthetubaguy | gmann: ah, we trimmed it down, cool | 10:50 |
| bauzas | now I remember that | 10:50 |
| gmann | yea | 10:50 |
| johnthetubaguy | bauzas: cool | 10:50 |
| bauzas | johnthetubaguy: but that's easily testable thanks to the fixture I wrote, I guess | 10:50 |
| johnthetubaguy | bauzas: there is that other patch I was taking about before, the problem there I think is that some of the code added around allocations is unreachable, and doesn't fix things for instances created after we start reporting custom classes, but I could be reading it all wrong | 10:51 |
| johnthetubaguy | andymccr: sorry, I got fixated on the first issue | 10:51 |
| johnthetubaguy | andymccr: you had a second question | 10:51 |
| bauzas | johnthetubaguy: I briefly looked at the code, but I need time for loading context in mind | 10:52 |
| johnthetubaguy | lots of API errors | 10:52 |
| johnthetubaguy | bauzas: ack | 10:52 |
| bauzas | and I'm awfully busy | 10:52 |
| bauzas | :( | 10:52 |
| johnthetubaguy | bauzas: understood | 10:52 |
| johnthetubaguy | gmann: I worry about advertising the alias | 10:57 |
| andymccr | johnthetubaguy: yeah i'm trying to understand what a 409 would mean in terms of what is actually conflicting - the endpoint seems ok since it's accepting GET requests (responding with a 200), but any PUT requests are returning bad request 400, and the initial put request returns a 409 conflict | 10:58 |
| *** efried has joined #openstack-nova | 10:58 | |
| andymccr | my understanding is the resource already exists, but im wondering where or what i can do to debug that a bit further | 10:59 |
| johnthetubaguy | andymccr: DB configuration is bad, maybe? | 10:59 |
| andymccr | johnthetubaguy: yeah thats what im thinking - so i noticed the nova_placement db that is created isn't populated, perhaps it needs write permissions that i havn't set up properly | 10:59 |
| johnthetubaguy | andymccr: needs a new nova-manage cmd running | 11:00 |
| andymccr | from a nova perspective i just need to run the nova-manage api_db sync command? | 11:00 |
| *** jpena has quit IRC | 11:00 | |
| *** ltomasbo has quit IRC | 11:00 | |
| *** dmellado has quit IRC | 11:00 | |
| johnthetubaguy | andymccr: no | 11:01 |
| gmann | johnthetubaguy: i see your point, and agree that can avoid users using those alias. ll update those in respective attribute description. | 11:01 |
| johnthetubaguy | andymccr: oh... well maybe, I can't remember now actually | 11:01 |
| andymccr | johnthetubaguy: i think i must be missing something because it's not quite happening :) | 11:02 |
| johnthetubaguy | gmann: awesome, thank you | 11:02 |
| *** jpena has joined #openstack-nova | 11:02 | |
| johnthetubaguy | andymccr: so do you have it configured the same as the API DB in the conf? | 11:02 |
| openstackgerrit | Bob Ball proposed openstack/nova: Fix live migrate with XenServer https://review.openstack.org/424428 | 11:02 |
| *** takashin has quit IRC | 11:02 | |
| andymccr | johnthetubaguy: no there is a separate db | 11:03 |
| andymccr | or rather we've setup a separate database | 11:03 |
| johnthetubaguy | andymccr: OK, that sounds good | 11:03 |
| andymccr | with a separate user | 11:03 |
| *** dmellado has joined #openstack-nova | 11:03 | |
| andymccr | but then the api_db sync doesn't populate the new db - so i wonder if its a permissions issue, although i imagine it would pull the connection string from nova.conf (for the placement db?) | 11:03 |
| johnthetubaguy | andymccr: oh, interesting. it should pull that from nova.conf, but I wonder if that works | 11:04 |
| *** takashin has joined #openstack-nova | 11:05 | |
| *** ltomasbo has joined #openstack-nova | 11:07 | |
| johnthetubaguy | andymccr: so that is what devstack does: https://github.com/openstack-dev/devstack/blob/master/lib/placement#L143 | 11:07 |
| *** Apoorva has joined #openstack-nova | 11:08 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova: Ignore IOError when creating 'console.log' https://review.openstack.org/392643 | 11:08 |
| andymccr | johnthetubaguy: hmm yeah, so that pretty much lines up - i tested with --conf-file but let me test that again | 11:09 |
| sfinucan | artom, mdbooth: ^^^ | 11:09 |
| johnthetubaguy | andymccr: this is our nova.conf in the gate: http://logs.openstack.org/63/426163/2/check/gate-tempest-dsvm-neutron-full-ubuntu-trusty/a5ece9b/logs/etc/nova/nova.conf.txt.gz | 11:09 |
| *** mvk has quit IRC | 11:10 | |
| BobBall | mriedem: See my updates to https://bugs.launchpad.net/nova/+bug/1658877 . I'd very much hope we can still aim for a fix in Ocata as changes to the object are needed and I understand these are particularly difficult to backport? | 11:10 |
| openstack | Launchpad bug 1658877 in OpenStack Compute (nova) "live migration failed with XenServer as hypervisor" [High,In progress] - Assigned to Bob Ball (bob-ball) | 11:10 |
| mdbooth | sfinucan: You want to add a test for ignoring EPERM? ;) | 11:11 |
| *** romainh1 has quit IRC | 11:11 | |
| johnthetubaguy | andymccr: did you configure api_database with the placement database, and use the correct conf file when calling api_sync? | 11:11 |
| sfinucan | mdbooth: Damn - you're quick. Had just started fixing that :) | 11:11 |
| * mdbooth floats like a butterfly... | 11:11 | |
| andymccr | johnthetubaguy: yes on the config file, but we have a the placement_database section defined. | 11:12 |
| johnthetubaguy | andymccr: something tells me we screwed up, and nova-manage doesn't read that | 11:12 |
| andymccr | johnthetubaguy: interesting, let me test and remove that section | 11:13 |
| andymccr | i assume it'll just default to the api_database then? | 11:13 |
| johnthetubaguy | andymccr: yeah, we will want to not do that, but it would be good to see that fix your issues | 11:13 |
| andymccr | johnthetubaguy: although - i know the puppet team has dedicated configuration for nova_placement database. | 11:14 |
| andymccr | but lets test | 11:14 |
| andymccr | im somewhat sure its db related | 11:14 |
| johnthetubaguy | andymccr: yeah, we should do a separate database, but it would be good to see if that fixes things | 11:14 |
| *** zz_dimtruck is now known as dimtruck | 11:15 | |
| *** nicolasbock has joined #openstack-nova | 11:16 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova: Avoid forcing translation on logging calls https://review.openstack.org/413876 | 11:16 |
| johnthetubaguy | bauzas: have you noticed how you can't have a separate placement database using the placement_database settings? seems in the gate we test with a single shared API database | 11:18 |
| *** Apoorva has quit IRC | 11:21 | |
| *** mvk has joined #openstack-nova | 11:23 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova: Ignore IOError when creating 'console.log' https://review.openstack.org/392643 | 11:24 |
| *** dimtruck is now known as zz_dimtruck | 11:25 | |
| *** hshiina has quit IRC | 11:25 | |
| *** Apoorva has joined #openstack-nova | 11:26 | |
| *** adisky_ has quit IRC | 11:29 | |
| openstackgerrit | Andy McCrae proposed openstack/nova: Allow placement endpoint interface to be set https://review.openstack.org/426163 | 11:31 |
| *** sree has joined #openstack-nova | 11:32 | |
| *** sree has quit IRC | 11:34 | |
| *** sree has joined #openstack-nova | 11:34 | |
| *** Apoorva has quit IRC | 11:35 | |
| *** ducttape_ has joined #openstack-nova | 11:38 | |
| rpodolyaka | johnthetubaguy: yeah, a separate placement db must only be possible with https://review.openstack.org/#/c/362766/ | 11:38 |
| *** Apoorva has joined #openstack-nova | 11:40 | |
| rpodolyaka | I wonder if we left placement_database conf group intentionally in this revert - https://review.openstack.org/#/c/360638/ or by mistake | 11:40 |
| *** timello has joined #openstack-nova | 11:40 | |
| *** stvnoyes has quit IRC | 11:41 | |
| *** hfu has quit IRC | 11:41 | |
| johnthetubaguy | rpodolyaka: ah, right, I couldn't see that code when I went digging | 11:42 |
| *** ducttape_ has quit IRC | 11:43 | |
| johnthetubaguy | andymccr: so I think we could make the placement DB separate by having a placement.conf that is used for the nova-manage call and the placement API, where the api-database is configured as the placement database | 11:43 |
| johnthetubaguy | andymccr: seems we are missing some bits on our side for that to work... more sensibly | 11:44 |
| openstackgerrit | Abhishek Kekane proposed openstack/nova: Use is_valid_cidr and is_valid_ipv6_cidr from oslo_utils https://review.openstack.org/320375 | 11:45 |
| andymccr | johnthetubaguy: ahh ok - weird. i wonder how the puppet stuff works then - im running a few tests now wrt not using a set placement_db | 11:46 |
| johnthetubaguy | andymccr: +1 | 11:47 |
| andymccr | i'll try speak to EmilienM a bit later - he put the pr in for that :) | 11:47 |
| sfinucan | lyarwood: Could you say if this is suitable bugfix to backport to Mitaka? https://review.openstack.org/427119 | 11:48 |
| sfinucan | Per this bug report https://bugs.launchpad.net/nova/+bug/1657791 | 11:48 |
| openstack | Launchpad bug 1578155 in OpenStack Compute (nova) newton "duplicate for #1657791 'hw:cpu_thread_policy=prefer' misbehaviour" [Medium,Fix committed] - Assigned to Stephen Finucane (stephenfinucane) | 11:48 |
| *** Apoorva has quit IRC | 11:49 | |
| *** sree has quit IRC | 11:51 | |
| *** hfu has joined #openstack-nova | 11:52 | |
| *** gszasz has joined #openstack-nova | 11:57 | |
| tdurakov | johnthetubaguy: could you please take a look https://review.openstack.org/#/c/244489/58 especially interested in default rpc method params, see my comments on ps-58, is it really required? I would like to clarify that moment for myself | 11:57 |
| *** sdague has joined #openstack-nova | 11:58 | |
| *** sdague_ has joined #openstack-nova | 12:00 | |
| johnthetubaguy | andymccr: on a related note, not sure if you have the cell0 database setup yet, there are details in here: http://docs.openstack.org/developer/nova/cells.html#setup-of-cells-v2 | 12:00 |
| *** ratailor has quit IRC | 12:01 | |
| *** udesale has joined #openstack-nova | 12:01 | |
| andymccr | johnthetubaguy: i was looking at that - is that a requirement? so you have to have a cell0 db (and a cell1 db) | 12:01 |
| openstackgerrit | Stephen Finucane proposed openstack/nova-specs: Add extra-specs-image-meta-conflicts spec https://review.openstack.org/382382 | 12:01 |
| johnthetubaguy | andymccr: yes, its all required now, I believe | 12:02 |
| andymccr | johnthetubaguy: i wonder if that is the issue then. | 12:02 |
| andymccr | hmm | 12:02 |
| andymccr | ok cool that gives me some more things to try at the lest | 12:02 |
| andymccr | *least | 12:02 |
| openstackgerrit | Stephen Finucane proposed openstack/nova-specs: Reserve NUMA nodes with PCI devices attached https://review.openstack.org/364468 | 12:03 |
| *** Apoorva has joined #openstack-nova | 12:03 | |
| johnthetubaguy | andymccr: you need the API db to know which cell a host is in, else we don't know which cell to send the build request, etc | 12:03 |
| openstackgerrit | Stephen Finucane proposed openstack/nova-specs: Add 'attributed-action-notifications' spec https://review.openstack.org/388573 | 12:04 |
| lyarwood | sfinucan: hey sorry was on a call, no I don't think it is http://docs.openstack.org/project-team-guide/stable-branches.html#support-phases | 12:04 |
| *** karimb has quit IRC | 12:05 | |
| *** dave-mccowan has joined #openstack-nova | 12:06 | |
| sfinucan | lyarwood: I thought as much. I was hoping the clause might apply though :) " It’s nevertheless allowed to backport fixes for other bugs if their safety can be easily proved. " | 12:06 |
| *** nicolasbock has quit IRC | 12:06 | |
| lyarwood | sfinucan: yeah we do make exceptions for simple fixes, I'm just going by the bug subject and Importance posted in the channel | 12:07 |
| kashyap | Hmm, this has become a bit of blocker it seems -- https://bugs.launchpad.net/bugs/1643911 | 12:10 |
| openstack | Launchpad bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] | 12:10 |
| kashyap | And the upstream libvirt folks go: "the stack trace will be totally useless for malloc memory corruption" | 12:10 |
| *** bkopilov has quit IRC | 12:11 | |
| kashyap | Because: https://bugs.launchpad.net/nova/+bug/1643911/comments/1 | 12:12 |
| openstack | Launchpad bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] | 12:12 |
| kashyap | If you run libvirtd under valgrind in the Gate, then it might hide the problem | 12:12 |
| kashyap | At least libvirt upstream admits: "I mean, we [libvirt] are clearly overwriting the memory somewhere; but stack trace is not helpful in those cases" | 12:13 |
| *** vsaienko has joined #openstack-nova | 12:13 | |
| *** zz_dimtruck is now known as dimtruck | 12:16 | |
| *** Apoorva has quit IRC | 12:21 | |
| *** catintheroof has joined #openstack-nova | 12:22 | |
| *** nicolasbock has joined #openstack-nova | 12:23 | |
| *** rfolco has joined #openstack-nova | 12:25 | |
| *** rfolco has quit IRC | 12:26 | |
| *** dimtruck is now known as zz_dimtruck | 12:26 | |
| *** Apoorva has joined #openstack-nova | 12:26 | |
| *** rfolco has joined #openstack-nova | 12:26 | |
| *** ayogi has quit IRC | 12:28 | |
| *** ayogi has joined #openstack-nova | 12:29 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova: Add release note and docs for filter/sort whitelist https://review.openstack.org/421760 | 12:32 |
| *** thorst_ has joined #openstack-nova | 12:35 | |
| *** vsaienko has quit IRC | 12:36 | |
| *** baoli has joined #openstack-nova | 12:37 | |
| *** bvanhav has joined #openstack-nova | 12:37 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/nova: Optimize time during PCI alias parsing process https://review.openstack.org/427145 | 12:37 |
| *** Apoorva has quit IRC | 12:40 | |
| *** sree has joined #openstack-nova | 12:40 | |
| *** baoli has quit IRC | 12:42 | |
| *** Guest15362 has quit IRC | 12:42 | |
| *** Apoorva has joined #openstack-nova | 12:44 | |
| *** lucasagomes is now known as lucas-hungry | 12:46 | |
| *** Guest15362 has joined #openstack-nova | 12:46 | |
| *** Jeffrey4l__ is now known as Jeffrey4l | 12:47 | |
| *** ayogi has quit IRC | 12:48 | |
| *** Hosam has joined #openstack-nova | 12:50 | |
| *** jaypipes has joined #openstack-nova | 12:50 | |
| *** takashin has left #openstack-nova | 12:52 | |
| *** edand has quit IRC | 12:54 | |
| *** romainh has joined #openstack-nova | 12:54 | |
| *** Apoorva has quit IRC | 12:58 | |
| *** cdent has joined #openstack-nova | 13:02 | |
| *** udesale has quit IRC | 13:02 | |
| *** udesale has joined #openstack-nova | 13:03 | |
| *** satyar has joined #openstack-nova | 13:03 | |
| *** ducttape_ has joined #openstack-nova | 13:06 | |
| *** kylek3h has quit IRC | 13:07 | |
| openstackgerrit | Emilien Macchi proposed openstack/nova: DNM - tripleo CI test https://review.openstack.org/426949 | 13:07 |
| *** tblakes has joined #openstack-nova | 13:07 | |
| *** Apoorva has joined #openstack-nova | 13:08 | |
| *** tbachman has joined #openstack-nova | 13:09 | |
| *** mdnadeem has quit IRC | 13:10 | |
| *** edmondsw has joined #openstack-nova | 13:12 | |
| cdent | johnthetubaguy, andymccr: Did you guys work out what was going on a while back with the placement db or are things still weird? | 13:13 |
| cdent | andymccr: I'm pretty sure the original 409 that is happening is because the generation on the resource provider is run, but it corrects itself so the next writes out to work | 13:13 |
| cdent | s/out/ought/ | 13:13 |
| cdent | (they do for me when I've been testing things in devstack) | 13:14 |
| cdent | so your theory that it is a database problem is likely | 13:14 |
| *** Hosam has quit IRC | 13:14 | |
| *** zz_dimtruck is now known as dimtruck | 13:17 | |
| *** Apoorva has quit IRC | 13:17 | |
| johnthetubaguy | cdent: I think the DB wasn't configured correctly | 13:17 |
| johnthetubaguy | cdent: but I could be wrong, not seen andymccr latest results | 13:17 |
| *** Apoorva has joined #openstack-nova | 13:17 | |
| johnthetubaguy | cdent: I forgot we didn't merge the stuff to support the separate placement_database | 13:18 |
| *** liverpooler has joined #openstack-nova | 13:18 | |
| andymccr | johnthetubaguy: cdent - thanks for the info :) I'm testing some more things with database changes/perms etc - will update when i (hopefully) have something working! | 13:18 |
| cdent | yeah, it totally stalled out. I have a working change that I keep up to date for it, but people stated unspecific reservations about it, without specifics there was no way to move on... | 13:19 |
| * cdent is looking at the endpoint adjustment patch now | 13:19 | |
| johnthetubaguy | cdent: jaypipes: I still had worries about the allocations in that ironic patch, I added comments/suggestions | 13:19 |
| cdent | johnthetubaguy: that's next | 13:20 |
| johnthetubaguy | cool, thanks | 13:20 |
| cdent | I skimmed your comments earlier today and my immediate thought was "moar tests" | 13:20 |
| markus_z | mriedem: Would you please remove/re-evaluate your -1 on https://review.openstack.org/#/c/406897/ ? | 13:21 |
| *** diana_clarke has joined #openstack-nova | 13:22 | |
| *** Apoorva has quit IRC | 13:22 | |
| openstackgerrit | Andy McCrae proposed openstack/nova: Allow placement endpoint interface to be set https://review.openstack.org/426163 | 13:22 |
| openstackgerrit | Sylvain Bauza proposed openstack/nova: Add a status check for enabled filters https://review.openstack.org/427200 | 13:23 |
| sfinucan | Kevin_Zheng: Could you take a look at https://bugs.launchpad.net/nova/+bug/1660317 ? fwict, the error message that they're receiving should be mitigated by a patch of yours | 13:24 |
| openstack | Launchpad bug 1660317 in ironic (Ubuntu) "NotImplementedError for detach_interface in nova-compute during instance deletion" [Undecided,New] | 13:24 |
| sfinucan | Namely, this patch https://github.com/openstack/nova/commit/4ad414f3b1216393301ef268a64e61ca1a3d5be9 | 13:25 |
| sfinucan | ...though I could be reading that incorrectly :) | 13:25 |
| mriedem | sfinucan: have you seen https://review.openstack.org/#/c/403925/ ? | 13:26 |
| mriedem | markus_z: removed the -1 | 13:26 |
| mriedem | until i can dig deeper | 13:26 |
| *** dimtruck is now known as zz_dimtruck | 13:26 | |
| markus_z | mriedem: Thanks | 13:26 |
| *** Apoorva has joined #openstack-nova | 13:26 | |
| sfinucan | mriedem: I had not. I can take a look now | 13:27 |
| Kevin_Zheng | sfinucan: sorry, I'm on vacation and didn't got my computer with me:( | 13:28 |
| *** ducttape_ has quit IRC | 13:28 | |
| mriedem | sfinucan: just wondering if it's related to what you're asking about | 13:28 |
| bauzas | mriedem: FYI https://review.openstack.org/427200 | 13:28 |
| *** jpena is now known as jpena|lunch | 13:28 | |
| sfinucan | Kevin_Zheng: No problem at all - it's not that important. Enjoy your vacation :) | 13:28 |
| sfinucan | mriedem: I'm looking but I don't think so | 13:29 |
| *** jheroux has joined #openstack-nova | 13:29 | |
| Kevin_Zheng | Thanks | 13:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif: Updated from global requirements https://review.openstack.org/395347 | 13:32 |
| *** karimb has joined #openstack-nova | 13:33 | |
| *** Apoorva has quit IRC | 13:35 | |
| *** catinthe_ has joined #openstack-nova | 13:36 | |
| mriedem | toabctl: +2 on https://review.openstack.org/#/c/402318/ with some comments - the libvirt driver ignores the requested device name that tempest is sending in anyway | 13:37 |
| mriedem | so if the libvirt driver was always defaulting to vda i'm not sure how things worked with the xenproject ci | 13:37 |
| mriedem | doesn't look like the libvirt+xen ci overrides that in tempest.conf either http://logs.openstack.xenproject.org/18/402318/1/check/dsvm-tempest-xen/6b9829a/logs/tempest_conf.txt.gz | 13:38 |
| mriedem | anthonyper: ^ | 13:39 |
| toabctl | mriedem, is libvirt+xen tested? | 13:39 |
| mriedem | yes | 13:39 |
| mriedem | that's the xenproject ci | 13:39 |
| *** catintheroof has quit IRC | 13:40 | |
| *** kylek3h has joined #openstack-nova | 13:40 | |
| *** Apoorva has joined #openstack-nova | 13:40 | |
| mriedem | e.g. | 13:41 |
| mriedem | 2016-11-25 08:10:13.591 13563 WARNING nova.virt.libvirt.driver [req-98364dbb-0b80-49f3-9d59-ac476fdd3855 tempest-AttachVolumeShelveTestJSON-134397458 tempest-AttachVolumeShelveTestJSON-134397458] [instance: b0cf5c0f-ae34-4ca1-b441-08a3f4a85b71] Ignoring supplied device name: /dev/vdb | 13:41 |
| *** lucas-hungry is now known as lucasagomes | 13:43 | |
| *** diga has quit IRC | 13:44 | |
| mriedem | toabctl: dropped to a +1 until someone that knows about the xenproject ci can explain why this wasn't a failure before | 13:45 |
| mriedem | maybe it's just because that ci wasn't running the test in question, test_volume_boot_pattern | 13:46 |
| mriedem | anthonyper: is the xenproject ci whitelist/blacklist available somewhere? i'm wondering if i could enable test_volume_boot_pattern against https://review.openstack.org/#/c/402318/ | 13:47 |
| BobBall | DEVSTACK_GATE_TEMPEST_REGEX='(?!.*\[.*\bslow\b.*\]|.*TestVolumeBootPattern\.test_(volume_boot_pattern|create <-- confirmed | 13:47 |
| mriedem | where is that defined though? | 13:48 |
| *** vladikr has joined #openstack-nova | 13:48 | |
| BobBall | Defined here http://xenbits.xen.org/gitweb/?p=openstack/ci-loop-config.git;a=blob;f=jenkins/jobs/jobs.yaml;h=a1a29f4b0fdaa4730c842736ee7e2ae4e49d06da;hb=HEAD | 13:48 |
| BobBall | which is not easily testable | 13:48 |
| *** cburgess has quit IRC | 13:48 | |
| toabctl | mriedem, yes. the test is not executed. | 13:48 |
| toabctl | but then I should reenable the test with my changeset | 13:48 |
| *** Apoorva has quit IRC | 13:49 | |
| openstackgerrit | Andy McCrae proposed openstack/nova: Allow placement endpoint interface to be set https://review.openstack.org/426163 | 13:49 |
| mriedem | BobBall: ah so i can't use a depends-on like the xenserver ci | 13:49 |
| *** Apoorva has joined #openstack-nova | 13:49 | |
| toabctl | oh. it's on the external CI. so I can not simply change that | 13:49 |
| *** cburgess has joined #openstack-nova | 13:49 | |
| mriedem | right | 13:49 |
| mriedem | BobBall: we could move that blacklist into the nova tree... | 13:50 |
| toabctl | so I did test that manually on our internal CI... | 13:50 |
| mriedem | then it's branch-specific | 13:50 |
| BobBall | Sorry mriedem, it's not... | 13:50 |
| *** baoli has joined #openstack-nova | 13:50 | |
| mriedem | BobBall: like this https://github.com/openstack/nova/blob/master/devstack/tempest-dsvm-lxc-rc | 13:50 |
| mriedem | then that job definition just needs to use the DEVSTACK_GATE_TEMPEST_REGEX variable | 13:51 |
| BobBall | That's nice, but curious because clearly it's not *just* nova implicated with some of the tempest tests - for example there have historically been some tempest tests that only work with libvirt | 13:51 |
| *** fnordahl has quit IRC | 13:51 | |
| *** fnordahl has joined #openstack-nova | 13:51 | |
| BobBall | i.e. the tests make assumptions about the hypervisor e.g. that it can support qcow2 images made in the test themselves | 13:52 |
| mriedem | right so the tempest defaults are based on the nova defaults, which are libvirt | 13:53 |
| mriedem | if you're not using those defaults, you have to configure stufff | 13:53 |
| mriedem | that doesn't mean we couldn't control the xenproject ci blacklist from within the nova tree | 13:53 |
| BobBall | Indeed - but the case I was thinking about wasn't configurable | 13:53 |
| mriedem | bauzas: rechecked your scheduler stuff, the grenade patch merged before cells v1 broke, but the cells v1 thing is fixed now so all of the rechecks are running | 13:55 |
| bauzas | mriedem: cool, thanks for following that | 13:55 |
| *** fnordahl has quit IRC | 13:55 | |
| *** fnordahl has joined #openstack-nova | 13:55 | |
| *** cleong has joined #openstack-nova | 13:56 | |
| *** gouthamr has joined #openstack-nova | 13:56 | |
| mriedem | oomichi: sdague: johnthetubaguy: want to take a crack at this? i've got a +2 on it https://review.openstack.org/#/c/424759/ | 13:57 |
| mriedem | and the tempest change is approved https://review.openstack.org/#/c/426991/ | 13:57 |
| johnthetubaguy | mriedem: talking a look now, would be good to get that in | 13:58 |
| johnthetubaguy | mriedem: there was a spec to match it too, but thats more a documentation thing at this point I guess? | 13:59 |
| tdurakov | PaulMurray paul-carlton2 eliqiao shaohe_feng pkoniszewski yuntongjin mdbooth kashyap kmartin claudiub tobasco tdurakov abhishekk mrhillsman raj_singh wznoinsk siva_krishnan hi, live-migration subteam meeting in a minute on #openstack-meeting-3 | 13:59 |
| *** Apoorva has quit IRC | 14:02 | |
| *** Apoorva has joined #openstack-nova | 14:03 | |
| *** sdague_ has quit IRC | 14:05 | |
| *** bvanhav_ has joined #openstack-nova | 14:06 | |
| *** bvanhav has quit IRC | 14:07 | |
| mriedem | johnthetubaguy: the spec was merged yesterday | 14:10 |
| *** satyar has quit IRC | 14:10 | |
| mriedem | johnthetubaguy: the spec was a normal spec | 14:11 |
| mriedem | since it's an api change and we require a spec for api changes | 14:11 |
| johnthetubaguy | mriedem: yep, found that, all good | 14:11 |
| *** pbandark has quit IRC | 14:12 | |
| edleafe | cdent: about to get sucked into 4 hours of meetings, but for "moar tests", you could start adding on to https://review.openstack.org/#/c/404472/28/nova/tests/functional/api/openstack/placement/gabbits/ironic-inventory.yaml | 14:14 |
| *** bvanhav_ is now known as bvanhav | 14:14 | |
| edleafe | It's just the barest of tests now, but I started it with "moar" in mind | 14:14 |
| cdent | edleafe: reviewing that stuff now, will look | 14:14 |
| *** Apoorva has quit IRC | 14:16 | |
| *** zz_dimtruck is now known as dimtruck | 14:17 | |
| cdent | edleafe: I think we need functional tests on the resource tracker side, not the gabbi side? | 14:19 |
| *** tbachman has quit IRC | 14:19 | |
| *** tbachman has joined #openstack-nova | 14:20 | |
| *** Apoorva has joined #openstack-nova | 14:21 | |
| *** mdrabe has joined #openstack-nova | 14:22 | |
| *** mriedem has quit IRC | 14:23 | |
| sean-k-mooney | mriedem: regarding os-vif no i dont think there is anything that is outstanding that needs to merge before creating stable/ocata | 14:24 |
| *** gcb has quit IRC | 14:24 | |
| edleafe | cdent: ah, ok. I just had time to briefly read the scrollback. | 14:24 |
| cdent | edleafe: I'll see if I can come up with something. At least think on it. | 14:25 |
| *** Apoorva has quit IRC | 14:26 | |
| *** Apoorva has joined #openstack-nova | 14:27 | |
| *** ducttape_ has joined #openstack-nova | 14:27 | |
| *** dimtruck is now known as zz_dimtruck | 14:27 | |
| *** mlavalle has joined #openstack-nova | 14:29 | |
| *** Cristina_ has quit IRC | 14:29 | |
| *** Apoorva has quit IRC | 14:31 | |
| *** Apoorva has joined #openstack-nova | 14:31 | |
| *** ducttape_ has quit IRC | 14:31 | |
| *** Cristina_ has joined #openstack-nova | 14:32 | |
| *** breitz has quit IRC | 14:35 | |
| *** hfu has quit IRC | 14:35 | |
| *** Apoorva has quit IRC | 14:35 | |
| *** READ10 has joined #openstack-nova | 14:35 | |
| *** jpena|lunch is now known as jpena | 14:37 | |
| *** prateek has quit IRC | 14:38 | |
| dansmith | hmm, the scheduler patches are still not through the gate? | 14:39 |
| *** karimb has quit IRC | 14:41 | |
| *** karimb has joined #openstack-nova | 14:42 | |
| derekh | could somebody put a extra pair of eyes on https://review.openstack.org/#/c/417227/ , its holding back another patch I'm trying to fix | 14:45 |
| *** mtanino has joined #openstack-nova | 14:45 | |
| *** READ10 has quit IRC | 14:46 | |
| *** hongbin has joined #openstack-nova | 14:49 | |
| *** jamesdenton has joined #openstack-nova | 14:50 | |
| *** READ10 has joined #openstack-nova | 14:50 | |
| *** zz_dimtruck is now known as dimtruck | 14:51 | |
| *** satyar has joined #openstack-nova | 14:55 | |
| *** gszasz has quit IRC | 14:56 | |
| *** gszasz has joined #openstack-nova | 14:56 | |
| *** eharney has joined #openstack-nova | 14:57 | |
| *** crushil has joined #openstack-nova | 14:58 | |
| johnthetubaguy | dansmith: I think its that nasty gate bug fix that hadn't merged, when I last checked | 14:58 |
| dansmith | which one? is it approved? | 14:59 |
| *** tbachman has quit IRC | 15:01 | |
| *** tbachman has joined #openstack-nova | 15:02 | |
| *** prateek has joined #openstack-nova | 15:02 | |
| *** bkopilov has joined #openstack-nova | 15:03 | |
| sfinucan | derekh: Hmm, much as I hate to say it, could you move that patch /after/ the bug patch? | 15:03 |
| sfinucan | I realize that might mean using Mox, but I'm not sure if we can merge a Mox-mock conversion patch first now...? | 15:04 |
| *** dimtruck is now known as zz_dimtruck | 15:04 | |
| sfinucan | Let's see what johnthetubaguy and/or dansmith think first though | 15:04 |
| *** annegentle has joined #openstack-nova | 15:05 | |
| johnthetubaguy | sfinucan: I was eyeing that one up, I can try squash it | 15:05 |
| johnthetubaguy | dansmith: one sec, checking | 15:05 |
| *** burgerk has quit IRC | 15:06 | |
| *** mriedem has joined #openstack-nova | 15:06 | |
| johnthetubaguy | dansmith: https://review.openstack.org/#/c/427009/ | 15:06 |
| dansmith | johnthetubaguy: ah okay | 15:06 |
| *** nkrinner is now known as nkrinner_afk | 15:07 | |
| mdbooth | dansmith: I've had 2 people call me on the N, N-1 upgrade thing in 2 days now: https://review.openstack.org/#/c/423392/ | 15:09 |
| mdbooth | dansmith: Can you confirm I am/am not over-assuming there? | 15:10 |
| dansmith | mdbooth: I think they want you to use versions to enforce the behavior and not just assume right? | 15:11 |
| *** ayogi has joined #openstack-nova | 15:11 | |
| *** kaisers_ has quit IRC | 15:11 | |
| *** ayogi has quit IRC | 15:12 | |
| *** kaisers has joined #openstack-nova | 15:12 | |
| *** ayogi has joined #openstack-nova | 15:13 | |
| *** ayogi has quit IRC | 15:14 | |
| *** cdelatte has joined #openstack-nova | 15:14 | |
| *** ayogi has joined #openstack-nova | 15:14 | |
| *** tovin07 has joined #openstack-nova | 15:14 | |
| *** markus_z has quit IRC | 15:15 | |
| mriedem | sean-k-mooney: jaypipes: sfinucan: i'm going to put up a releases patch to cut stable/ocata for os-vif today unless you are aware of anything we have to get merged before that happens | 15:17 |
| sfinucan | mriedem: Nothing on my end | 15:17 |
| *** kaisers has quit IRC | 15:17 | |
| openstackgerrit | Maciej Szankin proposed openstack/nova: conf: Resolve TODOs in 'database' https://review.openstack.org/393695 | 15:18 |
| *** jaosorior has joined #openstack-nova | 15:20 | |
| *** kaisers has joined #openstack-nova | 15:22 | |
| *** vsaienko has joined #openstack-nova | 15:22 | |
| sean-k-mooney | mriedem: i dont think anything else needs to be added before the release | 15:23 |
| jaypipes | mriedem: go for it. | 15:23 |
| *** burgerk has joined #openstack-nova | 15:26 | |
| *** kaisers has quit IRC | 15:26 | |
| *** tlian has joined #openstack-nova | 15:27 | |
| mriedem | ok, thanks. will do after morning meetings. | 15:27 |
| *** owalsh is now known as owalsh-brb | 15:27 | |
| *** psachin has quit IRC | 15:27 | |
| *** gatuus has joined #openstack-nova | 15:27 | |
| mdbooth | mriedem: Do we have a concept of a minimum supported service version? | 15:28 |
| *** owalsh has joined #openstack-nova | 15:30 | |
| *** ayogi has quit IRC | 15:31 | |
| *** owalsh-brb has quit IRC | 15:31 | |
| *** armax has joined #openstack-nova | 15:32 | |
| *** breitz has joined #openstack-nova | 15:33 | |
| *** udesale has quit IRC | 15:35 | |
| *** kaisers has joined #openstack-nova | 15:35 | |
| *** vsaienko has quit IRC | 15:36 | |
| *** mtanino_ has joined #openstack-nova | 15:39 | |
| *** mtanino has quit IRC | 15:40 | |
| mdbooth | johnthetubaguy: Can we hold off on the libvirt+xen thing temporarily? Concerned about adding a quick hack for something that has been broken a long time. Quick hacks tend to last a long time, and are very expensive. Looking now. | 15:40 |
| *** raunak has joined #openstack-nova | 15:40 | |
| mdbooth | If this is causing a problem in the gate, could we disable the test again? | 15:41 |
| johnthetubaguy | mdbooth: we could, just seems like a big gain not to have | 15:43 |
| mdbooth | johnthetubaguy: I'm not definitely saying we shouldn't take the patch, just that I'd like to look first at why we need it, especially as ftersin was also concerned about it. | 15:44 |
| *** marst has quit IRC | 15:44 | |
| johnthetubaguy | mdbooth: you got the link again? | 15:44 |
| mdbooth | Problem is it's adding a new foo(x) returns y normally, but z in this other bizarre situation which nobody will every think of. | 15:44 |
| mdbooth | https://review.openstack.org/#/c/402318/1/nova/virt/libvirt/blockinfo.py | 15:44 |
| johnthetubaguy | I am just cruzing all bugs with a +2 already | 15:44 |
| mdbooth | We have lots of these, and they're just edge-case bug factories. | 15:45 |
| *** archies_ has joined #openstack-nova | 15:45 | |
| *** catinthe_ has quit IRC | 15:45 | |
| mdbooth | johnthetubaguy: My immediate thought, btw, is your suggestion to fix it during spawn | 15:47 |
| *** kaisers has quit IRC | 15:48 | |
| *** marst has joined #openstack-nova | 15:51 | |
| *** marst_ has joined #openstack-nova | 15:52 | |
| *** raunak has quit IRC | 15:52 | |
| *** marst has quit IRC | 15:55 | |
| *** foexle has quit IRC | 16:00 | |
| *** jdurgin1 has joined #openstack-nova | 16:01 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova: libvirt: Limit destroying disks during cleanup to spawn https://review.openstack.org/427267 | 16:03 |
| *** crushil has quit IRC | 16:03 | |
| *** ducttape_ has joined #openstack-nova | 16:03 | |
| *** READ10 has quit IRC | 16:04 | |
| *** crushil has joined #openstack-nova | 16:04 | |
| *** rcernin has quit IRC | 16:04 | |
| *** stvnoyes has joined #openstack-nova | 16:05 | |
| lyarwood | dansmith, mdbooth ; ^ I'd appreciate your thoughts on https://review.openstack.org/427267 if you have time today | 16:05 |
| mdbooth | lyarwood: It just set my spidey sense tingling :) Was about to look. | 16:05 |
| lyarwood | mdbooth: thanks | 16:06 |
| *** archies_ has quit IRC | 16:06 | |
| *** tbachman has quit IRC | 16:07 | |
| derekh | sfinucan: sorry was on a call, so do I need to swap the patches around? | 16:08 |
| sfinucan | derekh: No, I think johnthetubaguy is just going to squash them | 16:09 |
| derekh | sfinucan: ok, cool | 16:09 |
| mdbooth | lyarwood: Oof, so a failed reboot would delete the instance? | 16:10 |
| *** ekuris__ has quit IRC | 16:10 | |
| lyarwood | mdbooth: well, failure to plug the vifs during a reboot would delete any local files, yeah | 16:10 |
| mdbooth | Eesh, that's baaaad | 16:11 |
| mdbooth | lyarwood: Compare this change for context: https://review.openstack.org/#/c/389593/2/nova/virt/libvirt/driver.py | 16:13 |
| dansmith | lyarwood: oof, that's from me huh? | 16:13 |
| dansmith | although it's just because I'm calling cleanup where we weren't before | 16:13 |
| mdbooth | I'm -1 on ^^^ because it superficially probably passes the cases we can think of right now, but it depends on the phase of the moon. | 16:14 |
| mdbooth | If we took your change and ^^^, rbd disks would be deleted anyway | 16:14 |
| mdbooth | That's just a comment on why I'm against that sort of thing in general, btw, and I want us to start fixing root causes. | 16:15 |
| dansmith | mdbooth: is this demonstrably worse than what we have today? because I don't think it is, and the bug is pretty bad... | 16:15 |
| mdbooth | At first glance, I think your patch effectively specifies the caller's intent. | 16:15 |
| mdbooth | dansmith: I'm not being clear, I think the *other* patch is bad, and lyarwood's patch is an example of why. | 16:16 |
| mdbooth | dansmith: Sorry, was internally also trying to justify being against https://review.openstack.org/#/c/402318/ | 16:17 |
| * dansmith is lost | 16:18 | |
| *** ducttape_ has quit IRC | 16:19 | |
| * lyarwood is back and also lost ;D | 16:19 | |
| lyarwood | dansmith: yeah AFAICT we just didn't make it to cleanup before your patch | 16:19 |
| *** ducttape_ has joined #openstack-nova | 16:19 | |
| dansmith | so, to restate, I think we should merge lyarwood's patch | 16:20 |
| lyarwood | cool thanks | 16:20 |
| *** zz_dimtruck is now known as dimtruck | 16:20 | |
| mdbooth | dansmith: Yeah. Reviewing now. | 16:20 |
| *** yamahata has joined #openstack-nova | 16:21 | |
| *** tovin07 has quit IRC | 16:22 | |
| *** Oku_OS is now known as Oku_OS-away | 16:22 | |
| *** tovin07 has joined #openstack-nova | 16:22 | |
| *** Guest52040 has joined #openstack-nova | 16:22 | |
| *** READ10 has joined #openstack-nova | 16:23 | |
| *** baoli has quit IRC | 16:26 | |
| *** _ducttape_ has joined #openstack-nova | 16:29 | |
| *** sridharg has quit IRC | 16:30 | |
| *** xinli has joined #openstack-nova | 16:31 | |
| *** tovin07 has left #openstack-nova | 16:31 | |
| *** ducttape_ has quit IRC | 16:32 | |
| mriedem | sdague: did you see this? http://lists.openstack.org/pipermail/openstack-dev/2017-January/111137.html | 16:34 |
| mriedem | sdague: i was wondering if the new devstack-tools stuff somehow screwed up local.conf for multinode grenade? | 16:35 |
| sdague | mriedem: it's possible, though I thought I had that covered | 16:35 |
| mriedem | we know d-g is setting it http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/console.html.gz#_2017-01-27_23_16_09_271784 | 16:36 |
| sdague | mriedem: where is that job definition | 16:36 |
| mriedem | echo 'export LIVE_MIGRATION_AVAILABLE=True' | 16:36 |
| *** sudswas__ has joined #openstack-nova | 16:37 | |
| mriedem | sdague: https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/devstack-gate.yaml#L1674 | 16:37 |
| sdague | is that coming from project-config or d-g? | 16:37 |
| mriedem | echo 'export LIVE_MIGRATION_AVAILABLE=True' is from d- | 16:37 |
| mriedem | *d-g | 16:37 |
| mriedem | sdague: https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L542 | 16:37 |
| *** baoli has joined #openstack-nova | 16:38 | |
| mriedem | sdague: the weird thing i noticed was, | 16:38 |
| mriedem | looking at the local.conf http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/logs/new/local.conf.txt.gz | 16:38 |
| mriedem | NOVA_ALLOW_MOVE_TO_SAME_HOST=False is in there | 16:38 |
| mriedem | from https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate.sh#L541 | 16:38 |
| *** chyka has joined #openstack-nova | 16:38 | |
| mriedem | but export LIVE_MIGRATION_AVAILABLE=True isn't | 16:38 |
| mriedem | so i'm wondering if the export is screwing it up | 16:38 |
| *** sudipto has quit IRC | 16:39 | |
| *** sudipto_ has quit IRC | 16:39 | |
| sdague | yeh, it's litterally using the export bit | 16:40 |
| *** _ducttape_ has quit IRC | 16:40 | |
| *** tbachman has joined #openstack-nova | 16:41 | |
| sdague | mriedem: you want to do a depends on https://review.openstack.org/427282 and see if that addresses things? | 16:41 |
| *** ducttape_ has joined #openstack-nova | 16:41 | |
| *** sudipto has joined #openstack-nova | 16:41 | |
| mriedem | sure | 16:42 |
| sdague | I took a strategy of doing a merge for valid looking lines, so you don't just have clobber clobber clobber going on, but that means understanding the kind of lines that can be brought over | 16:42 |
| mdbooth | lyarwood: Done. | 16:43 |
| *** sree has quit IRC | 16:43 | |
| *** sree has joined #openstack-nova | 16:44 | |
| sdague | mriedem: yeh - http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/logs/grenade.sh.txt.gz#_2017-01-27_23_16_19_637 | 16:44 |
| *** _ducttape_ has joined #openstack-nova | 16:44 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: DNM: testing grenade multinode + live migration fix https://review.openstack.org/427285 | 16:45 |
| *** artom_ has joined #openstack-nova | 16:45 | |
| *** artom has quit IRC | 16:45 | |
| mriedem | skipped LIBS_FROM_GIT since there was no valid right? | 16:45 |
| lyarwood | mdbooth: thanks, I'll sort that out now | 16:45 |
| *** artom_ is now known as artom | 16:46 | |
| *** unicell has joined #openstack-nova | 16:47 | |
| *** ducttape_ has quit IRC | 16:47 | |
| *** bvanhav_ has joined #openstack-nova | 16:47 | |
| *** bvanhav has quit IRC | 16:48 | |
| sdague | mriedem: yeh | 16:48 |
| sdague | because there was no value | 16:48 |
| mriedem | sdague: ok. pointed out OS_NO_CACHE in the review too | 16:48 |
| mriedem | otherwise lgtm | 16:48 |
| *** sree has quit IRC | 16:48 | |
| mriedem | got the nova change up to test it | 16:49 |
| sdague | mriedem: honestly, I'd leave the OS_NO_CACHE bit for now. I get it's probably also wrong, but it's not impacting anything right now. | 16:51 |
| sdague | and, I'm not convinced it does anything useful anymore anyway | 16:51 |
| mriedem | yeah hmm, looks like that's all dead code http://git.openstack.org/cgit/openstack-dev/devstack/tree/openrc#n56 | 16:52 |
| mriedem | lots of stuff setting it, but nothing using it http://codesearch.openstack.org/?q=OS_NO_CACHE&i=nope&files=&repos= | 16:53 |
| *** mdrabe has quit IRC | 16:54 | |
| *** liangy has joined #openstack-nova | 16:55 | |
| *** kaisers has joined #openstack-nova | 16:56 | |
| *** tesseract has quit IRC | 16:56 | |
| *** efoley has joined #openstack-nova | 16:59 | |
| *** mdrabe has joined #openstack-nova | 16:59 | |
| sdague | mriedem: yeh | 16:59 |
| sdague | there were definitely a few things I noticed in d-g that were completely dead config settings | 17:00 |
| *** sudswas__ has quit IRC | 17:03 | |
| *** sudipto has quit IRC | 17:03 | |
| *** archies has joined #openstack-nova | 17:04 | |
| *** sudipto_ has joined #openstack-nova | 17:09 | |
| *** sudipto has joined #openstack-nova | 17:09 | |
| *** raunak has joined #openstack-nova | 17:09 | |
| *** andreas_s has quit IRC | 17:10 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova: libvirt: Limit destroying disks during cleanup to spawn https://review.openstack.org/427267 | 17:12 |
| *** browne has joined #openstack-nova | 17:13 | |
| openstackgerrit | Chris Dent proposed openstack/nova: WIP: Explore functional test for the resource tracker https://review.openstack.org/427309 | 17:14 |
| *** mgould has joined #openstack-nova | 17:15 | |
| mgould | hi everyone | 17:15 |
| mgould | I'm getting "Host is not mapped to any cell" errors in nova boot on a clean devstack on a freshly-installed baremetal machine | 17:15 |
| mgould | I've previously used the same local.conf on a VM without issues | 17:15 |
| openstackgerrit | Mihail proposed openstack/nova: proposed fix for bug 1646896 - System hangs when using NFS storage backend with loopback mounts, Closes-Bug: #1646896 https://review.openstack.org/422041 | 17:15 |
| openstack | bug 1646896 in OpenStack Compute (nova) "System hangs when using NFS storage backend with loopback mounts" [Low,Confirmed] https://launchpad.net/bugs/1646896 | 17:15 |
| mgould | any idea what I've done wrong? | 17:15 |
| cdent | jaypipes, edleafe, johnthetubaguy, mriedem : that review ^ about functional test for resource provider is trying to the basis for one that tests ironic. at the moment is just does non ironic | 17:16 |
| *** sgordon has quit IRC | 17:16 | |
| cdent | I needed to start there to get any traction | 17:16 |
| *** kaisers has quit IRC | 17:17 | |
| jaypipes | cdent: hmm, I was right in the middle of adding a functional test to the Ironic resource classes patch. | 17:17 |
| cdent | ah, good, now we'll have more | 17:17 |
| cdent | ;) | 17:17 |
| cdent | that one is very bland | 17:17 |
| *** tbachman has quit IRC | 17:18 | |
| cdent | jaypipes: perhaps we can compare and contrast later. I'm going to fix a couple bugs I found while making that. | 17:18 |
| *** unicell has quit IRC | 17:21 | |
| jaypipes | cdent: k | 17:22 |
| cdent | if my version is for naught, was an excellent learning exercise | 17:22 |
| *** tbachman has joined #openstack-nova | 17:23 | |
| *** unicell has joined #openstack-nova | 17:23 | |
| *** Swami has joined #openstack-nova | 17:25 | |
| *** Apoorva has joined #openstack-nova | 17:27 | |
| openstackgerrit | Diana Clarke proposed openstack/nova: Fix map_cell_and_hosts help https://review.openstack.org/422171 | 17:27 |
| openstackgerrit | Chris Dent proposed openstack/nova: Fresh resource provider in RT must have generation 0 https://review.openstack.org/427319 | 17:28 |
| *** crushil has quit IRC | 17:31 | |
| *** mgould has left #openstack-nova | 17:33 | |
| *** baoli has quit IRC | 17:35 | |
| *** efoley_ has joined #openstack-nova | 17:36 | |
| *** jdurgin1 has quit IRC | 17:36 | |
| *** efoley_ has quit IRC | 17:38 | |
| *** efoley_ has joined #openstack-nova | 17:38 | |
| *** efoley has quit IRC | 17:39 | |
| *** efoley__ has quit IRC | 17:39 | |
| openstackgerrit | Chris Dent proposed openstack/nova: [placement] Use modern attributes of oslo_context https://review.openstack.org/427330 | 17:40 |
| cdent | mriedem: both of those ^ might be rc oriented | 17:41 |
| mriedem | i +2ed the first one | 17:41 |
| mriedem | https://review.openstack.org/#/c/427319/ isn't a regression in ocata though right? it was just always that way | 17:42 |
| *** _ducttape_ has quit IRC | 17:42 | |
| *** sudipto_ has quit IRC | 17:43 | |
| *** sudipto has quit IRC | 17:43 | |
| *** liangy has quit IRC | 17:43 | |
| *** mdrabe has quit IRC | 17:46 | |
| *** efoley_ has quit IRC | 17:46 | |
| cdent | mriedem: not a regression, no, but sending out something with noise on it seems untidy | 17:47 |
| mriedem | sure, but we're also 2 days from rc1 | 17:50 |
| *** baoli has joined #openstack-nova | 17:50 | |
| mriedem | so i can live with untidy | 17:50 |
| mriedem | since we can backport fixes | 17:50 |
| mriedem | anyway, i'm +2 on it since it's a simple fix | 17:50 |
| *** mdrabe has joined #openstack-nova | 17:50 | |
| cdent | mriedem: that's cool. All this release schedule stuff is voodoo to me. I just smile and nod. | 17:50 |
| dansmith | jroll: sdague: so, we really need to be running discover_hosts after compute nodes are in the database, which for ironic happens pretty late compared to other virt drivers | 17:50 |
| *** slaweq has quit IRC | 17:50 | |
| dansmith | jroll: sdague: should I try to wedge in a discover_hosts call into the late stages of ironic devstack stuff? | 17:51 |
| *** karimb has quit IRC | 17:51 | |
| *** gouthamr has quit IRC | 17:51 | |
| dansmith | jroll: sdague: or maybe it's futile if people don't provide ironic nodes at the time of a devstack run? I'm not actually sure how that works | 17:52 |
| *** jose-phillips has quit IRC | 17:52 | |
| *** unicell has quit IRC | 17:52 | |
| *** slaweq has joined #openstack-nova | 17:52 | |
| *** annegentle has quit IRC | 17:52 | |
| *** gatuus has quit IRC | 17:53 | |
| *** mvk has quit IRC | 17:54 | |
| *** mgould has joined #openstack-nova | 17:54 | |
| *** catintheroof has joined #openstack-nova | 17:55 | |
| mriedem | cdent: it's pretty simple, just don't risk putting anything in right before rc1 unless it's super low risk, or super critical to get in | 17:55 |
| * cdent smiles | 17:56 | |
| * cdent nods | 17:56 | |
| mriedem | since you don't want to release a major version with some kind of major bug which prevents upgrades or something | 17:56 |
| mriedem | ha | 17:56 |
| cdent | I understand the mechanics. | 17:56 |
| mriedem | having said all that, i'd bet most deployments wait much longer to pick up anything, | 17:56 |
| cdent | that | 17:56 |
| mriedem | so when they upgrade, they're going to pick up like the 3rd stable branch release anyway | 17:56 |
| *** jamielennox is now known as jamielennox|away | 17:58 | |
| *** crushil has joined #openstack-nova | 18:00 | |
| * cdent has some dinner to fuel later debugging | 18:00 | |
| mriedem | cdent: before you dine, | 18:01 |
| cdent | mriedem: yessir? | 18:01 |
| mriedem | did either you or bauzas put anything up for the placement upgrade stuff in the devref? if not, i can start that | 18:01 |
| mriedem | it will be pretty simple | 18:01 |
| mriedem | just upgrade from newton notes | 18:01 |
| cdent | I did not | 18:01 |
| mriedem | bauzas: ? | 18:01 |
| mriedem | ok i'll get started on that one | 18:01 |
| cdent | thanks | 18:02 |
| *** lpetrut has quit IRC | 18:02 | |
| *** dimtruck is now known as zz_dimtruck | 18:04 | |
| *** romainh1 has joined #openstack-nova | 18:06 | |
| *** romainh has quit IRC | 18:06 | |
| *** gouthamr has joined #openstack-nova | 18:07 | |
| dansmith | sdague: question for you here: https://review.openstack.org/#/c/426310 | 18:10 |
| sdague | dansmith: ok, question away | 18:12 |
| dansmith | sdague: it's in the review | 18:12 |
| dansmith | about verify_noapi | 18:12 |
| *** romainh1 has quit IRC | 18:12 | |
| sdague | how can this run when the api is down? | 18:14 |
| dansmith | sdague: there are other ways to solve this, including some sort of post phase for the plugin, where we've already run the verify, if you'd prefer | 18:14 |
| dansmith | sdague: it's nova-manage | 18:14 |
| sdague | it all depends on 'nova service-list' | 18:14 |
| dansmith | oh, did I do it with service-list? I did.. | 18:14 |
| dansmith | I don't actually care that the api is down, of course, although I guess that means we won't have the primary node compute up either | 18:15 |
| sdague | right, that too | 18:15 |
| *** browne has quit IRC | 18:15 | |
| dansmith | so, then, yeah, I need to run discover_hosts again after we've done the resource verify | 18:15 |
| sdague | so, given the number of other things in flight, does this catch a failure that would have passed otherwise? Or is this just catching a failure earlier? | 18:17 |
| dansmith | sdague: so, according to the plugin docs, I could run discover from resource verify post-upgrade I guess | 18:17 |
| sdague | dansmith: yeh, post-upgrade seems like a put to run the discover_hosts again if you need it | 18:17 |
| dansmith | sdague: this is a new thing we've introduced, and that log link proves that we're actually hitting it | 18:17 |
| sdague | ok, but the fix for that isn't this, right? | 18:18 |
| sdague | the fix for that is another discover_hosts call | 18:18 |
| *** ijw has joined #openstack-nova | 18:18 | |
| dansmith | sdague: no, this is the fix, otherwise the new discover_hosts call is still a race | 18:18 |
| dansmith | sdague: if both computes aren't up, the discover_hosts won't do anything | 18:18 |
| dansmith | sdague: am I missing why you don't like this service check? | 18:19 |
| *** lucasagomes is now known as lucas-afk | 18:20 | |
| *** bvanhav__ has joined #openstack-nova | 18:22 | |
| sdague | dansmith: so where is the discover_hosts getting run? | 18:23 |
| *** bvanhav_ has quit IRC | 18:23 | |
| dansmith | sdague: right now it's only run in simple_cell_setup | 18:23 |
| openstackgerrit | OpenStack Release Bot proposed openstack/os-vif: Update reno for stable/ocata https://review.openstack.org/427341 | 18:24 |
| sdague | dansmith: and where does that get called during this flow that is failing? | 18:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif: Updated from global requirements https://review.openstack.org/395347 | 18:25 |
| dansmith | sdague: I'm not sure what you mean.. it's not failing, it's just not seeing the computenode record for the subnode when it runs in simple_cell_setup, which means later we end up without the hostmapping, and thus the failed test in that log I linked | 18:25 |
| openstackgerrit | OpenStack Release Bot proposed openstack/python-novaclient: Update reno for stable/ocata https://review.openstack.org/427344 | 18:25 |
| sdague | dansmith: right... but the issue is that's a failure here - https://github.com/openstack-dev/grenade/blob/a1ea5cec068d59b9c2caa1c82d7ee2584d63aa08/grenade.sh#L270 | 18:26 |
| *** jlk has quit IRC | 18:26 | |
| sdague | but all this code is executed here - https://github.com/openstack-dev/grenade/blob/a1ea5cec068d59b9c2caa1c82d7ee2584d63aa08/grenade.sh#L283-L287 | 18:26 |
| sdague | and I don't understand how code that runs after the failure in question is going to fix the issue | 18:27 |
| *** unicell has joined #openstack-nova | 18:27 | |
| dansmith | sdague: you mean it's on the old side? | 18:27 |
| *** archies has quit IRC | 18:27 | |
| sdague | yes | 18:27 |
| sdague | http://logs.openstack.org/79/396679/45/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/11607f2/logs/grenade.sh.txt.gz#_2017-01-30_09_49_58_107 | 18:28 |
| dansmith | sdague: okay, I'm not sure how it's hitting that on the old side, since the thing that is failing merged on friday | 18:28 |
| *** dharinic is now known as dharinic|lunch | 18:28 | |
| *** mvk has joined #openstack-nova | 18:28 | |
| sdague | dansmith: well that's where this failure is | 18:28 |
| *** ducttape_ has joined #openstack-nova | 18:28 | |
| dansmith | sdague: okay, so, I guess we'll continue to hold onto this fix for a condition that we know we've added | 18:28 |
| *** archies has joined #openstack-nova | 18:28 | |
| dansmith | sdague: if you could tell me why you have a problem with it, it'd sure save us time when this becomes a critical problem | 18:29 |
| *** annegentle has joined #openstack-nova | 18:29 | |
| dansmith | 'cause I still am confused about that part | 18:29 |
| sdague | dansmith: because I don't see what it's making better. This was framed with the logs in question as fixing that issue, but they don't, because that's a different and real issue about initial node racing on the way up | 18:30 |
| *** mjura has quit IRC | 18:30 | |
| artom | Is http://logs.openstack.org/59/424759/12/gate/gate-tempest-dsvm-cells-ubuntu-xenial/d7b1311/console.html#_2017-01-31_17_48_34_663215 something to do with ongoing cells work? | 18:30 |
| dansmith | sdague: you agree that race conditions exist that we know about, but just haven't hit yet right? | 18:30 |
| *** vsaienko has joined #openstack-nova | 18:31 | |
| *** krtaylor has quit IRC | 18:32 | |
| sdague | dansmith: there are bunches of those though, and I'm fine fixing issues we're hitting. It just seems like this keeps getting pushed for issues we aren't yet hitting. And that are unlikely to hit based on the real timelines for additional stuff that happens before the second tempest run happens | 18:32 |
| *** ducttape_ has quit IRC | 18:33 | |
| *** ralonsoh has quit IRC | 18:33 | |
| dansmith | sdague: right, so paraphrasing, what you just said is: "This is a race we know about, but right now we think we'll never hit it, so we'll just wait until the context has fallen out of our brains and it becomes a gate blocker in six months" | 18:33 |
| dansmith | over ten lines of bash | 18:34 |
| dansmith | sdague: and fwiw, the reason they're hitting that (just found out) is that their patch set base to master | 18:34 |
| dansmith | hitting that in that way I mean | 18:34 |
| *** lpetrut has joined #openstack-nova | 18:35 | |
| *** karimb has joined #openstack-nova | 18:38 | |
| *** prateek has quit IRC | 18:39 | |
| *** karimb has quit IRC | 18:40 | |
| melwitt | artom: not that I know of | 18:42 |
| *** archies has quit IRC | 18:42 | |
| *** ducttape_ has joined #openstack-nova | 18:43 | |
| artom | melwitt, hrmm, thanks :) | 18:43 |
| * artom shall try a recheck | 18:43 | |
| *** xinli has quit IRC | 18:45 | |
| melwitt | artom: we recently merged a patch (on Jan 27) that might be related to this, so I'll do some digging through the logs to see what could be happening | 18:47 |
| artom | melwitt, 4 days ago? We'd have noticed it by now if it was causing consistent failure in the gate... | 18:48 |
| mriedem | i've seen that failure | 18:48 |
| mriedem | it's intermittent | 18:48 |
| *** owalsh is now known as owalsh-brb | 18:49 | |
| *** ducttape_ has quit IRC | 18:49 | |
| * artom couldn't find any glaring traceback in the logs... | 18:49 | |
| *** ekhugen| has quit IRC | 18:50 | |
| melwitt | this is the test that uses reset-state to set servers to error, then lists them. there must be some race here | 18:50 |
| *** zz_dimtruck is now known as dimtruck | 18:51 | |
| *** ekhugen- has quit IRC | 18:51 | |
| *** liangy has joined #openstack-nova | 18:51 | |
| *** egarbade| has quit IRC | 18:51 | |
| *** jdurgin has quit IRC | 18:51 | |
| *** patriciadomin has quit IRC | 18:51 | |
| jaypipes | cdent: any ideas on this? (I've updated my tox venv to the latest wsgi-intercept release): http://paste.openstack.org/show/597078/ | 18:53 |
| *** nic has joined #openstack-nova | 18:53 | |
| * cdent looks | 18:53 | |
| *** owalsh-brb has quit IRC | 18:53 | |
| jaypipes | cdent: lol, nm | 18:53 |
| *** avolkov has quit IRC | 18:54 | |
| cdent | jaypipes: what was it? | 18:54 |
| jaypipes | cdent: I'd forgotten to do: | 18:54 |
| *** browne has joined #openstack-nova | 18:54 | |
| jaypipes | self.rt.report_client = self.report_client | 18:54 |
| jaypipes | where self.report_client is the test_report_client.NoAuthKeystoneClient thing | 18:54 |
| cdent | ah | 18:55 |
| jaypipes | boom. | 18:55 |
| jaypipes | perfecto. | 18:55 |
| mriedem | artom: melwitt: http://tinyurl.com/hkpuoel | 18:55 |
| cdent | jaypipes: cool, I was worried urllib3 had gone off and changed something (as they do) and made wsgi-intercept much more complicated (it's already a hairball) | 18:55 |
| jroll | dansmith: did you get your question answered? typical devstack registers nodes with ironic after starting ironic, and then we (re)start n-cpu. so yeah, thinking we should wedge it in here-ish https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L1556 | 18:55 |
| jaypipes | cdent: nah | 18:55 |
| artom | mriedem, hrmm, does keep popping up, doesn't it? | 18:56 |
| artom | And it predate's the change melwitt was talking about, since there are some on the 24th... | 18:57 |
| *** baoli has quit IRC | 18:58 | |
| melwitt | yeah, looks like this has been happening for awhile, just not often | 18:58 |
| *** Guest52040 has quit IRC | 18:58 | |
| *** owalsh-brb has joined #openstack-nova | 18:59 | |
| mriedem | i'll open a bug | 19:00 |
| *** ducttape_ has joined #openstack-nova | 19:00 | |
| openstackgerrit | Pushkar Umaranikar proposed openstack/nova: Adopts keystoneauth with glance client. https://review.openstack.org/412634 | 19:01 |
| *** ducttape_ has joined #openstack-nova | 19:01 | |
| *** tlian has quit IRC | 19:02 | |
| *** _ducttape_ has joined #openstack-nova | 19:02 | |
| *** patriciadomin has joined #openstack-nova | 19:03 | |
| artom | mriedem, melwitt, https://github.com/openstack/tempest/blob/master/tempest/api/compute/admin/test_servers.py#L50 | 19:03 |
| *** ekhugen has joined #openstack-nova | 19:03 | |
| artom | That seems... obvious? Surely you'd want to wait for the server to enter error state at that point... | 19:03 |
| *** ekhugen_alt has joined #openstack-nova | 19:03 | |
| *** egarbade- has joined #openstack-nova | 19:03 | |
| *** baoli has joined #openstack-nova | 19:03 | |
| *** mgould is now known as mgould|afk | 19:04 | |
| *** mgould|afk has left #openstack-nova | 19:04 | |
| *** ducttape_ has quit IRC | 19:05 | |
| mriedem | artom: well it could, | 19:06 |
| artom | I checked the api-ref, it returns 202, not 200 | 19:06 |
| mriedem | it fails in cells v1, i assume, because the child cell is reporting the vm_state change back up to the parent api cell so the instances in both dbs are in sync, and when tempest makes the GET request, the api cell doesn't have the updated vm_state yet | 19:06 |
| artom | So it's async and might not be done by the time the next requests lists the servers in error state... | 19:07 |
| mriedem | it's actually odd that it's a 202 | 19:08 |
| mriedem | because all that api does is literally change the vm_state in the db https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/admin_actions.py#L82 | 19:08 |
| *** tlian has joined #openstack-nova | 19:08 | |
| *** foexle has joined #openstack-nova | 19:10 | |
| mriedem | the upcall to the api cell is an rpc cast, | 19:10 |
| mriedem | i wonder if that's why it's a 202, for cells v1 | 19:10 |
| *** jdurgin has joined #openstack-nova | 19:10 | |
| *** dharinic|lunch is now known as dharinic | 19:11 | |
| *** bvanhav__ has quit IRC | 19:12 | |
| artom | Where does the cells call happen in that? | 19:13 |
| mriedem | in nova.objects.Instance.save | 19:13 |
| *** vsaienko has quit IRC | 19:14 | |
| *** _ducttape_ has quit IRC | 19:14 | |
| melwitt | I would think that would save it at the top and should be returned as 'error' as expected by the test. the save() would sync the vm_state change to the child. the get_all in compute/api is reading from child cells, so that's probably how it's happening | 19:14 |
| *** krtaylor has joined #openstack-nova | 19:14 | |
| *** gszasz has quit IRC | 19:15 | |
| melwitt | we've put in some conditionals "if cells v1, read from the top" but it looks like this was missed, for the get_all | 19:15 |
| artom | Bah, vim ctags has failed me | 19:15 |
| artom | It took me to agents.py save method for some reason | 19:15 |
| mriedem | here is the bug btw https://bugs.launchpad.net/nova/+bug/1660747 | 19:16 |
| openstack | Launchpad bug 1660747 in OpenStack Compute (nova) "test_list_servers_filter_by_error_status intermittently fails with MismatchError on no servers in response" [Medium,Confirmed] | 19:16 |
| melwitt | thanks | 19:16 |
| openstackgerrit | Lee Yarwood proposed openstack/nova: WIP - libvirt: Remove redundant bdm serial mangling during swap_volume https://review.openstack.org/427364 | 19:16 |
| *** enki_anunnaki has joined #openstack-nova | 19:16 | |
| mriedem | sfinucan: do you know the ReST magic to find the root of a doc tree? | 19:17 |
| mriedem | for a link | 19:17 |
| *** mlavalle has quit IRC | 19:17 | |
| *** kaisers has joined #openstack-nova | 19:17 | |
| *** jaosorior has quit IRC | 19:18 | |
| artom | melwitt, you wanna propose a fix to Tempest? Shall I? | 19:18 |
| *** jaosorior has joined #openstack-nova | 19:18 | |
| dansmith | melwitt: I definitely had that in one of my patches at some point | 19:18 |
| melwitt | artom: I'll propose a fix to nova, it's the get_all that needs a tweak I think | 19:19 |
| dansmith | melwitt: for get_all, but I don't see it right now, so might've been the victim of a rebase, although I was failing the cells job regularly without it | 19:19 |
| artom | melwitt, aha! | 19:19 |
| melwitt | dansmith: yeah, I think it must have gotten lost in the mix | 19:19 |
| artom | I still think Tempest should wait after a request that returns a 202, not just assume it's been completed... | 19:19 |
| * artom shall propose that | 19:20 | |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver https://review.openstack.org/391288 | 19:20 |
| openstackgerrit | Sarafraj Singh proposed openstack/nova-specs: Send service token along with user tokens https://review.openstack.org/426933 | 19:20 |
| mriedem | melwitt: technically, we don't have to care about fixing latent bugs in cells v1 | 19:20 |
| dansmith | mriedem: this isn't latent | 19:21 |
| melwitt | mriedem: it's not a latent bug in cells v1. it should have been working fine until we added cells v2 instance listing from all cells | 19:21 |
| *** kaisers has quit IRC | 19:21 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: doc: add upgrade notes to the placement devref https://review.openstack.org/427367 | 19:22 |
| mriedem | cdent: bauzas: ^ | 19:23 |
| mriedem | dansmith: melwitt: ok | 19:23 |
| browne | mriedem: do the RPC versions need to be updated for Ocata? seemed so, so i put up this patch: https://review.openstack.org/#/c/425958/ | 19:24 |
| lyarwood | dansmith: https://review.openstack.org/#/c/427267 should be ready for a review if you have time later today | 19:24 |
| melwitt | artom: I think we've left the test alone since it helps catch our bugs, but technically you're right, a 202 means wait | 19:25 |
| artom | melwitt, well, is the problem that the server state update takes too long, or doesn't happen at all? Because the latter isn't affected by waiting | 19:26 |
| mriedem | it would have to be a race, | 19:26 |
| mriedem | else this would be 100% failure | 19:26 |
| melwitt | artom: the problem is our code is reading instances from the child cells instead of the parent cell, for cells v1 | 19:26 |
| artom | It'll still catch the bugs, except it'll do it by timing out on the wait_for_server_status call | 19:26 |
| melwitt | most of the time, the sync down gets to the child before our read does, and in that case, it will pass the test | 19:27 |
| melwitt | no, it wouldn't catch this bug I don't think | 19:27 |
| melwitt | this is like a split second difference | 19:27 |
| artom | Ah, so the status ends up being synced in all cases | 19:28 |
| melwitt | yes | 19:28 |
| mriedem | lyarwood: i threw the rc-potential tag on that one since it's a regression | 19:28 |
| lyarwood | mriedem: ack thanks | 19:29 |
| artom | melwitt, wait, just to make this clear in my head: the write happens on the parent cell, the read from the child cells, so if you time your read really quickly after the write, you won't get the new state? | 19:29 |
| *** abalutoiu has quit IRC | 19:29 | |
| artom | And the fix you have in mind is to read from the parent cell? | 19:29 |
| melwitt | yes. cells v1 normally reads from the parent cell. it has instances table in the parent and the childs and it syncs them | 19:30 |
| *** bvanhav__ has joined #openstack-nova | 19:30 | |
| *** owalsh-brb is now known as owalsh | 19:31 | |
| artom | Hrmpf, this is indeed a case of a test being technically wrong but actually useful | 19:31 |
| *** pcaruana has quit IRC | 19:31 | |
| dansmith | artom: no | 19:31 |
| dansmith | artom: the test case can't tell where it's being read from | 19:31 |
| melwitt | he means the 202 return code implies async so it shouldn't just assume the state change is available after the call returns | 19:32 |
| artom | melwitt, words out of my mouth :) | 19:32 |
| melwitt | we know that it should be, from the code. but the API doesn't tell that | 19:32 |
| dansmith | is it not polling? | 19:32 |
| *** crushil has quit IRC | 19:32 | |
| *** raunak has quit IRC | 19:32 | |
| artom | dansmith, nope | 19:33 |
| melwitt | no, it's just immediately reading after | 19:33 |
| dansmith | ah, okay | 19:33 |
| dansmith | then yeah | 19:33 |
| jaypipes | mriedem, cdent: yes, I'm still working on functional tests for the Ironic patch. Didn't want you to think I forgot or am slacking. | 19:33 |
| * cdent gives jaypipes a sandwich | 19:33 | |
| mriedem | i'm pretty far removed from that patch by now, | 19:34 |
| mriedem | once john manhandled it | 19:34 |
| mriedem | like, before i start reviewing it again, someone is probably going to have to give me a recap of what happened | 19:34 |
| mriedem | browne: probably... | 19:35 |
| mriedem | i feel like russellb used to have a cheat sheet for this | 19:36 |
| *** ociuhandu has joined #openstack-nova | 19:36 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: doc: add upgrade notes to the placement devref https://review.openstack.org/427367 | 19:42 |
| *** annegentle has quit IRC | 19:45 | |
| mordred | mriedem: I've got this error coming up on nodepool patches: http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/screen-nodepool.txt.gz#_2017-01-31_19_02_00_177 | 19:45 |
| mordred | mriedem: which is reporting a 500 error from nova and <class 'sqlalchemy.exc.ProgrammingError'> as the error | 19:45 |
| mriedem | nice http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/screen-n-api.txt.gz?level=TRACE#_2017-01-31_19_02_00_169 | 19:46 |
| mordred | yah | 19:46 |
| mordred | isn't that pretty? (I was just about to paste that link next :) ) | 19:46 |
| mriedem | Table 'nova_cell0.instance_extra' doesn't exist | 19:46 |
| mriedem | mordred: you don't have your cells v2 stuff setup | 19:47 |
| mriedem | in whatever that thing is | 19:47 |
| mordred | well, it's nodepool's functional tests that run on top of a devstack node | 19:47 |
| mordred | does devstack-gate need cellsv2 now but not set it up by default? :( | 19:47 |
| mriedem | devstack sets up cells v2 | 19:47 |
| *** armax has quit IRC | 19:48 | |
| mriedem | https://github.com/openstack-dev/devstack/blob/master/lib/nova#L684 | 19:48 |
| mordred | neat. well, apparently something I'm doing there is not letting it I guess - Ill look fruther | 19:48 |
| mriedem | ^ creates the cell0 db | 19:48 |
| mordred | wow. so it should just do it without any flags it looks like | 19:48 |
| mriedem | mordred: and this stuff at the end https://github.com/openstack-dev/devstack/blob/master/lib/nova#L947 | 19:48 |
| mriedem | mordred: yes, cells v2 is required now in ocata | 19:48 |
| *** raunak has joined #openstack-nova | 19:48 | |
| mriedem | all ocata nova deployments will be at least a cell of one | 19:49 |
| mordred | mriedem: is there a cell service I need to enable? | 19:49 |
| mriedem | no | 19:49 |
| mriedem | that's cells v1 | 19:49 |
| mriedem | cells v2 is baked in | 19:49 |
| *** raunak has quit IRC | 19:50 | |
| mriedem | here is the nova_cell0 db create in your run http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_18_58_29_045 | 19:50 |
| mriedem | map_cell0 http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_19_01_45_588 | 19:50 |
| mriedem | and simple_cell_setup http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_19_01_48_335 | 19:50 |
| mordred | WEIRD | 19:50 |
| mriedem | that's an appropriate reaction | 19:51 |
| mriedem | http://docs.openstack.org/developer/nova/cells.html | 19:51 |
| mriedem | so when your thing blew up in n-api, cell0 would be mapped | 19:52 |
| mriedem | so i'm not sure why it's not finding the table | 19:52 |
| mriedem | *db | 19:52 |
| mriedem | or, maybe it found the db but the schema wasn't migrated? | 19:52 |
| mriedem | simple_cell_setup will migrate the db schema on the cell0 db | 19:53 |
| mordred | does it do the migration asynchronously? | 19:53 |
| mriedem | you can see it doing that here http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_19_02_00_128 | 19:53 |
| mriedem | no | 19:53 |
| *** jose-phillips has joined #openstack-nova | 19:53 | |
| diana_clarke | perhaps this? "WARNING: cell0 mapping not found - not syncing cell0." | 19:53 |
| *** annegentle has joined #openstack-nova | 19:53 | |
| mriedem | Warning: (1831, u"Duplicate index 'block_device_mapping_instance_uuid_virtual_name_device_name_idx' defined on the table 'nova_cell0.block_device_mapping' | 19:53 |
| *** vsaienko has joined #openstack-nova | 19:53 | |
| diana_clarke | http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_18_58_31_449 | 19:53 |
| mriedem | diana_clarke: that's expected | 19:54 |
| mriedem | we've created the dbs, but haven't mapped cell0 yet, that comeslater | 19:54 |
| mriedem | *comes later | 19:54 |
| *** foexle has quit IRC | 19:54 | |
| mriedem | https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L638 | 19:54 |
| mriedem | db sync attempts to fan out by default | 19:54 |
| mriedem | i'm not sure that should be a WARNING?!?!??! | 19:55 |
| mriedem | https://review.openstack.org/#/c/420973/ fixes the fanout thing | 19:55 |
| *** ociuhandu has quit IRC | 19:56 | |
| mriedem | we see this https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L1100 | 19:56 |
| *** ducttape_ has joined #openstack-nova | 19:56 | |
| mriedem | and then it migrates the schema for the cell0 db here https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L1107 | 19:56 |
| diana_clarke | mriedem: but only in the non-cells v1 case, it looks to me like cells v1 is enabled here. (ignore me though, I'm probably wrong) | 19:57 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: power_on/off and reboot https://review.openstack.org/427380 | 19:58 |
| diana_clarke | (b/c is_service_enabled n-cell returns 1, which I assume means true) | 19:58 |
| mriedem | diana_clarke: in the cells v1 case, cell0 db schema would be migrated here https://github.com/openstack-dev/devstack/blob/master/lib/nova#L956 | 19:58 |
| mriedem | but no, cells v1 isn't enabled here | 19:59 |
| mordred | mriedem: I just pushed this up: remote: https://review.openstack.org/427381 Update nodepool dsvm test to disable services | 19:59 |
| *** slaweq has quit IRC | 19:59 | |
| mordred | mriedem: just in case something is wonk with us whitelisting a set of services | 19:59 |
| *** slaweq has joined #openstack-nova | 19:59 | |
| mordred | mriedem: I don't see any other real differences between job configs | 19:59 |
| *** vsaienko has quit IRC | 19:59 | |
| mriedem | mordred: there is no extra service for cells so it wouldn't be a problem - but you probably need ^ for placement-api anyway | 20:00 |
| mriedem | since nova requires placement-api in ocata to start computes | 20:00 |
| mordred | shouldn't that default to on in devstack then? | 20:00 |
| mriedem | or it will once this merges https://review.openstack.org/#/c/425806/ | 20:00 |
| mriedem | mordred: it does | 20:00 |
| mordred | ok. cool | 20:00 |
| *** vsaienko has joined #openstack-nova | 20:00 | |
| mordred | but I need to not whitelist things | 20:00 |
| mordred | so that I get the placement-api things | 20:00 |
| mriedem | https://github.com/openstack-dev/devstack/blob/master/stackrc#L58 | 20:00 |
| mriedem | indeed | 20:01 |
| mriedem | which makes me think, i should probably sound the alarm in the dev list quick | 20:01 |
| *** ducttape_ has quit IRC | 20:01 | |
| mriedem | before the hordes show up saying their big tent CIs are now all failing because nova-compute won't start | 20:01 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: power_on/off and reboot https://review.openstack.org/427380 | 20:02 |
| mordred | ++ | 20:02 |
| *** Sukhdev has joined #openstack-nova | 20:03 | |
| mriedem | done | 20:03 |
| *** vsaienko has quit IRC | 20:04 | |
| mriedem | so when this blows up, we're getting here https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2440 | 20:04 |
| mriedem | which means map_cell0 worked, we have the cell0 mapping | 20:04 |
| mriedem | and from what i could tell in the devstack logs, the db schema was migrated for nova_cell0 | 20:05 |
| *** abalutoiu has joined #openstack-nova | 20:06 | |
| mriedem | should be right here http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_19_01_50_743 | 20:07 |
| mriedem | 2017-01-31 19:01:50.743 | 2017-01-31 19:01:50.743 4887 DEBUG migrate.versioning.script.base [req-067d40dc-316e-42b5-82e8-feaec4129b2b - -] Loading script /opt/stack/new/nova/nova/db/sqlalchemy/migrate_repo/versions/252_add_instance_extra_table.py... __init__ /usr/local/lib/python2.7/dist-packages/migrate/versioning/script/base.py:27 | 20:07 |
| mriedem | actually more like http://logs.openstack.org/06/425706/7/check/gate-dsvm-nodepool-src/7004c5b/logs/devstacklog.txt.gz#_2017-01-31_19_02_22_726 | 20:08 |
| mriedem | mordred: which is 22 seconds after your failure | 20:08 |
| mriedem | fails here 2017-01-31_19_02_00_177 | 20:09 |
| mordred | mriedem: oh. I mean ... | 20:09 |
| mriedem | nova_cell0 db schema is being migrated here 2017-01-31_19_02_22_726 | 20:09 |
| mordred | mriedem: it seems that devstack is still setting itself up when nodepool is running :( | 20:09 |
| mordred | jeblair: ^^ you may (or may not) find this scrollback interesting | 20:10 |
| mordred | jeblair: tl;dr - it's possible openstack is not yet ready when nodepool tries to start talking to it | 20:11 |
| mordred | sdague, ianw: ^^ you two may or may not also find it interesting | 20:13 |
| jeblair | mordred: that's weirdly parallel with our zookeeper conversation... but anyway, wouldn't any devstack test (eg tempest) have this issue? | 20:13 |
| mriedem | so... | 20:13 |
| mriedem | jeblair: d-g runs tempest after stack.sh is done | 20:13 |
| mriedem | so no | 20:13 |
| mriedem | i think we could move that map_cell0 call way further up in the stack run though, | 20:14 |
| sdague | mordred: is there a log somewhere? | 20:14 |
| mriedem | so that the cell0 schema is migrated way early when setting up the dbs, not at the tail end | 20:14 |
| mriedem | dansmith: melwitt: ^ | 20:14 |
| mordred | mriedem: ++ | 20:14 |
| mordred | jeblair: OOOOHHHHHH - we install nodepool as a devstack plugin - we do not install it during the post_test_hook | 20:14 |
| mriedem | i'll push something up to test that out | 20:14 |
| *** vsaienko has joined #openstack-nova | 20:15 | |
| jeblair | mordred: aha, of course. :) | 20:15 |
| mriedem | mordred: it's always good when it's the users fault :) | 20:15 |
| mordred | mriedem: :) | 20:15 |
| mordred | mriedem: although I vote for moving the cells call way further up too | 20:16 |
| mriedem | yeah i can still tinker on that | 20:16 |
| sdague | mordred: yeh, the post_test_hook should give you a better guaruntee of where you want to be | 20:16 |
| sdague | you only need to move your start there, right? | 20:16 |
| mordred | sdague: ++ | 20:16 |
| sdague | all the install / configure can happen earlier I would think | 20:16 |
| sdague | the post_test_hook is kind of recent, because ironic needed to ensure they could do a thing after tempest was installed and configured | 20:17 |
| mordred | well, we're already using post_test_hook too | 20:18 |
| sdague | mordred: oh, interesting | 20:18 |
| mordred | so I think we just need to consolidate a bit | 20:18 |
| mtreinish | sdague: I thought post_test_hook was the d-g for running things after testing is done? | 20:18 |
| sdague | mtreinish: oh, sorry, there is a new devstack plugin phase | 20:18 |
| sdague | one sec | 20:18 |
| mtreinish | I thought I called the plugin phase test-config or something like that | 20:19 |
| sdague | yeh, that | 20:19 |
| mordred | I may need/want that - because we're using devstack functions like crazy | 20:19 |
| mordred | so I make a test_config_nodepool function? | 20:19 |
| mordred | to use that phase? | 20:19 |
| sdague | mordred: yeh, test-config | 20:19 |
| sdague | mordred: so change https://github.com/openstack-infra/nodepool/blob/12d3caf560aa827ed47f320259cdb66a20f1e24b/devstack/plugin.sh#L465-L469 | 20:20 |
| sdague | s/extra/test-config/ | 20:20 |
| mordred | cool. thank you! that'll be super helpful | 20:20 |
| sdague | that executes here in stack.sh - https://github.com/openstack-dev/devstack/blob/e6f8dbb55fc8fccb18f4ccb5ed5723a2efc3b025/stack.sh#L1401 | 20:20 |
| *** gouthamr has quit IRC | 20:20 | |
| *** ducttape_ has joined #openstack-nova | 20:21 | |
| mriedem | mordred: sdague: here is the devstack change https://review.openstack.org/427392 | 20:22 |
| mordred | mriedem: I tell you what - we can get some code written aroud here | 20:23 |
| mriedem | just not reviewed or merged :) | 20:23 |
| mriedem | hi-o! | 20:23 |
| *** Guest15362 has quit IRC | 20:23 | |
| mordred | :) | 20:24 |
| mordred | I've been trying to land a shade patch since last tuesday | 20:24 |
| *** vsaienko has quit IRC | 20:24 | |
| mordred | I'm going to get it landed today if I have to write and land a patch to every repo in openstack | 20:24 |
| *** mtanino_ has quit IRC | 20:25 | |
| *** vsaienko has joined #openstack-nova | 20:26 | |
| openstackgerrit | melanie witt proposed openstack/nova: Read instances from API cell for cells v1 https://review.openstack.org/427394 | 20:27 |
| mtreinish | mordred: don't you have ninja merge powers... | 20:27 |
| mordred | mtreinish: don't tempt me | 20:28 |
| *** bvanhav__ is now known as bvanhav | 20:28 | |
| melwitt | dansmith: ^ see if that's what you expect for the cells v1 get_all | 20:29 |
| *** gouthamr has joined #openstack-nova | 20:30 | |
| *** sree has joined #openstack-nova | 20:30 | |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver (disk drv) https://review.openstack.org/409401 | 20:30 |
| *** armax has joined #openstack-nova | 20:30 | |
| *** sree has quit IRC | 20:35 | |
| *** vsaienko has quit IRC | 20:35 | |
| *** xinli has joined #openstack-nova | 20:36 | |
| *** Guest15362 has joined #openstack-nova | 20:36 | |
| *** bvanhav has quit IRC | 20:36 | |
| *** mlavalle has joined #openstack-nova | 20:37 | |
| *** vsaienko has joined #openstack-nova | 20:39 | |
| *** READ10 has quit IRC | 20:41 | |
| *** rfolco has quit IRC | 20:45 | |
| mriedem | melwitt: lgtm for the most part - would be nice to have a comment in there about the conditional | 20:46 |
| mriedem | like we have in _get_instance | 20:46 |
| *** dave-mccowan has quit IRC | 20:46 | |
| cdent | we collided a bit on that | 20:46 |
| melwitt | mriedem: yeah, adding now | 20:46 |
| melwitt | I saw cdent's comment | 20:46 |
| mriedem | i had to pull it down to make sure the else condition was being hit in tests | 20:46 |
| mriedem | since the compute api unit tests are confusing with the cells v1 and non-cells v1 stuff | 20:47 |
| *** xyang1 has joined #openstack-nova | 20:47 | |
| dansmith | melwitt: effectively, yeah | 20:49 |
| openstackgerrit | melanie witt proposed openstack/nova: Read instances from API cell for cells v1 https://review.openstack.org/427394 | 20:51 |
| *** satyar has quit IRC | 20:51 | |
| *** cdelatte has quit IRC | 20:51 | |
| mriedem | +2 | 20:53 |
| openstackgerrit | Anusha Unnam proposed openstack/nova: Add post hook script to run tempest with old n-api https://review.openstack.org/401395 | 20:53 |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver https://review.openstack.org/391288 | 20:54 |
| *** _ducttape_ has joined #openstack-nova | 20:54 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: power_on/off and reboot https://review.openstack.org/427380 | 20:55 |
| mriedem | oomichi: you were +2 before https://review.openstack.org/#/c/422171/ want to get that one now? | 20:56 |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver (disk drv) https://review.openstack.org/409401 | 20:56 |
| *** ducttape_ has quit IRC | 20:57 | |
| *** raj_singh_ has joined #openstack-nova | 21:02 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: doc: add some detail to the map_cell0 man page https://review.openstack.org/427450 | 21:02 |
| mriedem | diana_clarke: ^ addresses something i noted in your map_cell0 man page change after it was approved | 21:02 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: spawn/destroy https://review.openstack.org/391288 | 21:04 |
| *** kentb1 has joined #openstack-nova | 21:04 | |
| *** raj_singh_ has quit IRC | 21:05 | |
| *** edmondsw has quit IRC | 21:05 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: power_on/off and reboot https://review.openstack.org/427380 | 21:06 |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver (disk drv) https://review.openstack.org/409401 | 21:07 |
| openstackgerrit | Scott DAngelo proposed openstack/nova: WIP Support cinder v3 API https://review.openstack.org/420201 | 21:16 |
| mriedem | browne: so looking at when the newton version aliases were made, that happened in ocata https://review.openstack.org/#/c/386625/ | 21:17 |
| mriedem | browne: which leads me to believe we should wait to do https://review.openstack.org/#/c/425958/ in pike | 21:18 |
| mriedem | dansmith: is that right? or does it not matter? ^ | 21:18 |
| browne | mriedem: ok, so maybe it can wait | 21:19 |
| mriedem | ooo i found the checklist https://wiki.openstack.org/wiki/Nova/ReleaseChecklist | 21:20 |
| openstackgerrit | Chris Dent proposed openstack/nova: Optional separate database for placement API https://review.openstack.org/362766 | 21:21 |
| *** slaweq has quit IRC | 21:21 | |
| cdent | omg, "scheduler calling the placement api" just merged. | 21:21 |
| bauzas | indeed | 21:22 |
| *** mtanino has joined #openstack-nova | 21:22 | |
| mriedem | i thought it was getting bumped again | 21:22 |
| * cdent wipes brow | 21:22 | |
| bauzas | back from the cave | 21:22 |
| bauzas | mriedem: you okay if I'm just providing a new revision for the reno branch ? | 21:22 |
| *** jaosorior has quit IRC | 21:23 | |
| mriedem | bauzas: yes | 21:23 |
| bauzas | k | 21:23 |
| dansmith | mriedem: we need to add the aliases once know it's never going to change for a release, which usually means "after the release" | 21:23 |
| browne | ah ok | 21:23 |
| *** slaweq has joined #openstack-nova | 21:23 | |
| cdent | mriedem: I'm done for the day, but can I assume that https://etherpad.openstack.org/p/nova-ocata-rc1-todos is still the place to go tomorrow morning for things, like, to do? | 21:25 |
| mriedem | cdent: yup | 21:25 |
| mriedem | good progress today | 21:25 |
| cdent | cool | 21:25 |
| cdent | goodnight everybody | 21:25 |
| *** cdent has quit IRC | 21:26 | |
| mriedem | dansmith: https://wiki.openstack.org/wiki/Nova/ReleaseChecklist#Pre-release_Checklist is a bit confusing since it says "Ideally add the RPC version alias just before opening the next release" | 21:28 |
| mriedem | i guess ideally is, well, ideal | 21:28 |
| mriedem | but optional | 21:28 |
| kencjohnston | Where would I find the name of Nova's default read-only role, if there is one? | 21:28 |
| *** kfarr has joined #openstack-nova | 21:28 | |
| dansmith | mriedem: right | 21:28 |
| *** crushil has joined #openstack-nova | 21:32 | |
| *** vsaienko has quit IRC | 21:32 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: doc: refer to the cell_v2 man pages from the cells v2 doc https://review.openstack.org/427459 | 21:33 |
| openstackgerrit | Matt Riedemann proposed openstack/nova: doc: update the man page entry for nova-manage db sync https://review.openstack.org/427460 | 21:33 |
| *** Jeffrey4l_ has joined #openstack-nova | 21:34 | |
| *** READ10 has joined #openstack-nova | 21:35 | |
| *** Jeffrey4l has quit IRC | 21:35 | |
| *** catintheroof has quit IRC | 21:38 | |
| *** catintheroof has joined #openstack-nova | 21:38 | |
| *** catintheroof has quit IRC | 21:39 | |
| *** tblakes has quit IRC | 21:39 | |
| *** Jack_I has quit IRC | 21:39 | |
| *** rushil has joined #openstack-nova | 21:40 | |
| *** baoli has quit IRC | 21:43 | |
| *** cleong has quit IRC | 21:44 | |
| *** annegentle has quit IRC | 21:44 | |
| *** _ducttape_ has quit IRC | 21:46 | |
| *** ducttape_ has joined #openstack-nova | 21:46 | |
| *** rushil has quit IRC | 21:46 | |
| *** vsaienko has joined #openstack-nova | 21:46 | |
| openstackgerrit | Sylvain Bauza proposed openstack/nova: Collected release notes for Ocata CellsV2 https://review.openstack.org/424737 | 21:51 |
| openstackgerrit | Sylvain Bauza proposed openstack/nova: Add release note for nova-status upgrade check CLI https://review.openstack.org/426911 | 21:51 |
| openstackgerrit | Sylvain Bauza proposed openstack/nova: Add prelude section for Ocata https://review.openstack.org/426864 | 21:51 |
| *** tblakes has joined #openstack-nova | 21:52 | |
| *** baoli has joined #openstack-nova | 21:54 | |
| *** jaosorior has joined #openstack-nova | 21:55 | |
| *** marst_ has quit IRC | 21:58 | |
| *** thorst_ has quit IRC | 22:00 | |
| *** liangy has quit IRC | 22:00 | |
| *** baoli has quit IRC | 22:01 | |
| *** edmondsw has joined #openstack-nova | 22:02 | |
| *** crushil has quit IRC | 22:04 | |
| *** catintheroof has joined #openstack-nova | 22:05 | |
| *** catintheroof has quit IRC | 22:05 | |
| *** catintheroof has joined #openstack-nova | 22:06 | |
| *** krtaylor has quit IRC | 22:07 | |
| *** catintheroof has quit IRC | 22:11 | |
| *** edmondsw has quit IRC | 22:13 | |
| *** ducttape_ has quit IRC | 22:14 | |
| *** jamielennox|away is now known as jamielennox | 22:15 | |
| *** kentb1 has quit IRC | 22:15 | |
| sfinucan | mriedem: Bit late, but ':doc:/<path>' is relative to root | 22:15 |
| sfinucan | re: mriedem> sfinucan: do you know the ReST magic to find the root of a doc tree? for a link | 22:15 |
| mriedem | sfinucan: not too late yet | 22:16 |
| mriedem | thanks | 22:16 |
| *** jeblair has quit IRC | 22:16 | |
| *** kaisers has joined #openstack-nova | 22:17 | |
| *** edmondsw has joined #openstack-nova | 22:17 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: localdisk https://review.openstack.org/409401 | 22:19 |
| *** johndperkins has joined #openstack-nova | 22:19 | |
| *** thorst_ has joined #openstack-nova | 22:20 | |
| *** jheroux has quit IRC | 22:21 | |
| *** kaisers has quit IRC | 22:22 | |
| *** jamesdenton has quit IRC | 22:22 | |
| *** jeblair has joined #openstack-nova | 22:22 | |
| *** tblakes has quit IRC | 22:24 | |
| *** thorst_ has quit IRC | 22:25 | |
| *** baoli has joined #openstack-nova | 22:25 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: console https://review.openstack.org/409402 | 22:26 |
| openstackgerrit | Eric Fried proposed openstack/nova: Introduce base PowerVM driver (cfg drv) https://review.openstack.org/409404 | 22:26 |
| *** edmondsw has quit IRC | 22:28 | |
| *** edmondsw has joined #openstack-nova | 22:28 | |
| *** edmondsw has quit IRC | 22:29 | |
| mriedem | so another thought occurs to me, | 22:29 |
| *** edmondsw has joined #openstack-nova | 22:29 | |
| *** READ10 has quit IRC | 22:29 | |
| mriedem | nova-status upgrade check is checking for resource providers and compute nodes and fails if there are compute nodes but not RPs, | 22:29 |
| mriedem | i'm fixing that due to the fallback change in the filter scheduler, | 22:30 |
| mriedem | but i was just thinking, none of this matters unless you're using the filter scheduler - since the caching scheduler doesn't use placement at all in ocata, RPs or not | 22:30 |
| *** ducttape_ has joined #openstack-nova | 22:31 | |
| *** kfarr has quit IRC | 22:33 | |
| openstackgerrit | Sylvain Bauza proposed openstack/nova: Add a status check for enabled filters https://review.openstack.org/427200 | 22:34 |
| *** edmondsw has quit IRC | 22:34 | |
| *** annegentle has joined #openstack-nova | 22:34 | |
| *** kylek3h has quit IRC | 22:35 | |
| *** lpetrut has quit IRC | 22:39 | |
| *** ansiwen has quit IRC | 22:40 | |
| *** ansiwen has joined #openstack-nova | 22:40 | |
| *** eharney has quit IRC | 22:42 | |
| *** amotoki has quit IRC | 22:44 | |
| *** thorst_ has joined #openstack-nova | 22:45 | |
| *** dimtruck is now known as zz_dimtruck | 22:49 | |
| *** burt has quit IRC | 22:52 | |
| *** krtaylor has joined #openstack-nova | 22:53 | |
| *** markvoelker_ has joined #openstack-nova | 22:58 | |
| *** markvoelker has quit IRC | 22:58 | |
| *** tlian2 has joined #openstack-nova | 22:59 | |
| *** _ducttape_ has joined #openstack-nova | 23:03 | |
| *** tlian has quit IRC | 23:03 | |
| *** xyang1 has quit IRC | 23:03 | |
| *** tlian2 has quit IRC | 23:04 | |
| *** mdrabe has quit IRC | 23:04 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova: nova-status: relax the resource providers check https://review.openstack.org/427499 | 23:05 |
| *** panda has joined #openstack-nova | 23:05 | |
| *** ducttape_ has quit IRC | 23:06 | |
| *** xinli has quit IRC | 23:06 | |
| panda | dansmith: hi, did someone already ping you about https://bugs.launchpad.net/python-novaclient/+bug/1654183 today ? | 23:07 |
| openstack | Launchpad bug 1654183 in tripleo "Token based authentication in Client class does not work" [High,Triaged] | 23:07 |
| mriedem | hopefully ^ gets nova-status working in grenade now https://review.openstack.org/#/c/426926/ | 23:08 |
| mriedem | panda: that's fixed in novaclient 7.1.0 | 23:09 |
| mriedem | andreykurilin: ^ | 23:09 |
| panda | mriedem: even using 7.1.0 we're still having problems when retrieving nova keypair using token authentication | 23:10 |
| andreykurilin | panda: what project we are talking about? | 23:10 |
| andreykurilin | hi | 23:10 |
| mriedem | andreykurilin: tripleo | 23:10 |
| mriedem | andreykurilin: http://logs.openstack.org/31/426231/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6015c34/logs/undercloud/var/log/undercloud_install.txt.gz#_2017-01-31_18_25_17_000 | 23:10 |
| *** Guest15362 has quit IRC | 23:11 | |
| andreykurilin | let me check | 23:11 |
| mriedem | http://logs.openstack.org/31/426231/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/6015c34/logs/undercloud/var/log/keystone/keystone.txt.gz#_2017-01-31_18_25_17_339 | 23:11 |
| mriedem | 2017-01-31 18:25:17.339 32100 DEBUG keystone.middleware.auth [req-74362ac9-6544-4b45-83f8-e8dc56b1d7e2 - - - - -] There is either no auth token in the request or the certificate issuer is not trusted. No auth context will be set. fill_context /usr/lib/python2.7/site-packages/keystone/middleware/auth.py:188 | 23:12 |
| andreykurilin | ok, it looks like I know the reason | 23:12 |
| andreykurilin | of failure | 23:12 |
| *** trevormc has joined #openstack-nova | 23:13 | |
| *** sdague has quit IRC | 23:13 | |
| andreykurilin | it is about that commit - https://github.com/openstack/python-novaclient/commit/9bbe5a87b7df62a7962debba5db7c96555da6761 | 23:13 |
| panda | andreykurilin: anything we should check on our side ? | 23:13 |
| andreykurilin | panda: fix should be simple | 23:14 |
| andreykurilin | just +1;-1 | 23:14 |
| andreykurilin | the problem is that projectid argument of novaclient had different meaning in different cases | 23:14 |
| andreykurilin | we fix that | 23:15 |
| andreykurilin | and now projectid means Project ID in case of keystone termas | 23:15 |
| mriedem | andreykurilin: where do you see that from the logs? | 23:15 |
| andreykurilin | there is nothing in logs:) | 23:15 |
| mriedem | heh | 23:15 |
| andreykurilin | I checked the code | 23:16 |
| mriedem | so it's your gut | 23:16 |
| andreykurilin | https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L1239-L1240 | 23:16 |
| panda | +1;-1 ok, and they said that math wasn't useful at school. | 23:16 |
| andreykurilin | https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L1099 | 23:16 |
| andreykurilin | tenant is a tenant_name | 23:16 |
| andreykurilin | but we expects tenant name | 23:17 |
| andreykurilin | *but we expect tenand id | 23:17 |
| andreykurilin | *tenant | 23:17 |
| panda | so it must be fixed in instack-undercloud ? | 23:17 |
| andreykurilin | yes | 23:17 |
| mriedem | andreykurilin: will that also work with novaclient 6.0? | 23:18 |
| mriedem | because 6.0 is the minimum in g-r right now | 23:18 |
| openstackgerrit | John Griffith proposed openstack/nova: Implement new attach/detach Cinder flow https://review.openstack.org/330285 | 23:18 |
| openstackgerrit | John Griffith proposed openstack/nova: Remove check_attach https://review.openstack.org/335358 | 23:18 |
| panda | andreykurilin: ah, interesting | 23:20 |
| andreykurilin | mriedem: I think no, if we just transmit it `via project_name=tenant`. But I can assume that if we obtain OS_TENANT_ID at https://github.com/openstack/instack-undercloud/blob/master/instack_undercloud/undercloud.py#L1099 and use tenant_id keyword argument while novaclient initialization it should work with 6.0 and 7.1 | 23:21 |
| *** baoli has quit IRC | 23:21 | |
| mriedem | ok | 23:21 |
| mriedem | well, i've got to run, but thanks for the quick investigation | 23:21 |
| mriedem | i posted those notes into the bug report | 23:21 |
| andreykurilin | panda: are you ok with that change^ | 23:22 |
| *** tlian has joined #openstack-nova | 23:22 | |
| andreykurilin | I can quickly propose a patch | 23:22 |
| andreykurilin | mriedem: I'm glad I could help | 23:23 |
| panda | andreykurilin: fine with me | 23:24 |
| *** mriedem has quit IRC | 23:25 | |
| panda | bnemec: ^ | 23:27 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: spawn/destroy https://review.openstack.org/391288 | 23:28 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: power_on/off and reboot https://review.openstack.org/427380 | 23:28 |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: localdisk https://review.openstack.org/409401 | 23:28 |
| bnemec | Umm, we don't generate OS_TENANT_ID, so it's not quite that simple. | 23:28 |
| *** _ducttape_ has quit IRC | 23:29 | |
| *** ducttape_ has joined #openstack-nova | 23:30 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: console https://review.openstack.org/409402 | 23:30 |
| *** trevormc has quit IRC | 23:31 | |
| jaypipes | #success \0/ Finally got a good functional test created that stresses the Ironic and Nova integration and migration from Newton to Ocata. | 23:35 |
| openstackstatus | jaypipes: Added success to Success page | 23:35 |
| *** ducttape_ has quit IRC | 23:35 | |
| *** gouthamr has quit IRC | 23:35 | |
| openstackgerrit | Eric Fried proposed openstack/nova: PowerVM Driver: config drive https://review.openstack.org/409404 | 23:41 |
| *** dave-mccowan has joined #openstack-nova | 23:43 | |
| *** takashin has joined #openstack-nova | 23:44 | |
| andreykurilin | bnemec: hm | 23:45 |
| andreykurilin | bnemec: is it difficult to add that? | 23:46 |
| *** tlian has quit IRC | 23:47 | |
| bnemec | andreykurilin: I'm not sure how we would. We'd need to look up the id in nova, which we can't do until we can create a client. | 23:47 |
| bnemec | andreykurilin: Can we just switch to using a project name or something? | 23:48 |
| andreykurilin | bnemec: yes, but it will not be compatible with min version in g-r. We can use simple check of novaclient version to support all versions. Are you ok about that solution? | 23:49 |
| *** tlian has joined #openstack-nova | 23:50 | |
| openstackgerrit | Scott DAngelo proposed openstack/nova: WIP Support cinder v3 API https://review.openstack.org/420201 | 23:50 |
| bnemec | andreykurilin: I'm not sure we're as concerned about the minimum. Our repos are generated in such a way that I think if we find any way that works with the new novaclient we can start using that. | 23:50 |
| andreykurilin | oh | 23:50 |
| andreykurilin | cool | 23:50 |
| andreykurilin | so it is just +2;-2 change (with tests) | 23:51 |
| bnemec | Anyone on the old novaclient would be using the old instack-undercloud, and when they update to the new novaclient they should also get the new instack-undercloud. | 23:51 |
| *** crushil has joined #openstack-nova | 23:54 | |
| andreykurilin | bnemec panda: https://review.openstack.org/427515 | 23:55 |
| andreykurilin | it should fix an issue | 23:56 |
| bnemec | andreykurilin: Cool, thanks. | 23:56 |
| panda | not until we put OS_TENANT_ID in stackrc ? | 23:57 |
| andreykurilin | panda: that solution should work with OS_TENANT_NAME and with latest novaclient without changing stackrc | 23:57 |
| panda | andreykurilin: nice, thanks | 23:59 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!