09:03:07 <anuragmahanto243> #startmeeting powervm_driver_meeting 09:03:08 <openstack> Meeting started Wed Aug 21 09:03:07 2019 UTC and is due to finish in 60 minutes. The chair is anuragmahanto243. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:03:09 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:03:11 <openstack> The meeting name has been set to 'powervm_driver_meeting' 09:05:16 <VedaAnnayappa> Hi Anurag 09:05:35 <anuragmahanto243> Hi Veda 09:06:00 <VedaAnnayappa> how is the infrastructure of PowerVM CI, any progress? 09:07:07 <anuragmahanto243> In nodepool I can see following error. "ERROR nodepool.NodeLauncher: OpenStackCloudCreateException launching node id: 84686 in provider: PowerVM_DevStacked error:" 09:07:59 <anuragmahanto243> upon checking the hosts I am seeing error in "devstack@n-api-meta.service" 09:08:49 <anuragmahanto243> so every time nodepool tries to create a vm, this error is hit. 09:09:51 <anuragmahanto243> Here is the service status from one of the host. "devstack@n-api-meta.service - Devstack devstack@n-api-meta.service 09:09:51 <anuragmahanto243> Group: /system.slice/system-devstack.slice/devstack@n-api-meta.service 09:09:55 <anuragmahanto243> 5:46 neo6 devstack@n-api-meta.service[34054]: ERROR nova File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/ut 09:09:57 <anuragmahanto243> st-packages/sqlalchemy/en 09:09:59 <anuragmahanto243> 21 03:35:46 neo6 devstack@n-api-meta.service[34054]: ERROR nova DBNonExistentTable: (sqlite3.OperationalError) no such table 09:10:01 <anuragmahanto243> k@n-api-meta.service[34054]: *** no app loaded. going in full dynamic mode *** 09:10:25 <VedaAnnayappa> is the node fine? 09:11:04 <anuragmahanto243> All the hosts except 2 has this error. 09:11:31 <VedaAnnayappa> so only 2 hosts are in healthy state.. 09:11:45 <anuragmahanto243> yes 09:13:03 <anuragmahanto243> though I have done the manual run on neo11. 09:13:04 <anuragmahanto243> ============================================== 09:13:07 <anuragmahanto243> ====================== 09:14:28 <anuragmahanto243> I dont see a quick workaround, redeploying hosts are works for a while only. 09:15:32 <VedaAnnayappa> then we should think of upgrading the tool, stage by stage, why dont we upgrade upgrade needed for mysql, nodepool, openstack.. 09:16:51 <VedaAnnayappa> lets upgrade node pool.. and deploy few host and monitor the health status 09:20:47 <anuragmahanto243> yes we can upgrade node pool from 0.3.0 to 3.7.0 09:22:19 <VedaAnnayappa> lets try this one and see of we get some green signal, so as to conclude, powervm tests are working fine and infrastructure has to be updated 09:22:26 <anuragmahanto243> sure 09:24:14 <VedaAnnayappa> fine.. also community is moving to train release and it needs test to get triggered soon, we will try to bring a small setup working ... 09:24:37 <anuragmahanto243> okay 09:25:00 <VedaAnnayappa> cool 09:25:36 <VedaAnnayappa> #endmeeting 09:25:50 <anuragmahanto243> #endmeeting