Tuesday, 2018-10-09

*** itlinux has joined #openstack-cinder00:23
*** raunak12 has quit IRC00:23
*** LiangFang has joined #openstack-cinder00:42
*** lemko has quit IRC00:43
*** raunak12 has joined #openstack-cinder01:05
*** zhaochao has joined #openstack-cinder01:30
*** Dinesh_Bhor has joined #openstack-cinder01:44
*** TuanDA has joined #openstack-cinder01:52
*** mhen has quit IRC01:58
*** Dinesh_Bhor has quit IRC01:59
*** mhen has joined #openstack-cinder02:00
openstackgerritzhufl proposed openstack/cinder master: api_ref: total_capacity and free_capacity can be float  https://review.openstack.org/60880502:06
openstackgerritwang yong proposed openstack/cinder master: Cinder volume driver for Inspur AS13000 series  https://review.openstack.org/56297702:14
openstackgerritYikun Jiang proposed openstack/cinder-specs master: Add volume re-image api  https://review.openstack.org/60531702:38
*** psachin has joined #openstack-cinder02:40
*** Dinesh_Bhor has joined #openstack-cinder02:55
*** dave-mccowan has quit IRC03:02
*** psachin has quit IRC03:10
openstackgerrityenai proposed openstack/os-brick master: Improve VolumePathsNotFound message details  https://review.openstack.org/60557603:23
*** psachin has joined #openstack-cinder03:44
*** Dinesh_Bhor has quit IRC04:09
*** e0ne has joined #openstack-cinder04:27
*** e0ne has quit IRC04:27
*** pcaruana has joined #openstack-cinder04:38
*** LiangFang has quit IRC04:40
*** Dinesh_Bhor has joined #openstack-cinder04:51
*** brinzhang has joined #openstack-cinder04:53
*** pooja-jadhav has joined #openstack-cinder05:03
*** e0ne has joined #openstack-cinder05:04
*** pooja_jadhav has quit IRC05:04
*** e0ne has quit IRC05:04
*** raunak12 has quit IRC05:06
*** lixiaoy1 has joined #openstack-cinder05:10
*** pooja-jadhav is now known as pooja_jadhav05:19
openstackgerritMerged openstack/cinder master: Fix wrong NotFound in get_by_name_or_id  https://review.openstack.org/60502005:41
*** lemko has joined #openstack-cinder05:42
*** Luzi has joined #openstack-cinder05:48
openstackgerrityenai proposed openstack/os-brick master: Remove unused connection properties  https://review.openstack.org/60428706:06
openstackgerritzhufl proposed openstack/cinder master: api-ref: Add response fields and response example for volume manage  https://review.openstack.org/60885706:21
openstackgerritYikun Jiang proposed openstack/cinder master: Fix unexpected behavior in _clone_image_volume  https://review.openstack.org/60623506:30
*** brinzhang has quit IRC06:30
*** brinzhang has joined #openstack-cinder06:31
*** mvkr has quit IRC06:59
*** rcernin has quit IRC07:08
openstackgerritzhufl proposed openstack/cinder master: api-ref: Add response fields and response example for volume manage  https://review.openstack.org/60885707:12
openstackgerrityenai proposed openstack/os-brick master: Remove unused connection properties  https://review.openstack.org/60428707:13
*** Emine has joined #openstack-cinder07:22
*** binhnd108 has joined #openstack-cinder07:39
*** belmoreira has joined #openstack-cinder07:40
binhnd108hi guide07:40
binhnd108i upgraded my openstack lab from queens to rocky07:40
binhnd108with cinder i got an error when create volume from image07:41
binhnd108GlanceMetadataExists: Glance metadata cannot be updated, key signature_verified exists for volume id07:41
binhnd108GlanceMetadataExists: Glance metadata cannot be updated, key signature_verified exists for volume id xxxx07:41
binhnd108i read the release note of rocky cinder that07:41
binhnd108Added image signature verification support when creating volume from image. This depends on signature metadata from glance. This feature is turned on by default, administrators can change behaviour by updating option verify_glance_signatures. Also, an additional image metadata signature_verified has been added to indicate whether signature verification was performed during creating process.07:41
binhnd108it's a new featrue07:41
binhnd108it's a new feature07:41
binhnd108but why this error happened07:42
binhnd108and anyone here see that error?07:42
*** gkadam has joined #openstack-cinder07:57
*** e0ne has joined #openstack-cinder08:11
*** Dinesh_Bhor has quit IRC08:13
*** hamdyk has joined #openstack-cinder08:16
*** e0ne has quit IRC08:17
*** e0ne has joined #openstack-cinder08:18
*** e0ne has quit IRC08:26
*** Dinesh_Bhor has joined #openstack-cinder08:49
*** dpawlik has quit IRC08:51
*** dpawlik has joined #openstack-cinder08:52
*** psachin has quit IRC08:54
*** elmaciej has joined #openstack-cinder08:54
*** lixiaoy1 has quit IRC08:56
*** belmorei_ has joined #openstack-cinder08:57
*** belmoreira has quit IRC08:57
*** elmaciej has quit IRC08:59
openstackgerritwanghao proposed openstack/cinder-specs master: Incremental backup completion in RBD driver  https://review.openstack.org/60889309:17
openstackgerritzhufl proposed openstack/cinder master: api-ref: remove created_at from response example of list-transfer  https://review.openstack.org/60889509:19
openstackgerritHamdy Khader proposed openstack/os-brick master: Retry executing command "nvme list" when fail  https://review.openstack.org/60233209:20
*** mvkr has joined #openstack-cinder09:22
openstackgerritwanghao proposed openstack/cinder-specs master: Incremental backup completion in RBD driver  https://review.openstack.org/60889309:27
openstackgerritcaixiaoyu proposed openstack/cinder master: Rollback quota incorrect after retype volume failure  https://review.openstack.org/59858309:30
*** imacdonn has quit IRC09:39
*** dave-mccowan has joined #openstack-cinder09:49
*** KeithMnemonic has joined #openstack-cinder09:49
KeithMnemonicsmcginnis: jungleboyj: can i please get a WF+1 on https://review.openstack.org/#/c/606139/ ? thanks!09:50
*** imacdonn has joined #openstack-cinder09:52
*** binhnd108 has quit IRC09:56
*** TuanDA has quit IRC10:03
*** Dinesh_Bhor has quit IRC10:06
*** binhnd108 has joined #openstack-cinder10:12
*** markvoelker has joined #openstack-cinder10:25
openstackgerritRajat Dhasmana proposed openstack/cinder master: Cinder Backup: object_count value incorrect  https://review.openstack.org/60890810:31
*** mvkr has quit IRC10:44
*** binhnd108 has quit IRC10:50
*** ganso has joined #openstack-cinder10:52
*** Dinesh_Bhor has joined #openstack-cinder10:52
*** markvoelker has quit IRC10:58
*** mvkr has joined #openstack-cinder11:02
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix: UnboundLocalError variable referenced before assignment  https://review.openstack.org/60891411:05
*** amoralej is now known as amoralej|lunch11:14
*** erlon_ has joined #openstack-cinder11:16
openstackgerrittianhui proposed openstack/cinder master: Fix doc output examples  https://review.openstack.org/60892011:25
*** markvoelker has joined #openstack-cinder11:51
openstackgerritYikun Jiang proposed openstack/cinder master: WIP: volume reimage  https://review.openstack.org/60634611:56
*** zul has joined #openstack-cinder12:04
*** Dinesh_Bhor has quit IRC12:09
*** tpsilva has joined #openstack-cinder12:14
*** luizbag has joined #openstack-cinder12:15
*** brinzhang has quit IRC12:17
openstackgerritYikun Jiang proposed openstack/cinder master: WIP: volume reimage  https://review.openstack.org/60634612:24
openstackgerritYikun Jiang proposed openstack/cinder master: WIP: volume reimage  https://review.openstack.org/60634612:33
*** amoralej|lunch is now known as amoralej12:47
erlon_smcginnis, jungleboyj: hey, wev got a few backports pending, can you guys help us with that?12:50
erlon_https://review.openstack.org/#/q/Iaf8a3f0bed5af053d5ea7796d84d5d77f160845812:50
erlon_https://review.openstack.org/#/q/I4d6a4f5cf4f4f0f751e1378d3747d2aacc050d2412:50
*** lpetrut has joined #openstack-cinder12:58
*** dustins has joined #openstack-cinder13:02
*** dpawlik has quit IRC13:07
*** ociuhandu has joined #openstack-cinder13:07
*** zul has quit IRC13:09
*** mriedem has joined #openstack-cinder13:19
*** mvkr has quit IRC13:23
*** hamdykhader has joined #openstack-cinder13:25
*** hamdyk has quit IRC13:26
openstackgerritArne Wiebalck proposed openstack/cinder master: Support deferred deletion in RBD  https://review.openstack.org/60898413:42
openstackgerritVieri proposed openstack/python-cinderclient master: Don't quote {posargs} in tox.ini  https://review.openstack.org/60898613:45
openstackgerritSean McGinnis proposed openstack/cinder master: Handle drivers that do not support list manageable  https://review.openstack.org/60898813:47
openstackgerritArne Wiebalck proposed openstack/cinder master: Support deferred deletion in RBD  https://review.openstack.org/60898413:49
*** zhaochao has quit IRC13:55
*** mchlumsky has joined #openstack-cinder13:55
*** zul has joined #openstack-cinder13:58
*** eharney has joined #openstack-cinder14:00
KeithMnemonicsmcginnis: next one in the scaleio mitaka fix, https://review.openstack.org/60894214:00
smcginnisKeithMnemonic: If you notice any of those with a DocImpact in the commit message while you are backporting then, can you remove that line for future ones?14:01
smcginnisThat causes a doc bug to be created which we don't really want anymore. Especially for driverfixes backports.14:01
smcginnisKeithMnemonic: That one is definitely adding new functionality. Is that needed for a bug fix?14:04
*** Luzi has quit IRC14:05
*** itlinux has quit IRC14:07
*** eharney has quit IRC14:18
*** eharney has joined #openstack-cinder14:33
*** hamdykhader has quit IRC14:35
*** munimeha1 has joined #openstack-cinder14:56
*** lpetrut has quit IRC14:56
*** itlinux has joined #openstack-cinder15:08
*** qqmber has joined #openstack-cinder15:22
qqmberHi. Yesterday I had a disaster recovery and now almost everything is running again... but cinder. I'm using iscsi and for some reason every single volume I had now is in error state.15:24
qqmberI reset the state of one of them and try to start the instance that has attached to it... and no luck..15:24
qqmberitgtadm: failed to send request hdr to tgt daemon, Transport endpoint is not connected15:26
qqmberthat's one of the errors I got15:26
qqmberIf I do "# tgtadm --lld iscsi --op show --mode target", nothing is shown...15:28
*** eharney_ has joined #openstack-cinder15:31
*** eharney has quit IRC15:34
jungleboyjqqmber:  Was the system hosting the volumes included in the disaster?15:35
qqmberyes15:35
qqmberjungleboyj: yes15:36
jungleboyjqqmber:  Ok, so I think that is why you are seeing the behavior you were.  When the system went down those iSCSI exports are lost.15:36
jungleboyjYou will have to detach and reattach the volumes.15:36
qqmbercan I do that with the instance off?15:37
qqmberso, I should reset volume's state, then dettach it and at the end, re attach it?15:38
jungleboyjqqmber:  I think that is the process you need to follow.15:38
jungleboyjI haven't played with that in a while though.15:38
qqmberok, thanks.. I'll try to do it that way15:39
*** ianychoi has quit IRC15:39
jungleboyjqqmber:  No problem.  Disaster recovery is a bit more of an art than a science at the moment despite our attempts to improve it.15:39
qqmberhahaha.. yes, it is...15:39
*** munimeha1 has quit IRC15:43
*** KeithMnemonic has quit IRC15:43
qqmberbut in general... can you detach a volume from a turned off instance?15:46
*** binhnd108 has joined #openstack-cinder15:53
qqmberjungleboyj: ?15:55
qqmberjungleboyj: Didn't work.. I was able to detached it, but when I try to attach it again, "nothing" happens (in horizon... I'll try manuelly from the CLI)15:59
openstackgerritHelen Walsh proposed openstack/cinder stable/rocky: VMAX Rocky driver - correcting an incorrect backport  https://review.openstack.org/60904216:03
openstackgerritMerged openstack/cinder stable/queens: NetApp SolidFire: Fix force_detach  https://review.openstack.org/60805016:03
qqmberjungleboyj: When I reset the volume state, should I reset it to "in use" or "available"?16:03
*** belmorei_ has quit IRC16:03
*** ircuser-1 has quit IRC16:07
*** belmoreira has joined #openstack-cinder16:10
*** chhagarw has joined #openstack-cinder16:17
chhagarwcinder volume transfer allows to move the volume from one project to another, is there any way to share the volumes across multiple projects16:19
*** raunak12 has joined #openstack-cinder16:20
raunak12core reviewers could you please review https://review.openstack.org/#/c/608101/ ?16:21
*** zul has quit IRC16:23
*** qqmber has quit IRC16:24
*** gkadam has quit IRC16:25
openstackgerritLuiz Benedito Aidar Gavioli proposed openstack/cinder-tempest-plugin master: [DNM] Test Netapp CI  https://review.openstack.org/60905316:38
*** asbishop is now known as abishop16:42
*** mriedem is now known as mriedem_stew16:43
*** qqmber has joined #openstack-cinder16:45
*** eharney_ is now known as eharney16:52
jungleboyjqqmber:  I think Available as the existing connection data is all gone.16:59
qqmberjungleboyj: yes.. that worked... in terms of attach that volume to a new instance.. now I'm facing the problem the actual instance that had attached the volume at first won't start... nova says:17:01
qqmber"Exception during message handling: VolumeDeviceNotFound: Volume device not found at ."17:01
qqmberso.. what is first.. the egg or the chicken... ?17:01
jungleboyjYeah.  So you will need to create new instances and boot because they lost their disk.17:02
qqmbertheir disk.. you mean the volume?17:05
qqmberthe volume is not booteable.. is their "/data" folder, or whatever...17:05
qqmberis there any way to tell nova (or the instance) to "forget" that has a volume attached if the instance is off? I think what that, I can rescue everything17:06
jungleboyjmriedem_stew:  ^^ Thoughts?17:13
jungleboyjqqmber:  That is more of a Nova question.  Seeing it Matt can help.17:14
qqmberjungleboyj: ok.. and matt is here? or in another #openstack-* channel?17:14
jungleboyjI just pinged him above.17:15
qqmberoh.. thx!17:15
qqmberas far as my tests are going... every instance responds in a different way!17:15
jungleboyjqqmber:  No problem.  Sorry you are recovering from a disaster.17:16
qqmberthe good part is I've learning a LOT17:16
jungleboyjqqmber:  That is the attitude!17:16
jungleboyj:-)17:16
qqmber(after 30 straight hours...)17:17
qqmberhaha17:17
*** zul has joined #openstack-cinder17:20
qqmberjungleboyj: BTW, the procedure that worked for me was: as admin, change volume's state to "in use", then, as user, detach the volume from the shutoff instance, then, as user, turn on the instance, while is turning on, as user, attach the volume back. Voilá!17:37
qqmberwhen I start the instance, what it is done, is that the instance is destryed and launched again17:39
*** mchlumsky has quit IRC17:40
jungleboyjqqmber:  So you found the magic combination?17:43
qqmberpretty much... yes17:43
qqmberthe first combination didn't work.. and now I have an instance in error state...17:43
qqmbertrying to take it out of it...17:43
qqmberall other 10 instances are running now17:43
*** ociuhandu has quit IRC17:45
jungleboyjqqmber:  Well, that is good.17:45
qqmberis there a channel that I can ask stuff about nova? Plain #openstack ?17:46
jungleboyjqqmber: #openstack-nova17:46
qqmberdah....17:46
qqmberthx17:46
jungleboyj:-)17:47
qqmberafter 30 hours.. don't ask for much17:47
qqmberhaha17:47
*** amoralej is now known as amoralej|off17:49
qqmberjungleboyj: I spoke too early... in the last instance/volume I received: "libvirtError: Failed to open file '/dev/sdd': No such device or address"17:54
qqmberbut if I go to the server that has that volume/disk:17:54
qqmber# parted /dev/sdd print17:54
qqmber...17:54
qqmberNumber  Start   End     Size    File system  Name     Flags17:55
qqmber 1      1049kB  3000GB  3000GB               primary17:55
qqmberany clue why it doesn't see /dev/sdd?17:55
imacdonnqqmber: The nova team will like crucify you for asking deployment-related questions in #openstack-nova, which is intended for development discussion - better to at least start in #openstack18:00
qqmberoh...18:00
qqmberok18:00
qqmberimacdonn: thanks for that.. didn't know that18:00
imacdonnit is in the topic of the channel, FWIW :)18:00
*** binhnd108 has quit IRC18:01
*** gkadam has joined #openstack-cinder18:01
qqmberI thought your answer would be something like that :)18:03
jungleboyjraunak12:  We need to have your 3rd Party CI running properly again before we can approve patches.18:15
raunak12jungleboyj: aah didn’t see that. Will get that going18:17
jungleboyjraunak12:  Yeah, I have sent email to your CI maintainer and they were looking into problems with the FC job.18:18
*** hoangcx has quit IRC18:19
raunak12jungleboyj: I was the one looking into it. :) The CI is back up but looks like it fails for non master branches. https://review.openstack.org/#/c/607328/ this one runs fine for both fc and iscsi18:20
hemnaflerm18:22
*** chhagarw has quit IRC18:28
*** raunak12_ has joined #openstack-cinder18:31
*** mriedem_stew is now known as mriedem18:31
mriedemcrucify is a bit harsh18:32
*** raunak12 has quit IRC18:33
*** raunak12_ is now known as raunak1218:33
jungleboyjimacdonn:  Wow, that is harsh.  I didn't know they cared that much.18:34
mriedemyou can detach a data volume from a stopped instance https://github.com/openstack/nova/blob/master/nova/compute/api.py#L418218:34
smcginnismriedem: tar and feather?18:34
mriedema pinch to grow an inch18:34
jungleboyjraunak12:  Ok.  On that patch you reference though they are both failing.18:34
mriedemdetach the problem volume and hard reboot the server?18:34
imacdonnjungleboyj: it probably depends on who's active in the channel, and what else is going on at the time ... but I can see the channel getting overrun by noobs asking noob questions18:34
mriedemqqmber: ^?18:34
qqmbermriedem: I solved that problem, thanks!18:35
mriedemqqmber: ah cool18:36
* mriedem puts away the hammer and nails18:36
imacdonnheh18:36
imacdonnI got smacked for asking a "howto" question in one of the channels, when I was new .. I don't remember which channel18:36
jungleboyjHmmm, maybe they don't feel like smacking me.  Or I just pull mriedem  over here.18:37
jungleboyjraunak12:  Ok, I am sorry.  I missed that https://review.openstack.org/#/c/608101 was a backport.18:37
jungleboyjThat looks ok now.18:37
qqmbermriedem: but I have an easier one (my last problem after recovering from a disaster): I have one instance in error status and with no power state... I know the instance is fine (or it should be). How can I start it? Reset state change it to "error"18:37
jungleboyjsmcginnis: ^^^ you can remove your -2 I think.18:37
*** chhagarw has joined #openstack-cinder18:38
mriedemqqmber: reboot it18:38
mriedemyou can reset the state to active,18:38
mriedembut if the hypervisor thinks it's shutdown then that won't fix the power_state18:38
qqmberit is off, actually18:39
qqmberI want it in shutoff and without errors.. in order to turn it on, normally18:39
mriedemok then i think you want to hard reboot the vm18:39
mriedemhttps://github.com/openstack/nova/blob/master/nova/compute/vm_states.py#L7218:40
qqmberok, I'll check that out18:40
qqmberthx!18:40
qqmbermriedem: it was as simple as "nova stop instance" and then turn it on!18:46
qqmberit worked!18:46
jungleboyjNice!18:46
mriedemcool18:48
*** chenhaw has quit IRC18:48
mriedemi guess you can stop an ERROR instance https://github.com/openstack/nova/blob/master/nova/compute/api.py#L225218:48
mriedemdidn't have that one memorized yet18:48
qqmberyeap18:50
*** eharney has quit IRC18:53
*** qqmber has quit IRC19:06
*** eharney has joined #openstack-cinder19:08
*** markvoelker has quit IRC19:09
*** markvoelker has joined #openstack-cinder19:09
*** raunak12 has quit IRC19:10
openstackgerritMerged openstack/cinder master: Don't quote {posargs} in tox.ini  https://review.openstack.org/60875819:12
*** markvoelker has quit IRC19:15
*** chhagarw has quit IRC19:17
*** markvoelker has joined #openstack-cinder19:17
*** gkadam has quit IRC19:19
openstackgerritMerged openstack/cinder master: Fix doc output examples  https://review.openstack.org/60892019:27
*** raunak12 has joined #openstack-cinder19:33
*** mvkr has joined #openstack-cinder19:44
*** gouthamr has quit IRC19:58
*** luizbag has quit IRC20:02
openstackgerritEric Harney proposed openstack/cinder stable/pike: Storwize: self assign the SCSI lun id for volume attaching  https://review.openstack.org/60912320:26
*** pcaruana has quit IRC20:37
*** ganso has quit IRC20:38
*** erlon_ has quit IRC20:50
*** gouthamr has joined #openstack-cinder20:50
*** eharney has quit IRC21:05
*** Emine has quit IRC21:17
openstackgerritMerged openstack/cinder master: Remove the HGST Flash Storage Driver  https://review.openstack.org/60706221:22
*** prometheanfire has joined #openstack-cinder21:24
prometheanfirelooks like oslo.messaging-9.0.1 is still failing http://logs.openstack.org/85/609085/1/check/cross-cinder-py35/5178927/testr_results.html.gz21:24
*** dustins has quit IRC21:24
smcginnisprometheanfire: I think we still need the change imacdonn was working on.21:26
smcginnisjungleboyj: https://review.openstack.org/#/c/608768/ < Can you take a look at that one?21:27
imacdonnprometheanfire: I was thinking you could make your change dependent on mine21:27
* jungleboyj is looking.21:29
prometheanfireah, k21:30
prometheanfireimacdonn: that'd work21:30
smcginnisimacdonn, prometheanfire: I did that a few minutes ago.21:31
* jungleboyj gives the thumbs up.21:31
imacdonncool21:31
smcginnisimacdonn: Thanks for that.21:31
imacdonnnp21:31
jungleboyj#thanks to imacdonn for all he has been doing to help out Cinder lately!21:32
openstackstatusjungleboyj: Added your thanks to Thanks page (https://wiki.openstack.org/wiki/Thanks)21:32
imacdonn:)21:32
prometheanfire:D21:34
*** rcernin has joined #openstack-cinder22:42
*** lemko has quit IRC22:52
*** mriedem has quit IRC22:57
openstackgerritMerged openstack/cinder stable/queens: NetApp SolidFire: Fix CG snapshot deletion  https://review.openstack.org/60766223:03
*** itlinux has quit IRC23:14
*** erlon_ has joined #openstack-cinder23:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!