Tuesday, 2017-06-13

*** catintheroof has quit IRC00:03
*** sticker has joined #openstack-manila00:05
*** catintheroof has joined #openstack-manila00:11
*** cknight1 has quit IRC00:17
*** ganso has quit IRC00:21
*** catintheroof has quit IRC00:25
*** hongbin has quit IRC00:54
*** markstur_ has joined #openstack-manila00:55
*** markstur has quit IRC00:57
*** gouthamr has quit IRC01:42
*** jiaohaolin1 has left #openstack-manila01:45
*** tuanluong has joined #openstack-manila02:13
*** winston-d_ has joined #openstack-manila02:30
*** chlong has quit IRC02:42
*** gouthamr has joined #openstack-manila02:53
bswartzzhongjun: sorry for late response...03:30
zhongjunbswartz: It doesn't matter03:31
bswartzzhongjun: the issue of needing multiple subnets for dual v4/v6 shares when DHSS=true is something that came up it Atlanta, but only during side conversations on friday03:31
bswartztbarron gouthamr and I discussed it on a white board03:31
bswartzsome kind of change to share networks is definitely needed03:31
bswartzinitially there was some confusion about what is a "network" and what is a "subnet"03:33
bswartzeventually we agreed that a network is an L2 broadcast domain and there can be multiple subnets per network (for different address types, primarily)03:34
zhongjunbswartz: yes, we need some kind of change to share networks. as above, there are two ways. which one is suitable for manila or there is another way.03:37
bswartzzhongjun: it's something to discuss with the community03:37
bswartzplease put it on the agenda for thursday03:38
zhongjunbswartz: ok, How about I separate ipv6 patch to two patch:  DHSS=true  and  DHSS=false03:40
bswartzI kind of don't like that03:41
bswartzI'd prefer 1 patch with some acknowledged limitations03:41
bswartzthen we can solve the limitations later03:41
bswartzseparating the patches just creates more work03:42
zhongjunbswartz:  We need to test lvm ipv6 (DHSS=false) first03:42
zhongjunbswartz: It could make our patch's goalsmore clearly03:43
bswartzyeah but we could also make the primary goal to make dhss=false work, and dhss=true to partially work03:45
bswartzthen later make dhss=true fully work03:45
zhongjunbswartz:  or add this patch  https://review.openstack.org/#/c/444479/ in ipv6 patch(DHSS=false),    Then we can run lvm-ipv6-job  https://review.openstack.org/#/c/443737/03:45
zhongjunbase on one patch03:46
zhongjunbswartz: It could a little weired, if I just let patch support both ipv6 and ipv4 for  dhss=false, and only support ipv6 or ipv4 for dhss=true03:54
zhongjunbswartz: in one patch03:55
*** gcb has quit IRC03:58
*** arnewiebalck_ has joined #openstack-manila04:15
*** jprovazn has joined #openstack-manila04:19
*** gouthamr has quit IRC05:23
*** gcb has joined #openstack-manila05:30
*** gcb has quit IRC05:46
*** gcb has joined #openstack-manila05:47
*** markstur_ has quit IRC05:49
*** markstur has joined #openstack-manila05:50
*** markstur has quit IRC05:55
*** sticker_ has joined #openstack-manila06:03
*** sticker has quit IRC06:06
*** pcaruana has joined #openstack-manila06:06
*** sticker_ is now known as sticker06:16
*** markstur has joined #openstack-manila06:31
*** td has quit IRC06:34
*** markstur has quit IRC06:36
*** td has joined #openstack-manila06:36
*** markstur has joined #openstack-manila07:13
*** markstur has quit IRC07:18
*** a-pugachev has joined #openstack-manila07:29
*** markstur has joined #openstack-manila07:55
*** markstur has quit IRC08:00
*** makowals has quit IRC08:38
*** makowals has joined #openstack-manila08:41
*** dsariel_ has joined #openstack-manila08:48
*** dsariel_ has quit IRC08:49
*** dsariel_ has joined #openstack-manila08:49
*** dgonzalez_ has joined #openstack-manila09:21
*** david_ has joined #openstack-manila09:21
*** tpatzig_ has joined #openstack-manila09:21
*** david_ has quit IRC09:23
*** dgonzalez_ has quit IRC09:23
*** tpatzig_ has quit IRC09:23
*** makowals has quit IRC09:43
*** makowals has joined #openstack-manila09:49
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346409:54
*** rraja has joined #openstack-manila10:00
*** arnewiebalck__ has joined #openstack-manila10:01
*** lpetrut has joined #openstack-manila10:01
*** arnewiebalck_ has quit IRC10:03
*** arnewiebalck__ is now known as arnewiebalck_10:03
*** rraja has quit IRC10:10
*** markstur has joined #openstack-manila10:21
*** markstur has quit IRC10:25
*** markstur has joined #openstack-manila10:42
*** arnewiebalck_ has quit IRC10:43
*** ganso has joined #openstack-manila10:46
*** markstur has quit IRC10:46
*** dsariel_ has quit IRC10:55
*** markstur has joined #openstack-manila11:03
*** markstur has quit IRC11:07
*** sticker_ has joined #openstack-manila11:07
*** sticker__ has joined #openstack-manila11:08
*** sticker has quit IRC11:11
*** sticker_ has quit IRC11:12
openstackgerritTom Barron proposed openstack/manila master: [Docs] Correct glusterfs references  https://review.openstack.org/47378711:21
*** markstur has joined #openstack-manila11:23
*** sticker__ is now known as sticker11:26
*** markstur has quit IRC11:28
*** markstur has joined #openstack-manila11:44
*** markstur has quit IRC11:48
*** chlong has joined #openstack-manila11:57
*** arnewiebalck_ has joined #openstack-manila12:01
openstackgerritMerged openstack/puppet-manila master: Add environment variable  https://review.openstack.org/47327112:02
*** tuanluong has quit IRC12:04
*** dsariel_ has joined #openstack-manila12:11
openstackgerritzhongjun proposed openstack/manila master: Add like filter  https://review.openstack.org/46246812:15
*** openstackgerrit has quit IRC12:18
*** openstackgerrit has joined #openstack-manila12:23
openstackgerritTom Barron proposed openstack/manila master: [Docs] Correct glusterfs references  https://review.openstack.org/47378712:23
*** markstur has joined #openstack-manila12:25
*** markstur has quit IRC12:30
*** catintheroof has joined #openstack-manila12:33
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346412:44
*** rraja has joined #openstack-manila12:55
*** arnewiebalck_ has quit IRC12:56
bswartzzhongjun: yes that's what I had in mind13:00
*** markstur has joined #openstack-manila13:07
*** eharney has joined #openstack-manila13:10
*** xyang1 has joined #openstack-manila13:10
*** xyang_ has joined #openstack-manila13:11
*** markstur has quit IRC13:12
xyang_bswartz: ping13:16
*** dustins has joined #openstack-manila13:18
xyang_bswartz: Several of our CI's are broken because of this bug: https://bugs.launchpad.net/manila/+bug/169758113:26
openstackLaunchpad bug 1697581 in Manila "create snapshot failed due to absent of snapshot['share_id']" [Critical,Confirmed] - Assigned to EMC VNX OpenStack (emc-vnx-openstack)13:26
xyang_bswartz: I wonder if you ran into the same issue with NetApp CI?13:26
*** dustins has quit IRC13:29
*** dustins has joined #openstack-manila13:29
bswartzxyang_: it would depend on the driver13:36
*** gouthamr has joined #openstack-manila13:36
xyang_bswartz: NetApp driver seems to be referencing it as well.  that's why I asked13:37
bswartzxyang_: it looks like our CI is broken but it's not clear that that bug is related13:37
bswartzxyang_: do you know which change introduced the breakage?13:38
bswartzin theory whatever change removed the field from the model should have fixed the drivers in the same commit13:38
xyang_bswartz: https://review.openstack.org/#/c/433854/12/manila/db/sqlalchemy/models.py13:39
bswartzoh!13:39
bswartzthe one we just merged13:39
bswartzso maybe this is my fault for not looking at CI results13:39
xyang_bswartz: :(13:39
xyang_bswartz: I didn't look either:(13:40
xyang_bswartz: https://github.com/openstack/manila/blob/master/manila/share/drivers/netapp/dataontap/cluster_mode/lib_base.py#L79113:40
xyang_bswartz: two of our CI's failed on that patch and I didn't notice it:(13:41
bswartzokay so the question is should we change the drivers or change the model13:42
bswartzI'll have to take a closer look13:42
xyang_ok13:44
*** markstur has joined #openstack-manila13:49
*** cknight has joined #openstack-manila13:51
*** eharney has quit IRC13:52
*** markstur has quit IRC13:54
*** eharney has joined #openstack-manila13:56
bswartzvponomaryov: was the removal of the share_id property here necessary? https://review.openstack.org/#/c/433854/12/manila/db/sqlalchemy/models.py14:01
bswartzIMO it should have stayed14:02
vponomaryovbswartz: it is not removed14:10
bswartzvponomaryov: what happened to it then?14:11
xyang_vponomaryov: share_id is still a field but it is not populated any more14:11
bswartzlines 729-734 look like it was removed14:11
vponomaryovbswartz: 72714:12
vponomaryovfor right14:12
vponomaryovbswartz: it is not proxy to other attr anymore it is standalone attr now14:13
bswartzaccording to xyang the field is blank14:13
xyang_vponomaryov: but that is not populated any more14:13
bswartzso maybe there's a bug?14:13
vponomaryovxyang_: it is populated on db migration step14:13
bswartzbecause drivers should see a property called "share_id" which is exactly the share_instance_id14:13
xyang_bswartz: we are fixing our drivers to use share_instance_id instead14:13
bswartzxyang_: no that's not the right fix14:14
vponomaryovit is14:14
xyang_bswartz: why not?14:14
xyang_bswartz: the snapshot passed in create_snapshot in the driver is an instance14:14
bswartzxyang_: when we introduce share instances years ago, the goal was to prevent drivers from knowing that fact14:14
bswartzfrom the driver's perspective, it was all supposed to look like plain shares and snapshots14:15
vponomaryovbswartz: drivers handle more than one instance14:15
bswartzdrivers weren't supposed to know about instances14:15
vponomaryovbswartz: disagree14:15
bswartzlater, when replication and migration happened it became necessary for drivers to know about instances14:15
xyang_bswartz: not sure if that's possible for driver not to know about instance14:15
bswartzbut outside of those 2 features knowledge of instances should not be reuqired14:16
xyang_vponomaryov: you are saying share_id should be populated after running db migration?  Our CI's are fresh installs and share_id is not populated14:18
vponomaryovhttps://review.openstack.org/#/c/433854/12/manila/db/migrations/alembic/versions/b10fb432c042_squash_share_group_snapshot_members_and_share_snapshot_instance_models.py14:18
xyang_bswartz: It's strange that only 2 features can use instance but other features cannot.14:19
xyang_bswartz: once driver starts to have knowledge about it, then it knows about it14:20
vponomaryovxyang_: if it is None then it means it was not set in place that is used as source14:20
xyang_vponomaryov: that should be set in the manager though if it is ever populated14:21
xyang_vponomaryov: I mean we don't see it in the driver after a fresh install in create_snapshot14:21
vponomaryovthen, it means it was never set in the source14:23
vponomaryovyou were depending on other attr all the time14:23
vponomaryovxyang_: so, I guess, you are right, this DB migration includes only port of share group snapshot members14:24
vponomaryovxyang_: share manager didn't write it before and does not now14:25
bswartzxyang_: I'm not sure what to do about the driver interface issue14:25
bswartzwe have some older drivers which might not update to a newer interface14:25
bswartzso we need to provide backward compatibility14:25
xyang_bswartz: if we need to always provide backward compatibility, then the share_id property needs to be added back, and we don't need to change our driver given that share_id will always be populated14:27
bswartzxyang_:  that was the point I was trying to make14:29
bswartzI think we should continue to provide backward compatibility in the snapshot model14:29
bswartzI was trying to find out if there was a good reason to remove it14:29
vponomaryovbswartz: it was providing wrong value14:30
vponomaryovbswartz: getting "share_id" it was not SHARE id14:31
vponomaryovbswartz: so, if we need to have it populated then we need to update it at the same time when we update other attrs14:31
vponomaryovwith creation of share snapshot instances14:32
vponomaryovnot keeping previous workarounds14:32
bswartzokay14:33
bswartzas long as drivers are able to obtain the value of the share instance id from the share_id property14:33
vponomaryovfor example, if we add "share_id" here https://github.com/openstack/manila/blame/master/manila/share/api.py#L1067 it should be populated all the time14:35
vponomaryovhttps://github.com/openstack/manila/blob/059fae0e/manila/share/api.py#L106714:36
xyang_vponomaryov: that one is for share with replicas only14:37
*** hongbin has joined #openstack-manila14:39
openstackgerritDustin Schoenbrun proposed openstack/manila master: Change example value in docs for CephFS snapshots  https://review.openstack.org/47352614:40
openstackgerritValeriy Ponomaryov proposed openstack/manila master: Set share_id to share snapshot instance all the time  https://review.openstack.org/47386414:45
vponomaryovxyang_, bswartz: expect it to work ^14:46
vponomaryovjust without unit tests yet14:46
xyang_vponomaryov: thanks14:47
*** a-pugachev has quit IRC14:57
*** a-pugachev has joined #openstack-manila14:59
*** markstur has joined #openstack-manila15:07
*** markstur has quit IRC15:07
*** markstur has joined #openstack-manila15:08
*** fishbone has joined #openstack-manila15:18
fishboneHello all, I have searched documentation and I can't see the method to ensure configuration of the attached block storage device for the shares15:20
bswartzfishbone: what driver?15:20
fishboneWhen I create the shares the share instance does not configure the disk, thus leaving it unmounted15:20
fishbonebswartz: generic15:20
bswartzyou mean the service instance isn't attaching the cinder volumes?15:21
fishbonebswartz: It attaches the drive but it doesn't format the drive, or configure the allocation table so it can be mounted as a proper file system15:21
bswartzfishbone: that's strange -- it should do that automatically15:23
bswartzyou may have found a recent bug, or it might be an environmental issue particular to you15:23
fishbonebswartz: hmmm, I will go over this again and verify I completed each step as required15:23
openstackgerritValeriy Ponomaryov proposed openstack/manila master: Set share_id to share snapshot instance all the time  https://review.openstack.org/47386415:41
openstackgerritValeriy Ponomaryov proposed openstack/manila master: Set share_id to share snapshot instance all the time  https://review.openstack.org/47386415:44
vponomaryovfishbone: in case it is not complicated correctly you should have some logs with errors15:45
vponomaryovs/complicated/completed/15:45
fishbonevponomaryov: after some testing I was confused, the nfs shares create properly just need to restart the service when adjusting permissions, however; it does not seem as if the cifs shares are created properly15:46
vponomaryovfishbone: release version? which image? which error?15:47
vponomaryovfishbone: driver mode? manila configuration?15:48
vponomaryovfishbone: how deployed ... etc15:48
fishbonevponomaryov: thanks, I'm using version 10.0.0, ocata, I manually created the manila service image using the documentation, essentially installed samba in this case, I'm using the generic driver15:53
fishbonevponomaryov: I launched a test share server using the dashboard, and the nfs share works fine15:54
*** lpetrut has quit IRC15:57
vponomaryovfishbone: even if you created your own image, there should be some errors in logs15:57
openstackgerritMerged openstack/manila master: Change example value in docs for CephFS snapshots  https://review.openstack.org/47352615:59
*** a-pugachev has quit IRC16:00
fishbonevponomaryov: There are no errors in the logs, it seems to assume that the server is created appropriately, my conf file: http://paste.openstack.org/show/612441/16:04
fishbonevponomaryov: I feel as though the issue is my interpretation of how the cifs share is configured within the provision, does it use samba to create the share?16:08
vponomaryovfishbone: have you enabeld registry?16:08
vponomaryovfishbone: is samba 3.2+ ?16:08
vponomaryovabsence of enabled registry is the only possible reason that can cause problems without errors in logs and comes into my mind16:09
fishbonevponomaryov: samba is version 4.2.14, I don't believe I enabled registry, I am also unfamiliar with that16:10
*** arnewiebalck_ has joined #openstack-manila16:10
vponomaryovfishbone: https://docs.openstack.org/developer/manila/devref/generic_driver.html#requirements-for-service-image16:10
vponomaryovSamba server >=3.2.0, that can be configured by data stored in registry16:10
*** dsariel_ has quit IRC16:10
vponomaryovfishbone: https://github.com/openstack/manila-image-elements/blob/b0d2c6dc/elements/ubuntu-cifs/post-install.d/50-manila-samba-patch-config16:12
vponomaryovfishbone: you need to execute last line from above link ^16:13
vponomaryovfishbone: and restart samba16:13
*** a-pugachev has joined #openstack-manila16:13
fishbonevponomaryov: ah I see, thanks a lot for this, I will test it out16:13
vponomaryovhttps://www.samba.org/samba/docs/man/manpages-3/smb.conf.5.html#idp5801281616:14
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346416:24
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346416:25
fishbonevponomaryov: That was it, thanks a million, vponomaryov!16:30
vponomaryovfishbone: you are welcome16:30
*** ianychoi has joined #openstack-manila17:15
*** rraja has quit IRC17:20
*** a-pugachev has quit IRC17:24
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346417:33
openstackgerritValeriy Ponomaryov proposed openstack/manila master: [WIP] Add share group quotas  https://review.openstack.org/47346417:36
openstackgerritValeriy Ponomaryov proposed openstack/manila master: Add share groups quotas  https://review.openstack.org/47346417:41
*** fishbone has quit IRC18:22
*** a-pugachev has joined #openstack-manila19:30
*** jprovazn has quit IRC19:38
*** xyang_ has quit IRC19:39
*** xyang_ has joined #openstack-manila19:41
*** dsariel has joined #openstack-manila19:48
*** a-pugachev has quit IRC19:49
*** eharney has quit IRC19:53
*** arnewiebalck_ has quit IRC19:59
*** ianychoi has quit IRC20:46
*** gouthamr has quit IRC21:03
*** erlon has quit IRC21:28
*** gouthamr has joined #openstack-manila21:29
*** xyang_ has quit IRC21:54
*** dustins has quit IRC21:54
*** xyang1 has quit IRC21:56
*** cknight has quit IRC22:17
*** ganso has quit IRC22:22
*** catintheroof has quit IRC22:47
*** winston-d_ has quit IRC23:13

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!