| *** tosky has quit IRC | 00:38 | |
| *** carloss has quit IRC | 01:14 | |
| *** LinPeiWen has joined #openstack-manila | 02:25 | |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila master: Part 1 - Add RBAC protection tests https://review.opendev.org/c/openstack/manila/+/777047 | 04:53 |
|---|---|---|
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila master: Part 2 - Add RBAC protection tests https://review.opendev.org/c/openstack/manila/+/777048 | 04:53 |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila master: Remove deprecated public share policies https://review.opendev.org/c/openstack/manila/+/763468 | 04:54 |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila master: Remove deprecated public share policies https://review.opendev.org/c/openstack/manila/+/763468 | 04:55 |
| *** LinPeiWen has quit IRC | 06:18 | |
| *** vishalmanchanda has joined #openstack-manila | 06:24 | |
| *** LinPeiWen has joined #openstack-manila | 06:43 | |
| *** thefuture__ has joined #openstack-manila | 07:08 | |
| *** hoonetorg has quit IRC | 07:38 | |
| *** thefuture__ has quit IRC | 07:55 | |
| *** tosky has joined #openstack-manila | 08:50 | |
| *** LinPeiWen has quit IRC | 09:16 | |
| *** noonedeadpunk has quit IRC | 09:26 | |
| *** noonedeadpunk has joined #openstack-manila | 09:29 | |
| *** lpetrut has joined #openstack-manila | 09:35 | |
| *** LinPeiWen has joined #openstack-manila | 10:19 | |
| *** iurygregory_ has joined #openstack-manila | 11:00 | |
| *** iurygregory has quit IRC | 11:01 | |
| *** iurygregory_ is now known as iurygregory | 11:06 | |
| *** carloss has joined #openstack-manila | 11:16 | |
| *** jv_ has quit IRC | 11:52 | |
| openstackgerrit | kiran pawar proposed openstack/manila master: Doc: Add profiler support documentation https://review.opendev.org/c/openstack/manila/+/777096 | 11:56 |
| *** jv_ has joined #openstack-manila | 12:05 | |
| *** LinPeiWen has quit IRC | 12:23 | |
| *** jv_ has quit IRC | 12:24 | |
| openstackgerrit | Dina Saparbaeva proposed openstack/manila-ui master: Addition of share shrinking feature to Manila-UI https://review.opendev.org/c/openstack/manila-ui/+/767017 | 12:33 |
| *** vishalmanchanda has quit IRC | 14:33 | |
| *** jv_ has joined #openstack-manila | 14:58 | |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila-tempest-plugin master: Refactor public share test cases https://review.opendev.org/c/openstack/manila-tempest-plugin/+/776869 | 15:14 |
| *** lpetrut has quit IRC | 16:32 | |
| *** legochen has joined #openstack-manila | 16:46 | |
| legochen | hi anyone here? I encounter an error in manila when contacting to NetApp backend. | 16:47 |
| legochen | manila.share.drivers.netapp.dataontap.client.api.NaApiError: NetApp API failed. Reason - 15661:entry doesn't exist | 16:47 |
| legochen | my manila version is from master branch, now it is 11.1 - Victoria. | 16:48 |
| legochen | I have another manila running in train version (python 2.x) is able to connect to my NetApp filer(the same one) without error. | 16:49 |
| legochen | So, not sure how to dig the issue :( | 16:49 |
| gouthamr | dviroel carloss ^ | 16:51 |
| gouthamr | legochen: "manila.share.drivers.netapp.dataontap.client.api.NaApiError: NetApp API failed. Reason - 15661:entry doesn't exist" doesn't say all that much, do you have a full traceback from the logs? | 16:52 |
| carloss | hello legochen o/ | 16:52 |
| carloss | gouthamr++ | 16:52 |
| gouthamr | legochen: if yes, you can paste it to https://paste.openstack.org - be sure to sanitize any information and share it here | 16:52 |
| legochen | http://paste.openstack.org/show/802937/ | 16:53 |
| legochen | let me give more context, I’m able to create “share type”, create “share” | 16:53 |
| legochen | the error only happens when I’m going to creare “share access” | 16:54 |
| legochen | “share access” operations are having problem. - creation/deletion. | 16:54 |
| legochen | if you could guide to inject some codes to dump useful info, that would be helpful. | 16:57 |
| gouthamr | hmm, that does help - sounds like your ontap doesn't know the "kerberos-config-get" ZAPI | 16:58 |
| legochen | is that something we can disable? | 16:58 |
| carloss | that sounds accurate, gouthamr | 16:59 |
| carloss | legochen: which ONTAP version are you using? | 16:59 |
| legochen | checking | 17:01 |
| legochen | NetApp Release 9.3P14: Wed Jul 10 14:38:46 UTC 2019 | 17:02 |
| legochen | carloss, which ONTAP version should I use? | 17:07 |
| carloss | I'm checking if that call is available to the version you're using, but to me, sounds like if the version you're using can't call the "kerberos-config-get" ZAPI, you should have a way to handle this | 17:11 |
| carloss | as per I was checking your version was supposed to support this call | 17:11 |
| gouthamr | carloss: yeah, seems like an old zapi - perhaps the login user legochen's using doesn't have permission to call this zapi? | 17:13 |
| legochen | we have granted admin permission to that login user. | 17:15 |
| gouthamr | legochen: i see, admin as in vsadmin? | 17:17 |
| legochen | no, not vsadmin, we use cluster admin. | 17:18 |
| legochen | anyway, I’m going to upgrade ontab version to 9.8P1 and see…. | 17:19 |
| legochen | it will take about 1 or 1.5 hours. will let you know the result tomorrow :) | 17:19 |
| carloss | alright, legochen... we will investigate this as well | 17:20 |
| legochen | btw, where can I know the version mapping table between manila and ontab? | 17:20 |
| carloss | ping us if you need something | 17:20 |
| legochen | ontap* | 17:20 |
| carloss | the NetApp driver row is up-to-date in this support matrix: https://docs.openstack.org/manila/queens/admin/share_back_ends_feature_support_mapping.html ... all of this features should be working for ONTAP 9.3 or newer | 17:22 |
| legochen | them, seems my version is good. | 17:23 |
| legochen | then* | 17:23 |
| carloss | yeah | 17:28 |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/manila master: Remove deprecated public share policies https://review.opendev.org/c/openstack/manila/+/763468 | 17:38 |
| *** lpetrut has joined #openstack-manila | 18:34 | |
| legochen | carloss and gouthamr, bad news after ontap version upgrade, the situation is still the same :( | 18:34 |
| gouthamr | that's not good news.. | 18:36 |
| gouthamr | legochen: can you turn on api tracing in your /etc/manila/manila.conf and recapture the results, that'll help carloss debug | 18:36 |
| gouthamr | the option is called "netapp_trace_flags", and is documented here: https://netapp-openstack-dev.github.io/openstack-docs/draft/appendices/section_triage-and-data-collection.html | 18:37 |
| carloss | yes, for sure | 18:37 |
| legochen | okay, only need this? method,api | 18:38 |
| *** lpetrut has quit IRC | 18:40 | |
| openstackgerrit | Dina Saparbaeva proposed openstack/manila-ui master: API v2.44, added 'ou' field to security service https://review.opendev.org/c/openstack/manila-ui/+/774438 | 18:42 |
| *** simondodsley has joined #openstack-manila | 18:46 | |
| simondodsley | Sorry for the newbie question, but I'm running a Victoria devstack with manila enabled and debug is set to True in the manila conf file, but I'm not getting any log messages from driver. Am I missing something else to enable for logs? | 18:46 |
| gouthamr | legochen: yes | 18:47 |
| gouthamr | simondodsley: no, that'd be strange.. are you trying to update the "debug" option on the fly? i.e., sending a SIGHUP? | 18:49 |
| legochen | share access deletion error - http://paste.openstack.org/show/802940/ | 18:49 |
| simondodsley | no - i'm restarting the api service | 18:49 |
| legochen | share access creation error - http://paste.openstack.org/show/802941/ | 18:49 |
| gouthamr | simondodsley: the share service needs to be restarted | 18:50 |
| legochen | gouthamr, I added that flags, but don’t see much difference. | 18:50 |
| simondodsley | ah - ok - that might be it | 18:50 |
| openstackgerrit | Dina Saparbaeva proposed openstack/manila-ui master: API v2.44, added 'ou' field to security service https://review.opendev.org/c/openstack/manila-ui/+/774438 | 18:50 |
| gouthamr | legochen: you'll need to enable debug logging, you'll see the API interactions to netapp being captured | 18:50 |
| legochen | I have this debug = true in manila.conf | 18:52 |
| gouthamr | legochen: then the log should have the api call - it might be hard to locate because of the amount of logging | 18:54 |
| gouthamr | legochen: you could grep for the API that's failing: "kerberos-config-get" | 18:54 |
| gouthamr | legochen: or just filter your logs with a request_id | 18:55 |
| gouthamr | legochen: if you're using the manila cli, the request-id can be found when you do "manila --debug access-allow ...." | 18:56 |
| legochen | does the name “manila,api” need to match /etc/manila/api-paste.ini ? | 18:56 |
| gouthamr | nope | 18:56 |
| gouthamr | i suppose you mean "method,api" | 18:56 |
| legochen | haha, my bad | 18:56 |
| gouthamr | no problem - "method,api" is an indicator to dump the request traces wrt method names in the netapp driver that we're hitting along the way along with a pretty-print of the ZAPIs used | 18:59 |
| gouthamr | be sure to turn that off after your troubleshooting though - it's known to fill up logs | 19:00 |
| dviroel | o/ | 19:04 |
| dviroel | i was in another meeting | 19:04 |
| gouthamr | meetings all day | 19:05 |
| gouthamr | :| | 19:05 |
| dviroel | 'kerberos-config-get' error looks weird, let me investigate | 19:05 |
| legochen | gouthamr - I don’t see more logs after configured - netapp_trace_flags. http://paste.openstack.org/show/802943/ | 19:05 |
| legochen | is the setting looks right? | 19:06 |
| legochen | dviroel, thank you | 19:11 |
| legochen | btw, we don’t enable kerberos on netapp filer side. | 19:13 |
| gouthamr | legochen: that looks correct, did you restart the manila-share service? | 19:41 |
| legochen | looks like I also need to configure this | 19:41 |
| legochen | [logger_root] | 19:41 |
| legochen | level = DEBUG | 19:41 |
| legochen | handlers = watchedfile,stderr | 19:41 |
| legochen | but, don’t know why is DEBUG mode to heavy, once I enabled it, the api call will become stuck. | 19:42 |
| legochen | whatever deleting or creating a share access - the state will always hang on - queued_to_deny state. | 19:42 |
| legochen | strange :( | 19:43 |
| legochen | btw, which version started to have - kerberos-config-get ?? | 19:43 |
| dviroel | legochen: it is a bugfix is available only in master for now, the idea is to backport it to other releases, considering that it will work just fine. It seems that isn't working in your end, which we need to degub | 19:45 |
| dviroel | legochen: if your question is related to ONTAP version, so since ONTAP 8.X. | 19:46 |
| *** gmann is now known as gmann_lunch | 19:47 | |
| legochen | okay, you mean if I don’t use master and change to use Victoria, the issue should be mitigated? | 19:47 |
| *** batrick has quit IRC | 19:47 | |
| legochen | dviroel, could you give me the bugfix commit? I’d like to compare my version’s code. | 19:49 |
| dviroel | legochen: yes, but would be great to discover the issue that you are having, since we weren't able to reproduce it here. | 19:50 |
| legochen | I hope it is not only happen in my environment :( | 19:51 |
| legochen | maybe that’s my environment issue … I can try to use Victoria and see if the problem is still exist. | 19:52 |
| legochen | if this issue only happens on master, I hope we can have a troubleshooting session, I can share my screen to you. | 19:53 |
| dviroel | legochen: here https://review.opendev.org/c/openstack/manila/+/772177 | 19:54 |
| dviroel | legochen: oh, the commit is this one https://github.com/openstack/manila/commit/68ad590c3738dd024507189a531e271460c6d5d4 | 19:55 |
| dviroel | legochen: i was able to get the same error only when I provide a non-existing network interface to the kerberos-config-get command. | 19:58 |
| dviroel | legochen: but the code reads all network interfaces in the SVM, before triggering the kerberos-config-get | 19:59 |
| legochen | the NIC you mentioned is on manila api node or on netapp filer side? | 20:00 |
| dviroel | in the netapp side, within the SVM that you provided in 'netapp_vserver' conf | 20:01 |
| legochen | def is_kerberos_enabled(self): | 20:03 |
| legochen | """Check if Kerberos in enabled in all LIFs.""" | 20:03 |
| legochen | return False | 20:03 |
| legochen | after I let this function always return false, then looks good now | 20:03 |
| legochen | both creation/deletion are good | 20:05 |
| *** gmann_lunch is now known as gmann | 20:07 | |
| legochen | dviroel, do you think kerberos stuff could be optional? | 20:07 |
| dviroel | legochen: no, it is probably easy to treat those errors and report false, instead of offer as an option. | 20:10 |
| legochen | btw, sometimes I’ll get this error after restart manila-share service http://paste.openstack.org/show/802945/ | 20:13 |
| legochen | manila.exception.DriverNotInitialized: Share driver 'NetAppCmodeSingleSvmShareDriver' not initialized. | 20:13 |
| legochen | sometimes is good. | 20:14 |
| legochen | 2021-02-23 20:15:20,135 INFO [manila.share.drivers.netapp.dataontap.client.client_cmode] /opt/openstack/venv/manila/lib/python3.7/site-packages/manila/share/drivers/netapp/dataontap/client/client_cmode.py:is_kerberos_enabled:1668 api_args | 20:17 |
| legochen | : {'interface-name': ‘my-server’, 'desired-attributes': {'kerberos-config-info': {'is-kerberos-enabled': None}}} | 20:17 |
| legochen | LOG.info(f"api_args: {api_args}") | 20:18 |
| legochen | result = self.send_request('kerberos-config-get', api_args) | 20:18 |
| legochen | dviroel, looks like after sending this attributes to netapp server, then got exception. | 20:19 |
| dviroel | legochen: i see, can you share more information about your interface 'my-server'? like role type, status, etc? | 20:26 |
| legochen | dviroel, let me ping you directly | 20:32 |
| *** rajinir has quit IRC | 21:01 | |
| *** rajinir has joined #openstack-manila | 21:02 | |
| *** batrick has joined #openstack-manila | 21:11 | |
| openstackgerrit | Victoria Martinez de la Cruz proposed openstack/devstack-plugin-ceph master: Update ceph default version to octopus https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/777232 | 21:23 |
| legochen | thank you dviroel for identifying the issue I posted above :) hope we could fix that soon. :D :D | 21:25 |
| dviroel | legochen: thanks | 21:52 |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/python-manilaclient master: DNM: Testing public shares policy change https://review.opendev.org/c/openstack/python-manilaclient/+/777249 | 22:03 |
| *** tkajinam has joined #openstack-manila | 22:51 | |
| openstackgerrit | Goutham Pacha Ravi proposed openstack/python-manilaclient master: Change public share tests https://review.opendev.org/c/openstack/python-manilaclient/+/777249 | 23:07 |
| *** tkajinam has quit IRC | 23:40 | |
| *** tkajinam has joined #openstack-manila | 23:40 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!