创建范围以从 Databricks 访问 Azure Datalake Gen2 时出现属性错误

Question

我正在尝试使用示波器进行设置，但遇到了一些问题。任何帮助将不胜感激。

我运行 Databricks CLI 中的以下命令

databricks secrets create-scope --scope dnb-dlg2-dbrcks-scp-stg
databricks secrets put --scope dnb-dlg2-dbrcks-scp-stg --key SPID --string-value "XXXXXXXXXXXXXXXXXX"
databricks secrets put --scope dnb-dlg2-dbrcks-scp-stg --key SPKey --string-value "XXXXXXXXXXXXXXX”
databricks secrets put --scope dnb-dlg2-dbrcks-scp-stg --key DirectoryID --string-value "XXXXXXXXXX"

成功创建范围。然后我试着运行在我的笔记本下面

#Gather Relevant Keys from our scope

ServicePrincipalId=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPID")
ServicePrincipalKey=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPKey")
DirectoryID=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="DirectoryID")

#Combine DirectoryID into full string
Directory="https://login.microsoftonline.com/{}/oauth2/token".format(DirectoryID)

#Create configurations for our connections
configs = {"fs.azure.account.auth.type": "OAuth",
           "fs.azure.account.oauth.provider.type": "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider",
           "fs.azure.account.oauth2.client.id" : ServicePrincipalId,
           "fs.azure.account.oauth2.client.secret":  ServicePrincipalKey,
           "fs.azure.account.oauth2.client.endpoint": Directory}
# "fs.azure.account.oauth2.client.secret" -> dbutils.secrets.get("dnb-dbrk-scrt-scp-stg", key = "dnb-data-bricks-kv-stg"),

# Mount the Data Lake onto DBFS at the /mnt/ location

dbutils.fs.mount(
  source = "abfss://datastore@dbstgstoraccgen2.dfs.core.windows.net/",
  mount_point = "/mnt/datastore5",
  extra_configs = configs)

此时报错，请参考下图

错误详情

    AttributeError: 
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<command-4345234368633882> in <module>
----> 1 dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPID")

/local_disk0/tmp/1575916741583-0/dbutils.py in __getattr__(self, item)
    482             return self.credentials
    483 
--> 484         raise AttributeError
    485 
    486     def __repr__(self):

AttributeError:

Answer 1

代码中的小错别字：“secret”应为“secrets”。

错误：

ServicePrincipalId=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPID")
ServicePrincipalKey=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPKey")
DirectoryID=dbutils.secret.get(scope="dnb-dlg2-dbrcks-scp-stg",key="DirectoryID")

将“secret.get”替换为“secrets.get”

ServicePrincipalId=dbutils.secrets.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPID")
ServicePrincipalKey=dbutils.secrets.get(scope="dnb-dlg2-dbrcks-scp-stg",key="SPKey")
DirectoryID=dbutils.secrets.get(scope="dnb-dlg2-dbrcks-scp-stg",key="DirectoryID")

希望这对您有所帮助。如果您有任何疑问，请告诉我们。

请点击 "Mark as Answer" 并在对您有帮助的 post 上投票，这可能对其他社区成员有益。

创建范围以从 Databricks 访问 Azure Datalake Gen2 时出现属性错误

Attribute error while creating scope to access Azure Datalake Gen2 from Databricks

python

azure

databricks

azure-data-lake-gen2

databricks-connect