Unable Connecting Power BI to Hadoop HDFS 获取内容失败

Question

当我尝试将 Power BI 连接到 Hadoop webhdfs 时，出现此错误

DataSource.Error: HDFS failed to get contents from 'http://xxx.xx.x.x:50070/webhdfs/v1/myFolder/20200626150740_PERSONAL_IDS'. Status code: 503, description: 'Service Unavailable'.

当我访问URL时，出现如下错误：

{
  RemoteException: {
    exception: "UnsupportedOperationException",
    javaClassName: "java.lang.UnsupportedOperationException",
    message: "op=NULL is not supported"
  }
}

有人可以帮忙吗？

Answer 1

当您使用带有 http(s): 方案的 webhdfs REST API 时，需要一个操作 (?op=...)。

例如，当我在浏览器中键入以下内容时：

https://<my.namenode.host>:9871/webhdfs/v1/user?op=LISTSTATUS

... 我取回了 hdfs 目录列表 /user 内容（类似于我将使用 hadoop fs -ls /user 获得的内容加上一些附加信息）：

// 20200709155934
// https://<my.namenode.host>:9871/webhdfs/v1/user?op=LISTSTATUS

{
  "FileStatuses": {
    "FileStatus": [
      {
        "accessTime": 0,
        "blockSize": 0,
        "childrenNum": 2,
        "fileId": 56899,
        "group": "supergroup",
        "length": 0,
        "modificationTime": 1592790690971,
        "owner": "hdfs",
        "pathSuffix": "hdfs",
        "permission": "700",
        "replication": 0,
        "storagePolicy": 0,
        "type": "DIRECTORY"
      },
      . . . . 
      {
        "accessTime": 0,
        "blockSize": 0,
        "childrenNum": 2,
        "fileId": 16390,
        "group": "hive",
        "length": 0,
        "modificationTime": 1591715444764,
        "owner": "hive",
        "pathSuffix": "hive",
        "permission": "1775",
        "replication": 0,
        "storagePolicy": 0,
        "type": "DIRECTORY"
      },
      . . . . 
      {
        "accessTime": 0,
        "blockSize": 0,
        "childrenNum": 2,
        "fileId": 16454,
        "group": "mazaneicha",
        "length": 0,
        "modificationTime": 1591035918913,
        "owner": "mazaneicha",
        "pathSuffix": "mazaneicha",
        "permission": "720",
        "replication": 0,
        "storagePolicy": 0,
        "type": "DIRECTORY"
      },
      . . . .
    ]
  }
}

您可以找到完整的 REST API 操作列表 online。

Unable Connecting Power BI to Hadoop HDFS 获取内容失败

Unable Connecting Power BI to Hadoop HDFS failed to get contents

hadoop

powerbi

hdfs

webhdfs