在自定义环境中安装 Apache Kylin

Question

我正在尝试在 Ubuntu 16.04 中安装 Apache Kylin。

我安装了：

伪分布式模式下的 hadoop 3.1.2 (fs.default.name: hdfs://localhost:9000)
apache hive 3.1.2 和 db derby 10.14.2.0（配置 hive 使用 db derby）
伪分布式模式下的hbase 1.4.10（使用hdfs://localhost:9000/hbase）

但是当我打电话时：

hbaseshell
hbase(主要):001:0> 列表

得到错误：

ERROR: Can't get master address from ZooKeeper; znode data == null

Here is some help for this command:
List all user tables in hbase. Optional regular expression parameter could
be used to filter the output. Examples:

  hbase> list
  hbase> list 'abc.*'
  hbase> list 'ns:abc.*'
  hbase> list 'ns:.*'

当我打电话时：

ssh 本地主机
kylin.sh开始

得到错误

2019-09-27 09:26:41,029 INFO  [main] client.ZooKeeperRegistry:107 : ClusterId read in ZooKeeper is null
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
    at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:99)
    at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:111)
    at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:99)
    at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:43)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
    ... 3 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't get the location for replica 0
    at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:372)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219)
    at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275)
    at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310)
    at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:639)
    at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
    at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:409)
    at org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:281)
    at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:306)
    at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:114)
    at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:88)
    ... 8 more

Answer 1

Hadoop 历史悠久且复杂，因此我们建议您使用一些经过良好测试的 Hadoop Distribution，例如 CDH 和 HDP，但不要使用自定义的 Hadoop 环境。如果你正在做 PoC，想快速学习 Kylin，请使用 Docker 图片 https://hub.docker.com/r/apachekylin/apache-kylin-standalone。如果想在更正式的 Hadoop 环境中使用 Kylin，可以使用 CDH 5.x 或 HDP 2.x Hadoop Distribution 吗？如果您有更多问题，请通过用户邮件列表联系 Kylin 社区。

Answer 2

从报错来看，显然你的HBase不是运行；请确保 HBase 是好的。

在自定义环境中安装 Apache Kylin

Install Apache Kylin in custom environment

kylin