Oozie 4.2.0 使用 Java 1.8 使用 Hadoop 2.7 构建错误
Oozie 4.2.0 build Error with Hadoop 2.7 with Java 1.8
我运行处于伪hadoop模式。具有以下组件
- Hadoop v2.7.0
- Java 1.8+
- 奥齐 4.2.0
- OS - Fedora 22 虚拟机
- Maven 3.3
我对 Java 或 Maven 一无所知，我对使用 Maven 构建这个世界完全陌生。我正在探索 Oozie 并想构建它，但每次我尝试构建它时，它都会失败并出现以下错误。我有搜索博客和已知博客（人们提到了 gauravkohli 博客，但这对我也没有帮助）但没有太多帮助。有人可以帮我吗？
其次，虽然我关注了一些博客，他们提到只需要更改 hadoop 版本，但即便如此，我认为我需要更改 Hbase 和其他组件版本，因为它们的版本比那些高得多在 ooze Distro 中提到，如果对此有任何输入也将是很好的见解。
[INFO]-------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] Apache Oozie Main ..............................SUCCESS [ 1.995 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [ 1.059 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [ 0.357 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS [ 0.080 s]
[INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [ 8.120 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [ 4.637 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [ 1.528 s]
[INFO] Apache Oozie Core ..............................FAILURE [ 5.388 s]
[INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
[INFO] Apache Oozie Share Lib Pig .........................SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
[INFO] Apache Oozie Examples ..............................SKIPPED
[INFO] Apache Oozie Share Lib Spark .......................SKIPPED
[INFO] Apache Oozie Share Lib .............................SKIPPED
[INFO] Apache Oozie Docs ..................................SKIPPED
[INFO] Apache Oozie WebApp ............................... SKIPPED
[INFO] Apache Oozie Tools ................................ SKIPPED
[INFO] Apache Oozie MiniOozie .............................SKIPPED
[INFO] Apache Oozie Distro ................................SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
[INFO]------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]-------------------------------------------------------------
[INFO] Total time: 51.047 s
[INFO] Finished at: 2015-10-11T12:44:19+11:00
[INFO] Final Memory: 96M/230M
[INFO]-------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-remote-resources-plugin:1.5:process (default) on project
oozie-core: Error resolving project artifact: Could not transfer artifact
org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to
Codehaus repository (http://repository.codehaus.org/):
repository.codehaus.org: unknown error for project org.pentaho:pentaho-
aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host
repository.codehaus.org: unknown error -> [Help 1]
[ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
**[edit]Edited: Vishant : 12-Oct-2015**
After doing some research and editing the pom.xml file. I enadbled the
REPO1 and Cloudera repositories, but then I stumbled upon the below
error. I went ahead and checked the REPO1 repository
** DOES NOT have hbase 1.1.2 jars.**
[INFO] ----------------------------------------------------------------
[INFO] Building Apache Oozie Core 4.2.0
[INFO]-----------------------------------------------------------------
[INFO] ----------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
[INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
[INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] -------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] -------------------------------------------------------------
[INFO] Total time: 32.115 s
[INFO] Finished at: 2015-10-12T11:03:04+11:00
[INFO] Final Memory: 100M/239M
[INFO] -------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-core: Could not resolve
dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure
to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2
was cached in the local repository, resolution will not be reattempted
until the update interval of central has elapsed or updates are forced
->[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
我该如何处理？如何将 jars 添加到我的本地存储库并继续？
这是因为Codehaus.org不再托管maven repos。您可以在 https://www.codehaus.org/mechanics/maven/
阅读更多内容
在您的 pom.xml 中，将 Codehaus 存储库的 url 更改为 -> https://repository-master.mulesoft.org/nexus/content/groups/public/
<repository>
<id>Codehaus repository</id>
<url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
我很抱歉，因为我之前没有权限回复我自己的问题！！
答案：
我已经解决了错误。按照下面的步骤，但是 codehaus 的东西根本不起作用
步骤 1. 下载 jar 文件 Hbase Jar
第 2 步。编辑 pom.xml 以指向 jar 文件，
<dependency>
<groupID>org.apache.hbase</groupID>
<artifactID>hbase</artifactID>
<version>${hbase.version}</version>
<scope>system</scope>
<system>system/path/to/jar/file/myjar.jar</system>
</dependency>
第 3 步。将 Hbase 文件添加到 MAVEN 存储库
mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>
2016 年 1 月 13 日编辑
我添加了 hbase-common-1.1.2.jar 文件，因为我的 hbase 版本是 1.1.2。请根据您的 hbase 版本添加 hbase-common 文件。
我解决了这个 pom.xml 的所有问题，如下 link
oozie-4.2 pom.xml
你可以看到我更改了一些配置，包括更改Codehas respository url
和其他一些。
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-tools</artifactId>
<version>1.2.1</version>
<!--<version>${distcp.version}</version>-->
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<version>1.2.1</version>
<!--<version>${hadoop.auth.version}</version>-->
你可以试试这个pom.xml来构建。
我运行处于伪hadoop模式。具有以下组件 - Hadoop v2.7.0 - Java 1.8+ - 奥齐 4.2.0 - OS - Fedora 22 虚拟机 - Maven 3.3
我对 Java 或 Maven 一无所知，我对使用 Maven 构建这个世界完全陌生。我正在探索 Oozie 并想构建它，但每次我尝试构建它时，它都会失败并出现以下错误。我有搜索博客和已知博客（人们提到了 gauravkohli 博客，但这对我也没有帮助）但没有太多帮助。有人可以帮我吗？
其次，虽然我关注了一些博客，他们提到只需要更改 hadoop 版本，但即便如此，我认为我需要更改 Hbase 和其他组件版本，因为它们的版本比那些高得多在 ooze Distro 中提到，如果对此有任何输入也将是很好的见解。
[INFO]-------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] Apache Oozie Main ..............................SUCCESS [ 1.995 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS [ 15.697 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS [ 1.059 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS [ 0.357 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS [ 0.080 s]
[INFO] Apache Oozie Client ............................SUCCESS [ 10.525 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS [ 8.120 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS [ 4.637 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS [ 1.528 s]
[INFO] Apache Oozie Core ..............................FAILURE [ 5.388 s]
[INFO] Apache Oozie Share Lib Streaming ...................SKIPPED
[INFO] Apache Oozie Share Lib Pig .........................SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ......................SKIPPED
[INFO] Apache Oozie Share Lib Sqoop .......................SKIPPED
[INFO] Apache Oozie Examples ..............................SKIPPED
[INFO] Apache Oozie Share Lib Spark .......................SKIPPED
[INFO] Apache Oozie Share Lib .............................SKIPPED
[INFO] Apache Oozie Docs ..................................SKIPPED
[INFO] Apache Oozie WebApp ............................... SKIPPED
[INFO] Apache Oozie Tools ................................ SKIPPED
[INFO] Apache Oozie MiniOozie .............................SKIPPED
[INFO] Apache Oozie Distro ................................SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests ..............SKIPPED
[INFO]------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]-------------------------------------------------------------
[INFO] Total time: 51.047 s
[INFO] Finished at: 2015-10-11T12:44:19+11:00
[INFO] Final Memory: 96M/230M
[INFO]-------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-remote-resources-plugin:1.5:process (default) on project
oozie-core: Error resolving project artifact: Could not transfer artifact
org.pentaho:pentaho-aggdesigner-algorithm:pom:5.1.5-jhyde from/to
Codehaus repository (http://repository.codehaus.org/):
repository.codehaus.org: unknown error for project org.pentaho:pentaho-
aggdesigner-algorithm:jar:5.1.5-jhyde: Unknown host
repository.codehaus.org: unknown error -> [Help 1]
[ERROR]To see the full stack trace of the errors, re-run Maven-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/disp
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
**[edit]Edited: Vishant : 12-Oct-2015**
After doing some research and editing the pom.xml file. I enadbled the
REPO1 and Cloudera repositories, but then I stumbled upon the below
error. I went ahead and checked the REPO1 repository
** DOES NOT have hbase 1.1.2 jars.**
[INFO] ----------------------------------------------------------------
[INFO] Building Apache Oozie Core 4.2.0
[INFO]-----------------------------------------------------------------
[INFO] ----------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Oozie Main ..............................SUCCESS[2.334 s]
[INFO] Apache Oozie Hadoop Utils hadoop-2-4.2.0 .......SUCCESS[4.010 s]
[INFO] Apache Oozie Hadoop Distcp hadoop-2-4.2.0 ......SUCCESS[0.341 s]
[INFO] Apache Oozie Hadoop Auth hadoop-2-4.2.0 Test ...SUCCESS[0.688 s]
[INFO] Apache Oozie Hadoop Libs .......................SUCCESS[0.066 s]
[INFO] Apache Oozie Client ............................SUCCESS[10.832 s]
[INFO] Apache Oozie Share Lib Oozie ...................SUCCESS[4.394 s]
[INFO] Apache Oozie Share Lib HCatalog ................SUCCESS[5.641 s]
[INFO] Apache Oozie Share Lib Distcp ..................SUCCESS[1.550 s]
[INFO] Apache Oozie Core ..............................FAILURE[0.508 s]
[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED
[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED
[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED
[INFO] Apache Oozie Share Lib Hive 2 ...................... SKIPPED
[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED
[INFO] Apache Oozie Examples .............................. SKIPPED
[INFO] Apache Oozie Share Lib Spark ....................... SKIPPED
[INFO] Apache Oozie Share Lib ............................. SKIPPED
[INFO] Apache Oozie Docs .................................. SKIPPED
[INFO] Apache Oozie WebApp ................................ SKIPPED
[INFO] Apache Oozie Tools ................................. SKIPPED
[INFO] Apache Oozie MiniOozie ............................. SKIPPED
[INFO] Apache Oozie Distro ................................ SKIPPED
[INFO] Apache Oozie ZooKeeper Security Tests .............. SKIPPED
[INFO] -------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] -------------------------------------------------------------
[INFO] Total time: 32.115 s
[INFO] Finished at: 2015-10-12T11:03:04+11:00
[INFO] Final Memory: 100M/239M
[INFO] -------------------------------------------------------------
[ERROR] Failed to execute goal on project oozie-core: Could not resolve
dependencies for project org.apache.oozie:oozie-core:jar:4.2.0: Failure
to find org.apache.hbase:hbase:jar:1.1.2 in http://repo1.maven.org/maven2
was cached in the local repository, resolution will not be reattempted
until the update interval of central has elapsed or updates are forced
->[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN
/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :oozie-core
我该如何处理？如何将 jars 添加到我的本地存储库并继续？
这是因为Codehaus.org不再托管maven repos。您可以在 https://www.codehaus.org/mechanics/maven/
阅读更多内容在您的 pom.xml 中，将 Codehaus 存储库的 url 更改为 -> https://repository-master.mulesoft.org/nexus/content/groups/public/
<repository>
<id>Codehaus repository</id>
<url>https://repository-master.mulesoft.org/nexus/content/groups/public/</url>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
我很抱歉，因为我之前没有权限回复我自己的问题！！
答案：
我已经解决了错误。按照下面的步骤，但是 codehaus 的东西根本不起作用
步骤 1. 下载 jar 文件 Hbase Jar
第 2 步。编辑 pom.xml 以指向 jar 文件，
<dependency>
<groupID>org.apache.hbase</groupID>
<artifactID>hbase</artifactID>
<version>${hbase.version}</version>
<scope>system</scope>
<system>system/path/to/jar/file/myjar.jar</system>
</dependency>
第 3 步。将 Hbase 文件添加到 MAVEN 存储库
mvn install:install-file -Dfile=<path-to-file> -DgroupId=<group-id> \ -DartifactId=<artifact-id> -Dversion=<version> -Dpackaging=<packaging>
2016 年 1 月 13 日编辑 我添加了 hbase-common-1.1.2.jar 文件，因为我的 hbase 版本是 1.1.2。请根据您的 hbase 版本添加 hbase-common 文件。
我解决了这个 pom.xml 的所有问题，如下 link oozie-4.2 pom.xml
你可以看到我更改了一些配置，包括更改Codehas respository url 和其他一些。
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-tools</artifactId>
<version>1.2.1</version>
<!--<version>${distcp.version}</version>-->
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<version>1.2.1</version>
<!--<version>${hadoop.auth.version}</version>-->
你可以试试这个pom.xml来构建。