Hadoop:No 个可用于容器的日志

Question

我正在学习Hadoop，现在在单节点设置时遇到问题。我想在网页上查看JobHistory，但是我点了logs what i can see is only "No logs available for container container_1541377958924_0001_01_000001" 之后，我不知道怎么解决

这些是我的配置：

mapred-size.xml

<property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
</property>

<property>
    <name>mapreduce.jobhistory.address</name>
    <value>hadoop000:10020</value>
    <description>MapReduce JobHistory Server IPC host:port</description>
</property>

<property>
    <name>mapreduce.jobhistory.webapp.address</name>
    <value>hadoop000:19888</value>
    <description>MapReduce JobHistory Server Web UI host:port</description>
</property>

<property>
    <name>mapreduce.jobhistory.done-dir</name>
    <value>/history/done</value>
</property>

<property>
    <name>mapreduce.jobhistory.intermediate-done-dir</name>
    <value>/history/done_intermediate</value>
</property>

纱-site.xml

<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
</property>

<property>
    <name>yarn.log-aggregation-enable</name>
    <value>true</value>
</property>


<property>
    <name>yarn.log.server.url</name>
    <value>hadoop000:19888/jobhistory/logs/</value>
</property>

请原谅我糟糕的英语，谢谢！

Answer 1

为了在 WebApp 中查看来自 Hadoop 作业的日志，除了启用聚合日志之外，您还需要启动 JobHistory 守护进程。

尝试：

$ ./sbin/mr-jobhistory-daemon.sh # OR mr-job-history-daemon.sh $ stop-yarn.sh && start-yarn.sh

Hadoop:No 个可用于容器的日志

Hadoop:No logs available for container

hadoop

mapreduce