没有 YARN 的 MapReduce 2
MapReduce 2 without YARN
考虑到 YARN 是 运行 mapreduce2 的更好选择这一事实,但是 运行 MR2 是否可以不使用 YARN?
我尝试使用 MR2,但它 运行 与 YARN 一起使用。
MRv2 实际上是 YARN!所以,不,你不能 运行 没有 YARN 的 mapreduce2 作业!
Apache Hadoop NextGen MapReduce (YARN)
MapReduce has undergone a complete overhaul in hadoop-0.23 and we now
have, what we call, MapReduce 2.0 (MRv2) or YARN.
The fundamental idea of MRv2 is to split up the two major
functionalities of the JobTracker, resource management and job
scheduling/monitoring, into separate daemons. The idea is to have a
global ResourceManager (RM) and per-application ApplicationMaster
(AM). An application is either a single job in the classical sense of
Map-Reduce jobs or a DAG of jobs.
考虑到 YARN 是 运行 mapreduce2 的更好选择这一事实,但是 运行 MR2 是否可以不使用 YARN? 我尝试使用 MR2,但它 运行 与 YARN 一起使用。
MRv2 实际上是 YARN!所以,不,你不能 运行 没有 YARN 的 mapreduce2 作业!
Apache Hadoop NextGen MapReduce (YARN)
MapReduce has undergone a complete overhaul in hadoop-0.23 and we now have, what we call, MapReduce 2.0 (MRv2) or YARN.
The fundamental idea of MRv2 is to split up the two major functionalities of the JobTracker, resource management and job scheduling/monitoring, into separate daemons. The idea is to have a global ResourceManager (RM) and per-application ApplicationMaster (AM). An application is either a single job in the classical sense of Map-Reduce jobs or a DAG of jobs.