spark中的纱线模式和部署模式有什么区别？

Question

我现在很困惑。请检查是否正确。

4 例命令如下：

# It mean, yarn is cluster mode and deploy cluster mode.
# cluster have YARN Container(have Spark AM, Spark Driver) and YARN node manager.
spark-submit --master yarn --deploy-mode cluster

# It mean, yarn is cluster mode and deploy client mode.
# client have Spark Driver.
# cluster have YARN Container(have Spark AM, Spark Driver) and YARN node manager.
spark-submit --master yarn --deploy-mode client

# It mean, yarn is client mode and deploy cluster mode.
# cluster have YARN Container(have Spark AM) and YARN node manager.
spark-submit --master yarn-client --deploy-mode cluster

# It mean, yarn is client mode and deploy client mode.
# client have Spark Driver.
# cluster have YARN Container(have Spark AM) and YARN node manager.
spark-submit --master yarn-client --deploy-mode client

以上代码的解释是否正确？

Answer 1

#使用yarn，将驱动部署到yarn集群中。

spark-submit --master yarn --deploy-mode cluster

#使用 yarn，在我的本地机器（启动代码的机器）上部署驱动程序

spark-submit --master yarn --deploy-mode client # this is the default if you don't specify --deploy-mode

这些不再是 actual options，所以它们真的不值得讨论：

spark-submit --master yarn-client --deploy-mode cluster
spark-submit --master yarn-client --deploy-mode client

--master yarn-client 可能是早期版本的 spark 中的一个选项，但今天没有使用。（如上文所述）

spark中的纱线模式和部署模式有什么区别？

What is different between yarn mode and deploy mode in spark?

apache-spark

hadoop-yarn