为什么将 Spark 应用程序提交到 Mesos 会失败并显示 "Could not parse Master URL: 'mesos://localhost:5050'"?

Why does submitting a Spark application to Mesos fail with "Could not parse Master URL: 'mesos://localhost:5050'"?

我在尝试将 Spark 应用程序提交到 Mesos 集群时遇到以下异常:

17/01/31 17:04:21 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 17/01/31 17:04:22 ERROR SparkContext: Error initializing SparkContext. org.apache.spark.SparkException: Could not parse Master URL: 'mesos://localhost:5050' at org.apache.spark.SparkContext$.org$apache$spark$SparkContext$$createTaskScheduler(SparkContext.scala:2550) at org.apache.spark.SparkContext.(SparkContext.scala:501)

您可能使用了错误的命令来构建 Spark,例如,缺少 -Pmesos。从 Spark 2.1.0 开始,您应该使用 ./build/mvn -Pmesos -DskipTests clean package 构建它。