NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala 当运行 pyspark 代码 zepplin

Question

我正在尝试运行飞艇中的 pyspark 单元，但我在 scala.tools.nsc.interpreter.ILoop.scala

上收到 NoSuchMethodException

小区代码：

%pyspark

print("hello")

错误：

java.lang.NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala$tools$nsc$interpreter$ILoop$$loopPostInit()
    at java.lang.Class.getMethod(Class.java:1786)
    at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.callMethod(BaseSparkScalaInterpreter.scala:268)
    at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.callMethod(BaseSparkScalaInterpreter.scala:262)
    at org.apache.zeppelin.spark.SparkScala211Interpreter.open(SparkScala211Interpreter.scala:84)
    at org.apache.zeppelin.spark.NewSparkInterpreter.open(NewSparkInterpreter.java:102)
    at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:62)
    at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
    at org.apache.zeppelin.spark.PySparkInterpreter.getSparkInterpreter(PySparkInterpreter.java:664)
    at org.apache.zeppelin.spark.PySparkInterpreter.createGatewayServerAndStartScript(PySparkInterpreter.java:260)
    at org.apache.zeppelin.spark.PySparkInterpreter.open(PySparkInterpreter.java:194)
    at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
    at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
    at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
    at org.apache.zeppelin.scheduler.FIFOScheduler.run(FIFOScheduler.java:140)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access1(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)

飞艇版本：0.8.0

火花版本：2.4.0

scala 版本：2.11.12

Answer 1

关于 zeppelin 的 spark 版本，我有同样的错误，我只是尝试将 spark 版本更改为 2.3.2 并运行它。

Answer 2

[ZEPPELIN-3810] Support Spark 2.4 中描述了该问题，zeppelin 0.8.1 版本已修复该问题。

NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala 当运行 pyspark 代码 zepplin

NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala when running pyspark code zepplin

scala

apache-spark

pyspark

apache-zeppelin

NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala 当 运行 pyspark 代码 zepplin

NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala when running pyspark code zepplin

scala

apache-spark

pyspark

apache-zeppelin

NoSuchMethodException: scala.tools.nsc.interpreter.ILoop.scala 当运行 pyspark 代码 zepplin