安装spark并配置

Question

我安装了 spark，当在命令提示符中键入 spark-shell 时，在第一次写入时 is not recognized as an internal or external command 在几行之后，火花是运行。我想看看我的问题是什么？

C:\Users\Ramin>spark-shell
'#' is not recognized as an internal or external command,
operable program or batch file.
'#' is not recognized as an internal or external command,
operable program or batch file.
'export' is not recognized as an internal or external command,
operable program or batch file.
'#' is not recognized as an internal or external command,
operable program or batch file.
'#' is not recognized as an internal or external command,
operable program or batch file.
'export' is not recognized as an internal or external command,
operable program or batch file.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
20/08/27 03:30:30 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
20/08/27 03:30:30 WARN Utils: Service 'SparkUI' could not bind on port 4041. Attempting port 4042.
Spark context Web UI available at http://DESKTOP-QQ9VRP2:4042
Spark context available as 'sc' (master = local[*], app id = local-1598482830954).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.4.6
      /_/

Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_261)
Type in expressions to have them evaluated.
Type :help for more information.

Answer 1

我假设你是运行一台 windows 机器？

您是否尝试过运行 spark-shell.cmd 并看到同样的情况？

安装spark并配置

Install spark and configure it

runtime-error

command-prompt

apache-spark