要求失败：提供的 Maven 坐标必须采用 'groupId:artifactId:version' 形式

Question

我收到以下错误

requirement failed: Provided Maven Coordinates must be in the form 'groupId:artifactId:version'

当我运行下面的命令时

spark-submit --class StreamHandler\
--master local[*]\
--packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.4.5,\
  net.snowflake.snowflake-ingest-sdk:0.10.3,\
  net.snowflake.snowflake-jdbc.3.13.14\
  target/scala-2.11/stream-handler_2.11-1.0.jar

我正在尝试使用 scala 使用数据并将其推送到雪花接收器数据库。我的 build.sbt 文件看起来像这样

name := "Stream Handler"

version := "1.0"

scalaVersion := "2.11.12"

libraryDependencies ++= Seq(
    "org.apache.spark" %% "spark-core" % "2.4.5" % "provided",
    "org.apache.spark" %% "spark-sql" % "2.4.5" % "provided",
    "net.snowflake" % "snowflake-ingest-sdk" % "0.10.3",
    "net.snowflake" % "snowflake-jdbc" % "3.13.14",
    "org.apache.hadoop" % "hadoop-core" % "1.2.0"
    //"net.snowflake" % "spark-snowflake" % "2.7.2"
  
  )

这里有谁遇到过这个可以帮忙吗？

Answer 1

为 Snowflake 指定包的正确方法是：

不是：

net.snowflake.snowflake-ingest-sdk:0.10.3

但是：

net.snowflake:snowflake-ingest-sdk:0.10.3

其中：

<groupId>net.snowflake</groupId>
<artifactId>snowflake-ingest-sdk</artifactId>
<version>0.10.3</version>

JDBC 相同：

net.snowflake:snowflake-jdbc:3.13.14

要求失败：提供的 Maven 坐标必须采用 'groupId:artifactId:version' 形式

requirement failed: Provided Maven Coordinates must be in the form 'groupId:artifactId:version'

scala

sbt

spark-streaming

snowflake-cloud-data-platform

snowflake-connector