Scala 2.11 的 Scalding
Scalding for Scala 2.11
我的build.sbt是这样写的:
name := """scala-hbase"""
version := "1.0"
scalaVersion := "2.11.2"
//scalaVersion := "2.10.4"
/* HBase dependencies */
resolvers ++= Seq(
"Apache Repo" at "https://repository.apache.org/content/repositories/releases",
"Thrift-Repo" at "http://people.apache.org/~rawson/repo",
"ClouderaRepo" at "https://repository.cloudera.com/content/repositories/releases",
"ClouderaRcs" at "https://repository.cloudera.com/artifactory/cdh-releases-rcs",
"Twitter Maven" at "http://maven.twttr.com",
"MVN Repo" at "http://mvnrepository.com/artifact",
"releases" at "http://scala-tools.org/repo-releases"
)
// Hbase 0.94 / Hadoop 2.5.2
libraryDependencies ++= Seq(
//"org.apache.zookeeper" % "zookeeper" % "3.4.6",
//"org.specs2" %% "specs2" % "2.4.5" % "test",
"org.apache.hadoop" % "hadoop-core" % "1.2.1",
"org.apache.hbase" % "hbase" % "0.94.16",
"com.twitter" %% "scalding-args" % "0.10.0",
"com.twitter" %% "scalding-core" % "0.10.0",
"com.twitter" %% "scalding-date" % "0.10.0"
)
// Uncomment to use Akka
//libraryDependencies += "com.typesafe.akka" % "akka-actor_2.11" % "2.3.3"
但是我有一些未解决的依赖关系
[警告]:::::::::::::::::::::::::::::::::
[警告] :: 未解决的依赖关系 ::
[警告]:::::::::::::::::::::::::::::::::
[警告] :: com.twitter#scalding-args_2.11;0.10.0:未找到
[警告] :: com.twitter#scalding-core_2.11;0.10.0: 未找到
[警告] :: com.twitter#scalding-date_2.11;0.10.0: 未找到
[警告]:::::::::::::::::::::::::::::::::
我应该为 scala 2.11 使用什么版本的 scalding ?谢谢
We don't compile for 2.11.0 since its super hard/impossible to have code compatible from 2.9 -> 2.11.
We (at twitter) are still on 2.9.x for the moment so for now we can only support up to the 2.10.x scala's. Hopefully this will change over the next few months.
此外,当前的 scalding 版本(0.12) 仅与 scala 2.10 兼容(maven)
正如@Travis 在评论中提到的,Scalding for Scala 2.11 版在 Scalding 的开发分支中可用(github)
Scalding 0.13 现已发布,它支持 Scala 2.11。
https://github.com/twitter/scalding/releases
我的build.sbt是这样写的:
name := """scala-hbase"""
version := "1.0"
scalaVersion := "2.11.2"
//scalaVersion := "2.10.4"
/* HBase dependencies */
resolvers ++= Seq(
"Apache Repo" at "https://repository.apache.org/content/repositories/releases",
"Thrift-Repo" at "http://people.apache.org/~rawson/repo",
"ClouderaRepo" at "https://repository.cloudera.com/content/repositories/releases",
"ClouderaRcs" at "https://repository.cloudera.com/artifactory/cdh-releases-rcs",
"Twitter Maven" at "http://maven.twttr.com",
"MVN Repo" at "http://mvnrepository.com/artifact",
"releases" at "http://scala-tools.org/repo-releases"
)
// Hbase 0.94 / Hadoop 2.5.2
libraryDependencies ++= Seq(
//"org.apache.zookeeper" % "zookeeper" % "3.4.6",
//"org.specs2" %% "specs2" % "2.4.5" % "test",
"org.apache.hadoop" % "hadoop-core" % "1.2.1",
"org.apache.hbase" % "hbase" % "0.94.16",
"com.twitter" %% "scalding-args" % "0.10.0",
"com.twitter" %% "scalding-core" % "0.10.0",
"com.twitter" %% "scalding-date" % "0.10.0"
)
// Uncomment to use Akka
//libraryDependencies += "com.typesafe.akka" % "akka-actor_2.11" % "2.3.3"
但是我有一些未解决的依赖关系
[警告]:::::::::::::::::::::::::::::::::
[警告] :: 未解决的依赖关系 ::
[警告]:::::::::::::::::::::::::::::::::
[警告] :: com.twitter#scalding-args_2.11;0.10.0:未找到
[警告] :: com.twitter#scalding-core_2.11;0.10.0: 未找到
[警告] :: com.twitter#scalding-date_2.11;0.10.0: 未找到
[警告]:::::::::::::::::::::::::::::::::
我应该为 scala 2.11 使用什么版本的 scalding ?谢谢
We don't compile for 2.11.0 since its super hard/impossible to have code compatible from 2.9 -> 2.11.
We (at twitter) are still on 2.9.x for the moment so for now we can only support up to the 2.10.x scala's. Hopefully this will change over the next few months.
此外,当前的 scalding 版本(0.12) 仅与 scala 2.10 兼容(maven)
正如@Travis 在评论中提到的,Scalding for Scala 2.11 版在 Scalding 的开发分支中可用(github)
Scalding 0.13 现已发布,它支持 Scala 2.11。 https://github.com/twitter/scalding/releases