2016-12-03 39 views
0

无法同时试图使用最新Apache Spark 2.0.2解决依赖关系和共同Scala 2.11.7SBT:SPARK2.0 *:SCALA:未解决的依赖org.glassfish.hk2和javax.validation

我需要使用最新版本的spark因为它支持SparkSession。下面配置工作正常spark 1.6.2。但我想为spark 2.0.*

这是我的依赖配置

scalaVersion := "2.11.7" 

val sparkVersion = "2.0.2" 

libraryDependencies ++= Seq(
    ws , 
    "org.apache.spark" %% "spark-core" % sparkVersion, 
    "org.apache.spark" %% "spark-sql" % sparkVersion, 
    "org.apache.spark" %% "spark-streaming" % sparkVersion, 
    "org.mongodb.spark" % "mongo-spark-connector_2.11" % "2.0.0", 
    specs2 % Test 
) 

这是错误消息:

Error:Error while importing SBT project: 
[info] Resolving org.ow2.asm#asm-tree;4.1 ... 
[info] Resolving org.ow2.asm#asm-analysis;4.1 ... 
[info] Resolving org.ow2.asm#asm-util;4.1 ... 
[info] Resolving jline#jline;2.12.1 ... 
[warn] :::::::::::::::::::::::::::::::::::::::::::::: 
[warn] ::   UNRESOLVED DEPENDENCIES   :: 
[warn] :::::::::::::::::::::::::::::::::::::::::::::: 
[warn] :: org.glassfish.hk2#hk2-utils;2.22.2: not found 
[warn] :: org.glassfish.hk2#hk2-locator;2.22.2: not found 
[warn] :: javax.validation#validation-api;${javax.validation.version}: not found 
[warn] :::::::::::::::::::::::::::::::::::::::::::::: 
[trace] Stack trace suppressed: run 'last *:update' for the full output. 
[trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for the full output. 
[error] (*:update) sbt.ResolveException: unresolved dependency: org.glassfish.hk2#hk2-utils;2.22.2: not found 
[error] unresolved dependency: org.glassfish.hk2#hk2-locator;2.22.2: not found 
[error] unresolved dependency: javax.validation#validation-api;${javax.validation.version}: not found 
[error] (*:ssExtractDependencies) sbt.ResolveException: unresolved dependency: org.glassfish.hk2#hk2-utils;2.22.2: not found 
[error] unresolved dependency: org.glassfish.hk2#hk2-locator;2.22.2: not found 
[error] unresolved dependency: javax.validation#validation-api;${javax.validation.version}: not found 
[error] Total time: 81 s, completed 3 Dec, 2016 8:51:18 PM 

纠正我,如果我做任何错误的应用依赖性。谢谢

+0

请考虑评论你的downvote? –

回答

2

依赖项发布链中可能存在错误。一种选择是排除破坏的依赖关系 - 将exclude("org.glassfish.hk2", "hk2-utils") exclude("org.glassfish.hk2", "hk2-locator") exclude("javax.validation", "validation-api")添加到正在引入这些依赖项的任何Spark依赖项中 - 并显式添加这三个依赖项的工作版本。

此外,我没有看到版本2.22.2org.glassfish.hk2#hk2-utilsorg.glassfish.hk2#hk2-locator

+0

我如何报告此MavenCentral?不仅如此,还有一些运行时出现的错误依赖关系像'fastxml-jackson'一样 –