2

问题连接卡桑德拉3.0 - 无法使用火花卡桑德拉连接器1.5.0无法使用火花卡桑德拉连接器1.5.0

背景连接卡桑德拉3.0 - 我试图从火花1.5用来连接卡桑德拉3.0。 0 通过使用设置火花卡桑德拉连接器1.5.0但我得到以下错误 -

作为每DataStax火花卡桑德拉连接器document,它说,连接器火花1.5可以从火花1.5.0/1.6用于卡桑德拉3.0 0.0。

你能否建议我是我想念这里的任何一步?

试过的方法

  1. 我试图从星火流和核心罐子

  2. 添加在 “pom.xml的” 独立番石榴依赖

排除番石榴依赖提前致谢。


16/04/26 09:45:07 WARN TaskSetManager: Lost task 4.0 in stage 1.0 (TID 16, ip-172-31-23-23.ec2.internal): java.lang.ExceptionInInitializerError 
    at com.datastax.spark.connector.cql.DefaultConnectionFactory$.clusterBuilder(CassandraConnectionFactory.scala:35) 
    at com.datastax.spark.connector.cql.DefaultConnectionFactory$.createCluster(CassandraConnectionFactory.scala:87) 
    at 
--- 
-- 
Caused by: java.lang.IllegalStateException: Detected Guava issue #1635 which indicates that a version of Guava less than 16.01 is in use. This introduces codec resolution issues and potentially other incompatibility issues in the driver. Please upgrade to Guava 16.01 or later. 
    at com.datastax.driver.core.SanityChecks.checkGuava(SanityChecks.java:62) 
    at com.datastax.driver.core.SanityChecks.check(SanityChecks.java:36) 
    at com.datastax.driver.core.Cluster.<clinit>(Cluster.java:67) 
    ... 23 more16/04/26 09:45:07 WARN TaskSetManager: Lost task 4.0 in stage 1.0 (TID 16, ip-172-31-23-23.ec2.internal): java.lang.ExceptionInInitializerError 
    at com.datastax.spark.connector.cql.DefaultConnectionFactory$.clusterBuilder(CassandraConnectionFactory.scala:35) 
    at com.datastax.spark.connector.cql.DefaultConnectionFactory$.createCluster(CassandraConnectionFactory.scala:87) 
    at com.datastax.spark.connector.cql.CassandraConnector$.com$datastax$spark$connector$cql$CassandraConnector$$createSession(CassandraConnector.scala:153) 
    at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$2.apply(CassandraConnector.scala:148) 
    at com.datastax.spark.connector.cql.CassandraConnector$$anonfun$2.apply(CassandraConnector.scala:148) 
    at com.datastax.spark.connector.cql.RefCountedCache.createNewValueAndKeys(RefCountedCache.scala:31) 

回答

0

有附带连接器的番石榴版本和一个附带火花之间的已知冲突。你是如何试图遮蔽番石榴图书馆的?

尝试将此添加到您的build.sbt文件:

assemblyShadeRules in assembly := Seq(
    ShadeRule.rename("com.google.**" -> "[email protected]").inAll 
) 
相关问题