0

我想为了使火花SQL和画面工作中使用这些链接:DSE 4.7和火花SQL驱动程序

我所做的:

    上DSE侧
  • 启用火花
  • 开始sudo dse start-spark-sql-thriftserver
  • 我看到10000端口是通过启动火花-SQL thriftserver LISTEN

vagrant @ dsenode01:〜$ sudo netstat -alnpt | grep的10000 TCP 0
0 0.0.0.0:10000 0.0.0.0:* LISTEN
5908/JAVA

流浪汉@ dsenode01:〜$ sudo的PS -ef | grep 5908 root 5908 1 3 09:26 pts/0 00:00:31/usr/lib/jvm/java-7-oracle/jre // bin/java -cp :/ etc/dse/spark:.. ..

当我尝试测试ODBC连接,我得到一个错误 ODBC driver failure

而且我看到奇怪的节俭例外火花-SQL thriftserver日志。 它可能是什么?

dse.system_memory_in_mb=3009 -Dcassandra.config.loader=com.datastax.bdp.config.DseConfigurationLoader -Dspark.cassandra.connection.host=192.168.56.10 -Dlogback.configurationFile=/etc/dse/spark/logback-spark.xml -Xms512M -Xmx512M org.apache.spark.deploy.SparkSubmit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --master spark://192.168.56.30:7077 spark-internal --hiveconf disableVirtualColumns=true 
======================================== 

ERROR 2015-06-15 09:29:56 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message. 
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80] 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80] 
    at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] 
Caused by: org.apache.thrift.transport.TTransportException: null 
    at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    ... 4 common frames omitted 
ERROR 2015-06-15 09:36:03 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message. 
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80] 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80] 
    at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] 
Caused by: org.apache.thrift.transport.TTransportException: null 
    at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    ... 4 common frames omitted 
ERROR 2015-06-15 09:51:04 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message. 
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80] 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80] 
    at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] 
Caused by: org.apache.thrift.transport.TTransportException: null 
    at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7] 
    ... 4 common frames omitted 

回答

0

好了,所以这里是很好的conf例如:

  • 使用辛巴星火ODBC驱动器V 1.00.08.1008(也许它以后可以改变...)
  • 创建系统DSN
  • NB:我们没有使用任何auth机制。选择授权机制“用户名”和请勿输入用户名,留空。

它的工作,感谢上帝。请看屏幕截图 How the driver looks like