0
我想为了使火花SQL和画面工作中使用这些链接:DSE 4.7和火花SQL驱动程序
- http://www.tableau.com/about/blog/2014/10/tableau-spark-sql-big-data-just-got-even-more-supercharged-33799
- https://www.concur.com/blog/en-us/connect-tableau-to-sparksql 对DSE之上运行火花SQL - 来自Tableau的分析。
我所做的:
-
上DSE侧
- 启用火花
- 开始
sudo dse start-spark-sql-thriftserver
- 我看到10000端口是通过启动火花-SQL thriftserver LISTEN
vagrant @ dsenode01:〜$ sudo netstat -alnpt | grep的10000 TCP 0
0 0.0.0.0:10000 0.0.0.0:* LISTEN
5908/JAVA流浪汉@ dsenode01:〜$ sudo的PS -ef | grep 5908 root 5908 1 3 09:26 pts/0 00:00:31/usr/lib/jvm/java-7-oracle/jre // bin/java -cp :/ etc/dse/spark:.. ..
当我尝试测试ODBC连接,我得到一个错误
而且我看到奇怪的节俭例外火花-SQL thriftserver日志。 它可能是什么?
dse.system_memory_in_mb=3009 -Dcassandra.config.loader=com.datastax.bdp.config.DseConfigurationLoader -Dspark.cassandra.connection.host=192.168.56.10 -Dlogback.configurationFile=/etc/dse/spark/logback-spark.xml -Xms512M -Xmx512M org.apache.spark.deploy.SparkSubmit --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --master spark://192.168.56.30:7077 spark-internal --hiveconf disableVirtualColumns=true
========================================
ERROR 2015-06-15 09:29:56 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
Caused by: org.apache.thrift.transport.TTransportException: null
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
... 4 common frames omitted
ERROR 2015-06-15 09:36:03 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
Caused by: org.apache.thrift.transport.TTransportException: null
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
... 4 common frames omitted
ERROR 2015-06-15 09:51:04 org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:208) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_80]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_80]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80]
Caused by: org.apache.thrift.transport.TTransportException: null
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:182) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-0.12.0.7.jar:0.12.0.7]
... 4 common frames omitted