1
我用过spark SQL connect hive,基本查询还行,但是无法创建索引,会不会引发SQL支持索引?Spark SQL(版本1.1.0)是否支持配置单元索引?
DROP TABLE test_tabe;
CREATE TABLE test_tabe
(
....
,area STRING
...
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
LINES TERMINATED BY '\n'
STORED AS RCFILE
--STORED AS SEQUENCEFILE
;
CREATE INDEX idx_compact_index ON TABLE test_tabe (area) AS 'COMPACT' WITH DEFERRED REBUILD
#!!!!Execute always,no error,spark web page no corresponding job !!!!
ALTER INDEX idx_compact_index ON test_tabe REBUILD;
insert overwrite table test.test_tabe select * from test.new_mkt_browse_label_10m
谢谢。
Hive vs Spark SQL vs Impala http://blog.atscale.com/how-different-sql-on-hadoop-engines-satisfy-bi-workloads – 2016-07-27 16:55:39