2014-11-09 62 views
0

执行以下命令-x local -f /Hbase/load_hbase.pig错误2998:未处理的内部错误。运行该代码

我收到以下错误

2014-11-08 23:36:47,455 [main] INFO org.apache.pig.Main - Apache Pig version 0.12.1 (r1585011) compiled Apr 05 2014, 01:41:34 
2014-11-08 23:36:47,455 [main] INFO org.apache.pig.Main - Logging error messages to: /home/eduardo/pig_1415497007452.log 
2014-11-08 23:36:47,817 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/eduardo/.pigbootup not found 
2014-11-08 23:36:47,918 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:/// 
2014-11-08 23:36:48,436 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org/apache/hadoop/hbase/filter/WritableByteArrayComparable 

这里是我运行代码:

raw_data = LOAD '/data/QCLCD201211/201201hourly.txt' USING PigStorage(','); 
weather_data = FOREACH raw_data GENERATE $1, $10; 
ranked_data = RANK weather_data; 
final_data = FILTER ranked_data BY $0 IS NOT NULL; 
STORE final_data INTO 'hbase://weather' 
     USING org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:date info:temp'); 

我不知道我做错了我将放下hadoop,hbase和猪的版本。 Hadoop的:Hadoop的1.2.1 HBASE:HBase的-0.96.2-hadoop1 猪:猪-0.12.1

回答

0

复制猪罐和Hadoop中

1 HBase的罐)复制这些文件到HADOOP图书馆。

sudo cp /usr/lib/pig/lib/pig-common-0.8.0-cdh3u0.jar /usr/lib/hadoop/lib/ 
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar /usr/lib/hadoop/lib/ 
sudo cp /usr/lib/pig/lib/hbase-0.96.2-cdh3u0.jar /usr/lib/hadoop/lib/ 

2)关闭HBASE和Hadoop使用FOLLOWING COMMOND

/usr/lib/hadoop/bin/stop-all.sh 
/usr/lib/hbase/bin/stop-hbase.sh 

3)重新启动HBASE和Hadoop使用COMMOND

/usr/lib/hadoop/bin/start-all.sh 
/usr/lib/hadoop/bin/start-hbase.sh 
+0

我不觉得我的猪/ lib文件夹这些文件。在这里我找到了一个名为jython-standalone-2.5.3.jar的文件和一个名为jdiff的文件夹。 – 2014-11-09 20:39:12

相关问题