没有类名的ClassNotFoundException

我试着在一个jar中添加一个UDF并尝试LOAD。以下是我的代码段没有类名的ClassNotFoundException

 
register 'target/warcbase-0.1.0-SNAPSHOT-fatjar.jar'; 

DEFINE WarcLoader org.warcbase.pig.WarcLoader(); 

warc = LOAD '/raw/' USING WarcLoader AS (url: chararray, date: chararray, mime: chararray, content: bytearray); 
STORE warc INTO '/raw/proc/';

我收到以下异常。不幸的是，它并没有告诉我哪个课程没有找到。以下是整个堆栈跟踪

 
Backend error message 
--------------------- 
Error: java.io.IOException: java.lang.ClassNotFoundException: Class not found 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit.readFields(PigSplit.java:236) 
     at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71) 
     at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42) 
     at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372) 
     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751) 
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) 
     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) 
     at java.security.AccessController.doPrivileged(Native Method) 
     at javax.security.auth.Subject.doAs(Subject.java:415) 
     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) 
     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 
Caused by: java.lang.ClassNotFoundException: Class not found 
     at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1982) 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit.readFields(PigSplit.java:224) 
     ... 10 more 

Pig Stack Trace 
--------------- 
ERROR 0: java.io.IOException: java.lang.ClassNotFoundException: Class not found 

org.apache.pig.backend.executionengine.ExecException: ERROR 0: java.io.IOException: java.lang.ClassNotFoundException: Class not found 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.getStats(MapReduceLauncher.java:819) 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:452) 
     at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:280) 
     at org.apache.pig.PigServer.launchPlan(PigServer.java:1390) 
     at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375) 
     at org.apache.pig.PigServer.execute(PigServer.java:1364) 
     at org.apache.pig.PigServer.executeBatch(PigServer.java:415) 
     at org.apache.pig.PigServer.executeBatch(PigServer.java:398) 
     at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171) 
     at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234) 
     at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205) 
     at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) 
     at org.apache.pig.Main.run(Main.java:624) 
     at org.apache.pig.Main.main(Main.java:170) 
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
     at java.lang.reflect.Method.invoke(Method.java:606) 
     at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 
     at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 
Caused by: java.io.IOException: java.lang.ClassNotFoundException: Class not found 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit.readFields(PigSplit.java:236) 
     at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71) 
     at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42) 
     at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372) 
     at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751) 
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) 
     at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) 
     at java.security.AccessController.doPrivileged(Native Method) 
     at javax.security.auth.Subject.doAs(Subject.java:415) 
     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) 
     at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 
Caused by: java.lang.ClassNotFoundException: Class not found 
     at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1982) 
     at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit.readFields(PigSplit.java:224)

请帮我关于如何从这里开始。

来源

2015-07-20 Sree Aurovindh

我也打这个问题时，我意外地包括来自罐同时在类路径上的多个Pig版本。 – erwaman

确保您的UDF jar包含在您的Pig ClASSPATH中。添加以下环境变量：

出口PIG_CLASSPATH = /到/罐/地点：$ PIG_HOME /猪0.15.0-h2.jar：$ PIG_CLASSPATH

来源

2015-07-20 07:00:50 Abdulrahman

谢谢。它帮助！ –

没有类名的ClassNotFoundException

回答

相关问题