由于Spring-Data-Hadoop尚未发布,因此很难找到正在运行的示例配置以将其与cloudera配合使用。如何使用Cloudera CDH4和Maven获得正在运行的Spring-Data-Hadoop项目
我需要选择哪种依赖关系来获得与CDH4(Hadoop 2.0.0-cdh4.1.3)一起运行的Spring-Data-Hadoop?
通过选择不同的apporches我得到这个异常:
空指针
Exception in thread "SimpleAsyncTaskExecutor-1" java.lang.ExceptionInInitializerError at org.springframework.data.hadoop.mapreduce.JobExecutor$2.run(JobExecutor.java:183) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.NullPointerException at org.springframework.util.ReflectionUtils.makeAccessible(ReflectionUtils.java:405) at org.springframework.data.hadoop.mapreduce.JobUtils.<clinit>(JobUtils.java:123) ... 2 more
版本missmatch 7至4
Caused by: org.apache.hadoop.ipc.RemoteException: Server IPC version 7 cannot communicate with client version 4 at org.apache.hadoop.ipc.Client.call(Client.java:1070) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) at $Proxy1.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379) at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:238) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:372) at org.springframework.data.hadoop.mapreduce.JobFactoryBean.afterPropertiesSet(JobFactoryBean.java:208) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1545) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1483) ... 12 more
虽然链接可能会回答问题,但请考虑在答案中添加重要的问题/摘要。这样做会确保即使提供的链接变为不活动状态,您的答案仍然有用。在SO中只有链接的答案是不鼓励的。 – Harry 2013-11-26 04:56:15
这个答案很神秘,至少。它不回答这个问题。 – waste 2016-01-20 06:30:41