2016-12-08 24 views
0

here moved snapshot jar in lib folder收到此错误水槽运行命令后, 即错误node.PollingPropertiesFileConfigurationProvider:未能加载配置数据。异常如下。 org.apache.flume.FlumeException:

用户@ Ubuntu的:〜/ hadoop_store/Apache的水槽-1.4.0-斌/斌$ ./flume-ng代理-n TwitterAgent -c的conf -f ../conf/twitter1.conf

也试过

用户@ Ubuntu的:〜/ hadoop_store/Apache的水槽-1.4.0-斌/斌$ ./flume -ng agent -n TwitterAgent -c conf -f /home/user/hadoop_store/apache-flume-1.4.0-bin/conf/twitter1.conf

引起其中一个类似的问题estion有人提到这样, 这里到底是什么的话

16/12/08 04:41:26 INFO source.DefaultSourceFactory: Creating instance of source Twitter, type org.apache.flume.source.twitter.TwitterSource 
16/12/08 04:41:26 ERROR node.PollingPropertiesFileConfigurationProvider: Failed to load configuration data. Exception follows. 
org.apache.flume.FlumeException: Unable to load source type: org.apache.flume.source.twitter.TwitterSource, class: org.apache.flume.source.twitter.TwitterSource 
    at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:67) 
    at org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:40) 
    at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:327) 
    at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102) 
    at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) 
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) 
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) 
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:745) 
Caused by: java.lang.ClassNotFoundException: org.apache.flume.source.twitter.TwitterSource 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 
    at java.lang.Class.forName0(Native Method) 
    at java.lang.Class.forName(Class.java:195) 
    at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:65) 
    ... 11 more 

这里是我的twitter1.conf文件,有没有在这个任何错误这样

# Naming the components on the current agent. 
TwitterAgent.sources = Twitter 
TwitterAgent.channels = MemChannel 
TwitterAgent.sinks = HDFS 

# Describing/Configuring the source 
TwitterAgent.sources.Twitter.type = org.apache.flume.source.twitter.TwitterSource 
TwitterAgent.sources.Twitter.consumerKey = ### 
TwitterAgent.sources.Twitter.consumerSecret = ### 
TwitterAgent.sources.Twitter.accessToken = ### 
TwitterAgent.sources.Twitter.accessTokenSecret = ### 
TwitterAgent.sources.Twitter.keywords = lalalala 

# Describing/Configuring the sink 

TwitterAgent.sinks.HDFS.type = hdfs 
TwitterAgent.sinks.HDFS.hdfs.path = hdfs://localhost:8020/user/Hadoop/twitter_data/ 
TwitterAgent.sinks.HDFS.hdfs.fileType = DataStream 
TwitterAgent.sinks.HDFS.hdfs.writeFormat = Text 
TwitterAgent.sinks.HDFS.hdfs.batchSize = 1000 
TwitterAgent.sinks.HDFS.hdfs.rollSize = 0 
TwitterAgent.sinks.HDFS.hdfs.rollCount = 10000 

# Describing/Configuring the channel 
TwitterAgent.channels.MemChannel.type = memory 
TwitterAgent.channels.MemChannel.capacity = 10000 
TwitterAgent.channels.MemChannel.transactionCapacity = 100 

# Binding the source and sink to the channel 
TwitterAgent.sources.Twitter.channels = MemChannel 
TwitterAgent.sinks.HDFS.channel = MemChannel 

找不出什么问题这里

+0

@A。 T:我在你之前的问题中回复过,请进入 – Farooque

+0

这是不一样的,做了更正, –

+0

你得到java.lang.ClassNotFoundException:org.apache.flume.source.twitter.TwitterSource错误.. 。你必须将flume-source jar放在flume lib目录中 – Farooque

回答

0

添加水槽来源-1.0-SNAPSHOT.jar在水槽/ lib文件夹,并用Twitter4j2.2.6.jar文件替换Twitter4j3.0.3.jar(包括核心,媒体和流文件),它可能工作