2015-06-29 69 views
0

我想从CDH-5.3.2版本的Flume中获取数据。我已经配置了flume.conf,hbase sink和twitter源代码。认证错误Flume的Twitter4J

但是,当我启动代理,我得到这个以下错误:

2015-06-29 16:57:15,115 ERROR org.apache.flume.lifecycle.LifecycleSupervisor: Unable to start EventDrivenSourceRunner: { source:com.cloudera.flume.source.TwitterSource{name:Twitter,state:IDLE} } - Exception follows. 
java.lang.IllegalStateException: Authentication credentials are missing. See http://twitter4j.org/configuration.html for the detail. 
    at twitter4j.TwitterBaseImpl.ensureAuthorizationEnabled(TwitterBaseImpl.java:200) 
    at twitter4j.TwitterStreamImpl.sample(TwitterStreamImpl.java:159) 
    at com.cloudera.flume.source.TwitterSource.start(TwitterSource.java:121) 
    at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44) 
    at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251) 
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) 
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) 
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:745) 

的flume.conf和HBase的沉代码是相同的这个博客:http://ahikmat.blogspot.com/2014/08/streaming-twitter-tweets-to-hbase-with.html

而且,Twitter的源代码与https://github.com/cloudera/cdh-twitter-example/tree/master/flume-sources/src/main/java/com/cloudera/flume/source

相同我不明白twitter4j中的auth错误,无论是回调url设置/ Twitter源代码有问题。

+0

您编辑'TwitterSourceConstants.java'添加您的应用程序的使用者密钥和秘密? –

+0

是的,我已经编辑这些代码,用我的消费者密钥和秘密 – ByanJati

回答

1

你已经在TwitterSourceConstants.java中添加了你的消费者密钥和秘密? 如果你已经完成了这个,你应该改变这个编辑。信息必须位于flume.conf文件中。有一个例子在twitter_flume。在flume sources文件夹中查看flume.conf文件。

希望它可以帮助