2015-07-04 40 views
3

我可以写信给卡夫卡。然而,消费不工作用于消费的蟒蛇卡夫卡不起作用

kafka = KafkaClient(kafka_host_list) 
consumer = SimpleConsumer(kafka,'topic-test-development','topic-test-development') 

No handlers could be found for logger "kafka.conn" 
Traceback (most recent call last): 
    File "/home/ubuntu/workspace/feed-tests/tests/kafka_consumer.py", line 44, in <module> 
    consumer = SimpleConsumer(kafka,'topic-test-development','topic-test-development') 
    File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/simple.py", line 126, in __init__ 
    auto_commit_every_t=auto_commit_every_t) 
    File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/base.py", line 75, in __init__ 
    self.fetch_last_known_offsets(partitions) 
    File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/base.py", line 101, in fetch_last_known_offsets 
    check_error(resp) 
    File "/usr/local/lib/python2.7/dist-packages/kafka/common.py", line 230, in check_error 
    raise response 
kafka.common.FailedPayloadsError 
+0

看来,经纪人不可用.... – BAE

+0

python kafka客户端的版本是什么? doc中有一个介绍:group:该用户的名称,用于偏移量存储,并且必须是唯一的 如果要连接到不支持偏移量 commit/fetch(任何在0.8.1.1之前)的服务器,则你*必须*设置为无(从:https://github.com/mumrah/kafka-python/blob/adbd4ac052e4a5b40cfc2a3589b7adbcb656afe5/kafka/consumer/simple.py) – BAE

+0

我对卡夫卡和蟒蛇卡夫卡包装经验是经纪人连接是片状的,这意味着当生产者尝试发送消息或消费者试图将消息标记为消费时,可以重置连接。你最好的选择是实施一个重试逻辑,因为我认为这个问题很快就会得到解决。我仍然看到他们在这里和那里弹出。 – adam

回答

1

No handlers could be found for logger "kafka.conn"

附加代码记录:

logging.basicConfig(
    format='%(asctime)s.%(msecs)s:%(name)s:%(thread)d:%(levelname)s:%(process)d:%(message)s', 
    level=logging.DEBUG 
) 

运行和输出更多信息

2015-07-12 15:26:32,158.158.830881119:kafka.conn:140247909795584:DEBUG:17035:重新初始化s 9092 2015-07-12 15:26:32,221.221.35591507:为host01 OCKET连接kafka.conn:140247909795584:错误:17035:无法在host01连接到卡夫卡经纪人:9092