2017-08-16 56 views
0

我使用Docker容器内的流利插件水槽运行流利的代理。 了一段时间后,我的容器里面的一些程序失败,下一个错误:使用流畅和水槽无限增加的文件描述符的数量

Check failed: _s.ok() Bad status: Runtime error: Could not create thread: Resource temporarily unavailable (error 11) 

我发现号泊坞容器内的文件描述符增加无限:

sudo lsof| grep flume | wc -l 
469292 

和描述的,而数后变得更大,然后文件描述符限制。 看起来像节点连接以错误的方式处理:文件描述符在事务结束后仍然存在。

Fluend配置:

<source> 
    @type forward 
    tag forward_1 
    bind 0.0.0.0 
    port 24224 
    linger_timeout 0 
</source> 

<match forward_1> 
     @type copy 
     <store> 
       @type flume 
       timeout 15 
       host localhost 
      port 33333 
     </store> 
</match> 

油烟配置:

forward_1.sources = source1 
forward_1.channels = channel1 
forward_1.sinks = sink1 
# 
forward_1.sources.source1.type = thrift 
forward_1.sources.source1.bind = localhost 
forward_1.sources.source1.port = 33333 
forward_1.sources.source1.channels = channel1 
# 
forward_1.channels.channel1.type = memory 
forward_1.channels.channel1.capacity = 10000 
forward_1.channels.channel1.transactionCapacity = 1000 
# 
forward_1.sinks.sink1.type = org.apache.kudu.flume.sink.KuduSink 
forward_1.sinks.sink1.channel = channel1 
forward_1.sinks.sink1.masterAddresses = 10.1.0.1:7051 
forward_1.sinks.sink1.tableName = shop_logs 
forward_1.sinks.sink1.batchSize = 50 
forward_1.sinks.sink1.producer = KuduJsonProducer 

泊坞版:17.03 Fluentd版本:0​​.14.19 水槽版本:1.7.0

是否有办法限制文件描述符数量?

回答

相关问题