3

我正在使用Pyramid和rq,并且我想将rq worker作业记录在与我的金字塔应用程序相同的文件中。写入与金字塔和rq相同的日志文件

我的设置是这样的:

development.ini

# regular pyramid setup here... 

[loggers] 
keys = root, main 

[handlers] 
keys = console, debuglog 

[formatters] 
keys = generic 

[logger_root] 
level = DEBUG 
handlers = console, debuglog 

[logger_main] 
level = DEBUG 
handlers = 
qualname = main 

[handler_debuglog] 
class = handlers.RotatingFileHandler 
args = ('%(here)s/__logs/pyramid_debug.log','a') 
level = DEBUG 
formatter = generic 

[formatter_generic] 
format = %(asctime)s %(levelname)-8s [%(name)s][%(threadName)s] %(message)s 

main.py

from bunch import Bunch 
from redis import Redis 
from rq import Queue, Worker 
from helpers.rqworker import run_worker 
from helpers.log import write_log 

write_log('info', 'APP STARTED.') 
q = Queue(connection=Redis()) 
req_obj = Bunch() 
req_obj.remote_addr = self.request.remote_addr 
job = q.enqueue(run_worker, req_obj, {'some_other': 'data'}) 
write_log('info', 'APP ENDED.') 

佣工/ rqworker.py

from helpers.log import write_log 

def run_worker(req, data): 
    write_log(req, 'debug', 'WORKER STARTED', separator=True) 

佣工/ log.py

import logging 
log = logging.getLogger(__name__) 


def write_log(request, loglevel, message=None, **kwargs): 
    msg = '[{0}] {1}'.format(request.remote_addr, message) 
    level = logging.getLevelName(loglevel.upper()) 

    if 'separator' in kwargs: 
     log.log(level, '='*40) 

    if message: 
     log.log(level, msg) 

    if 'stack' in kwargs: 
     log.log(level, '{0} EXCEPTION {0}'.format('*'*15)) 
     log.log(level, kwargs['stack']) 
     log.log(level, '{0} EXCEPTION END {0}'.format('*'*13)) 

当我运行我的应用程序,我不能看到rqworker.py日志(可能是因为它是一个单独的线程),所以我不知道我怎么可以(和有可能)实现写入相同的日志文件?

回答

0

这可能不是到OP有用了,但我已经能够为RQ工人的输出重定向到一个自定义文件的方法是通过获取这样的记录:

logger = logging.getLogger('rq.worker') 

你可以添加一个新的FileHandler这个记录器上文件输出,并更改格式太:

h = logging.FileHandler("/path/to/logfile.log") 
formatter = logging.Formatter(...) 
fh.setFormatter(formatter) 
logger.addHandler(fh) 

我一直没能消除输出的色彩,不过,这将导致日志,打开时在文本编辑器中,会略微混杂ANSI颜色代码。

请注意,这会将日志记录移除到控制台。你也可以通过添加另一个处理程序来保持这一点。