0

错误和报告工具没有标识严重性为“ERROR”的日志。使用fluentd代理将应用程序日志定向到Google Stackdriver Logging,其中一些是第三方Java组件。Google Stackdriver错误报告没有发现错误

{ 
insertId: "14sf3lvg3ccncgh" 
jsonPayload: { 
    class: "o.a.w.MarkupContainer"  
    message: "Unable to find component with id 'search2' in [Form [Component id = form]] 
       Expected: 'form:search2'. 
       Found with similar names: 'form:search' 
     at org.apache.wicket.markup.MarkupStream.throwMarkupException(MarkupStream.java:526) ~[wicket-core-6.22.0.jar:6.22.0] 
     at org.apache.wicket.MarkupContainer.renderNext(MarkupContainer.java:1438) ~[wicket-core-6.22.0.jar:6.22.0] 
     at org.apache.wicket.MarkupContainer.renderAll(MarkupContainer.java:1557) ~[wicket-core-6.22.0.jar:6.22.0] 
     at org.apache.wicket.MarkupContainer.renderComponentTagBody(MarkupContainer.java:1532) ~[wicket-core-6.22.0.jar:6.22.0] 
     at org.apache.wicket.MarkupContainer.onComponentTagBody(MarkupContainer.java:1487) ~[wicket-core-6.22.0.jar:6.22.0]"  
    milsec: "576"  
    reportLocation: {…}  
    serviceContext: {…}  
    tag: "test.gui"  
    thread: "[ajp-apr-8009-exec-5]"  
} 
labels: {…} 
logName: "projects/myservice/logs/test.gui" 
receiveTimestamp: "2017-08-29T15:20:16.847782870Z" 
resource: {…} 
severity: "ERROR" 
timestamp: "2017-08-29T15:20:11Z" 
} 

通过下面的配置允许,才能正确地转发给谷歌的Stackdriver记录我的应用程序日志和所有条目正确识别。

<source> 
    @type tail 
    path /var/log/test/test_gui/test_gui.log 
    pos_file /var/lib/google-fluentd/pos/test_gui-multiline.pos 
    read_from_head true 
    tag test.gui 
    format multiline 
    time_format %Y-%m-%d %H:%M:%S 
    format_firstline /\d{4}-\d{1,2}-\d{1,2} \d{1,2}:\d{1,2}:\d{1,2},\d{1,3}\s(?<severity>\S*)/ 
    format1 /^(?<time>\d{4}-\d{1,2}-\d{1,2} \d{1,2}:\d{1,2}:\d{1,2}),(?<milsec>\d{1,3})\s(?<severity>\S*)\s(?<class>\S*)\s(?<thread>\[\S*\])\s(?<message>.*)/ 
</source> 

然而,对于严重错误,错误报告从来没有注意到这些条目。

输出被确定为textPayLoad,我用下面的过滤器,这确保了输出功率为jsonPayload

<filter test.gui> 
    @type record_transformer 
    <record> 
    serviceContext {"service": "test.gui", "version": "1"} 
    reportLocation {"filePath": "test_gui.log", "lineNumber": "unknown", "functionName": "unknown"} 
    tag ${tag} 
    </record> 
</filter> 

仍然被忽略jsonPayload的误差。

如果我使用的过滤器更换的消息,然后突然错误报告工作

<filter test.gui> 
     @type record_transformer 
     <record> 
     serviceContext {"service": "test.gui", "version": "1"} 
     reportLocation {"filePath": "test_gui.log", "lineNumber": "unknown", 
     "functionName": "unknown"} 
     message "java.lang.TestError: msg 
      at com.example.TestClass.test (TestClass.java:51) 
      at com.example.AnotherClass (AnotherClass.java:25)" 
     tag ${tag} 
    </record> 
    </filter> 

我怎么能强迫错误报告来接这些错误项为我的下一个步骤将是实现某种形式的警报的。

回答

1

第三方没有生成正确的Java堆栈跟踪。我需要reportLocation,但这需要在上下文中。

我改变了下面一行:

reportLocation {"filePath": "test_gui.log", "lineNumber": "unknown", "functionName": "unknown"} 

context { "reportLocation" : {"filePath": "test_gui.log", "lineNumber": 1, "functionName": "unknown"} } 

这保证了日志现在为Stackdriver错误报告回升。

这是我的过滤器的最终版本:

<filter test.gui> 
    @type record_transformer 
    <record> 
    serviceContext {"service": "test.gui", "version": "1"} 
    context { "reportLocation" : {"filePath": "test_gui.log", "lineNumber": 1, "functionName": "unknown"} } 
    tag ${tag} 
    </record> 
</filter>