2017-04-04 76 views
0

所以我试图在Solr 5.4.1上使用Solr CEL和Tika索引文档。我使用的是默认的配置,但是当我输入我的文档,我得到这个错误:导入solr单元格/ Tika元数据导致文件导致多值错误

multiple values encountered for non multiValued field meta: 

下面是相关的错误日志,你可以看到,我提供到Solr的数据。

125973 INFO (qtp840863278-17) [ x:fusearchiver] o.a.s.c.PluginBag Going to create a new requestHandler with {type = requestHandler,name = /update/extract,class = solr.extraction.ExtractingRequestHandler,args = {defaults={lowernames=true,uprefix=ignored_,captureAttr=true,fmap.a=links,fmap.div=ignored_}}} 

127134 INFO (qtp840863278-17) [ x:fusearchiver] o.a.s.u.p.LogUpdateProcessorFactory [fusearchiver] webapp=/solr path=/update/extract params={literal.archiveDate_dt=Mon+Apr+03+21:16:48+EDT+2017&literal._accountId=2&literal.categories=taxes&literal.categories=5498&literal.id=b5701a36-0dec-4746-bb5d-3c307a557cd7&literal._batchId=25&literal._type=document&literal._filename=2016-0664-Form-5498.pdf&literal._employeeNumber=1411&wt=javabin&literal._employeeFuseId=1&literal.effectiveDate_dt=Sat+Dec+31+00:00:00+EST+2016&literal._json={"accountId":2,"archiveDate":1491268608431,"batchId":25,"categories":["taxes","5498"],"effectiveDate":1483160400000,"employeeFuseId":1,"employeeNumber":"1411","fileName":"2016-0664-Form-5498.pdf","id":"b5701a36-0dec-4746-bb5d-3c307a557cd7","imageUrl":null,"path":"2016-0664-Form-5498.pdf","uploadedBy":null,"url":null}&version=2} {} 0 1161 

127135 ERROR (qtp840863278-17) [ x:fusearchiver] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: ERROR: [doc=b5701a36-0dec-4746-bb5d-3c307a557cd7] multiple values encountered for non multiValued field meta: [dcterms:modified, 2017-03-16T23:14:41Z, meta:creation-date, 2017-03-16T23:14:41Z, meta:save-date, 2017-03-16T23:14:41Z, pdf:PDFVersion, 1.4, dcterms:created, 2017-03-16T23:14:41Z, Last-Modified, 2017-03-16T23:14:41Z, date, 2017-03-16T23:14:41Z, X-Parsed-By, org.apache.tika.parser.DefaultParser, X-Parsed-By, org.apache.tika.parser.pdf.PDFParser, modified, 2017-03-16T23:14:41Z, xmpTPg:NPages, 2, Creation-Date, 2017-03-16T23:14:41Z, pdf:encrypted, false, created, Thu Mar 16 23:14:41 UTC 2017, stream_size, null, dc:format, application/pdf; version=1.4, producer, Ricoh Americas Corporation, AFP2PDF, Content-Type, application/pdf, xmp:CreatorTool, Ricoh Americas Corporation, AFP2PDF Plus Version: 1.014.10, Last-Save-Date, 2017-03-16T23:14:41Z] 

at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:92) 

at org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:83) 

at org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:273) 

at org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:207) 

at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:169) 

at org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) 

at org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:49) 

at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:924) 

at org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1079) 

at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:702) 

at org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104) 

at org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:126) 

at org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:131) 

at org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:237) 

at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:70) 

at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:156) 

这里是我的提取模块的solrconfig.xml中:

<requestHandler name="/update/extract" 
      startup="lazy" 
      class="solr.extraction.ExtractingRequestHandler" > 
    <lst name="defaults"> 
    <str name="lowernames">true</str> 
    <str name="uprefix">ignored_</str> 

    <!-- capture link hrefs but ignore div attributes --> 
    <str name="captureAttr">true</str> 
    <str name="fmap.a">links</str> 
    <str name="fmap.div">ignored_</str> 
    </lst> 
</requestHandler> 

我认为这将标志着基本上,这不是一个字段作为忽略,以便元不应导入一切。我已经搜索了我的solr模式,并且我没有声明元域,因此我认为CEL会将其抛出。

我正在使用Solrj导入文档。我还在文档中添加了大量文字。你可以在上面看到我用文字提供的数据。

为什么我看到这个错误?

我可以简单地只提取信息,我会把它放在一个文本字段中,并以相同的方式处理HTML以解决此问题?

+0

是否还配置了未被索引的动态ignored_ *字段? –

+0

是的,我在我的模式中有这个: chubbsondubs

+0

被忽略的字段索引? –

回答

0

的解决此问题的是介绍我的提取物中的requesthandler配置solrconfig.xml中的以下内容:

<str name="fmap.meta">ignored_</str> 

我不知道为什么我必须明确地做到这一点。我也不得不打开lowernames = false,因为我的文字被改变了,对我造成了严重的问题。这让我相信,我应该在Solr之外运行Tika,因为我会对它有更多的控制权。我想最终添加tesseract,而且你自己做起来似乎更容易。