2014-10-28 27 views
0

后相关的错误开始使用DSE Solr的节点,初始设置罚款,并能以此为榜样,没有问题:Solr模式“已关闭”和基地DSE/Solr的节点设置

http://www.datastax.com/documentation/datastax_enterprise/4.5/datastax_enterprise/srch/srchTutStrt.html

我第一个测试用例是一些示例位置数据,修改了教程示例。我现在在哪里,我可以创造我表个态,插入〜5K例如行,推动该架构得到下面的异常时:org.apache.lucene.store.AlreadyClosedException:

<?xml version="1.0" encoding="UTF-8"?> 
    <response> 
    <lst name="responseHeader"><int name="status">500</int><int name="QTime">245</int></lst><lst name="error"><str name="msg">Already closed</str><str name="trace">org.apache.solr.common.SolrException: Already closed 
    at org.apache.solr.core.SolrCore.&lt;init&gt;(SolrCore.java:851) 
    at com.datastax.bdp.search.solr.core.CassandraCoreContainer.doReload(CassandraCoreContainer.java:700) 
    at com.datastax.bdp.search.solr.core.CassandraCoreContainer.create(CassandraCoreContainer.java:224) 
    at com.datastax.bdp.search.solr.core.SolrCoreResourceManager.createCore(SolrCoreResourceManager.java:256) 
    at com.datastax.bdp.search.solr.handler.admin.CassandraCoreAdminHandler.handleCreateAction(CassandraCoreAdminHandler.java:117) 
    at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:152) 
    at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:137) 
    at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:669) 
    at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:248) 
    at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:197) 
    at com.datastax.bdp.search.solr.servlet.CassandraDispatchFilter.doFilter(CassandraDispatchFilter.java:99) 
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
    at com.datastax.bdp.cassandra.audit.SolrHttpAuditLogFilter.doFilter(SolrHttpAuditLogFilter.java:218) 
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
    at com.datastax.bdp.search.solr.auth.CassandraAuthorizationFilter.doFilter(CassandraAuthorizationFilter.java:100) 
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
    at com.datastax.bdp.search.solr.auth.DseAuthenticationFilter.doFilter(DseAuthenticationFilter.java:102) 
    at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
    at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
    at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) 
    at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) 
    at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) 
    at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) 
    at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) 
    at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) 
    at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:891) 
    at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:750) 
    at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2283) 
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
    at java.lang.Thread.run(Thread.java:745) 

所致已关闭 at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:340) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:262) at org.apache.solr.core .SolrCore.initIndex(SolrCore.java:480) at org.apache.solr.core.SolrCore。 <初始化>(SolrCore.java:772) ...... 33多个 500name = snet_data.location_test1 &行动=创建

以此为我的表创建语句:

CREATE table location_test1 (
"id" TIMEUUID, 
"source_id" UUID, 
"name" VARCHAR, 
"address" VARCHAR, 
"address_extended" VARCHAR, 
"po_box" VARCHAR, 
"locality" VARCHAR, 
"region" VARCHAR, 
"post_town" VARCHAR, 
"admin_region" VARCHAR, 
"postcode" VARCHAR, 
"country" VARCHAR, 
"tel" VARCHAR, 
"latlon" VARCHAR, 
"neighborhood" SET<VARCHAR>, 
"website" VARCHAR, 
"email" VARCHAR, 
"category_ids" SET<VARCHAR>, 
"status" VARCHAR, 
"chain_name" VARCHAR, 
"chain_id" UUID, 
PRIMARY KEY ("id")); 

随着Solr模式:

<schema name="location_test1" version="1.5"> 
<types> 
    <fieldType name="string" class="solr.StrField"/> 
    <fieldType name="text" class="solr.TextField"> 
    <analyzer> 
     <tokenizer class="solr.StandardTokenizerFactory"/> 
     <filter class="solr.LowerCaseFilterFactory"/> 
     </analyzer> 
    </fieldType> 
    <fieldType name="geo" class="solr.GeoHashField"/> 
    <fieldType name="tdouble" class="solr.TrieDoubleField" precisionStep="8" positionIncrementGap="0" /> 
    <fieldType name="int" class="solr.TrieIntField"/> 
    <fieldType name="uuid" class="solr.UUIDField"/> 
</types> 
<fields> 
    <field name="id" type="uuid" indexed="true" stored="true" docValues="true"/> 
    <field name="name" type="string" indexed="true" stored="true"/> 
    <field name="latlon" type="geo" indexed="true" stored="true"/> 
</fields> 
<defaultSearchField>name</defaultSearchField> 
<uniqueKey>(id)</uniqueKey> 
</schema> 

被更新(10/29)后,新的测试

因此,看起来像这些错误正在导致B/C DSE Solr处于某种不良状态,即使在删除表和数据并重新开始之后,我决定将整个键空间作为重新启动点。现在得到不同的行为..,与核心创建时的早期错误一致,它抱怨多值字段应该映射到List/Set类型。

<?xml version="1.0" encoding="UTF-8"?> 
<response> 
<lst name="responseHeader"><int name="status">500</int><int name="QTime">325</int></lst><lst name="error"><str name="msg">Unable to create core: snet_data.location_test1</str><str name="trace">org.apache.solr.common.SolrException: Unable to create core: snet_data.location_test1 
     at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:957) 
     at com.datastax.bdp.search.solr.core.CassandraCoreContainer.create(CassandraCoreContainer.java:266) 
     at com.datastax.bdp.search.solr.core.SolrCoreResourceManager.createCore(SolrCoreResourceManager.java:256) 
     at com.datastax.bdp.search.solr.handler.admin.CassandraCoreAdminHandler.handleCreateAction(CassandraCoreAdminHandler.java:117) 
     at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:152) 
     at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:137) 
     at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:669) 
     at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:248) 
     at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:197) 
     at com.datastax.bdp.search.solr.servlet.CassandraDispatchFilter.doFilter(CassandraDispatchFilter.java:99) 
     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
     at com.datastax.bdp.cassandra.audit.SolrHttpAuditLogFilter.doFilter(SolrHttpAuditLogFilter.java:218) 
     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
     at com.datastax.bdp.search.solr.auth.CassandraAuthorizationFilter.doFilter(CassandraAuthorizationFilter.java:100) 
     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
     at com.datastax.bdp.search.solr.auth.DseAuthenticationFilter.doFilter(DseAuthenticationFilter.java:102) 
     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) 
     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
     at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) 
     at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) 
     at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) 
     at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) 
     at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) 
     at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) 
     at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:891) 
     at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:750) 
     at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2283) 
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
     at java.lang.Thread.run(Thread.java:745) 
Caused by: java.lang.IllegalStateException: Multi-valued field status should be mapped to either List or Set types, found: org.apache.cassandra.db.marshal.UTF8Type 
     at com.datastax.bdp.search.solr.core.Cql3CassandraSolrSchemaUpdater.update(Cql3CassandraSolrSchemaUpdater.java:115) 
     at com.datastax.bdp.search.solr.core.CassandraCoreContainer.create(CassandraCoreContainer.java:245) 
     ... 31 more 
</str><int name="code">500</int></lst><str name="params">name=snet_data.location_test1&amp;action=CREATE</str> 
</response> 

也跟其他领域的错误,状态字段它在抱怨在表中定义为varchar和架构中的一个字符串,所以不明白为什么它抱怨这些之前。

我现在所做的就是将模式简化为id,name,latlon。回到我没有得到单值varchar/string字段的多值错误的地方..,回到原来的“已关闭”的错误

这里是我的卷曲的语句,从例如从datastax Solr的教程上面提到的建立:

curl http://10.0.1.212:8983/solr/resource/snet_data.location_test1/solrconfig.xml --data-binary @solrconfig.xml -H 'Content-type:text/xml; charset=utf-8' 

curl http://10.0.1.212:8983/solr/resource/snet_data.location_test1/schema.xml --data-binary @schema.xml -H 'Content-type:text/xml; charset=utf-8' 

curl "http://10.0.1.212:8983/solr/admin/cores?action=CREATE&name=snet_data.location_test1" 

所采取的步骤在运行安装程序测试:

登录到定制列表外壳,并做以下

创建密钥空间:

CREATE KEYSPACE snet_data WITH REPLICATION = 
     {'class':'NetworkTopologyStrategy', 'Solr':1}; 

创建表:

CREATE table location_test1 (
"id" TIMEUUID, 
"source_id" UUID, 
"name" VARCHAR, 
"address" VARCHAR, 
"address_extended" VARCHAR, 
"po_box" VARCHAR, 
"locality" VARCHAR, 
"region" VARCHAR, 
"post_town" VARCHAR, 
"admin_region" VARCHAR, 
"postcode" VARCHAR, 
"country" VARCHAR, 
"tel" VARCHAR, 
"latlon" VARCHAR, 
"neighborhood" SET<VARCHAR>, 
"website" VARCHAR, 
"email" VARCHAR, 
"category_ids" SET<VARCHAR>, 
"status" VARCHAR, 
"chain_name" VARCHAR, 
"chain_id" UUID, 
PRIMARY KEY ("id")); 

(试过的5K记录像教程两者导入测试,同时还运行solr的卷曲命令SANS插入初始数据)

运行solr的卷曲的命令来设置的配置,架构的核心:

curl http://10.0.1.212:8983/solr/resource/snet_data.location_test1/solrconfig.xml --data-binary @solrconfig.xml -H 'Content-type:text/xml; charset=utf-8' 

curl http://10.0.1.212:8983/solr/resource/snet_data.location_test1/schema.xml --data-binary @schema.xml -H 'Content-type:text/xml; charset=utf-8' 

curl "http://10.0.1.212:8983/solr/admin/cores?action=CREATE&name=snet_data.location_test1" 
+0

你能分享你的卷曲声明吗? – phact 2014-10-28 23:25:29

+0

请提供从DSE安装到错误的逐步复制方案,并将Solr模式版本修复为1.5。 – sbtourist 2014-10-29 09:36:00

+0

更新的模式为1.5(为什么这是必需的方式?),更新后的步骤底部我一直在遵循 – kaiyzen 2014-10-29 22:23:19

回答

0

在使用模式并创建表语句之后,我可能会重现您的错误。在尝试创建核心几次崩溃后,服务器最终会出现该错误,可能是因为它处于不一致的状态。

如果您在您的模式中使用以下内容,我猜所有对您都可以。我需要知道确切的版本才能100%确定。

<?xml version="1.0" encoding="UTF-8" ?> 
<schema name="myTest" version="1.5"> 

为了避免此问题,未来是我会建议你:

  • 寻找在演示文件夹中的“维基”的演示。
  • 将其用作模板。更改脚本的核心名称,更改架构,改变solrconfig等
  • 这将是方便,因为脚本做你的工作,你已经工作模式等,你可以修改,并确保他们的工作

希望它有帮助。

更新10/30:

我需要你确切的版本,但已经取得了进展为在一个点上,确实也得到那个“状态”多值字段错误。让我们一步一步来:

  • 停止服务器并删除东西。在我的情况:rm -rf /var/lib/cassandra/*
  • 启动服务器:dse cassandra -s
  • 创建KS和表与cqlsh外壳:

    创建REPLICATION = { '类' KEYSPACE维基: 'SimpleStrategy', 'replication_factor': 1};

    USE wiki;

    CREATE表location_test1( “ID” TIMEUUID, “SOURCE_ID” UUID, “名” VARCHAR, “地址” VARCHAR, “address_extended” VARCHAR, “po_box” VARCHAR, “局部性” VARCHAR, “区域” VARCHAR, “post_town” VARCHAR, “admin_region” VARCHAR, “邮政编码” VARCHAR, “国家” VARCHAR, “电话” VARCHAR, “latlon” VARCHAR, “邻里” SET, “网站“VARCHAR, “email”VARCHAR, “category_ids”SET, “status”VARCHAR, “chain_name”VARCHAR, “chain_id”UUID, PRIMARY KEY(“id”));

  • 编辑schema.xml并复制你自己的。我复制了你的问题。我使用wiki演示中的solrconfig。

卷曲的http://:8983/solr的/资源/ wiki.location_test1/schema.xml中--data二进制@ schema.xml中-H“内容 - 类型:文本/ XML;字符集= UTF-8'

SUCCESS

curl http://<host>:8983/solr/resource/wiki.location_test1/solrconfig.xml --data-binary @solrconfig.xml -H 'Content-type:text/xml; charset=utf-8' 

SUCCESS 

curl "http://<host>:8983/solr/admin/cores?action=CREATE&name=wiki.location_test1" 

<?xml version="1.0" encoding="UTF-8"?> 
<response> 
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1598</int></lst> 
</response> 

它应该工作。如果它不,我需要你的确切版本。抱歉的格式,我不能让它显示为代码...

+0

感谢您的回复Bereng,我把它作为我的头文件在我的模式中:'<?xml version =“ 1.0“encoding =”UTF-8“?>'我尝试颠覆这个版本并且再次尝试从头开始,仍然是同样的问题。尝试从wiki示例开始,而不是从DSE Solr的nhanes_ks开始,看看这是否有所作为 – kaiyzen 2014-10-29 19:42:37

+0

使用dse-demos文件夹中的维基百科示例获取新错误:'uniqueKey字段(null)不能配置为多值“看起来像维基百科示例和来自dse docs的nhandes_ks示例之间的真正区别是维基百科示例中的uniqueKey值示例是”id“,其中nhanes是”(id)“ – kaiyzen 2014-10-29 20:02:56

+0

另一个测试,具有相同的结果。我再次从零开始,使用只有id和name字段的精简模式,作为uniqueKey添加回“(id)”中,得到与前面相同的错误:'uniqueKey字段(null)不能配置为多值化“似乎系统再次处于某种波动状态,这是令人困惑的。 DSE文档说DSE Solr是通过管理密钥空间/表来管理的......,所以会假设当我放弃并重新创建从头开始时,事情就会表现出来,如果不是这样的话,人们如何通过重新设置表/索引来重新安装? – kaiyzen 2014-10-29 20:16:38