Searchkick with aws elasticsearch

我有一个searchkick和elasticsearch的问题，并使用faraday_middleware-aws-signers-v4 gem。如果我把我的elasticsearch.rb初始化器留空，它在我的开发方面起作用。但是，如果我放入AWS Elasticsearch的配置，则会收到json解析错误。这里是我的elasticsearch.rb文件：Searchkick with aws elasticsearch

require 'faraday_middleware/aws_signers_v4' 

Searchkick.aws_credentials = { 
    access_key_id: ENV["AWS_ACCESS_KEY_ID"], 
    secret_access_key: ENV["AWS_SECRET_ACCESS_KEY"], 
    region: "us-west-2" 
}

我按照AWS的github页面上的说明。我遗漏了ENV ['ELASTICSEARCH_URL']，因为它是在我的env文件中定义的。我在那里试了一下，结果也一样。香港专业教育学院也尝试过这种方式，这是旧的方式，它是假设有，并得到相同的结果：

require 'faraday_middleware/aws_signers_v4' 

Searchkick.client = 
    Elasticsearch::Client.new(
    url: ENV['ELASTICSEARCH_URL'], 
    transport_options: {request: {timeout: 10}} 
) do |f| 
    f.request :aws_signers_v4, { 
     credentials: Aws::Credentials.new(ENV['AWS_ACCESS_KEY_ID'], ENV['AWS_SECRET_ACCESS_KEY']), 
     service_name: "es", 
     region: "us-west-2" 
    } 
    end

的Ive能虽然范围缩小到这种配置。

编辑：下面有完整的错误输出：

livingrecipe_1 | Oj::ParseError - unexpected character at line 1, column 1 [parse.c:690]: 
livingrecipe_1 | multi_json (1.12.2) lib/multi_json/adapters/oj.rb:15:in `load' 
livingrecipe_1 | multi_json (1.12.2) lib/multi_json/adapter.rb:21:in `load' 
livingrecipe_1 | multi_json (1.12.2) lib/multi_json.rb:122:in `load' 
livingrecipe_1 | elasticsearch-transport (5.0.4) lib/elasticsearch/transport/transport/serializer/multi_json.rb:24:in `load' 
livingrecipe_1 | elasticsearch-transport (5.0.4) lib/elasticsearch/transport/transport/base.rb:322:in `perform_request' 
livingrecipe_1 | elasticsearch-transport (5.0.4) lib/elasticsearch/transport/transport/http/faraday.rb:20:in `perform_request' 
livingrecipe_1 | elasticsearch-transport (5.0.4) lib/elasticsearch/transport/client.rb:131:in `perform_request' 
livingrecipe_1 | elasticsearch-api (5.0.4) lib/elasticsearch/api/actions/info.rb:15:in `info' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick.rb:77:in `server_version' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick.rb:81:in `server_below?' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/query.rb:906:in `below50?' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/query.rb:723:in `set_order' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/query.rb:437:in `prepare' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/query.rb:43:in `initialize' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick.rb:95:in `search' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/model.rb:29:in `searchkick_search' 
livingrecipe_1 | app/helpers/recipe_search.rb:18:in `search' 
livingrecipe_1 | app/controllers/recipes_controller.rb:9:in `index' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/basic_implicit_render.rb:4:in `send_action' 
livingrecipe_1 | actionpack (5.1.3) lib/abstract_controller/base.rb:186:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/rendering.rb:30:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/abstract_controller/callbacks.rb:20:in `block in process_action' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/callbacks.rb:131:in `run_callbacks' 
livingrecipe_1 | actionpack (5.1.3) lib/abstract_controller/callbacks.rb:19:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/rescue.rb:20:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/instrumentation.rb:32:in `block in process_action' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/notifications.rb:166:in `block in instrument' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/notifications/instrumenter.rb:21:in `instrument' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/notifications.rb:166:in `instrument' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/instrumentation.rb:30:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal/params_wrapper.rb:252:in `process_action' 
livingrecipe_1 | searchkick (2.3.1) lib/searchkick/logging.rb:209:in `process_action' 
livingrecipe_1 | activerecord (5.1.3) lib/active_record/railties/controller_runtime.rb:22:in `process_action' 
livingrecipe_1 | actionpack (5.1.3) lib/abstract_controller/base.rb:124:in `process' 
livingrecipe_1 | actionview (5.1.3) lib/action_view/rendering.rb:30:in `process' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal.rb:189:in `dispatch' 
livingrecipe_1 | actionpack (5.1.3) lib/action_controller/metal.rb:253:in `dispatch' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/routing/route_set.rb:49:in `dispatch' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/routing/route_set.rb:31:in `serve' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/routing/mapper.rb:16:in `block in <class:Constraints>' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/routing/mapper.rb:46:in `serve' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/journey/router.rb:46:in `block in serve' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/journey/router.rb:33:in `serve' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/routing/route_set.rb:834:in `call' 
livingrecipe_1 | rack-pjax (1.0.0) lib/rack/pjax.rb:12:in `call' 
livingrecipe_1 | omniauth (1.6.1) lib/omniauth/strategy.rb:189:in `call!' 
livingrecipe_1 | omniauth (1.6.1) lib/omniauth/strategy.rb:167:in `call' 
livingrecipe_1 | omniauth (1.6.1) lib/omniauth/strategy.rb:189:in `call!' 
livingrecipe_1 | omniauth (1.6.1) lib/omniauth/strategy.rb:167:in `call' 
livingrecipe_1 | omniauth (1.6.1) lib/omniauth/builder.rb:63:in `call' 
livingrecipe_1 | remotipart (1.3.1) lib/remotipart/middleware.rb:32:in `call' 
livingrecipe_1 | clearance (1.16.0) lib/clearance/rack_session.rb:23:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/etag.rb:25:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/conditional_get.rb:25:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/head.rb:12:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/session/abstract/id.rb:232:in `context' 
livingrecipe_1 | rack (2.0.3) lib/rack/session/abstract/id.rb:226:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/cookies.rb:613:in `call' 
livingrecipe_1 | activerecord (5.1.3) lib/active_record/migration.rb:556:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/callbacks.rb:26:in `block in call' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/callbacks.rb:97:in `run_callbacks' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/callbacks.rb:24:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/executor.rb:12:in `call' 
livingrecipe_1 | better_errors (2.3.0) lib/better_errors/middleware.rb:84:in `protected_app_call' 
livingrecipe_1 | better_errors (2.3.0) lib/better_errors/middleware.rb:79:in `better_errors_call' 
livingrecipe_1 | better_errors (2.3.0) lib/better_errors/middleware.rb:57:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/debug_exceptions.rb:59:in `call' 
livingrecipe_1 | web-console (3.5.1) lib/web_console/middleware.rb:135:in `call_app' 
livingrecipe_1 | web-console (3.5.1) lib/web_console/middleware.rb:20:in `block in call' 
livingrecipe_1 | web-console (3.5.1) lib/web_console/middleware.rb:18:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/show_exceptions.rb:31:in `call' 
livingrecipe_1 | railties (5.1.3) lib/rails/rack/logger.rb:36:in `call_app' 
livingrecipe_1 | railties (5.1.3) lib/rails/rack/logger.rb:24:in `block in call' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/tagged_logging.rb:69:in `block in tagged' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/tagged_logging.rb:26:in `tagged' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/tagged_logging.rb:69:in `tagged' 
livingrecipe_1 | railties (5.1.3) lib/rails/rack/logger.rb:24:in `call' 
livingrecipe_1 | sprockets-rails (3.2.1) lib/sprockets/rails/quiet_assets.rb:13:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/remote_ip.rb:79:in `call' 
livingrecipe_1 | request_store (1.3.2) lib/request_store/middleware.rb:9:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/request_id.rb:25:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/method_override.rb:22:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/runtime.rb:22:in `call' 
livingrecipe_1 | rack-timeout (0.4.2) lib/rack/timeout/core.rb:122:in `block in call' 
livingrecipe_1 | rack-timeout (0.4.2) lib/rack/timeout/support/timeout.rb:19:in `timeout' 
livingrecipe_1 | rack-timeout (0.4.2) lib/rack/timeout/core.rb:121:in `call' 
livingrecipe_1 | activesupport (5.1.3) lib/active_support/cache/strategy/local_cache_middleware.rb:27:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/executor.rb:12:in `call' 
livingrecipe_1 | actionpack (5.1.3) lib/action_dispatch/middleware/static.rb:125:in `call' 
livingrecipe_1 | rack (2.0.3) lib/rack/sendfile.rb:111:in `call' 
livingrecipe_1 | railties (5.1.3) lib/rails/engine.rb:522:in `call' 
livingrecipe_1 | puma (3.10.0) lib/puma/configuration.rb:225:in `call' 
livingrecipe_1 | puma (3.10.0) lib/puma/server.rb:605:in `handle_request' 
livingrecipe_1 | puma (3.10.0) lib/puma/server.rb:437:in `process_client' 
livingrecipe_1 | puma (3.10.0) lib/puma/server.rb:301:in `block in run' 
livingrecipe_1 | puma (3.10.0) lib/puma/thread_pool.rb:120:in `block in spawn_thread'

来源

2017-09-06 DRing

很有可能您的env设置不正确且ENV ['ELASTICSEARCH_URL']'为空。你可以通过puts/Rails.logger检查这个值吗？ – kiddorails

所以当我查看控制台中的变量时，他们会正确输出。也会很惊讶，如果是他们，因为我很长一段时间没有碰到我的.env文件，这只是开始发生。但要确保我拿出env变量和硬编码的值来测试并得到相同的错误 – DRing

因此，searchkick的人回到我的github页面，错误是我需要包括faraday_middleware gem并设置gzip。在这里看到问题https://github.com/ankane/searchkick/issues/982 – DRing

对于任何人谁可能偶然发现这一点，需要的答案。这与Elasticsearch 5以gzip压缩格式返回请求的方式有关。通过使用faraday_middleware宝石和像这样设置它的初始化：

require 'faraday/middleware' 
require 'faraday_middleware/aws_signers_v4' 

Searchkick.client = 
    Elasticsearch::Client.new(
    url: ENV["ELASTICSEARCH_URL"], 
    transport_options: {request: {timeout: 10}} 
) do |f| 
    f.use FaradayMiddleware::Gzip 
    f.request :aws_signers_v4, { 
     credentials: Aws::Credentials.new(ENV["AWS_ACCESS_KEY_ID"], ENV["AWS_SECRET_ACCESS_KEY"]), 
     service_name: "es", 
     region: "us-west-2" 
    } 
    end

它能够完美地处理了退货请求。请参阅以上评论以供参考，以在searchkick github上发布页面

来源

2017-09-06 12:20:47 DRing

Searchkick with aws elasticsearch

回答

相关问题