遇到可重试错误。将使用指数退避重试 {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"}

Question

Logstash 配置文件

input {
 elasticsearch {
 hosts => ["https://staing-example.com:443"]
 user => "userName"
 password => "password"
 index => "testingindex"
 size => 100
 scroll => "1m"
 }
}

filter {

}


output {
 amazon_es {
 hosts => ["https://example.us-east-1.es.amazonaws.com:443"]
 region => "us-east-1"
 aws_access_key_id => "access_key_id"
 aws_secret_access_key => "access_key_id"
 index => "testingindex"
}
}

使用 Logstash 从一台弹性搜索服务器转移到亚马逊弹性搜索

对于上述配置，Logstash 不断抛出

2019-10-10T16:00:51,232][错误][logstash.outputs.elasticsearch] 遇到可重试错误。将使用指数退避重试 {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"} [2019-10-10T16:00:52,127][错误][logstash.outputs.elasticsearch] 遇到可重试错误。将使用指数退避重试 {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"} [2019-10-10T16:00:52,317][错误][logstash.outputs.elasticsearch] 遇到可重试错误。将使用指数退避重试 {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"}

不知道为什么会这样

Answer 1

以下解决方案解决了我的问题单击 Amazon Elastic Search 中配置的集群 configure cluster

现在点击高级选项在那里你可以看到允许可以跨越多个索引并绕过特定于索引的访问策略的 API - 检查策略 Advance Option

遇到可重试错误。将使用指数退避重试 {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"}

Encountered a retryable error. Will Retry with exponential backoff {:code=>400, :url=>"https://example.us-east-1.es.amazonaws.com:443/_bulk"}

elasticsearch

logstash

amazon-elasticsearch