术语查询在弹性搜索中不起作用？

Question

您好，我正在尝试发出 curl 命令以从我的弹性搜索索引 (mep-reports) 中检索一些文档，但它无法正常工作。

想象一下，如果我执行以下 curl 命令，它 return 是数据

curl -XGET 'localhost:52671/mep-reports*/_search?size=1' -H 'Content-Type: application/json' -d @query1.txt

回应

{
  "took": 6,
  "timed_out": false,
  "_shards": {
    "total": 5,
    "successful": 5,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 100,
    "max_score": null,
    "hits": [
      {
        "_index": "mep-reports",
        "_type": "doc",
        "_id": "99",
        "_score": null,
        "_source": {
          "inventory": "SMS",
          "msg_text": "This is random text",
          "status": "ENROUTE",
          "@timestamp": "2019-09-10T07:06:26.287Z",
          "o_error": "",
          "flight_id": "92348fa1-ca6c-456a-b3b2-85fba2d2deed",
          "recipient": "420736408281",
          "account_id": "a56f7e14-20f9-40e6-90c6-10604140ac5f",
          "sender": "8800111",
          "campaign_id": "6f2abca3-b46d-43f3-91be-3278a8dd7dc0",
          "nof_segments": 1,
          "@version": 1,
          "submission_ts": 1568105380000000,
          "delivery_ts": 1553616888000000,
          "campaign_name": "Starbucks Promotion",
          "flight_name": "Extremely very very long flight",
          "campaign_type": "NON_MARKETING"
        },
        "sort": [
          1568099186287
        ]
      }
    ]
  }
}

query1.txt 文件内容。

{
  "from": 0,
  "size": 10,
  "timeout": "300s",
  "query": {
    "bool": {
      "must": [
        {
          "range": {
            "@timestamp": {
              "from": "2019-08-31T23:00:00.000Z",
              "to": null,
              "include_lower": true,
              "include_upper": true,
              "format": "yyyy-MM-dd'T'HH:mm:ss.SSSZ",
              "boost": 1.0
            }
          }
        },
        {
          "range": {
            "@timestamp": {
              "from": null,
              "to": "2019-09-12T07:06:26.287Z",
              "include_lower": true,
              "include_upper": true,
              "format": "yyyy-MM-dd'T'HH:mm:ss.SSSZ",
              "boost": 1.0
            }
          }
        },
        {
          "match": {
            "account_id": {
              "query": "a56f7e14-20f9-40e6-90c6-10604140ac5f",
              "operator": "OR",
              "prefix_length": 0,
              "max_expansions": 50,
              "fuzzy_transpositions": true,
              "lenient": false,
              "zero_terms_query": "NONE",
              "auto_generate_synonyms_phrase_query": true,
              "boost": 1.0
            }
          }
        }
      ],
      "adjust_pure_negative": true,
      "boost": 1.0
    }
  },
  "sort": [
    {
      "@timestamp": {
        "order": "desc"
      }
    }
  ]
}

然而，当我修改 query1.txt 以搜索文档以包含 campaign_type 上的术语查询时，它不起作用。

   curl -XGET 'localhost:52671/mep-reports*/_search?size=1' -H 'Content-Type: application/json' -d @query.txt

回应

{"took":6,"timed_out":false,"_shards":{"total":5,"successful":5,"skipped":0,"failed":0},"hits":{"total":0,"max_score":null,"hits":[]}}

修改查询。 query.txt 文件内容

{
  "from": 0,
  "size": 10,
  "timeout": "300s",
  "query": {
    "bool": {
      "must": [
        {
          "range": {
            "@timestamp": {
              "from": "2019-08-31T23:00:00.000Z",
              "to": null,
              "include_lower": true,
              "include_upper": true,
              "format": "yyyy-MM-dd'T'HH:mm:ss.SSSZ",
              "boost": 1.0
            }
          }
        },
        {
          "range": {
            "@timestamp": {
              "from": null,
              "to": "2019-09-12T07:06:26.287Z",
              "include_lower": true,
              "include_upper": true,
              "format": "yyyy-MM-dd'T'HH:mm:ss.SSSZ",
              "boost": 1.0
            }
          }
        },
        {
          "match": {
            "account_id": {
              "query": "a56f7e14-20f9-40e6-90c6-10604140ac5f",
              "operator": "OR",
              "prefix_length": 0,
              "max_expansions": 50,
              "fuzzy_transpositions": true,
              "lenient": false,
              "zero_terms_query": "NONE",
              "auto_generate_synonyms_phrase_query": true,
              "boost": 1.0
            }
          }
        },
        {
          "terms": {
            "campaign_type": [
              "NON_MARKETING"
            ],
            "boost": 1.0
          }
        }
      ],
      "adjust_pure_negative": true,
      "boost": 1.0
    }
  },
  "sort": [
    {
      "@timestamp": {
        "order": "desc"
      }
    }
  ]
}

我希望上面的查询 return 一些结果。唯一的区别是我在广告系列类型字段中添加了条款查询。

这是我的弹性搜索映射文件

{
  "mappings": {
    "doc": {
      "properties": {
        "@timestamp": {
          "type": "date"
        },
        "@version": {
          "type": "text"
        },
        "account_id": {
          "type": "keyword"
        },
        "campaign_id": {
          "type": "keyword"
        },
        "delivery_ts": {
          "type": "date",
          "format": "epoch_millis"
        },
        "submission_ts": {
          "type": "date",
          "format": "epoch_millis"
        },
        "flight_id": {
          "type": "keyword"
        },
        "inventory": {
          "type": "keyword"
        },
        "msg_text": {
          "type": "keyword"
        },
        "nof_segments": {
          "type": "keyword"
        },
        "o_error": {
          "type": "keyword"
        },
        "recipient": {
          "type": "text"
        },
        "sender": {
          "type": "keyword"
        },
        "status": {
          "type": "keyword"
        },
        "campaign_name": {
          "type": "keyword"
        },
        "flight_name": {
          "type": "keyword"
        },
        "campaign_type": {
          "type": "keyword"
        }
      }
    }
  }
}

如果您能提供帮助，我将不胜感激。

我还观察到以下查询工作正常

{"from":0,"size":10,"timeout":"300s","query":{"bool":{"must":[{"range":{"@timestamp":{"from":"2019-08-31T23:00:00.000Z","to":null,"include_lower":true,"include_upper":true,"format":"yyyy-MM-dd'T'HH:mm:ss.SSSZ","boost":1.0}}},{"range":{"@timestamp":{"from":null,"to":"2019-09-12T07:06:26.287Z","include_lower":true,"include_upper":true,"format":"yyyy-MM-dd'T'HH:mm:ss.SSSZ","boost":1.0}}},{"match":{"recipient":{"query":"420736408281","operator":"OR","prefix_length":0,"max_expansions":50,"fuzzy_transpositions":true,"lenient":false,"zero_terms_query":"NONE","auto_generate_synonyms_phrase_query":true,"boost":1.0}}},{"match":{"account_id":{"query":"a56f7e14-20f9-40e6-90c6-10604140ac5f","operator":"OR","prefix_length":0,"max_expansions":50,"fuzzy_transpositions":true,"lenient":false,"zero_terms_query":"NONE","auto_generate_synonyms_phrase_query":true,"boost":1.0}}},{"match":{"campaign_id":{"query":"6f2abca3-b46d-43f3-91be-3278a8dd7dc0","operator":"OR","prefix_length":0,"max_expansions":50,"fuzzy_transpositions":true,"lenient":false,"zero_terms_query":"NONE","auto_generate_synonyms_phrase_query":true,"boost":1.0}}},{"match":{"flight_id":{"query":"92348fa1-ca6c-456a-b3b2-85fba2d2deed","operator":"OR","prefix_length":0,"max_expansions":50,"fuzzy_transpositions":true,"lenient":false,"zero_terms_query":"NONE","auto_generate_synonyms_phrase_query":true,"boost":1.0}}},{"terms":{"status":["enroute"],"boost":1.0}},{"terms":{"inventory":["sms"],"boost":1.0}}],"adjust_pure_negative":true,"boost":1.0}},"sort":[{"@timestamp":{"order":"desc"}}]}

Answer 1

术语查询未被分析并用于精确搜索或关键字搜索，在您的第一个查询中，您使用的是匹配查询，该查询已被分析并使用与索引时间相同的分析器，因此您得到了结果。

如果你想得到你的term查询的结果，请使用campaign_type.keyword如果它存在于你的映射中（如果你动态生成它），否则你需要创建一个关键字字段来存储它并查询在那个领域。

请参考elastic post explaining diff b/w term and match query。

术语查询在弹性搜索中不起作用？

terms query not working in elastic search?

elasticsearch

elasticsearch-6