Confluent Kafka Connect Elasticsearch 连接器安装

Question

我正在尝试将 Elasticsearch 连接器安装到 Confluent Kafka Connect。我正在按照以下说明进行操作： https://docs.confluent.io/kafka-connect-elasticsearch/current/index.html#install-the-connector-using-c-hub
执行后：

confluent-hub install confluentinc/kafka-connect-elasticsearch:latest

一切似乎都很好。查看以下结果：

[ec2-user@ip-172-31-16-76 confluent-6.1.0]$ confluent-hub install confluentinc/kafka-connect-elasticsearch:latest
The component can be installed in any of the following Confluent Platform installations:
  1. /home/ec2-user/confluent-6.1.0 (based on $CONFLUENT_HOME)
  2. /home/ec2-user/confluent-6.1.0 (found in the current directory)
  3. /home/ec2-user/confluent-6.1.0 (where this tool is installed)
Choose one of these to continue the installation (1-3): 2
Do you want to install this into /home/ec2-user/confluent-6.1.0/share/confluent-hub-components? (yN) y


Component's license:
Confluent Community License
http://www.confluent.io/confluent-community-license
I agree to the software license agreement (yN) y

Downloading component Kafka Connect Elasticsearch 11.0.3, provided by Confluent, Inc. from Confluent Hub and installing into /home/ec2-user/confluent-6.1.0/share/confluent-hub-components
Do you want to uninstall existing version 11.0.3? (yN) y

Detected Worker's configs:
  1. Standard: /home/ec2-user/confluent-6.1.0/etc/kafka/connect-distributed.properties
  2. Standard: /home/ec2-user/confluent-6.1.0/etc/kafka/connect-standalone.properties
  3. Standard: /home/ec2-user/confluent-6.1.0/etc/schema-registry/connect-avro-distributed.properties
  4. Standard: /home/ec2-user/confluent-6.1.0/etc/schema-registry/connect-avro-standalone.properties
  5. Based on CONFLUENT_CURRENT: /tmp/confluent.424339/connect/connect.properties
  6. Used by Connect process with PID : /tmp/confluent.424339/connect/connect.properties
Do you want to update all detected configs? (yN) y

Adding installation directory to plugin path in the following files:
  /home/ec2-user/confluent-6.1.0/etc/kafka/connect-distributed.properties
  /home/ec2-user/confluent-6.1.0/etc/kafka/connect-standalone.properties
  /home/ec2-user/confluent-6.1.0/etc/schema-registry/connect-avro-distributed.properties
  /home/ec2-user/confluent-6.1.0/etc/schema-registry/connect-avro-standalone.properties
  /tmp/confluent.424339/connect/connect.properties
  /tmp/confluent.424339/connect/connect.properties

Completed

但是，当我尝试列出所有可用连接器时，我得到以下列表：

[ec2-user@ip-172-31-16-76 confluent-6.1.0]$ confluent local services connect connector list
The local commands are intended for a single-node development environment only,
NOT for production usage. https://docs.confluent.io/current/cli/index.html

Bundled Connectors:
  file-sink
  file-source
  replicator

根据上面 link 中的说明，我希望看到 elasticsearch-sink 。不幸的是，没有这样的条目可用。
似乎我遗漏了一些简单的东西，但我没有看到任何说明。任何帮助将不胜感激。

编辑 1
下面你可以看到 curl -s localhost:8083/connector-plugins

的结果

[
    {"class":"io.confluent.connect.elasticsearch.ElasticsearchSinkConnector","type":"sink","version":"11.0.3"},
    {"class":"io.confluent.connect.replicator.ReplicatorSourceConnector","type":"source","version":"6.1.0"},
    {"class":"io.confluent.kafka.connect.datagen.DatagenConnector","type":"source","version":"null"},
    {"class":"org.apache.kafka.connect.file.FileStreamSinkConnector","type":"sink","version":"6.1.0-ce"},
    {"class":"org.apache.kafka.connect.file.FileStreamSourceConnector","type":"source","version":"6.1.0-ce"},
    {"class":"org.apache.kafka.connect.mirror.MirrorCheckpointConnector","type":"source","version":"1"},
    {"class":"org.apache.kafka.connect.mirror.MirrorHeartbeatConnector","type":"source","version":"1"},
    {"class":"org.apache.kafka.connect.mirror.MirrorSourceConnector","type":"source","version":"1"}
]

Answer 1

curl -s localhost:8083/connector-plugins 给出了工作人员安装了哪些插件的明确响应。

根据您问题中的输出，Elasticsearch 接收器连接器现已安装在您的连接器中。我不知道为什么 Confluent CLI 不显示这个。

Confluent Kafka Connect Elasticsearch 连接器安装

Confluent Kafka Connect Elasticsearch connector installation

elasticsearch

apache-kafka

apache-kafka-connect

confluent-platform