Kafka Streams：topic.compression.type 不是已知配置

Question

在Kafka Streams中添加压缩配置，类似link:

properties.put(StreamsConfig.topicPrefix(TopicConfig.COMPRESSION_TYPE_CONFIG), "snappy");

但我在日志中看到以下警告消息：

[2018-11-19 23:52:10,158] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig)
[2018-11-19 23:52:10,158] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig)
[2018-11-19 23:52:10,194] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-11-19 23:52:10,194] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-11-19 23:52:10,209] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig)
[2018-11-19 23:52:10,209] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig)
[2018-11-19 23:52:10,221] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-11-19 23:52:10,221] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)

这个设置不被接受吗？是不是表达不好？

Answer 1

您可以忽略这些警告。 "problem" 是，主题配置参数被复制到内部使用的客户端的配置中，他们不知道参数名称，因此发出警告。但是，这些配置必须在客户端上设置，因为客户端会将这些配置 "forward" 传递给代码库中知道如何使用它们的其他部分。

这有点不幸，而且是一个已知问题（但不容易解决）。此问题有 JIRA：https://issues.apache.org/jira/browse/KAFKA-6793

Kafka Streams：topic.compression.type 不是已知配置

Kafka Streams: topic.compression.type not a known config

java

apache-kafka

apache-kafka-streams