线程'kafka-producer-network-thread | 中的未捕获异常生产者-1

Question

生产到kafka后，日志出现Uncaught exception。但是成功地产生了 kafka 的提要。我想了解为什么会出现此日志、它的严重性以及如何修复它。谢谢！

pom.xml 中的 Kafka 依赖项如下所示：

<dependency>
   <groupId>org.apache.kafka</groupId>
   <artifactId>kafka-streams</artifactId>
</dependency>

<dependency>
    <groupId>org.springframework.kafka</groupId>
    <artifactId>spring-kafka</artifactId>
</dependency>

<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka-clients</artifactId>
    <version>2.0.0</version>
</dependency>

我的生产者配置如下所示：

@Bean
public ProducerFactory<String, Object> jsonProducerFactory() {
    Map<String, Object> configProps = new HashMap<>();
    configProps.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, kafkaBootstrapServers);
    configProps.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, StringSerializer.class);
    configProps.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, JsonSerializer.class);
    configProps.put(ProducerConfig.BATCH_SIZE_CONFIG, 500);
    configProps.put(ProducerConfig.LINGER_MS_CONFIG, 1000);
    configProps.put(ProducerConfig.RETRIES_CONFIG, 0);
    configProps.put(ProducerConfig.BUFFER_MEMORY_CONFIG, 50000000);
    configProps.put(ProducerConfig.MAX_REQUEST_SIZE_CONFIG, 5048576);
    return new DefaultKafkaProducerFactory<>(configProps);
}

@Bean
public KafkaTemplate<String, Object> jsonKkafkaTemplate() {
    return new KafkaTemplate<>(jsonProducerFactory());
}

我有这个日志：

java.lang.NoSuchMethodError: org.apache.kafka.clients.producer.Producer.close(Ljava/time/Duration;)V
    at org.springframework.kafka.core.KafkaTemplate.closeProducer(KafkaTemplate.java:382) ~[spring-kafka-2.3.1.RELEASE.jar:2.3.1.RELEASE]
    at org.springframework.kafka.core.KafkaTemplate.lambda$buildCallback(KafkaTemplate.java:433) ~[spring-kafka-2.3.1.RELEASE.jar:2.3.1.RELEASE]
    at org.apache.kafka.clients.producer.KafkaProducer$InterceptorCallback.onCompletion(KafkaProducer.java:1235) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.ProducerBatch.completeFutureAndFireCallbacks(ProducerBatch.java:201) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.ProducerBatch.done(ProducerBatch.java:187) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:599) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.completeBatch(Sender.java:575) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.handleProduceResponse(Sender.java:485) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.access0(Sender.java:74) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.onComplete(Sender.java:700) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:532) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:524) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:239) ~[kafka-clients-2.0.0.jar:na]
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:163) ~[kafka-clients-2.0.0.jar:na]
    at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_121]

Answer 1

您使用的 Kafka 客户端库与 Spring Kafka 和 Kafka Stream 库不兼容。这是依赖性问题；您可以尝试从 Kafka Clients 依赖项中删除版本以加载默认兼容版本，或者可以明确指定受支持的版本。

<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka-clients</artifactId>
</dependency>

或

<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka-clients</artifactId>
    <version><Supported Version></version>
</dependency>

线程'kafka-producer-network-thread | 中的未捕获异常生产者-1

Uncaught exception in thread 'kafka-producer-network-thread | producer-1

java

apache-kafka

spring-boot

spring-kafka