卡夫卡消费者抵消最大值?
Kafka consumer offset max value?
我正在谷歌搜索和阅读 Kafka 文档,但我找不到消费者偏移量的最大值以及最大值后是否有偏移量环绕。
我知道偏移量是一个 Int64 值,所以最大值是 0xFFFFFFFFFFFFFFFF。
如果有wraparound,Kafka是怎么处理这种情况的?
看来这不是真的"handled"。但是,考虑到偏移量是每个分区的,这似乎是我们不应该担心的事情:)
请参阅http://search-hadoop.com/m/uyzND1uRn8D1sSH322/rollover/v=threaded
根据这个post,不重置偏移量:
We don't roll back offset at this moment. Since the offset is a long, it
can last for a really long time. If you write 1TB a day, you can keep going
for about 4 million days.
Plus, you can always use more partitions (each partition has its own
offset).
所以正如卢西亚诺所说,可能不值得担心。
我正在谷歌搜索和阅读 Kafka 文档,但我找不到消费者偏移量的最大值以及最大值后是否有偏移量环绕。 我知道偏移量是一个 Int64 值,所以最大值是 0xFFFFFFFFFFFFFFFF。 如果有wraparound,Kafka是怎么处理这种情况的?
看来这不是真的"handled"。但是,考虑到偏移量是每个分区的,这似乎是我们不应该担心的事情:)
请参阅http://search-hadoop.com/m/uyzND1uRn8D1sSH322/rollover/v=threaded
根据这个post,不重置偏移量:
We don't roll back offset at this moment. Since the offset is a long, it can last for a really long time. If you write 1TB a day, you can keep going for about 4 million days.
Plus, you can always use more partitions (each partition has its own offset).
所以正如卢西亚诺所说,可能不值得担心。