Zookeeper 是否需要 SSD 磁盘用于 Apache Kafka 集群?
Does Zookeeper require SSD disks for Apache Kafka Clusters?
我们要安装kafka集群和3个zookeeper服务器
kafka 应该使用 zookeeper 服务器,以便在 zookeeper 服务器上保存元数据
ZK 数据和日志文件应位于磁盘上,与其他 I/O 活动的争用最少。理想情况下,ZK 数据和 ZK 事务日志文件应该在不同的磁盘上,这样它们就不会争用 IO 资源。
请注意,仅仅有分区是不够的,它们必须是不同的磁盘以确保性能。
那么zookeeper服务器一定要用SSD盘吗?
如果是,动物园磁盘作为 IO 等的最低要求是什么?
Confluent 在生产环境中 运行 Zookeeper 推荐以下配置:
Disks
Disk performance is vital to maintaining a healthy ZooKeeper cluster.
Solid state drives (SSD) are highly recommended as ZooKeeper must have
low latency disk writes in order to perform optimally. Each request to
ZooKeeper must be committed to to disk on each server in the quorum
before the result is available for read. A dedicated SSD of at least
64 GB in size on each ZooKeeper server is recommended for a production
deployment. You can use autopurge.purgeInterval and
autopurge.snapRetainCount to automatically cleanup ZooKeeper data and
lower maintenance overhead.
我们要安装kafka集群和3个zookeeper服务器
kafka 应该使用 zookeeper 服务器,以便在 zookeeper 服务器上保存元数据
ZK 数据和日志文件应位于磁盘上,与其他 I/O 活动的争用最少。理想情况下,ZK 数据和 ZK 事务日志文件应该在不同的磁盘上,这样它们就不会争用 IO 资源。
请注意,仅仅有分区是不够的,它们必须是不同的磁盘以确保性能。
那么zookeeper服务器一定要用SSD盘吗?
如果是,动物园磁盘作为 IO 等的最低要求是什么?
Confluent 在生产环境中 运行 Zookeeper 推荐以下配置:
Disks
Disk performance is vital to maintaining a healthy ZooKeeper cluster. Solid state drives (SSD) are highly recommended as ZooKeeper must have low latency disk writes in order to perform optimally. Each request to ZooKeeper must be committed to to disk on each server in the quorum before the result is available for read. A dedicated SSD of at least 64 GB in size on each ZooKeeper server is recommended for a production deployment. You can use autopurge.purgeInterval and autopurge.snapRetainCount to automatically cleanup ZooKeeper data and lower maintenance overhead.