Hadoop 上的辅助名称节点 2.x (Hortonworks)

Secondary namenode on Hadoop 2.x (Hortonworks)

我在Hortonworks,cloudera学习hadoop2.x技术,发现hadoop2.x的架构中没有secondary namenode ;它被 备用名称节点 取代。

据我所知,辅助和备用都有不同的 function.standby 名称节点用于 HA 集群

针对您的问题

1.Secondary 节点未被弃用,但是如果您正在设置 HA 集群,那么您可能不需要使用辅助名称节点,因为备用名称节点保持其状态与活动名称节点同步

2.you 可以在没有辅助节点或备用节点的情况下进行 hadoop 设置而不会损失任何性能,但是如果名称节点发生故障,您的所有数据都将丢失,因为名称节点将其所有元数据存储在内存中

辅助名称节点和备用名称节点是不同的东西。

旧的 'secondary' 名称节点主要是 misnomer。它所做的只是不时检查 fsimage,以便在发生崩溃时更快地恢复真实名称节点。它绝不提供任何 standby/high 可用性功能。你应该使用这个。

新的备用名称节点是一个真正的备用、高可用性功能。在 HDFS High Availability:

阅读更多相关信息

Prior to Hadoop 2.0.0, the NameNode was a single point of failure (SPOF) in an HDFS cluster. Each cluster had a single NameNode, and if that machine or process became unavailable, the cluster as a whole would be unavailable until the NameNode was either restarted or brought up on a separate machine.

This impacted the total availability of the HDFS cluster in two major ways:

In the case of an unplanned event such as a machine crash, the cluster would be unavailable until an operator restarted the NameNode. Planned maintenance events such as software or hardware upgrades on the NameNode machine would result in windows of cluster downtime. The HDFS High Availability feature addresses the above problems by providing the option of running two redundant NameNodes in the same cluster in an Active/Passive configuration with a hot standby. This allows a fast failover to a new NameNode in the case that a machine crashes, or a graceful administrator-initiated failover for the purpose of planned maintenance.

你应该use/configure一个备用名称节点。

在当前版本(撰写本文时为 2.6)中,您有两种 HA 模式:

有关 Hortonworks 发行版的特定文档,请参阅 NameNode High Availability for Hadoop