在不关闭集群的情况下增加我的 EMR 主节点容量的解决方案
A solution to increase my EMR master node capacity without shutting down the cluster
我的 EMR 主节点已经满了,我需要给它附加一些 ESB 卷,有什么办法可以在不终止集群的情况下做到这一点吗?
我不这么认为。这是因为您在集群启动时设置了Amazon Elastic Block Store (Amazon EBS) 卷并配置了挂载点,因此集群运行后很难修改存储容量。
The feasible solutions usually involve adding more nodes to your
cluster, backing up your data to a data lake, and then launching a new
cluster with a higher storage capacity. Or, if the data that occupies
the storage is expendable, removing the excess data is usually the way
to go.
详情请看:https://aws.amazon.com/blogs/big-data/dynamically-scale-up-storage-on-amazon-emr-clusters/
您可以添加额外的 EBS 卷并调整大小
这里如何解释:
https://superuser.com/questions/1409373/how-to-add-an-ebs-volume-by-snapshot-id-to-amazon-emr
https://github.com/qyjohn/AWS_Tutorials/wiki/Grow-EBS-volumes-on-EMR-clusters
我的 EMR 主节点已经满了,我需要给它附加一些 ESB 卷,有什么办法可以在不终止集群的情况下做到这一点吗?
我不这么认为。这是因为您在集群启动时设置了Amazon Elastic Block Store (Amazon EBS) 卷并配置了挂载点,因此集群运行后很难修改存储容量。
The feasible solutions usually involve adding more nodes to your cluster, backing up your data to a data lake, and then launching a new cluster with a higher storage capacity. Or, if the data that occupies the storage is expendable, removing the excess data is usually the way to go.
详情请看:https://aws.amazon.com/blogs/big-data/dynamically-scale-up-storage-on-amazon-emr-clusters/
您可以添加额外的 EBS 卷并调整大小
这里如何解释:
https://superuser.com/questions/1409373/how-to-add-an-ebs-volume-by-snapshot-id-to-amazon-emr
https://github.com/qyjohn/AWS_Tutorials/wiki/Grow-EBS-volumes-on-EMR-clusters