DC/OS 上的 HDFS 关闭端口 22。无法在任何 HDFS 节点上使用 SSH
HDFS on DC/OS closes port 22. Cannot SSH on any of the HDFS nodes
我已经在我的 10 台核心 OS 机器(3 个主节点,7 个代理节点)的 dcos 集群上安装了来自 universe 的 HDFS。我的 HA HDFS 配置有 2 个名称节点、3 个日志节点和 5 个数据节点。在 long 运行 中,HDFS 所在的代理节点 运行ning - 所有这些节点,无论它们是名称节点、日志节点还是数据节点 - 都关闭了它们的端口 22,所以我无法通过 ssh 进入它们,而 HDFS 未 运行ning 的节点保持其端口 22 打开。关于为什么会发生或我应该寻找什么来理解为什么会发生的任何想法?
这里是集群代理节点上 运行ning nmap 之后的日志。节点 13 和 16 没有 HDFS 角色,并保持其 22 端口打开。安装了 HDFS 的所有其他节点都关闭了端口 22。
root@svr-17:/home/andreab# nmap svc-10.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:37 GMT
Nmap scan report for svc-10.dc01 (192.168.111.70)
Host is up (0.00061s latency).
Not shown: 997 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9000/tcp open cslistener
9003/tcp open unknown
MAC Address: 52:54:00:DE:8E:96 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.72 seconds
root@svr-17:/home/andreab# nmap svc-11.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-11.dc01 (192.168.111.71)
Host is up (0.00084s latency).
Not shown: 996 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9001/tcp open tor-orport
9002/tcp open dynamid
9003/tcp open unknown
MAC Address: 52:54:00:31:1A:E9 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.70 seconds
root@svr-17:/home/andreab# nmap svc-12.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-12.dc01 (192.168.111.72)
Host is up (0.00082s latency).
Not shown: 996 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9001/tcp open tor-orport
9002/tcp open dynamid
9003/tcp open unknown
MAC Address: 52:54:00:D9:B4:F7 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.69 seconds
root@svr-17:/home/andreab# nmap svc-13.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-13.dc01 (192.168.111.73)
Host is up (0.00025s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
22/tcp open ssh
5051/tcp open ida-agent
MAC Address: 52:54:00:43:96:45 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.69 seconds
root@svr-17:/home/andreab# nmap svc-14.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-14.dc01 (192.168.111.74)
Host is up (0.00029s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9003/tcp open unknown
MAC Address: 52:54:00:77:9D:2E (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.70 seconds
root@svr-17:/home/andreab# nmap svc-15.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:39 GMT
Nmap scan report for svc-15.dc01 (192.168.111.75)
Host is up (0.00020s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9003/tcp open unknown
MAC Address: 52:54:00:B9:03:FA (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 23.51 seconds
root@svr-17:/home/andreab# nmap svc-16.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:39 GMT
Nmap scan report for svc-16.dc01 (192.168.111.76)
Host is up (0.00065s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
22/tcp open ssh
5051/tcp open ida-agent
MAC Address: 52:54:00:E8:D6:07 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.72 seconds
正如我对 的回答中提到的:
在 DC/OS 的 Universe HDFS 包的错误版本中发现了问题。 DC/OS 的全新 HDFS 软件包将在接下来的几周内在 Universe 上发布。
https://dcos-community.slack.com/archives/data-services/p1485717889001709
https://dcos-community.slack.com/archives/data-services/p1485801481001734
我已经在我的 10 台核心 OS 机器(3 个主节点,7 个代理节点)的 dcos 集群上安装了来自 universe 的 HDFS。我的 HA HDFS 配置有 2 个名称节点、3 个日志节点和 5 个数据节点。在 long 运行 中,HDFS 所在的代理节点 运行ning - 所有这些节点,无论它们是名称节点、日志节点还是数据节点 - 都关闭了它们的端口 22,所以我无法通过 ssh 进入它们,而 HDFS 未 运行ning 的节点保持其端口 22 打开。关于为什么会发生或我应该寻找什么来理解为什么会发生的任何想法?
这里是集群代理节点上 运行ning nmap 之后的日志。节点 13 和 16 没有 HDFS 角色,并保持其 22 端口打开。安装了 HDFS 的所有其他节点都关闭了端口 22。
root@svr-17:/home/andreab# nmap svc-10.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:37 GMT
Nmap scan report for svc-10.dc01 (192.168.111.70)
Host is up (0.00061s latency).
Not shown: 997 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9000/tcp open cslistener
9003/tcp open unknown
MAC Address: 52:54:00:DE:8E:96 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.72 seconds
root@svr-17:/home/andreab# nmap svc-11.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-11.dc01 (192.168.111.71)
Host is up (0.00084s latency).
Not shown: 996 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9001/tcp open tor-orport
9002/tcp open dynamid
9003/tcp open unknown
MAC Address: 52:54:00:31:1A:E9 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.70 seconds
root@svr-17:/home/andreab# nmap svc-12.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-12.dc01 (192.168.111.72)
Host is up (0.00082s latency).
Not shown: 996 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9001/tcp open tor-orport
9002/tcp open dynamid
9003/tcp open unknown
MAC Address: 52:54:00:D9:B4:F7 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.69 seconds
root@svr-17:/home/andreab# nmap svc-13.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-13.dc01 (192.168.111.73)
Host is up (0.00025s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
22/tcp open ssh
5051/tcp open ida-agent
MAC Address: 52:54:00:43:96:45 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.69 seconds
root@svr-17:/home/andreab# nmap svc-14.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:38 GMT
Nmap scan report for svc-14.dc01 (192.168.111.74)
Host is up (0.00029s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9003/tcp open unknown
MAC Address: 52:54:00:77:9D:2E (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.70 seconds
root@svr-17:/home/andreab# nmap svc-15.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:39 GMT
Nmap scan report for svc-15.dc01 (192.168.111.75)
Host is up (0.00020s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
5051/tcp open ida-agent
9003/tcp open unknown
MAC Address: 52:54:00:B9:03:FA (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 23.51 seconds
root@svr-17:/home/andreab# nmap svc-16.dc01
Starting Nmap 6.47 ( http://nmap.org ) at 2017-01-29 11:39 GMT
Nmap scan report for svc-16.dc01 (192.168.111.76)
Host is up (0.00065s latency).
Not shown: 998 closed ports
PORT STATE SERVICE
22/tcp open ssh
5051/tcp open ida-agent
MAC Address: 52:54:00:E8:D6:07 (QEMU Virtual NIC)
Nmap done: 1 IP address (1 host up) scanned in 1.72 seconds
正如我对
在 DC/OS 的 Universe HDFS 包的错误版本中发现了问题。 DC/OS 的全新 HDFS 软件包将在接下来的几周内在 Universe 上发布。
https://dcos-community.slack.com/archives/data-services/p1485717889001709
https://dcos-community.slack.com/archives/data-services/p1485801481001734