K8S Elasticsearch集群中不同的pod如何配置不同的存储挂载？

Question

我正在使用节点组将 Elasticsearch 集群部署到 EKS 上的 K8S。我为集群的存储申请了一个 EBS。当我启动集群时，只有一个 pod 运行成功，但其他 pods:

出现此错误

 Warning  FailedAttachVolume  3m33s                  attachdetach-controller  Multi-Attach error for volume "pvc-4870bd46-2f1e-402a-acf7-005de83e4588" Volume is already used by pod(s) es-0
  Warning  FailedMount         90s                    kubelet                  Unable to attach or mount volumes: unmounted volumes=[persistent-storage], unattached volumes=[es-config persistent-storage default-token-pqzkp]: timed out waiting for the condition

表示存储空间已被占用。我知道这个卷被第一个 pod 使用，所以其他 pods 不能使用它。但是我不知道如何在不同的 pod 使用相同的 EBS 卷时使用不同的挂载路径。

下面是集群的完整规范。


apiVersion: v1
kind: ConfigMap
metadata:
  name: es-config
data:
  elasticsearch.yml: |
    cluster.name: elk-cluster
    network.host: "0.0.0.0"
    bootstrap.memory_lock: false
    # discovery.zen.minimum_master_nodes: 2
    node.max_local_storage_nodes: 9
    discovery.seed_hosts:
      - es-0.es-entrypoint.default.svc.cluster.local
      - es-1.es-entrypoint.default.svc.cluster.local
      - es-2.es-entrypoint.default.svc.cluster.local
  ES_JAVA_OPTS: -Xms4g -Xmx8g
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es
  namespace: default
spec:
  serviceName: es-entrypoint
  replicas: 3
  selector:
    matchLabels:
      name: es
  template:
    metadata:
      labels:
        name: es
    spec:
      volumes:
        - name: es-config
          configMap:
            name: es-config
            items:
              - key: elasticsearch.yml
                path: elasticsearch.yml
        - name: persistent-storage
          persistentVolumeClaim:
            claimName: ebs-claim
      initContainers:
        - name: permissions-fix
          image: busybox
          volumeMounts:
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
          command: [ 'chown' ]
          args: [ '1000:1000', '/usr/share/elasticsearch/data' ]
      containers:
        - name: es
          image: elasticsearch:7.10.1
          resources:
            requests:
              cpu: 2
              memory: 8Gi
          ports:
            - name: http
              containerPort: 9200
            - containerPort: 9300
              name: inter-node
          volumeMounts:
            - name: es-config
              mountPath: /usr/share/elasticsearch/config/elasticsearch.yml
              subPath: elasticsearch.yml
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
---
apiVersion: v1
kind: Service
metadata:
  name: es-entrypoint
spec:
  selector:
    name: es
  ports:
    - port: 9200
      targetPort: 9200
      protocol: TCP
  clusterIP: None

Answer 1

您应该将 volumeClaimTemplates 与 statefulset 一起使用，以便每个 pod 都有自己的卷。 Details:

volumeClaimTemplates:
- metadata:
    name: es
  spec:
    accessModes:
    - ReadWriteOnce
    resources:
      requests:
        storage: 5Gi
    # storageClassName: <omit to use default StorageClass or specify>

K8S Elasticsearch集群中不同的pod如何配置不同的存储挂载？

How can I configure different storage mount for different pod in Elasticsearch cluster in K8S?

elasticsearch

kubernetes

amazon-eks