Dataproc 返回未找到 StatusRuntimeException 集群

Question

我正在向使用 gcloud Dataproc 重新编制索引的 API 发送请求。我正在发送一个正在给我回复的请求

io.grpc.StatusRuntimeException: NOT_FOUND: 未找到: 集群 projects/go-dev-central/regions/us-central1/clusters/cluster-156c

gcloud 的新手不知道我应该研究哪里。会不会是regional/zone的问题。

Suppressed: com.google.api.gax.rpc.AsyncTaskException: Asynchronous task failed
        at com.google.api.gax.rpc.ApiExceptions.callAndTranslateApiException(ApiExceptions.java:57)
        at com.google.api.gax.rpc.UnaryCallable.call(UnaryCallable.java:112)
        at com.google.cloud.dataproc.v1.JobControllerClient.submitJob(JobControllerClient.java:210)
        at com.google.cloud.dataproc.v1.JobControllerClient.submitJob(JobControllerClient.java:183)
        at com.carecloud.edison.commons.providers.gcp.GoogleDataProcProvider.$anonfun$submitDataProcJob(GoogleDataProcProvider.scala:59)
        at com.carecloud.edison.commons.providers.gcp.GoogleDataProcProvider.withJobControllerClientSync(GoogleDataProcProvider.scala:39)
        at com.carecloud.edison.commons.providers.gcp.GoogleDataProcProvider.$anonfun$withJobControllerClient(GoogleDataProcProvider.scala:27)
        at scala.concurrent.Future$.$anonfun$apply(Future.scala:658)
        at scala.util.Success.$anonfun$map(Try.scala:255)
        at scala.util.Success.map(Try.scala:213)
Caused by: io.grpc.StatusRuntimeException: NOT_FOUND: Not found: Cluster projects/go-dev-central/regions/us-central1/clusters/cluster-156c
    at io.grpc.Status.asRuntimeException(Status.java:533)
    at io.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:490)
    at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
    at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
    at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
    at io.grpc.internal.CensusStatsModule$StatsClientInterceptor.onClose(CensusStatsModule.java:700)
    at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
    at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
    at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
    at io.grpc.internal.CensusTracingModule$TracingClientInterceptor.onClose(CensusTracingModule.java:399)
2020-08-31 04:33:49,568 [ERROR] c.ReindexController - General Service Error: io.grpc.StatusRuntimeException: NOT_FOUND: Not found: Cluster projects/go-dev-central/regions/us-central1/clusters/cluster-156c

Answer 1

最可能的解释是您使用单独的“全球”多区域创建集群，即使您将其放置在 us-central1 内的 GCE 区域中，同时您已将代码配置为使用“us -central1" 区域 Dataproc 宇宙。

有关差异的更多详细信息，请参阅 https://cloud.google.com/dataproc/docs/concepts/regional-endpoints。高层是“global”是一个独立的Dataproc universe，就像“us-central1”、“europe-west1”等不同区域的universe；他们都是彼此孤立的。

如果查看 Cloud Console 中的“集群”列表页面，您可以看到您的集群所在的集群，因为应该有一列指示正在使用的 Dataproc 区域。

Dataproc 返回未找到 StatusRuntimeException 集群

Dataproc returning StatusRuntimeException cluster not found

scala

apache-spark

gcloud

google-cloud-dataproc

data-processing