为什么 Dataflow 工作人员不尊重新的悉尼地区?
Why are the Dataflow workers not honouring the new Sydney region?
我正在尝试将我的 Dataflow (Java SDK 2.0.0) 管道的区域设置为 australia-southeast1-a
、australia-southeast1-b
或 australia-southeast1-c
之一(即悉尼的其中一个地区):
public static void main(String... args) {
DataflowPipelineOptions options = PipelineOptionsFactory
.fromArgs(args)
.withValidation()
.as(DataflowPipelineOptions.class);
options.setRunner(DataflowRunner.class);
options.setJobName("sydney-dataflow-pipeline");
options.setStagingLocation("gs://<redacted>/jars");
options.setTempLocation("gs://<redacted>/jars");
options.setRegion("australia-southeast1-a"); //<<--trying to set region to Sydney
options.setMaxNumWorkers(3);
Pipeline pipeline = Pipeline.create(options);
pipeline.apply
[..]
pipeline.run(); //run it
}
但是,工作池中的 GCE 实例在美国区域 (us-central1-f
) 中不断增加:
为什么指定区域的worker没有启动?
Javadoc 将此方法列为 @Hidden
和 @Experimental
,并附注:
"The Cloud Dataflow service does not yet honor this setting. However,
once service support is added then users of this SDK will be able to
control the region."
setZone
方法仍可用于控制工作人员位置。
我正在尝试将我的 Dataflow (Java SDK 2.0.0) 管道的区域设置为 australia-southeast1-a
、australia-southeast1-b
或 australia-southeast1-c
之一(即悉尼的其中一个地区):
public static void main(String... args) {
DataflowPipelineOptions options = PipelineOptionsFactory
.fromArgs(args)
.withValidation()
.as(DataflowPipelineOptions.class);
options.setRunner(DataflowRunner.class);
options.setJobName("sydney-dataflow-pipeline");
options.setStagingLocation("gs://<redacted>/jars");
options.setTempLocation("gs://<redacted>/jars");
options.setRegion("australia-southeast1-a"); //<<--trying to set region to Sydney
options.setMaxNumWorkers(3);
Pipeline pipeline = Pipeline.create(options);
pipeline.apply
[..]
pipeline.run(); //run it
}
但是,工作池中的 GCE 实例在美国区域 (us-central1-f
) 中不断增加:
为什么指定区域的worker没有启动?
Javadoc 将此方法列为 @Hidden
和 @Experimental
,并附注:
"The Cloud Dataflow service does not yet honor this setting. However, once service support is added then users of this SDK will be able to control the region."
setZone
方法仍可用于控制工作人员位置。