dask 分布式:如何增加工作连接的超时时间? connect() 没有及时完成
dask distributed: How to increase timeout for worker connections? connect() didn't finish in time
OSError: Timed out trying to connect to 'tcp://127.0.0.1:40475' after 10 s: Timed out trying to connect to 'tcp:// 8.56.11:40475' after 10 s: connect() didn't finish in time
有一些巨大的操作 运行,我想使用 Convertion Tool 增加超时。但是我想知道,这里真正使用了哪个配置选项?
我试过了:
os.environ["DASK_DISTRIBUTED__COMM__TIMEOUTS__CONNECT"] = "33s"
os.environ["DASK_DISTRIBUTED__COMM__TIMEOUTS__TCP"] = "35s"
os.environ["DASK_DISTRIBUTED__DEPLOY__LOST_WORKER"] = "34s"
但没有效果(还有10秒超时。
答案在~/.dask/config.yaml
:
# Communication options
connect-timeout: 10 # seconds delay before connecting fails
tcp-timeout: 30 # seconds delay before calling an unresponsive connection dead
default-scheme: tcp
来自 dask 文档:https://docs.dask.org/en/latest/configuration.html
已接受的答案现已过时 - 支持使用 ~/.dask/config.yml
已弃用。
OSError: Timed out trying to connect to 'tcp://127.0.0.1:40475' after 10 s: Timed out trying to connect to 'tcp:// 8.56.11:40475' after 10 s: connect() didn't finish in time
有一些巨大的操作 运行,我想使用 Convertion Tool 增加超时。但是我想知道,这里真正使用了哪个配置选项?
我试过了:
os.environ["DASK_DISTRIBUTED__COMM__TIMEOUTS__CONNECT"] = "33s"
os.environ["DASK_DISTRIBUTED__COMM__TIMEOUTS__TCP"] = "35s"
os.environ["DASK_DISTRIBUTED__DEPLOY__LOST_WORKER"] = "34s"
但没有效果(还有10秒超时。
答案在~/.dask/config.yaml
:
# Communication options
connect-timeout: 10 # seconds delay before connecting fails
tcp-timeout: 30 # seconds delay before calling an unresponsive connection dead
default-scheme: tcp
来自 dask 文档:https://docs.dask.org/en/latest/configuration.html
已接受的答案现已过时 - 支持使用 ~/.dask/config.yml
已弃用。