modin 显示一条警告消息 "Perhaps you already have a cluster running?"

Question

我正在使用 modin 读取 sql table，但是我收到此警告

    import pyodbc
    import sqlalchemy as sal
    from sqlalchemy import create_engine
    import modin.pandas as pd
    from distributed import Client
    client = Client()

   UserWarning: Port 8787 is already in use.
   Perhaps you already have a cluster running?
   Hosting the HTTP server on port 57475 instead

我是使用 modin 的新手，无法弄清楚发生了什么，Jupyter Lab 变慢了 5 分钟，然后加载了数据帧，任何 Suggestions/Recommendations ?

Answer 1

您似乎正在使用 Modin，其中在导入时正在进行引擎初始化，即此时 import modin.pandas as pd。之后您不需要自己创建 dask 客户端，因为 dask 环境已经初始化。但是如果你想自己创建dask客户端，你只需要移动一些行：

import pyodbc
import sqlalchemy as sal
from sqlalchemy import create_engine
from distributed import Client
client = Client()
import modin.pandas as pd # Modin will connect to current dask environment

这有意义吗？

modin 显示一条警告消息 "Perhaps you already have a cluster running?"

modin shown a warning message "Perhaps you already have a cluster running?"

python

pandas

sqlalchemy

modin