sql airflow initdb 上的 Alchemy 连接终止

Question

我正在使用 Airflow v1.9.0 和 Python 3.5.2。
我有一个运行暂存和生产环境，它工作正常。
我也在本地 Ubuntu 机器上使用它，它工作正常。
最近我从原来的 Ubuntu 18 切换到 MacOS 10.15.2。

问题

当我执行 $airflow initdb 或 $airflow upgradedb 时，我得到这个混乱的 SQL Alchemy 错误。

Traceback (most recent call last):
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/bin/airflow", line 27, in <module>
    args.func(args)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/airflow/bin/cli.py", line 897, in initdb
    db_utils.initdb()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/airflow/utils/db.py", line 103, in initdb
    upgradedb()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/airflow/utils/db.py", line 320, in upgradedb
    command.upgrade(config, 'heads')
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/alembic/command.py", line 174, in upgrade
    script.run_env()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/alembic/script/base.py", line 416, in run_env
    util.load_python_file(self.dir, 'env.py')
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/alembic/util/pyfiles.py", line 93, in load_python_file
    module = load_module_py(module_id, path)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/alembic/util/compat.py", line 68, in load_module_py
    module_id, path).load_module(module_id)
  File "<frozen importlib._bootstrap_external>", line 388, in _check_name_wrapper
  File "<frozen importlib._bootstrap_external>", line 809, in load_module
  File "<frozen importlib._bootstrap_external>", line 668, in load_module
  File "<frozen importlib._bootstrap>", line 268, in _load_module_shim
  File "<frozen importlib._bootstrap>", line 693, in _load
  File "<frozen importlib._bootstrap>", line 673, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 665, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/airflow/migrations/env.py", line 86, in <module>
    run_migrations_online()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/airflow/migrations/env.py", line 73, in run_migrations_online
    with connectable.connect() as connection:
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 2102, in connect
    return self._connection_cls(self, **kwargs)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 90, in __init__
    if connection is not None else engine.raw_connection()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 2188, in raw_connection
    self.pool.unique_connection, _connection)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 2162, in _wrap_pool_connect
    e, dialect, self)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 1476, in _handle_dbapi_exception_noconnection
    exc_info
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/util/compat.py", line 265, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/util/compat.py", line 248, in reraise
    raise value.with_traceback(tb)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/base.py", line 2158, in _wrap_pool_connect
    return fn()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 342, in unique_connection
    return _ConnectionFairy._checkout(self)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 788, in _checkout
    fairy = _ConnectionRecord.checkout(pool)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 529, in checkout
    rec = pool._do_get()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 1193, in _do_get
    self._dec_overflow()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
    compat.reraise(exc_type, exc_value, exc_tb)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/util/compat.py", line 249, in reraise
    raise value
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 1190, in _do_get
    return self._create_connection()
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 347, in _create_connection
    return _ConnectionRecord(self)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 474, in __init__
    self.__connect(first_connect_check=True)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/pool.py", line 671, in __connect
    connection = pool._invoke_creator(self)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/strategies.py", line 106, in connect
    return dialect.connect(*cargs, **cparams)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/sqlalchemy/engine/default.py", line 412, in connect
    return self.dbapi.connect(*cargs, **cparams)
  File "/Users/userabc/.pyenv/versions/3.5.2/envs/vmds/lib/python3.5/site-packages/psycopg2/__init__.py", line 130, in connect
    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) server closed the connection unexpectedly
    This probably means the server terminated abnormally
    before or while processing the request.
 (Background on this error at: http://sqlalche.me/e/e3q8)

配置

当我做

$ grep sql_alchemy_conn $AIRFLOW_HOME/airflow.cfg

我可以在我的终端上看到这个输出

sql_alchemy_conn=postgresql://airflow-user:airflow-pwd@localhost/airflow-db

我什至可以使用 DataGrip.

根据连接字符串中提到的凭据连接到此数据库

已检查

我做到了

$brew services list | grep postgres

而且我可以看到服务运行很好

postgresql started saadali /Users/userabc/Library/LaunchAgents/homebrew.mxcl.postgresql.plist

只是仔细检查一下，即使它是运行这就是我能够通过 Datagrip 连接的原因。
我究竟做错了什么？ MacOS 有什么不同吗？

Note: 2/3 days ago I set airflow up with the same settings on a colleague's MacOS and there no such error occurred, although I am not sure what his MacOS version was.

Answer 1

我的防病毒软件运行阻止了端口。关闭防火墙对我有用。

sql airflow initdb 上的 Alchemy 连接终止

sql alchemy connection termination on airflow initdb

python

macos

sqlalchemy

python-3.5

airflow

问题

配置

已检查