Apache unable to load virtualenv properly: "ImportError: No module named 'psycopg2._psycopg'"

Apache unable to load virtualenv properly: "ImportError: No module named 'psycopg2._psycopg'"

我将我的 Django 项目从 Python 2.7 移到了 Python 3.6。

从那以后,我无法启动我的项目 & 运行,因为 Apache 抱怨如下(重启后的完整输出):

[mpm_prefork:notice] [pid 2340] AH00173: SIGHUP received.  Attempting to restart
[:notice] [pid 25019] FastCGI: process manager initialized (pid 25019)
[:warn] [pid 2340] mod_wsgi: Compiled for Python/3.4.0.
[:warn] [pid 2340] mod_wsgi: Runtime using Python/3.4.3.
[mpm_prefork:notice] [pid 2340] AH00163: Apache/2.4.7 (Ubuntu) mod_fastcgi/mod_fastcgi-SNAP-0910052141 PHP/5.5.9-1ubuntu4.21 OpenSSL/1.0.1f mod_wsgi/3.4 Python/3.4.3 configured -- resuming normal operations
[core:notice] [pid 2340] AH00094: Command line: '/usr/sbin/apache2'
[:error] [pid 25025] [client 10.0.10.117:49933] mod_wsgi (pid=25025): Target WSGI script '/home/myuser/projects/myproject/myproject_project/wsgi.py' cannot be loaded as Python module.
[:error] [pid 25025] [client 10.0.10.117:49933] mod_wsgi (pid=25025): Exception occurred processing WSGI script '/home/myuser/projects/myproject/myproject_project/wsgi.py'.
[:error] [pid 25025] [client 10.0.10.117:49933] Traceback (most recent call last):
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/projects/myproject/myproject_project/wsgi.py", line 29, in <module>
[:error] [pid 25025] [client 10.0.10.117:49933]     application = get_wsgi_application()
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/core/wsgi.py", line 13, in get_wsgi_application
[:error] [pid 25025] [client 10.0.10.117:49933]     django.setup(set_prefix=False)
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/__init__.py", line 27, in setup
[:error] [pid 25025] [client 10.0.10.117:49933]     apps.populate(settings.INSTALLED_APPS)
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/apps/registry.py", line 85, in populate
[:error] [pid 25025] [client 10.0.10.117:49933]     app_config = AppConfig.create(entry)
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/apps/config.py", line 116, in create
[:error] [pid 25025] [client 10.0.10.117:49933]     mod = import_module(mod_path)
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/usr/lib/python3.4/importlib/__init__.py", line 109, in import_module
[:error] [pid 25025] [client 10.0.10.117:49933]     return _bootstrap._gcd_import(name[level:], package, level)
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 2254, in _gcd_import
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 2237, in _find_and_load
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 2226, in _find_and_load_unlocked
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 1200, in _load_unlocked
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 1129, in _exec
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 1471, in exec_module
[:error] [pid 25025] [client 10.0.10.117:49933]   File "<frozen importlib._bootstrap>", line 321, in _call_with_frames_removed
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/contrib/postgres/apps.py", line 7, in <module>
[:error] [pid 25025] [client 10.0.10.117:49933]     from .signals import register_hstore_handler
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/contrib/postgres/signals.py", line 1, in <module>
[:error] [pid 25025] [client 10.0.10.117:49933]     from psycopg2 import ProgrammingError
[:error] [pid 25025] [client 10.0.10.117:49933]   File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/psycopg2/__init__.py", line 50, in <module>
[:error] [pid 25025] [client 10.0.10.117:49933]     from psycopg2._psycopg import (                     # noqa
[:error] [pid 25025] [client 10.0.10.117:49933] ImportError: No module named 'psycopg2._psycopg'

然而,当我尝试在 virtualenv 中手动加载问题模块 (psycopg2) 时,完全可以这样做:

(myproject-3.6)myuser@Server:$ python
Python 3.6.0 (default, Jan 13 2017, 00:00:00)
[GCC 4.8.4] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import psycopg2
>>>

我正在使用 WSGI。其文件内容如下:

import os
os.environ.setdefault("DJANGO_SETTINGS_MODULE", "my_project.settings")
from django.core.wsgi import get_wsgi_application
application = get_wsgi_application()

我的主要 Apache2 站点配置如下(还有一个用于管理/的部分):

WSGIApplicationGroup %{GLOBAL}
WSGIScriptAlias / /home/myuser/projects/myproject/myproject_project/wsgi.py
#WSGIPythonPath /home/myuser/projects/myproject:/home/myuser/.virtualenvs/myproject/local/lib/python2.7/site-packages
WSGIPythonPath /home/myuser/projects/myproject:/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages
<Directory /home/myuser/projects/myproject/myproject_project>
        SSLRequireSSL
        <Files wsgi.py>
                Order deny,allow
                Require all granted
        </Files>
</Directory>

我已经通过 apt-get 安装了 python3-psycopg2 包。当然我的 virtualenv 也安装了 psycopg2:

(myproject-3.6)myuser@Server:~/projects/$ pip freeze | grep psy
psycopg2==2.7

出了什么问题?

我正在使用 Ubuntu 14.04 LTS。

我在 Debian 8 机器上使用 Python 3.6、Apache2.4 和 WSGI 尝试 运行 我的 Django 1.11 应用程序时遇到了完全相同的问题。

问题是 libapache2-mod-wsgi-py 是为 apache2python 的特定版本编译的,它与不同的 python 版本不兼容。 当然,

  • libapache2-mod-wsgi-py 用于 python 2.7,
  • libapache2-mod-wsgi-py3 --- 对于 python3,

但较小的 python 版本也很重要。

让我们看看。在@SaeX stacktrace 中,大部分行都是关于你的 Python 3.6 venv such

...
File "/home/myuser/.virtualenvs/myproject-3.6/lib/python3.6/site-packages/django/apps/config.py", line 116, in create
...

但是有一行Python 3.4 call

...
File "/usr/lib/python3.4/importlib/__init__.py", line 109, in import_module
...

我假设在他的 OS 存储库中(当时)apt-get install python3 提供的最新 python3 版本是 3.4.napt-get install libapache2-mod-wsgi-py3 的结果mod_wsgi 是为 Python 3.4 编译的。就是这个原因。


在我的情况下,我首先在堆栈跟踪

中捕获了 python2.7
File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module'

这意味着我尝试使用 libapache2-mod-wsgi-py 而不是 libapache2-mod-wsgi-py3。但是当我安装 libapache2-mod-wsgi-py3 时,我在 stacktrace

中得到了 python3.5
File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module'

我已经用两种方法解决了这个问题,两种方法都适合我:

  1. 使用 OS;
  2. 的软件包存储库中的最新可用 python3 版本
  3. python3.6
  4. 构建 mod-wsgi

1.最新系统Python 3

@SaeX 是这样使用的:

Thanks; downgrading my venv to Python 3.4 fixed the issue

在你的情况下,最新的 Python 3 版本可能不同。

apt-get update
apt-get install python3 python3-venv

# check python3 version
python3 -V
# >>> Python 3.5.4 is for my Debian 8 in September 2017

# setting virtual environment for WSGI
python3 -m venv /home/pyvenv_354
source /home/pyvenv_354/bin/activate
# check venv and get path for WSGI
(pyvenv_354) python -c 'import sys; print(sys.prefix)'
# >>> /home/pyvenv_354

# mod_wsgi from repo must be compatible
apt install libapache2-mod-wsgi-py3

现在这个 python3.5 venv 可以用在 apache2

# sites-available/mysite.conf
...
Define WWW_ROOT /var/www/mysite/mysite
...
Define PYTHON_VENV_HOME /home/pyvenv_354
Define PYTHON_VENV_PACKAGES ${PYTHON_VENV_HOME}/lib/python3.5/site-packages
WSGIDaemonProcess mysite processes=2 python-path=${WWW_ROOT}:${PYTHON_VENV_PACKAGES}
WSGIProcessGroup mysite
WSGIScriptAlias / ${MAIN_APP_PATH}/wsgi.py

最后使用您喜欢的方式重新启动 Apache2,例如

service apache2 restart

2。为 Python 构建 mod_wsgi 3.6

我已经使用 mod_wsgi quick installation guide 来执行它。 注意: apache2-devpython-dev 软件包是必需的。

apt-get install python3.6 python3.6-dev apache2-dev
# checking Python version
python3.6 -V
# >>> 3.6.2

# set virtual environment
python3.6 -m venv /home/pyvenv_362

# download mod_wsgi sources from https://github.com/GrahamDumpleton/mod_wsgi/releases
# x, y, z --- version, select using link above
cd /usr/src/
wget https://github.com/GrahamDumpleton/mod_wsgi/archive/x.y.z.tar.gz
tar xvfz x.y.z.tar.gz
cd mod_wsgi-x.y.z

# set python3.6 venv for mod_wsgi
./configure --with-python=/home/pyvenv_362/bin/python

make
make install

# >>> Libraries have been installed in:
#   /usr/lib/apache2/modules
#   mod_wsgi.so

# adding module to apache2
cat /etc/apache2/mods-enabled/wsgi.load
nano /etc/apache2/httpd.conf
add to httpd.conf line `LoadModule wsgi_module modules/mod_wsgi.so`

现在 python3.6 venv 可以在 apache2

中使用
# sites-available/mysite.conf
...
Define WWW_ROOT /var/www/mysite/mysite
...
Define PYTHON_VENV_HOME /home/pyvenv_362
Define PYTHON_VENV_PACKAGES ${PYTHON_VENV_HOME}/lib/python3.6/site-packages
WSGIDaemonProcess mysite processes=2 python-path=${WWW_ROOT}:${PYTHON_VENV_PACKAGES}
WSGIProcessGroup mysite
WSGIScriptAlias / ${MAIN_APP_PATH}/wsgi.py

最后使用您喜欢的方式重新启动 Apache2,例如

service apache2 restart