Docker 运行 在容器化应用程序之前启动代理时挂起
Docker run hangs when starting provixy prior to containerized app
我有一个 python FastAPI 应用程序，它 运行 在 GKE 上的 Kubernetes 集群中。我试图让容器 (pods) 的出站流量通过 privoxy 路由。为了测试这个，我 building/running 我本地机器上的容器，但是当我 运行 docker run -p 8080:8080 privoxy 命令时，我得到以下挂在最后一行的 output/log ：
2020-09-08 13:32:15.342 7fb59e36de80 Info: Privoxy version 3.0.26
2020-09-08 13:32:15.342 7fb59e36de80 Info: Program name: privoxy
2020-09-08 13:32:15.344 7fb59e36de80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Listening on port 8118 on IP address 0.0.0.0
我的问题是，“我怎样才能在 Docker 容器内启动 privoxy 在 运行 时间然后 运行 我的应用程序（使用 privoxy）没有 privoxy 挂起或抛出错误？
我的 Docker 文件看起来像这样：
FROM continuumio/miniconda3:4.6.14
# ...
# Install Privoxy
RUN set -xe \
&& apt-get update \
&& apt-get install -y privoxy \
&& curl -sSL https://github.com/tianon/gosu/releases/download/1.9/gosu-amd64 > /usr/sbin/gosu \
&& chmod +x /usr/sbin/gosu
RUN sed -i -e '/^listen-address \[/s/listen-address/#listen-address/' \
-e '/^enforce-blocks/s/0/1/' \
-e '/^#debug/s/#//' /etc/privoxy/config
VOLUME /etc/privoxy
EXPOSE 8118
# Install Firefox
RUN apt-get update && \
apt-get -y install firefox-esr
# Install Geckodriver
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.24.0/geckodriver-v0.24.0-linux64.tar.gz && \
tar xzf geckodriver-v0.24.0-linux64.tar.gz && \
mv geckodriver /usr/bin/geckodriver
# ...
CMD start.sh
start.sh 看起来像这样：
#!/usr/bin/env bash
gosu privoxy privoxy --no-daemon /etc/privoxy/config
cd /code
python app.py
当我启动 webdriver/Selenium 我使用这个功能：
from selenium import webdriver
from selenium.webdriver.firefox.options import Options as FFOptions
from selenium.webdriver.firefox.webdriver import WebDriver as FirefoxWebDriver
def get_container_firefox_driver(windows_mask: bool=True):
# create a new FireFox session
os.environ['MOZ_FORCE_DISABLE_E10S'] = '1'
ff_options = FFOptions()
ff_options.add_argument('-new-instance')
ff_options.add_argument('-headless')
ff_profile = webdriver.FirefoxProfile()
# set some privacy settings
ff_profile.set_preference("places.history.enabled", False)
ff_profile.set_preference("privacy.clearOnShutdown.offlineApps", True)
ff_profile.set_preference("privacy.clearOnShutdown.passwords", True)
ff_profile.set_preference("privacy.clearOnShutdown.siteSettings", True)
ff_profile.set_preference("privacy.sanitize.sanitizeOnShutdown", True)
ff_profile.set_preference("signon.rememberSignons", False)
ff_profile.set_preference("network.cookie.lifetimePolicy", 2)
ff_profile.set_preference("network.dns.disablePrefetch", True)
ff_profile.set_preference("network.http.sendRefererHeader", 0)
# set socks proxy
ff_profile.set_preference("network.proxy.type", 1)
ff_profile.set_preference("network.proxy.socks_version", 5)
ff_profile.set_preference("network.proxy.socks", '127.0.0.1')
ff_profile.set_preference("network.proxy.socks_port", 8118)
ff_profile.set_preference("network.proxy.socks_remote_dns", True)
# get a speed increase by not downloading images
ff_profile.set_preference("permissions.default.image", 2)
driver = webdriver.Firefox(
firefox_profile=ff_profile,
options=ff_options,
executable_path="/usr/bin/geckodriver",
)
return driver
其他尝试
我也尝试过在 Docker 文件中使用 sed 命令不注释掉 privoxy 配置文件的 listen-address [::1]:8118 行：
RUN sed -i -e '/^enforce-blocks/s/0/1/' \
-e '/^#debug/s/#//' /etc/privoxy/config
...但是当我这样做时，当 privoxy 在容器中启动时出现以下“致命错误”：
2020-09-08 14:21:16.844 7fa4d8646e80 Info: Privoxy version 3.0.26
2020-09-08 14:21:16.844 7fa4d8646e80 Info: Program name: privoxy
2020-09-08 14:21:16.845 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 14:21:16.849 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 14:21:16.850 7fa4d8646e80 Info: Listening on port 8118 on IP address 127.0.0.1
2020-09-08 14:21:16.850 7fa4d8646e80 Fatal error: can't bind to ::1:8118: Cannot assign requested address
根据所使用的操作系统，privoxy 的启动命令不正确。根据 privoxy startup manual，对于 debian linux OS，启动命令应该是 /etc/init.d/privoxy start --no-daemon。此外，此命令之前的 gosu 命令不是必需的，并且会导致 privoxy 启动崩溃。 start.sh 应如下所示：
#!/usr/bin/env bash
/etc/init.d/privoxy start --no-daemon
cd /code
python app.py
用 RUN sed -i -e '/^listen-address \[/s/listen-address/#listen-address/ ... 注释掉 listen-address [::1]:8118 行可以防止在 privoxy 启动期间出现致命错误，因此应该使用它。
我有一个 python FastAPI 应用程序，它 运行 在 GKE 上的 Kubernetes 集群中。我试图让容器 (pods) 的出站流量通过 privoxy 路由。为了测试这个，我 building/running 我本地机器上的容器，但是当我 运行 docker run -p 8080:8080 privoxy 命令时，我得到以下挂在最后一行的 output/log ：
2020-09-08 13:32:15.342 7fb59e36de80 Info: Privoxy version 3.0.26
2020-09-08 13:32:15.342 7fb59e36de80 Info: Program name: privoxy
2020-09-08 13:32:15.344 7fb59e36de80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Listening on port 8118 on IP address 0.0.0.0
我的问题是，“我怎样才能在 Docker 容器内启动 privoxy 在 运行 时间然后 运行 我的应用程序（使用 privoxy）没有 privoxy 挂起或抛出错误？
我的 Docker 文件看起来像这样：
FROM continuumio/miniconda3:4.6.14
# ...
# Install Privoxy
RUN set -xe \
&& apt-get update \
&& apt-get install -y privoxy \
&& curl -sSL https://github.com/tianon/gosu/releases/download/1.9/gosu-amd64 > /usr/sbin/gosu \
&& chmod +x /usr/sbin/gosu
RUN sed -i -e '/^listen-address \[/s/listen-address/#listen-address/' \
-e '/^enforce-blocks/s/0/1/' \
-e '/^#debug/s/#//' /etc/privoxy/config
VOLUME /etc/privoxy
EXPOSE 8118
# Install Firefox
RUN apt-get update && \
apt-get -y install firefox-esr
# Install Geckodriver
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.24.0/geckodriver-v0.24.0-linux64.tar.gz && \
tar xzf geckodriver-v0.24.0-linux64.tar.gz && \
mv geckodriver /usr/bin/geckodriver
# ...
CMD start.sh
start.sh 看起来像这样：
#!/usr/bin/env bash
gosu privoxy privoxy --no-daemon /etc/privoxy/config
cd /code
python app.py
当我启动 webdriver/Selenium 我使用这个功能：
from selenium import webdriver
from selenium.webdriver.firefox.options import Options as FFOptions
from selenium.webdriver.firefox.webdriver import WebDriver as FirefoxWebDriver
def get_container_firefox_driver(windows_mask: bool=True):
# create a new FireFox session
os.environ['MOZ_FORCE_DISABLE_E10S'] = '1'
ff_options = FFOptions()
ff_options.add_argument('-new-instance')
ff_options.add_argument('-headless')
ff_profile = webdriver.FirefoxProfile()
# set some privacy settings
ff_profile.set_preference("places.history.enabled", False)
ff_profile.set_preference("privacy.clearOnShutdown.offlineApps", True)
ff_profile.set_preference("privacy.clearOnShutdown.passwords", True)
ff_profile.set_preference("privacy.clearOnShutdown.siteSettings", True)
ff_profile.set_preference("privacy.sanitize.sanitizeOnShutdown", True)
ff_profile.set_preference("signon.rememberSignons", False)
ff_profile.set_preference("network.cookie.lifetimePolicy", 2)
ff_profile.set_preference("network.dns.disablePrefetch", True)
ff_profile.set_preference("network.http.sendRefererHeader", 0)
# set socks proxy
ff_profile.set_preference("network.proxy.type", 1)
ff_profile.set_preference("network.proxy.socks_version", 5)
ff_profile.set_preference("network.proxy.socks", '127.0.0.1')
ff_profile.set_preference("network.proxy.socks_port", 8118)
ff_profile.set_preference("network.proxy.socks_remote_dns", True)
# get a speed increase by not downloading images
ff_profile.set_preference("permissions.default.image", 2)
driver = webdriver.Firefox(
firefox_profile=ff_profile,
options=ff_options,
executable_path="/usr/bin/geckodriver",
)
return driver
其他尝试
我也尝试过在 Docker 文件中使用 sed 命令不注释掉 privoxy 配置文件的 listen-address [::1]:8118 行：
RUN sed -i -e '/^enforce-blocks/s/0/1/' \
-e '/^#debug/s/#//' /etc/privoxy/config
...但是当我这样做时，当 privoxy 在容器中启动时出现以下“致命错误”：
2020-09-08 14:21:16.844 7fa4d8646e80 Info: Privoxy version 3.0.26
2020-09-08 14:21:16.844 7fa4d8646e80 Info: Program name: privoxy
2020-09-08 14:21:16.845 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 14:21:16.849 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 14:21:16.850 7fa4d8646e80 Info: Listening on port 8118 on IP address 127.0.0.1
2020-09-08 14:21:16.850 7fa4d8646e80 Fatal error: can't bind to ::1:8118: Cannot assign requested address
根据所使用的操作系统，privoxy 的启动命令不正确。根据 privoxy startup manual，对于 debian linux OS，启动命令应该是 /etc/init.d/privoxy start --no-daemon。此外，此命令之前的 gosu 命令不是必需的，并且会导致 privoxy 启动崩溃。 start.sh 应如下所示：
#!/usr/bin/env bash
/etc/init.d/privoxy start --no-daemon
cd /code
python app.py
用 RUN sed -i -e '/^listen-address \[/s/listen-address/#listen-address/ ... 注释掉 listen-address [::1]:8118 行可以防止在 privoxy 启动期间出现致命错误，因此应该使用它。