如何在 Amazon EC2 或 SageMaker 上安装 Vowpal Wabbit？ （亚马逊 linux）
How to install Vowpal Wabbit on Amazon EC2 or SageMaker? (amazon linux)
有人可以解释或帮助我在 Amazon linux 机器上安装 vowpalwabbit（我对 python 绑定感兴趣），EC2 或 SageMaker？
出于某种原因，它很难，我在网上找不到任何关于它的信息...
一个pip install vowpalwabbitreturns一个
Using cached https://files.pythonhosted.org/packages/d1/5a/9fcd64fd52ad22e2d1821b2ef871e8783c324b37e2103e7ddefa776c2ed7/vowpalwabbit-8.8.0.tar.gz
Building wheels for collected packages: vowpalwabbit
Building wheel for vowpalwabbit (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/ec2-user/anaconda3/envs/JupyterSystemEnv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0]= '"'"'/tmp/pip-install-tvp1174t/vowpalwabbit/setup.py'"'"'; __file__='"'"'/tmp/pip-install-tvp1174t/vowpalwabbit/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-x0j85ac_ --python-tag cp36
cwd: /tmp/pip-install-tvp1174t/vowpalwabbit/
在错误的下方我还可以看到一个：
CMake Error at /usr/lib64/python3.6/dist-packages/cmake/data/share/cmake-3.13/Modules/FindBoost.cmake:2100 (message):
Unable to find the requested Boost libraries.
Boost version: 1.53.0
Boost include path: /usr/include
Could not find the following Boost libraries:
boost_python3
Some (but not all) of the required Boost libraries were found. You may
need to install these additional Boost libraries. Alternatively, set
BOOST_LIBRARYDIR to the directory containing Boost libraries or BOOST_ROOT
to the location of Boost.
看起来好像 SageMaker VW Docker 图像已经安装了 Python 绑定。参见 here。
根据他们的container repo，图像是：
462105765813.dkr.ecr.<region>.amazonaws.com/sagemaker-rl-vw-container:vw-8.7.0-cpu
1.5 年后再次测试，pip install vowpalwabbit 在笔记本实例上运行良好。在训练作业中，在 requirements.txt 发送到 AWS 管理的 Scikit 学习容器 (141502667606.dkr.ecr.eu-west-1.amazonaws.com/sagemaker-scikit-learn:0.23-1-cpu-py3) 中添加 vowpalwabbit 也安装成功。两者均使用 vowpalwabbit-8.11.0
进行了测试
有人可以解释或帮助我在 Amazon linux 机器上安装 vowpalwabbit（我对 python 绑定感兴趣），EC2 或 SageMaker？ 出于某种原因，它很难，我在网上找不到任何关于它的信息...
一个pip install vowpalwabbitreturns一个
Using cached https://files.pythonhosted.org/packages/d1/5a/9fcd64fd52ad22e2d1821b2ef871e8783c324b37e2103e7ddefa776c2ed7/vowpalwabbit-8.8.0.tar.gz
Building wheels for collected packages: vowpalwabbit
Building wheel for vowpalwabbit (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/ec2-user/anaconda3/envs/JupyterSystemEnv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0]= '"'"'/tmp/pip-install-tvp1174t/vowpalwabbit/setup.py'"'"'; __file__='"'"'/tmp/pip-install-tvp1174t/vowpalwabbit/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-x0j85ac_ --python-tag cp36
cwd: /tmp/pip-install-tvp1174t/vowpalwabbit/
在错误的下方我还可以看到一个：
CMake Error at /usr/lib64/python3.6/dist-packages/cmake/data/share/cmake-3.13/Modules/FindBoost.cmake:2100 (message):
Unable to find the requested Boost libraries.
Boost version: 1.53.0
Boost include path: /usr/include
Could not find the following Boost libraries:
boost_python3
Some (but not all) of the required Boost libraries were found. You may
need to install these additional Boost libraries. Alternatively, set
BOOST_LIBRARYDIR to the directory containing Boost libraries or BOOST_ROOT
to the location of Boost.
看起来好像 SageMaker VW Docker 图像已经安装了 Python 绑定。参见 here。
根据他们的container repo，图像是：
462105765813.dkr.ecr.<region>.amazonaws.com/sagemaker-rl-vw-container:vw-8.7.0-cpu
1.5 年后再次测试，pip install vowpalwabbit 在笔记本实例上运行良好。在训练作业中，在 requirements.txt 发送到 AWS 管理的 Scikit 学习容器 (141502667606.dkr.ecr.eu-west-1.amazonaws.com/sagemaker-scikit-learn:0.23-1-cpu-py3) 中添加 vowpalwabbit 也安装成功。两者均使用 vowpalwabbit-8.11.0