如何运行通过 .py 传输 blob 数据

Question

我试图在我的 VM 中创建一个程序运行来实现它，这样我就可以将目录中的数据传输运行到我的 azure blob 存储帐户。每当我运行程序外的命令（在命令行上）它都会工作，但是，如果我运行包含运行命令的子进程的程序，它不会工作。

这是我通过有效的命令行发送的内容：

sudo ./azcopy cp "/directory/subdirectory" "https://myblob.blob.core.windows.net/container[SAS]" --recursive=true

这样就完成了数据t运行sfer.

当我把它放到一个程序中时，我运行陷入了很多问题。

当前代码：

import subprocess
import os
import sys
try:
    key = ('SAS')
    file_path = ('/directory/subdirectory')
    full_link = ('"https://myblob.blob.core.windows.net/' + key + '"')
    transfer = subprocess.check_output(['azcopy', 'cp', file_path,
                                        full_link,
                                        '--recursive=true'], stderr=subprocess.STDOUT)
    print('Transfer Complete.')
# except subprocess.CalledProcessError as e:
#     raise RuntimeError("command '{}' return with error (code {}): {}".format(e.cmd, e.returncode, e.output))
except EOFError as error:
    #Output for EOF error, would be caused by missing SAS
    print('Error with SAS')
except Exception as e:
    #When an unexpected error has occured.
    print(str(e) + 'Unknown error has occured')
exit(0)

输出：

Command '['azcopy', 'cp', '/directory/subdirectory', '"https://myblob.blob.core.windows.net/[SAS]"', '--recursive=true']' 
returned non-zero exit status 1Unknown error has occured

如果我在当前被注释掉的代码中重新添加 except 语句，我会收到此错误：

Traceback (most recent call last):
  File "data_transfer.py", line 11, in <module>
    '--recursive=true'], stderr=subprocess.STDOUT)
  File "/usr/lib/python3.5/subprocess.py", line 626, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.5/subprocess.py", line 708, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['azcopy', 'cp', 'datadrive/peeled-images', '"https://myblob.blob.core.windows.net[SAS]"', '--recursive=true']' returned non-zero exit status 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "data_transfer.py", line 14, in <module>
    raise RuntimeError("command '{}' return with error (code {}): {}".format(e.cmd, e.returncode, e.output))
RuntimeError: command '['azcopy', 'cp', '/directory/subdirectory', '"https://myblob.blob.core.windows.net/[SAS]"', '--recursive=true']' return with error (code 1): b'\nfailed to parse user input due to error: the inferred source/destination combination is currently not supported. Please post an issue on Github if support for this scenario is desired\n'

非常感谢所有帮助

Answer 1

对此的答案是更改以下行：

subprocess.check_output(['azcopy', 'cp', '/directory/subdirectory',
                 full_link, '--recursive=true'], stderr=subprocess.STDOUT)

需要的更改是：

subprocess.call(['azcopy', 'cp', '/directory/subdirectory',
                 full_link, '--recursive=true'], stderr=subprocess.STDOUT)

这是因为这是为了运行并执行一个程序，不一定提供特定的输出。

如何 运行 通过 .py 传输 blob 数据

How to run a blob data transfer through .py

python

subprocess

blob

azure

azcopy

如何运行通过 .py 传输 blob 数据