将 csv 上传到 Snowflakes 时出错

Question

尝试上传大小为 100GB 的 csv 并在 tmp 中创建压缩文件后出现此错误


   data = sf_file_transfer_agent.result()
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/file_transfer_agent.py", line 722, in result
    "errno": ER_FAILED_TO_UPLOAD_TO_STAGE,
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 258, in errorhandler_wrapper
    error_value,
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 309, in hand_to_other_handler
    cursor.errorhandler(connection, cursor, error_class, error_value)
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 195, in default_errorhandler
    cursor=cursor,
snowflake.connector.errors.OperationalError: AttributeError("'StorageCredential' object has no attribute '_command'",)

Answer 1

不建议加载非常大的文件（例如 100 GB 或更大）。尝试将文件压缩到 100-250 MB 大小（压缩）并尝试。

将 csv 上传到 Snowflakes 时出错

Getting error when uploading csv to Snowflakes

snowflake-connector