无法使用 Python Drive API 上传大于 200 MB 的 csv 文件
Unable to upload > 200 MB csv file using Python Drive API
我正在尝试使用驱动器 API 自动执行我的日常任务,当我尝试上传较大的文件(> 300 MB CSV)时遇到错误,而以下代码用于上传较小的文件文件(<100 MB)。补充说我是 运行 我的 Debian Linux VM 中的片段,我的 VM 端没有问题。
from pydrive.auth import GoogleAuth
from pydrive.drive import GoogleDrive
import os
gauth = GoogleAuth()
# Try to load saved client credentials if already done
gauth.LoadCredentialsFile("mycreds.txt")
drive_path = '<drive_id>'
data_to_be_uploaded = "my_big_file.csv"
# Declared the variable so that it will be uploaded as per the last date
file1 = drive.CreateFile({'title': my_big_csv_data+'.csv',
'parents': [{'id': drive_path}]
})
file1.SetContentFile(data_to_be_uploaded)
file1.Upload()
错误如下
File "test_code.py", line 72, in <module>
file1.Upload()
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/files.py", line 285, in Upload
self._FilesInsert(param=param)
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/auth.py", line 75, in _decorated
return decoratee(self, *args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/files.py", line 369, in _FilesInsert
http=self.http)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/_helpers.py", line 133, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/googleapiclient/http.py", line 810, in execute
_, body = self.next_chunk(http=http, num_retries=num_retries)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/_helpers.py", line 133, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/googleapiclient/http.py", line 970, in next_chunk
headers=headers)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/transport.py", line 175, in new_request
redirections, connection_type)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/transport.py", line 282, in request
connection_type=connection_type)
File "/usr/share/hunch/lib/python3.6/site-packages/httplib2/__init__.py", line 1994, in request
cachekey,
File "/usr/share/hunch/lib/python3.6/site-packages/httplib2/__init__.py", line 1690, in _request
content,
httplib2.RedirectMissingLocation: Redirected but the response is missing a Location: header.```
某些类型的文件有 100MB 的限制
通过将我的 httplib2 包降级到 0.13.1 解决
引用已用here
谢谢! @巴尔德曼
我正在尝试使用驱动器 API 自动执行我的日常任务,当我尝试上传较大的文件(> 300 MB CSV)时遇到错误,而以下代码用于上传较小的文件文件(<100 MB)。补充说我是 运行 我的 Debian Linux VM 中的片段,我的 VM 端没有问题。
from pydrive.auth import GoogleAuth
from pydrive.drive import GoogleDrive
import os
gauth = GoogleAuth()
# Try to load saved client credentials if already done
gauth.LoadCredentialsFile("mycreds.txt")
drive_path = '<drive_id>'
data_to_be_uploaded = "my_big_file.csv"
# Declared the variable so that it will be uploaded as per the last date
file1 = drive.CreateFile({'title': my_big_csv_data+'.csv',
'parents': [{'id': drive_path}]
})
file1.SetContentFile(data_to_be_uploaded)
file1.Upload()
错误如下
File "test_code.py", line 72, in <module>
file1.Upload()
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/files.py", line 285, in Upload
self._FilesInsert(param=param)
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/auth.py", line 75, in _decorated
return decoratee(self, *args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/pydrive/files.py", line 369, in _FilesInsert
http=self.http)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/_helpers.py", line 133, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/googleapiclient/http.py", line 810, in execute
_, body = self.next_chunk(http=http, num_retries=num_retries)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/_helpers.py", line 133, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/share/hunch/lib/python3.6/site-packages/googleapiclient/http.py", line 970, in next_chunk
headers=headers)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/transport.py", line 175, in new_request
redirections, connection_type)
File "/usr/share/hunch/lib/python3.6/site-packages/oauth2client/transport.py", line 282, in request
connection_type=connection_type)
File "/usr/share/hunch/lib/python3.6/site-packages/httplib2/__init__.py", line 1994, in request
cachekey,
File "/usr/share/hunch/lib/python3.6/site-packages/httplib2/__init__.py", line 1690, in _request
content,
httplib2.RedirectMissingLocation: Redirected but the response is missing a Location: header.```
某些类型的文件有 100MB 的限制
通过将我的 httplib2 包降级到 0.13.1 解决
引用已用here
谢谢! @巴尔德曼