Pandas applymap内存错误
Pandas applymap memory error
我正在尝试将所有日期时间实例更改为字符串并将我的数据框导出到 excel。数据框可能有 20,000 - 50,000 个条目。这是我当前的代码:
wb = xw.Book('filelname.xlsx')
sht = wb.sheets['FNC']
data = wb.sheets['Data']
smdata = wb.sheets['Social']
df_sm_temp = sm_all
df_sm_temp['Date'] = df_sm_temp['Date'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
df_sm_temp['Added'] = df_sm_temp['Added'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
df_sm_temp['Updated'] = df_sm_temp['Updated'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
smdata.range('SM_ALL').value = df_sm_temp
尝试 运行 时,出现内存错误。任何帮助将不胜感激!
这里是数据集的一个小样本:https://www.sendspace.com/file/jxhmx2
谢谢
实际上你不需要转换数据本身,只需将datetime_format
与xlsxwriter
引擎结合使用即可:
演示:
writer = pd.ExcelWriter('/path/to/result.xlsx', engine='xlsxwriter',
date_format='mm/dd/yyyy', datetime_format='mm/dd/yyyy')
df.to_excel(writer)
我正在尝试将所有日期时间实例更改为字符串并将我的数据框导出到 excel。数据框可能有 20,000 - 50,000 个条目。这是我当前的代码:
wb = xw.Book('filelname.xlsx')
sht = wb.sheets['FNC']
data = wb.sheets['Data']
smdata = wb.sheets['Social']
df_sm_temp = sm_all
df_sm_temp['Date'] = df_sm_temp['Date'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
df_sm_temp['Added'] = df_sm_temp['Added'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
df_sm_temp['Updated'] = df_sm_temp['Updated'].apply(lambda x: str(x) if isinstance(x, datetime.time) else x)
smdata.range('SM_ALL').value = df_sm_temp
尝试 运行 时,出现内存错误。任何帮助将不胜感激!
这里是数据集的一个小样本:https://www.sendspace.com/file/jxhmx2
谢谢
实际上你不需要转换数据本身,只需将datetime_format
与xlsxwriter
引擎结合使用即可:
演示:
writer = pd.ExcelWriter('/path/to/result.xlsx', engine='xlsxwriter',
date_format='mm/dd/yyyy', datetime_format='mm/dd/yyyy')
df.to_excel(writer)