上传到 S3 时 Lambda 函数超时

Question

我有一个用 python 编写的 lambda 函数，它在 mongodb 中执行一些操作，然后它应该将图片从函数的 tmp 文件夹上传到 s3。该函数在上传步骤中保持超时。

我将超时时间提高到 2 分钟并且该函数具有 S3 和 vpc 权限。该功能只是超时。任何人都知道出了什么问题？

示例输入

#picturename should be created by the app. a name unique for the dish
{
    "UserId": "56dc63fc1769d032d4d78e2e",  
    "DishId": "56dcc2781769d032d4d78e2f",
    "PictureName" : "katsu-001.png",
    "Data": "base64 image just the bits ignore data:image/jpeg;base64, if you have it"
}

函数

def addPicture(event,context):  

from __future__ import print_function
import pymongo
from pymongo import MongoClient
import bson.code
from bson.objectid import ObjectId
import datetime
import json    
import boto3
import sys
import uuid
from base64 import decodestring

print ('Writing file to disk')
with open('/tmp/' + pictureName,"wb") as f:
    f.write(decodestring(event["Data"]))
    print ('File written to /tmp/' + pictureName)

s3_client = boto3.client('s3')
print ('Starting S3 upload')
bucket = "foundue-dev-filestore"
upload_path = 'pictures/dish/' + dishId.__str__() + '/' + pictureName
print ('Uploading /tmp/' + pictureName + ' ' + bucket + ' ' + upload_path) 
s3_client.upload_file('/tmp/' + pictureName,bucket, upload_path)   
print ('Upload Complete')  
#pics[pictureName] = upload_path
#dish["Pictures"] = pics
#dish["UpdatedOn"] = datetime.datetime.utcnow()
#db.dishes.replace_one({"_id": dishId}, dish)
return

附加到 lambda 的策略

oneClick_lambda_basic_vpc_execution_1457284829450
oneClick_lambda_s3_exec_role_1457392283800

输出

Loading function 
START RequestId: ed91c290-e582-11e5-95d6-ed4fc6a3321b Version: $LATEST 
Writing file to disk 
File written to /tmp/katsu-002png 
Starting S3 upload 
Uploading /tmp/katsu-002png foundue-dev-filestore pictures/dish/56dcc2781769d032d4d78e2f/katsu-002png 
END RequestId: ed91c290-e582-11e5-95d6-ed4fc6a3321b 
REPORT RequestId: ed91c290-e582-11e5-95d6-ed4fc6a3321b  Duration: 121003.49 ms  Billed Duration: 121000 ms Memory Size: 128 MB  Max Memory Used: 22 MB
2016-03-08T23:12:21.437Z ed91c290-e582-11e5-95d6-ed4fc6a3321b Task timed out after 121.00 seconds

Answer 1

你的输出很清楚：

Task timed out after 121.00 seconds

似乎 2 分钟不足以成功上传您的文件。尝试使用较小的文件重现该问题。您也可以尝试为超时设置设置最大值（5 分钟）。

Answer 2

真正的问题是 lambda 使用的是 VPC，但 VPC 没有访问 s3 的端点。所以确保你有那个。

（并允许 lambda 有足够的权限调用 s3）

现在它可以在不到一秒的时间内完成所有功能。

上传到 S3 时 Lambda 函数超时

Lambda Function timing out when uploading to S3

python

amazon-s3

aws-lambda