Implemntation of AWS lambda function to resize images in S3 bucket - node.js

I am working on a project which uses the zoom functionality for images. In few images, zoom is not working. I need to know few things:
1) How AWS Lambda function helps me in this?? As the images are stored in the s3 bucket.
2) How to implement Lambda function on my local.

Related

How can i add a file to my AWS SAM lambda function runtime?

While working with aws i need to load a WSDL file in order to setup a soap service. The problem I now encounter however is that i don't know how i can possibly add a file to the docker container running my lambda function so that i can just read the file inside my lambda like in the code snippet below.
const files = readdirSync(__dirname + pathToWsdl);
files.forEach(file => {
log.info(file);
});
any suggestions on how i can do this are greatly appreciated!
Here are a few options:
If the files are static and small, you can bundle them in the Lambda package.
If the files are static or change infrequently then you can store them in S3 and pull from there on Lambda cold start.
If the files need to be accessed and modified by multiple Lambda functions concurrently or if you have a large volume of data with low-latency access requirements, then use EFS.
EFS is overkill for a small, static file. I would just package the file with the Lambda function.

AWS S3 lambda function doesn't trigger when upload large file

I have 2 buckets on the S3 service. I have a lambda function "create-thumbnail" that triggered when an object is created into an original bucket, if it is an image, then resize it and upload it into the resized bucket.
Everything is working fine, but the function doesn't trigger when I upload files more than 4MB on the original bucket.
Function configurations are as follow,
Timeout Limit: 2mins
Memory 10240
Trigger Event type: ObjectCreated (that covers create, put, post, copy and multipart upload complete)
Instead of using the lambda function, I have used some packages on the server and resize the file accordingly and then upload those files on the S3 bucket.
I know this is not a solution to this question, but that's the only solution I found
Thanks to everyone who took their time to investigate this.

How to upload downloaded file to s3 bucket using Lambda function

I saw different questions/answers but I could not find the one that worked for me. Hence, I am really new to AWS, I need your help. I am trying to download gzip file and load it to the json file then upload it to the S3 bucket using Lambda function. I wrote the code to download the file and convert it to json but having problem while uploading it to the s3 bucket. Assume that file is ready as x.json. What should I do then?
I know it is really basic question but still help needed :)
This code will upload to Amazon S3:
import boto3
s3_client = boto3.client('s3', region_name='us-west-2') # Change as appropriate
s3._client.upload_file('/tmp/foo.json', 'my-bucket', 'folder/foo.json')
Some tips:
In Lambda functions you can only write to /tmp/
There is a limit of 512MB
At the end of your function, delete the files (zip, json, etc) because the container can be reused and you don't want to run out of disk space
If your lambda has proper permission to write a file into S3, then simply use boto3 package which is an AWS SDK for python.
https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html
Be aware that if the lambda locates inside of VPC then lambda cannot access to the public internet, and also boto3 API endpoint. Thus, you may require a NAT gateway to proxy lambda to the public.

How do I create events for the buckets in s3 using nodejs or from lambda function

I wish to create s3 event from nodejs lambda function to to call another lambda function.
for example-> I have a lambda function test1 that creates s3 bucket and attaches the event to the bucket such that on the occurence of the event it call some different lambda function.
Problem -> I can create the lambda function to create an s3 bucket but I am not able to find create event method in AWS S3 documentation to implement this.
It is called BucketNotificationConfiguration in s3.
Refer
http://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/S3.html#putBucketNotificationConfiguration-property
http://docs.aws.amazon.com/AmazonS3/latest/API/RESTBucketPUTnotification.html
http://docs.aws.amazon.com/lambda/latest/dg/with-s3.html

Can I use lambda to compress all images under a bucket?

Can I use lambda to compress images under a bucket?
I can get the images under a particular bucket visa listObject. How do you compress these returns and write it in another bucket?
Yes, you can absolutely use lambda. Try this library: aws-lambda-image-compressor
AWS lambda function to compress and resize images
This is a Lambda Function which resizes/reduces images automatically. When an image is put on some AWS S3 bucket, this function will resize/reduce it and save it into a new bucket. I have used it in the past and I loved it.
Usage
edit lambda-config.js file and assign name, description, memory size, timeout of your lambda function.
edit .env file with your AWS access data
npm install
gulp deploy
You can also try this other library which is more popular in the crowd - aws-lambda-image
If you really want to create something of your own and want a good start.
I would recommend these 2 articles that explain it very well -
Image conversion using Amazon Lambda and S3 in Node.js
Automating Image Compression Using S3 & Lambda
If you are fine to use Amazon API Gateway then u can follow this AWS Compute Blog -
Resize Images on the Fly with Amazon S3, AWS Lambda, and Amazon API Gateway
Hope this was useful.

Resources