aws_s3.md

AWS S3

Lithops with AWS S3 as storage backend.

Installation

1. Install Amazon Web Services backend dependencies:

   $ python3 -m pip install lithops[aws]
   

2. Login to Amazon Web Services Console (or signup if you don't have an account)

3. Navigate to S3 and create a bucket. Type a name (e.g. lithops-data). The bucket should be created in the same region as the Lambda functions are expected to be run (mainly to avoid inter-region data transfer charges).

Configuration

4. Edit your lithopsa config and add the following keys:

   lithops:
       storage: aws_s3
   
   aws:
       region : <REGION_NAME>
       access_key_id : <ACCESS_KEY_ID>
       secret_access_key : <SECRET_ACCESS_KEY>

Summary of configuration keys for AWS:

AWS:

Group	Key	Default	Mandatory	Additional info
aws	region		yes	AWS Region. For example us-east-1
aws	access_key_id		yes	Account access key to AWS services. To find them, navigate to My Security Credentials and click Create Access Key if you don't already have one.
aws	secret_access_key		yes	Account secret access key to AWS services. To find them, navigate to My Security Credentials and click Create Access Key if you don't already have one.
aws	session_token		no	Session token for temporary AWS credentials

Summary of configuration keys for AWS S3:

Group	Key	Default	Mandatory	Additional info
aws_s3	region		no	Region of your Bcuket. e.g us-east-1, eu-west-1, etc. Lithops will use the region set under the aws section if it is not set here
aws_s3	storage_bucket		no	The name of a bucket that exists in you account. This will be used by Lithops for intermediate data. Lithops will automatically create a new one if it is not provided