Serverless Application

This is a serverless application using AWS SAM.

Prerequisite

• pyenv
• aws-cli
• docker
• direnv

Installation

git clone https://github.com/AlisProject/serverless-application.git
cd serverless-application
pyenv install
libraries
python -m venv venv
. venv/bin/activate
pip install -r requirements.txt
pip install -r requirements_test.txt

Environment valuables

# Create .envrc to suit your environment.
cp -pr .envrc.sample .envrc
vi .envrc # edit
allow
direnv allow

Test

Set up dynamoDB local

Download and unzip the dynamoDB local zip in any directory

For example

$ curl -O https://s3-ap-northeast-1.amazonaws.com/dynamodb-local-tokyo/dynamodblocallatest.tar.gz $ tar xf ./dynamodblocallatest.tar.gz $ rm ./dynamodblocallatest.tar.gz

Execute Test

# Start dynamoDB local
java -Djava.library.path=./DynamoDBLocal_lib -jar DynamoDBLocal.jar -sharedDb
lunch docker for localstack（for MAC OS）
TMPDIR=/private$TMPDIR docker-compose up -d
lunch docker for elasticsearch
docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" docker.elastic.co/elasticsearch/elasticsearch:6.2.0
exec
python exec_test.py
single directory
python exec_test.py --target /handlers
ignore specific directory
python exec_test.py --ignore /handlers

Set SSM valuables

You have to specify SSM valuables as can as possible.

• See: https://github.com/AlisProject/environment

Deployment via AWS Cloud Formation

Create S3 bucket

aws s3api create-bucket --bucket ${ALISAPPID}-serverless-deploy-bucket \
  --create-bucket-configuration LocationConstraint=$AWSDEFAULTREGION

Packaging and deployment

Packaging

Pack all resources.

./packaging.sh

You can Pack specify resource if you want.

python makedeployzip.py --target 'src/handlers/labo/n/random/handler.py'

DynamoDB

./deploy.sh database
Show all tables.
aws dynamodb list-tables |grep ${ALISAPPID}database |sort |tr -d ' ",'

And add all of generated table names to SSM.

• See: https://github.com/AlisProject/environment

- You can use dynamodb-table-replacer.sh

Master Data

Add master data to DynamoDB.

./addmasterdata.sh

Cognito

./deploy.sh cognito

Specify generated Cognito User Pool ARN to SSM.

• See: https://github.com/AlisProject/environment

Lambda & API Gateway

You have to add SNS authentication params to SSM.

• See: https://github.com/AlisProject/environment

./deploy.sh function && ./deploy.sh function02 && ./deploy.sh api

ElasticSearch

./deploy.sh elasticsearch
show ElasticSearch Endpoint
aws es describe-elasticsearch-domain --domain-name ${ALISAPPID}elasticsearch | jq '.DomainStatus.Endpoint'
Notice: After this, Elasticsearch is expensive if it is the default setting, so it may be better to reconfigure its performance settings.

And add ElasticSearch Endpoint to SSM.

• See: https://github.com/AlisProject/environment

Add Your local IP to ES access policy.

python elasticsearch-setup.py $(curl https://checkip.amazonaws.com/)

Permissions

You have to add RestApiArn, ApiLambdaRole and ElasticSearchEndpoint to SSM.

• See: https://github.com/AlisProject/environment

- You can use api-stack-replacer.sh

./deploy.sh permission

You have to update Cognito pre authentication trigger.

# Get function name.
aws lambda list-functions | jq -r --arg FUNCTION \
  "${ALISAPPID}api-CognitoTriggerPreAuthentication" '.Functions[] | select(.FunctionName | test($FUNCTION)) | .FunctionName'
  
Add it to Cognito via Management console

FYI:

Lambda & API Gateway are bunch of CloudFormation stacks. You can use the script from next time.

./deploy_api.sh

Fix API settings via a script

# Show generated Rest API ID
aws apigateway  get-rest-apis | jq '.items[] | if .name == "'${ALISAPPID}'api" then .id else empty end'
Set SERVERLESSRESTAPI_ID to .envrc
direnv edit
Show generated Rest API with OAuth ID
aws apigateway  get-rest-apis | jq '.items[] | if .name == "'${ALISAPPID}'api-with-oauth" then .id else empty end'
Set SERVERLESSRESTAPIWITHOAUTH_ID to .envrc
direnv edit
Load envs
direnv allow
./fix_api.sh

Single API Lambda Function

You can deploy single function on api-template.yaml with using deployapifunction.py script. Following example is that ArticlesRecent function is deployed.

python makedeployzip.py && ./deployapifunction.py ArticlesRecent

ALIS Laboratory resources

Experimental features.

npm ci
npx deploy

CloudWatch Alarm

For production and staging, you should enable alarms.

./deploy.sh apialarms

Cloudfront

For development only. You can create Cloudfront and Route53 resources via Cloudformation.

# Show API Gateway IDs
aws apigateway  get-rest-apis | jq -r '.items[] | select( .name | contains("'${ALISAPPID}'")) | .name + " : " + .id'
Show ACM
aws acm list-certificates --region us-east-1
Add it to env
direnv edit
Deployment
./deploy_cloudfront.sh

Resource Groups

You can create Resource Groups if you want.

./createresourcegroups.sh