Registry of Social Beneficiaries (PUB) Monthly Catalog Service Pipeline
To run this, you will need:
- Python and a recent
pip - The AWS CLI (
pip install awscli) - Serverless framework (
npm install -g serverless) - Plugin existing-s3, overcomes the CloudFormation limitation (
npm install serverless-plugin-existing-s3)
serverless config credentials --provider aws --key $AWS_ACCESS_KEY_ID --secret $AWS_SECRET_ACCESS_KEY_ID
sls deploy
sls s3deploy
sls remove
- First lambda function to query Athena for monthly Pub Metadata Update
- Second lambda function to trigger elasticsearch update