-
Notifications
You must be signed in to change notification settings - Fork 0
Examples
Harshad Ranganathan edited this page Jan 21, 2020
·
1 revision
You can find examples for the configuration files here -
| File | |
|---|---|
| default.yaml | https://github.com/HarshadRanganathan/aws-emr-launcher/blob/master/tests/resources/default.yaml |
| <environment_template>.yaml | https://github.com/HarshadRanganathan/aws-emr-launcher/blob/master/tests/resources/prod.yaml |
In default.yaml we have defined the common steps (such as job flow definitions, tags, emr label etc.) as these will remain the same across all environments.
In prod.yaml we have defined the cluster configuration (number of ec2 instances to be used, instance type, whether to use on-demand or spot instances etc.). Similarly, we can define the cluster configuration for each of the environments (such as qa, stg etc.) in separate files. They will override any properties defined in default.yaml.