-
Notifications
You must be signed in to change notification settings - Fork 0
Configuration Files
Harshad Ranganathan edited this page Jan 21, 2020
·
3 revisions
Typical config directory structure will be as follows -
config
│-- configurations.json
│-- default.yaml
│-- <environment_template>.yaml
File | Description |
---|---|
configurations.json | List of configurations for the EMR cluster (e.g. export properties) Refer https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html |
default.yaml | Default yaml configuration file that defines the job flow |
<environment_template>.yaml | Environment specific configuration. Properties defined here override the default configuration |
YAML configuration files follow run_job_flow syntax definition in boto3 library documentation - https://boto3.readthedocs.io/en/latest/reference/services/emr.html#EMR.Client.run_job_flow