Skip to content

Configuration Files

Harshad Ranganathan edited this page Jan 21, 2020 · 3 revisions

Typical config directory structure will be as follows -

config

       │-- configurations.json

       │-- default.yaml

       │-- <environment_template>.yaml

File Description
configurations.json List of configurations for the EMR cluster (e.g. export properties)
Refer https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html
default.yaml Default yaml configuration file that defines the job flow
<environment_template>.yaml Environment specific configuration. Properties defined here override the default configuration

YAML configuration files follow run_job_flow syntax definition in boto3 library documentation - https://boto3.readthedocs.io/en/latest/reference/services/emr.html#EMR.Client.run_job_flow

Clone this wiki locally