Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gitlab DBT example inconsistencies for a reason? #215

Open
stevenayers opened this issue Feb 15, 2025 · 0 comments
Open

Gitlab DBT example inconsistencies for a reason? #215

stevenayers opened this issue Feb 15, 2025 · 0 comments

Comments

@stevenayers
Copy link

Under branch deployment for preparing a DBT project, there is this:

- pip install pip --upgrade
- cd $DAGSTER_DBT_PROJECT_DIR/$DAGSTER_DBT_PROJECT_NAME
- pip install . MarkupSafe==2.0.1 'click>8.1.0' 'Jinja2>3.0.0'
- pip install pyOpenSSL --upgrade
- cd -
- which rsync || ( apt-get update -y && apt-get -y install rsync )
- rsync -avz --exclude $DAGSTER_DBT_PROJECT_NAME --exclude .git $DAGSTER_DBT_PROJECT_DIR/ $DAGSTER_DBT_PACKAGE_DATA_DIR
- dbt deps --project-dir $DAGSTER_DBT_PACKAGE_DATA_DIR --profiles-dir $DAGSTER_DBT_PACKAGE_DATA_DIR
- dbt parse --project-dir $DAGSTER_DBT_PACKAGE_DATA_DIR --profiles-dir $DAGSTER_DBT_PACKAGE_DATA_DIR
- rm $DAGSTER_DBT_PACKAGE_DATA_DIR/target/partial_parse.msgpack

Should it not use the same method of prepare that the main branch is using?

- pip install pip --upgrade
- cd $DAGSTER_DBT_PROJECT_DIR/$DAGSTER_DBT_PROJECT_NAME
- pip install . --upgrade --upgrade-strategy eager
- dagster-dbt project prepare-and-package --file $DAGSTER_DBT_PROJECT_NAME/project.py

I say this because branch_deployments.yml for the GitHub example do this:

run: |
python -m pip install pip --upgrade
cd project-repo/${{ env.DAGSTER_PROJECT_NAME }}
pip install . --upgrade --upgrade-strategy eager
dagster-dbt project prepare-and-package --file ${{ env.DAGSTER_PROJECT_NAME }}/project.py
# The cli command below can be used to manage syncing the prod manifest to branches if state_path is set on the DbtProject
# dagster-cloud ci dagster-dbt project manage-state --file ${{ env.DAGSTER_PROJECT_NAME }}/project.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant