Skip to content

bug: toggling dev_mode doesn't reset dataset_name #3276

@zilto

Description

@zilto

Run a pipeline without dev_mode (defaults to False); You get a dataset named {dataset_name}

Repro

  1. Set dev_mode=True. For each run, it produces a namespaced dataset {dataset_name}_{timestamp}.
  2. Set dev_mode=False, data is written to the latest namespaced dataset.

Intuitively, Step 2 should create or write to non-namespaced dataset named {dataset_name}.

I don't see good a reason why the sequence dev_mode=True -> dev_mode=False should matter. The behavior of dev_mode=False should be consistent (not stateful)

I'm filing this as a bug given behavior isn't intuitive.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions