Skip to content

Draft: POC#13393

Draft
mprahl wants to merge 4 commits into
kubeflow:mlmd-removalfrom
mprahl:mlmd-removal-11
Draft

Draft: POC#13393
mprahl wants to merge 4 commits into
kubeflow:mlmd-removalfrom
mprahl:mlmd-removal-11

Conversation

@mprahl
Copy link
Copy Markdown
Collaborator

@mprahl mprahl commented May 12, 2026

Description of your changes:

Checklist:

Remove the MLMD dependency by storing artifacts and task state directly in
KFP's API server and database, and switch the runtime path to use the new
v2beta1 artifact and task APIs instead of the metadata service.

This change:
- adds artifact/task models, storage, API surface, and generated clients
- updates the driver, launcher, importer, auth, and workspace artifact flows
  to use the KFP API end to end
- removes MLMD deployment/manifests and refreshes the frontend, CI, tests,
  and generated outputs needed to keep the rebased branch passing

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>
@google-oss-prow
Copy link
Copy Markdown

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@mprahl
Copy link
Copy Markdown
Collaborator Author

mprahl commented May 12, 2026

/test all

@google-oss-prow
Copy link
Copy Markdown

@mprahl: No presubmit jobs available for kubeflow/pipelines@master

Details

In response to this:

/test all

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@mprahl mprahl changed the base branch from master to mlmd-removal May 12, 2026 19:18
@mprahl mprahl marked this pull request as ready for review May 12, 2026 19:19
@mprahl mprahl closed this May 12, 2026
@mprahl mprahl reopened this May 12, 2026
@google-oss-prow
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from mprahl. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mprahl mprahl removed request for alyssacgoins and nsingla May 12, 2026 19:19
@mprahl mprahl force-pushed the mlmd-removal-11 branch 12 times, most recently from 1e6a865 to aaf2ba5 Compare May 15, 2026 19:30
Signed-off-by: mprahl <mprahl@users.noreply.github.com>
@mprahl mprahl force-pushed the mlmd-removal-11 branch from aaf2ba5 to d847a0c Compare May 15, 2026 20:04
Run the local coordinator Docker flow without MySQL or MinIO by switching to SQLite and a Go CDK file blob store. Mount the local SDK into step containers so local E2Es exercise the current checkout and keep file-backed artifact paths working end to end.

Signed-off-by: mprahl <mprahl@users.noreply.github.com>
@mprahl mprahl force-pushed the mlmd-removal-11 branch from be42df2 to f2140d6 Compare May 18, 2026 19:37
Use the resolved artifact path when compiling input placeholders so coordinator Docker runs can pass customPath-backed artifacts between containerized tasks.

Signed-off-by: mprahl <mprahl@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants