Skip to content

[Testing do not merge] Add ROCm wheel build and test pipeline to continuous CI#723

Draft
alekstheod wants to merge 58 commits intoamd-mainfrom
implement_periodic_build_wheels_pipeline_rocm_internal_v2
Draft

[Testing do not merge] Add ROCm wheel build and test pipeline to continuous CI#723
alekstheod wants to merge 58 commits intoamd-mainfrom
implement_periodic_build_wheels_pipeline_rocm_internal_v2

Conversation

@alekstheod
Copy link

  • Add jax-rocm-plugin and jax-rocm-pjrt to allowed artifacts in build_artifacts.sh with ROCm version flag passthrough.
  • Create build_rocm_artifacts.yml reusable workflow that builds ROCm wheels in a ROCm container and uploads them to S3 via OIDC.
  • Extend wheel_tests_continuous.yml with build-rocm-artifacts, run-pytest-rocm, and run-bazel-test-rocm jobs.

charleshofer and others added 30 commits March 2, 2026 10:20
…tignore (#563)

When jaxlib was built in debug more, an assertion in LLVM code that lazy-loads VHLO dialect could fire, since the code path could execute in a multi-threaded environment, and LLVM dialect repositories aren't thread safe to modify.

This patch applies the same changes that upstream makes to fix this: jax-ml@48c8762

(this includes disabling a call to `jax_mlir_ext.enter_multi_threaded_execution(context)` in `mlir.py`. Presumably, the whole functionality related to `enter_multi_threaded_execution()` multithreaded checks isn't ready yet, and it was prematurely rolled into the production code.

Manual testing
(forgot this skip in the previous PR)
Co-authored-by: Daniel Suo <danielsuo@gmail.com>
Co-authored-by: Jake VanderPlas <jakevdp@google.com>
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 4670ac2 to f2b145c Compare March 4, 2026 14:36
@alekstheod alekstheod marked this pull request as draft March 4, 2026 14:38
@alekstheod alekstheod changed the title [Testing do not merge] Add ROCm wheel build and test pipeline to continuous CI Add ROCm wheel build and test pipeline to continuous CI Mar 4, 2026
@alekstheod alekstheod changed the title Add ROCm wheel build and test pipeline to continuous CI [Testing do not merge] Add ROCm wheel build and test pipeline to continuous CI Mar 4, 2026
@alekstheod alekstheod marked this pull request as ready for review March 4, 2026 15:00
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch 2 times, most recently from 173cd80 to ae3fc9f Compare March 4, 2026 15:22
@alekstheod alekstheod marked this pull request as draft March 4, 2026 15:24
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from ae3fc9f to 4a37416 Compare March 4, 2026 15:32
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 8b729bb to 250595b Compare March 4, 2026 16:36
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 80d8ed5 to 76ac8c0 Compare March 4, 2026 17:16
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from f172dc1 to 3965854 Compare March 4, 2026 17:57
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from ab6bb69 to 3ea5e36 Compare March 5, 2026 09:49
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 3ea5e36 to a4958bb Compare March 5, 2026 09:55
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 6289d0f to bc61e1e Compare March 6, 2026 07:53
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from bc61e1e to 9a3bb3b Compare March 6, 2026 08:14
@alekstheod alekstheod force-pushed the implement_periodic_build_wheels_pipeline_rocm_internal_v2 branch from 714ba20 to b4f4b37 Compare March 6, 2026 08:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants