Skip to content

nicp2p Preset#228

Merged
AtlantaPepsi merged 11 commits intoROCm:candidatefrom
AtlantaPepsi:candidate_nicp2p
Feb 3, 2026
Merged

nicp2p Preset#228
AtlantaPepsi merged 11 commits intoROCm:candidatefrom
AtlantaPepsi:candidate_nicp2p

Conversation

@AtlantaPepsi
Copy link
Copy Markdown
Contributor

Motivation

Adding a preset of internode p2p transfers

Technical Details

Transfers between any pair of NICs from all nodes will be executed serially. Results will be displayed and sorted.

Test Plan

Test Result

Example outputs
image
image

Submission Checklist

@AtlantaPepsi AtlantaPepsi requested a review from a team as a code owner January 9, 2026 22:06
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/Presets.hpp Outdated
{"a2asweep", {AllToAllSweepPreset, "Test GFX-based all-to-all transfers swept across different CU and GFX unroll counts"}},
{"healthcheck", {HealthCheckPreset, "Simple bandwidth health check (MI300X series only)"}},
{"nicrings", {NicRingsPreset, "Tests NIC rings created across identical NIC indices across ranks"}},
{"nicp2p", {NicPeerToPeerPreset, "Multi-node peer-to-peer bandwidth test using Nearest NIC RDMA transfers"}},
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This description doesn't seem accurate

Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated

auto cpuDelta = std::chrono::high_resolution_clock::now() - cpuStart;
durationSec += std::chrono::duration_cast<std::chrono::duration<double>>(cpuDelta).count();
fprintf(stderr, "Completed %d/%d pairs in %6.3fs, estimated remaining time %6.3fs.\n",
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to only be printed by one rank sometimes, similar to Print()

Comment thread src/client/Presets/NicPeerToPeer.hpp Outdated
@AtlantaPepsi AtlantaPepsi merged commit 2f93ce3 into ROCm:candidate Feb 3, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants