Different architecture M-chip connected over RDMA for inference

Machine Learning & AI General
Binaire OP
Created 2w
Replies 1
Boosts 0
Views 446
Participants 2

Can anyone please tell if a M5 Pro Macbook Pro can connect to a M3 ultra Mac studio over thunderbolt 5 using RDMA for LLM inference? Thanks

Answered by DTS Engineer in 899146022

Yeah, that should work a treat.

Oh, and if you haven’t already seen it, you should check out TN3205 Low-latency communication with RDMA over Thunderbolt. It’s chock full of RDMA hints and tips.

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Replies  1
Boosts  0
Views  446
Participants  2
DTS Engineer OP
Apple
2w
Recommended

Yeah, that should work a treat.

Oh, and if you haven’t already seen it, you should check out TN3205 Low-latency communication with RDMA over Thunderbolt. It’s chock full of RDMA hints and tips.

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Different architecture M-chip connected over RDMA for inference
First post date Last post date
 
 
Q