Hello ,
We are planning to deploy an 8-node Mac Studio M5 Ultra cluster for distributed AI computing and would appreciate technical guidance on the recommended architecture, Thunderbolt 5 connectivity, and software configuration.
I have reviewed Apple's WWDC26 demonstration of distributed inference and training using MLX, which features four Mac Studios. We would like to understand how best to extend this architecture to eight nodes.
We would appreciate guidance on the following:
Cluster Architecture and Thunderbolt 5 Connectivity
Is it possible to configure all eight Mac Studios as a single distributed AI compute cluster using MLX?
What Thunderbolt 5 topology is recommended for eight nodes: ring, partial mesh, or another configuration?
Our proposed design includes 14 Thunderbolt 5 cables. Can all 14 be effectively utilized, or would a different cabling arrangement be more appropriate?
Is there a recommended port-to-port cabling diagram or reference architecture for an eight-node configuration?
Can multiple Thunderbolt 5 links between neighboring Macs be utilized to improve communication performance?
Are there example configuration files, commands, or implementation guides for establishing and validating an eight-node cluster?
Networking and Storage
Is it appropriate to use Thunderbolt 5 for inter-node communication while using a separate 10GbE network and shared NAS for model and dataset storage?
Are there any configuration considerations when using both network types simultaneously?
My primary concern is establishing the correct Thunderbolt 5 topology and software architecture before implementation, particularly whether the proposed 14-cable arrangement is appropriate for eight nodes.
Any guidance, reference architecture, cabling examples, or links to relevant technical documentation would be greatly appreciated.
Thank you.
Topic:
Machine Learning & AI
SubTopic:
General
Tags:
Machine Learning
Apple Silicon
Network
ML Compute
1
0
53