M5 Ultra Mac Studio vs. Dual NVIDIA DGX Sparks for Local AI

I compare an M5 Ultra Mac Studio with two NVIDIA DGX Sparks to show how their performance differs when running large language models locally. The tests cover prompt processing, token generation, and multiple users, with practical details on setup and power use.

■ Performance and workloads
- Model loading, prompt processing, and generation across different prompt lengths
- Comparisons involving concurrency, cached context, and software engines
■ Setup and practical considerations
- Multi-node Spark configuration, power use, and temperatures
- How to assess hardware based on prompt size, response length, and intended users

For developers and small teams considering local AI hardware, the examples provide context for matching a setup to a workload. The comparisons are limited to the tested configurations and models, so use your own prompt and usage requirements to guide a purchase decision.