Evaluating Microsoft Foundry Model Router for Cost, Quality, and Latency

Learn how to set up Model Router Auto Evaluation to compare Microsoft Foundry Model Router with a baseline model on quality, cost, and latency. The walkthrough covers configuration, running an evaluation, and reviewing a sample results dashboard.

- Project setup, endpoints, API keys, model deployments, and pricing
- Evaluation data and running the command-line workflow
- Reviewing dashboard comparisons and planning follow-up tests

For developers choosing models for AI agents, this walkthrough explains how to run an evaluation and interpret its trade-offs. You can use the same process with your own prompts and agent priorities; the example uses a small sample set, so its results are not a general benchmark.