An agentic autonomous prompt optimization and model selection tool/gateway

The talk demonstrates an autonomous agent that examines LLM execution traces, suggests optimal models and usage patterns, and reduces cost through intelligent routing.

Overview

We’ll demonstrate an agent that analyzes LLM traces and recommends optimal models and LLM usage recommendations to aid in model selection, performance optimization, and cost reduction, and how this can be used in an intelligent AI router.