Jan 17, 2025

Introducing Agent Router

Automatically choose the most suitable model for each agent request—boost performance while cutting costs by leveraging the combined strengths of multiple LLM models.

The Challenge of Model Selection

As the landscape of Large Language Models (LLMs) continues to evolve, developers face a growing challenge: choosing the right model for each task. While top-tier models excel at complex operations, using them for every request can quickly become costly. On the flip side, relying solely on cheaper models might compromise the quality of your results.

Today, we're excited to announce Agent Router—a smart routing system for Cline and OpenHands that automatically chooses the most suitable model for each agent request. This intelligent routing system helps you boost performance while cutting costs by leveraging the combined strengths of multiple LLM models.

Cloud-Hosted Solution

Agent Router is a fully managed cloud solution that includes access to SOTA models and ML-based routing for optimal performance. Perfect for teams that want a hassle-free setup with advanced features.

How It Works

Agent Router analyzes each incoming request in real-time, evaluating factors such as:

  • Task complexity (e.g., simple bug fixes vs. deep refactoring)
  • Context requirements
  • Code generation needs
  • Required reasoning capabilities

Based on this analysis, Agent Router selects the most suitable model that can handle the task successfully. For example:

  • Simple code formatting or basic bug fixes might be routed to efficient, lower-cost models
  • Complex refactoring operations that require deep code understanding get directed to more powerful models
  • Code generation tasks are balanced between models based on the complexity of the required output

Benefits

Early testing has shown significant advantages:

  • Reduced costs through intelligent model selection
  • Improved performance by using the right model for each task
  • Simple integration with Cline and OpenHands
  • Hassle-free cloud deployment with automatic updates

Join the Waitlist

We're currently in a closed beta phase, but you can join our waitlist to be among the first to try Agent Router when we launch. Here's how to get started:

  1. Sign up for the Agent Router waitlist
  2. Complete your registration details
  3. We'll notify you when your access is ready

Ready to optimize your agent's performance? Join the waitlist and be first in line when we launch.