AgentPantheon
New API logo

New APIOpen-source LLM gateway unifying multiple AI provider APIs with routing, billing, and analytics

4.3 (4)
Daniel NikulshynReviewed by Daniel Nikulshyn·Updated June 2026

Overview

New API is an open-source LLM gateway that provides a unified interface for connecting to multiple AI model providers, including OpenAI, Anthropic Claude, and Google Gemini-style APIs. It acts as a central management layer that lets teams route requests across providers, control access, and track usage from one place. The project is aimed at developers, platform teams, and organizations that consume AI APIs at scale and want a single gateway rather than integrating each provider separately. By exposing OpenAI-compatible endpoints, it allows existing applications and SDKs to work with many backends without rewriting client code. Beyond basic proxying, New API focuses on operational concerns such as token-based quotas, billing and credit management, request auditing, and usage analytics. These features make it suitable for building internal AI platforms or reselling/metering access to multiple users or teams. As an open-source, self-hostable tool, it gives operators control over deployment and data flow, which can be important for cost management and compliance. It positions itself in the same space as other API gateways and aggregators like LiteLLM and One API, from which it derives. As with most self-hosted gateways, adopting New API requires infrastructure setup and ongoing maintenance, and the breadth of provider support and stability depend on community contributions.

Key features

  • Unified multi-provider API gateway
  • OpenAI-compatible endpoints
  • Request routing across model providers
  • Token quotas and billing management
  • Usage analytics and auditing

Pricing

Model
Freemium
Rating
4.3 / 5 (4)

Use cases

Unify Multi-Provider LLM Access

Route requests across OpenAI, Claude, and Gemini through a single API, simplifying integration and reducing vendor lock-in for engineering teams.

Enforce Quotas and Team Billing

Apply per-user or per-team quotas and track usage for internal chargebacks, enabling controlled LLM consumption across an organization.

Audit and Analyze LLM Usage

Capture detailed logs and analytics on LLM requests to support compliance audits, cost optimization, and performance monitoring.

Self-Hosted AI Infrastructure

Deploy an open-source gateway in-house to maintain data control while standardizing access to multiple LLM providers.

Pros & Cons

Pros

  • Open-source and self-hostable for full control
  • Unifies many AI providers behind one compatible API
  • Built-in quotas, billing, and usage analytics
  • Auditing and access management for multi-user setups

Cons

  • Requires self-hosting and ongoing maintenance
  • Feature depth depends on community contributions
  • Documentation may be sparse for newcomers

Reviews

4.3

Average from 4 ratings.

5
1
4
3
3
0
2
0
1
0

Sign in to leave a review.

M

Compared a few options

Evaluated this against two competitors. Where it wins: the dashboard and the value for money is strong. Where it lags: the docs could be deeper. On balance the feature set — especially the dashboard — justifies the 4 stars for our use case.

W

Wei Chen

Jul 28, 2025

Use it every day

Honestly didn't expect to like it this much. The dashboard is exactly what I needed, and it saves real time. I do wish pricing gets steep at scale, but I reach for it almost every day now and it just clicks.

J

Jamal Carter

Jul 11, 2025

Solid for our team

We rolled this out across the team last quarter and it saves real time. The onboarding fits neatly into how we already work, and the core workflow removed a step we used to do by hand. The mobile experience lags, which is the main caveat, but it has held up under daily use.

A

Aaliyah Johnson

Jun 18, 2025

Compared a few options

Evaluated this against two competitors. Where it wins: the integrations and it is genuinely easy to set up. Where it lags: pricing gets steep at scale. On balance the feature set — especially the core workflow — justifies the 4 stars for our use case.

Q&A

What operational features does New API offer beyond basic API proxying?

Beyond routing requests to multiple LLM providers, New API includes built-in quotas, billing, auditing, and usage analytics, making it suitable for teams that need to manage, monitor, and control LLM consumption centrally.

Which LLM providers and API formats does New API support?

New API acts as a unified gateway for major LLM APIs, including OpenAI-, Claude-, and Gemini-style endpoints, letting you route requests across providers through a single consistent interface.

Is New API free, and can it be self-hosted?

Yes. New API is open-source, so you can self-host it without licensing fees. Your only costs are the infrastructure you run it on and the usage fees charged by the upstream LLM providers it connects to.

Ask a question

AI Model Serving Platforms alternatives