Open-source LLMOps platform unifying an LLM gateway, observability, evaluation, optimization and experimentation in one Rust-based system, with a commercial Autopilot layer.

That unifying gateway, observability, evals and optimization in one open-source stack would make TensorZero the default way teams run LLMs in production.

$7.3M seed led by FirstMark with Bessemer, Bedrock, DRW and Coalition (announced August 2025); founders spent less than half and returned the rest

Founded in early 2024 in New York by Gabriel Bianconi (ex-CPO at Ondo Finance) and Viraj Mehta (CMU PhD focused on reinforcement learning). Their premise: LLM applications are reinforcement-learning problems — production calls return feedback, and that feedback should make the system cheaper, faster and better over time.

In August 2025 TensorZero announced a $7.3M seed led by FirstMark with Bessemer, Bedrock, DRW and Coalition. Its GitHub repo became the #1 trending repository of the week, jumping from roughly 3,000 to 9,700+ stars, and the README claimed adoption from frontier AI startups to Fortune 10 companies moving ~1% of global LLM API spend. The company kept the core stack open source with no paid features in OSS and shipped Autopilot, a commercial automated-AI-engineer layer, inside the product.

Wound down: on June 12, 2026 the team archived the GitHub repo to read-only without warning. CEO Gabriel Bianconi explained on Hacker News that an open-source company must find product-market fit twice — once for the OSS project and again for a commercial product — and that the paid layer never became a business that could carry the company; the team had spent less than half of the $7.3M, carried no debt, and returned the rest to investors.

LLM tooling was fragmented — gateway, evals, observability and optimization were sold separately; TensorZero unified them in one stack with a compounding data and learning flywheel.

A Rust gateway with <1ms p99 overhead at 10,000+ QPS gave a performance wedge over Python-based alternatives like LiteLLM at scale.

Keeping the core open source with no paid features lowered enterprise trust barriers and helped drive the #1 trending week that validated demand.

The shutdown was an orderly strategic call: the founders judged the commercial Autopilot layer had no product-market fit, so they returned unspent capital rather than burn it.

The moat was shallow: hyperscalers and model vendors kept bundling gateways and observability, and competitor Langfuse was acquired by ClickHouse in January 2026.

Adoption and a big round don't equal a business: TensorZero had #1 trending, 11k stars and Fortune 10 users, but its paid layer never found buyers — an OSS company needs product-market fit twice.

As of late June 2026, TensorZero no longer operates: the repository is archived read-only under Apache 2.0, the official site states the project is no longer maintained, and no foundation or successor has adopted it. The founders returned the unspent majority of the $7.3M seed to investors; teams that built on the stack must fork and maintain it themselves or migrate to alternatives such as Langfuse (now under ClickHouse), LiteLLM or cloud-native routers.

FOLLOW THE EVIDENCE

The sources

  1. TensorZero raises $7.3M seed round to build an open-source stack for industrial-grade LLM applications The AI Journal (PR Newswire) · aijourn.com ·
  2. TensorZero Secures $7.3M To Advance Enterprise LLM Infrastructure Open Source For You · opensourceforu.com ·
  3. TensorZero Shutdown: What Happened and What You Lose Future Stack Reviews · future-stack-reviews.com ·
  4. Warum gibt TensorZero trotz 7,3 Mio. auf? Markt zu eng. Dr. Web · drweb.de ·