Paul Krill
Editor at Large

Mozilla.ai releases universal interface to LLMs

news
Nov 5, 20252 mins

Open-source Python library any-llm allows developers to switch among cloud and local model providers without rewriting code.

Programmer, teamwork and presentation with business people in office for website developer, coding and review. Mentor, collaboration and software engineer with group of employees in tech startup
Credit: PeopleImages / Shutterstock

Mozilla.ai, a company backed by the Mozilla Foundation, has released any-llm v1.0, an open-source Python library that provides a single interface to communicate with different large language model (LLM) providers.

any-llm 1.0 was released November 4 and is available on GitHub. With any-llm, developers can use any model, cloud or local, without rewriting a stack every time. This means less boilerplate code, fewer integration headaches, and more flexibility to pick what works best for the developer, Nathan Brake, machine learning engineer at Mozilla.ai, wrote in a blog post. “We wanted to make it easy for developers to use any large language model without being locked into a single provider,” Brake wrote.

Mozilla.ai initially introduced any-llm on July 24. The 1.0 release has a stable, consistent API surface, async-first APIs, and re-usable client connections for high-throughput and streaming use cases, Brake wrote. Clear deprecation and experimental notices are provided to avoid surprises when API changes may occur.

The any-llm v1.0 release adds the following capabilities:

  • Improved test coverage for stability and reliability
  • Responses API support 
  • A List Models API to programmatically query supported models per provider
  • Re-usable client connections for better performance
  • Standardized reasoning output across all models, allowing users to access LLM reasoning results regardless of the provider chosen
  • Auto-updating of the provider compatibility matrix, which shows which features are supported by which providers

Future plans call for support for native batch completions, support for new providers, and deeper integrations inside of the company’s other “any-suite” libraries including any-guardrailany-agent, and mcpd.

Paul Krill

Paul Krill is editor at large at InfoWorld. Paul has been covering computer technology as a news and feature reporter for more than 35 years, including 30 years at InfoWorld. He has specialized in coverage of software development tools and technologies since the 1990s, and he continues to lead InfoWorld’s news coverage of software development platforms including Java and .NET and programming languages including JavaScript, TypeScript, PHP, Python, Ruby, Rust, and Go. Long trusted as a reporter who prioritizes accuracy, integrity, and the best interests of readers, Paul is sought out by technology companies and industry organizations who want to reach InfoWorld’s audience of software developers and other information technology professionals. Paul has won a “Best Technology News Coverage” award from IDG.

More from this author