Awesome Open

Project record

OpenLLM

OpenLLMServe language models through OpenAI-compatible API endpoints.Apache-2.0
Field notes / 294OpenLLM
I / Function

Serve language models through OpenAI-compatible API endpoints.

OpenLLM serves open and custom language models through an OpenAI-compatible API. Its command-line interface starts a model server, while a browser chat interface and terminal chat provide ways to try it. Built on BentoML, it supports local serving and deployment through containers or Kubernetes, with a model catalog and registration of additional model repositories.

OpenLLM official documentation · Reviewed 2026-10-28

An apricot vessel houses interchangeable copper-and-black cores that release folded pale ribbons.
Awesome Open* · Field recordOpenLLMOP-9D0676F8 · Folio 294Domain: AI & Language Models
  1. 01 / Feature noteCompatible model endpoint

    A served model exposes an OpenAI-compatible API for application clients.

    Feature source ↗
  2. 02 / Feature noteInteractive chat

    Built-in browser and terminal chat interfaces connect to the running model server.

    Feature source ↗
II / Repository record

GitHub stars

12,582

Detected license

Apache-2.0

Repository created

2023-04-19

Repository push

2026-11-02

III / Observations & evidence

GitHub stars

Unknown

i
Window mismatch; awaiting refresh

Cached history uses a different month window; chart withheld until aligned.

Latest attempt: ok · Checked 2026-10-15T19:40:39.600225+00:00 · Last successful fetch 2026-10-15T19:40:39.600225+00:00 · Provider source

Hacker News stories

Unknown

i
Not recorded

OpenSSF Scorecard

Unknown

i
Unavailable

No result returned.

Checked 2026-10-26T19:44:31Z · Latest attempt: not found · Provider source

IV / Release record

GitHub release

v0.6.30

Published 2025-04-21

i
Available

Checked 2026-11-04T04:04:05Z · Last successful fetch 2026-11-04T04:04:05Z · Value fetched 2026-11-04T04:04:05Z · Provider source

V / Where it runs

Unknown

i
Not reviewed