Start Here

Welcome to the OpenArc documentation! These docs are under construction but cover everything in the 2.0.3 README.

Installation

• Linux
• Windows
• Docker

Commands

OpenArc includes a command line tool for controlling the server.

• openarc add — Add a model to the config.
• openarc list — List models added to the config.
• openarc serve — Start the OpenArc server.
• openarc load — Load a model from the config.
• openarc status — Check loaded models.
• openarc bench — Benchmarking tool for LLMs.
• openarc tool — OpenVINO utilities.

Models

Models to get you started and where to find more!

OpenArc is deeply integrated with the Huggingface Ecosytem and has been written from the ground up to handle a ton of deployment complexity but still demands some calories to choose what models to use.

We are working on improving this process with experimental GGUF support coming, as well as a new frontend application similar to LM-Studio!

Below are some models to get started which are known to work.

• Model Sources
• LLMs
• VLMs
• Text to Speech
  • Whisper
  • Qwen3-ASR
• Speech to Text
  • Kokoro
  • Qwen3-TTS
• Embedding
• Rerank