CLIO Coder
All tutorials

Model choice6 min read

Choose a model for your project

Connect a local server, a cloud API, or a supported subscription route, then choose models separately for conversation and delegated work.

Written for
v0.8.0
Works in
Terminal · Desktop alpha
Basis
Documented workflow
Updated
Guided setup after choosing a model server and entering its address: the server is reachable with one model, qwen3.8-27b is taken as the only one listed, the test message is answered, and the connection is saved as the chat and worker default, with a note that the server reported no context window.
A server that lists one model skips the picker; setup tests it and saves. Review choices appear only when the test fails. Terminal · v0.8.0
On this pageBefore you start Decide where inference may run Connect one model Ask one question you can check Separate conversation from worker models Choose capabilities deliberately

CLIO Coder lets you choose the model connection around your project. Start with the place your code is allowed to go, then choose a model and runtime that can do the task. A local GPU, a model server, an institutional gateway, and a cloud API are different deployment choices.

If you already connected a model, skip to Separate conversation from worker models below.

Before you start

  • Linux, macOS, or WSL. The installer supplies Node.js.
  • A repository you know, so you can judge the first answer.
  • One model route you are allowed to use for this code: an app on your computer, a model server, an AI subscription, or a provider account.

Decide where inference may run

On first setup, Guided setup asks what you have. Choose by where the model input may go, then by what you already run.

Answer Where inference runs What it covers
An API key The provider Anthropic, OpenAI, Google, OpenRouter, Groq, Mistral, DeepSeek, and others
A subscription The provider ChatGPT Plus or Pro, Claude Pro or Max, or GitHub Copilot
A model server or gateway The server you name Ollama, LM Studio, llama.cpp, vLLM, LiteLLM, or any OpenAI-compatible address
A setup file from my lab or team The targets the file names A path or https address someone gave you

When setup finds a route first, such as a provider key in your environment or a model server on a default local port, it lists that route before asking. A subscription-backed route has its own authentication and usage conditions; it is not interchangeable with an API account. The connection guide covers each route.

Where each part runs

  1. Your computer

    CLIO Coder and its tools

    The session, repository tools, and approvals run where you start CLIO Coder.

  2. model requests

    The route you choose

    Inference

    A local app, a model server, a subscription, or a provider API.

  3. delegated work

    Where a worker runs

    Worker tools

    On this computer by default, or on an SSH node you configure.

CLIO Coder, its tools, and inference can run in different places. Choosing a remote model does not move your files or tools there.

Connect one model

  1. Install CLIO Coder

    Shell

    curl -fsSL https://coder.iowarp.ai/install.sh | sh
    cd /path/to/your/project
  2. Start guided setup

    Shell

    clio-coder configure

    Choose Guided setup. The desktop alpha offers the same wizard after clio-coder gui --open. In a terminal session, /config opens your connections, where Add a target runs the wizard without leaving the session.

  3. Pick the route and the model

    Answer what you have, then provide the key, sign-in, or server address it asks for. Setup takes the provider's recommended model, or the only model a server lists; otherwise you pick from the list. For a local server with no models, load one and choose Check again.

  4. Test the connection, then save

    Setup sends the model one short test request and saves when it answers. After a failure you can try again, change the key or address, or choose Save anyway. The first connection supplies the chat and worker defaults, and /model changes the model later.

  1. Guided setup in the terminal after it found a model server: it offers the LiteLLM gateway on this machine with model qwen3.8-27b, or Set up something else for an API key, a subscription, or another server.

    01 When setup finds a model server it offers it first; Set up something else leads to the routes. Terminal · v0.8.0

  2. Guided setup in the terminal asking what you have: an API key, a subscription, a model server or gateway, or a setup file from your lab or team, with the providers behind the first three and a path or https address for the setup file.

    02 Guided setup asks what you have: an API key, a subscription, a model server or gateway, or a setup file. Terminal · v0.8.0

  3. Guided setup after choosing a model server and entering its address: the server is reachable with one model, qwen3.8-27b is taken as the only one listed, the test message is answered, and the connection is saved as the chat and worker default, with a note that the server reported no context window.

    03 A server that lists one model skips the picker; setup tests it and saves. Review choices appear only when the test fails. Terminal · v0.8.0

Guided setup in the terminal: a model server it found, the routes it offers, and the saved connection.

What you should see

When setup shows a model list, the list says whether it is live, cached, or the provider's catalog; a server that lists one model skips the list. The test request shows that the model answers; it does not test tool calling. An answer is useful, but it is not a coding benchmark.

Ask one question you can check

Ask CLIO Coder

Explain this project's build and test entry points. Do not change files. Identify one check I could run to confirm your explanation.

Read the tool activity and compare the answer with the project. If it fails, check the endpoint, the loaded model, the credentials, and the selected runtime before giving it a larger assignment. clio-coder doctor provides diagnostics; it does not certify model quality.

Separate conversation from worker models

The model answering you need not handle every delegated task. The terminal /settings groups its rows into seven areas below Recent & Pinned, with the conversation model under Models and worker defaults under Workers.

clio-coder configure --settings opens the shell menu, which uses eight sections instead: the conversation model is under Chat and worker defaults under Fleet. On the desktop, Settings has a Models page and a Fleet routes tab. Select a connection and model for conversation, then use worker defaults or profiles for delegated work.

  1. Terminal Settings open on Models: the healthy litellm connection used by chat and workers, the chat connection and model qwen3.8-27b, thinking level and maximum answer length, beside the list of settings sections.

    01 Settings: the model answering you, under Models. Terminal · v0.8.0

  2. Terminal Settings open on Workers at the top: the default worker's connection litellm, model qwen3.8-27b, thinking level Off and location Automatic, then profiles, agent routes, automatic routing and machines.

    02 Settings: the default worker's connection, model and thinking level, under Workers. Terminal · v0.8.0

Terminal settings keep the conversation model and the worker defaults apart.

This helps when exploring a repository and changing code have different requirements, or when you want to keep a workflow while evaluating another model. The benefit depends on the task and environment; this guide makes no claim that a particular combination is cheaper or faster.

A worker running on your machine against a remote model server is still a local worker: inference and tool execution are separate choices. To run the worker process on another machine, use the fleet configuration.

Choose capabilities deliberately

CLIO Coder supports more than one kind of model interaction. Its Inception runtime serves Mercury diffusion language models as chat models with tool calling. Optional, experimental System One routes answer typed questions an agent asks through consult. Neither replaces a chat model or is required to get started.

Vision support depends on the model and the route. A model advertised as multimodal is not enough if the bridge does not carry images: the managed Codex, Pi, OpenCode, Claude Code, and Antigravity CLI bridges are text-only. Check what the route accepts before attaching a screenshot.

Know where information goes

  • CLIO Coder runs locally, but a configured cloud model receives the input sent to that provider.
  • Local inference keeps inference on the selected server; tools, peers, plugins, and commands can still make network requests.
  • CLIO Coder is Apache 2.0 software. Inference hardware, provider usage, and subscriptions can still cost money.

By The CLIO Coder team · CLIO Coder

Continue with the documentation