mosaic v0.9.6/Chat · Code · Crea on your machinesDocs

Chat with AI.
Let it act on your code.

Mosaic is the app for talking to AI and getting work done. Start in Chat for questions and ideas, connect a repository in Code, or use Crea to create images today—and soon music, video, and more—on linked machines.

$curl -fsSL https://mosaic.methil.group/api/install | sh

Open App Documentation See benchmark results

[CHAT]Ask and plan

Start with questions, explanations, and ideas.

[CODE]Change your code

Inspect files, edit code, and run tests with context.

[CREA]Create locally

Generate images today, with music, video, and more to come.

[LOCAL]Run it your way

Use local models or choose a connected machine.

[GITHUB]Finish the work

Review changes and open a pull request when ready.

// ARCHITECTURE & CAPABILITIES

Built for local performance and explicit data boundaries.

ENGINE01

Hardware Auto-Detection

Automatically probes system memory and hardware accelerators (Apple Silicon Metal, NVIDIA CUDA, AMD ROCm, CPU). Calculates layer offload and context budget with zero manual flags.

›Metal · CUDA · ROCm · AVX2

›Dynamic VRAM & RAM sizing

TOOLS02

Deterministic Tool Protocol

Autonomous tool loop equipped with ripgrep code search, line-accurate file editing, command execution, and recursive subagents. Validates mutations before touching disk.

›grep_search · read_file · edit_file

›run_command · background tasks

RUNTIMES03

Open-Weights Inference

Native backends for running Qwen3.8, Qwen3.5, DeepSeek, Gemma, and Llama locally or through existing local servers without vendor lock-in.

›MLX · llama.cpp · vLLM · SGLang

›GGUF · safetensors

WORKFLOW04

GitHub & Fleet Orchestration

Link remote GPU workstations or laptops with `mosaic machine link`. Trigger jobs, stream live terminal logs, and publish GitHub pull requests directly from the web dashboard.

›Branch & PR creation

›End-to-end encrypted logs

CREA05

Connected Crea

Create on a linked machine without moving models to the cloud. Image generation is available today, with the same fleet designed to expand to music, video, and more.

›Image · Music · Video · More

›Queue across linked machines

PRIVACY06

Explicit Data Boundaries

Local CLI runs stay on your machine. Hosted analysis, Docker sandbox runs, and linked-machine jobs are explicit choices with separate capability controls. Telemetry remains opt-in.

›Local-first execution

›Opt-in remote routes

EVALUATION07

Mosabench Benchmark

Bundled with a reproducible benchmark evaluating local LLMs on 70+ multi-language software engineering tasks across Node, Rust, Python, Go, and Java.

›70+ SWE tasks

›Deterministic pass@1 scoring

Model & Family	Target Hardware	Optimized Quantization	Context Window	Runtime status
Qwen3.8 27B · Q4_K_MRecommended Alibaba Qwen · GGUF vision	`24GB+ unified memory / VRAM`	Q4_K_M · mmproj BF16	`Configured by runtime`	Runtime-dependent
Qwen3.8 27B · BF16Recommended Alibaba Qwen · Hugging Face	`64GB+ RAM / unified memory`	BF16 · safetensors	`Configured by runtime`	Runtime-dependent
Qwen3.5 9BRecommended Alibaba Qwen	`16GB+ RAM / Metal / CUDA`	MLX 4-bit / Q4_K_M	`Configured by runtime`	Runtime-dependent
GPT-OSS 20BRecommended OpenAI Open-Weights	`24GB+ RAM / RTX 3090 / 4090`	HF MXFP4 (SGLang) / Q6_K	`Configured by runtime`	Runtime-dependent
Qwen3.5 35B A3B Alibaba Qwen MoE	`32GB+ RAM / Mac Studio / A100`	Q3_K_M / MLX 4-bit	`Configured by runtime`	Runtime-dependent
Gemma 3 12B Google Gemma	`16GB+ RAM / Any Platform`	Q4_K_M / Q8_0	`Configured by runtime`	Runtime-dependent

// GETTING STARTED

From a question to a finished change.

Start in Chat

Ask questions, explore ideas, or plan your next move.

mosaic chat

Connect your code

Open a repository when you want Mosaic to inspect or edit files.

cd my-project && mosaic .

Let Mosaic act

Run tests, review the changes, and open a pull request.

mosaic "Fix memory leak in buffer pool and run test suite"

Ready to try the Mosaic App?

Start with a chat, connect a repository, or create on a linked machine with Mosaic Crea.