Ablate

Unrestricted small models. On your machine.

Open source by AI Anytime. No account, no cloud, no logs: your profile and chats live in a database file on this computer.

Welcome to Ablate.

Create a local profile. It never leaves this computer.

Local Open No cloud
your profile

Open source under Apache-2.0 · About Ablate

Welcome back.

Unlock your local Ablate Chat.

Forgot it? Run ablate chat --reset-passcode on this computer.

Ablate Chat

Please verify your age

These models have had their refusals removed and can produce content other assistants decline. To keep this a responsible environment, please confirm you are of legal age.

Home
AblateAblate
Chats
100% local. Chats are saved on this computer only.
A
Youlocal
0 / 4,096

Ready when you are

Pick a model to start. It downloads once, then runs offline.

Models

Run an unrestricted model on this computer, or connect one you host yourself on RunPod or any OpenAI-compatible server.

On this computer downloads once from HuggingFace, then runs offline

Self-hosted · RunPod & servers bigger models on your own GPU, for longer context and better tool use

Your pod needs an OpenAI-compatible server (vLLM) on an HTTP port. Setup guide ↗ · The key is stored only in your local Ablate database.
vLLM, llama.cpp server, Ollama (http://localhost:11434/v1), LM Studio, or a RunPod proxy URL.

Any other model

Downloads go to your HuggingFace cache. Remove a model here to free the disk space.

Memory

Facts added to every chat so the model remembers them. Stored on this computer in ~/.ablate/chat.

Use memory in chats

Settings

Profile

A
Display name
New passcode
A passcode locks the app and is required with --share.

Model behaviour

System prompt
Context window
How much of the conversation the model sees. Older messages are dropped first. Bigger uses more memory.
Max reply length
Temperature
0 = always the same answer. Higher = more creative.
Top-p
Repetition penalty

Tools

Local toolsCalculator, date and time, search your past chats.
Network toolsLets the model fetch public web pages. Off keeps everything offline.

OpenAI-compatible API

Point any OpenAI SDK, editor or agent at the loaded model.
The key is only needed from other devices. Requests from this computer work without it.

Data

Everything lives in ~/.ablate/chat. Delete that folder to reset. Terms, privacy and acceptable use.