Clawdbot + Ollama
Run Clawdbot with zero API costs. Ollama lets you run powerful LLMs like Llama 3, Mistral, and more completely locally on your own hardware.
No monthly bills from OpenAI or Anthropic. Once set up, it's completely free to use.
Your data never leaves your machine. Perfect for sensitive conversations and business use.
Send as many messages as you want. No quotas, no throttling, no waiting.
System Requirements
- β’ 8 GB RAM
- β’ 10 GB free disk space
- β’ Any modern CPU (4+ cores)
- β’ GPU optional but helps
- β 16 GB+ RAM
- β Apple Silicon (M1/M2/M3) or NVIDIA GPU
- β SSD storage
- β Mac Mini M2/M4 is perfect!
Setup Guide
Download and install Ollama for your platform:
# macOS / Linux
curl -fsSL https://ollama.ai/install.sh | sh
# Windows: Download from ollama.ai
Pull Llama 3.1 (recommended for most users):
ollama pull llama3.1
# This downloads ~4.7 GB
Update your Clawdbot .env file:
# .env file
AI_PROVIDER=ollama
OLLAMA_HOST=http://localhost:11434
OLLAMA_MODEL=llama3.1
Restart Clawdbot and enjoy free AI:
clawdbot restart
# Now using local Llama 3.1!
Available Models
| Model | Size | Speed | Quality | Command |
|---|---|---|---|---|
Llama 3.1 8BRecommended | 4.7 GB | Fast | Good | ollama pull llama318b |
Llama 3.1 70B | 40 GB | Slow | Excellent | ollama pull llama3170b |
Mistral 7B | 4.1 GB | Fast | Good | ollama pull mistral7b |
Mixtral 8x7B | 26 GB | Medium | Very Good | ollama pull mixtral8x7b |
Phi-3 | 2.2 GB | Very Fast | Decent | ollama pull phi-3 |
Gemma 2 9B | 5.4 GB | Fast | Good | ollama pull gemma29b |
Pro Tips
π Speed Up with GPU
Apple Silicon and NVIDIA GPUs automatically accelerate inference. A Mac Mini M2 can run Llama 3.1 8B at 30+ tokens/second.
πΎ Manage Disk Space
Models are stored in ~/.ollama. Use ollama list to see installed models and ollama rm modelname to delete.
π Run Ollama as Service
On Linux, Ollama runs as a systemd service automatically. On Mac, use ollama serve in the background.
π Remote Access
To access Ollama from another machine, set OLLAMA_HOST=0.0.0.0 (careful with security!).