Ejecutar un LLM con archivos Kiwix offline gratis sin ChatGPT.
Escuchar este artículo
✅ What to do after running the script
- Put your
.zimfiles somewhere, for example:
~/zimfiles/
Or set:
export KIWIX_HOME=~/zimfiles
- Run a query:
llm -m llama3.2 --tool kiwix_search_and_collect "How do I install Gentoo?"
The LLM will:
- Search inside your ZIM file
- Extract relevant article content
- Use Llama 3.2 locally to answer
No API keys needed. No LangChain. No internet.
Completely offline.
🔥 Want an even better version?
I can also generate:
- A TUI (terminal UI) browser
- A web UI
- A local RAG server
- A fully packaged Arch
PKGBUILD
Just tell me what you want.
You want to know how to use llm-tools-kiwix, right? I’ll break it down step by step so you can get a fully working setup without OpenAI, using a free local model.
1️⃣ Install llm CLI
If you haven’t already:
python -m venv llm-tools-kiwix
pip install llm
or follow their official instructions.
Check it works:
llm --version
2️⃣ Install llm-tools-kiwix
llm install llm-tools-kiwix
Check installed tools:
llm tools list
You should see:
kiwix_searchkiwix_search_and_collectkiwix_read
3️⃣ Install a free local LLM (Ollama recommended)
Step A — Install Ollama
Follow instructions for your OS: https://ollama.com/download
Step B — Pull a free model
ollama pull llama3.2 (2 GB)
ollama pull deepseek-r1 (5 GB)
Step C — Install llm-ollama plugin
llm install llm-ollama
Step D — Set default model
llm models set-default ollama/llama3.2
llm -m llama3.2
Now llm will use your local LLM instead of OpenAI.
4️⃣ Use llm-tools-kiwix
Make sure you have at least one ZIM file (e.g., Wikipedia):
llm --tool kiwix_search "Gentoo installation"
Or to retrieve and read articles:
llm --tool kiwix_search_and_collect "How do I install Gentoo"
You can also directly read a specific article:
llm --tool kiwix_read "Gentoo/Installation"
5️⃣ Notes / Tips
- By default,
kiwix_searchsearches titles only. kiwix_search_and_collectfetches the full article text.- You don’t need any API key if you’re using Ollama.
If you want, I can make a single “copy-paste” script that:
- Installs
llm - Installs
llm-tools-kiwix - Installs Ollama and pulls a free model
- Lets you query a ZIM file immediately
This way, you can run one command and have it working fully offline.
Do you want me to do that?
Below is a single copy-paste script that sets up everything you need:
✅ llm CLI
✅ llm-tools-kiwix
✅ llm-ollama
✅ Ollama + free model
✅ Fully offline ZIM search + LLM answering
Works on Arch Linux (since you’re on Arch).
🚀 ONE-COMMAND FULL SETUP SCRIPT (ARCH LINUX)
Copy this entire block and save it as setup_kiwix_llm.sh, then run:
bash setup_kiwix_llm.sh
📌 setup_kiwix_llm.sh
#!/usr/bin/env bash
set -e
echo "=== Updating system ==="
sudo pacman -Sy --noconfirm
echo "=== Installing Python + pip ==="
sudo pacman -S --noconfirm python python-pip
echo "=== Installing llm CLI ==="
pip install --upgrade llm
echo "=== Installing llm-tools-kiwix ==="
llm install llm-tools-kiwix
echo "=== Installing llm-ollama backend ==="
llm install llm-ollama
echo "=== Installing Ollama ==="
# Official Arch package
sudo pacman -S --noconfirm ollama
echo "=== Starting Ollama service ==="
sudo systemctl enable --now ollama.service
echo "=== Pulling free local LLM (Llama 3.2) ==="
ollama pull llama3.2
echo "=== Setting Llama 3.2 as default llm model ==="
llm models set-default ollama/llama3.2
echo ""
echo "======================================================"
echo " Setup complete!"
echo " You can now run offline ZIM + LLM commands, for example:"
echo ""
echo ' llm --tool kiwix_search "Gentoo installation"'
echo ' llm --tool kiwix_search_and_collect "How do I install Gentoo?"'
echo ""
echo "Place your ZIM files in the current folder or set KIWIX_HOME."
echo "======================================================"
llm -m llama3.2 \
--tool kiwix_search \
--zim zim-llm/zim_library/gentoo_en_all_maxi_2021-03.zim \
"How do I install Gentoo?"
