#llm
2026
- From plugin to entities: local Ollama behind Kong AI Gateway 2.x
The same local Ollama model from the last post, now behind Kong AI Gateway 2.x on Konnect: a provider, a model and an API key instead of plugin config.
2025
- Run local LLMs with Ollama and Open WebUI in Docker
A pinned Docker Compose setup for Ollama and Open WebUI, what to expect on a Mac (CPU, not GPU), and how to put a gateway in front of it.