Run Local LLMs with Ollama + Open WebUI in Docker Want to run large language models like LLaMA 3 on your own machine — no OpenAI key, no internet required? Here’s a quick guide to get started with Ollama and Open WebUI using Docker Compose. Prerequisites Make sure you have the following installed: 🐳 Docker and docker compose (v2.20+ recommended) or Orbstack 🧠 A machine with at least: 8–16 GB RAM for basic models like llama3...
Kong Gateway’s declarative configuration approach is powerful, but it opens the door to subtle routing mistakes that can break your API in production. One of the most common issues I’ve recently encountered is malformed route paths: missing path arrays, empty strings, or accidentally defining paths as strings instead of arrays. These errors often slip through manual reviews and only surface when traffic starts failing. To catch these configuration errors early in our CI pipeline, I built a custom ruleset that enforces proper route path structure before deployment....
Introduction Today, I’m excited to share a detailed guide on setting up Kong Gateway in hybrid mode using Helm charts. This setup provides a base where you can start playing around the Kong Hybrid setup and build and expand your own setup on top of this. We’ll be using my GitHub repository which contains all the necessary configurations and scripts. Prerequisites Before we dive in, ensure you have: A Kubernetes cluster (Minikube, GKE, EKS, or AKS)....
Introduction While working on local API gateway projects, switching between multiple versions of the decK tool can be a hassle. While in automation setups or CI/CD pipelines, you often specify a specific decK version, DVM is designed specifically to make local development easier. With a few simple commands, you can install, switch, and list decK versions locally as needed. Motivation I developed DVM while working on a customer upgrade project where I had to validate API gateway configurations across multiple versions of Kong and decK....