Pluggable units of behavior running in the gateway request or response pipeline
View All TagsWhy and how to run a self-hosted LLM gateway: open-source options, deployment (Docker/Kubernetes), data control, and SaaS vs self-hosted trade-offs.
How MCP server authentication works: OAuth 2.1 with PKCE, token validation, the confused-deputy problem, and delegating auth to an identity provider. With examples.
What LLM fallback is and how to implement it: fallback chains, retries with backoff, and circuit breakers, to keep AI apps running through provider outages.
A practical guide to MCP implementations: architecture, official SDKs, reference/example servers, a step-by-step build, and a hands-on walkthrough governing an existing server with WSO2 AI Workspace.
Learn how to turn a REST API into an MCP server: map endpoints to tools, handle auth and schemas, and avoid the auto-convert trap. Step-by-step with examples.
What semantic caching is, how it works (embeddings + similarity), and how it cuts LLM cost and latency, plus best practices and gateway-level implementation.
Secure write-capable MCP tools at the gateway using access control, scope authorization, rate limiting, and Moesif analytics.