Pluggable units of behavior running in the gateway request or response pipeline
View All TagsA full walkthrough registering Amazon Bedrock as a provider and attaching its native guardrail to a WSO2 AI Gateway, with both requests and responses validated.
Block prompt injection and unsafe LLM requests before they reach the model. Chain content length, word count, regex, and semantic prompt guard on the WSO2 AI Gateway.
Why and how to run a self-hosted LLM gateway: open-source options, deployment (Docker/Kubernetes), data control, and SaaS vs self-hosted trade-offs.
How MCP server authentication works: OAuth 2.1 with PKCE, token validation, the confused-deputy problem, and delegating auth to an identity provider. With examples.
What LLM fallback is and how to implement it: fallback chains, retries with backoff, and circuit breakers, to keep AI apps running through provider outages.
A practical guide to MCP implementations: architecture, official SDKs, reference/example servers, a step-by-step build, and a hands-on walkthrough governing an existing server with WSO2 AI Workspace.
Learn how to turn a REST API into an MCP server: map endpoints to tools, handle auth and schemas, and avoid the auto-convert trap. Step-by-step with examples.
What semantic caching is, how it works (embeddings + similarity), and how it cuts LLM cost and latency, plus best practices and gateway-level implementation.
Secure write-capable MCP tools at the gateway using access control, scope authorization, rate limiting, and Moesif analytics.