apisix

Apache APISIX is a dynamic, real-time, high-performance API Gateway built on top of NGINX and etcd. It provides rich traffic management features including load balancing, dynamic upstream, canary release, circuit breaking, authentication, and observability. It handles both north-south and east-west traffic and can serve as a Kubernetes ingress controller. Key capabilities include: - **Multi-protocol support**: TCP/UDP proxy, Dubbo proxy, MQTT proxy, gRPC proxy, gRPC Web proxy, gRPC transcoding, WebSocket proxy, HTTP(S) forward proxy, SSL, and HTTP/3 with QUIC. - **Full dynamic configuration**: Hot updates and hot plugins without restarts, proxy rewrite, response rewrite, dynamic load balancing (round-robin and hash-based), health checks, circuit breaker, proxy mirror, and traffic split. - **Fine-grained routing**: Full path and prefix matching, Nginx built-in variables as routing conditions, various operators, custom route matching functions, IPv6 support, TTL, priority, batch HTTP requests, and GraphQL attribute filtering. - **Security**: Multiple authentication methods (key-auth, JWT, basic-auth, wolf-rbac, casbin, keycloak, casdoor), IP and referer whitelisting/blacklisting, IdP integration, rate limiting (limit-req, limit-count, limit-concurrency), Anti-ReDoS, CORS, URI blocker, request validation, and CSRF protection. - **Operations**: Zipkin tracing, Apache SkyWalking APM, external service discovery (Consul, Nacos, Eureka, Zookeeper), Prometheus monitoring, clustering, high availability, dashboard, version control with rollbacks, CLI, standalone mode, global rules, fault injection, REST Admin API, and extensive external logger integrations (HTTP, TCP, Kafka, UDP, RocketMQ, SkyWalking, SLS, Google Cloud, Splunk, File, Loggly, Tencent Cloud CLS, ClickHouse, Elasticsearch, Datadog). - **Highly scalable**: Custom plugins in Lua, Java, Go, Python, Node.js, and Proxy Wasm SDK; custom load balancing algorithms; custom routing. - **Serverless integration**: Lua functions, AWS Lambda, Azure Functions, and Apache OpenWhisk. - **AI Gateway**: AI proxying to route traffic to different LLM providers through a unified interface, load balancing/retries/fallbacks across multiple LLMs, token-based rate limiting, robust security for AI workloads, and the mcp-bridge plugin to convert stdio-based MCP servers to scalable HTTP SSE services. APISIX is platform-agnostic with no vendor lock-in, runs from bare-metal to Kubernetes, and supports ARM64. The single-core QPS reaches 18k with average delay under 0.2 milliseconds, and on an AWS eight-core server, QPS reaches 140,000 with 0.2 ms latency. It is licensed under Apache 2.0.