K
Senior Software Engineer, AI Gateway
Kong
22 days ago
Full-time
Remote
Worldwide
Remote Engineering
Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others. THE MISSION The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. In this role you will design and build the core of the gateway that handles live AI traffic: the runtime and data plane that route, translate, secure, and observe every request, with the performance and reliability our customers depend on. WHAT YOU’LL DO - Own the technical direction for core AI Gateway features, from design to production rollout. - Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua. - Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic. - Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platform... Click Apply to read the full job description.