Skip to main content
K

Senior Software Engineer, AI Gateway (Machine Learning)

Kong
25 days ago
Full-time
Remote
Worldwide
Remote Engineering
Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others. THE MISSION The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. Some of the gateway’s more advanced capabilities, such as intelligent model routing, semantic caching, request classification, and content guardrails, work best when backed by small, purpose-built models. In this role you will build those features end to end: the gateway code that runs them in the request path, and the models behind them. WHAT YOU’LL DO - Own the technical direction for model-backed AI Gateway features, from design to production rollout. - Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua. - Train, fine-tune, and evaluate models for specific gateway use cases, such as classifiers for intelligent routing, embeddings for semantic cach... Click Apply to read the full job description.