← Back to jobs

Kong AI Gateway Sr Engineer

Location
Jersey City, NJ
Work type
Full Time · On-site
Posted
2026-08-27

Job description

We are seeking an experienced Senior AI Gateway Engineer to lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform, with a primary focus on Kong AI Gateway. This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs) and other AI services. The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, and identity management to deliver a highly available AI platform that meets the demands of a regulated financial services environment.

Key Responsibilities
Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.
Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI.
Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and other AI services.
Implement intelligent model routing, failover, traffic shaping, and provider abstraction.
Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.
Architect and implement enterprise-grade identity controls for AI platforms, including OAuth 2.0, OIDC, JWT, and mTLS.
Implement AI security guardrails, policy enforcement, and controls for prompt injection protection, DLP, and PII redaction.
Design highly available and resilient AI platform architectures, including multi-region and cross-cloud recovery patterns.
Integrate AI Gateway services with cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), and Snowflake.
Build enterprise observability capabilities for AI workloads, including monitoring, metrics, tracing, and audit logging.
Required Qualifications

Education: A Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, or a related discipline is required.

Experience:
8+ years of experience designing and operating enterprise API, application, or cloud platforms.
5+ years of experience in cloud architecture and security.
3+ years working with AI/ML platform technologies or enterprise AI deployments.
Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions.
Experience within regulated industries such as financial services, banking, insurance, or capital markets is strongly preferred.
Preferred Qualifications
Master's degree in a relevant field.
Kong Certified Professional certification.
AWS Solutions Architect or Microsoft Azure Solutions Architect certification.
CISSP, CCSP, or equivalent security certification.
Experience implementing AI security controls and governance frameworks.
Familiarity with NIST AI RMF, NIST 800-53, NYDFS 500, PCI DSS, SOC 2, and other financial services regulatory requirements.
Experience with DSPM, DLP, and enterprise data protection controls.

Original source