AI Platform Engineer
- Location
- New York, NY
- Work type
- Full Time
- Posted
- 2026-07-20
Job description
RESPONSIBILITIES:
Design, develop, and deploy production AI applications utilizing foundation models such as OpenAI, Anthropic, Gemini, or equivalent technologies.
Build reusable Model Context Protocol (MCP) servers that securely expose enterprise tools, APIs, and data sources.
Develop AI agents capable of planning, reasoning, and executing complex business workflows.
Design and implement Retrieval-Augmented Generation (RAG) solutions utilizing enterprise knowledge bases and vector databases.
Build scalable backend services using Java (Spring Boot) and/or Python.
Design and develop secure RESTful APIs and enterprise integrations.
Implement AI evaluation frameworks, observability, prompt testing, monitoring, and cost optimization practices.
Collaborate with business stakeholders to identify, prioritize, and deliver high-value AI use cases.
Mentor software engineers and promote AI engineering best practices across development teams.
Contribute to the ongoing evolution of Bayview’s Enterprise AI Platform architecture and reusable AI services.
Participate in code reviews, technical design discussions, and software architecture planning.
Produce technical documentation supporting development, deployment, and operational processes.
Stay current with emerging AI technologies, frameworks, and industry best practices.
QUALIFICATIONS:
Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline required.
REQUIRED SKILLS & EXPERIENCE:
Bachelor’s degree in Computer Science, Engineering, or a related technical field.
5+ years of professional software engineering experience building scalable backend applications.
Strong proficiency in Java (Spring Boot) and/or Python.
Experience developing REST APIs, SQL-based applications, and distributed systems.
Experience with Git, Docker, and Kubernetes.
Hands-on experience building production Generative AI applications using Large Language Models (LLMs) such as OpenAI, Anthropic, Gemini, or similar.
Experience with AI frameworks such as LangGraph, LangChain, Semantic Kernel, LlamaIndex, CrewAI, AutoGen, or similar.
Experience with Retrieval-Augmented Generation (RAG), vector databases, embeddings, and AI agent development.
Familiarity with cloud AI platforms including Azure AI, AWS Bedrock, or Google Vertex AI.
Understanding of Model Context Protocol (MCP) is preferred.
Strong analytical, problem-solving, communication, and collaboration skills.
Experience working in Agile software development environments.
Experience building enterprise AI platforms or reusable AI services.
Financial services or asset management experience.
Knowledge of AI governance, security, evaluation, and observability.
Experience with enterprise search, workflow automation, or open-source AI technologies.
LOCATION AND COMPENSATION:
This role will be located in our New York, NY office.
The expectation for this role will be hybrid, with 3 days on-site (Tues – Thurs)
The compensation range provided for this position will be based on years of relevant experience.