AI Prompt Engineer IV

Description

tango is seeking an experienced AI Prompt Engineer IV to lead the development, optimization, governance, and operational excellence of enterprise AI solutions. This role will serve as Tango's internal subject matter expert for prompt engineering and AI performance management, ensuring AI-driven solutions deliver measurable business value, accuracy, compliance, and scalability.
While the initial focus will include ownership and optimization of Clinical ADI and Referral ADI workflows, this position is intended to establish and expand Tango's long-term internal AI capabilities. The successful candidate will reduce organizational dependence on external vendors by creating internal expertise in prompt engineering, AI governance, testing, monitoring, change management, and enterprise AI adoption.
This role partners closely with Clinical Operations, Referral Management, IT, Product, Business Intelligence, Compliance, and executive leadership to design and support AI-driven solutions that improve operational efficiency, clinical support processes, and business outcomes across the enterprise.

Key Responsibilities

Enterprise AI Strategy & Prompt Engineering

Design, develop, test, and optimize prompts for large language models (LLMs) and AI-driven workflows.
Continuously improve prompt performance through experimentation, measurement, and refinement.
Develop reusable prompt frameworks, templates, and standards to ensure consistency across AI implementations.
Translate complex business processes into AI-assisted solutions that improve productivity, quality, and scalability.
Identify new opportunities for AI adoption throughout Tango's business operations.

AI Governance & Quality Assurance

Establish enterprise standards for prompt engineering, AI usage, documentation, and governance.
Develop testing and validation methodologies to ensure AI outputs meet business, operational, and compliance requirements.
Create auditability, version control, and approval processes for prompt modifications.
Implement prompt lifecycle management practices, including change control, release management, and rollback procedures.
Partner with Compliance and Privacy teams to ensure responsible and compliant use of AI technologies.

AI Performance Monitoring & Optimization

Monitor production AI solutions for quality, accuracy, consistency, drift, and operational performance.
Develop dashboards, metrics, and reporting to measure AI effectiveness and business impact.
Analyze user feedback and operational outcomes to identify improvement opportunities.
Establish formal feedback loops with stakeholders and business users to continuously improve AI performance.

Vendor Management & Knowledge Transfer

Partner with external AI vendors to support implementation and optimization activities.
Drive knowledge transfer from third-party vendors to internal teams.
Evaluate vendor performance and recommend improvements, modifications, or alternative solutions.
Build internal capabilities that reduce long-term reliance on external AI consulting resources.

Enterprise AI Innovation

Research emerging AI technologies, prompt engineering techniques, and industry best practices.
Pilot and evaluate new AI use cases and tools.
Support future AI initiatives across business functions, including clinical operations, referral management, customer service, quality, analytics, finance, HR, and corporate functions.
Serve as an internal advisor and educator on AI best practices and opportunities.

Required Qualifications

Bachelor's degree in Computer Science, Data Science, Information Systems, Business Analytics, Engineering, or related field.
7+ years of experience in technology, analytics, process improvement, AI, automation, product management, or related disciplines.
3+ years of direct experience working with generative AI platforms, large language models, prompt engineering, or AI solution development.
Experience designing, testing, and optimizing AI workflows in production environments.
Demonstrated understanding of LLMs, retrieval-augmented generation (RAG), prompt chaining, model evaluation, and AI performance measurement.
Experience developing business requirements and translating them into technical AI solutions.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and stakeholder management abilities.

Preferred Qualifications

Experience in healthcare, managed care, home health, utilization management, or healthcare operations.
Experience with Microsoft Copilot, Azure AI, OpenAI, Anthropic, Google Gemini, or similar platforms.
Familiarity with SQL, Python, Power Automate, APIs, workflow automation, or low-code platforms.
Experience establishing AI governance, responsible AI frameworks, or quality assurance programs.
Project management or product ownership experience.
Experience working with healthcare compliance and regulatory environments.

Knowledge, Skills & Abilities

Prompt Engineering
Large Language Models (LLMs)
AI Governance
Natural Language Processing (NLP)
Machine Learning Concepts
AI Performance Optimization
Data Analysis & Analytics
Production Monitoring
Testing & Validation Frameworks
Process Improvement
Business Transformation
Vendor Management
Change Management
Technical Documentation
Problem Solving & Troubleshooting