AI Transformation Engineer

What You'll Do

Production LLM systems (40%)

Build and run production LLM workflows in n8n and similar platforms: retrieval over ticket and documentation data, answer drafting and routing.
Build APIs, integrations and data pipelines that connect CRM, support and operational systems.
Build and calibrate confidence scoring so teams know when to trust an answer, and design the review steps and approval gates where a person decides.
Protect the data you work with: scope what each workflow can read, handle PII and sensitive fields, and keep access logs.
Ship every solution monitored, error-handled and version-controlled, not just functional.

Evals and quality (15%)

Define evals before each build: test sets, groundedness and accuracy checks, and the thresholds that decide whether output ships or needs review.
Report quality results to partner teams in plain terms.
Track LLM spend and usage by team, manage API keys, and report run rate.

Knowledge transfer and enablement (20%)

Pair-build with embedded team members so they learn by doing, not by watching.
Write documentation that scales: runbooks, admin guides, architecture diagrams and decision logs.
Train department champions at the right altitude: enough to maintain and extend, not enough to overwhelm.
Build with handoff in mind from day one. The owning team should run each system day to day within 30 days of launch. They own workflow configuration, prompts, review queues and reports. You keep the retrieval, eval and scoring code until a second engineer can take it.

System design and architecture (15%)

Design integration patterns that connect CRM, support and operational systems.
Architect data flows that enable automation and AI-powered decisions.
Evaluate new models and tools, and make build-vs-buy recommendations grounded in the team's real maintenance capacity.

Opportunity identification (10%)

Spot automation and integration opportunities others miss by understanding how work actually gets done.
Translate technical possibilities into language department stakeholders can evaluate.
Estimate effort honestly and scope tightly: cut work that does not change the outcome, and say so early.

What You Have

5 to 8 years in software engineering, integration development or automation engineering.
Production experience with a workflow platform such as n8n, Zapier or Tray.io, building automations that other teams rely on.
Experience designing reliable autonomous agents: agent frameworks and patterns such as tool calling, orchestration, guardrails and human escalation, with eval feedback loops that keep output high quality and consistent.
Python or TypeScript for the work a platform cannot do, with API design skills and an understanding of how software is operated: monitoring, error handling, version control and deployment discipline.
Hands-on production use of LLM APIs (Anthropic, OpenAI or Google), including prompt design and structured outputs.
Retrieval experience: vector databases such as Qdrant or pgvector, chunking and grounding.
Experience measuring LLM output quality with test sets, graded review or evals.
Experience handling sensitive data in production systems: PII, permissions and audit logging.
A teaching instinct. You explain what you build and why, and you notice when someone is lost before they say so.
Documentation discipline, and the ability to explain trade-offs to non-technical stakeholders without jargon.

Bonus Points

MCP servers, agent frameworks or tool-calling design.
Experience governing a shared LLM cost budget or API keys.
CRM systems (Salesforce, HubSpot), data engineering or ETL, and warehouse analytics such as Snowflake.
Familiarity with support, customer success or professional services operations.
Experience building internal tools where the users are colleagues, not customers.
Training, facilitation or mentoring experience, formal or informal.
Comfort in ambiguous environments where requirements evolve as understanding deepens.