Opportunity AI Engineering work from LinkedIn, X, Reddit and Upwork, in one list. Find me work
remoteroles

Applied AI Engineer

DistantJob Open
Remote Worldwide Full-time Mid-level AI Engineering

At a glance

Mid-level AI Engineering role at DistantJob. Remote · full-time.

Pay not stated Applied AI Engineer salary

RoleAI Engineering
SeniorityMid-level
LocationWorldwide
WorkplaceRemote
EmploymentFull-time
PostedNov 13, 2026
Role brief

remoteroles summary, based on the employer's posting.

What you'll do

  • Convert scenario plans, decision models and scoring rubrics into prompts, application logic and behavior you can test
  • Decide how models connect to APIs and approved data, setting validation, error handling and action boundaries
  • Build conversational systems with defined personas and session states, while preventing feedback from affecting assessment scores
  • Use approved knowledge sources to ground answers, adding source references when needed
  • Test prototypes with Product, launch validated versions alongside Engineering, and check their performance afterward

What you bring

  • You have built LLM applications involving conversational workflows that take multiple steps
  • You bring strong prompt, context, retrieval and agent design skills, plus structured outputs, evaluation and safety controls
  • You can use Python or TypeScript for API connections and automated tests, and work with Git
  • You have partnered with subject-matter experts and can explain technical trade-offs to non-technical colleagues

Who this fits

This fully remote, long-term role suits a hands-on engineer comfortable working across product, engineering, content and subject-matter teams. Experience in learning products, assessment, simulations or regulated professional content is preferred.

From the employer

Teaching AI to say yes is easy. Teaching it when to say ‘no,’ ‘I don’t know,’ or ‘let me get a human’ is the actual job. Our client is hiring an Applied AI Engineer to build the second kind.

The Applied AI Engineer designs, builds and tests the AI conversations and agents inside the client’s learner-facing products: advisory experiences, practice simulations and diagnostic coaching.

They work with Product, Content Studios, Engineering and subject-matter experts. They turn product and instructional requirements into reliable AI behavior, prove it through testing, and keep it performing after release.

This company is at the forefront of learning technologies, providing e-learning programs for professionals in regulated industries such as healthcare and finance. They’re constantly evolving and growing, run efficient Agile-first teams, and have a broadly distributed staff. They value good-natured, inquisitive, and methodical IT professionals who come prepared to collaborate and share their knowledge.

Your responsibilities will include:

  • Turn scenario specs, decision models and assessment rubrics into prompts, application logic and testable behavior.
  • Spot missing requirements and technical constraints, and raise them with Product, Engineering and SMEs.
  • Define how AI models connect to application services and approved data sources: APIs, tool interactions, data structures, validation, error handling, permitted actions.
  • Design prompts, structured outputs and validation logic, and catch invalid responses before they reach learners.
  • Build conversational runtimes with controlled personas, session state and explicit state transitions.
  • Keep simulation behavior, assessment logic and feedback separate, so feedback cannot change assessment results.
  • Implement grounding and retrieval from approved knowledge sources, with source references where required.
  • Keep code, prompts, schemas and evaluation assets under version control, and document them.
  • Run bounded experiments with Product, with clear questions and success measures.
  • Take validated prototypes into production with Engineering, and check behavior stays the same.
  • Help build the technical controls that keep AI features compliant with accreditation requirements (issue flagging, review steps, disclosure, logging).

What are the required skills?

  • Expert prompt and context engineering: system prompts, few-shot examples, prompt chaining, routing, breaking complex tasks into steps
  • Structured outputs with JSON Schema, function calling and validation layers, with retry and fallback logic
  • RAG design: chunking, metadata filtering, hybrid search, reranking, citation grounding
  • Managing token budgets, prompt caching, context compaction and long-session memory
  • Agentic systems: tool use, planner/executor patterns, multi-agent orchestration, state machines, human-in-the-loop checkpoints
  • Defining tool schemas, permission scopes and action limits for agents
  • AI evaluation: golden datasets, rubric-based scoring, LLM-as-judge calibrated against human raters, regression testing
  • LLM observability and tracing
  • LLM security: prompt injection, data leakage, jailbreaks, unsafe tool actions, and guardrails
  • Comparing prompting, retrieval and model options on quality, latency and cost
  • Python or TypeScript, including API integrations and automated testing
  • Git (e.g. Bitbucket), reproducible tests and CI
  • Works with AI coding agents by default
  • Explains technical trade-offs to non-technical colleagues
  • Sound judgment on privacy, human oversight and the limits of AI-generated assessment or advice
  • Hands-on experience building LLM applications with multi-step conversational workflows
  • Experience collaborating with subject-matter experts

Preferred

  • Background in learning products, assessment, simulations or regulated professional content

If this looks interesting, please use the form below to apply! Remember, this is a fully remote, long-term opportunity :)

Opportunity

AI Engineering work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

AI EngineeringRemote

Find me work

By the team behind remoteroles.

Find me work
Opportunity

AI Engineering work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Find me work

By the team behind remoteroles.