Senior Applied AI Engineer (GenAI & LLM Evaluation)
At a glance
Senior AI Engineering role at Acuity Analytics. Remote, United Kingdom · full-time · no salary stated · we estimate £75,000–£112,500 across the United Kingdom.
Acuity Analytics has not published a salary for this role. The figure below is our estimate, not theirs.
remoteroles summary, based on the employer's posting.
What you'll do
- Build and look after data pipelines and workflows that can scale
- Create testing frameworks for GenAI and LLM applications, including datasets used to check model outputs
- Measure and compare LLM results, then use ML-assisted tools to improve delivery and automation
- Take AI solutions from design through deployment, working with delivery teams on technical problems
- Improve data quality and automate work to make operations more efficient
What you bring
- At least five years in data engineering, machine learning, AI engineering or data science
- Strong Python and SQL skills, plus practical work with generative AI and large language models
- Experience testing LLMs with reference datasets, benchmarks or judge-based methods
- A track record of deploying production ML solutions and working with pipelines, data checks, APIs and cloud AI services
Who this fits
This is a hands-on senior role for someone comfortable owning AI solutions from initial design through launch. You’ll work across data science, engineering and delivery teams in a remote role based in the United Kingdom.
From the employer
About Us
Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.
About the role
We're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products.
Working alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies.
If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.
Skills and experience required
Core skills
5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
Strong Python and SQL skills.
Hands-on experience with Generative AI and Large Language Models (LLMs).
Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
Experience building and deploying production-ready ML solutions.
Strong understanding of data pipelines, validation, and quality frameworks.
Experience integrating APIs and cloud-based AI services.
Soft skills
Strong problem-solving and analytical skills.
Comfortable owning solutions end-to-end.
Excellent communication and stakeholder management.
Experience working in Agile, cross-functional teams.
Consulting or customer-facing experience is a plus.
What you will do
Build and maintain scalable data pipelines and workflows.
Develop evaluation frameworks for GenAI and LLM applications.
Create and maintain golden datasets for model testing.
Evaluate and benchmark LLM performance.
Build ML-assisted tools to improve delivery and automation.
Deploy production-ready AI solutions.
Work closely with delivery teams to solve technical challenges.
Continuously improve data quality, automation, and operational efficiency.
Why join us
People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details.
If you have any questions contact our Talent Acquisition team on ta.admin@acuityanalytics.
For more details about Acuity Analytics please see here: Read here.