Senior AI/ML Platform Engineer
At a glance
Senior ML Platform & Ops role at Lyra Health. Remote, United States · full-time · $143,000–$197,000 base.
remoteroles summary, based on the employer's posting.
What you'll do
- Build shared machine learning and generative AI platforms that teams across the organization can use
- Create backend infrastructure designed to keep solutions scalable, resilient and responsive
- Develop services for machine learning and AI products, then deploy and run applications in production
- Write code daily and guide teammates while taking ownership of cross-functional projects
What you bring
- At least six years delivering products ready for production use
- Strong Python coding skills and experience with asynchronous web frameworks and streaming data
- Hands-on experience with Docker, Kubernetes, relational and low-latency databases, and vector databases
- Experience building RAG solutions and monitoring LLM behavior, including latency, token use and output quality
Who this fits
This senior role suits a hands-on engineer who enjoys building systems from the ground up, learning new tools and balancing quality with deadlines. You’ll work remotely in the United States and collaborate across engineering, product, data science and clinical teams.
From the employer
We are looking for an experienced Senior AI/ML Platform Engineer who is eager to build the platforms, infrastructure and services necessary to deliver ML and generative AI based products that make a significant impact within the organization. The ideal candidate will be enthusiastic about taking ownership of their work, spearheading cross-functional projects, and providing guidance and mentorship to other team members.
Responsibilities
-
Thrive on working with brilliant teammates to solve complex, meaningful problems
-
Are passionate about making a social impact and supporting people at their most challenging moments
-
Enjoy cross-functional collaboration with therapists, data scientists, engineers and product managers
-
Be part of a team working on building our machine learning and generative AI platforms that will be used by teams across the company
-
Create the necessary backend infrastructure and platform to enable scalable, resilient and highly performant solutions
-
Build services that are used in machine learning and AI based products
-
Deploy and manage various applications in production
-
And of course, you will be coding every day!
Lyra is for you if you:
In this role, you will:
Qualifications
-
6+ years of experience delivering production ready products
-
Ability to write high-quality code in Python
-
Experience with modern async Python web frameworks (e.g., FastAPI) and handling data streaming (WebSockets, Server-Sent Events)
-
Experience working with Docker and deploying applications to Kubernetes
-
Experience with relational and low-latency databases
-
Experience building RAG based AI solutions
-
Experience setting up and maintaining vector databases
-
Familiarity with LLM orchestration frameworks (e.g., LangChain, LlamaIndex) and integrating with foundation model APIs (e.g., OpenAI, Anthropic, AWS Bedrock)
-
Experience with LLM observability and monitoring tools (e.g., Langfuse) to track latency, token usage, and output quality.
-
A desire to learn new technologies quickly
-
A love of building systems from scratch
-
A thoughtful approach to balancing quality and deadlines in fast-paced settings
-
Excellent communication skills with a talent for building consensus and alignment
-
Strong organizational skills and the ability to distill complex
Preferred Qualifications
-
Experience with Graph Databases (e.g., Neo4j, AWS Neptune) and integrating them into AI/Knowledge systems (e.g., GraphRAG)
-
Experience working with Celery
-
Experience defining and using Protobuf messages
-
Experience writing production code in Java/Kotlin
-
Experience building solutions on cloud infrastructure, particularly AWS
-
Experience working with highly sensitive data in a healthcare environment