Opportunity AI Research work from LinkedIn, X, Reddit and Upwork, in one list. Find me work
remoteroles

AI Researcher — Inference Optimization

Featherless AI featherless.ai Open
Remote Worldwide Full-time Mid-level AI Research

At a glance

Mid-level AI Research role at Featherless AI. Remote · full-time.

Pay not stated AI Researcher salary

RoleAI Research
SeniorityMid-level
LocationWorldwide
WorkplaceRemote
EmploymentFull-time
PostedJan 23, 2026
Role brief

remoteroles summary, based on the employer's posting.

What you'll do

  • Develop methods that make inference for large neural networks faster and more efficient
  • Tune latency, throughput, memory use and per-inference costs in production workloads
  • Apply model techniques such as quantization and pruning, alongside batching and kernel-level system changes
  • Test workloads on hardware accelerators and work with engineers to put improved pipelines into use
  • Turn research findings into deployable changes, supported by benchmarks and documentation

What you bring

  • A strong foundation in machine learning, deep learning or AI systems
  • Practical experience improving inference for large-scale models
  • Fluency in Python and modern ML frameworks such as PyTorch
  • Experience with inference platforms such as Triton, TensorRT or another listed tool
  • The ability to design experiments and explain the results clearly

Who this fits

This role suits a mid-level researcher focused on inference performance, spanning model design, systems work and hardware-aware tuning. It is remote and centers on bringing research improvements into production.

From the employer

Role Overview

We are seeking an AI Researcher with deep experience in inference optimization to design, evaluate, and deploy high-performance inference systems for large-scale machine learning models. You will work at the intersection of model architecture, systems engineering, and hardware-aware optimization, improving latency, throughput, and cost efficiency across real-world production environments.

Key Responsibilities

  • Research and develop techniques to optimize inference performance for large neural networks.

  • Improve latency, throughput, memory efficiency, and cost per inference.

  • Design and evaluate model-level optimizations (quantization, pruning, KV-cache optimization, architecture-aware simplifications).

  • Implement systems-level optimizations (dynamic batching, kernel fusion, multi-GPU inference, prefill vs decode optimization).

  • Benchmark inference workloads across hardware accelerators.

  • Collaborate with engineering teams to deploy optimized inference pipelines.

  • Translate research insights into production-ready improvements.

Required Qualifications

  • Strong background in machine learning, deep learning, or AI systems.

  • Hands-on experience optimizing inference for large-scale models.

  • Proficiency in Python and modern ML frameworks (e.g., PyTorch).

  • Experience with inference tooling (e.g., Triton, TensorRT, vLLM, ONNX Runtime).

  • Ability to design experiments and communicate results clearly.

Preferred / Nice-to-Have Qualifications

  • Experience deploying production inference systems at scale.

  • Familiarity with distributed and multi-GPU inference.

  • Experience contributing to open-source ML or inference frameworks.

  • Authorship or co-authorship of peer-reviewed research papers in machine learning, systems, or related fields.

  • Experience working close to hardware (CUDA, ROCm, profiling tools).

What Success Looks Like

  • Measurable gains in latency, throughput, and cost efficiency.

  • Optimized inference systems running reliably in production.

  • Research ideas successfully translated into deployable systems.

  • Clear benchmarks and documentation that inform product decisions.

Relevant Research Areas (Bonus)

  • Long-context inference optimization

  • Speculative decoding

  • KV-cache compression and paging

  • Efficient decoding strategies

  • Hardware-aware inference design

Opportunity

AI Research work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

AI ResearchRemote

Find me work

By the team behind remoteroles.

Find me work
Opportunity

AI Research work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Find me work

By the team behind remoteroles.