We are looking for MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling) candidates for a project delivered through Mercor.
What you'll do
- Design challenging, domain-relevant tasks across four areas, GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions to them.
- Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics.
- Evaluate MLOps and ML systems tasks and solutions, and provide clear, written technical feedback that stands up to reviewer scrutiny.
- Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
- Collaborate with other subject matter experts to keep training data consistent and accurate.
What you need
- 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering. This is a hands-on systems role rather than an applied modelling or data science one.
- Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom GPU kernels (CUDA, Triton, Pallas); performance profiling and trace analysis (Kineto, torch.profiler, Nsight, XLA or JAX profiler); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, Ray Serve, KV cache, paged attention, continuous batching).
- Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, distributed training (FSDP, DDP, DeepSpeed, Megatron), or compiler and graph-level work.
- Familiarity with modern accelerators such as A100, H100, B200 or TPU, and the ability to reason about throughput, latency and memory trade-offs.
- Demonstrable career progression.
- Ability to engage reliably for at least 40 hours/week during weekdays.
- Strong written communication skills and the ability to explain complex technical decisions clearly.
Expertise
MLOpsLarge Language Models (LLMs)GPU kernel programmingPerformance profiling and trace analysisDebugging accelerated and distributed workloadsHigh-throughput inference servingJAXPyTorchCUDATritonPallasKineto
RequiredAlso useful
Also listed: written communication.
Who you work with
Project and contracting process: Mercor. Applications continue on the provider's website.