Machine Learning Performance Engineer

Machine Learning Performance Engineer (Inference) High-Frequency Trading FirmCompensation: $600,000-1.5 million totalAbout the OpportunityA leading high frequency trading firm is hiring a Machine Learning Performance Engineer to sit at the intersection of quantitative research and high-performance production systems. In his role, you'll architect inference pipelines that operate at the physical limits of hardware, driving the speed, efficiency, and reliability of ML inference so predictive models consistently achieve microsecond-level latency.GPU usage across the firm's trading teams has grown roughly 100x in the past year as deep learning has moved from a supporting signal to the core of how strategies are built. That growth has outpaced the decision-making around it. Strategies get pushed onto GPUs by default, without anyone systematically asking whether GPU is the right target at all. This role owns that question end to end: benchmark the workload across CPU, GPU, and FPGA, decide the architecture on evidence, then optimize and deploy against it.You will also have the chance to revisit existing models that never reached production, some of which stalled for hardware or deployment reasons, and run them through different environments to determine where they belong.What You'll DoBenchmarking & StrategyLead the technical evaluation of inference platforms across CPUs, GPUs, and FPGAs to guide infrastructure deployment decisionsBenchmark trading workloads across architectures before compute is committed, and identify where performance gains actually come from — code-level or hardware-levelSystem Architecture OptimizationAnalyze and enhance execution across deep memory hierarchies to maximize resource utilization and parallel processingAssess and resolve memory subsystem and interconnect bottlenecks across the end-to-end inference lifecycleInfrastructure & Deployment FeasibilityWork with Infrastructure teams to understand the thermal, power, and operational constraints of hardware platforms, and design inference strategies for latency-critical trading strategies that fit within those envelopesConsider the interaction between trading workloads, compute requirements, hardware selection, and fleet utilizationGPU Kernel DevelopmentDevelop highly optimized kernels and integrate specialized performance libraries to extract maximum computational throughput from the underlying siliconModel Optimization & DeploymentImplement advanced model reduction techniques — quantization, pruning, distillation — to ensure compact memory footprints and numerical stabilityPrioritize optimization for low-latency, event-level inference workloads that meet real-time trading requirementsCross-Functional CollaborationPartner closely with ML Researchers, HPC Engineers, FPGA Engineers, and Datacenter Engineers to bring target deployments to productionWhat We're Looking For2+ years optimizing deep learning inference in latency-sensitive or high-throughput production environments, in any domainML frameworks: deep expertise in lower-level ML framework development (PyTorch/JAX), paired with strong Python/C++ skills and a thorough understanding of mixed-precision computationKernel development and tooling: proven experience building custom GPU kernels, with deep familiarity with optimization libraries and compilers (Triton, TensorRT, ONNX, IREE, HLS4ML, cuBLAS, CUTLASS) and profiling tools (Nsight Systems, Nsight Compute)GPU architecture: deep expertise in GPU microarchitecture, including SM execution, warp scheduling, and full memory hierarchy optimization from registers to HBMCross-architecture benchmarking: a rigorous, data-driven track record evaluating inference performance across heterogeneous compute architecturesPrior experience in financial trading is not required.Nice to HavePractical experience targeting and optimizing inference workloads on specialized hardware ecosystems, including FPGAs and ASICsWhy Join?This is a role with genuine decision-making scope. Rather than optimizing code for whatever hardware happens to be available, you will determine which hardware the workload should run on in the first place, prove it with data, and then build for it. That combination of architectural judgment and hands-on kernel, and the results are measurable in production almost immediately.You'll work on inference at microsecond latency, where the constraints are physical rather than theoretical, and where memory hierarchy, interconnect behavior, thermal envelopes, and fleet utilization all shape the answer.Benefits include generous paid time off, regional savings and financial wellness plans, hybrid working options, free breakfast, lunch, and snacks daily, in-office wellness experiences and reimbursement for select wellness expenses, company-sponsored sports teams and fitness events, volunteer and charitable giving opportunities, regular social events, and ongoing workshops and learning opportunities.The culture is collaborative and low on hierarchy, smart, driven people, an open-plan workspace, casual dress, and an environment where the best idea wins.Equal opportunity employer.