Senior Software Engineer – Compute Infrastructure (C++) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Aurtiro · 3 weeks ago

Senior Software Engineer – Compute Infrastructure (C++)

Aurtiro is focused on building virtualization software that maximizes GPU utilization for AI workloads. The role involves designing low-level runtimes, networking stacks, and scheduling layers to create efficient compute platforms, requiring strong systems fundamentals and experience in performance-sensitive software development.

Staffing & Recruiting
Hiring Manager
Joe Boys
linkedin

Responsibilities

Build the core software that isolates, schedules, and multiplexes GPU workloads across thousands of accelerators with minimal overhead
Design high-performance C++ services for resource allocation, job dispatch, and data-path optimization
Profile end-to-end: memory layout, scheduling policies, network utilization
Implement and optimize the stack below CUDA: RDMA, GPU-direct communication, and ultra-low-latency interconnects (NVLink, InfiniBand, RoCE)
Explore novel approaches to container startup, model loading, multi-tenancy, and failure handling

Qualification

C++Performance optimizationSystems fundamentalsLow-level networkingGPU computingDistributed systemsDebugging skillsPrototyping skillsCapacity planningResource accounting

Required

Strong systems fundamentals: concurrency, memory management, OS internals, networking
Experience building performance-sensitive software in C++ (or Rust/Go if you're willing to work in C++)
Comfort with ambiguity—able to prototype, measure, debug hard problems, and iterate toward production-quality systems
Excited by extremely complex debugging, profiling tools, and making things measurably faster
Track record shipping and sustaining performance-focused infrastructure or runtime systems
Fluency in diagnosing reliability + performance issues in distributed environments

Preferred

GPU computing (CUDA, ROCm, NCCL), accelerator runtimes, or HPC workloads
Distributed systems, schedulers, or orchestration (Kubernetes, Slurm, custom frameworks)
High-speed networking or storage systems at scale
Scheduling/orchestration, capacity planning, resource accounting
Profiling/tracing (perf, flamegraphs, custom instrumentation)
High-performance networking (RDMA/DPDK/kernel bypass) or equivalent systems depth
Performance work involving accelerators or high-throughput I/O

Benefits

Competitive compensation
Meaningful early-stage equity

Company

Aurtiro

twitter
company-logo
Aurtiro is a boutique technical search firm focused on C++ and Rust low-latency systems engineers.

Funding

Current Stage
Early Stage
Company data provided by crunchbase