ShiftCode Analytics, Inc. · 3 months ago
Machine Learning Performance Engineer
United States
Full-time
Remote
Mid, Senior LevelShiftCode Analytics, Inc. is focused on optimizing the performance of machine learning models. The Machine Learning Performance Engineer will be responsible for enhancing both training and inference efficiency, requiring strong pre-sales abilities and a comprehensive understanding of modern ML techniques.
AnalyticsConsultingInformation Technology
Responsibilities
Optimizing the performance of our models – both training and inference
Improving straightforward CUDA
Ensuring our platform makes sense even at the lowest level
Debugging a training run's performance end to end
Debugging and optimization experience using tools like CUDA GDB, NSight Systems, NSight Compute
An understanding of the collective algorithms supporting distributed GPU training in NCCL or MPI
An inventive approach and the willingness to ask hard questions about whether we're taking the right approaches and using the right tools
Qualification
Required
Must be willing to travel
Must have strong pre-sales abilities i.e. presentation skills, communication skills, etc
Must be willing to help train employees and customers
An understanding of modern ML techniques and toolsets
The experience and systems knowledge required to debug a training run's performance end to end
Low-level GPU knowledge of PTX, SASS, warps, cooperative groups, Tensor Cores, and the memory hierarchy
Debugging and optimization experience using tools like CUDA GDB, NSight Systems, NSight Compute
Library knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS
Intuition about the latency and throughput characteristics of CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads
Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, and NVLink, and how to use these networking technologies to link up GPU clusters
An understanding of the collective algorithms supporting distributed GPU training in NCCL or MPI
An inventive approach and the willingness to ask hard questions about whether we're taking the right approaches and using the right tools
Company
ShiftCode Analytics, Inc.
ShiftCode Analytics Inc is a Tampa, FL based firm formed with one sole purpose of delivering best and quick services to its clients nationwide.
Founded in 2019
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase