Software Engineer, Infra PyTorch (PhD) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Meta · 9 hours ago

Software Engineer, Infra PyTorch (PhD)

Meta builds technologies that help people connect, find communities, and grow businesses. They are seeking a Software Engineer to develop the core PyTorch 2.0 technologies and advance the state-of-the-art of ML compilers, while optimizing Generative AI models and collaborating with users of PyTorch.

Computer Software
check
Comp. & Benefits

Responsibilities

Develop the PT2 compiler (e.g., TorchDynamo, TorchInductor, PyTorch Distributed, PyTorch Core)
Improve PyTorch performance via systematic solutions for the entire community
Explore the intersection of the PyTorch compiler and PyTorch distributed
Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference)
Collaborate with users of PyTorch to enable new use cases of PT2 technologies both inside and outside Meta

Qualification

Compiler developmentMachine Learning systemsPython programmingC++ programmingPyTorch developmentGPU performanceML accelerator performanceSocial media presenceCommunication skillsCollaboration skills

Required

Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
Currently has or is in the process of obtaining a PhD degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
Research or industry experience in developing compilers, ML systems, ML accelerators, GPU performance, and similar
Advanced in Python or C++ programming

Preferred

Experience in developing PyTorch/PT2, Triton, MLIR, JAX, XLA, TVM is a huge plus
Knowledge in GPU architecture, ML accelerator performance, and developing high-performance kernels
Experience in building OSS communities and extensive social media presence in the ML Sys domain
Experience with training models, end-to-end model optimizations, or applying ML to systems
Knowledge of communication collectives, PyTorch distributed, and parallelism
Experience in developing inside other ML frameworks like Caffe2, TensorFlow, ONNX, TensorRT
First-authored publications at peer-reviewed conferences (e.g. NeurIPS, MLSys, ASPLOS, PLDI, ICML, or similar)

Benefits

Bonus
Equity
Benefits

Company

Meta's mission is to build the future of human connection and the technology that makes it possible.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Kathryn Glickman
Director, CEO Communications
linkedin
leader-logo
Christine Lu
CTO Business Engineering NA
linkedin
Company data provided by crunchbase