ByteDance · 18 hours ago
Sr. Multimodal Model Training and Inference Optimization Engineer
San Jose, CA
Full-time
Onsite
Mid, Senior Level
$209K/yr - $438K/yr
3+ years expByteDance is a leading technology company focused on inspiring creativity and enriching life through innovative products. The role involves optimizing AI model training and inference, enhancing performance and scalability of large-scale generative AI models.
Telecom & CommunicationsArtificial Intelligence (AI)Social MediaDigital MediaBig DataContentData MiningFoundational AIInternet
Responsibilities
Optimize large model training pipelines to improve efficiency, speed, and scalability
Develop and improve distributed training strategies such as data parallelism, model parallelism, pipeline parallelism and communication to accelerate model training
Benchmark and profile deep learning models to identify performance bottlenecks and optimize computational resources
Qualification
Required
M.S or PhD in Computer Science, Electrical Engineering, Artificial Intelligence, or a related field
3 years+ experience in AI model training optimization
Strong software engineering skills, including proficiency in Python, C++, and CUDA
Strong proficiency in deep learning frameworks such as PyTorch, Megatron and Deepspeed
Experience with distributed training techniques such as data parallelism, model parallelism, and pipeline parallelism
Knowledge of transformers and diffusion models
Preferred
Candidates with publications at conferences such as MLSys, NeurIPS, ICLR, or ICML are preferred
Strong communication and teamwork skills
Self-motivated and strong problem-solving skills
Ability to work collaboratively in multi-functional teams
Experienced in implementing and optimizing complex and performance-critical systems
Benefits
Medical, dental, and vision insurance
A 401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
10001+ employees
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Kohlberg Kravis Roberts Japan,Sequoia Capital
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Jochen Bischoff
Head of Global Business Solutions - Africa
Matty Lin
General Manager, Global Business Solutions, KR
Recent News
South China Morning Post
2026-02-04
Company data provided by crunchbase