ByteDance · 19 hours ago
Software Engineer, Inference
Seattle, WA
Full-time
Onsite
Entry, Mid Level
$178K/yr - $342K/yrByteDance is a company dedicated to pioneering advanced AI foundation models. They are seeking a Software Engineer specializing in Inference to develop and optimize LLM inference frameworks and enhance GPU and CUDA performance for high-performance LLM inference engines.
ContentData MiningFoundational AIInternetSocial Media
Responsibilities
Responsible for developing and optimizing LLM inference framework
Responsible for GPU and CUDA Performance optimization to create an industry-leading high-performance LLM inference engine
Qualification
Required
Bachelor's degree or above, major in computer/electronics/automation/software, etc
Proficient in C/C++, proficient in algorithms and data structures, familiar with Python
Understand the basic principles of deep learning algorithms, be familiar with the basic architecture of neural networks and understand deep learning training frameworks such as Pytorch
Preferred
Knowledge of LLM models, experience in accelerating LLM model optimization is preferred
Proficient in GPU high-performance computing optimization technology on CUDA, in-depth understanding of computer architecture, familiar with parallel computing optimization, memory access optimization, low-bit computing
Familiar with TensorRT-LLM, ORCA, VLLM, etc
Benefits
Medical, dental, and vision insurance
A 401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
Founded in 2012
10001+ employees
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Jochen Bischoff
Head of Global Business Solutions - Africa
Matty Lin
General Manager, Global Business Solutions, KR
Recent News
DealStreetAsia
2026-01-18
Business Insider
2026-01-18
2026-01-16
Company data provided by crunchbase