Cisco · 3 hours ago
Machine Learning Engineer (Remote)
United States
Full-time
Remote
Mid Level
$165K/yr - $209K/yr
3+ years expCisco is a leader in revolutionizing how data and infrastructure connect and protect organizations in the AI era. The Machine Learning Engineer will implement and maintain features for AI inference services, improve performance for generative workloads, and collaborate with product teams to build new models and features.
Communications InfrastructureEnterprise SoftwareHardwareSoftware
Responsibilities
Implement and maintain features for AI inference services, including vLLM- and Ray-based serving stacks, routing layers, and orchestration services
Help improve latency, throughput, and cost for LLM and generative workloads by contributing to batching, caching, and other performance optimizations
Contribute to Kubernetes-native control planes for autoscaling, placement, and capacity management of GPU and CPU workloads across regions and clouds
Implement and extend platform capabilities such as telemetry, metering & throttling, guardrails, and rollout/rollback, ensuring services are observable and safe by default
Integrate inference services with VectorDB/RAG, identity & access, networking, and observability stacks under the guidance of more senior engineers
Participate in code reviews, on-call rotations, and post-incident reviews, helping to drive reliability and operational excellence for the AI Platform
Collaborate with applied scientists and product teams to produce new models and features on top of the platform
Qualification
Required
Bachelor's degree in computer science, Engineering, or equivalent practical experience
3+ years of hands-on experience building and operating backend or distributed systems in production or 2+ years of experience with Master's degree
Proficiency in at least one modern programming language (e.g., Python, Go, or Java) and solid foundation in software engineering best practices
Practical experience with containerization and Kubernetes (e.g., Docker, Helm, basic deployment and service concepts)
Experience designing and implementing REST/gRPC services or microservices, with attention to correctness, robustness, and basic observability (metrics, logs, tracing)
Evidence of end-to-end ownership on projects or services: design participation, implementation, testing, deployment, and production support
Preferred
Experience working with LLM or ML inference systems or interest in learning frameworks such as vLLM, TensorRT-LLM, or Triton Inference Server
Familiarity with GPU concepts (CUDA, basic performance considerations) or distributed systems concepts such as sharding, load balancing, and caching
Exposure to RAG architectures and VectorDB systems (Weaviate, Qdrant, Milvus, FAISS, etc.)
Experience with AWS or Azure cloud services (EC2/VMs, IAM roles, VPC basics) and an understanding of security best practices for cloud workloads
Background contributing to platforms or shared services used by multiple teams (e.g., internal APIs, SDKs, feature flags, shared libraries)
Experience implementing dashboards, alerts using Prometheus, Skynet, or cloud-native observability tools
Strong communication skills, willingness to ask questions, and a growth mindset—comfortable learning from senior engineers and progressively taking on more ownership
Benefits
Medical, dental and vision insurance
A 401(k) plan with a Cisco matching contribution
Paid parental leave
Short and long-term disability coverage
Basic life insurance
10 paid holidays per full calendar year
1 floating holiday for non-exempt employees
1 paid day off for employee’s birthday
Paid year-end holiday shutdown
4 paid days off for personal wellness
16 days of paid vacation time per full calendar year
Flexible vacation time off program
80 hours of sick time off
Up to 80 hours of unused sick time carried forward
Optional 10 paid days per full calendar year to volunteer
Annual bonuses subject to Cisco’s policies
Performance-based incentive pay on top of their base salary
Company
Cisco
Cisco develops, manufactures, and sells networking hardware, telecommunications equipment, and other technology services and products. It is a sub-organization of Cisco Press.
10001+ employees
H1B Sponsorship
Cisco has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1238)
2024 (1231)
2023 (1273)
2022 (2127)
2021 (1991)
2020 (1173)
Funding
Current Stage
Public CompanyTotal Funding
unknown1990-02-13IPO
Leadership Team
Chuck Robbins
Chair and CEO
Carl Solder
Chief Technology Officer - Cisco System Australia/New Zealand
Recent News
2026-02-05
Company data provided by crunchbase