Arango · 5 hours ago
Join Team Arango!Senior AI Infrastructure Engineer
United States
Full-time
Remote
Senior Level
5+ years expArango is a company focused on providing a trusted data foundation for enterprise AI with graph-based Contextual AI. They are seeking a Senior AI Infrastructure Engineer to maintain and debug their AI infrastructure, requiring strong technical problem-solving skills and experience in production environments.
Big DataDatabaseEnterprise SoftwareOpen SourceSoftware
Responsibilities
Maintain, develop and stabilize AI infrastructure services
Architect and implement foundational services and shared libraries that scale our entire AI infrastructure ecosystem
Debug complex, non-obvious production issues across application, process, network, and memory layers
Systematically analyze, isolate, and resolve failures in unclear scenarios
Improve observability, profiling, and tracing across services
Work with distributed microservices and internal platforms
Operate and improve systems running on Docker, Kubernetes, and Helm
Support CI/CD pipelines (CircleCI), testing, and security-relevant components
Work with MLflow, Triton, and distributed Python modules
Qualification
Required
Senior-level experience (minimum 5+ years)
Passion for working with cutting-edge technologies in a fast-moving AI environment, including LLM-based workflows and pipelines
Comfortable working independently in a fast-paced, evolving environment
Strong debugging skills in complex, distributed systems with the ability to identify root causes when failures are ambiguous
Solid understanding of how software behaves in production environments
Experience designing and operating microservices, distributed systems, and databases
Proven experience building and scaling high-availability services
Python (primary language) - 5+ years
Docker, Kubernetes, Helm - 5+ years
CI/CD pipelines and testing frameworks (e.g., CircleCI)
Observability tools: metrics, logs, tracing, and profiling
Exposure to AI/ML infrastructure, including tools such as MLflow and Triton
Preferred
Customer-facing experience, including proofs of concept (PoCs) or technical demos
Experience with AI/ML infrastructure and orchestration, i.e., MLflow and Triton
Cross-language debugging experience
Familiarity with Rust
Experience working with databases, NoSQL, multi-model, or graph databases
Knowledge of Retrieval-Augmented Generation (RAG) and GraphRAG concepts
Understanding of graph algorithms and graph-based data modeling
Company
Arango
Arango provides a trusted data foundation for Contextual AI — transforming enterprise data into a System of Context that truly represents the business, so LLMs can deliver better outcomes with unlimited scale and cost efficiency.
51-200 employees
H1B Sponsorship
Arango has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (1)
Funding
Current Stage
Growth StageTotal Funding
$47.02MKey Investors
IRISBow CapitalTarget Partners
2021-10-06Series B· $27.8M
2019-03-14Series A· $10M
2017-06-29Seed· $4.8M
Leadership Team
Shekhar Iyer
Chief Executive Officer
Jason Heine
Chief Financial Officer
Recent News
2025-01-17
2024-01-26
Company data provided by crunchbase