QA Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

H2O.ai · 18 hours ago

QA Engineer

positionMountain View, CA
timeFull-time
remoteHybrid
seniorityEntry, Mid Level
money$105K/yr - $130K/yr
date2+ years exp

H2O.ai is on a mission to democratize AI and is seeking a QA Engineer to ensure the quality and reliability of their product portfolio. The role involves designing and maintaining automation frameworks, performing manual testing, and collaborating with feature teams in an Agile environment.

AnalyticsArtificial Intelligence (AI)Machine LearningSoftware
check
H1B Sponsor Likelynote

Responsibilities

Design, build, and maintain Python-first automation frameworks (pytest + Playwright + async) for UI, API, and end-to-end workflows of h2o.ai's product portfolio
Perform deep exploratory and manual testing of the h2o.ai's product portfolio web UI (chat interfaces, document upload/processing, agent builder, maker suite, evaluation hub, enterprise admin console)
Use h2o.ai's product portfolio itself (and other GenAI tools) in creative ways to: Generate realistic test documents, datasets, and edge-case prompts. Auto-generate or refine test cases via prompt engineering. Rapidly summarize and debug massive, complex log files (e.g., Kubernetes pods, etc.). Explain cryptic LLM traceback chains or hallucination root causes in seconds instead of hours
Root-cause of difficult, intermittent failures in distributed RAG/LLM systems by combining traditional log analysis with GenAI-assisted debugging
Create and execute chaos experiments targeting LLM routing, vector database latency, GPU OOM, retrieval failures, and token-limit edge cases
Build and manage ephemeral h2o.ai's product portfolio clusters on Kubernetes for testing (Helm, custom operators)
Own UI regression suites (Playwright) and accessibility testing
Write reproducible, high-quality bug reports that developers love and regularly verify fixes across the full stack
Collaborate closely with the h2o.ai's product portfolio feature teams in an Agile environment and influence testability from the design phase

Qualification

PythonKubernetesAutomation frameworksPlaywrightGenerative AI toolsCI/CDAgile environmentManual testingExploratory testingLog analysis

Required

2-4 years of QA experience with a strong mix of automation and hands-on manual/exploratory testing
Decent Python skills and experience building maintainable test frameworks from scratch
Real-world experience testing modern React/TypeScript web applications and writing bulletproof Playwright or Selenium tests
Hands-on Kubernetes experience in a testing or test-environment context (kubectl, Helm, writing manifests, debugging pods)
Proven ability to use generative AI tools daily to accelerate debugging, test-data creation, and log analysis (you've already used h2o.ai's product portfolio, ChatGPT, Claude, or similar in your current QA workflow)
Comfort reading and triaging complex logs from LLM frameworks, vector DBs, and tracing systems
Solid grasp of CI/CD (GitHub Actions preferred) and infrastructure-as-code concepts

Preferred

Prior experience testing RAG systems, agentic workflows, or enterprise chat/assistant platforms
Experience with visual diffing of generated outputs (documents, charts, markdown)
Chaos engineering on Kubernetes (Chaos Mesh, Litmus) or GPU workloads
Familiarity with Chaos engineering principles
Basic understanding of containerization (Docker/Kubernetes concepts like pods and kubectl) in a testing context

Benefits

Market leader in total rewards
Remote-friendly culture
Flexible working environment
Be part of a world-class team
Career growth

Company

H2O.ai

twittertwittertwitter
Glassdoor3.1
company-logo
H2O.ai is a machine learning platform that builds smart applications.
dateFounded in 2012
location
Mountain View, California, USA
people-size201-500 employees
web-link
http://h2o.ai

H1B Sponsorship

H2O.ai has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (1)
2023 (2)
2021 (4)
2020 (5)

Funding

Current Stage
Late Stage
Total Funding
$251.1M
Key Investors
Commonwealth Bank of AustraliaWells FargoPaxion Capital Partners
2023-05-12Secondary Market
2021-11-07Series E· $100M
2019-08-20Series D· $72.5M

Leadership Team

leader-logo
Sri Ambati
Founder and Chief Executive Officer
linkedin
leader-logo
Arno Candel
Chief Technology Officer
linkedin

Recent News

Business Wire
H2O.ai Appoints Jason Finney as President and Chief Revenue Officer to Accelerate Global Growth in Agentic, Secure, and Responsible AI
2025-11-20
PR Newswire
Former Deputy CIO of Executive Office of the President, and the First CIO & CISO of CISA David Epperson Joins Knox Systems Federal Advisory Board
2025-10-29
Business Wire
H2O.ai Brings NVIDIA Nemotron and NVIDIA NIM Microservices into Enterprise AI
2025-10-29
Company data provided by crunchbase