American Family Insurance ยท 6 hours ago
Lead Data Engineer (Hybrid)
American Family Insurance is looking for an experienced and driven Lead Data Engineer to guide their Data Platform team. In this role, you will oversee a team of engineers and create tools and infrastructure that empower various teams within the company.
Angel InvestmentFinanceVenture Capital
Responsibilities
Partner with stakeholders to refine undefined use cases into clear requirements, translate those into technical specs, and implement working solutions
Design and build platform capabilities that multiple teams consume, including feature stores, observability tooling, evaluation pipelines, and deployment patterns
Define and implement reusable patterns and infrastructure: shared LLM serving, evaluation frameworks, CI/CD templates, internal SDKs
Assess existing AI applications and establish standards for code quality, testing, deployment, and observability
Mentor data scientist and data engineers, conduct meaningful code reviews, and provide architectural guidance across the platform
Facilitate communication across project teams, architects, and business partners
Document critical workflows, standards, and operational support aspects of the platform
Qualification
Required
Demonstrated experience building AI/ML systems that run in production at scale - not notebooks or prototypes, but real software serving real users
Proven ability to take ambiguous, undefined problems and deliver shipped products
Strong system design skills with an emphasis on scalability, failure modes, and long-term maintainability
Deep software engineering fundamentals: experience with large codebases, design patterns, testability, and enterprise SDLC
Hands-on experience with LLMs in production: RAG, agents, evaluation, prompt engineering, or fine-tuning
Expert-level Python programming in a software engineering context, not just scripting or pipelines
Experience designing and building APIs for internal or external consumption
Deep experience with GCP, specifically Vertex AI, Pub/Sub, BigQuery, and NoSQL databases (e.g., Firestore, Bigtable)
Applied knowledge of Kubernetes for container orchestration and workload management
Experience with infrastructure-as-code tools (e.g., Terraform, Docker) and CI/CD pipelines
Benefits
Comprehensive medical, dental, vision and wellbeing benefits
Competitive 401(k) contribution
Pension plan
Annual incentive
9 paid holidays
Paid time off program (23 days accrued annually for full-time employees)
Student loan repayment program
Paid-family leave
Company
American Family Insurance
For more than 90 years, American Family Insurance has built its reputation on sound principles.
Funding
Current Stage
Late StageLeadership Team
Dan Reed
Founder. President, and MD
Recent News
Business Insider
2025-12-25
globalventuring.com
2025-12-13
2025-11-14
Company data provided by crunchbase