Guidehouse · 4 hours ago
Databricks Data Engineer
Arlington, VA
Full-time
Onsite
Senior Level
7+ years expGuidehouse is a consulting firm specializing in data engineering and architecture. The Databricks Data Engineer will develop and implement data pipelines, ensure data quality and compliance, and collaborate with other data professionals to support machine learning workflows.
AdviceConsultingManagement Consulting
Responsibilities
Develop and implement CI/CD pipelines for Databricks notebooks and jobs
Develop ETL pipelines using PySpark and Databricks
Implement Delta Lake for ACID transactions and data reliability
Optimize ingestion from APIs, streaming, and batch sources
Ensure compliance with data governance and security standards
Collaborate with data engineers and scientists to support data pipelines and ML workflows
Conduct ETL and data quality analysis using various technologies (i.e., Python, Databricks)
Ensure data governance and quality assurance standards are met
Organize and lead meetings, including scheduling meetings; drafting and delivering agendas and meeting minutes; providing and archiving required documentation; and documenting, tracking, and following up on action items
Summarize and present information and reports to the team and make recommendations (both oral and written)
Qualification
Required
Bachelor's degree is required
Minimum SEVEN (7) years of total experience in cloud-based data platforms
Minimum FIVE (5) years experience with Databricks
Strong scripting skills (Python, Bash)
Experience with Delta Lake and Unity Catalog
Strong knowledge of Spark architecture and distributed computing
Hands-on experience with Terraform or other IaC tools
Experience with Unity Catalog and Delta Lake
Experience with data modeling and performance tuning
Experience with streaming technologies (Kafka, Event Hub)
Experience with using CI/CD for data pipelines
Familiarity with Kubernetes and container orchestration
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills, with the ability to work effectively in a team environment
Preferred
Databricks Certified Data Engineer Associate or Professional
Azure Data Engineer Associate or AWS Big Data Specialty
Benefits
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Position may be eligible for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities
Skills Development & Certifications
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Emergency Back-Up Childcare Program
Mobility Stipend
Company
Guidehouse
Guidehouse offers consulting services for public and commercial markets with expertise in management, technology, and risk consulting.
10001+ employees
H1B Sponsorship
Guidehouse has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (23)
2024 (20)
2023 (29)
2022 (49)
2021 (50)
2020 (59)
Funding
Current Stage
Late StageTotal Funding
$0.75MKey Investors
Mission Daybreak
2023-11-06Acquired
2023-02-16Grant· $0.75M
Leadership Team
Scott McIntyre
Chairman and CEO
Alicia Harkness
Partner
Recent News
Washington Technology
2025-11-20
Washington Technology
2025-11-19
Company data provided by crunchbase