ECS · 1 month ago
Sr. Databricks Consultant
ECS is a leading mid-sized provider of technology services to the United States Federal Government. They are seeking a Sr. Databricks Consultant to work remotely, responsible for consulting with customers to optimize their Databricks environments for advanced data analytics and machine learning.
Artificial Intelligence (AI)Cloud InfrastructureComplianceConsultingCyber SecurityInformation TechnologyMachine LearningSecuritySoftware
Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines in Databricks
Optimize workflows and clusters for performance and cost efficiency
Integrate Databricks with cloud platforms (AWS, Azure, or GCP)
Implement data governance, security, and compliance standards
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights
Troubleshoot issues and drive continuous improvement in data infrastructure
Qualification
Required
Proven experience working with Databricks in production environments
Strong proficiency in Python and/or SQL for data engineering
Experience with Apache Spark for distributed data processing
Knowledge of data lakehouse architecture and best practices
Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage)
Hands-on experience building and managing ETL/ELT pipelines
Strong understanding of data modeling, data quality, and performance tuning
Familiarity with CI/CD pipelines and version control (Git)
Able and willing to obtain a US Security Clearance
Ability to travel, as needed, to customer sites
Must be a US Citizen per contract
Bachelor's degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree
Preferred
Master's degree or PhD in Computer Science, Data Science, or a related field
Experience with machine learning pipelines in Databricks (MLflow)
Knowledge of Delta Lake and Unity Catalog for governance
Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs)
Exposure to data visualization tools (Tableau, Power BI, or Looker)
Experience with Terraform, ARM, or CloudFormation for infrastructure as code
Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.)
Strong understanding of DevOps/MLOps practices
Prior consulting or customer-facing experience
Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments
Company
ECS
ECS is a fast-growing 4,000-person, $1.2B provider of advanced technology solutions for federal civilian, defense, intelligence, and commercial customers.
Funding
Current Stage
Late StageTotal Funding
unknown2018-01-31Acquired
2015-04-10Private Equity
Recent News
2025-11-19
2025-03-26
2025-02-14
Company data provided by crunchbase