RBA, Inc. · 3 days ago
Senior Data Engineer/Databricks Expert- Contract
United States
Contract
Remote
Senior Level
$70/hr - $100/hr
5+ years expRBA, Inc. is an established leader and trusted partner for enterprise and mid-size organizations seeking to transform their business through technology solutions. They are seeking a Senior Data Engineer with strong Databricks expertise to architect, build, and optimize modern data pipelines and Databricks Lakehouse platforms that power analytics, AI/ML, and business intelligence solutions for their clients.
Cloud ComputingEnterprise SoftwareConsultingSoftwareInformation TechnologyCollaborationInfrastructure
Responsibilities
Design, build, and optimize end-to-end data pipelines within Databricks across structured, semi-structured, and unstructured data sources
Architect and implement cloud-based Lakehouse platforms using Databricks and Delta Lake
Implement Medallion (Bronze/Silver/Gold) architecture and enforce best practices for data quality, governance, and security
Develop and optimize ETL/ELT processes using Databricks, dbt, Airflow, or Azure Data Factory
Optimize Spark (PySpark/Scala) workloads for performance and cost efficiency, including cluster configuration and tuning
Integrate real-time streaming technologies (Kafka, Kinesis, or Event Hubs) with Databricks Structured Streaming
Support AI/ML initiatives by building pipelines for feature engineering, MLflow integration, and RAG use cases
Collaborate with cross-functional teams to translate business requirements into scalable technical solutions
Contribute to CI/CD practices and infrastructure-as-code (Terraform) for Databricks deployments
Mentor junior engineers and stay current with emerging trends in Databricks and cloud-native data platforms
Qualification
Required
Bachelor's or Master's degree in Computer Science, Engineering, or related field
5+ years of experience in data engineering or data platform development
Hands-on experience building and optimizing solutions in Databricks
Strong programming skills in Python or Scala and experience with Spark
Expertise in SQL, data modeling, and modern lakehouse architectures
Experience with at least one major cloud platform (Azure preferred; AWS or GCP acceptable)
Proficiency with ETL/ELT and workflow orchestration tools (Databricks Workflows, Airflow, dbt, ADF)
Strong understanding of CI/CD, DevOps for data, and infrastructure-as-code
Excellent communication skills and ability to thrive in client-facing environments
Preferred
Databricks certifications (Associate or Professional)
Experience with Unity Catalog and enterprise data governance
Familiarity with Vector Databases and semantic search use cases
Experience supporting AI/ML workflows and cloud-based ML services
Certifications in AWS, Azure, or GCP
Experience with BI tools such as Power BI, Tableau, or Looker
Company
RBA, Inc.
RBA is an award-winning, national digital and technology consultancy.
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
J
Jim Kessler
CEO and board member.
Rick Born
CEO & Founder
Recent News
2025-07-04
2024-10-21
2024-10-18
Company data provided by crunchbase