ComResource · 19 hours ago
Data Engineer (Databricks)
Columbus, OH
Full-time
Hybrid
Mid LevelComResource is seeking a data-driven professional to design, build, and optimize scalable data solutions using Databricks. The role involves collaborating with analytics, product, and business teams to transform raw data into reliable datasets for insights and advanced analytics.
CRMInformation TechnologySoftware
Hiring Manager
Meg Kunk
Responsibilities
Design, build, and maintain scalable data pipelines using Databricks and Apache Spark
Develop and optimize ETL/ELT workflows for batch and streaming data
Model, transform, and curate data for analytics, reporting, and downstream use cases
Ensure data quality, reliability, and performance across datasets
Collaborate with analytics, data science, and business stakeholders to understand data needs
Optimize queries and Spark jobs for performance and cost efficiency
Implement best practices for data governance, security, and access control
Monitor pipelines and troubleshoot data issues in production environments
Qualification
Required
Strong experience with Databricks (workspaces, notebooks, jobs, Delta Lake)
Proficiency in SQL and Python (or Scala) for data processing
Solid understanding of Apache Spark concepts and distributed computing
Experience building data pipelines in a cloud environment (AWS, Azure, or GCP)
Knowledge of data modeling concepts (star/snowflake schemas, dimensional modeling)
Familiarity with version control (Git) and CI/CD practices for data workflows
Preferred
Experience with Unity Catalog, and Databricks performance tuning
Exposure to data orchestration tools (e.g., Airflow, dbt, Databricks Workflows)
Experience supporting analytics or machine learning use cases
Understanding of data governance, privacy, and compliance standards
Company
ComResource
ComResource is one of IBM's preferred Business Partners in the the IBM Sterling Solutions.
Founded in 1991
201-500 employees
H1B Sponsorship
ComResource has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (1)
2020 (3)
Funding
Current Stage
Growth StageLeadership Team
Monica Pennington
Director, Data Solutions / Chief Branding & Communications Officer
Company data provided by crunchbase