SPADTEK SOLUTIONS · 9 hours ago
Senior Data Engineer
San Antonio, TX
Contract
Onsite
Senior Level, Lead/Staff
10+ years expSPADTEK SOLUTIONS is seeking a highly skilled Senior Data Engineer / Data Architect with expertise in modern data architectures. The role involves designing and optimizing data pipelines, implementing Data Lakehouse solutions, and collaborating with cross-functional teams to ensure data quality and performance optimization.
Information Technology & Services
No H1B
Hiring Manager
Sindhu Samala
Responsibilities
Design, build, and optimize data pipelines using PySpark, DBT, and Python
Architect and implement Data Lakehouse solutions using Databricks
Work with Starburst engine for distributed SQL query processing
Develop and maintain Airflow DAGs for orchestration and workflow automation
Support POC systems and transition them into scalable production‑ready solutions
Manage data ingestion, transformation, and storage across on‑prem and cloud‑based systems
Build small‑scale POC pipelines using Airflow, containers, and local compute environments
Contribute to live project environments, including BW‑related data flows (if applicable)
Collaborate with cross‑functional teams to define data models, architecture patterns, and best practices
Ensure data quality, governance, and performance optimization across all pipelines
Qualification
Required
12+ years of experience
Strong experience in PySpark
Strong experience in Databricks
Strong experience in Airflow
Strong experience in DBT
Strong experience in Python
Experience working with Starburst / Trino engines
Experience with Data Lakehouse architectures
Experience with on-prem Dell ecosystem (servers, storage, containers)
Experience building POC systems and scaling them to production
Strong understanding of distributed computing, ETL/ELT frameworks, and data modeling
Company
SPADTEK SOLUTIONS
At Spadtek, we believe sustainable growth happens when talent works in harmony with technology.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase