Alpha Consulting Corp. · 6 days ago
Software/Data Engineer 4
Dallas, TX
Full-time
Onsite
Senior LevelAlpha Consulting Corp. is seeking a skilled professional to design and develop robust ETL/ELT workflows and data pipelines for home loan data management. The role focuses on performance and scalability while working with a variety of data technologies and cloud platforms.
ConsultingPharmaceuticalHuman ResourcesStaffing Agency
No H1B
Responsibilities
Design and develop ETL/ELT workflows and data pipelines for batch and real-time processing
Build and maintain data pipelines for reporting and downstream applications using open-source frameworks and cloud technologies
Collaborate with architects and engineering teams to ensure alignment with target architecture
Apply best practices for data governance, lineage tracking, and metadata management
Develop, schedule, and orchestrate complex workflows using Apache Airflow
Troubleshoot and resolve issues in data pipelines to ensure high availability and reliability
Qualification
Required
Applicants must be able to work directly on a W2 basis
Strong understanding of data structures, modeling, and lifecycle management
Hands-on experience designing and managing data pipelines with ETL/ELT expertise
Advanced skills in PySpark for distributed data processing and transformation
Experience with NetApp Iceberg and open table formats for analytics
Knowledge of the Hadoop Ecosystem, including HDFS and Hive
Proficiency in cloud platforms such as GCP (BigQuery, Dataflow) or AWS/Azure
Experience with Delta Lake and Dataplex for governance and metadata management
Strong programming skills in Python, Spark, and SQL
Experience with Apache Airflow for workflow orchestration, including authoring and maintaining DAGs
Strong understanding of relational and distributed database systems
Preferred
Experience with modern database concepts and operational/analytical data stores
Proficiency in optimizing data structures for performance and scalability
Ability to provide thought leadership and share insights with the scrum team
Benefits
Commitment to diversity and inclusion, fostering an environment where all individuals feel valued and respected.
Opportunities for professional growth and development.
Collaborative and supportive work environment.
Company
Alpha Consulting Corp.
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
Founded in 1994
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase