Collabera · 7 hours ago
Python Hadoop Data Engineer
Collabera is a global leader in talent solutions, and they are seeking a Senior Python Hadoop Data Engineer to join their client’s Data Engineering team. This role involves designing and maintaining Python-based data pipelines on Hadoop platforms, working with large-scale datasets, and collaborating with cross-functional teams to deliver scalable solutions.
Responsibilities
Design, develop, and maintain Python-based data pipelines on Hadoop platforms
Work with large-scale datasets using Hadoop, HDFS, and Spark
Build and enhance batch and near-real-time data processing solutions
Develop and maintain applications and services using Python and PHP
Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions
Optimize data workflows for performance, reliability, and scalability
Participate in code reviews and follow best practices for software development
Qualification
Required
5+ years of experience as a Data Engineer, Big Data Engineer, or Hadoop Developer
Strong hands-on Python development experience (primary skill)
Solid experience working with Hadoop ecosystem technologies (HDFS, Spark, MapReduce)
Working knowledge of PHP
Strong understanding of data engineering concepts, including data ingestion and transformation
Experience building solutions through actual coding and development, not just tool usage
Strong problem-solving skills and ability to work independently in a fast-paced environment
Benefits
Medical insurance
Dental insurance
Vision insurance
401(k) retirement plan
Life insurance
Long-term disability insurance
Short-term disability insurance
Paid parking/public transportation
Paid sick and safe time
Paid vacation time
Paid parental leave
Paid holidays annually (as applicable)
Company
Collabera
Collabera is an end-to-end information technology services and solutions provider helping clients align their business and IT strategies.
H1B Sponsorship
Collabera has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (141)
2024 (93)
2023 (120)
2022 (186)
2021 (180)
2020 (146)
Funding
Current Stage
Late StageTotal Funding
$30M2006-05-04Series Unknown· $30M
Recent News
2024-04-09
2023-01-20
2022-04-19
Company data provided by crunchbase