Tech Genius inc ยท 1 hour ago
Big Data Developer With GCP on our W2
Tech Genius inc is seeking an experienced Big Data Developer to join their client American Express (Amex). The ideal candidate will have strong expertise in Big Data technologies, Spark, Python, and GCP to design, develop, and optimize large-scale data processing pipelines and enterprise applications.
Information TechnologySoftwareSoftware Engineering
Responsibilities
Design and develop scalable data pipelines and ETL processes using Spark and Python
Work on Big Data ecosystems for handling large datasets across distributed systems
Deploy, manage, and optimize applications on Google Cloud Platform (GCP) services like BigQuery, Dataproc, Dataflow, and Pub/Sub
Collaborate with business stakeholders and data engineers to deliver high-quality data solutions
Ensure data quality, reliability, and security across applications
Participate in Agile/Scrum ceremonies and contribute to sprint deliverables
Troubleshoot and resolve performance issues in data pipelines and distributed systems
Qualification
Required
Strong hands-on experience in Big Data technologies (Hadoop/Spark ecosystem)
Proficiency in Apache Spark (PySpark, DataFrames, RDDs)
Strong Python programming skills for data engineering and automation
Hands-on experience with GCP services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage)
Solid understanding of ETL frameworks, data ingestion, and data transformation
Knowledge of SQL and database optimization techniques
Good problem-solving and communication skills
Bachelor's or Master's degree in Computer Science, Engineering, or related field
7+ years of professional experience in Big Data development and data engineering
Preferred
Experience with CI/CD pipelines, Git, Jenkins is a plus
Prior experience in financial domain projects is a plus
Company
Tech Genius inc
Tech Genius IT Solutions Simplifies IT by offering end-to-end solutions for all of your IT challenges.
H1B Sponsorship
Tech Genius inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (6)
2023 (2)
2022 (2)
Funding
Current Stage
Growth StageCompany data provided by crunchbase