This job has closed.

TestingXperts · 5 hours ago

AWS Data Engineer (Apache Spark, Iceberg, Redshift) – Remote

United States

Contract

Remote

Mid, Senior Level

TestingXperts is seeking an experienced AWS Data Engineer with strong expertise in big data distributed systems and Spark-based data processing. The ideal candidate will have hands-on experience building scalable data pipelines on AWS and working with modern data lake technologies.

DevOpsInformation TechnologyPenetration TestingQuality AssuranceSoftwareUsability Testing

H1B Sponsor Likely

Hiring Manager

Mahesh Kumar

Responsibilities

Strong experience with Big Data distributed systems such as:

Apache Iceberg

Hadoop

Hudi

Amazon Redshift

Deep expertise in Apache Spark (batch and/or streaming)

Hands-on experience with:

Shell scripting (Bash)

Python

PySpark

Solid experience with AWS services, including:

AWS Glue

Lambda

Airflow

Lake Formation

EKS

EC2

SQS

SNS

Strong understanding of data pipeline design, performance optimization, and troubleshooting

Qualification

Apache SparkAWS servicesBig Data distributed systemsPythonApache IcebergAmazon RedshiftShell scriptingHadoopHudiAWS GlueLambdaAirflowLake FormationEKSEC2SQSSNSGoogle Cloud PlatformBigQueryDBTReal-time processing

Required

Strong experience with Big Data distributed systems such as: Apache Iceberg, Hadoop, Hudi, Amazon Redshift

Deep expertise in Apache Spark (batch and/or streaming)

Hands-on experience with Shell scripting (Bash)

Hands-on experience with Python

Hands-on experience with PySpark

Solid experience with AWS services, including: AWS Glue, Lambda, Airflow, Lake Formation, EKS, EC2, SQS, SNS

Strong understanding of data pipeline design, performance optimization, and troubleshooting

Preferred

Experience with Google Cloud Platform (GCP)

Hands-on exposure to BigQuery

Experience working with DBT

Familiarity with real-time / streaming data processing

Company

TestingXperts

Glassdoor4.1

Next Gen QA & Software Testing Company

Founded in 1996

Mechanicsburg, Pennsylvania, USA

1001-5000 employees

https://www.testingxperts.com/

H1B Sponsorship

TestingXperts has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (10)

2024 (1)

2020 (1)