AI AXISS INC · 14 hours ago
Senior AWS Data Engineer Cloud AWS
New Jersey, United States
Contract
Onsite
Senior Level, Lead/Staff
10+ years expAI AXISS INC is seeking a Senior AWS Data Engineer with extensive experience in designing and implementing enterprise-scale data lake architecture on AWS. The role involves building and maintaining serverless ETL pipelines, optimizing data processing jobs, and ensuring data quality for financial reporting.
Information Technology & Services
Hiring Manager
Vinny Thomas
Responsibilities
Designed and implemented enterprise-scale data lake architecture on AWS, ingesting high-volume banking and card transaction data into Amazon S3 using AWS Glue and PySpark
Built and maintained serverless ETL pipelines using AWS Glue, reducing batch processing time
Developed PySpark transformations on AWS Glue and EMR to process terabytes of transactional and customer data daily
Implemented data ingestion frameworks from multiple banking systems using Glue, Lambda, and Step Functions
Optimized Spark jobs and partitioning strategies, improving query performance and reducing compute costs by 30%+
Created data catalog and metadata governance using AWS Glue Data Catalog for improved discoverability and lineage
Automated data validation and reconciliation checks to ensure data quality and compliance for financial reporting
Qualification
Required
10+ years of experience
Designed and implemented enterprise-scale data lake architecture on AWS
Ingesting high-volume banking and card transaction data into Amazon S3 using AWS Glue and PySpark
Built and maintained serverless ETL pipelines using AWS Glue
Developed PySpark transformations on AWS Glue and EMR to process terabytes of transactional and customer data daily
Implemented data ingestion frameworks from multiple banking systems using Glue, Lambda, and Step Functions
Optimized Spark jobs and partitioning strategies, improving query performance and reducing compute costs by 30%+
Created data catalog and metadata governance using AWS Glue Data Catalog for improved discoverability and lineage
Automated data validation and reconciliation checks to ensure data quality and compliance for financial reporting
Experience with AWS Glue, PySpark, Hadoop, Spark, EMR, S3, Redshift, Banking, US Cards, Transaction Data, Fraud Analytics, Risk Analytics, Data Lake, ETL, Data Engineering, Financial Services
Company
AI AXISS INC
Empowering the future of work through innovative IT & non-IT staffing, managed services, and consulting. Talent. Technology. Transformation.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase