SIGN IN
Big Data Architect- Databricks, Spark, AWS jobs in United States
cer-icon
Apply on Employer Site
company-logo

Grid Dynamics · 8 hours ago

Big Data Architect- Databricks, Spark, AWS

Grid Dynamics is a leading provider of technology consulting and advanced analytics services, and they are seeking a Big Data Architect for a hybrid role in Atlanta, GA. The role involves designing and implementing data architectures, optimizing data pipeline performance, and providing technical leadership and recommendations for cloud-based data platforms.
Cloud ComputingBig DataSoftwareOutsourcingAppsMobile AppsSoftware Engineering
check
H1B Sponsor Likelynote

Responsibilities

Design and implement medallion architecture (raw, silver, gold layers) to enable efficient data ingestion, processing, and quality management
Develop standardized ETL and streaming pipelines using Databricks, Apache Spark, and Apache Airflow, ensuring low-latency data processing
Define and enforce data quality and observability frameworks, integrating dashboards and monitoring tools to maintain high data integrity
Optimize data pipeline performance and infrastructure costs, identifying bottlenecks and areas for improvement
Lead the technical discovering and ongoing development, assessing current systems, identifying pain points, and defining the target state architecture
Provide technical recommendations and a roadmap for implementation, ensuring best practices in data engineering and architecture
Guide the selection and implementation of cloud-based data platforms to support scalability, efficiency, and future growth
Ensure compliance with security, governance, and regulatory requirements in data handling and processing
Act as the technical point of contact between engineering teams, business stakeholders, and management
Work closely with team members to ensure smooth collaboration and knowledge transfer
Translate business requirements into technical solutions, ensuring alignment between data engineering practices and business objectives
Define best practices, coding standards, and development workflows for data engineering teams
Ensure a smooth transition from discovery to implementation, providing hands-on guidance and technical oversight
Participate in planning and work closely with the Delivery Manager to manage timelines and priorities, various program related topics
Monitor and troubleshoot data pipeline performance, ensuring high availability and reliability of data systems

Qualification

DatabricksApache SparkAWSPythonApache AirflowAWS GlueApache KafkaData ArchitectureTechnical LeadershipCross-Team Collaboration

Required

Cloud provider: AWS
Programming language: Python
Frameworks and technologies: AWS Glue, Apache Spark, Apache Kafka, Apache Airflow
Databricks is a MUST
Bachelor's/Master's degree in Computer Science/ Engineering or a related field

Preferred

Experience working with on-premise will be a plus

Benefits

Medical insurance
Vision
Dental
Corporate social events
Professional development opportunities

Company

Grid Dynamics

company-logo
Grid Dynamics is a provider of in driving enterprise-level digital transformation solutions.

H1B Sponsorship

Grid Dynamics has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (40)
2024 (29)
2023 (12)
2022 (12)
2021 (1)

Funding

Current Stage
Public Company
Total Funding
$124.5M
Key Investors
Benhamou Global Ventures
2024-11-12Post Ipo Equity· $108M
2020-03-06IPO
2019-05-31Series Unknown· $15M

Leadership Team

leader-logo
Ilya Katsov
CTO, Americas
linkedin
leader-logo
Rahul Bindlish
Senior Vice President, Global Partnership & Marketing
linkedin
Company data provided by crunchbase