Grid Dynamics · 8 hours ago
Big Data Architect- Databricks, Spark, AWS
Grid Dynamics is a leading provider of technology consulting and advanced analytics services, and they are seeking a Big Data Architect for a hybrid role in Atlanta, GA. The role involves designing and implementing data architectures, optimizing data pipeline performance, and providing technical leadership and recommendations for cloud-based data platforms.
Cloud ComputingBig DataSoftwareOutsourcingAppsMobile AppsSoftware Engineering
Responsibilities
Design and implement medallion architecture (raw, silver, gold layers) to enable efficient data ingestion, processing, and quality management
Develop standardized ETL and streaming pipelines using Databricks, Apache Spark, and Apache Airflow, ensuring low-latency data processing
Define and enforce data quality and observability frameworks, integrating dashboards and monitoring tools to maintain high data integrity
Optimize data pipeline performance and infrastructure costs, identifying bottlenecks and areas for improvement
Lead the technical discovering and ongoing development, assessing current systems, identifying pain points, and defining the target state architecture
Provide technical recommendations and a roadmap for implementation, ensuring best practices in data engineering and architecture
Guide the selection and implementation of cloud-based data platforms to support scalability, efficiency, and future growth
Ensure compliance with security, governance, and regulatory requirements in data handling and processing
Act as the technical point of contact between engineering teams, business stakeholders, and management
Work closely with team members to ensure smooth collaboration and knowledge transfer
Translate business requirements into technical solutions, ensuring alignment between data engineering practices and business objectives
Define best practices, coding standards, and development workflows for data engineering teams
Ensure a smooth transition from discovery to implementation, providing hands-on guidance and technical oversight
Participate in planning and work closely with the Delivery Manager to manage timelines and priorities, various program related topics
Monitor and troubleshoot data pipeline performance, ensuring high availability and reliability of data systems
Qualification
Required
Cloud provider: AWS
Programming language: Python
Frameworks and technologies: AWS Glue, Apache Spark, Apache Kafka, Apache Airflow
Databricks is a MUST
Bachelor's/Master's degree in Computer Science/ Engineering or a related field
Preferred
Experience working with on-premise will be a plus
Benefits
Medical insurance
Vision
Dental
Corporate social events
Professional development opportunities
Company
Grid Dynamics
Grid Dynamics is a provider of in driving enterprise-level digital transformation solutions.
H1B Sponsorship
Grid Dynamics has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (40)
2024 (29)
2023 (12)
2022 (12)
2021 (1)
Funding
Current Stage
Public CompanyTotal Funding
$124.5MKey Investors
Benhamou Global Ventures
2024-11-12Post Ipo Equity· $108M
2020-03-06IPO
2019-05-31Series Unknown· $15M
Leadership Team
Recent News
Business Wire
2026-02-12
legacy.thefly.com
2026-02-12
Company data provided by crunchbase