Apply on Employer Site

CapTech · 5 days ago

Lead Data Engineer (AWS, Azure, GCP)

Atlanta, GA

Full-time

Onsite

Senior Level, Lead/Staff

5+ years exp

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. The Lead Data Engineer will enable clients to build and maintain advanced data systems and will be responsible for designing, implementing, and maintaining modern data pipelines utilizing cloud technologies.

ConsultingInformation TechnologyManagement Consulting

No H1B

Responsibilities

Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions

Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies

Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution

Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs

Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders

Qualification

Cloud data engineeringETL / Data OrchestrationSQLNoSQL databasesCloud platforms AWSCloud platforms AzureCloud platforms GCPData warehousing solutionsProgramming languages PythonProgramming languages JavaProgramming languages etc.DevOps tools familiarityBig data conceptsCloud certificationTechnical leadership

Required

Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets

5+ years of experience delivering data engineering solutions on cloud platform

5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)

Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)

Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks

5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)

Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)

5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)

Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira)

Fundamental understanding of big data, open source, and data streaming concepts

Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs

Experience providing technical leadership and mentoring other engineers in data engineering space

Preferred

Cloud certification on any platform a plus

Benefits

Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths

Modern Health –A mental health and well-being platform that provides 1:1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs

Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care

Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more

Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations

Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities.

401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness