PySpark Tech Lead jobs in United States
cer-icon
Apply on Employer Site
company-logo

Cognizant · 1 day ago

PySpark Tech Lead

positionColumbus, OH
timeFull-time
remoteOnsite
seniorityLead/Staff
date12+ years exp

Cognizant is seeking an experienced technology leader with over 12 years of experience in data engineering and big data platforms. The role involves architecting scalable data solutions and leading teams to drive end-to-end data pipelines for real-time analytics.

ConsultingIndustrial AutomationInformation TechnologySoftwareSoftware Engineering
badNo H1Bnote

Responsibilities

Proven expertise in architecting and delivering scalable data solutions using Apache Spark (PySpark), Hadoop ecosystem, and cloud-native technologies
Adept at leading cross-functional teams, driving end-to-end data pipelines, and enabling real-time analytics for enterprise-grade applications

Qualification

Apache SparkHadoopAWSPythonETL/ELT design

Required

12 years of experience in data engineering, big data platforms, and distributed computing
Proven expertise in architecting and delivering scalable data solutions using Apache Spark (PySpark)
Experience with Hadoop ecosystem
Experience with cloud-native technologies
Adept at leading cross-functional teams
Driving end-to-end data pipelines
Enabling real-time analytics for enterprise-grade applications
5+ years of experience in Apache Spark (PySpark, Spark SQL, Spark Streaming)
5+ years of experience in Hadoop, Hive, HDFS
5+ years of experience in Python, Scala, SQL, Shell Scripting
5+ years of experience in AWS (EC2, S3, RDS, Confluent Cloud)
5+ years of experience in ETL/ELT pipeline design, data ingestion, transformation, and orchestration

Company

Cognizant

twittertwittertwitter
Glassdoor3.8
company-logo
Cognizant is a professional services company that helps clients alter their business, operating, and technology models for the digital era.
dateFounded in 1994
location
Teaneck, New Jersey, USA
people-size10001+ employees
web-link
https://www.cognizant.com

Funding

Current Stage
Public Company
Total Funding
$0.24M
Key Investors
Summit Financial Wealth Advisors
2025-03-08Post Ipo Equity
2016-11-18Post Ipo Equity· $0.24M
1998-06-19IPO

Leadership Team

leader-logo
Ravi Kumar S
Chief Executive Officer
linkedin
leader-logo
Anil Cheriyan
CTO / EVP Strategy & Technology
linkedin

Recent News

Forbes India
We are now in the AI S-curve: Cognizant’s Surya Gummadi
2026-01-03
thefly.com
Gryphon Investors completes sale of 3Cloud to Cognizant
2026-01-03
IndiaTimes
Cognizant faces lawsuits in US over TriZetto Healthcare data breach
2026-01-03
Company data provided by crunchbase