Cognizant · 8 hours ago
Software Development Engineer (Python/Pyspark)
United States
Full-time
Remote
Mid, Senior Level
$67K/yr - $132K/yr
6+ years expCognizant is seeking a Software Development Engineer (Python/Pyspark) to support and enhance batch data processing and batch letters. The role involves developing and maintaining ETL/ELT data pipelines, optimizing Spark jobs, and ensuring adherence to security best practices.
ConsultingIndustrial AutomationInformation TechnologySoftwareSoftware Engineering
No H1B
Responsibilities
Support and enhance batch data processing and batch letters using Python and PySpark
Research, troubleshoot, and fix potential issues in existing data pipelines and Spark jobs
Develop and maintain new ETL/ELT data pipelines to support business enhancements and regulatory mandates
Monitor batch and streaming jobs on AWS EMR and Databricks; ensure timely issue resolution
Support ad-hoc member/data requests and reporting needs
Optimize Spark jobs for performance, scalability, and cost efficiency
Implement error handling, retries, and exponential backoff for resilient services
Assist with technical debt reduction, platform upgrades (EMR, Airflow, Spark), and refactoring
Ensure adherence to security best practices including IAM, encryption at rest and in transit
Qualification
Required
6+ years of experience in Python development
Strong hands-on experience with PySpark and Apache Spark
Experience in ETL/ELT integration using Python
Proficiency in AWS services: EMR, Redshift, S3, EC2, IAM
Strong knowledge of SQL for data transformation and analytics
Experience with Databricks for distributed data processing
Hands-on experience with Python testing and code quality tools (Pytest, Pylint)
Experience in Spark cluster management, parallel processing, and big-data optimization
AWS: Intermediate / Proficient
EC2 / S3: Intermediate / Proficient
IAM: Intermediate / Proficient
EMR: Intermediate / Proficient
Spark / PySpark: Proficient
Preferred
Healthcare
Experience with Apache Airflow for workflow orchestration
Familiarity with Facets
Experience in EMR and Spark upgrades
Benefits
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
Long-term/Short-term Disability
Paid Parental Leave
Employee Stock Purchase Plan
Company
Cognizant
Cognizant is a professional services company that helps clients alter their business, operating, and technology models for the digital era.
10001+ employees
Funding
Current Stage
Public CompanyTotal Funding
$0.24MKey Investors
Summit Financial Wealth Advisors
2025-03-08Post Ipo Equity
2016-11-18Post Ipo Equity· $0.24M
1998-06-19IPO
Leadership Team
Ravi Kumar S
Chief Executive Officer
Anil Cheriyan
CTO / EVP Strategy & Technology
Recent News
Hindu Business Line
2026-01-24
Hindu Business Line
2026-01-24
2026-01-24
Company data provided by crunchbase