Lead Software Engineer- ETL/ELT Pipelines / Python / Pyspark jobs in United States
cer-icon
Apply on Employer Site
company-logo

JPMorganChase · 5 hours ago

Lead Software Engineer- ETL/ELT Pipelines / Python / Pyspark

JPMorgan Chase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers and businesses. As a Lead Software Engineer specializing in ETL/ELT Pipelines, Python, and PySpark, you will be responsible for developing secure, high-quality production code and designing scalable data solutions to support the firm's business objectives.

Asset ManagementBankingFinancial Services
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Lead the development of secure high-quality production code, and review and debug code written by others
Ensure data quality, integrity, and security across all data systems and platforms and enforce data governance policies and best practices
Design and implement scalable data solutions that align with business objectives and technology strategies and technical troubleshooting with ability to think beyond routine or conventional approaches to build and support solutions or break down technical problems
Design, develop, and optimize robust ETL/ELT pipelines using SQL, Python, and PySpark for large-scale, complex data environments
Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications
Conduct performance tuning and optimization of data systems to ensure high availability and scalability
Identify opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
Stay current on emerging ETL and data engineering technologies with industry trends to drive innovation
Work closely with stakeholders to identify opportunities for data-driven improvements and efficiencies
Maintain detailed documentation for pipelines, data models, and integration processes

Qualification

PythonPySparkETL/ELT pipelinesSQLAWS cloud servicesData quality best practicesData lake platformsCloud-based data warehouseAutomation methodsAgile methodologiesProblem-solving skillsCommunication skillsCollaboration skills

Required

Formal training or certification on software engineering concepts and 5+ years applied experience
Proven experience as a lead engineer in data management, ETL/ELT pipeline development, and large-scale data processing with strong hands-on coding proficiency in Python, PySpark, Apache Spark, SQL, and AWS cloud services such as AWS EMR, S3, Athena, Redshift
Strong understanding of data quality, security, and lineage best practices
Hands-on experience with AWS cloud and data lake platforms, Snowflake, Databricks etc
Experience with cloud-based data warehouse migration and modernization
Intimate knowledge and ability to implement unit, integration and functional testing strategies
Experience providing the tools that will enable data to be made available on Mesh and distributed to meet consumer need
Proficiency in automation and continuous delivery methods and understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
Excellent problem-solving and troubleshooting skills, with ability to optimize performance and troubleshoot complex data pipelines
Strong communication and documentation abilities
Ability to collaborate effectively with business and technical stakeholders

Preferred

Knowledge of Apache Iceberg
In-depth knowledge of the financial services industry and IT systems

Benefits

Comprehensive health care coverage
On-site health and wellness centers
A retirement savings plan
Backup childcare
Tuition reimbursement
Mental health support
Financial coaching

Company

JPMorganChase

company-logo
With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets.

H1B Sponsorship

JPMorganChase has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3471)
2024 (3469)
2023 (3395)
2022 (3594)
2021 (2515)
2020 (2495)

Funding

Current Stage
Public Company
Total Funding
unknown
1998-02-01IPO

Leadership Team

leader-logo
Allison Beer
CEO of Card Services and Connected Commerce
linkedin
leader-logo
Dan Mendelson
CEO, Morgan Health
linkedin
Company data provided by crunchbase