hackajob · 8 hours ago
Lead Software Engineer - Data & Analytics Platform, Databricks, Terraform
Jersey City, NJ
Full-time
Onsite
Senior Level, Lead/Staff
$152K/yr - $215K/yr
5+ years exphackajob is collaborating with J.P. Morgan to connect exceptional tech professionals with an opportunity as a Lead Software Engineer within the Corporate Technology Data Analytics Platform team. This role involves enhancing, building, and delivering technology products while driving functional and technical architecture to enable Databricks capabilities.
Artificial Intelligence (AI)Generative AIHuman ResourcesRecruitingSoftware
Responsibilities
Partner with engineering and central platform teams to enable and scale core data lake capabilities on Databricks across ingestion, processing, governance, cataloging, quality, lineage, access, and consumption
Pilot and evaluate new tools and services; run Proof of concepts, define selection criteria and success metrics, and integrate successful solutions into the platform
Operate within Agile SDLC; coordinate with stakeholders and provide clear updates on progress and priorities
Drive performance, scalability, and reliability through capacity planning, stress testing, and performance tuning
Document best practices, guardrails, patterns, and runbooks; maintain a knowledge base and onboarding materials for broader Corprate Data & Analytics Platform engineers’ reference and understanding
Explore agentic solutions and tools to improve automation, developer experience, and operational efficiency
Logs metrics, tracing; reliability and Site Reliability Engineering practices
Qualification
Required
Formal training or certification on software engineering concepts and 5+ years applied experience
Hands on experience in cloud data engineering and platform engineering with hands-on enablement of data platform capabilities
Strong hands on expertice in AWS, VPC design, subnets, routing, security groups, NACLs, Transit Gateway, PrivateLink
Proficiency in Kubernetes (EKS) and AWS ECS expertise; containerization, orchestration, and workload scaling
Advanced in one or more programming language(s) such as Python and SQL
Hands on experience and proficiency in Databricks experience (Unity Catalog, Delta Lake) and familiarity with Lakehouse patterns
Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security, including
Proficiency in automation and continuous delivery methods CI/CD and Infrastructure as Code (Terraform or CloudFormation); automated testing and release pipelines
Preferred
Exposure to agentic solutions and tools for data platforms
Benefits
Comprehensive health care coverage
On-site health and wellness centers
A retirement savings plan
Backup childcare
Tuition reimbursement
Mental health support
Financial coaching
Company
hackajob
The AI-native tech hiring platform trusted by enterprises, scale-ups, and 1M+ tech professionals worldwide.
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$33MKey Investors
Volition CapitalDowning VenturesTechstars
2023-05-03Series B· $25M
2018-10-25Series A· $6.7M
2017-03-31Seed· $0.58M
Leadership Team
Mark Chaffey
CEO
Phil Kell
VP - Marketplace
Recent News
2025-10-23
2025-09-26
2025-09-12
Company data provided by crunchbase