Parafin · 1 day ago
Senior Software Engineer, Data Platform
San Francisco, CA
Full-time
Hybrid
Mid, Senior Level
$230K/yr - $265K/yr
4+ years expParafin is on a mission to grow small businesses by providing them with accessible financial tools. The Senior Software Engineer will lead the development of the Data Platform, ensuring the data infrastructure is reliable and scalable while collaborating with various teams to support data-driven product development.
FinanceFinTechFinancial ServicesSmall and Medium Businesses
Responsibilities
Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS
Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self‑service tooling, and clear documentation
Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products
Own the Data & ML platform infrastructure using Terraform, including end‑to‑end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines
Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring)
Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support on all engineering aspects of their work
Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives
Share best practices and mentor other engineers working on data-centric systems
Qualification
Required
4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems
Advanced proficiency in Python and SQL
Hands-on Spark development experience
Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures
Hands-on experience with foundational data-infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto
Familiarity with ingestion frameworks, developer-experience tooling, and best practices for data versioning, lineage, partitioning, and clustering
Strong problem-solving skills and a proactive attitude toward ownership and platform health
Excellent communication and collaboration skills, especially in cross-functional settings
Preferred
Experience with AWS infrastructure using Terraform
Familiarity with observability tools (e.g., Datadog) and cost tracking in cloud environments
Experience with financial systems or building platforms in a fintech setting
Prior work on ML infrastructure: Feature stores (e.g., Tecton), ML model lifecycle (training, deployment, monitoring, retraining), real-time inference
Contributions to internal tooling or open-source projects in the data ecosystem
Benefits
Equity grant
Medical, dental & vision insurance
Work from home flexibility
Unlimited PTO
Commuter benefits
Free lunches
Paid parental leave
401(k)
Employee assistance program
Company
Parafin
Parafin is a financial infrastructure company that offers pre-built financial services programs to support small businesses.
51-200 employees
H1B Sponsorship
Parafin has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (9)
2023 (6)
2022 (2)
2021 (3)
2020 (1)
Funding
Current Stage
Growth StageTotal Funding
$562MKey Investors
Notable CapitalSilicon Valley Bank,Trinity CapitalGIC
2024-12-17Series C· $100M
2024-08-28Debt Financing· $93M
2024-04-10Debt Financing· $125M
Leadership Team
Sahill Poddar
Co-Founder & CEO
Vineet Goel
Co-Founder and Chief Product and Technology Officer
Recent News
2025-12-15
2025-12-09
Company data provided by crunchbase