Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Profitmind · 2 hours ago

Senior Data Engineer

positionPittsburgh, PA
timeFull-time
remoteOnsite
senioritySenior Level
date5+ years exp

Profitmind is a fast-growing startup focused on transforming how retailers make pricing and merchandising decisions through intelligent data solutions. They are seeking a talented Senior Data Engineer to build and scale the data infrastructure that powers their retail technology platform, enabling data-driven decision making across the organization.

RetailSoftware

Responsibilities

Design and implement scalable data pipelines for both batch and streaming workloads using Python and Spark
Build and maintain cloud-native data infrastructure to support our retail analytics and operational needs
Develop real-time streaming solutions to process transaction, inventory, and operational data
Develop AI agents to automate operations
Implement data quality validation and monitoring to ensure reliability across our data ecosystem
Establish DataOps best practices and automation as we scale our data infrastructure
Own data security and privacy compliance as we handle sensitive customer and business data
Collaborate closely with product, engineering, and business teams to understand data requirements and deliver solutions
Mentor team members and contribute to building a strong data engineering culture

Qualification

PythonApache SparkCloud platform (AWS/GCP/Azure)SQLData modelingETL/ELT patternsWorkflow orchestrationReal-time processing frameworksDataOpsMLOpsCommunication skillsProblem-solving skills

Required

5+ years of hands-on data engineering experience
Strong proficiency in Python for data processing and pipeline development
Production experience with Apache Spark for large-scale data processing
Hands-on experience with at least one major cloud platform (AWS, GCP, or Azure)
Proven track record implementing both batch and streaming data pipelines
Deep understanding of SQL and modern data warehouse technologies
Strong knowledge of data modeling, ETL/ELT patterns, and workflow orchestration
Experience with distributed systems and cloud infrastructure
Excellent problem-solving and analytical skills
Strong communication skills with ability to translate business needs into technical solutions
Thrives in fast-paced, early-stage startup environments with changing priorities

Preferred

Experience in retail tech, e-commerce, or similar enterprise systems
Expertise with real-time processing frameworks like Kafka, Kinesis, or Flink
Proficiency with Python data handling libraries (pandas, NumPy, polars)
Knowledge of data quality and observability platforms
Understanding of event-driven architectures, medallion architectures, and CDC patterns
Previous experience at an early-stage startup or building data infrastructure from scratch
Background working with multi-tenant SaaS platforms or enterprise analytics systems
Experience with container orchestration (Docker, Kubernetes)
Knowledge of DataOps and MLOps best practices

Company

Profitmind

twittertwitter
company-logo
Profitmind enables retailers to auto-identify competitors across the internet and track their assortments, and optimize prices in real time.
dateFounded in 2022
location
Palo Alto, California, USA
people-size11-50 employees
web-link
https://www.profitmind.com/

Funding

Current Stage
Early Stage
Total Funding
$5M
Key Investors
Accenture VenturesAI Fund,Magarac Venture Partners
2026-01-08Series Unknown
2022-11-29Seed· $5M

Leadership Team

leader-logo
Mark Chrystal
Chief Executive Officer
linkedin

Recent News

Crowdfund Insider
Accenture Prioritizes AI Adoption with Strategic Investments and Partnerships
2026-01-22
The Register
Accenture bets AI will ring up retail sales with Profitmind investment
2026-01-11
Business Wire
Accenture Invests in Profitmind to Drive Agentic AI Reinvention in Retail Sector
2026-01-09
Company data provided by crunchbase