Spot Freight · 7 hours ago
Data Engineer
Spot Freight is a logistics company that provides tools to tackle industry challenges for its partners. They are seeking a Data Engineer to build scalable data platforms and maintain production-grade data pipelines, ensuring data quality and performance optimization.
Logistics
Responsibilities
Design, build, and support Red Technologies’ data and business intelligence platform using Databricks, Azure Synapse, Sigma Computing, and SQL Server
Own and maintain production-grade data pipelines that reliably serve data scientists, analysts, internal applications, and customer-facing systems
Lead or contribute to the ingestion of near-real-time and streaming data into the platform
Partner with software engineers, product managers, analysts, and non-technical stakeholders to translate business needs into scalable technical solutions
Design and implement data quality checks, testing frameworks, and governance processes to ensure accuracy, reliability, and trust in our data
Optimize data models, queries, and pipelines for performance, scalability, and cost efficiency
Contribute to architectural decisions and help guide best practices across the data engineering stack
Mentor junior team members and help raise the overall technical bar of the team
Qualification
Required
3+ years of experience building and maintaining data pipelines using tools such as PySpark, Pandas, SQL, and similar technologies
Bachelor's degree in Data Engineering, Computer Science, a related field, or equivalent real-world experience
Strong understanding of data modeling, joins, aggregations, and analytical patterns
Solid experience working with cloud and distributed data systems
Proven ability to debug complex data issues and deliver reliable solutions in production environments
Strong problem-solving skills, attention to detail, and ownership mindset
Ability to independently research, evaluate, and adopt new tools and technologies
Preferred
Experience with Azure, Databricks, Azure Synapse, SQL Server, and/or Kafka is a plus
Experience in logistics, transportation, or supply chain environments is a plus
Company
Spot Freight
The industry leader in logistics services,
Funding
Current Stage
Growth StageLeadership Team
Recent News
Company data provided by crunchbase