This job has closed.

Louis Dreyfus Company · 1 day ago

Data Engineer, Data & Analytics

Wilton, CT

Full-time

Onsite

Entry, Mid Level

2+ years exp

Louis Dreyfus Company is a leading merchant and processor of agricultural goods. They are seeking a talented Data Engineer to architect and implement innovative data solutions that directly impact business decision-making and operational efficiency.

AgricultureConsumer GoodsFarmingFood ProcessingMeat and PoultrySupply Chain ManagementSustainability

No H1B

Responsibilities

Design, build, and maintain scalable data pipelines and ETL/ELT workflows using modern cloud-native architectures

Design and implement robust software solutions in Python, focusing on scalability, performance, and reliability

Schedule and automate workflows, enhancing operational efficiency and accuracy

Collaborate in the development and maintenance of cloud-based infrastructure, applying best practices in DevOps to ensure high data availability and scalability

Work closely with data scientists, quantitative researchers, and trading teams to understand their data needs, providing technical solutions that enable effective data analysis and strategy implementation

Ensure code quality and maintainability by implementing strong CI/CD practices, code versioning, automated tests, and conducting thorough peer-reviews

Stay current with emerging trends and advancements in software development, data engineering, and cloud technologies, integrating new tools and techniques where beneficial

Expertise in handling and optimizing relational databases to support analytical applications

Ensure data quality, governance, and compliance through automated testing and monitoring frameworks

Design and implement dimensional data models, star schemas, and semantic layers optimized for analytics and reporting

Create and maintain data models and data transformation logic using SQL and Python

Develop automated, high-quality indicators and KPIs from diverse data sources

Perform exploratory data analysis to uncover patterns and support business intelligence initiatives

Collaborate with data scientists to productionize machine learning models and AI solutions

Qualification

Data engineeringSQLPythonCloud data platformsData orchestration toolsData modelingETL/ELTDataOpsCI/CD pipelinesVersion controlDistributed computingAgricultural industry knowledge

Required

2+ years of experience in data engineering roles with focus on data modeling, pipeline development, ETL/ELT, and analytics platform management

Expert-level proficiency in SQL for complex queries, optimization, and performance tuning

1+ years of hands-on experience with Python for data engineering, including libraries such as Pandas, NumPy, PySpark, and data visualization tools (Plotly, Matplotlib)

Proficiency with modern cloud data platforms (Azure preferred, AWS or GCP acceptable)

Experience with data orchestration tools (Azure Data Factory preferred, Airflow, Prefect, Dagster)

Understanding of DataOps, CI/CD pipelines, version control (Git), and infrastructure as code

Bachelor's or, Master's degree in Computer Science, Data Engineering, Computer/Systems Engineering, Data Science, Statistics, Mathematics, or related quantitative field. Candidates with equivalent professional experience and demonstrated technical expertise will be considered

Preferred

Experience with distributed computing frameworks (Databricks, Apache Spark)

Understanding of commodities trading, supply chain analytics, or agricultural industry domains

Benefits

Comprehensive benefits program including medical, dental and vision care coverage, flexible spending account plans, employee assistance program, life insurance and disability coverage

401k with Company Match

Family Friendly Benefits including childbirth and parental leave, fertility and family building benefits

Paid Time Off (PTO) and Paid Holidays

Flexible work available (not applicable to all roles)