Flow Traders · 17 hours ago
Senior Core Data Engineer - Chicago
Flow Traders is looking for a Senior Core Data Engineer to own the end-to-end lifecycle of their fundamental data products. The role involves crafting and executing data product blueprints, building automated pipelines, and collaborating with teams to ensure high-quality and timely delivery of data products.
Financial ServicesSoftwareStock ExchangesTrading Platform
Responsibilities
Be accountable for timely and high-quality delivery of core data products to the rest of the organization: Security Master, ETF Compositions, Market Data, Trades / Orders / Quotes / Inquiries
Develop and own the end-to-end lifecycle of these data products: build and maintain pipelines, develop quality checks, correct day-to-day issues, and systematize/automate manual processing steps
Define and manage project plans to assume ownership of these data products
Create and refine a common data model (esp. identifiers, normalized schemas, use of master data) across these data products
Investigate currently available sources of data and ensure that Flow extracts maximum information and value from them
Explore, evaluate, and onboard additional sources of available data (both independently and at the request of stakeholders)
Work closely with other teams to: automate existing workflows, ensure pipelines leverage standard Flow technologies, provide guidance on data-related architecture / design topics, ensure licensing and access control are appropriate
Qualification
Required
Excellent programming skills (any language, Python preferred)
Working proficiency with Linux, SQL and relational/non-relational databases
Demonstrated ability to work with large datasets and familiarity with big data solutions
Organized with strong attention to detail and quality
Innately driven to generalize, systematize, and automate
Strong interpersonal skills, works very well with both technical and non-technical stakeholders
Able to balance individual stakeholder demands to preserve quality and wide applicability of data
Organized and able to define, manage, and execute projects (often several in parallel) while effectively triaging operational concerns
Primarily technical, but domain-literate (exposure to symbology, security reference/pricing data, ETF compositions, exchange market data)
Preferred
Experience with Airflow, Kafka, and GCP (esp. GKE, Dataproc, and Big Query) highly desired
Experience with Pandas, Spark, Apache Beam, Apache NiFi a plus
Benefits
Annual discretionary variable remuneration
Company
Flow Traders
Flow Traders is a technology-driven liquidity provider and market maker.
H1B Sponsorship
Flow Traders has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (4)
2023 (3)
2022 (7)
2021 (3)
2020 (1)
Funding
Current Stage
Public CompanyTotal Funding
$275MKey Investors
Benefit Street Partners,Stone Point CapitalSummit Partners
2025-10-30Post Ipo Debt· $275M
2015-07-10IPO
2008-06-05Private Equity
Leadership Team
Recent News
2025-12-11
Flow Traders Ltd
2025-10-31
Company data provided by crunchbase