Flybridge Staffing · 1 day ago
Senior Data Engineer
Responsibilities
Collaborate effectively with Stakeholders, Project Managers, Software Engineers, Data Analysts, QA Analysts, DBAs, and Data Engineers
Build and maintain data pipelines based on functional and non-functional requirements
Proactively seek out information and overcome obstacles to deliver projects efficiently
Ensure that data pipelines incorporate best practices related to performance, scaling, extensibility, fault tolerance, instrumentation, and maintainability
Ensure that data pipelines are kept simple and not overly engineered
Produce and maintain design and operational documentation
Analyze complex data problems and engineer elegant solutions
Qualification
Required
BA degree and 5+ years of Data Engineering experience
Strong experience building ETL data pipelines for on-premises SQL Server 2017 or newer
Deep understanding of the development of data pipelines with either SSIS or Python
Experience building data pipelines using third-party external data sources
Broad experience with SQL Server, including Columnstore, etc
Extensive experience using SSMS and T-SQL to create and maintain SQL Server tables, views, functions, stored procedures, and user-defined table types
Experience with data modeling indexes, Temporal tables, CLR, and Service Broker
Experience in partitioning tables and indexes, and performance improvement with Query Analyzer
Experience writing C#, PowerShell, and Python
Experience with source control integration with GitHub, BitBucket, and Azure DevOps
Experience working in an Agile and Kanban SDLC
Experience with cloud-based data management solutions such as Snowflake, Redshift
Experience writing design documentation such as ERDs, Data Flow Diagrams, and Process Flow Diagrams
Collaborate effectively with Stakeholders, Project Managers, Software Engineers, Data Analysts, QA Analysts, DBAs, and Data Engineers
Build and maintain data pipelines based on functional and non-functional requirements
Proactively seek out information and overcome obstacles to deliver projects efficiently
Ensure that data pipelines incorporate best practices related to performance, scaling, extensibility, fault tolerance, instrumentation, and maintainability
Ensure that data pipelines are kept simple and not overly engineered
Produce and maintain design and operational documentation
Analyze complex data problems and engineer elegant solutions
Preferred
Experience with Python programming is a plus. Libraries such as Pandas, Numpy, csv, Traceback, JSON, PyODBC, Math-Are nice to have
Experience with open-source database engines such as Clickhouse, ArcticDB, and PostGreSQL is a plus
Company
Flybridge Staffing
Impacting those we serve Flybridge or "Fly Bridge" by definition "is an open area on top of a ship which provides unobstructed views of the fore, aft, and the sides of a vessel, and which serves as an operating station for the ship's officers, such as the captain or officer of the watch." Our unmatched professionalism, integrity and work ethic gives our partners the competitive edge needed to deliver on all fronts.