Raas Infotek ยท 3 hours ago
Senior Python/Data Engineer (15+ Years)
Raas Infotek is seeking a Senior Data Engineer to design and develop scalable data pipelines for managing large datasets. The role involves collaborating with teams to enhance data models and ensure data quality and governance while mentoring junior engineers.
Responsibilities
Develop, test, document and support scalable data pipelines
Build out and evolve data integrations including APIs to support continuing increases in data volume and complexity
Establish and follow data governance processes and guidelines to ensure data availability, usability, consistency, integrity, and security
Build, implement, and maintain scalable solutions that align to our data governance standards and architectural road maps for data integrations, data storage, reporting, and analytic solutions
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization
Design and develop data integrations and a data quality framework. Write unit/integration/functional tests and document work
Design, implement, and automate deployment of our distributed system for collecting and processing streaming events from multiple sources
Perform data analysis needed to troubleshoot data-related issues and aid in the resolution of data issues
Guide and mentor junior engineers on coding best practices and optimization
Qualification
Required
Education: 4-year college degree or equivalent combination of education and experience. Prefer an academic background in Computer Science, Mathematics, Statistics, or related technical field
5 years of relevant work experience in analytics, data engineering, business intelligence or related field
Skilled in object-oriented programming (Python in particular)
Strong Experience in Python, PySpark and SQL
Strong Experience in Databricks
Experience developing integrations across multiple systems and APIs
Experience with or knowledge of Agile software development methodologies
Experience with cloud-based databases, specifically Azure technologies (e.g., Azure data lake, ADF, Azure DevOps and Azure Functions)
Experience using SQL queries as well as writing and perfecting SQL queries in a business environment with large-scale, complex datasets
Experience with data warehouse technologies. Experience creating ETL and/or ELT jobs
Excellent problem solving and troubleshooting skills
Process oriented with great documentation skills
Preferred
Experience designing data schemas and operating SQL/NoSQL database systems is a plus
Experience in Kafka, Flink, Fivetran and Matillion is nice to have
Experience in Data Science and Machine Learning is nice to have
Company
Raas Infotek
RAAS Infotek is a full spectrum global Information Technology services company, providing end-to-end business solutions.
Funding
Current Stage
Growth StageCompany data provided by crunchbase