Artmac · 3 hours ago
Senior Data Engineer - Microsoft Fabric & Azure Analytics
Artmac is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers. They are seeking a Senior Data Engineer with a strong focus on Microsoft Azure Data stack and Fabric technologies to design, implement, and manage data pipelines and architectures.
Digital MarketingInformation TechnologyWeb DesignWeb Development
Responsibilities
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies
Expertise in Microsoft Fabric: Lakehouse, Dataflows Gen2, Pipelines, Notebooks
Strong experience with Azure Data Factory, Azure SQL, and Azure Data Lake Storage Gen2
Experience working with structured and semi-structured data (JSON, XML, CSV, Parquet)
Experience with conversational AI platforms or integration with AI-driven analytics
Knowledge of multi-agent orchestration and federated query systems
Strong track record of scaling data pipelines and optimizing compute/storage performance
Proven ability to build metadata-driven architectures and reusable components
Proficiency in Power BI or other visualization and reporting tools
Strong programming skills in SQL, Python, PySpark, and/or Scala
Familiarity with agent-based architectures and conversational AI integration is a plus
Solid understanding of data modeling, governance, security, and best practices
Design, implement, and manage ETL/ELT pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse, Warehouse, SQL) and Azure Data Factory
Build and maintain metadata-driven Lakehouse architectures with threaded datasets to support multiple data consumption patterns
Develop agent-specific data lakes and an orchestration layer for a central “uber” agent capable of querying across agents to answer customer questions
Enable interactive analytics and AI-driven insights via Power BI, Azure OpenAI, and other tools
Ensure data quality, lineage, security, and governance across all ingestion and transformation processes
Collaborate closely with product, analytics, and AI teams to understand business requirements and deliver scalable solutions
Optimize storage, compute, and pipeline performance while balancing cost-efficiency
Document best practices, standards, and reusable components to enable long-term maintainability
Qualification
Required
9 – 18 years of experience
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies
Expertise in Microsoft Fabric: Lakehouse, Dataflows Gen2, Pipelines, Notebooks
Strong experience with Azure Data Factory, Azure SQL, and Azure Data Lake Storage Gen2
Experience working with structured and semi-structured data (JSON, XML, CSV, Parquet)
Experience with conversational AI platforms or integration with AI-driven analytics
Knowledge of multi-agent orchestration and federated query systems
Strong track record of scaling data pipelines and optimizing compute/storage performance
Proven ability to build metadata-driven architectures and reusable components
Proficiency in Power BI or other visualization and reporting tools
Strong programming skills in SQL, Python, PySpark, and/or Scala
Solid understanding of data modeling, governance, security, and best practices
Design, implement, and manage ETL/ELT pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse, Warehouse, SQL) and Azure Data Factory
Build and maintain metadata-driven Lakehouse architectures with threaded datasets to support multiple data consumption patterns
Develop agent-specific data lakes and an orchestration layer for a central 'uber' agent capable of querying across agents to answer customer questions
Enable interactive analytics and AI-driven insights via Power BI, Azure OpenAI, and other tools
Ensure data quality, lineage, security, and governance across all ingestion and transformation processes
Collaborate closely with product, analytics, and AI teams to understand business requirements and deliver scalable solutions
Optimize storage, compute, and pipeline performance while balancing cost-efficiency
Document best practices, standards, and reusable components to enable long-term maintainability
Bachelor's degree or equivalent combination of education and experience
Company
Artmac
Artmac provides Digital, consulting and Management IT services to clients globally - As your trusted partner, let’s reimagine how your business gets done.
H1B Sponsorship
Artmac has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (3)
2021 (3)
Funding
Current Stage
Early StageCompany data provided by crunchbase