Principal Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Jobs via Dice ยท 4 hours ago

Principal Data Engineer

Microsoft's Path team helps customers along their journey from the initial idea to the final realization of their goals. The Principal Data Engineer will operate as a senior technical leader shaping the data & analytics foundations that power Microsoft Path org's products and platforms at a global scale, collaborating with multiple teams to analyze data requirements and lead the design of data models and pipelines.

Computer Software

Responsibilities

Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support Microsoft Path products data analytics initiatives
Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas
Data Governance & Trust: Enforce best practices for data quality, lineage, security, and compliance
Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable
Cross-functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals
Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information
Translate ambitious vision into actionable roadmaps and measurable outcomes
Mentor senior data engineers and technical leads, guide complex design decisions, and foster a culture of engineering excellence, operational rigor, and continuous learning across the organization

Qualification

Data engineeringCloud environmentsData governanceData pipelinesCC++C#JavaAzure Data LakeSQL databasesPySparkCommunicationCross-functional collaborationMentoring

Required

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Preferred

Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Deep experience architecting and operating large-scale distributed data systems in cloud environments, preferably Azure
Ability to write clean, working code using core algorithms, data structures, and analytics-oriented problem-solving
Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases)
Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments
Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences
Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, PySpark, SQL, etc)
Experience collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business)
Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others

Company

Jobs via Dice

twitter
company-logo
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.

Funding

Current Stage
Early Stage
Company data provided by crunchbase