Energy Transfer · 5 hours ago
Principal Specialist - Databricks Developer
Energy Transfer, recognized by Forbes as one of America's best large employers, is dedicated to responsibly and safely delivering America’s energy. The Principal Specialist - Databricks Developer will design and implement data solutions, maintain data pipelines, and collaborate with cross-functional teams to enhance the BI landscape within the company.
Responsibilities
Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, Power BI/Fabric
Develop, monitor, and maintain scalable data pipelines to support analytics and data science projects
Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks
Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts
Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack
Primarily SQL Server, SSIS, and SSRS
Assist with server and system administration of On-Prem BI infrastructure such as Power BI/Azure Gateway servers, Business Objects, Tableau, and SSRS
Collaborate with cross-functional teams to translate business needs into technical specifications and data models
Ensure data quality and integrity by implementing best practices and data governance standards
Provide ongoing support and enhancements to existing data structures and reporting environments
Stay current with industry trends and advancements in BI and data analytics technologies
Lead prototype efforts in various BI tools for capability assessment and demonstrations
Leverage AI tools to assist with the creation, maintenance, and updating of comprehensive documentation for all data solutions and processes
Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration
Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions
Provide general support to BI customers, addressing queries and issues in a timely and effective manner
Qualification
Required
Bachelor's degree in Computer Science, Management Information Systems, or related field
Minimum 3 years of experience in Databricks and Azure stack
Proficient in Azure Data Factory, Azure Data Lake Storage, and Azure Databricks
Skilled in Python/Spark
Understanding of cloud and distributed systems principles, including load balancing, networks, scaling etc
Minimum 3 years of experience in traditional SQL BI Stack
Strong understanding of SQL, data warehousing concepts, and ETL processes
Experience with data modeling, data visualization, and reporting tools
Ability to write clean, well-documented, and efficient code
Excellent problem-solving skills and attention to detail
Strong communication and collaboration skills to work effectively in a team environment
Must be able to work on multiple simultaneous tasks with limited supervision. Able to follow change management procedures and internal guidelines
Strong time-management skills, initiative, commitment, and ability to work under pressure to meet tight deadlines while maintaining high quality standards and best practices
Preferred
Experience in Oil & Gas industry, particularly Midstream
Experience warehousing or reporting against SAP/S4/HANA
Experience with consuming and developing REST API, JSON, XML, and/or JavaScript
Confidence in several programming languages such as R, Python, Scala, or Java, with the ability to pick up new languages and technologies quickly
ITIL Certification or experience using Remedy application is a plus
Benefits
Industry leading compensation
Comprehensive benefits
401(k) match with additional profit sharing
PTO
Abundant career opportunities
Company
Energy Transfer
Energy Transfer LP (NYSE: ET) owns and operates one of the largest and most diversified portfolios of energy assets in the United States, with more than 125,000 miles of pipeline and associated energy infrastructure.
H1B Sponsorship
Energy Transfer has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (12)
2024 (15)
2023 (7)
2022 (3)
2021 (4)
2020 (10)
Funding
Current Stage
Public CompanyTotal Funding
$17.24BKey Investors
Stephens Group
2025-08-11Post Ipo Debt· $2B
2025-02-18Post Ipo Debt· $3B
2024-08-09Post Ipo Secondary· $611.57M
Recent News
2025-12-19
2025-12-18
Company data provided by crunchbase