Southern Company · 8 hours ago
Data Engineer I or II
Atlanta, GA
Full-time
Onsite
Senior Level
6+ years expSouthern Company is a leading energy provider serving 9 million customers across the Southeast and beyond. They are seeking a Data Engineer I or II to build, operationalize, and maintain data pipelines for Data, Analytics & Artificial Intelligence use cases, ensuring data is readily consumable for various consumers.
EnergyNatural ResourcesNuclear
Responsibilities
Designing and Developing methods to process structured, semi-structured, and unstructured data using batch and real-time data processing techniques
Delivering fast, reliable, and scalable data by incrementally and efficiently processing as it arrives from files or streaming sources like Kafka, DBMS and NoSQL
Developing Release pipelines to automate recurring manual tasks like creating a build package, checking that build package into a version control repository and deploying it to a DV/UA environment
Building and Maintaining templates such as code libraries, pipeline patterns and semantic models to promote reuse and agility
Establishing gatekeeping processes that monitor and controls the promotion of successful data processes into production by understanding the business criticality
Collaborating with cross-functional teams with a combination of data, business, and technical personas, as well as a product owner/manager as necessary
Advocating data reusability by breaking down monolithic data delivery processes into modular data product delivery
Ensuring data reliability by defining data quality and integrity controls within the pipeline with defined data expectations and addressing data quality errors with predefined policies
Actively working with less experienced data engineers providing technical guidance and oversight
Understanding the usage of performance optimization clusters that parallelize jobs and minimize the data movement in Batch and stream data processing
Recommending improvements to the processes, technology, and interfaces that reduce the development time and effort and enhance the effectiveness of the team
Promptly participating in the Enterprise Social Networking sites, staying up to date on new data technologies and best practices and sharing insights with others in the organization
Qualification
Required
Bachelor's degree in computer science (CS), MIS, CIS, Mathematics, Statistics (Theoretical/Computational), Machine Learning or a related field
Proven knowledge of data engineering, data integration and data science principles are required
6+ years of related work experience in a fast-paced, competitive organization driven by data and enabled by technology
Working experience with batch and real-time data processing frameworks
Working experience with data modelling, data access, schemas, and data storage techniques
Working experience with data quality tools
Experience in creating functional and technical designs for data engineering and analytics solutions
Experience implementing data models of different schemas and working with diverse data source types
Hands-on experience developing solutions with big data technologies such as Hadoop, HIVE and Spark
Hands-on experience developing and supporting Python based AI/ML solutions
6+ years hands on experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions using on-premises tools such as, Microsoft's BI Stack (SSIS/SSAS/SSRS), Informatica, Oracle Golden Gate, SQL, Oracle, and SQL Server
4+ years hands on experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions using Microsoft cloud-based tools such as Azure Data Lake, Azure Data Factory, Azure Databricks, Python, Azure Synapse, Azure Key Vault, and Power BI
Experience with Containerization methodologies – Docker, OpenShift etc
Experience with Agile as well as DevOps, CI/CD methodologies
Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services
Experience working with Jira or similar tools
Experience working with Kafka or similar tools
Benefits
Competitive base salary
Annual incentive awards for eligible employees
Health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being
Incentive program
Company
Southern Company
Southern Company headquartered in Birmingham, Alabama, is the shared services division of Southern Company.
10001+ employees
H1B Sponsorship
Southern Company has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2023 (4)
2020 (3)
Funding
Current Stage
Public CompanyTotal Funding
$6.16BKey Investors
GRIP Program
2025-10-03Post Ipo Equity· $1.75B
2025-05-20Post Ipo Debt· $1.45B
2024-10-21Grant· $160M
Leadership Team
Thomas Fanning
President and CEO
David Poroch
Chief Financial Officer
Recent News
2026-01-22
Idaho Business Review
2025-12-26
Company data provided by crunchbase