Sidley Austin LLP · 3 hours ago
Data Engineer
Chicago, IL
Full-time
Hybrid
Mid Level
$129K/yr - $144K/yr
3+ years expSidley Austin LLP is seeking a Data Engineer to help build and maintain data pipelines and infrastructure for analytics and machine-learning initiatives. The role involves collaborating with senior engineers and cross-functional partners to transform raw data into reliable datasets that support informed decisions.
AdviceConsultingFinanceFinancial ServicesLegal
Responsibilities
Build E2E Azure Databricks-based data solutions
Design, develop, and maintain scalable ETL and streaming data pipelines on Azure Databricks, leveraging Apache Spark, Delta Lake, and Azure Data Lake Storage (ADLS Gen2) to enable reliable lakehouse architectures and ensure efficient ingestion, transformation, and storage of data
Build and optimize data models and schemas for analytics, reporting, and operational data stores
Build and optimize Delta Lake / Lakehouse patterns (Bronze/Silver/Gold), including schema evolution and time travel
Develop high-quality PySpark / Spark SQL transformations, optimize joins, partitioning, caching, and shuffle behavior
Implement and maintain data quality frameworks, including data validation, monitoring, and alerting mechanisms
Collaborate closely with data architects, data analysts, BI engineers and product teams to align data engineering activities with business goals
Contribute to CI/CD pipelines supported by version control, linting, automated testing, security scanning, and monitoring
Troubleshoot and resolve complex Azure Databricks platform data infrastructure and pipeline issues, ensuring minimal downtime and optimal performance
Follow coding standards, participate in code reviews, and document your work to foster knowledge sharing
Qualification
Required
Bachelor's degree in Computer Science, Engineering, Data Science, or a related field
A minimum of 3 years of hands-on experience designing, building, and operating data solutions on Databricks
Knowledge of Databricks architecture and core components, including Databricks Lakehouse, Delta Lake, Databricks SQL, Apache Spark Clusters, Unity Catalog, Databricks Workflows (Jobs), and Databricks Notebooks
Proficiency with Python, SQL, and Apache Spark for data processing
Proven experience building reusable, metadata-driven data ingestion frameworks using Python and Scala
Familiarity with cloud data-platform components such as object storage, metadata / data catalog services, batch/streaming/CDC ingestion & processing
Proven experience with data modeling, schema design, and performance tuning of large-scale data systems
Experience working with AI & BI engineers to deliver high-quality data products to stakeholders
Skilled at crafting compelling data narratives through tables, reports, dashboards, and other visualization tools
Understanding of data engineering best practices: code repositories, CI/CD pipelines, test automation, monitoring, and alerting systems
Strong problem-solving and analytical skills with excellent attention to detail
Excellent communication skills and experience collaborating with technical and business stakeholders
Preferred
Experience building data pipelines in an Azure Databricks environment
Hands-on experience integrating Azure Databricks with Azure DevOps, Azure Blob Storage / ADLS Gen2, Azure Key Vault, and Azure Data Factory
Familiarity with enterprise data modeling tools such as ERwin Data Modeler, including the ability to interpret and apply logical and physical data models to analytical and lakehouse architectures
Familiarity with Infrastructure as Code (IAC)
Experience working with regulated/sensitive data and controls
Experience working in an Agile delivery model
Benefits
Bonus eligibility
Comprehensive benefits program
Company
Sidley Austin LLP
Sidley is an elite global law firm.
1001-5000 employees
H1B Sponsorship
Sidley Austin LLP has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (51)
2024 (36)
2023 (17)
2022 (33)
2021 (20)
2020 (23)
Funding
Current Stage
Late StageLeadership Team
Anne Falvey
Chief Knowledge Officer
CARTER G. PHILLIPS
Partner
Recent News
2025-12-15
bloomberglaw.com
2025-12-12
Company data provided by crunchbase