ALL KNOWN SERVICES · 1 day ago
Software Engineering Specialist
United States
Contract
Remote
Entry, Mid Level
$55/hr - $55/hr
2+ years expALL KNOWN SERVICES is looking for a Lead I – Software Engineering professional to support and maintain modern data pipelines built on Azure Data Factory, Databricks, PySpark, and Python. This role focuses on ensuring reliability, scalability, and operational excellence of data platforms, with exposure to AI-driven automation and DevOps CI/CD practices in a cloud environment.
Staffing & Recruiting
Hiring Manager
John J
Responsibilities
Support and maintain data pipelines using ADF, Databricks, PySpark, and Python
Monitor, troubleshoot, and ensure high availability and reliability of data systems
Implement and support DevOps CI/CD pipelines
Work within cloud-based environments to manage data workflows
Leverage AI/ML techniques to automate issue detection, reduce manual support tasks, and improve system stability
Collaborate with cross-functional teams to improve data engineering and operational processes
Qualification
Required
Bachelor's Degree in Computer Science, Engineering, or related field (Required)
2–4 years of technical engineering experience
Strong hands-on experience with Databricks
Strong hands-on experience with PySpark
Strong hands-on experience with Python
Strong hands-on experience with SQL / Data Manipulation
Strong hands-on experience with Azure Cloud Storage
Strong hands-on experience with Shell scripting
Strong hands-on experience with DevOps tools and practices
Preferred
2–4 years of experience in Data Modeling, Data Analysis, and Software/Functional Design
Exposure to AI/ML concepts and automation use cases
Experience supporting production data platforms
Company
ALL KNOWN SERVICES
All Known Services is committed to redefining how organizations hire talent and build technology.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase