IMCS Group · 1 month ago
Technology Lead | Analytics - Packages | Python - Big Data
Hopkins, MN
Full-time
Onsite
Senior Level
6+ years expIMCS Group is one of the fastest growing MWBE staffing firms in the U.S. The Technology Lead will focus on operations related to the AI Dojo Databricks platform, providing support, automation, and ensuring system reliability and security.
Staffing & Recruiting
No H1B
Responsibilities
Provide continuous SRE support to thousands of geographically distributed users on the AI Dojo Databricks platform: respond to tickets, triage support, liaise with customers
Improve existing Infrastructure as Code (IaC) according to best DevOps practices
Develop and maintain monitoring frameworks to timely respond to outages and other service interruptions
Collaborate with internal cybersecurity teams to ensure all systems and operations comply with industry standards and are secure against evolving threats
Forecast and manage capacity requirements for the AI/ML training environment, while identifying opportunities to reduce costs without compromising performance
Qualification
Required
Bachelor's degree in computer science, information technology, or a related field
6+ years of infrastructure experience: Proven experience working on large-scale, cloud-based, enterprise-level software platforms and deep understanding of Databricks environment
Experience building Github Actions pipelines including composite actions, OIDC federation for cloud provider identity acquisition, and use of environments and deployment controls
Experience building Databricks Asset Bundle and Terraform pipelines to manage and deploy Databricks Platform and Workspace resources
Fluency in Python, experience with the Databricks Python SDK to perform Workspace operations, and familiarity with PySpark and Delta Lake
Deep familiarity with Databricks APIs, and use of the Databricks CLI for use provisioning Workspace identities, filesystem resources, and the querying of account and workspace level Users, Groups, and Service Principals
Strong understanding of security best practices and experience ensuring compliance with relevant regulatory frameworks
3+ years of practical experience in Infrastructure-as-Code and CI/CD tools like Terraform, Git Actions and alike
3+ years of experience working in support teams that are geographically distributed
Preferred
Expert-level proficiency in Databricks, Python and SQL
Company
IMCS Group
IMCS Group is an IT, Healthcare, and Professional Staffing Company that helps Enterprises optimize the business value of their Staffing investments and enables them to achieve world-class business performance.
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
Satish G Kumar
Founder and CEO
Kathleen Thompson
Diretor Client Partnership
Company data provided by crunchbase