Scalence L.L.C. · 1 month ago
Java Tech lead ( Nifi, Airflow)
Phoenix, AZ
Full-time
Hybrid
Senior LevelScalence L.L.C. is a company seeking a Java Tech Lead with expertise in NiFi and Airflow. The role involves creating and managing data flow solutions, ensuring scalability and performance of data processes, and addressing integration challenges.
Information Technology & Services
Responsibilities
Creating and implementing data flow solutions using NiFi, including defining data sources, destinations, and transformation processes
Managing data ingestion from various sources (e.g., files, databases, APIs) and transforming data into desired formats for downstream consumption
Configuring NiFi to route data to appropriate destinations and enriching data with additional information (e.g., timestamps, location)
Ensuring data flows are scalable and performant to handle varying data volumes and velocity
Maintaining and improving NiFi clusters, including configuration, optimization, and troubleshooting
Identifying and resolving issues related to data flows, NiFi configurations, and data integration processes
Identifying and addressing performance bottlenecks in Airflow environments and implementing best practices for orchestration and scheduling
Qualification
Required
Strong NiFi Expertise: Deep understanding of Apache NiFi architecture, processors, controllers, and data flow management capabilities
Proficiency in Java, Spring Boot & API Microservices
Familiarity with databases, SQL, and data manipulation techniques
Experience with Big Data Technologies, specifically Kafka (Event-driven & streaming architecture)
Deep knowledge of Airflow's architecture, including schedulers, executors (Celery, Kubernetes), and plugin development
Experience in designing and implementing data flow solutions using NiFi
Experience in developing and integrating microservices to support data conditioning, format validation, and transformation processes
Experience in designing and developing complex, modular, and reusable DAGs (Directed Acyclic Graphs) to automate data pipelines
Benefits
Inclusive and diverse work environment.
Opportunities for professional growth and development.
Supportive team culture.
Company
Scalence L.L.C.
In today’s dynamic and competitive market, success hinges on mastering three key areas: Data Intelligence, Business Resilience, and Digital Experience.
501-1000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase