Alpha Consulting Corp. ยท 1 month ago
Java Tech lead ( Nifi, Airflow)
Phoenix, AZ
Full-time
Hybrid
Senior LevelAlpha Consulting Corp. is seeking a Java Tech Lead with expertise in NiFi and Airflow. The main responsibilities include creating and implementing data flow solutions using NiFi, managing data ingestion, and ensuring scalable and performant data flows.
ConsultingPharmaceuticalStaffing Agency
Responsibilities
Creating and implementing data flow solutions using NiFi, including defining data sources, destinations, and transformation processes
Managing data ingestion from various sources (e.g., files, databases, APIs) and transforming data into desired formats for downstream consumption
Configuring NiFi to route data to appropriate destinations and enriching data with additional information (e.g., timestamps, location)
Ensuring data flows are scalable and performant to handle varying data volumes and velocity
Maintaining and improving NiFi clusters, including configuration, optimization, and troubleshooting
Identifying and resolving issues related to data flows, NiFi configurations, and data integration processes
Identifying and addressing performance bottlenecks in Airflow environments and implementing best practices for orchestration and scheduling
Qualification
Required
Strong NiFi Expertise: Deep understanding of Apache NiFi architecture, processors, controllers, and data flow management capabilities
Proficiency in Java, Spring Boot & API Microservices
Familiarity with databases, SQL, and data manipulation techniques
Experience with Big Data Technologies, specifically Kafka (Event-driven & streaming architecture)
Deep knowledge of Airflow's architecture, including schedulers, executors (Celery, Kubernetes), and plugin development
Experience in designing and implementing data flow solutions using NiFi
Experience in developing and integrating microservices to support data conditioning, format validation, and transformation processes
Experience in designing and developing complex, modular, and reusable DAGs (Directed Acyclic Graphs) to automate data pipelines
Benefits
Inclusive and diverse work environment.
Opportunities for professional growth and development.
Supportive team culture.
Company
Alpha Consulting Corp.
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
Founded in 1994
201-500 employees
H1B Sponsorship
Alpha Consulting Corp. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (3)
2021 (4)
2020 (6)
Funding
Current Stage
Growth StageCompany data provided by crunchbase