Cynet Systems ยท 2 months ago
Big Data Platform Support Engineer
Reston, VA
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expCynet Systems is seeking a Big Data Platform Support Engineer to lead the design, development, and support of large-scale data platforms, particularly focusing on Cloudera and related technologies. The role involves ensuring high performance and reliability of data pipelines while mentoring junior engineers and collaborating with cross-functional teams.
EmploymentRecruitingStaffing Agency
Responsibilities
Lead a team of software engineers in the design, development, and implementation of multiple applications
Perform detailed technical design, coding, code reviews, and testing of new and existing applications
Serve as a subject matter expert for specified systems and ensure compliance with DevSecOps practices and policies
Identify gaps in requirements and develop solutions to improve system performance and availability
Lead evaluations of risk, opportunities, and technology integration across projects
Support the Project Manager as the technical lead, estimating technical costs and defining system requirements
Participate in architectural planning, roadmap discussions, and transformation initiatives to new software architectures
Extend open-source libraries and systems to meet team requirements
Ensure adherence to code quality, deployment standards, and practices
Mentor junior developers and foster a culture of continuous improvement
Qualification
Required
8 years of software design, development, testing, and requirements management
Strong experience supporting Cloudera applications running in cloud environments
Hands-on experience with Cloudera Manager for monitoring and maintaining production clusters
Expertise in writing shell scripts for Hadoop daemon service health checks and automation tasks
Experience working with Hive, Impala, HBase, and SOLR, including query optimization and database management
Proficient in coordinating with application development, security, and platform teams for configuration and performance enhancements
Cloudera administration and optimization (CDP, CDSW, Hive, Spark, NiFi)
Cloud application support with MongoDB
Experience in cloud disaster recovery strategies
Strong Kafka administration and troubleshooting, including Streams API, integration with MQ, topic/offset management, and broker management
Apache NiFi administration, registry management, and integration with Kafka, HBase, and Solr
HBase administration, troubleshooting, and database management
Solr administration, managing shards, collections, logging levels, and query optimization
Flume integration with Kafka, NiFi, and IBM MQ
Bachelor's degree in Information Technology or Computer Science
In lieu of a degree, an additional 4 years of relevant work experience is required
Company
Cynet Systems
Headquartered in Washington DC Metro Area, Cynet Systems is a top talent supplier for companies across North America.
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Ashwani (Ash) M.
Partner and Co-CEO
Nikhil "Nick" Budhiraja
Founder / Co-CEO
Company data provided by crunchbase