Hadoop Administrator jobs in United States
info-icon
This job has closed.
company-logo

Cynet Systems · 6 days ago

Hadoop Administrator

positionCharlotte, NC
timeFull-time
remoteOnsite
seniorityMid Level
date4+ years exp

Cynet Systems is seeking a Hadoop Administrator to manage and optimize MapR-based Hadoop clusters in a production environment. The role involves overseeing daily operations, ensuring security and compliance, and developing automation for operational tasks.

EmploymentRecruitingStaffing Agency
check
Growth Opportunities

Responsibilities

Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment
Oversee daily operations, including cluster health checks, performance tuning, capacity planning, and system upgrades
Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools
Configure, support, and optimize multi-tenant setups, ensuring isolation, resource fairness, and performance SLAs
Manage YARN queues, ACLs, quotas, and security policies per tenant requirements
Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs
Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services
Manage node failures, job failures, and cluster rebalancing while maintaining uptime
Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar
Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management
Ensure compliance with internal and external standards for data governance and security
Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations
Ensure 24/7 availability of production environments and participate in on-call rotation
Develop automation for operational tasks using Python, Shell scripting, or Ansible
Streamline cluster provisioning, monitoring, and deployment pipelines

Qualification

Hadoop AdministrationMapR-FSLinux AdministrationPerformance TuningShell ScriptingMonitoring ToolsHadoop SecurityAutomationMulti-Tenant EnvironmentsCloud Services

Required

4+ years of hands-on experience as a Hadoop/MapR Administrator
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka
Experience managing production clusters with high availability requirements
Proficiency in Linux administration (RHEL/CentOS/Ubuntu)
Expertise with multi-tenant Hadoop environments, resource governance, and user management
Strong skills in shell scripting, automation, and performance tuning
Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS)
Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration)

Preferred

Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) – a plus
Knowledge of Cloud (AWS/Azure/GCP) big data services
Experience with CI/CD pipelines, DevOps tools, or containerized big data workloads

Company

Cynet Systems

twittertwitter
company-logo
Headquartered in Washington DC Metro Area, Cynet Systems is a top talent supplier for companies across North America.
dateFounded in 2010
location
Ashburn, Virginia, USA
people-size1001-5000 employees
web-link
http://www.cynetsystems.com

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Ashwani (Ash) M.
Partner and Co-CEO
linkedin
leader-logo
Nikhil "Nick" Budhiraja
Founder / Co-CEO
linkedin
Company data provided by crunchbase