Principal Hadoop Administrator jobs in United States
cer-icon
Apply on Employer Site
company-logo

Epsilon · 7 hours ago

Principal Hadoop Administrator

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. They are seeking a Principal Hadoop Administrator to install, configure, and maintain Hadoop components, ensuring optimal performance and security while managing user access and permissions.

AdvertisingDigital MediaEmailMarketingMobileSocial Media
check
H1B Sponsor Likelynote

Responsibilities

Install, configure, and maintain an organization's local area network (LAN), wide area network (WAN), data communications network, operating systems, and physical and virtual servers
Troubleshoot Hadoop component's performance and resolve issues
Implement and manage security measures for Hadoop components, including authentication and authorization to safeguard sensitive data
Configure and maintain Hadoop clusters to ensure optimal performance and resource utilization
Integrate and manage various components with the Hadoop ecosystem and ensure seamless interoperability
Administer user access and permissions, controlling who can access and manipulate data within the Hadoop environment using Ranger and Knox
Participate in on-call rotation and monitor the Hadoop cluster health
Maintain thorough documentation of configurations, changes, and procedures
Write adhoc shell scripts for automation like Ranger policy creation and monitoring like resource usage metrics
Assist team members in debugging Hadoop components issues, tuning configurations, adjusting resource allocations, and implementing best practices
Learn new technologies to integrate various Apache tools with Hadoop ecosystem

Qualification

HadoopHiveHDFSSparkLinux ScriptingYarnRangerZookeeperKnoxAtlasGitHubData GovernanceData AnalysisTask Tracking

Required

Employer will accept a Master's degree in Computer Science, Engineering, Business or a related field and five years of experience in the job offered or five years of experience in any occupation in which the required experience was gained
Experience must include five years of experience in each of the following:
Gather data insights using Hive to provide an SQL interface to data on the Hadoop filesystem
Utilize HDFS and HBase to ensure data durability and high-availability and optimal performance by analyzing performance and tuning
Analyze the data in the datalake; through all phases to ensure optimal configuration using Yarn
Organize and track tasks using Jira
Utilize Ranger for security and access control for Hadoop components including Yarn and Hive
Utilize Zookeeper to provide durable and highly-available coordination to intra-cluster processes and Solr for search capabilities over massive datasets
Analyze and modify huge datasets using Spark
Provide secure access to Hadoop cluster using Kerberos and Knox to provide enhanced LDAP based security
Provide data governance and lineage for Hive tables and datasets in a Hadoop cluster using Atlas
Execute changes and commands across servers in an automated fashion with Linux Scripting
Provides version control to shared code repositories using GitHub

Benefits

Flexible time off (FTO), 15 paid holidays
Paid sick time
Parental/new child leave, childcare & elder care assistance, adoption assistance
Comprehensive health coverage
401(k)
Tuition assistance
Commuter benefits
Professional development
Employee recognition
Charitable donation matching
Health coaching and counseling

Company

Epsilon is an all-encompassing global marketing company, a leader in creating connections between people and brands.

H1B Sponsorship

Epsilon has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (132)
2024 (128)
2023 (124)
2022 (201)
2021 (136)
2020 (137)

Funding

Current Stage
Late Stage
Total Funding
unknown
2019-04-15Acquired

Leadership Team

leader-logo
Myron Sojka
CTO
linkedin
leader-logo
Lakshmana Gnanapragasam
Senior Vice President Strategy & Analytics
linkedin
Company data provided by crunchbase