Veracity Software Pvt. Ltd. ยท 2 months ago
Big Data Platform Engineer
Charlotte, NC
Full-time
Hybrid
Mid, Senior LevelVeracity Software Pvt. Ltd. is seeking a highly skilled Tools Administration & Engineering Specialist to join their Data private cloud. This role involves managing, supporting, and engineering platform tools across various big data and cloud environments, requiring collaboration with technical staff and stakeholders.
Information Technology & Services
Responsibilities
Administer and support tools on the Data private cloud , Including CDP, HWX, MapR
Install, configure, and maintain data analytical and virtualization tools such as Dremio, JupyterHub and AtScale, across multiple clusters
Develop proof-of-concept solutions leveraging CDP and OCP technologies
Deploy tools and troubleshoot issues, perform root cause analysis, and remediate vulnerabilities
Act as a technical subject matter expert, supporting programming staff during development, testing, and implementation phases
Develop automation scripts for configuration and maintenance of data virtualization tools
Lead complex platform design, coding, and testing efforts
Drive advanced modeling, simulation, and analysis initiatives
Maintain comprehensive documentation of Hadoop cluster configurations, processes, and procedures
Generate reports on cluster usage, performance metrics, and capacity utilization
Work closely with data engineers, data scientists, and other stakeholders to understand their requirements and provide necessary support
Collaborate with IT infrastructure teams for integrating Dremio Tool, Hadoop clusters with existing systems and services
Qualification
Required
Strong experience with big data platforms: MapR, Hortonworks, Cloudera Data Platform
Hands-on expertise with data virtualization tools: Dremio, JupyterHub, AtScale
Proficiency in deploying and managing tools in cloud and containerized environments (CDP, OCP)
Solid understanding of platform engineering, automation scripting, and DevOps practices
Proven ability to troubleshoot complex issues and perform root cause analysis
Experience in leading technical efforts and mentoring team members
Preferred
Certifications in Cloudera, OpenShift, or related technologies
Experience with enterprise-level data lake architectures and governance
Company
Veracity Software Pvt. Ltd.
At Veracity, if you have an idea you want to validate, a product you need to build, or an existing product that needs optimization, our teams are trained to jump in wherever needed.
Founded in 2010
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase