Apply on Employer Site

Ventures Unlimited Inc · 11 hours ago

Kafka Tester

Dallas, TX

Full-time

Onsite

Mid Level

Ventures Unlimited Inc is seeking a Kafka Tester to ensure the quality and performance of data pipelines. The role involves designing and executing test cases for ETL workflows, validating data processes within Kafka, and collaborating with development teams to resolve data issues.

ConsultingInformation TechnologyStaffing Agency

Diversity & Inclusion

Hiring Manager

Prabhakar Choudhary

Responsibilities

Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data

Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems

Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka architecture and concepts

Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts

Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions

Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput

Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle

Familiarity with data warehousing concepts and cloud data platforms is often a plus

Qualification

Apache KafkaSQLETLTest AutomationData AnalysisScriptingAgile/ScrumData WarehousingCommunication

Required

Apache Kafka: Deep understanding of Kafka architecture, components, and functionality

SQL: Experience with SQL for data validation and debugging

ETL: Experience with ETL processes and data warehousing concepts

Test Automation: Experience in developing and maintaining automated tests for data pipelines

Data Analysis: Ability to analyze data, identify issues, and propose solutions

Communication: Strong communication and collaboration skills are essential for working with development teams

Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data

Data Validation: Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems

Kafka Expertise: Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka architecture and concepts

Scripting and Automation: Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts

Issue Resolution: Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions

Performance Testing: Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput

Agile/Scrum: Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle