Big Data Engineer – Hadoop, PySpark, Apache Kafka jobs in United States
cer-icon
Apply on Employer Site
company-logo

NuStar Technologies · 4 hours ago

Big Data Engineer – Hadoop, PySpark, Apache Kafka

NuStar Technologies is seeking a Big Data Engineer with expertise in the Hadoop ecosystem and related technologies. The role involves defining architecture for data platforms, implementing data processing pipelines, and collaborating with cross-functional teams to deliver high-performance systems.

AnalyticsConsultingEnterprise Resource Planning (ERP)IT ManagementStaffing Agency
check
H1B Sponsor Likelynote

Responsibilities

Define end-to-end architecture for data platforms, streaming systems, and web applications
Ensure alignment with enterprise standards, security, and compliance requirements
Evaluate emerging technologies and recommend adoption strategies
Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools
Optimize ETL workflows for large-scale datasets and real-time streaming
Integrate Apache Kafka for event-driven architectures and messaging
Build and maintain backend services using Python and microservices architecture
Develop responsive, dynamic front-end applications using Angular
Implement RESTful APIs and ensure seamless integration between components
Work closely with product owners, business analysts, and DevOps teams
Mentor junior developers and data engineers
Participate in agile ceremonies, code reviews, and design discussions

Qualification

Hadoop ecosystemPySparkPythonApache KafkaAngularMicroservicesCI/CD pipelinesCloud platformsAnalytical skillsCommunication skillsLeadership skills

Required

Strong experience with Hadoop ecosystem (HDFS, Hive, Spark)
Proficiency in PySpark for distributed data processing
Advanced programming skills in Python
Hands-on experience with Apache Kafka for real-time streaming
Frontend development using Angular (TypeScript, HTML, CSS)
Expertise in designing scalable, secure, and high-performance systems
Familiarity with microservices, API design, and cloud-native architectures
Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes)
Exposure to cloud platforms (AWS, Azure, GCP)
Bachelor's or Master's degree in Computer Science, Engineering, or related field
9+ years in software development, with at least 4 + years in architecture and Big Data technologies

Preferred

BFSI domain experience or large-scale enterprise systems
Understanding of data governance, security, and compliance standards
Strong analytical and problem-solving abilities
Excellent communication and leadership skills
Ability to thrive in a fast-paced, agile environment

Benefits

Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Company

NuStar Technologies

twittertwitter
company-logo
NuStar Technologies provides staffing, recruiting, cloud enablement, ERP implementation, analytics, web solution, and managed services.

H1B Sponsorship

NuStar Technologies has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
2023 (3)
2022 (1)
2020 (3)

Funding

Current Stage
Early Stage
Company data provided by crunchbase