Big Data Developer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Dexian · 7 hours ago

Big Data Developer

Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees. They are seeking a Big Data Developer to design, build, and support data pipelines while optimizing large-scale distributed data processing systems.

ConsultingHuman ResourcesInformation TechnologyProfessional ServicesStaffing Agency
check
H1B Sponsor Likelynote
Hiring Manager
Pooja Bhatia
linkedin

Responsibilities

Design, build, and support near-real-time and batch data pipelines
Develop and optimize large-scale distributed data processing systems
Work closely with cross-functional teams in an Agile environment
Troubleshoot, tune, and enhance performance of Spark, MapReduce, and SQL workloads
Partner with stakeholders to understand requirements and deliver effective data solutions

Qualification

SQLHadoopSparkNoSQLScalaPythonLinuxGitJenkinsShell scripting

Required

Strong SQL skills (one or more of MySQL, Hive, Impala, Spark SQL)
Experience with Hadoop/Big Data ecosystems and distributed systems
Hands-on experience with Spark (including Structured Streaming), Sqoop, Kafka, MapReduce
Experience with NoSQL technologies such as HBase, Solr
Exposure to Cloudera (CDP/HDP), ElasticSearch, Kibana
Experience ingesting data from message queues, file shares, REST APIs, and relational databases
Familiarity with data formats such as JSON, CSV, XML
Hands-on programming experience in Scala, Python, Shell scripting (PHP a plus)
Performance tuning experience for Spark, MapReduce, and SQL jobs
Strong proficiency with Linux
Experience with source control (Git, SVN, Bitbucket)
Working knowledge of Jenkins and JAR/package management

Company

Dexian provides services for staffing, talent development, and consulting, with a focus on technology, finance, and project management.

H1B Sponsorship

Dexian has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (65)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mahfuz Ahmed
Chairman of the Board
linkedin
leader-logo
Vikram Motiani
Managing Director
linkedin
Company data provided by crunchbase