Technology Lead | Big Data - Data Processing | Spark jobs in United States
cer-icon
Apply on Employer Site
company-logo

Alpha Consulting Corp. · 5 days ago

Technology Lead | Big Data - Data Processing | Spark

Alpha Consulting Corp. is a company seeking a Technology Lead specializing in Big Data and Data Processing. The role involves designing and developing large scale data processing pipelines using Apache Spark and related technologies, while ensuring high code quality and collaboration within diverse teams.

ConsultingPharmaceuticalStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
At least 8 years of experience in Project development life cycle activities and maintenance/support projects
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development

Qualification

SparkScalaSpark StreamingHadoopSQLHiveData StructuresETL conceptsUNIX shell scriptingAgile methodologyAnalytical skillsGlobal delivery experienceProblem solvingCommunication skills

Required

At least 8+ years of experience and strong knowledge in Scala programming language
Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
At least 8 years of experience in Project development life cycle activities and maintenance/support projects
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development
8 years

Preferred

Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala

Company

Alpha Consulting Corp.

twittertwitter
company-logo
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.

H1B Sponsorship

Alpha Consulting Corp. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (3)
2021 (4)
2020 (6)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase