Technology Lead | Big Data - Data Processing | Spark jobs in United States
cer-icon
Apply on Employer Site
company-logo

IMCS Group · 2 days ago

Technology Lead | Big Data - Data Processing | Spark

IMCS Group is one of the fastest growing MWBE staffing firms in the U.S. They are seeking a Technology Lead specializing in Big Data and Data Processing with expertise in Spark and Scala. The role involves designing and developing large scale, distributed data processing pipelines and collaborating with diverse teams to troubleshoot and resolve data issues.

Staffing & Recruiting
check
Growth Opportunities
badNo H1Bnote

Responsibilities

Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development

Qualification

SparkScalaSpark StreamingHadoopSQLHiveSqoopImpalaUNIX shell scriptingAgileAnalytical skillsProblem solvingCommunication skills

Required

At least 8+ years of experience and strong knowledge in Scala programming language
Able to write clean, maintainable and efficient Scala code following best practices
Good knowledge on the fundamental Data Structures and their usage
At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies
Having expertise in Spark Core, Spark SQL and Spark Streaming
Experience with Hadoop, HDFS, Hive and other BigData technologies
Familiarity with Data warehousing and ETL concepts and techniques
Having expertise in Database concepts and SQL/NoSQL operations
UNIX shell scripting will be an added advantage in scheduling/running application jobs
At least 8 years of experience in Project development life cycle activities and maintenance/support projects
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives
Understand project requirements and translate them into technical solutions which meets the project quality standards
Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues
Strong problem solving and Good Analytical skills
Excellent verbal and written communication skills
Experience and desire to work in a Global delivery environment
Stay up to date with new technologies and industry trends in Development
Karat assessment

Preferred

Spark Streaming
Hadoop
Hive
SQL
Sqoop
Impala

Company

IMCS Group

twitter
company-logo
IMCS Group is an IT, Healthcare, and Professional Staffing Company that helps Enterprises optimize the business value of their Staffing investments and enables them to achieve world-class business performance.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Satish G Kumar
Founder and CEO
linkedin
leader-logo
Kathleen Thompson
Diretor Client Partnership
linkedin
Company data provided by crunchbase