SoTalent · 23 hours ago
Data Analytics Engineer
Irving, TX
Full-time
Onsite
Senior Level
5+ years expSoTalent is seeking a talented Data & Analytics Engineer II to join their growing technology team. This role focuses on building, expanding, and maintaining robust data pipelines that fuel enterprise-wide analytics and decision-making.
Staffing & Recruiting
Hiring Manager
Mohamed Thasleem Mohideen
Responsibilities
Analyze data sources, participate in requirements gathering, and provide guidance on data modeling and technology best practices
Translate business needs into effective technical designs and scalable data solutions
Design, build, and optimize data pipelines using open-source big data frameworks
Collaborate across teams to troubleshoot issues and deploy solutions that support performance, scalability, and efficiency
Develop high-quality code in alignment with industry and organizational standards
Evaluate and integrate new tools, systems, and technologies into the existing ecosystem
Work with data integration technologies, ETL frameworks, and big data querying tools (Hive, Impala, Spark SQL)
Build and support stream-processing systems using tools like NiFi or Spark Streaming
Apply distributed computing principles and advanced data engineering practices, including Lambda Architecture
Utilize SQL performance tuning techniques across transactional, MPP, and columnar architectures
Participate in designing applications, databases, and interfaces, with a focus on analytics and BI environments
Qualification
Required
Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field
3+ years of hands-on experience with MapReduce and Spark programming
3+ years working with analytics solutions on large datasets within OLAP or MPP environments
5+ years designing and developing enterprise-scale platforms using open-source technologies
Strong experience with Python, Spark, Hive, HDFS, NiFi, and big data processing
Solid understanding of relational and non-relational databases, data mining, and ETL frameworks
Preferred
Working knowledge of SQL Server
Experience with SSIS
Healthcare IT background is a plus
Hadoop or Java certifications are an added advantage
Company
SoTalent
At SoTechTalent, we specialise in connecting forward-thinking tech companies with world-class talent.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase