ShiftCode Analytics, Inc. ยท 2 months ago
Lead Data Engineer
New York City, NY
Full-time
Onsite
Lead/Staff
8+ years expShiftCode Analytics, Inc. is seeking a forward-thinking Lead Data Engineer to work on-site in New York, NY. The role involves designing and developing enterprise-wide big data solutions, with a focus on ETL/ELT processes and frameworks, while leveraging expertise in various programming languages and database technologies.
AnalyticsConsultingInformation Technology
Responsibilities
At least 8+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution
Strong Application development experience in Scala/Python
Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch
Strong Database SQL experience, preferably Redshift
Strong in Git repo and CI/CD deployment process
Experience in Snowflake
Experience with ETL/ELT process and frameworks is a must
Create integration and application technical design documentation
Conduct peer-reviews of functional design documentation
Complete development, configuration, test cases and unit testing
Perform code reviews and ensure standards are applied to each solution component
Resolve complex defects during testing phases and identify root causes
Drive performance testing
Production Support: Assist in troubleshooting production environment and tuning environments
Ensure best practices are followed from a technical perspective during all phases of the project
Qualification
Required
At least 8+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution
Strong Application development experience in Scala/Python
Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch
Strong Database SQL experience, preferably Redshift
Strong in Git repo and CI/CD deployment process
Experience in Snowflake
Experience with ETL/ELT process and frameworks is a must
Create integration and application technical design documentation
Conduct peer-reviews of functional design documentation
Complete development, configuration, test cases and unit testing
Perform code reviews and ensure standards are applied to each solution component
Resolve complex defects during testing phases and identify root causes
Drive performance testing
Production Support: Assist in troubleshooting production environment and tuning environments
Ensure best practices are followed from a technical perspective during all phases of the project
Domain Experience: Asset Management
Domain Experience: Financial Services
Domain Experience: Investment Management
Domain Experience: Hedge Funds
Company
ShiftCode Analytics, Inc.
ShiftCode Analytics Inc is a Tampa, FL based firm formed with one sole purpose of delivering best and quick services to its clients nationwide.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase