Apply on Employer Site

NetSuite · 4 months ago

Senior Principal Applied Scientist - AI Infrastructure Innovation

United States

Full-time

Remote

Senior Level, Lead/Staff

10+ years exp

NetSuite is seeking a Senior Principal Applied Scientist for their AI Innovation team. This role involves shaping Oracle’s next generation AI infrastructure through research and collaboration, focusing on machine learning techniques and production-ready code.

Cloud ComputingComputerCRMiOSSaaSSoftware

Responsibilities

Conduct in-depth research on foundation model evaluation, including traditional NLP/CV metrics, LLMaaJ techniques, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation. Produce production-ready code for handoff of POC applications to counterparts in Engineering

Work closely with cross-functional teams to integrate evaluation capabilities into various applications and products

Identify new opportunities for evaluation and explore emerging technologies

Maintain a deep understanding of industry trends and advancements in evaluation

Qualification

Machine Learning TechniquesGenerative AIPythonTensorFlowPyTorchAnalytical SkillsProblem-solvingLeadershipCommunication

Required

10+ years of experience in relevant field

Deep understanding of machine learning techniques, including foundation model evaluation, traditional NLP/CV metrics, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation

Experience in conducting in-depth research

Experience producing production-ready code

Experience collaborating with cross-functional teams to integrate evaluation capabilities into various products

Strong background in programming languages, such as Python

Experience with machine learning frameworks, such as TensorFlow or PyTorch

Strong publication record, including as a lead author or reviewer, in top-tier journals or conferences

Extensive experience in generative AI and model/application evaluation

Strong understanding of machine learning algorithms and architectures

Excellent problem-solving and analytical skills

Strong leadership and communication abilities

Preferred

PhD in Computer Science, Mathematics, Statistics, Physics, Linguistics, or a related field, with a dissertation or thesis centered on machine learning techniques

Master's or Bachelor's degree with relevant experience will also be considered