Artificial Analysis ยท 4 months ago
Product Manager (AI Media Generation)
San Francisco, CA
Full-time
Hybrid
Mid LevelArtificial Analysis is an independent AI benchmarking and insights company. They are seeking a Product Manager focused on AI media generation to develop and enhance media generation arenas and leaderboards, contributing to product strategy and execution.
Computer Software
Hiring Manager
Ben Bayliss
Responsibilities
Product Development for Media Generation AI Benchmarking: Contribute to Media Generation AI product strategy and help execute the roadmap for our media generation evaluation platforms, including image, video, audio, and emerging modalities - including working with engineers on our team to develop features and potentially coding features yourself
Curate and Develop Media Generation Evaluation Frameworks: Build and maintain comprehensive frameworks, prompt libraries and evaluation techniques that reflect real-world usage patterns to test the capabilities, strengths and weaknesses of media generation models. Our aim is to reflect not just how consumers and professionals are using media generation models today, but how they might be able to use future models in the coming months and years
Media Generation Operations: Ensure that coverage of media generation models across Artificial Analysis stays up to date by benchmarking new models and providers - both working with our development team and using our tooling yourself (e.g. running Python scripts)
Creative Direction & Use Case Analysis: Deeply understand how creators are pushing the boundaries with AI media tools, and translate these insights into evaluation frameworks that help creators understand AI capabilities in the future
Strategic Marketing Support and Community Engagement: Help amplify the impact of our media generation benchmarks, collaborating with our team to maximize impact of our content across platforms and audiences
Industry Engagement: Work with with leading companies to benchmark their media generation models, understanding their capabilities and helping shape industry standards for how AI media capabilities are evaluated
Become AI-Native: Embrace an AI-native workflow, using the latest AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking
Qualification
Required
Strong analytical and critical thinking skills
Excitement about AI and eagerness to work at the forefront of technological innovation
Demonstrated excellence, both academically and professionally
Real interest in media generation AI models - especially image and video models
Preferred
Experience working with image and video generation AI models - especially building products leveraging recent models
Experience working in a product role at a creative software company (Canva, Adobe, Figma) or in a startup environment
Experience in strategy consulting
Academic success in a technical degree programme, especially related to AI (e.g. Computer Science, Engineering), or in related technical field (e.g. Physics, Maths)
Strong writing skills, especially in relation to explaining technical topics to both technical and non-technical audiences
Visual communication skills (e.g. making slides, visualizing data)
A strong perspective on AI scaling laws - and specifically their implications for media models
Publication record in AI/ML conferences or journals (or more broadly any publication record, including non-technical or non-traditional)
Familiarity with modern AI language models (e.g. developing systems leveraging LLMs as a component)
Experience working in software engineering or data science
Proficiency in Python and data analysis libraries (e.g., pandas, numpy, matplotlib); experience with AI/ML frameworks (e.g. PyTorch, Tensor Flow)
Benefits
Competitive compensation package (including potential for equity)
Flexible work arrangements, including remote and hybrid options
Company
Artificial Analysis
Leading independent analysis of AI. Understand the AI landscape to choose the best AI technologies for your use case.
11-50 employees
H1B Sponsorship
Artificial Analysis has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase