Apply on Employer Site

NBCUniversal · 6 days ago

Manager, Media Experimentation

New York, NY

Full-time

Hybrid

Mid Level

$100K/yr - $160K/yr

4+ years exp

NBCUniversal is one of the world's leading media and entertainment companies. The Manager, Media Experimentation leads NBCU’s incrementality testing program for Performance and Device media, collaborating with various teams to inform crucial company decisions on marketing investment and allocation.

BroadcastingMedia and EntertainmentNews

Responsibilities

Co-own the experimentation roadmap with the Sr. Manager of Media Experimentation; define learning agenda, decision questions, hypotheses, success metrics, guardrails, and power thresholds; review/approve vendor designs and reject under-powered or invalid proposals

Lead day-to-day relationship with external measurement vendor— partner with Sr. Manager to prioritize the study backlog, deliver accurate data, align on methods, track SLAs and change logs, escalate blockers

Collaborate with Sr. Manager of Media Experimentation on ensuring clear schedules, accurate data inputs, agency and/or vendor alignment, and structured documentation of results

Partner with the vendor and a Media Analytics analyst to produce clear, defensible readouts that inform decisions (lift, uncertainty, risks); write concise decision memos and hand off to Optimization and & Insights team for execution and pacing/optimization

Drive calibration with MMM/MTA; propose tiebreakers and thresholds for decisioning; contribute to cross-channel measurement efforts by triangulating learnings

Ensure high quality of analysis with speed; Monitor design defects/leakage; run targeted validations (SQL/R/Python spot checks) as needed; improve run-rate without sacrificing validity

Mentor a Media Analytics analyst; uplevel partner teams (brief quality, power, common pitfalls); collaborate with data science and other analytics & media teams; contribute to a standardized measurement approach across the NBCU Media Group

Qualification

Marketing/media experimentationCausal inferenceSQLRPythonData analysisBig data infrastructureProject managementCuriosityInnovative mindsetCommunication skillsInterpersonal skills

Required

4+ years in marketing/media experimentation with direct design/QA ownership and experience partnering with an incrementality testing measurement vendor (e.g., Haus, Measured, or similar)

Proven command of causal inference in media—appropriate use of RCT, geo, diff-in-diff, and platform holdouts—and the ability to evaluate vendor assumptions/methods

Familiarity with power analysis, and failure modes (leakage, seasonality, parallel trends); history of stopping or redesigning under-powered tests

Platform experience: Google/Meta/TikTok incrementality and at least one CTV/Device environment (e.g., Roku, Samsung, Vizio)

Experience reconciling vendor experiment reads with MMM/MTA and informing planning/pacing decisions without surprises

Fluent in SQL and Excel

Knowledge of big data infrastructure and data science techniques

Effective communicator and collaborator with strong project management; ability to work in a highly matrixed environment and influence media buyers/channel leads

Preferred

Strong interpersonal skills with the ability to collaborate, motivate, and influence

Ability to thrive in a fast-paced environment and meet tight deadlines

Proficient in using R or Python for data analysis

Strong interest in the media industry, specifically in television and streaming

Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment

Benefits

Medical, dental and vision insurance

401(k)

Paid leave

Tuition reimbursement

A variety of other discounts and perks

Company

NBCUniversal

Glassdoor4.0

NBCUniversal is a media company that provides entertainment and news development, production, distribution, and marketing services. It is a sub-organization of Comcast.

Founded in 1912

New York, New York, USA

10001+ employees