Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

Netflix says multimodal embeddings help it choose artwork and video previews even when a new title or asset has too little interaction history for an asset-ID model to learn what members prefer. Its MAPS account describes combining content signals with personalization data, testing candidates offline and online, and deploying the resulting embeddings across Netflix surfaces. The findings and deployment claims below are Netflix’s own report, not an independent evaluation.

Why new titles and assets are difficult to personalize

Netflix’s asset-ID models learn from members’ interactions with known artwork or previews. A newly created asset has no such history, so an ID-only model has little basis for predicting how a particular member will respond. Netflix describes the resulting cold-start problem as one it historically addressed by increasing exploration or relying on popularity heuristics until more interaction data accumulated.

Content embeddings offer another signal sooner: a model can represent what an asset looks or sounds like before members have interacted with it. The practical question is not just which title to recommend, but which image or preview to show a given member—and what to show immediately after a title launches.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How Netflix personalizes artwork across five canvases

For each artwork image, Netflix uses pretrained CLIP to produce a 768-dimensional image embedding. It concatenates that vector with the artwork’s learned asset-ID embedding, then feeds the combined representation through a multilayer perceptron (MLP) to score the asset for a member. The image signal is intended to let preferences learned from related visual content inform predictions for an artwork asset that has little or no interaction history of its own.

#1 Best Overall
Sale
Roku Streaming Stick HD with Voice Remote
  • HD streaming made simple: With America’s number 1 TV streaming platform,* exploring popular apps—plus tons of free movies, shows, and live TV—is as easy as it is fun. *Based on hours streamed—Hypothesis Group
  • Compact without compromises: The sleek design of Roku Streaming Stick won’t block neighboring HDMI ports, and it even powers from your TV alone, plugging into the back and staying out of sight. No wall outlet, no extra cords, no clutter.
  • No more juggling remotes: Power up your TV, adjust the volume, and control your Roku device with one remote. Use your voice to quickly search, play entertainment, and more.
  • Shows on the go: Take your TV to-go when traveling—without needing to log into someone else’s device.
  • TV, simplified: With setup that only takes minutes, a simple-to-navigate Home Screen, and an uncluttered remote control that does all you need—Roku makes it easier to watch the TV you love.

Netflix names five artwork canvases: billboard, vertical-box, horizontal-panel, short-panel, and landscape-panel. It says CLIP’s relative invariance to crops, resizing, and aspect ratios made it possible to pool interaction signals across those surfaces in one model rather than train five separate models. In Netflix’s account, gains were greatest on canvases with the least interaction data.

Pooling also creates an imbalance problem: canvases differ in impression volume and in the kinds of interactions they generate. Netflix says it weights training examples according to the long-term reward assigned to each interaction type. That approach is meant to keep high-volume, short-term actions from dominating while avoiding a manually selected weight for every canvas.

Rank #2
Amazon Fire TV Stick 4K Plus with AI-powered Fire TV Search, Wi-Fi 6, stream hundreds of thousands of movies and shows, free & live TV, find shows faster with Alexa+
  • Advanced 4K streaming - Elevate your entertainment with the next generation of our best-selling 4K stick, with improved streaming performance optimized for 4K TVs.
  • The newest Fire TV experience (2026) – Our biggest update to Fire TV has a new, modern design that gets you to your entertainment fast. Browse dedicated content categories, pin more of your favorite apps, and get personalized recommendations from Alexa+. Spend less time scrolling, and more time watching.
  • Cloud gaming, no console required – Stream Call of Duty: Black Ops 7, Hogwarts Legacy, Outer Worlds 2, Ninja Gaiden 4, and hundreds of games on your Fire TV Stick 4K Select with Xbox Game Pass and Luna via cloud gaming. Xbox Game Pass subscription and compatible controller required. Each sold separately.
  • Smarter picks with Alexa+ – Getting to what you love has never been easier. Press the voice remote button and talk naturally to find what to watch across your apps, manage your smart home, or dive into virtually any topic.
  • Wi-Fi 6 support - Enjoy smooth 4K streaming, even when other devices are connected to your router.

What the artwork ablation found

Version Model design Netflix’s reported result
V1 Image embeddings in separate models for each canvas Did not produce a statistically significant online lift in the reported ablation.
V2 One pooled model using asset IDs only Did not produce a statistically significant online lift in the reported ablation.
V3 One pooled model using image embeddings The only version Netflix says produced a statistically significant online lift; the company says it runs in production.

Netflix says this ablation used an all-platform A/B test lasting at least four weeks. It also reports a 5.691% short-panel offline lift for V3 over the combined V1 and V2 lifts. That figure is an offline result, not the online lift; the article does not disclose the online effect size. Netflix describes changes within ±1% as not significant for the reported offline metric.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Why the short-panel canvas mattered for a TV redesign

Netflix says a redesigned TV home screen made short-panel the dominant artwork canvas, even though that surface had little historical interaction data. The company reports shipping V3 ahead of the redesign and measuring it in a one-month holdback A/B test around the change. Netflix says the model significantly improved its core discovery metric and streaming hours, but does not give the effect sizes.

Rank #3
Sale
Roku Streaming Stick Plus with Voice Remote - 4K & HDR10+
  • 4K streaming made simple:With America’s number 1 TV streaming platform,* exploring popular apps—plus tons of free movies, shows, and live TV—is as easy as it is fun. *Based on hours streamed—Hypothesis Group
  • 4K picture quality: With Roku Streaming Stick Plus, watch your favorites with brilliant 4K picture and vivid HDR color.
  • Compact without compromises: Our sleek design won’t block neighboring HDMI ports, and it even powers from your TV alone, plugging into the back and staying out of sight. No wall outlet, no extra cords, no clutter.
  • No more juggling remotes: Power up your TV, adjust the volume, and control your Roku device with one remote. Use your voice to quickly search, play entertainment, and more.
  • Shows on the go: Take your TV to-go when traveling—without needing to log into someone else’s device.

How search adds the query to artwork ranking

For search results, Netflix combines the artwork model’s member-personalization score with the cosine similarity between a CLIP text embedding of the search query and the CLIP image embedding of an artwork asset. The mixing weight, α, is tuned in online A/B tests. This lets ranking account for both a member’s general taste and the specific query, rather than treating either as the only signal.

How MediaFM represents video previews

Netflix’s earlier content-aware approach, SeqCLIP, encoded preview frames with CLIP and averaged their representations. It captured visual appearance but did not represent audio or dialogue. MediaFM, which Netflix describes as its first in-house multimodal foundation model, combines three signals for each shot: visual SeqCLIP features, a pretrained speech-and-audio embedding, and captions encoded by a large-scale text model. Netflix says MediaFM was trained at a scale of 80 million shots.

Rank #4
Google Streamer 4K – Fast Streaming Entertainment with Voice Search Remote, Watch Movies, Shows, Live Channels and Netflix in HDR, Smart Home Control, 32 GB Storage, Porcelain
  • The Google TV Streamer (4K) delivers your favorite entertainment quickly, easily, and personalized to you[1,2]
  • HDMI 2.1 cable required (sold separately)
  • See movies and TV shows from all your services right from your home screen[2]; and find new things to watch with tailored recommendations for everyone in your home based on their interests and viewing habits
  • Watch live TV and access over 800 free channels from Pluto TV, Tubi, and more[3]; if you find an interesting show or movie on your TV, mobile app, or Google search, you can easily add it to your watchlist, so it’s ready when you are[2]
  • Up to 4K HDR with Dolby Vision delivers captivating, true-to-life detail[4]; and you can connect speakers that support Dolby Atmos for more immersive 3D sound
Video-preview representation Signals used Evidence and reported status
ID-only Asset ID and interaction history; no content signal described. Baseline in Netflix’s comparison.
SeqCLIP Visual features from preview frames. Outperformed ID-only in Netflix’s reported ordering, but ranked below MediaFM.
MediaFM Visual features, speech/audio, and caption text. Ranked first in Netflix’s reported comparison and became the default video-preview embedding across platforms, according to the company.

Netflix says it compared these approaches offline with inverse propensity scoring (IPS) and in a five-week online A/B test across device platforms. The reported ordering was MediaFM, then SeqCLIP, then ID-only, with the largest gains on TV. Netflix says MediaFM significantly lifted its core streaming metric over ID-only; the article does not disclose the online lift percentage.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How Netflix screens embeddings before an A/B test

Netflix describes a two-stage evaluation workflow. For offline IPS, randomized asset selection in a dedicated exploration slice provides known serving propensities. The evaluation reweights observations by the inverse of those propensities, and Netflix requires a candidate to beat the production baseline offline before allocating it A/B-test traffic.

Best Value
Roku Streaming Stick 4K with Voice Remote - HDR10+ & Dolby Vision
  • Stunning 4K and Dolby Vision streaming made simple: With America’s number 1 TV streaming platform,* exploring popular apps—plus tons of free movies, shows, and live TV—is as easy as it is fun. *Based on hours streamed—Hypothesis Group
  • Breathtaking picture quality: Stunningly sharp 4K picture brings out rich detail in your entertainment with four times the resolution of HD. Watch as colors pop off your screen and enjoy lifelike clarity with Dolby Vision and HDR10+.
  • Seamless streaming for any room: With Roku Streaming Stick 4K, watch your favorite entertainment on any TV in the house, even in rooms farther from your router thanks to the long-range Wi-Fi receiver.
  • Shows on the go: Take your TV to-go when traveling—without needing to log into someone else’s device.
  • Compact without compromises: Our sleek design won’t block neighboring HDMI ports, so you can switch from streaming to gaming with ease. Plus, it’s designed to stay hidden behind your TV, keeping wires neatly out of sight

To narrow the number of candidates that need full evaluation, Netflix also uses a linear probe: a low-cost model that predicts a title’s debiased popularity-winning asset from the embedding alone. Netflix labels that winner using exploration data with propensity adjustment. The probe is a screening step, not a replacement for IPS or an online test. In the reported comparison, Netflix says probe accuracy, IPS, and online results all ranked MediaFM ahead of SeqCLIP; the company now uses the probe to screen each new MediaFM checkpoint.

How shared embedding infrastructure supports deployment

Netflix describes its Embedding Store as part of its AI Platform. It stores dense embeddings for titles, games, member profiles, and multimedia assets, and serves the same embeddings to both training and online inference. This separates updates to an embedding model from updates to the personalization models that consume its output.

In Netflix’s account, teams can register, backfill, and validate a new embedding separately, then expose it through configuration without changing downstream code. That arrangement supports testing a representation independently before making it available to multiple personalization systems.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What Netflix’s results establish—and what they do not

The company’s account supports a clear explanation of its system: content embeddings can give personalization models useful information before an asset has much interaction history; pooled artwork training can share signal across sparse canvases; and MediaFM adds audio and text to a visual preview representation. Netflix reports positive experimental results and production deployment for the combined artwork model and for MediaFM.

Those are company-reported methods and results. The MAPS article does not disclose all online effect sizes, so its significance claims and relative model rankings cannot be translated into a specific expected increase for an individual member or title. Nor does the account independently establish how the system performs outside Netflix’s own products and experiments.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.