
Intelligent Delivery: Making Every Unit of Compute Serve Better Ads
Engineering at Meta fb.com
Listen to this summary
Ads ranking models are growing toward LLM scale faster than the hardware to run them can keep up. An extra unit of compute has more impact on some ad requests, models, and chips than on others. The challenge is deciding where to allocate it to get the best outcome for the entire system.
We built Intelligent Delivery, an ML-driven system that allocates resources across the serving stack toward the system-wide optimum. It has delivered ~10% incremental ranking performance on top of model and system advancements since 2017.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.
2014 Porsche Cayenne Diesel at No Reserve
1972 Triumph Tiger 650 Street Tracker by Loaded Gun Customs at No Reserve
2000 Chevrolet Tahoe Z71 at No Reserve
20k-Mile 2014 BMW X5 sDrive35i M Sport at No Reserve