{"product_id":"ai-model-evaluation-leemay-nassery-9781633435674","title":"AI Model Evaluation","description":"\u003cb\u003eDe-risk AI models, validate real-world performance, and align output with product goals.\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003eBefore you trust critical business systems to an AI model, you need to answer a few questions. Will it be fast enough? Will the system satisfy user expectations? Is it safe? Can you trust the output? This book will help you answer these questions and more before you roll out an AI system--and make sure it runs smoothly after you deploy. \u003cp\u003e\u003c\/p\u003eIn \u003ci\u003eAI Model Evaluation\u003c\/i\u003e you'll learn how to: \u003cp\u003e\u003c\/p\u003e - Build diagnostic offline evaluations that uncover model behavior\u003cbr\u003e - Use shadow traffic to simulate production conditions\u003cbr\u003e - Design A\/B tests that validate model impact on key product metrics\u003cbr\u003e - Spot nuanced failures with human-in-the-loop feedback\u003cbr\u003e - Use LLMs as automated judges to scale your evaluation pipeline \u003cp\u003e\u003c\/p\u003e In \u003ci\u003eAI Model Evaluation\u003c\/i\u003e author \u003cb\u003eLeemay Nassery\u003c\/b\u003e shares her hard-won experiences specializing in experimentation and personalization across companies such as Spotify, Comcast, Dropbox, and Etsy. The book is packed with insights on what it really takes to get a model ready for production. You'll go beyond basic performance evaluations to discover how you can measure model effectiveness on the product, spot latency issues as you introduce the model in your end-to-end architecture, and understand the model's real-world impact. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the book\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e \u003ci\u003eAI Model Evaluation\u003c\/i\u003e teaches you how to effectively evaluate and assess machine learning models for better scaling and integration into production systems. Each chapter tackles a different evaluation method. You'll start with offline evaluations, then move into live A\/B tests, shadow traffic deployments, qualitative evaluations, and LLM-based feedback loops. You'll learn how to evaluate both model behavior and engineering system performance, with a hands-on example grounded in a movie recommendation engine. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the reader\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e For practitioners with experience in machine learning, data science, or software engineering. Familiarity with Python is recommended. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the author\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e \u003cb\u003eLeemay Nassery\u003c\/b\u003e is an engineering leader specializing in experimentation and personalization. With a notable track record that includes evolving Spotify's A\/B testing strategy for the Homepage, launching Comcast's For You page, and establishing data warehousing teams at Etsy, she firmly believes that the key to innovation at any company is the ability to experiment effectively. \u003cp\u003e\u003c\/p\u003eGet a free eBook (PDF or ePub) from Manning as well as access to the online liveBook format (and its AI assistant that will answer your questions in any language) when you purchase the print book. \u003cp\u003e\u003c\/p\u003e\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAuthor:\u003c\/b\u003e Leemay Nassery\u003cbr\u003e\u003cb\u003eISBN-10:\u003c\/b\u003e 1633435679\u003cbr\u003e\u003cb\u003eISBN-13:\u003c\/b\u003e 9781633435674\u003cbr\u003e\u003cb\u003ePublisher:\u003c\/b\u003e Manning Publications\u003cbr\u003e\u003cb\u003eLanguage:\u003c\/b\u003e English\u003cbr\u003e\u003cb\u003ePublished:\u003c\/b\u003e 04\/28\/2026\u003cbr\u003e\u003cb\u003ePages:\u003c\/b\u003e 250\u003cbr\u003e\u003cb\u003eFormat:\u003c\/b\u003e Paperback\u003cbr\u003e\u003cb\u003eWeight:\u003c\/b\u003e 0.66lbs","brand":"Leemay Nassery","offers":[{"title":"Paperback","offer_id":47966021746943,"sku":"9781633435674","price":59.99,"currency_code":"USD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0662\/2982\/9887\/files\/img_80cead01-618a-4818-b505-fd5a6943e29b.jpg?v=1767286374","url":"https:\/\/www.whiterainbookhouse.com\/products\/ai-model-evaluation-leemay-nassery-9781633435674","provider":"WR Book House","version":"1.0","type":"link"}