{"product_id":"evaluation-and-alignment-the-seminal-han-lee-9781633434240","title":"Evaluation and Alignment, the Seminal Papers","description":"\u003cb\u003eGet the eBook free when you register your print book at Manning.\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003eIt's a fundamental truth that all software--even AI systems--is broken. AI engineers who can diagnose faults and refine systems to align with business needs are in high demand. This book expands the foundational research into judging and adapting AI systems into a collection of practical techniques you can use on the job. As you trace the progression from surface-level text matching to semantic similarity to judgment-based evaluation, you'll build the mental models necessary to choose the right metrics, detect failure modes, and close the loop from evaluation to alignment. \u003cp\u003e\u003c\/p\u003eThis book teaches you to think of evaluation as a design constraint. You'll employ a \"working backwards\" methodology that begins with what your system must get right, which directs you to the appropriate evaluation approach. As you internalize the define \u0026gt; evaluate \u0026gt; analysis \u0026gt; align cycle, you'll start making more informed tradeoffs and expertly balancing helpfulness, safety, and brand voice in your models. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eWhat's inside\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e - BLEU, ROUGE, BERTScore, COMET, and LLM-as-a-judge methods\u003cbr\u003e - Detecting and quantifying hallucinations\u003cbr\u003e - Aligning AI with RLHF, constitutional AI, and red teaming\u003cbr\u003e - Timeless best practices that will apply as models evolve \u003cp\u003e\u003c\/p\u003e\u003cb\u003eAbout the reader\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e For AI engineers and LLM practitioners. No prior knowledge of NLP metrics, reinforcement learning, or alignment research is required. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the author\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e \u003cb\u003eHan Lee\u003c\/b\u003e has spent more than a decade applying cutting-edge research on large-scale AI and machine learning systems into production-grade products. A Senior Director of Data and AI at Moody's, he leads teams that ship generative AI applications and has daily, hands-on exposure to safety-critical evaluation pipelines.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAuthor:\u003c\/b\u003e Han Lee\u003cbr\u003e\u003cb\u003eISBN-10:\u003c\/b\u003e 1633434249\u003cbr\u003e\u003cb\u003eISBN-13:\u003c\/b\u003e 9781633434240\u003cbr\u003e\u003cb\u003ePublisher:\u003c\/b\u003e Manning Publications\u003cbr\u003e\u003cb\u003eLanguage:\u003c\/b\u003e English\u003cbr\u003e\u003cb\u003ePublished:\u003c\/b\u003e 11\/24\/2026\u003cbr\u003e\u003cb\u003ePages:\u003c\/b\u003e 275\u003cbr\u003e\u003cb\u003eFormat:\u003c\/b\u003e Paperback\u003cbr\u003e\u003cb\u003eWeight:\u003c\/b\u003e 0.72lbs","brand":"Han Lee","offers":[{"title":"Paperback","offer_id":48748327207167,"sku":"9781633434240","price":59.99,"currency_code":"USD","in_stock":false}],"url":"https:\/\/www.whiterainbookhouse.com\/products\/evaluation-and-alignment-the-seminal-han-lee-9781633434240","provider":"WR Book House","version":"1.0","type":"link"}