{"product_id":"build-a-large-language-model-sebastian-raschka-9781633437166","title":"Build a Large Language Model (from Scratch)","description":"\u003cb\u003eLearn how to create, train, and tweak large language models (LLMs) by building one from the ground up!\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003eIn \u003ci\u003eBuild a Large Language Model (from Scratch)\u003c\/i\u003e, you'll discover how LLMs work from the inside out. In this insightful book, bestselling author Sebastian Raschka guides you step by step through creating your own LLM, explaining each stage with clear text, diagrams, and examples. You'll go from the initial design and creation to pretraining on a general corpus, all the way to finetuning for specific tasks. \u003cp\u003e\u003c\/p\u003e \u003ci\u003eBuild a Large Language Model (from Scratch)\u003c\/i\u003e teaches you how to: \u003cp\u003e\u003c\/p\u003e \u003cul\u003e \u003cli\u003ePlan and code all the parts of an LLM\u003c\/li\u003e \u003cli\u003ePrepare a dataset suitable for LLM training\u003c\/li\u003e \u003cli\u003eFinetune LLMs for text classification and with your own data\u003c\/li\u003e \u003cli\u003eApply instruction tuning techniques to ensure your LLM follows instructions\u003c\/li\u003e \u003cli\u003eLoad pretrained weights into an LLM\u003c\/li\u003e \u003c\/ul\u003e \u003cbr\u003eThe large language models (LLMs) that power cutting-edge AI tools like ChatGPT, Bard, and Copilot seem like a miracle, but they're not magic. This book demystifies LLMs by helping you build your own from scratch. You'll get a unique and valuable insight into how LLMs work, learn how to evaluate their quality, and pick up concrete techniques to finetune and improve them. \u003cp\u003e\u003c\/p\u003e The process you use to train and develop your own small-but-functional model in this book follows the same steps used to deliver huge-scale foundation models like GPT-4. Your small-scale LLM can be developed on an ordinary laptop, and you'll be able to use it as your own personal assistant. \u003cp\u003e\u003c\/p\u003e Purchase of the print book includes a free eBook in PDF and ePub formats from Manning Publications. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the book\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e \u003ci\u003eBuild a Large Language Model (from Scratch)\u003c\/i\u003e is a one-of-a-kind guide to building your own working LLM. In it, machine learning expert and author Sebastian Raschka reveals how LLMs work under the hood, tearing the lid off the Generative AI black box. The book is filled with practical insights into constructing LLMs, including building a data loading pipeline, assembling their internal building blocks, and finetuning techniques. As you go, you'll gradually turn your base model into a text classifier tool, and a chatbot that follows your conversational instructions. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the reader\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e For readers who know Python. Experience developing machine learning models is useful but not essential. \u003cp\u003e\u003c\/p\u003e \u003cb\u003eAbout the author\u003c\/b\u003e \u003cp\u003e\u003c\/p\u003e \u003cb\u003eSebastian Raschka\u003c\/b\u003e has been working on machine learning and AI for more than a decade. Sebastian joined Lightning AI in 2022, where he now focuses on AI and LLM research, developing open-source software, and creating educational material. Prior to that, Sebastian worked at the University of Wisconsin-Madison as an assistant professor in the Department of Statistics, focusing on deep learning and machine learning research. He has a strong passion for education and is best known for his bestselling books on machine learning using open-source software.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eAuthor:\u003c\/b\u003e Sebastian Raschka\u003cbr\u003e\u003cb\u003eISBN-10:\u003c\/b\u003e 1633437167\u003cbr\u003e\u003cb\u003eISBN-13:\u003c\/b\u003e 9781633437166\u003cbr\u003e\u003cb\u003ePublisher:\u003c\/b\u003e Manning Publications\u003cbr\u003e\u003cb\u003eLanguage:\u003c\/b\u003e English\u003cbr\u003e\u003cb\u003ePublished:\u003c\/b\u003e 10\/29\/2024\u003cbr\u003e\u003cb\u003ePages:\u003c\/b\u003e 400\u003cbr\u003e\u003cb\u003eFormat:\u003c\/b\u003e Paperback\u003cbr\u003e\u003cb\u003eWeight:\u003c\/b\u003e 1.05lbs","brand":"Sebastian Raschka","offers":[{"title":"Paperback","offer_id":45898815471871,"sku":"9781633437166","price":59.99,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0662\/2982\/9887\/files\/img_9565bb56-9973-404b-8067-ecb6a5300987.jpg?v=1721377173","url":"https:\/\/www.whiterainbookhouse.com\/products\/build-a-large-language-model-sebastian-raschka-9781633437166","provider":"WR Book House","version":"1.0","type":"link"}