Mastering Transformers: Build state-of-the-art models from scratch with advanced natural language processing techniques

Mastering Transformers: Build state-of-the-art models from scratch with advanced natural language processing techniques

作者: Yıldırım Savaş Asgari-Chenaghlu Meysam
出版社: Packt Publishing
出版在: 2021-09-15
ISBN-13: 9781801077651
ISBN-10: 1801077657
裝訂格式: Quality Paper - also called trade paper
總頁數: 374 頁





內容描述


Take a problem-solving approach to learning all about transformers and get up and running in no time by implementing methodologies that will build the future of NLPKey Features: Explore quick prototyping with up-to-date Python libraries to create effective solutions to industrial problemsSolve advanced NLP problems such as named-entity recognition, information extraction, language generation, and conversational AIMonitor your model's performance with the help of BertViz, exBERT, and TensorBoardBook Description: Transformer-based language models have dominated natural language processing (NLP) studies and have now become a new paradigm. With this book, you'll learn how to build various transformer-based NLP applications using the Python Transformers library.The book gives you an introduction to Transformers by showing you how to write your first hello-world program. You'll then learn how a tokenizer works and how to train your own tokenizer. As you advance, you'll explore the architecture of autoencoding models, such as BERT, and autoregressive models, such as GPT. You'll see how to train and fine-tune models for a variety of natural language understanding (NLU) and natural language generation (NLG) problems, including text classification, token classification, and text representation. This book also helps you to learn efficient models for challenging problems, such as long-context NLP tasks with limited computational capacity. You'll also work with multilingual and cross-lingual problems, optimize models by monitoring their performance, and discover how to deconstruct these models for interpretability and explainability. Finally, you'll be able to deploy your transformer models in a production environment.By the end of this NLP book, you'll have learned how to use Transformers to solve advanced NLP problems using advanced models.What You Will Learn: Explore state-of-the-art NLP solutions with the Transformers libraryTrain a language model in any language with any transformer architectureFine-tune a pre-trained language model to perform several downstream tasksSelect the right framework for the training, evaluation, and production of an end-to-end solutionGet hands-on experience in using TensorBoard and Weights & BiasesVisualize the internal representation of transformer models for interpretabilityWho this book is for: This book is for deep learning researchers, hands-on NLP practitioners, as well as ML/NLP educators and students who want to start their journey with Transformers. Beginner-level machine learning knowledge and a good command of Python will help you get the best out of this book.




相關書籍

CCNA路由和交換<200-120>學習指南(附光盤)

作者 迪爾 (Richard Deal)

2021-09-15

GIS Tutorial 2: Spatial Analysis Workbook ,4/e

作者 David W. Allen

2021-09-15

Scratch 與 PicoBoard 互動設計快速入門 (附10大主題完整影音教學/範例)

作者 許惠美 俞誌凱 石飛雄基 徐戎昌

2021-09-15