Transformers for Natural Language Processing
PublisherPublishDrive Inc (Packt Publishing)
OpenAI’s GPT-3, ChatGPT, GPT-4 and Hugging Face transformers for language tasks in one book. Get a taste of the future of transformers, including computer vision tasks and code writing and assistance.<br /> <br /> Purchase of the print or Kindle book includes a free eBook in PDF format<h4>Key Features</h4><ul><li>Improve your productivity with OpenAI’s ChatGPT and GPT-4 from prompt engineering to creating and analyzing machine learning models</li><li>Pretrain a BERT-based model from scratch using Hugging Face</li><li>Fine-tune powerful transformer models, including OpenAI's GPT-3, to learn the logic of your data</li></ul><h4>Book Description</h4>Transformers are...well...transforming the world of AI. There are many platforms and models out there, but which ones best suit your needs?<br /> <br /> Transformers for Natural Language Processing, 2nd Edition, guides you through the world of transformers, highlighting the strengths of different models and platforms, while teaching you the problem-solving skills you need to tackle model weaknesses.<br /> <br /> You'll use Hugging Face to pretrain a RoBERTa model from scratch, from building the dataset to defining the data collator to training the model.<br /> <br /> If you're looking to fine-tune a pretrained model, including GPT-3, then Transformers for Natural Language Processing, 2nd Edition, shows you how with step-by-step guides.<br /> <br /> The book investigates machine translations, speech-to-text, text-to-speech, question-answering, and many more NLP tasks. It provides techniques to solve hard language problems and may even help with fake news anxiety (read chapter 13 for more details).<br /> <br /> You'll see how cutting-edge platforms, such as OpenAI, have taken transformers beyond language into computer vision tasks and code creation using DALL-E 2, ChatGPT, and GPT-4.<br /> <br /> By the end of this book, you'll know how transformers work and how to implement them and resolve issues like an AI detective.<h4>What you will learn</h4><ul><li>Discover new techniques to investigate complex language problems</li><li>Compare and contrast the results of GPT-3 against T5, GPT-2, and BERT-based transformers</li><li>Carry out sentiment analysis, text summarization, casual speech analysis, machine translations, and more using TensorFlow, PyTorch, and GPT-3</li><li>Find out how ViT and CLIP label images (including blurry ones!) and create images from a sentence using DALL-E</li><li>Learn the mechanics of advanced prompt engineering for ChatGPT and GPT-4</li></ul><h4>Who this book is for</h4>If you want to learn about and apply transformers to your natural language (and image) data, this book is for you.<br /> <br /> You'll need a good understanding of Python and deep learning and a basic understanding of NLP to benefit most from this book. Many platforms covered in this book provide interactive user interfaces, which allow readers with a general interest in NLP and AI to follow several chapters. And don't worry if you get stuck or have questions; this book gives you direct access to our AI/ML community to help guide you on your transformers journey!