Home | Amazing | Today | Tags | Publishers | Years | Account | Search 
Getting Started with Google BERT: Build and train state-of-the-art natural language processing models using BERT

Buy

Kickstart your NLP journey by exploring BERT and its variants such as ALBERT, RoBERTa, DistilBERT, VideoBERT, and more with Hugging Face's transformers library

Key Features

  • Explore the encoder and decoder of the transformer model
  • Become well-versed with BERT along with ALBERT, RoBERTa, and DistilBERT
  • Discover how to pre-train and fine-tune BERT models for several NLP tasks

Book Description

BERT (bidirectional encoder representations from transformer) has revolutionized the world of natural language processing (NLP) with promising results. This book is an introductory guide that will help you get to grips with Google's BERT architecture. With a detailed explanation of the transformer architecture, this book will help you understand how the transformer's encoder and decoder work.

You'll explore the BERT architecture by learning how the BERT model is pre-trained and how to use pre-trained BERT for downstream tasks by fine-tuning it for NLP tasks such as sentiment analysis and text summarization with the Hugging Face transformers library. As you advance, you'll learn about different variants of BERT such as ALBERT, RoBERTa, and ELECTRA, and look at SpanBERT, which is used for NLP tasks like question answering. You'll also cover simpler and faster BERT variants based on knowledge distillation such as DistilBERT and TinyBERT. The book takes you through MBERT, XLM, and XLM-R in detail and then introduces you to sentence-BERT, which is used for obtaining sentence representation. Finally, you'll discover domain-specific BERT models such as BioBERT and ClinicalBERT, and discover an interesting variant called VideoBERT.

By the end of this BERT book, you'll be well-versed with using BERT and its variants for performing practical NLP tasks.

What you will learn

  • Understand the transformer model from the ground up
  • Find out how BERT works and pre-train it using masked language model (MLM) and next sentence prediction (NSP) tasks
  • Get hands-on with BERT by learning to generate contextual word and sentence embeddings
  • Fine-tune BERT for downstream tasks
  • Get to grips with ALBERT, RoBERTa, ELECTRA, and SpanBERT models
  • Get the hang of the BERT models based on knowledge distillation
  • Understand cross-lingual models such as XLM and XLM-R
  • Explore Sentence-BERT, VideoBERT, and BART

Who this book is for

This book is for NLP professionals and data scientists looking to simplify NLP tasks to enable efficient language understanding using BERT. A basic understanding of NLP concepts and deep learning is required to get the best out of this book.

Table of Contents

  1. A Primer on Transformer Model
  2. Understanding the BERT Model
  3. Getting Hands-On with BERT
  4. BERT variants I - ALBERT, RoBERTa, ELECTRA, and SpanBERT
  5. BERT variants II - Based on knowledge distillation
  6. Exploring BERTSUM for Text Summarization
  7. Applying BERT for Other Languages
  8. Exploring Sentence and Domain Specific BERT
  9. Working with VideoBERT, BART, and more
(HTML tags aren't allowed.)

Blockchain for 5G-Enabled IoT: The new wave for Industrial Automation
Blockchain for 5G-Enabled IoT: The new wave for Industrial Automation
This book addresses one of the most overlooked practical, methodological, and moral questions in the journey to secure and handle the massive amount of data being generated from smart devices interactions: the integration of Blockchain with 5G-enabled IoT. After an overview, this book discusses open issues and challenges, which may hinder the...
Ghidra Software Reverse Engineering for Beginners: Analyze, identify, and avoid malicious code and potential threats in your networks and systems
Ghidra Software Reverse Engineering for Beginners: Analyze, identify, and avoid malicious code and potential threats in your networks and systems

Detect potentials bugs in your code or program and develop your own tools using the Ghidra reverse engineering framework developed by the NSA project

Key Features

  • Make the most of Ghidra on different platforms such as Linux, Windows, and macOS
  • Leverage a variety of...
Dive Into Algorithms: A Pythonic Adventure for the Intrepid Beginner
Dive Into Algorithms: A Pythonic Adventure for the Intrepid Beginner
Dive Into Algorithms is a broad introduction to algorithms using the Python Programming Language.

Dive Into Algorithms is a wide-ranging, Pythonic tour of many of the world's most interesting algorithms. With little more than a bit of computer programming experience and basic high-school math,
...

Software Architecture with C++: Design modern systems using effective architecture concepts, design patterns, and techniques with C++20
Software Architecture with C++: Design modern systems using effective architecture concepts, design patterns, and techniques with C++20

Apply business requirements to IT infrastructure and deliver a high-quality product by understanding architectures such as microservices, DevOps, and cloud-native using modern C++ standards and features

Key Features

  • Design scalable large-scale applications with the C++ programming...
Android Programming for Beginners: Build in-depth, full-featured Android apps starting from zero programming experience, 3rd Edition
Android Programming for Beginners: Build in-depth, full-featured Android apps starting from zero programming experience, 3rd Edition

Learn the Java and Android skills you need to start developing powerful mobile applications with the help of actionable steps

Key Features

  • Kick-start your Android programming career or just have fun publishing apps to the Google Play marketplace
  • Get a first principles...
QUANTUM COMPUTING WITH PYTHON: The new comprehensive guide to master applied artificial intelligence in Physics. Learn Machine Learning and computer programming with a complete crash course
QUANTUM COMPUTING WITH PYTHON: The new comprehensive guide to master applied artificial intelligence in Physics. Learn Machine Learning and computer programming with a complete crash course

*KINDLE VERSION Discounted at $ 9.99 instead of $ 14.99... Get QUANTUM PHYSICS section for FREE!!

"Master the best methods for PYTHON. Learn how to programming as a pro and get positive ROI in 7 days with data science and machine learning" 

Are you looking...

©2021 LearnIT (support@pdfchm.net) - Privacy Policy