Intensive lectures on practical application cases of MATLAB algorithms-[Deep Learning] Pre-training Model ELECTRA&Performer

Table of contents

ELECTRA

1 Introduction

2. Model structure

2.1 Replaced Token Detection

2.2 Weight Sharing

2.3 Smaller generators

3