DataFun: Detailed model behind ChatGPT

News 2023-08-19 01:50:26 views: null

Detailed explanation of the model behind ChatGPT

Overview

insert image description here

Transofrmer

insert image description here
insert image description here
Each component has a role

Multi-head self attention

insert image description here
The importance of each word is different, learning QKV three matrix (query, key, value)
insert image description here
multiple sets of QKV
insert image description here
insert image description here

RLHF

insert image description here
insert image description here

insert image description here
insert image description here
insert image description here
insert image description here
insert image description here
insert image description here

ChatGPT training process

insert image description here
insert image description here
insert image description here
insert image description here
insert image description here
insert image description here

Chain of thought COT

insert image description here
insert image description here
insert image description here

insert image description here

Guess you like

Origin blog.csdn.net/uncle_ll/article/details/131668411
Recommended
Ranking
#2019110700005
What materials and procedures are required for patent transfer
What is the blockchain Ethereum triplet state root transaction root receipt root
Front-end study notes 04 --- About the insertion of html pictures and videos
Documents required for the filing of WeChat Mini Programs in special industries, the filing process of WeChat Mini Programs in special industries, how to file WeChat Mini Programs in special industries
2017 Qingdao-site tournament I The Squared Mosquito Coil
[BZOJ3165][HEOI2013]Segment (line segment tree without marking)
Kettle series: KettleEasyExpand, an open source Kettle universal plugin by Ma Jinju
The latest tutorial on making framework for iOS
DAX Section 6: Statistical Functions
Daily
More
2024-05-14(9)
2024-05-13(8)
2024-05-12(28)
2024-05-11(32)
2024-05-10(34)
2024-05-09(32)
2024-05-08(18)
2024-05-07(34)
2024-05-06(6)
2024-05-05(0)

Code World

© 2018 codetd.com