Prompt-Tuning - In-depth interpretation of a new fine-tuning paradigm
Overall interpretation of prompt tuning
Level 1: Prompt is an instruction to a task;
Level 2: Prompt is a reuse of pre-training targets;
Level 3: Prompt is essentially parameter validity training;
https://blog.csdn.net/qq_36426650/ article/details/120607050
Interpretation and arrangement of continuous pattern construction papers
"The Power of Scale for Parameter-Efficient Prompt Tuning": the representative method is Prompt Tuning
"GPT Understands, Too": the representative method is P-tuning
"PPT: Pre-trained Prompt Tuning for Few-shot Learning": the representative method is PPT