2 Remarks
2.1 Excuse me, if I use PaddleSlim for distillation, are there any requirements for choosing the teacher model? Is it better to "look like" the student?
This is the reply of the flying paddle teachers:
This is the reply of the flying paddle teachers: