liner、dense、mlp、fc区别

Linear:线性层,最原始的称谓,单层即无隐层。熟悉torch的同学都清楚torch.nn.Linear就是提供了一个in_dim * out_dim的tensor layer而已。

Dense:密集层,可以指单层linear也可以指多层堆叠,可无隐层也可有但一般多指后者。dense层其实就是多层线性层的堆叠。隐层一般大于2

MLP:多层感知器(Multi-layer perceptron neural networks),指多层linear的堆叠,有隐层。mlp 三层也可以,输入层,隐层,输出层。。。。
FC:全连接层(fully connected layer),单层多层均可以表示,是对Linear Classifier最笼统的一种称谓。

原文:https://blog.csdn.net/weixin_43301333/article/details/114394629?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522163749555916780271599921%2522%252C%2522scm%2522%253A%252220140713.130102334.pc%255Fall.%2522%257D&request_id=163749555916780271599921&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2allfirst_rank_ecpm_v1~rank_v31_ecpm-3-114394629.pc_search_result_cache&utm_term=%23%23%23%23+%E5%85%B3%E4%BA%8EDL%E9%87%8C%E9%9D%A2%E5%90%84%E7%A7%8Dclassifier%E7%BA%BF%E6%80%A7%E5%B1%82%E7%9A%84%E7%A7%B0%E8%B0%93Linear%2CDense%2CMLP%2CFC%E4%B9%8B%E9%97%B4%E7%9A%84%E5%8C%BA%E5%88%AB%E3%80%82&spm=1018.2226.3001.4187

猜你喜欢

转载自blog.csdn.net/weixin_44885180/article/details/115663074
MLP