Network in the network NiN hands-on deep learning v2 pytorch

Enterprise 2022-04-20 05:40:37 views: null

1. Network NiN in Network

The network NiN in the network is based on the attempted improvement of AlexNet, and the fully connected layer is removed.
The network NiN in the network is not used much later, but the idea of removing the fully connected layer is adopted.
insert image description here
The biggest problem with the fully connected layer is that

uses a lot of memory
Takes up a lot of computing bandwidth
Convergence is fast, but can lead to overfitting

2. Code implementation

insert image description here

insert image description here

3. Q&A

1. nvidia-smiIt is nvidia's system management interface, where smi is the abbreviation of System management interface, which can collect various levels of information and view video memory usage.
1. AlexNet, NiN still need Softmax and need to be classified.
1. Why does NiN need two 1x1 convolutional layers, the high probability is the result of training parameters.

reference

https://www.bilibili.com/video/BV1Uv411G71b?p=1

Guess you like

Origin blog.csdn.net/zgpeace/article/details/124139383

Network in the network NiN hands-on deep learning v2 pytorch

CNN deep convolutional neural network AlexNet hands-on deep learning v2 pytorch

Network with parallel connections GoogLeNet / Inception V3 hands-on deep learning v2 pytorch

Hands-on deep learning v2 pytorch using block network VGG

Classic convolutional neural network LeNet hands-on deep learning v2 pytorch

CNN convolutional neural network pooling layer Pooling hands-on deep learning v2 pytorch

hands-on deep learning v2 p2 linear neural network linear regression

Hands-on deep learning-pytorch version (2): linear neural network

[pytorch, learning]-5.8 Network in Network (NiN)

"Hands-on Learning Deep Learning" Notes (2) Linear Neural Network

Deep neural network hardware GPU single machine multi-card parallel hands-on deep learning v2

Hands-on Deep Learning Notes (2) - Linear Neural Network

DJL of java deep learning creates NiN network

"Hands-on Deep Learning Pytorch Edition" 7.1 Deep Convolutional Neural Network (LeNet)

Multi-layer perceptron + code implementation - hands-on deep learning v2 pytorch

Dropout drop method hands-on deep learning v2 pytorch

Weight decay Weight Decade hands-on deep learning v2 pytorch

Softmax regression + loss function + image classification dataset hands-on deep learning v2 pytorch

Padding and stride stride in convolutional layers hands-on deep learning v2 pytorch

Actual Kaggle Competition: Dog Breed Recognition (ImageNet Dogs) Hands-on Deep Learning v2 pytorch

Object detection object detection object recognition and coco dataset hands-on deep learning v2 pytorch

MXNet hands-on deep learning notes: GoogLeNet neural network implementation

MXNet hands-on deep learning notes: VGG neural network implementation

MXNet hands-on deep learning notes: convolutional neural network implementation

[Datawhale hands-on deep learning notes] linear neural network

[Hands-on deep learning] Li Mu - Recurrent Neural Network

[Hands-on Deep Learning] Li Mu - Convolutional Neural Network

[AI] "Hands-on Learning-Deep Learning-PyTorch Edition" Notes (16): Customize network layers, save/load parameters, and use GPU

Numerical stability gradient explosion gradient disappearance + model initialization and activation function hands-on deep learning v2 pytorch

Multi-input multi-output channel channel in CNN convolutional layer hands-on deep learning v2 pytorch

Recommended

Ranking

#2019110700005

What materials and procedures are required for patent transfer

What is the blockchain Ethereum triplet state root transaction root receipt root

Front-end study notes 04 --- About the insertion of html pictures and videos

Documents required for the filing of WeChat Mini Programs in special industries, the filing process of WeChat Mini Programs in special industries, how to file WeChat Mini Programs in special industries

2017 Qingdao-site tournament I The Squared Mosquito Coil

[BZOJ3165][HEOI2013]Segment (line segment tree without marking)

Kettle series: KettleEasyExpand, an open source Kettle universal plugin by Ma Jinju

The latest tutorial on making framework for iOS

DAX Section 6: Statistical Functions

Daily

More

2024-05-14(9)

2024-05-13(8)

2024-05-12(28)

2024-05-11(32)

2024-05-10(34)

2024-05-09(32)

2024-05-08(18)

2024-05-07(34)

2024-05-06(6)

2024-05-05(0)