NTU 课程笔记：self-supervised learning

Others 2021-11-28 09:17:29 views: null

1 为什么需要 self-supervision？

为每个新的任务都创建一个新的数据集，开销是很大的
有些领域标注是很稀缺的（比如医疗领域）
有些领域数据集太大，来不及标注
self-supervision 很像婴儿学习的方式

2 什么是self-supervison

A form of unsupervised learning where the data provides the supervision（用数据本身创造label）
In general, withhold some part of the data, and task the network with predicting it
The task defines a proxy loss, and the network is forced to learn what we really

care about, e.g. a semantic representation, in order to solve it（proxy loss~~text loss）

Guess you like

Origin blog.csdn.net/qq_40206371/article/details/121285762

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

NTU 课程笔记：self-supervised learning

Self-Supervised Learning (SSL) Self-Supervised Learning

An introduction to self-supervised learning

Introduction to Self-Supervised Learning

What is self-supervised learning?

Self-supervised learning and computer vision

SelFlow: Self-Supervised Learning of Optical Flow

Self-supervised Graph Learning for Recommendation(SGL)

A Survey of Self-Supervised Learning for Time Series

Supervised learning, semi-supervised learning, unsupervised learning, self-supervised learning, reinforcement learning, and contrastive learning

Self-supervised contrastive learning + MoCo trilogy + self-supervised model evaluation method in deep learning

[Pytorch] Characteristics and applications of supervised learning, unsupervised learning, semi-supervised learning and self-supervised learning

Machine learning 13 - self-supervised unsupervised learning

Self-supervised learning - contrastive learning SimCLR framework (principle + code)

Machine Learning: Self-supervised Learning for Speech and image

[Machine Learning] The difference between supervised, unsupervised, self-supervised, semi-supervised, and weakly supervised

Graphic self-supervised learning, artificial intelligence, the biggest piece of cake

Self-Supervised Learning of Pretext-Invariant Representation

Distilling Visual Priors from Self-Supervised Learning

[Self-supervised learning collection] 1: Intensive reading of moco code

A review and interpretation of self-supervised learning for time series

Masked Autoencoders (MAE) of self-supervised learning - audio recognition

NTU课程笔记 mas714复习：例题

Recommended

Ranking

vue project automated build tools 1.0, support for multi-page build

JDBC add, update, delete data

SpringCloud combat service in response to the decline tutorial series (Chapter IV)

A segmentation fault (core dumped) error occurs when C+11 compiles and calls the PCL library

Django achieve websocket

Go语言并发之道--笔记1

Three-tier structure and application

Zhejiang data structure after-school exercise practice two 7-2 Reversing Linked List (25 points)

Front-end interview brushing day9 (updated daily high-frequency inspection points for front-end interviews)

The difference between the shell of the single and double quote

Daily

More

2024-05-02(0)

2024-05-01(4)

2024-04-30(36)

2024-04-29(5)

2024-04-28(12)

2024-04-27(29)

2024-04-26(22)

2024-04-25(32)

2024-04-24(30)

2024-04-23(30)