Reprinted: https://blog.csdn.net/qq_26898461/article/details/50593328 There is no doubt about the importance of big data for deep learning, so let’s go directly!
* First come to a dataset website that cannot be missed (Gospel for deep learners): *
http://deeplearning.net/datasets/ **
First of all, let’s talk about a few websites that collect datasets:
1. Public Data Sets on Amazon Web Services (AWS)
http://aws.amazon.com/datasets
Amazon has provided developers with dozens of terabytes of development data since 2008 .
2 Yahoo! Webscope
http://webscope.sandbox.yahoo.com/index.php
3、Konect is a collection of network datasets
http://konect.uni-koblenz.de/
4、Stanford Large Network Dataset Collection
http://snap.stanford.edu/data/index.html
Let's talk about a few data sets related to the Internet:
1. Dataset for "Statistics and Social Network of YouTube Videos"
http://netsg.cs.sfu.ca/youtubedata/
2. 1998 World Cup Web Site Access Logs
http://ita.ee.lbl.gov/html/contrib/WorldCup.html
This is a data set during the 1998 World Cup. During the 92 days from 1998/04/26 to 1998/07/26, 1,352,804,107 requests occurred.
3、Page view statistics for Wikimedia projects
http://dammit.lt/wikistats/
4、AOL Search Query Logs - RP
http://www.researchpipeline.com/mediawiki/index.php?title=AOL_Search_Query_Logs
5、livedoor gourmet
http://blog.livedoor.jp/techblog/archives/65836960.html
Massive image dataset:
1. ImageNet
http://www.image-net.org/
contains 14 million images.
2. Tiny Images Dataset
http://horatio.cs.nyu.edu/mit/tiny/data/index.html
contains 80 million 32x32 images.
3. MirFlickr1M
http://press.liacs.nl/mirflickr/
A collection of 1 million images in Flickr.
4、 CoPhIR
http://cophir.isti.cnr.it/whatis.html
Flickr中的1亿600万的图像
5、SBU captioned photo dataset
http://dsl1.cewit.stonybrook.edu/~vicente/sbucaptions/
Flickr中的100万的图像集。
6、Large-Scale Image Annotation using Visual Synset(ICCV 2011)
http://cpl.cc.gatech.edu/projects/VisualSynset/
包含2亿图像
7、NUS-WIDE
http://lms.comp.nus.edu.sg/research/NUS-WIDE.htm
Flickr中的27万的图像集。
8、SUN dataset
http://people.csail.mit.edu/jxiao/SUN/
包含13万的图像
9、MSRA-MM
http://research.microsoft.com/en-us/projects/msrammdata/
包含100万的图像，23000视频
10、TRECVID
http://trecvid.nist.gov/
截止目前好像还没有国内的企业或者组织开放自己的数据集。希望也能有企业开发自己的数据集给研究人员使用，从而推动海量数据处理在国内的发展！
2014/07/07 雅虎发布超大Flickr数据集 1亿的图片+视频
http://yahoolabs.tumblr.com/post/89783581601/one-hundred-million-creative-commons-flickr-images-for
100多个有趣的数据集
http://www.csdn.net/article/2014-06-06/2820111-100-Interesting-Data-Sets-for-Statistics
- 本文已收录于以下专栏：