近这两年里deep learning技术在图像识别和跟踪等方面有很大的突破,是一大研究热点,里面涉及的数学理论和应用技术很值得深入研究,这系列博客总结了深度学习的博客,原理等资料,供大家学习讨论。
二、深度学习资料整理(文章类)
1 论文汇总
主要是顺着Bengio的PAMI review的文章找出来的。包括几本综述文章,将近100篇论文,各位山头们的Presentation。全部都可以在google上找到。
此论文都是关于DL的应用主要都是跟Vision相关的。在其他方面比如语音或者NLP,很少或者几乎没有。个人非常看好CNN和Sparse Autoencoder,这个list也反映了我的偏好,仅供参考。
Review Book List:
[2009 Thesis] Learning Deep Generative Models.pdf
[2009] Learning Deep Architectures for AI.pdf
[2013 DengLi Review] Deep Learning for Signal and Information Processing.pdf
http://deeplearning.net/tutorial/deeplearning.pdf
Paper List:
[1996 Nature] sparse coding.pdf
[1997 Vision] Sparse coding with an overcomplete basis set.pdf
[1998 NIPS] EM Algorithms for PCA and SPCA.pdf
[1998 PIEEE] Gradient-Based Learning Applied to Document Recognition.pdf
[1999] Probabilistic Principal Component Analysis.pdf
[2002 NC] Training Products of Experts by Minimizing Contrastive Divergence.pdf
[2005 JMLR] Estimation of non-normalized statistical models by score matching.pdf
[2006 NC] A fast learning algorithm for deep belief nets.pdf
[2006 NIPS] Efficient Learning of Sparse Representations with an Energy-Based Model.pdf
[2006 NIPS] Efficient sparse coding algorithms.pdf
[2006 Science] Neural Network Dimension Reduction.pdf
[2006] A Tutorial on Energy-Based Learning.pdf
[2006] To Recognize Shapes, First Learn to Generate Images montrealTR.pdf
[2007 BOOK] Scaling Learning Algorithms towards AI.pdf
[2007 CVPR] Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition.pdf
[2007 ICML] Self-taught learning transfer learning from unlabeled data.pdf
[2007 NIPS TR] Greedy Layer-Wise Training of Deep Networks.pdf
[2007 NIPS] Sparse deep belief net model for visual area V2.pdf
[2007 NIPS] Sparse Feature Learning for Deep Belief Networks.pdf
[2007] Energy-Based Models in Document Recognition and Computer Vision.pdf
[2008 ICML] Extracting and Composing Robust Features with Denoising Autoencoders.pdf
[2008 ICML] Training restricted Boltzmann machines using approximations to the likelihood gradient.pdf
[2008 PSD] Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition.
评论记录:
回复评论: