视频显著性检测发展主线

版权声明: https://blog.csdn.net/Dorothy_Xue/article/details/83188834

2013年之前

未完待续

早期工作:

《G. Buswell. How people look at pictures: a study ofthe psychology and perception in art. 1935.》提出将voluntary和involuntary attention分开学习

《J. Henderson. Human gaze control during realworld scene perception. Trends in cognitive sciences,7(11):498–504, 2003.》集中注意于理解图像数据

《R. Goldstein, R. Woods, and E. Peli. Where people look when watching movies: Do all viewers look at the same place? Computers in biology and medicine, 37(7):957–964, 2007.》和《P. Mital, T. Smith, R. Hill, and J. Henderson. Clustering of gaze during dynamic scene viewing is predicted by motion. Cognitive Computation, 3(1):5–24, 2011.》则集中于研究视频

《A. Treisman and G. Gelade. A feature-integration theory of attention. Cognitive psychology, 12(1):97–136, 1980.》提出特征聚合理论,将一些特征类型聚合到一起

《C. Koch and S. Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology, 4(4):219–27, 1985.》提出了特征聚合的前馈模型,以及显著性映射的概念——场景中每个点的视觉吸引力的度量。这个idea首次提出是在《L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. PAMI, 20(11):1254– 1259, 1998.》中,并首次提出一个完整的针对于图像的类注意力模型

图像显著性工作有了很大进步后:

《J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. NIPS, 19:545, 2007.》仅使用低级信息

《T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In ICCV, pages 2106–2113, 2009.》使用高级对象检测方法

《S. Goferman, L. Zelnik-Manor, and A. Tal. Context-aware saliency detection. PAMI, 34(10):1915–1926,2012.》结合语境

《T. Liu, J. Sun, N.-N. Zheng, X. Tang, and H.-Y. Shum. Learning to Detect A Salient Object. In CVPR, 2007. 》提出了一种带有bounding box标注的大型显著性对象检测数据集;工作于局部对比度

《R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk. Frequency-tuned Salient Region Detection. In CVPR, 2009.》通过将上面那篇文章的数据集的1000张图像作为label,优化了显著性检测任务;全局统计

《J. Harel, C. Koch, and P. Perona. Graph-based Visual Saliency. In NIPS, 2006.》工作于局部对比度

视频显著性工作很少:

《C. Guo, Q. Ma, and L. Zhang. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In CVPR, pages 1–8, 2008.》采用一种基于视频中频谱分析的有效方法

《W. Kim, C. Jung, and C. Kim. Spatiotemporal saliency detection and its applications in static and dynamic scenes. IEEE Transactions on Circuits and Systems for Video Technology, 21(4):446–456, 2011.》通过加上其他维度的信息,将图像中的center-surround方法拓展到了视频中

《V. Mahadevan and N. Vasconcelos. Spatiotemporal saliency in dynamic scenes. PAMI, 32(1):171–177, 2010.》将video patches作为动态信息来处理复杂的背景和移动摄像机的情况

《H. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9(7), 2009.》提出在静态和时空显著性检测中使用自相似性(self-resemblanc)

《X. Cui, Q. Liu, and D. Metaxas. Temporal spectral residual: fast motion saliency detection. In Proceedings of the ACM international Conference on Multimedia, 2009.》用了一种不同的方法,他们将注意力主要集中于运动显著性,并通过时间上的频谱分析进行检测

《X. Hou and L. Zhang. Dynamic visual attention: Searching for coding length increments. NIPS, 21:681–688, 2008.》提出使用增量编码长度来衡量特征的稀有性(rarity)。这种方法可以在图像和视频中找到显著的区域

《M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, and S.-M. Hu. Global contrast based salient region detection. In CVPR, 2011.》全局统计

《J. Li, Levine, M.D., X. An, X. Xu, and H. He. Visual Saliency Based on Scale-Space Analysis in the Frequency Domain. PAMI, 35(4):996–1010, 2013.》全局统计

最近:

《Y. Wei, F. Wen, W. Zhu, and J. Sun. Geodesic Saliency Using Background Priors. In ECCV, 2012.》基于分割的方法,强加一个对象中心先验,即对象必须与图像边界分开

《Y. Zhai and M. Shah. Visual Attention Detection in Video Sequences Using Spatiotemporal Cues. In ACM MM, 2006.》同上

《F. Zhou, S. B. Kang, and M. F. Cohen. Time-Mapping using Space-Time Saliency. In CVPR, 2014.》同上

猜你喜欢

转载自blog.csdn.net/Dorothy_Xue/article/details/83188834