Segment Anything开源项目学习记录

一、什么是Segment Anything开源项目(Introduction)

        We introduce the Segment Anything (SA) project: a new task, model, and dataset for image segmentation. Using our efficient model in a data collection loop, we built the largest segmentation dataset to date (by far), with over 1 billion masks on 11M licensed and privacy respecting images. The model is designed and trained to be promptable, so it can transfer zero-shot to new image distributions and tasks. We evaluate its capabilities on numerous tasks and find that its zero-shot performance is impressive – often competitive with or even superior to prior fully supervised results.

         (个人总结翻译)Segment Anything项目是一个应用于图像分割的新的工作任务、模型和数据的集合体。它具有千万量级图片及物体掩码图片的数据集并且模型被设计训练得敏捷,以至于能够完成泛化训练零样本—zero-shot(模型从未训练过的标签数据)图片的全新物体目标分割。

二、Segment Anything开源项目Web端使用

(一)SAM高效和灵活的设计

        SAM旨在高效地为其数据引擎提供动力,并且在网络浏览器中运行处理的时间为毫秒级。SAM被解耦为两部分,分别为一次性图像编码器轻量级掩码解码器

(二)SAM的数据引擎

        SAM的高级功能是基于一种model-in-the-loop方法的数据引擎及千万数量级的图片与物体掩码图片的训练结果。研究者们不断使用图片及标注图片更新SAM模型,这种model-in-loop方法将会不断重复提高SAM数据集及其自身训练模型。

(三)Web端使用示例   

参考资料:

FacebookResearch——segment-anything——Github

GitHub - facebookresearch/segment-anything: The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Segment Anything(论文原文)

扫描二维码关注公众号,回复: 15260450 查看本文章

https://scontent-sjc3-1.xx.fbcdn.net/v/t39.2365-6/10000000_900554171201033_1602411987825904100_n.pdf?_nc_cat=100&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=YLTtOW2cPwwAX8G98Jn&_nc_ht=scontent-sjc3-1.xx&oh=00_AfC2T7X2La5JIPSMtN7bZZNaCqZPw-u_qaJOARao9yr2VA&oe=6436FB27

Segment Anything Research by Meta AI (网页端)

Segment Anything | Meta AI

猜你喜欢

转载自blog.csdn.net/Jcb1906824038/article/details/130047601