基于分流存储网络的半监督视频对象分割
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP 18

基金项目:

国家自然科学基金资助项目(62173232)


Semi-supervised video object segmentation based split-flow memory network
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    半监督视频分割的目标是在给定首帧视频标注的条件下,持续跟踪并分割出后续视频帧中的目标。许多基于时空存储方法的网络,利用过去存储的视频帧背景与目标特征来引导后续帧目标的分割,已经取得了显著的效果。但这些网络多数是按时间顺序存储视频帧,导致存储库不断扩大,增加了匹配分割时间,且存储特征中不断累积的扰动与噪声也降低了分割的精确度。受记忆曲线启发,提出一种分流存储网络来解决上述问题。网络将存储库分为3个级别:初级、中级和高级,并引入分流存储模块作为分流准则,控制特征存储的流向。通过采用不同策略,使网络在提升精确率的同时,缩短了分割时间。在训练数据保持一致的情况下,本文网络与同类型网络相比,在单对象数据集DAVIS16与多对象数据集DAVIS2017上均取得了较好效果。

    Abstract:

    The goal of semi-supervised video object segmentation is to continuously track and segment out the target objects in subsequent video frames given the first frame video object labeling. Many networks based on space-time memory have achieved significant results by utilizing the background and object features of past stored video frames to guide the segmentation of objects in subsequent frames. However, most of these networks simply store video frames in chronological order, resulting in an ever-expanding memory bank that increases the matching segmentation time, while the accumulating perturbations and noises in the stored features also reduce the segmentation accuracy. Inspired by the memory curve, a split-flow memory network was proposed to solve the above problems. The network divided the memory bank into three levels: primary, middle and senior, and introduced a split-flow memory module to set standards and control the feature memory flow. By adopting different strategies, the network improved the accuracy rate while shortening the segmentation time. With consistent training data, the network achieved optimal results on both single-object dataset DAVIS16 and multi-object dataset DAVIS2017 compared with the same type of networks.

    参考文献
    相似文献
    引证文献
引用本文

郭旭丰,王朝立,孙占全,蒋纯国.基于分流存储网络的半监督视频对象分割[J].上海理工大学学报,2026,48(2):149-158,208.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-02-12
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-05-11
  • 出版日期:
文章二维码