基于特征深层融合的吊装过程视频目标分割
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP 391

基金项目:

国家自然科学基金资助项目(6217323);国防科工局基础研究项目 (JCKY2019413D001)


Video object segmentation based on deep feature fusion for hoisting process
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    吊装事故的频繁发生, 对国家、社会、人民都造成了非常大的损害。根据吊装过程的视频信息,实现无人安全监控的关键是准确度和速度,提出了一种新的基于全局编码和非对称卷积的目标分割网络,研究视频图像的半监督目标分割问题。首先,将带有标签的视频图像输入网络,分别通过全局编码器与相似性编码器提取到互为补充的特征,从而获得对目标外观的有效表示;然后,通过非对称卷积将两个分支的特征进行深层融合;最后,采用残差上采样解码生成预测掩膜,实现对目标的分割。该方法在DAVIS2017数据集上的准确度为0.675,综合指标为0.708,帧率为31 帧/s;在实验用吊装数据集上的准确度为0.952,综合指标为0.976,比基线方法高5.1%,帧率为26.16 帧/s。与其他网络方法进行了实验比较,验证了分割算法在准确度与速度方面的有效性。

    Abstract:

    The frequent occurrence of hoisting accidents has caused great damage to the country, society and people. According to the video information in hoisting process, the accuracy and speed are the key to realize unmanned safety monitoring system. A new object segmentation network based on global coding and asymmetric convolution was proposed to study semi-supervised video object segmentation task. Firstly, video frames with labels were input into the network, and complementary features were extracted by global encoder and similarity encoder respectively, so that appearance of the target could be effectively represented. Then features of two branches were deeply fused through asymmetric convolution, and residual up-sampling decoding was used to generate prediction mask for target segmentation. The accuracy and overall indicator on DAVIS2017 dataset were 0.675 and 0.708 respectively, and frame rate was 31 frames per second. On hoisting dataset, the accuracy was 0.952, with the result of 0.976 overall indicator which was 5.1% higher than baseline, and frame rate was 26.16 frames per second. Compared to other methods on DAVIS2017 dataset and the hoisting dataset for experiment, the verification showed that the proposed method was effective in accuracy and speed.

    参考文献
    相似文献
    引证文献
引用本文

周明君,王朝立,孙占全.基于特征深层融合的吊装过程视频目标分割[J].上海理工大学学报,2024,46(4):407-416.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-03-08
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-09-18
  • 出版日期:
文章二维码