基于多尺度GAN的虚拟现实多视角图像视觉伪影消除方法
作者:
作者单位:

福建农业职业技术学院信息工程学院,福建 福州350007

作者简介:

通讯作者:

基金项目:

中国高校产学研创新基金宽泛创新项目(2023KY077)。


A Method for Eliminating Visual Artifacts in Virtual Reality Multi-View Images Based on Multi-Scale GAN
Author:
Affiliation:

School of Information Engineering, Fujian Agricultural Vocational and Technical College, Fuzhou 350007, Fujian, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    虚拟现实(virtual reality,VR)多视角图像的伪影消除难点在于其跨尺度复杂性。多尺度生成对抗网络(generative adversarial networks,GAN)通过引入多尺度结构,分层处理图像全局结构与局部细节,以适应伪影的跨尺度特性。为此,基于多尺度GAN的VR多视角图像视觉伪影消除方法,设计包含多尺度生成器与判别器的多尺度GAN。通过多尺度生成器的DenseNet-121网络提取VR多视角伪影图像的多尺度特征,结合特征金字塔网络(feature pyramid network,FPN)和卷积块注意力模块(convolutional block attention module,CBAM)实现多尺度特征融合优化;经上采样和残差连接处理,生成基础去伪影图像;通过多尺度判别器从不同尺度判别生成图像真伪,并反馈给生成器继续校正图像伪影。结果显示:该方法可有效消除VR多视角图像的不同尺度的视觉伪影,且在消除多视角图像伪影时,其结构、特征相似性及边缘保持因子均未低于0.96,感知相似度可低至0.035以下;可同时消除不同尺度伪影,并兼顾全局与局部细节,提升VR多视角图像整体质量。

    Abstract:

    The key challenge of eliminating artifacts in virtual reality (VR) multi-view images lies in their cross-scale complexity. The multi-scale generative adversarial network (GAN) adapts to the cross-scale characteristics of artifacts by introducing a multi-scale structure to hierarchically process the global structure and local details of images. To address this issue, a method for eliminating visual artifacts in VR multi-view images based on multi-scale GAN is proposed in this study. A multi-scale GAN consisting of a multi-scale generator and a multi-scale discriminator is designed. First, the DenseNet-121 network in the multi-scale generator is used to extract multi-scale features of VR multi-view images with artifacts. Then, the feature pyramid network (FPN) and convolutional block attention module (CBAM) are combined to realize the fusion and optimization of multi-scale features. After upsampling and residual connection processing, a basic artifact-removed image is generated. Furthermore, the multi-scale discriminator is adopted to distinguish the authenticity of the generated images from different scales, and the feedback information is sent to the generator for further correction of image artifacts. The experimental results show that the proposed method can effectively eliminate visual artifacts of different scales in VR multi-view images. When eliminating artifacts from multi-view images, its structural similarity, feature similarity and edge preservation factor are all no less than 0.96, and the perceptual similarity can be as low as 0.035 or below. This method can eliminate cross-scale artifacts simultaneously, take both global structure and local details into account, and thus effectively improve the overall quality of VR multi-view images.

    参考文献
    相似文献
    引证文献
引用本文

邓丽萍.基于多尺度GAN的虚拟现实多视角图像视觉伪影消除方法[J].西昌学院学报(自然科学版),2026,40(2):81-92.

复制
文章指标
  • 点击次数:
  • 下载次数:
历史
  • 收稿日期:2025-10-28
  • 最后修改日期:2025-12-04
  • 录用日期:2025-12-22
  • 在线发布日期: 2026-07-08