高级检索+

基于纹理和结构的双流人脸图像修复算法

Two-Stream Face Image Restoration Algorithm Based on Texture and Structure

  • 摘要: 图像修复作为图像处理领域重要的研究方向而备受关注,现有的图像修复模型只针对纹理或结构的某一方面,忽略了二者在图像修复任务中是相辅相成的,从而导致所修复出的图像不尽如意。鉴于此,采用双支流的编解码器作为图像生成器的主干,分别对应生成图像的纹理特征和结构特征,达到结构约束纹理,纹理引导结构的效果;利用双向残差特征融合模块融合解码器生成的纹理特征和结构特征,完成两种特征的信息交换;并用多尺度上下文特征信息聚合模块丰富修复图像的细节特征。实验证明,该方法在不同掩码率下SSIM及PSNR值均有提升。

     

    Abstract: As an important research direction in the field of image processing, image restoration has attracted much attention. The existing image restoration models only focus on one aspect of texture or structure, but ignore that the two complement each other in image restoration tasks, which leads to unsatisfactory images. In this paper, the codecs of double tributaries are used as the backbone of the image generator, corresponding to the texture features and structure features of the generated image respectively, so as to achieve the effect of structure constraint texture and texture guidance structure. Secondly, The bidirectional residual feature fusion module is used to fuse texture features and structure features generated by the decoder to complete the information exchange of the two features. Finally, The detailed features of the restored images are enriched with a multi-scale context feature information aggregation module. Experiments show that the proposed method can improve the SSIM and PSNR values under different mask rates.

     

/

返回文章
返回