[This article belongs to Volume - 54, Issue - 09]
Gongcheng Kexue Yu Jishu/Advanced Engineering Science
Journal ID : AES-13-11-2022-416

Title : Multi-scale Discriminator Image Inpainting Algorithm Based on Dual Network
LI Haiyan, WU Ziying, WU Jun, LI Haijiang, LI Hongsong,

Abstract :

In order to effectively solve the defects of boundary distortion, artifacts and training instability when repairing complex backgrounds and high-resolution images, an image repair algorithm based on dual generative adversarial networks and multi-scale discriminators is proposed. First, the image to be repaired is input into the content prediction network based on the dilated convolution layer, and the reconstruction loss and the global decision device based on the generative adversarial loss are used as the standard, and the rough repair is performed to obtain a clear and reasonable overall semantic consistency. structure. Then, the rough inpainting result is input into the detail inpainting network, and after being decoded and deconvoluted by the dilated convolution path and the perceptual convolution path, it is sent to three different-scale decision devices for optimization to improve the fine-grained texture of the inpainting result. Finally, 3 different scales of adversarial losses are used to optimize network parameters to capture multi-scale edge information of damaged regions and generate reasonable and realistic texture details. On the recognized image dataset, the algorithm of this paper is used for inpainting experiment, dual network inpainting comparison, high-resolution inpainting comparison, target removal experiment, ablation experiment and objective experiment. , can generate reasonable structure and clear texture details; the double network structure is better than the single network structure; the fine-grained texture obtained when repairing high-resolution images is better than the comparison algorithm; the algorithm proposed in this paper is used for high-resolution target removal , can get results with clear and reasonable structure and fine texture; ablation experiments verify the effectiveness of the proposed module; the peak signal-to-noise ratio, structural similarity, and average l1 error and average l2 The errors are all better than the compared classical inpainting algorithms. In short, the algorithm proposed in this paper can well combine the overall semantics of the image, enhance the restoration accuracy of image details, and effectively avoid problems such as structural texture disorder, pixel overlapping, and boundary distortion