Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability
salem, M., Sakr, M., eletriby, S. (2023). Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability. EKB Journal Management System, 10(2), 66-79. doi: 10.21608/ijci.2023.200402.1101
Mohamed Fathallah salem; Mohamed Sakr; Sherif eletriby. "Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability". EKB Journal Management System, 10, 2, 2023, 66-79. doi: 10.21608/ijci.2023.200402.1101
salem, M., Sakr, M., eletriby, S. (2023). 'Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability', EKB Journal Management System, 10(2), pp. 66-79. doi: 10.21608/ijci.2023.200402.1101
salem, M., Sakr, M., eletriby, S. Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability. EKB Journal Management System, 2023; 10(2): 66-79. doi: 10.21608/ijci.2023.200402.1101

Enhancing the Performance of Generative Adversarial Networks with Identity Blocks and Revised Loss Function to Improve Training Stability

IJCI. International Journal of Computers and Information
Article 7, Volume 10, Issue 2, September 2023, Page 66-79  XML PDF (1.42 MB)
Document Type: Original Article
DOI: 10.21608/ijci.2023.200402.1101
View on SCiNiTO View on SCiNiTO
Authors
Mohamed Fathallah salem email orcid 1; Mohamed Sakr2; Sherif eletribyorcid 2
1Department of Computer Science, Faculty of Computers and Information, Kafr El-Sheikh University, Kafr El-Sheikh 33511, Egypt
2Department of Computer Science, Faculty of Computers and Information, Menoufia University, Menoufia 32511, Egypt
Abstract
Generative adversarial networks (GANs) are a powerful deep learning model for synthesizing realistic images; however, they can be difficult to train and are prone to instability and mode collapse. This paper presents a modified deep learning model called Identity Generative Adversarial Network (IGAN) to address the challenges of training and instability faced by generative adversarial models in synthesizing realistic images. The IGAN model includes three modifications to improve the performance of DCGAN: a non-linear identity block to ease complex data fitting and reduce training time; a modified loss function with label smoothing to smooth the standard GAN loss function; and minibatch training to use other examples from the same minibatch as side information for better quality and variety of generated images. The effectiveness of IGAN was evaluated and compared with other state-of-the-art generative models using the inception score (IS) and Fréchet inception distance (FID) on CelebA and stacked MNIST datasets. The experiments demonstrated that IGAN outperformed the other models in terms of convergence speed, stability, and diversity of results. Specifically, in 200 epochs, IGAN achieved an IS of 13.6 and an FID of 46.2. Furthermore, the IGAN collapsed modes were compared with other generative models using a stacked MNIST dataset, showing the superiority of IGAN in producing all the modes while the other models failed to do so. These results demonstrate that the modifications implemented in IGAN can significantly enhance the performance of GANs in synthesizing realistic images, providing a more stable, high-quality, and diverse output.
Keywords
Generative adversarial network; deep learning; mode collapse; label smoothing; identity block
Statistics
Article View: 252
PDF Download: 300