Multi-Stage Hybrid Text-to-Image Generation Models | ||||
| International Journal of Intelligent Computing and Information Sciences | ||||
| Article 19, Volume 22, Issue 3, August 2022, Page 82-91 PDF (1.28 MB) | ||||
| Document Type: Original Article | ||||
| DOI: 10.21608/ijicis.2022.117124.1157 | ||||
 View on SCiNiTO | ||||
| Authors | ||||
Razan Bayoumi   1; Marco Alfonse 1; Abdel-Badeeh Salem 2
| ||||
| 1Computer Science Department, Faculty of Computer and Information Sciences, Ain Shams University, Cairo, Egypt | ||||
| 2Computer Sciece Department, Faculty of Computer and Information Sciences, Ain Shams University | ||||
| Abstract | ||||
| Generative Adversarial Networks (GANs) have proven their outstanding potential in creating realistic images that can't differentiate between them and the real images, but text-to-image (conditional generation) still faces some challenges. In this paper, we propose a new model called (AttnDM GAN) stands for Attentional Dynamic Memory Generative Adversarial Memory, which seeks to generate realistic output semantically harmonious with an input text description. AttnDM GAN is a three-stage hybrid model of the Attentional Generative Adversarial Network (AttnGAN) and the Dynamic Memory Generative Adversarial Network (DM-GAN), the 1st stage is called the Initial Image Generation, in which low resolution 64x64 images are generated conditioned on the encoded input textual description. The 2nd stage is the Attention Image Generation stage that generates higher-resolution images 128x128, and the last stage is Dynamic Memory Based Image Refinement that refines the images to 256x256 resolution images. We conduct an experiment on our model the AttnDM GAN using the Caltech-UCSD Birds 200 dataset and evaluate it using the Frechet Inception Distance (FID) with a value of 19.78. We also proposed another model called Dynamic Memory Attention Generative Adversarial Networks (DMAttn-GAN) which considered a variation of the AttnDM GAN model, where the second and the third stages are switched together, its FID value is 17.04. | ||||
| Keywords | ||||
| Generative Adversarial Networks; Image Generation; Text-to-image; Computer Vision; Conditional Image Synthesis | ||||
|
Statistics Article View: 219 PDF Download: 195 |
||||
