diff --git a/text2image/BigGAN_utils/LICENSE b/text2image/BigGAN_utils/LICENSE deleted file mode 100644 index c2dd721..0000000 --- a/text2image/BigGAN_utils/LICENSE +++ /dev/null @@ -1,21 +0,0 @@ -MIT License - -Copyright (c) 2019 Andy Brock - -Permission is hereby granted, free of charge, to any person obtaining a copy -of this software and associated documentation files (the "Software"), to deal -in the Software without restriction, including without limitation the rights -to use, copy, modify, merge, publish, distribute, sublicense, and/or sell -copies of the Software, and to permit persons to whom the Software is -furnished to do so, subject to the following conditions: - -The above copyright notice and this permission notice shall be included in all -copies or substantial portions of the Software. - -THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR -IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, -FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE -AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER -LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, -OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE -SOFTWARE. diff --git a/text2image/BigGAN_utils/__pycache__/BigGAN.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/BigGAN.cpython-37.pyc deleted file mode 100644 index 4a6ab4b..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/BigGAN.cpython-37.pyc and /dev/null differ diff --git a/text2image/BigGAN_utils/__pycache__/__init__.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/__init__.cpython-37.pyc deleted file mode 100644 index 8543bbb..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/__init__.cpython-37.pyc and /dev/null differ diff --git a/text2image/BigGAN_utils/__pycache__/animal_hash.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/animal_hash.cpython-37.pyc deleted file mode 100644 index 6669dd8..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/animal_hash.cpython-37.pyc and /dev/null differ diff --git a/text2image/BigGAN_utils/__pycache__/datasets.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/datasets.cpython-37.pyc deleted file mode 100644 index 7bf77c6..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/datasets.cpython-37.pyc and /dev/null differ diff --git a/text2image/BigGAN_utils/__pycache__/layers.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/layers.cpython-37.pyc deleted file mode 100644 index 9f6bf9a..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/layers.cpython-37.pyc and /dev/null differ diff --git a/text2image/BigGAN_utils/__pycache__/utils.cpython-37.pyc b/text2image/BigGAN_utils/__pycache__/utils.cpython-37.pyc deleted file mode 100644 index ef37c33..0000000 Binary files a/text2image/BigGAN_utils/__pycache__/utils.cpython-37.pyc and /dev/null differ diff --git a/text2image/LICENSE b/text2image/LICENSE deleted file mode 100644 index 04205d8..0000000 --- a/text2image/LICENSE +++ /dev/null @@ -1,21 +0,0 @@ -MIT License - -Copyright (c) 2021 gnobitab - -Permission is hereby granted, free of charge, to any person obtaining a copy -of this software and associated documentation files (the "Software"), to deal -in the Software without restriction, including without limitation the rights -to use, copy, modify, merge, publish, distribute, sublicense, and/or sell -copies of the Software, and to permit persons to whom the Software is -furnished to do so, subject to the following conditions: - -The above copyright notice and this permission notice shall be included in all -copies or substantial portions of the Software. - -THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR -IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, -FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE -AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER -LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, -OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE -SOFTWARE. diff --git a/text2image/README.md b/text2image/README.md deleted file mode 100644 index c56644a..0000000 --- a/text2image/README.md +++ /dev/null @@ -1,65 +0,0 @@ -# FuseDream - -This repo contains code for our paper ([paper link](https://arxiv.org/abs/2112.01573)): - -**FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimization** - -by *Xingchao Liu, Chengyue Gong, Lemeng Wu, Shujian Zhang, Hao Su and Qiang Liu* from UCSD and UT Austin. - -![FuseDream](./imgs/header_img.png?raw=true "FuseDream") - -## Introduction -FuseDream uses pre-trained GANs (we support BigGAN-256 and BigGAN-512 for now) and CLIP to achieve high-fidelity text-to-image generation. - -## Requirements -Please use `pip` or `conda` to install the following packages: -`PyTorch==1.7.1, torchvision==0.8.2, lpips==0.1.4` and also the requirements from [BigGAN](https://github.com/ajbrock/BigGAN-PyTorch). - -## Getting Started - -We transformed the pre-trained weights of BigGAN from TFHub to PyTorch. To save your time, you can download the transformed BigGAN checkpoints from: - -https://drive.google.com/drive/folders/1nJ3HmgYgeA9NZr-oU-enqbYeO7zBaANs?usp=sharing - -Put the checkpoints into `./BigGAN_utils/weights/` - -Run the following command to generate images from text query: - -`python fusedream_generator.py --text 'YOUR TEXT' --seed YOUR_SEED` - -For example, to get an image of a blue dog: - -`python fusedream_generator.py --text 'A photo of a blue dog.' --seed 1234` - -The generated image will be stored in `./samples` - -## Colab Notebook - -For a quick test of *FuseDream*, we provide Colab notebooks for [*FuseDream*(Single Image)](https://colab.research.google.com/drive/17qkzkoQQtzDRFaSCJQzIaNj88xjO9Rm9?usp=sharing) and *FuseDream-Composition*(TODO). Have fun! - -## Citations -If you use the code, please cite: - -```BibTex -@inproceedings{ -brock2018large, -title={Large Scale {GAN} Training for High Fidelity Natural Image Synthesis}, -author={Andrew Brock and Jeff Donahue and Karen Simonyan}, -booktitle={International Conference on Learning Representations}, -year={2019}, -url={https://openreview.net/forum?id=B1xsqj09Fm}, -} -``` - -and -```BibTex -@misc{ -liu2021fusedream, -title={FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimization}, -author={Xingchao Liu and Chengyue Gong and Lemeng Wu and Shujian Zhang and Hao Su and Qiang Liu}, -year={2021}, -eprint={2112.01573}, -archivePrefix={arXiv}, -primaryClass={cs.CV} -} -```