Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update network_swin2sr.py #1

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Update network_swin2sr.py #1

wants to merge 3 commits into from

Conversation

nbardy
Copy link
Owner

@nbardy nbardy commented Aug 2, 2023

Hooks up a Clip cross attention TextEncoder to SWINIR at both the features and high frequency features layers.

This should improve, performance, add text guidance and increase training stability as seen in the gigaGAN paper.

The gigaGAN paper also adds cross attention to the discriminator. This could be useful as followup.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant