Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Probably invalid infill logic #45

Open
ex3ndr opened this issue Feb 3, 2024 · 0 comments
Open

Probably invalid infill logic #45

ex3ndr opened this issue Feb 3, 2024 · 0 comments

Comments

@ex3ndr
Copy link

ex3ndr commented Feb 3, 2024

Hey,

I am looking at the code, paper and Meta's demos and i have strong feeling that there is something wrong with the way infill is solved.

On all demos they cut the audio and then do actual infill keeping surroundings intact, while here we are use full output of the xt, which expects network to be perfectly trained to synthesize very same audio, which is clearly not expected from the model that is measured to do opposite.

It seems we need either to init y0 with noise + unmasked audio or merge results from solver on each step or run solver on specific segment only.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant