Fix for grid_sample_gradfix and conv2d_gradfix on pytorch 1.11 #117
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I was receiving the below error when training which seems to be a result of a backwards-incompatible change in PyTorch 1.11.0, as pointed out in PyTorch issue #75018 regarding StyleGAN3.
@jannehellsten pushed a change to StyleGAN3 to fix this issue according to their comment on the aforementioned PyTorch issue.
After applying these same changes locally to conv2d_gradfix.py and grid_sample_gradfix.py in stylegan-xl, I can confirm that the model is training smoothly on my custom dataset.