We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
context: In the future, we plan on extending this support to allow for quantized versions of attention or things like RadixAttention as well.
https://pytorch.org/blog/flexattention/
No response
The text was updated successfully, but these errors were encountered:
hmmm. I personally do not know this. Maybe cc @yzh119
Sorry, something went wrong.
zhaochenyang20
No branches or pull requests
Checklist
Motivation
context:
In the future, we plan on extending this support to allow for quantized versions of attention or things like RadixAttention as well.
https://pytorch.org/blog/flexattention/
Related resources
No response
The text was updated successfully, but these errors were encountered: