Skip to content

[executorch] Add coreml quant recipes #13387

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

abhinaykukkadapu
Copy link
Contributor

@abhinaykukkadapu abhinaykukkadapu commented Aug 13, 2025

Stack from ghstack (oldest at bottom):

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: D80206542

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Aug 13, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13387

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Pending, 4 Unrelated Failures

As of commit 11d73d2 with merge base 46dd51a (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

abhinaykukkadapu added a commit that referenced this pull request Aug 13, 2025
Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

ghstack-source-id: 302827577
Pull Request resolved: #13387
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

Copy link

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 13, 2025
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 302842396
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 13, 2025
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 302857006
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 13, 2025
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 302870102
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 14, 2025
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
TORCHAO_INT4_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT4_WEIGHT_ONLY_PER_GROUP
TORCHAO_INT8_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 303044428
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
INT4_WEIGHT_ONLY_PER_CHANNEL
INT4_WEIGHT_ONLY_PER_GROUP
INT8_WEIGHT_ONLY_PER_CHANNEL
INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)

[ghstack-poisoned]
abhinaykukkadapu added a commit that referenced this pull request Aug 14, 2025
Pull Request resolved: #13387

Fixing tests for stack that got reverted: #13265

Adds coreml quant recipes after FP32/16 recipes added in #13121

Recipes added:

PT2E_INT8_STATIC
PT2E_INT8_WEIGHT_ONLY
TORCHAO_INT4_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT4_WEIGHT_ONLY_PER_GROUP
TORCHAO_INT8_WEIGHT_ONLY_PER_CHANNEL
TORCHAO_INT8_WEIGHT_ONLY_PER_GROUP
CODEBOOK_WEIGHT_ONLY
ghstack-source-id: 303126085
@exported-using-ghexport

Differential Revision: [D80206542](https://our.internmc.facebook.com/intern/diff/D80206542/)
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D80206542

@abhinaykukkadapu abhinaykukkadapu merged commit 6643637 into gh/abhinaykukkadapu/7/base Aug 14, 2025
104 of 113 checks passed
@abhinaykukkadapu abhinaykukkadapu deleted the gh/abhinaykukkadapu/7/head branch August 14, 2025 22:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants