Add export recipes for xnnpack (#12069) #12070

abhinaykukkadapu · 2025-06-27T20:13:31Z

Summary: Enables basic export recipes for XNNPack backend described in #12069

Differential Revision: D77414795

pytorch-bot · 2025-06-27T20:13:34Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12070

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 41 New Failures

As of commit ce2010d with merge base 85b91a4 ():

NEW FAILURES - The following jobs have failed:

Build documentation / build (buck2) / Build doc (gh)
RuntimeError: Command docker exec -t 47c0348b769286ab7cad9dd674be72853e16dd2603d8409c21e3cd2354e23916 /exec failed with exit code 2
Lint / lintrunner / linux-job (gh)
>>> Lint for export/recipe.py:
pull / android / build-llm-demo / linux-job (gh)
RuntimeError: Command docker exec -t 9d54dfb230e43bd1b7260c9f2595c06e2ab17c05924013aedc38b5373a42172f /exec failed with exit code 1
pull / test-eval_llama-mmlu-linux / linux-job (gh)
RuntimeError: Command docker exec -t f256175bda90cd3757331e2e0aa0dad93949d80130a0426a2a38fc3950fbd180 /exec failed with exit code 1
pull / test-eval_llama-wikitext-linux / linux-job (gh)
RuntimeError: Command docker exec -t 6c44ea30ec7ae7a045d5a10654622643f3abb47d9310d7b5764b4bd2c8adcd7c /exec failed with exit code 1
pull / test-llama_runner_eager-linux / linux-job (gh)
RuntimeError: Command docker exec -t 044a49ff1aca3bfcb825d883685903d1814e034441329a8dfb490ad8750c3cc8 /exec failed with exit code 1
pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 512fd5c7daab03e7e4abf43cfc03007b4bcc5f58ebea96be0f8e434f8cd8f9dc /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t e8ea26b245790d29139139349e9a0b17b2a2caa085e21d1359cbf17fdfeb8bfe /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
RuntimeError: Command docker exec -t 3f0967b53d3faba344bc67023cc7e4bc7517b34a3763650b732ec0b3f574822c /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
RuntimeError: Command docker exec -t 1113703da4b859838508405cb586351ec59ae1d00985f2e397aeaae6de967b90 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
RuntimeError: Command docker exec -t 0c1ab8df66792f25cea2c005e950b26869dc750b6faa78c9900cff5ec0ff5dc8 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 8e913280eb8814f02d8dce1eace058c477c26555791b0b38f4463ea97c38c8ef /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
RuntimeError: Command docker exec -t 20ffe951eaff356b971e824c6e78c11b38e9f4e029750f44aa09b5345e073f67 /exec failed with exit code 1
pull / test-llava-runner-linux / linux-job (gh)
test_llava
pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 73eb1a23d7c5dfc0e456c245eef28e55fdc576d6dca8941edf0399e67554e234 /exec failed with exit code 1
pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b031bd743c39df99b558d3e9253efb485e62debd46511e761d36696aa1b250f1 /exec failed with exit code 1
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t a29fa2a4e44a8ce8197955f1bcfae3f695e52bce93bf563c723b2e5a49e28bb7 /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 9a60446966cfbc16dee8e82f512ebc2ee0a224020a48f7df399be643b020bdf8 /exec failed with exit code 1
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 4d6950f242a4237e97908ed81f56afeffc27ebc508596849abe863cc5a4c44f0 /exec failed with exit code 1
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t eb4f3c32133cdfc5a21abd6c9971d900edbebcda68687435edebfd0cdc08a82b /exec failed with exit code 1
pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t ad892426a24a5f9e19399d47f431e876ae498df579012195871fa61310a12046 /exec failed with exit code 1
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 0ad8b67823b9cb41dc5c56a643cf4e1934a6c131af87637d0735cc73639db1b0 /exec failed with exit code 1
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 72f6b024baa872e99789ec2b898ff9ca5c671d43ff4075bdd7ca707e629cf7d6 /exec failed with exit code 1
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t d7f93ebba2389a9d55aafd1a664118b1cddad4e45de5d4a182ffe2669a0db77d /exec failed with exit code 1
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 42a4d63da36ccca2c29083869eb5f65308123be985823672015ccf0ba19ef504 /exec failed with exit code 1
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 4ea8568a657fab10a102e5d9dd5bf0349e9de1b186a52a311cc1c1b32afa9f85 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 7d1bcdcd451e5577531b45e512a736cd545380807dd6e3b215dac6160492f23d /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 73ee12a4b76ca40afb711e898b4dabed3ba292d6b153285bdca5de721116f660 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 0452fbef0e2e3f661bbd686f9719b2ee50abbce4dc42ab7bbba636ac72636983 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 945ca4fad5d08ebcc4e1c52baaf7d6b5dca3fac834df1ee20dd290d79b49b9ad /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t a49022c72860ba001b35e3eb7169b80ad3465f18320702041965b2e8cc6fb06f /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 2fa9552e871450bc19c7bed0e08f46baf89cf239ac983b7a9bbb9ad9355eae16 /exec failed with exit code 1
pull / test-moshi-linux / linux-job (gh)
test_mimi
pull / test-phi-3-mini-runner-linux / linux-job (gh)
RuntimeError: Command docker exec -t d0da4273b0061d839e2b3f0a4661c2b005d6d4996fb117c1a8380a3c014e42d9 /exec failed with exit code 1
pull / test-quantized-aot-lib-linux / linux-job (gh)
RuntimeError: Command docker exec -t aaf760d7b0b2ebc09fbbb0adcf8f1dfd324844a676f68bee0ae50890252522f0 /exec failed with exit code 1
pull / unittest / linux / linux-job (gh)
backends/xnnpack/test/serialization/test_xnnheader.py::TestXNNHeader::test_to_bytes_same_as_from_bytes
pull / unittest / macos / macos-job (gh)
backends/xnnpack/test/serialization/test_xnnheader.py::TestXNNHeader::test_to_bytes_same_as_from_bytes
pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
RuntimeError: Command docker exec -t 8f567880ae49155c9173b3154ed63c1afe8c588368a3a18fe52827c54d4eec7f /exec failed with exit code 2
pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
RuntimeError: Command docker exec -t 6394a3d0bf90c4d46a633a802cc6168a06a70314d8cd9241a9e722dd41ffa822 /exec failed with exit code 1
pull / unittest-editable / linux / linux-job (gh)
backends/xnnpack/test/serialization/test_xnnheader.py::TestXNNHeader::test_to_bytes_same_as_from_bytes
pull / unittest-editable / macos / macos-job (gh)
backends/xnnpack/test/serialization/test_xnnheader.py::TestXNNHeader::test_to_bytes_same_as_from_bytes

This comment was automatically generated by Dr. CI and updates every 15 minutes.

facebook-github-bot · 2025-06-27T20:13:40Z

This pull request was exported from Phabricator. Differential Revision: D77414795

github-actions · 2025-06-27T20:14:11Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Summary: Enables basic export recipes for XNNPack backend described in pytorch#12069 Differential Revision: D77414795

facebook-github-bot · 2025-06-27T20:15:34Z

This pull request was exported from Phabricator. Differential Revision: D77414795

mcr229 · 2025-06-30T21:30:52Z

backends/xnnpack/recipes/recipes.py

+        name="dynamic_quant",
+        quantization_recipe=quant_recipe,
+        partitioners=[XnnpackPartitioner(config_precisions=ConfigPrecisionType.DYNAMIC_QUANT)],
+        pre_edge_transform_passes=[DuplicateDynamicQuantChainPass()],


can remove this

mcr229 · 2025-06-30T21:31:22Z

backends/xnnpack/recipes/recipes.py

+
+
+RECIPE_MAP: dict[str, Callable[[], ExportRecipe]] = {
+    "FP32_RECIPE": get_fp32_recipe,


should we have a recipe for static int8? it would just be the same as dynamic config except is_dynamic = false

mcr229 · 2025-06-30T21:33:05Z

backends/xnnpack/test/recipes/test_xnnpack_recipes.py

@@ -0,0 +1,95 @@
+# Copyright (c) Meta Platforms, Inc. and affiliates.


I think what would be a really good test is if we used these recipes on all of the example_models from aot_compiler:

https://github.com/pytorch/executorch/blob/main/examples/xnnpack/__init__.py#L29-L48

this would be a nice test to make sure these recipes all work.

abhinaykukkadapu requested review from digantdesai and mcr229 as code owners June 27, 2025 20:13

facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 27, 2025

facebook-github-bot added the fb-exported label Jun 27, 2025

Add export recipes for xnnpack (pytorch#12069) (pytorch#12070)

ce2010d

Summary: Enables basic export recipes for XNNPack backend described in pytorch#12069 Differential Revision: D77414795

abhinaykukkadapu force-pushed the export-D77414795 branch from b46b07e to ce2010d Compare June 27, 2025 20:15

mcr229 requested changes Jun 30, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add export recipes for xnnpack (#12069) #12070

Add export recipes for xnnpack (#12069) #12070

abhinaykukkadapu commented Jun 27, 2025

Uh oh!

pytorch-bot bot commented Jun 27, 2025 •

edited

Loading

Uh oh!

facebook-github-bot commented Jun 27, 2025

Uh oh!

github-actions bot commented Jun 27, 2025

Uh oh!

facebook-github-bot commented Jun 27, 2025

Uh oh!

mcr229 Jun 30, 2025

Uh oh!

mcr229 Jun 30, 2025

Uh oh!

mcr229 Jun 30, 2025

Uh oh!

Uh oh!



		RECIPE_MAP: dict[str, Callable[[], ExportRecipe]] = {
		"FP32_RECIPE": get_fp32_recipe,

		@@ -0,0 +1,95 @@
		# Copyright (c) Meta Platforms, Inc. and affiliates.

Add export recipes for xnnpack (#12069) #12070

Are you sure you want to change the base?

Add export recipes for xnnpack (#12069) #12070

Conversation

abhinaykukkadapu commented Jun 27, 2025

Uh oh!

pytorch-bot bot commented Jun 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/12070

❌ 41 New Failures

Uh oh!

facebook-github-bot commented Jun 27, 2025

Uh oh!

github-actions bot commented Jun 27, 2025

This PR needs a release notes: label

Uh oh!

facebook-github-bot commented Jun 27, 2025

Uh oh!

mcr229 Jun 30, 2025

Choose a reason for hiding this comment

Uh oh!

mcr229 Jun 30, 2025

Choose a reason for hiding this comment

Uh oh!

mcr229 Jun 30, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

pytorch-bot bot commented Jun 27, 2025 •

edited

Loading

This PR needs a `release notes:` label