force neon vectorization for ios (#21479) - #21479
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21479
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 57e01dc with merge base f4a21b8 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
@JakeStevens has exported this pull request. If you are a Meta employee, you can view the originating Diff in D113940046. |
This PR needs a
|
Summary: Adds separate query-head and state-head configuration to the model definition as well as updates the fused channelwise_gated_delta_rule custom op to support grouped decode and prefill. Differential Revision: D113299906
Summary: The default implementation auto-vectorized well for Android builds, but the specific LLVM Clang 21 toolchain + compiler flags did not auto-vectorize, resulting in only scalar operations. This commit selectively forces neon vectorization for iOS Differential Revision: D113940046
530ec25 to
57e01dc
Compare
Summary:
The default implementation auto-vectorized well for Android builds, but the specific LLVM Clang 21 toolchain + compiler flags did not auto-vectorize, resulting in only scalar operations.
This commit selectively forces neon vectorization for iOS
Differential Revision: D113940046