Skip to content

[slimtensor] Add aoti_torch_item_bool for SlimTensor #16453

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Gasoonjia wants to merge 11 commits into
base: gh/gasoonjia/95/base
Choose a base branch
from
Open

[slimtensor] Add aoti_torch_item_bool for SlimTensor #16453

Gasoonjia wants to merge 11 commits into from
+334 −0

Conversation

@Gasoonjia
Copy link
Contributor

@Gasoonjia Gasoonjia commented Jan 5, 2026 •
edited
Loading

Stack from ghstack (oldest at bottom):

Add SlimTensor-based aoti_torch_item_bool() - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's item<bool>() which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: D90126253

@Gasoonjia
[slimtensor] Add aoti_torch_item_bool for SlimTensor
5d3a52f 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Jan 5, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16453

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 107 Pending

As of commit 1b78e47 with merge base c487340 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Jan 5, 2026
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
@github-actions
Copy link

github-actions bot commented Jan 5, 2026

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

This was referenced Jan 5, 2026
Merged
Merged
Merged
Merged
Merged
Open
Open
Open
Open
Open
Open
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 5, 2026
This was referenced Jan 6, 2026
Open
Open
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
8a9db6d 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia Gasoonjia mentioned this pull request Jan 13, 2026
Open
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
6235577 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
b95e0b4 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
41af6ea 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia Gasoonjia mentioned this pull request Jan 21, 2026
Merged
Gasoonjia added a commit that referenced this pull request Jan 21, 2026
@Gasoonjia
[slimtensor] Add aoti_torch_item_bool for SlimTensor
3f3d1d8 
Pull Request resolved: #16453

Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.
ghstack-source-id: 334642306
@exported-using-ghexport

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
fe7bf7d 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
b2c938b 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
This was referenced Jan 22, 2026
Merged
Merged
Merged
Merged
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
c2af229 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
41cb3f0 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
354fec6 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
Gasoonjia added a commit that referenced this pull request Jan 27, 2026
@Gasoonjia
[slimtensor] Introduce CUDA guard to aoti/slim/cuda (#16724)
4af7c3e 
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #16565
* #16551
* #16469
* #16457
* #16455
* #16454
* #16453
* #16452
* #16451
* #16450
* #16449
* #16448
* #16447
* #16446
* __->__ #16724

Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular
dependency:
- cuda_backend/main_functionalities -> aoti/slimtensor ->
cuda_backend/cuda_guard

This change:
- copy guard.h, guard.cpp and test files from backend/cuda_backend to
backend/aoti/slim/cuda/

Differential Revision:
[D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)
Gasoonjia added a commit that referenced this pull request Jan 27, 2026
@Gasoonjia
[slimtensor] Add SlimTensor-based aoti_torch_create_tensor_from_blob_…
665facc 
…v2 (#16446)

Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #16565
* #16551
* #16469
* #16457
* #16455
* #16454
* #16453
* #16452
* #16451
* #16450
* #16449
* #16448
* #16447
* __->__ #16446
* #16724

Add SlimTensor-based implementations of AOTI shim functions for tensor
creation:

1. `aoti_torch_create_tensor_from_blob_v2()` - Creates a non-owning
SlimTensor that wraps existing memory using the `from_blob()` factory

Both functions support CPU and CUDA devices and handle all 7 SlimTensor
dtypes.

Also add `memory_slim.h` and `memory_slim.cpp` with SlimTensor-based
shim implementations for working on new API while not impact the current
pipeline. Will use memory_slim.{h/cpp} to replace current memory.{h/cpp}
when everything has been set up.

Differential Revision:
[D90126247](https://our.internmc.facebook.com/intern/diff/D90126247/)
Gasoonjia added a commit that referenced this pull request Jan 27, 2026
@Gasoonjia
[slimtensor] Add SlimTensor-based aoti_torch_empty_strided (#16447)
c653d80 
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at
bottom):
* #16565
* #16551
* #16469
* #16457
* #16455
* #16454
* #16453
* #16452
* #16451
* #16450
* #16449
* #16448
* __->__ #16447
* #16446
* #16724

Add SlimTensor-based implementations of AOTI shim functions for tensor
creation:

`aoti_torch_create_tensor_from_blob_v2()` - Creates a non-owning
SlimTensor that wraps existing memory using the `from_blob()` factory

Both functions support CPU and CUDA devices and handle all 7 SlimTensor
dtypes.

Changes:
- Add `memory_slim.h` and `memory_slim.cpp` with SlimTensor-based shim
implementations
- Add `runtime_shims_slim` library target to TARGETS with
`CUDA_AVAILABLE=1` preprocessor flag
- Add `cuda_shim_slim_cpp_unittest()` function for SlimTensor test
targets

Differential Revision:
[D90126244](https://our.internmc.facebook.com/intern/diff/D90126244/)
@Gasoonjia
Update on "[slimtensor] Add aoti_torch_item_bool for SlimTensor"
1b78e47 
Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)

[ghstack-poisoned]
Gasoonjia added a commit that referenced this pull request Jan 28, 2026
@Gasoonjia
[slimtensor] Add aoti_torch_item_bool for SlimTensor
9ec9964 
Pull Request resolved: #16453

Add SlimTensor-based `aoti_torch_item_bool()` - Extracts a boolean scalar value from a single-element tensor. Uses SlimTensor's `item<bool>()` which handles CUDA tensors by automatically copying the value to CPU.
ghstack-source-id: 336360655
@exported-using-ghexport

Differential Revision: [D90126253](https://our.internmc.facebook.com/intern/diff/D90126253/)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@larryliu0820 larryliu0820 larryliu0820 approved these changes

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported meta-exported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Gasoonjia @larryliu0820