Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce NamedDataStore #8719

Merged
merged 1 commit into from
Feb 26, 2025
Merged

Introduce NamedDataStore #8719

merged 1 commit into from
Feb 26, 2025

Conversation

pytorchbot
Copy link
Collaborator

This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #8587 by @lucylq
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/lucylq/43/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/lucylq/43/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/main
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/lucylq/43/orig
@diff-train-skip-merge

Copy link

pytorch-bot bot commented Feb 26, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/8719

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 37 Pending

As of commit 9731a75 with merge base 65432b1 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 26, 2025
@swolchok swolchok added release notes: api Changes to public facing apis (any interfaces, pybinded runtime methods, etc.) release notes: exir Changes to any dialects and passes on these dialects, such as memory planning labels Feb 26, 2025
Pull Request resolved: #8587

Introduce NamedDataStore for weight sharing. See 'NamedBlobStore' in [RFC]

Rename 'NamedBlobStore' --> 'NamedDataStore' to mirror 'NamedDataMap' in the runtime.


The NamedDataStore exposes two methods:
- add_named_data: add a blob to the store
- get_named_data_store_output: return the contents of the store, to pass to serialization.

Invariants on the NamedDataStore
- Keys are unique regardless of whether they are in PTE or external file.
- Different keys can point to the same data.

NamedDataStore is used in D69764150. It's owned by the EdgeProgramManager.
ghstack-source-id: 268328940
@exported-using-ghexport

Differential Revision: [D69764094](https://our.internmc.facebook.com/intern/diff/D69764094/)
@swolchok swolchok merged commit 13b5605 into main Feb 26, 2025
46 checks passed
@swolchok swolchok deleted the gh/lucylq/43/orig branch February 26, 2025 07:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: api Changes to public facing apis (any interfaces, pybinded runtime methods, etc.) release notes: exir Changes to any dialects and passes on these dialects, such as memory planning
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants