Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to share embeddings between an EmbeddingCollection and an EmbeddingBagCollection? #2268

Open
tiankongdeguiji opened this issue Aug 2, 2024 · 3 comments

Comments

@tiankongdeguiji
Copy link
Contributor

We aim to share embeddings between sparse features and sequence sparse features. For sparse features, we use EmbeddingBagCollection, and for sequence sparse features, we use EmbeddingCollection. Could you advise on how to effectively share embeddings between an EmbeddingCollection and an EmbeddingBagCollection?

@tiankongdeguiji
Copy link
Contributor Author

Hi, @henrylhtsang @IvanKobzarev @joshuadeng @PaulZhang12 can you see this problem?

@PaulZhang12
Copy link
Contributor

I don't believe this is something that is supported, feel free to create a prototype

@tiankongdeguiji
Copy link
Contributor Author

I don't believe this is something that is supported, feel free to create a prototype

Thank you! I find this challenging because the states of ebc and ec are created and managed by fbgemm. Do you have any suggestions?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants