Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backfill is crashing #82

Open
rohan-mehta opened this issue Jul 12, 2024 · 1 comment
Open

Backfill is crashing #82

rohan-mehta opened this issue Jul 12, 2024 · 1 comment

Comments

@rohan-mehta
Copy link

Description

I have a large-ish firebase collection (hundreds of thousands of docs) that I'm trying to sync to typesense. When I start the backfill, I see:

Memory limit of 2048 MiB exceeded with 2054 MiB used. Consider increasing the memory limit, see https://cloud.google.com/functions/docs/configuring/memory 

How do I fix this?

Metadata

Typesense Version: 26

OS: typesense cloud

@rohan-mehta
Copy link
Author

Based on some closed issues — seems like the extension tries to load the entire collection into memory instead of paginating?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant