Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Insufficient memory to continue the execution of the program #111

Open
Prokhozhijj opened this issue Feb 8, 2025 · 0 comments
Open

Insufficient memory to continue the execution of the program #111

Prokhozhijj opened this issue Feb 8, 2025 · 0 comments

Comments

@Prokhozhijj
Copy link

Prokhozhijj commented Feb 8, 2025

I have Window 11 with 64GB RAM onboard. I was trying to execute the program with parameters below and got the error about insufficient memory. Also I tried to execute the program without -t, -m parameters - and the issue is the same.

cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8000000000
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26

  • ... articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8000000000
  •                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
    

At line:1 char:1

  • cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8 ...
  •   + CategoryInfo          : ResourceUnavailable: (:) [], ApplicationFailedException
      + FullyQualifiedErrorId : NativeCommandFailed
    
    
    

Also tried this:

cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 36000000000
Indexing failed : InvalidArgument("The memory arena in bytes per thread cannot exceed 4293967295")
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26

  • ... rticles.json | tantivy index -i ./wikipedia-index -t 1 -m 36000000000
  •                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
    

At line:1 char:1

  • cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 3 ...
  •   + CategoryInfo          : ResourceUnavailable: (:) [], ApplicationFailedException
      + FullyQualifiedErrorId : NativeCommandFailed
    
    
    

And this:

cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4293967294
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26

  • ... articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4293967294
  •                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
    

At line:1 char:1

  • cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4 ...
  •   + CategoryInfo          : ResourceUnavailable: (:) [], ApplicationFailedException
      + FullyQualifiedErrorId : NativeCommandFailed
    
    
    
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant