nRetrieve not being respected for embeddings

[RomneyDa]

Before submitting your bug report

• I believe this is a bug. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that reports the same bug
• I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

"contextProviders": [
    {
      "name": "diff",
      "params": {}
    },
    {
      "name": "folder",
      "params": {
        "nRetrieve": 256,
        "nFinal": 32,
        "useReranking": true
      }
    },
    {
      "name": "codebase",
      "params": {
        "nRetrieve": 256,
        "nFinal": 32,
        "useReranking": true
      }
    },

Description

@Lael on discord
https://discord.com/channels/1108621136150929458/1299251762376736839/1300210690958561412

nRetrieve is not being respected for text embeddings provider

To reproduce

No response

Log output

2024-10-28T17:06:37.326127Z ERROR rerank: text_embeddings_router::http::server: router/src/http/server.rs:374: batch size 1095 > maximum allowed batch size 1024

[RomneyDa]

batch of 1095 was sent to embeddings provider with nRetrieve = 256