How to pass workers and batch_size in weaviate vector db (Add a feature)

[anshumantanwar]

In Weaviate vector db, we have option to pass workers (for multithreading) and batch_size. In langchain weaviate we do not have any such options.
I would like to extend weaviate package in langchain using below steps

1. pass two more (optional) params - workers and batch_size in Weaviate.from_texts
2. add below code to allow workers and batch_size (using if condition):
   client.batch.configure(batch_size=batch_size, num_workers=workers)

I can contribute as told in steps.
In case there is any other way to implement this, i would love to know that.

CC: @hwchase17

[dosubot[bot]]

🤖

That's great to hear that you're interested in contributing to LangChain! Your proposed solution to extend the Weaviate package sounds like a valuable addition. Adding the option to pass workers and batch_size in Weaviate.from_texts would provide more flexibility for users.

To contribute, you can follow these steps:

1. Fork the LangChain repository on GitHub.
2. Create a new branch for your changes.
3. Implement your proposed solution by adding the two optional parameters and configuring the batch size and number of workers.
4. Test your changes to ensure they work as expected.
5. Commit your changes and push them to your forked repository.
6. Open a pull request (PR) on the main LangChain repository, explaining the changes you made and why they are beneficial.

The maintainers will review your PR and provide feedback. Thank you for your willingness to contribute! Let me know if you have any further questions.

---

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.