Vectara summarization

[ofermend]

• Description: Adding Summarization to Vectara, to reflect it provides not only vector-store type functionality but also can return a summary.
  Also added:

• MMR capability (in the Vectara platform side)

• Updated templates

• Updated documentation and IPYNB examples

  • Tag maintainer: @baskaryan
  • Twitter handle: @ofermend

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchain	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 20, 2023 6:27pm

[efriis]

Hey @ofermend ! We're currently splitting up integration packages, so would you be game to wait on this PR until next week, when you can put the PR up against the new location for these?

[ofermend]

Sure. I've been working on this for last few days and also in parallel with Jacob on the JS version. Can wait with both until you are done with the split and then I assume there may be some fixes to do, but I hope nothing too bad.
Can you please ping me when I should take a look next week and refactor what's needed?

[ofermend]

Hey @efriis - any updates on working to merge this in, post the refactor?
Also I noticed there was another PR for MMR that never got merged. This supercedes this and has the code for our internal MMR implementation so I think it's okay to close that other PR: #13571

[efriis]

Yes! If you merge in master, you'll notice most of these files have moved to the langchain-community lib. If you could merge that in (it's all in master), that would be great!

More info if curious: #14243

[ofermend]

Okay let me merge master in, move things around, and I'll test everything then update the PR
I noticed that self-query vectara remains in the original location - does that need to move to the new community location too?

[efriis]

Feel free to leave the self query one where it is for now - we'll handle that with the rest at that time.

[ofermend]

@efriis - any updates on merging this in? Anything else missing?

[efriis]

I think it's just failing lint if you want to take a look!

[ofermend]

fixed that lint issue. Anything else I'm missing?

[efriis]

It's still failing lint. I'll take a look later today! Make sure you're running mypy 0.0.991 and ruff 0.1.5 in community!

[ofermend]

Thanks. Pls let me know. THe failures I see above are unrelated to Vectara (Power BI or something)

[efriis]

Assuming you didn't mean to change those files in this PR?

[ofermend]

Not at all. Sorry maybe did so mistakenly during a previous "make format" that went bad?

[efriis]

Can't edit this branch. Merging in #14970