Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

indexes refactoring #18146

Closed
wants to merge 3 commits into from
Closed

Conversation

leo-gan
Copy link
Collaborator

@leo-gan leo-gan commented Feb 26, 2024

indexes atifacts partially duplicted in the langchain and in langchain_community packages.
Regarding #17832 and following @baskaryan recommendations, indexes is moved into the langchain_community.
All ut-s in langchain work without changes.
Missed ut-s from langchain were added into the langchain_community ut-s. Only ut-s that test the "all" symbol were not added, because "allinlangchain_community` is not used.

Copy link

vercel bot commented Feb 26, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
langchain ⬜️ Ignored (Inspect) Visit Preview Feb 26, 2024 8:24pm

"""Number of skipped documents because they were already up to date."""


def index(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

index should stay in langchain -- since partner packages may introduce a record manager implementation and we don't want partner packages to ever depend on langchain_community

NAMESPACE_UUID = uuid.UUID(int=1984)


class RecordManager(ABC):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should stay in langchain or end up in langchain core since partner packages will need to inherit for their own implementations.

Generally abstract interfaces should be in either langchain core or langchain, but not in langchain community

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@eyurtsev Yeah, exactly, that was implemented in the #17832 but @baskaryan opposed it. So...
looks like you and @baskaryan should decide what to do or not to do. I'm pausing now with this PR.

@leo-gan
Copy link
Collaborator Author

leo-gan commented Feb 27, 2024

Close temporarily till the dependency rules are clear.

@leo-gan leo-gan closed this Feb 27, 2024
@leo-gan leo-gan deleted the indexes-refactoring branch February 27, 2024 01:58
@eyurtsev eyurtsev self-assigned this Apr 18, 2024
@eyurtsev
Copy link
Collaborator

Created this from referencing the refactor #20667

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants