Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cast updated fields #5076

Merged
merged 8 commits into from
Jun 7, 2024
Merged

cast updated fields #5076

merged 8 commits into from
Jun 7, 2024

Conversation

trinity-1686a
Copy link
Contributor

@trinity-1686a trinity-1686a commented Jun 4, 2024

Description

Following a docmapper update, we might end up with documents with a one type stored, while the docmapper expecting a different type, attempt to cast what we have to what we want.

How was this PR tested?

completed unit tests, tested manually after updating an index

@trinity-1686a trinity-1686a requested a review from guilload June 4, 2024 09:47
@fulmicoton
Copy link
Contributor

Make sure the motivation also ends up in the commit description.

@trinity-1686a trinity-1686a mentioned this pull request Jun 5, 2024
9 tasks
@trinity-1686a trinity-1686a requested a review from guilload June 6, 2024 10:05
Copy link

github-actions bot commented Jun 6, 2024

On SSD:

Average search latency is 1.0x that of the reference (lower is better).
Ref run id: 1901, ref commit: e69d3c5
Link

On GCS:

Average search latency is 1.4x that of the reference (lower is better).
Ref run id: 1902, ref commit: e69d3c5
Link


/// Transform a tantivy object into a serde_json one, without cloning strings.
/// It still allocates maps.
// TODO we should probably move this to tantivy, it has the opposite conversion already
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@PSeitz, can we move that code to tantivy eventually?

@trinity-1686a trinity-1686a enabled auto-merge (squash) June 7, 2024 14:25
@trinity-1686a trinity-1686a merged commit 0816302 into main Jun 7, 2024
4 of 5 checks passed
@trinity-1686a trinity-1686a deleted the trinity/cast-updated-fields branch June 7, 2024 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants