Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doc mapper: convert number handling to deserialization #5527

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

PSeitz
Copy link
Contributor

@PSeitz PSeitz commented Oct 28, 2024

change number deserialization in docmapper from json to generic deserialization.
This improves codes reuse between different code paths, e.g.
serialization and validation.

fixes conversion order in map_primitive_json_to_tantivy

@PSeitz PSeitz force-pushed the refactor_mapping branch 2 times, most recently from 8f49c91 to 6192fbe Compare October 28, 2024 03:20
Copy link

github-actions bot commented Oct 28, 2024

On SSD:

Average search latency is 1.01x that of the reference (lower is better).
Ref run id: 4045, ref commit: 105aa7d
Link

On GCS:

Average search latency is 0.886x that of the reference (lower is better).
Ref run id: 4046, ref commit: 105aa7d
Link

@PSeitz PSeitz requested a review from fulmicoton October 28, 2024 04:02
change number deserialization in docmapper from json to generic deserialization.
This improves codes reuse between different code paths, e.g.
serialization and validation.

use super::*;

#[test]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need to test what happens for stuff that is out of bound.

  • "-1" to u64
  • u64::MAX to i64
  • 1.2 to u64
  • "1.2" to u64

Copy link
Contributor

@fulmicoton fulmicoton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you checked there was no perf regression?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants