Skip to content

Commit

Permalink
Add reindex capability to remote store protocol (#8985)
Browse files Browse the repository at this point in the history
### Related

Part of rerun-io/dataplatform#156.

### What

We want to be able to manually request the reindexing of an existing
index. This could be used after a recording is added, which leaves the
index in a stale state.
  • Loading branch information
drauschenbach authored Feb 11, 2025
1 parent 0bbfb84 commit d3b7e9d
Show file tree
Hide file tree
Showing 3 changed files with 104 additions and 0 deletions.
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -75,3 +75,6 @@ justfile

# heaptrack files
*.zst

# IDE stuff
/.idea
11 changes: 11 additions & 0 deletions crates/store/re_protos/proto/rerun/v0/remote_store.proto
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ service StorageNode {
rpc FetchRecording(FetchRecordingRequest) returns (stream rerun.common.v0.RerunChunk) {}

rpc CreateIndex(CreateIndexRequest) returns (CreateIndexResponse) {}
rpc ReIndex(ReIndexRequest) returns (ReIndexResponse) {}

// The response to `SearchIndex` a RecordBatch with 3 columns:
// - 'resource_id' column with the id of the resource
Expand Down Expand Up @@ -74,6 +75,13 @@ message CreateIndexRequest {
rerun.common.v0.IndexColumnSelector time_index = 4;
}

message ReIndexRequest {
// which catalog entry do we want to reindex for
CatalogEntry entry = 1;
// which column do we want to reindex
IndexColumn column = 2;
}

message IndexProperties {
oneof props {
InvertedIndex inverted = 1;
Expand Down Expand Up @@ -109,6 +117,9 @@ message CreateIndexResponse {
uint64 indexed_rows = 1;
}

message ReIndexResponse {
}

// ---------------- SearchIndex ------------------

message SearchIndexRequest {
Expand Down
90 changes: 90 additions & 0 deletions crates/store/re_protos/src/v0/rerun.remote_store.v0.rs

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

0 comments on commit d3b7e9d

Please sign in to comment.