Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate file format to protobuf #8995

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Conversation

jprochazk
Copy link
Member

@jprochazk jprochazk commented Feb 11, 2025

Related

What

  • Use protobuf encoding for our file format.
  • Completely remove msgpack code from the repository.

Tested by opening running the clock example and attempting to load the data in both the native and web viewers.

There are still some pieces left in the file format that have now been made redundant. One example is the per-recording compression field. We don't use that anymore, compression is now specified per ArrowMsg. There are a few other things like that, but I believe that refactoring is better left to the time when we decide to get rid of LogMsg, which would be another breaking change for the file format.

Copy link

github-actions bot commented Feb 11, 2025

Web viewer built successfully. If applicable, you should also test it:

  • I have tested the web viewer
Result Commit Link Manifest
ea90dd8 https://rerun.io/viewer/pr/8995 +nightly +main

Note: This comment is updated whenever you push a commit.

@jprochazk jprochazk added the 🪵 Log & send APIs Affects the user-facing API for all languages label Feb 11, 2025
@jprochazk jprochazk marked this pull request as draft February 11, 2025 18:03
@jprochazk jprochazk force-pushed the jan/migrate-file-protobuf branch from b1ebf6e to cb6f4f8 Compare February 13, 2025 15:00
@jprochazk jprochazk force-pushed the jan/migrate-file-protobuf branch from cb6f4f8 to ea90dd8 Compare February 13, 2025 15:01
@jprochazk jprochazk marked this pull request as ready for review February 13, 2025 15:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
include in changelog 🪵 Log & send APIs Affects the user-facing API for all languages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove support for MsgPack serializer Migrate rrd to protobuf
1 participant