Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Save compute output checksums in PodResult #55

Open
guzman-raphael opened this issue Feb 1, 2025 · 0 comments
Open

Save compute output checksums in PodResult #55

guzman-raphael opened this issue Feb 1, 2025 · 0 comments

Comments

@guzman-raphael
Copy link
Contributor

guzman-raphael commented Feb 1, 2025

This issue is to add evaluating checksums for any outputs generated from a compute run and storing them into the model.

Specifically:

// model.rs
enum Artifact {  // renamed from `Input` to be more general so use with outputs is less confusing
    Unary(Blob<FileOrFolder>),
    Collection(Vec<Blob<FileOrFolder>>),
}

struct PodJob {
    // ...
    output_dir: Blob<FolderOnly>, // no checksum, just a rename from previous `output_stream_path` since that is what this actually is
    // ...
}

struct PodResult {
    // ...
    output_dir: Option<Blob<FolderOnly>>, // added with checksum
    output_stream_path: Option<BTreeMap<String, Artifact>>, // added with checksums
    // ...
}

Depends on #14, #54

@github-project-automation github-project-automation bot moved this to Todo in orcapod Feb 1, 2025
@guzman-raphael guzman-raphael changed the title Save compute output checksums Save compute output checksums in PodResult Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant