Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deprecate tsv fasta #640

Merged
merged 3 commits into from
Nov 14, 2024
Merged

Deprecate tsv fasta #640

merged 3 commits into from
Nov 14, 2024

Conversation

Taepper
Copy link
Collaborator

@Taepper Taepper commented Nov 7, 2024

resolves #562

Summary

PR Checklist

  • All necessary documentation has been adapted or there is an issue to do so.
  • The implemented feature is covered by an appropriate test.

@Taepper Taepper force-pushed the deprecate-tsv-fasta branch 5 times, most recently from f412967 to fb2d185 Compare November 12, 2024 15:54
@Taepper Taepper marked this pull request as ready for review November 13, 2024 08:20
Copy link
Contributor

github-actions bot commented Nov 13, 2024

This is a preview of the changelog of the next release. If this branch is not up-to-date with the current main branch, the changelog may not be accurate. Rebase your branch on the main branch to get the most accurate changelog.

Note that this might contain changes that are on main, but not yet released.

Changelog:

0.4.0 (2024-11-14)

⚠ BREAKING CHANGES

  • metadataInputFile key in preprocessing config file has been removed. Instead, ndjson files should be used and specified with the ndjsonInputFilename option

Features

Bug Fixes

  • preprocessing: correct error message when field is in config but not in metadata file (828182a)

@Taepper Taepper force-pushed the deprecate-tsv-fasta branch 3 times, most recently from 60a13d3 to 9517a28 Compare November 13, 2024 13:33
Copy link
Contributor

@fengelniederhammer fengelniederhammer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually looks good 👍

I would however rephrase the commit message: Instead of "deprecate" I would write something like "remove" (when reading deprecated as a user, I would think it still works, but I should slowly migrate away)

@@ -51,13 +41,7 @@ class PreprocessingConfig {
std::optional<uint32_t> duckdb_memory_limit_in_g;
std::optional<std::filesystem::path> lineage_definitions_file;
std::optional<std::filesystem::path> ndjson_input_filename;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we make this non-optional now?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this were non-optional, it would need a default value. Anyways, I would wait for the config refactor for this. Maybe it will resolve this already

CMakeLists.txt Show resolved Hide resolved
src/silo/preprocessing/preprocessor.cpp Outdated Show resolved Hide resolved
src/silo/preprocessing/preprocessor.test.cpp Outdated Show resolved Hide resolved
include/silo/preprocessing/preprocessor.h Outdated Show resolved Hide resolved
It is now impossible to specify an input file different from ndjsonInputFilename. An error will be thrown if this variable is not set.

resolves #562

BREAKING CHANGE: `metadataInputFile` key in preprocessing config file has been removed. Instead, ndjson files should be used and specified with the `ndjsonInputFilename` option
@Taepper Taepper merged commit 1fdd2cd into main Nov 14, 2024
9 checks passed
@Taepper Taepper deleted the deprecate-tsv-fasta branch November 14, 2024 11:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove tsv/fasta input format
2 participants