[ci] - fix(test): fix test workflow #72
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…flow - Change the `uv sync` command to install all extras during PR checks
…t code during loading - Allow datasets library to execute remote code by setting `trust_remote_code=True`, improving compatibility with datasets hosted externally
- Refactor the line that loads the dataset to span multiple lines for better code readability - Maintain functionality of trusting remote dataset code by setting `trust_remote_code=True` in a more readable format
…eferences - Deleted the ConferenceDataset class to streamline local_datasets - Removed ConferenceDataset import from the __init__.py to clean up package initialization [docs] - docs: update data documentation to reflect removed ConferenceDataset - Removed reference to ConferenceDataset in the data.rst docs to keep documentation accurate
- Deleted the `local_datasets` module which managed unlabeled and parallel datasets - Data related to BERT squeeze training removed from .gitignore indicating possible deprecation or refactoring [docs] - docs: update documentation to reflect codebase changes - Removed documentation entries for the now-deleted `local_datasets` module in `bert_squeeze`
…ranslation tasks - Removed hardcoded text column name in favor of dynamic translation column configuration - Added a filter to exclude entries without translations before tokenization - Fixed mismatched attention mask column name in tokenized_dataset [tests] - test: change DistilAssistant test to use `kmfoda/booksum` dataset parameters - Updated test cases to use `booksum` dataset path and specific configuration parameters like `percent`, `target_col`, and `source_col` - Modified asserts to expect different lengths for train and validation data loaders based on `booksum` dataset
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR aims at fixing the test CI workflow