Website Updates for 2.4.0 #1126
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…on-data-lost-during-testcase-import-process Bug/ner evaluation fix in is_pass()
…on-data-lost-during-testcase-import-process resolved: recovering the transformation object.
…ries-even-when-no-transformations-are-applied fixed: consistent issues while generated templates
…ce to number of extra templates to be needed
…ries-even-when-no-transformations-are-applied Chore: Add Option to Configure Number of Generated Templates in Templatic Augmentation
…ries-even-when-no-transformations-are-applied resolved/augmentation errors
…ries-even-when-no-transformations-are-applied Fix/augmentations
…s-for-ner-task Fix/error in accuracy tests for ner task
Update transformer's version to 4.44.2
…ement-the-support-for-multimodal-with-new-vqa-task
…ort-for-multimodal-with-new-vqa-task Feature/implement the support for multimodal with new vqa task
…cation in text-classification task and predictions in ner task
…s-for-multi-label-classification Fix/AttributeError in accuracy tests for multi label classification
This commit refactors the PromptGuard class in the modelhandler/promptguard.py module. The changes include: - Simplifying the initialization process by using a singleton pattern - Loading the model and tokenizer from Hugging Face - Preprocessing the input text to remove spaces and mitigate prompt injection tactics - Calculating class probabilities for a single or batch of texts - Adding methods to get jailbreak scores and indirect injection scores for a single input text or a batch of texts - Processing texts in batches to improve efficiency The commit also includes changes in the safety.py module: - Importing the PromptGuard class from the modelhandler/promptguard.py module - Replacing the pipeline usage with the PromptGuard class to get indirect injection scores Lastly, the commit includes changes in the output.py and sample.py modules: - Adding a greater than or equal to comparison method in the MaxScoreOutput class - Updating the comparison method in the QASample class to use the new comparison method in MaxScoreOutput
…lassification task and predictions in ner task
…s-for-multi-label-classification Refactor fairness test to handle multi-label classification
…ests-with-promptguard Feature/enhance safety tests with promptguard
Release/2.4.0
Add new tests for text classification and prompt evaluation tutorials
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.