FEAT Add McGill-NLP/stereoset Dataset #451
Labels
datasets
Pulling in external datasets into PyRIT
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Originally posted by @divyaamin9825 in #429
Describe the solution you'd like
This dataset should be available within PyRIT: https://huggingface.co/datasets/McGill-NLP/stereoset
Associated paper: https://arxiv.org/abs/2004.09456
Additional context
There are examples of how PyRIT interacts with other datasets here: https://github.com/search?q=repo%3AAzure%2FPyRIT%20%23%20The%20dataset%20sources%20can%20be%20found%20at%3A&type=code
[[Content Warning: Prompts are aimed at provoking the model, and may contain offensive content.]]
Additional Disclaimer: Given the content of these prompts, keep in mind that you may want to check with your relevant legal department before trying them against LLMs.
The text was updated successfully, but these errors were encountered: