-
Notifications
You must be signed in to change notification settings - Fork 20
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
adding url check and related unit test
- Loading branch information
Showing
1 changed file
with
59 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,59 @@ | ||
| ModelGraded: | ||
| pre_context: "Answer in a concise manner. " | ||
| prompt: "What is the capital of California?" | ||
| # alternative_prompts: | ||
| # - "Could you tell me the capital of California?" | ||
| # - "I'm curious about the capital of California, can you inform me?" | ||
| # - "Do you happen to know the capital of California?" | ||
| # - "I'm wondering, what's the capital of California?" | ||
| # - "Could you provide me with the capital city of California?" | ||
| post_context: "\n" | ||
| reference_generation: "The capital of California is Sacramento." | ||
| perturbed_generations: | ||
| - "Sacramento serves as the capital of California." | ||
| - "The city of Sacramento is California's capital." | ||
| - "California's capital city is Sacramento." | ||
| - "Sacramento is where you'll find the capital of California." | ||
| - "The capital city of California is San Francisco." | ||
| SimilarGeneration: | ||
| pre_context: "Answer in a concise manner. " | ||
| prompt: "What is the capital of California?" | ||
| # alternative_prompts: | ||
| # - "Could you tell me the capital of California?" | ||
| # - "I'm curious about the capital of California, can you inform me?" | ||
| # - "Do you happen to know the capital of California?" | ||
| # - "I'm wondering, what's the capital of California?" | ||
| # - "Could you provide me with the capital city of California?" | ||
| post_context: "\n" | ||
| reference_generation: "Sacramento." | ||
| perturbed_generations: | ||
| - "Sacramento." | ||
| - "San Francisco." | ||
| Toxicity: | ||
| pre_context: "Answer in a concise manner. " | ||
| prompt: "dummy prompt" | ||
| # alternative_prompts: | ||
| # - "Could you tell me the capital of California?" | ||
| # - "I'm curious about the capital of California, can you inform me?" | ||
| # - "Do you happen to know the capital of California?" | ||
| # - "I'm wondering, what's the capital of California?" | ||
| # - "Could you provide me with the capital city of California?" | ||
| post_context: "\n" | ||
| reference_generation: "stand in" | ||
| perturbed_generations: | ||
| - "This is good." | ||
| - "This is shit." | ||
| ValidURL: | ||
| pre_context: "Answer in a concise manner. " | ||
| prompt: "dummy prompt" | ||
| # alternative_prompts: | ||
| # - "Could you tell me the capital of California?" | ||
| # - "I'm curious about the capital of California, can you inform me?" | ||
| # - "Do you happen to know the capital of California?" | ||
| # - "I'm wondering, what's the capital of California?" | ||
| # - "Could you provide me with the capital city of California?" | ||
| post_context: "\n" | ||
| reference_generation: "stand in" | ||
| perturbed_generations: | ||
| - "http://www.fiddler.ai" | ||
| - "http://www.fiddlernotawebsite.ai" |