Skip to content

feat(tests): add tests for models and options and api #1111

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Apr 23, 2025

Conversation

Pouyanpi
Copy link
Collaborator

Description

Add more tests that might help reviewing #967

@Pouyanpi Pouyanpi requested review from tgasser-nv and Copilot April 11, 2025 14:10
Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

@Pouyanpi Pouyanpi self-assigned this Apr 11, 2025
@Pouyanpi Pouyanpi added this to the v0.14.0 milestone Apr 11, 2025
Copy link
Collaborator

@tgasser-nv tgasser-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! I think we need tests against the NeMoLLM, TaskPrompt, and FiddlerGuardrails BaseModel-inherited classes too. Could you add one valid and one invalid per model, to check the validation is working correctly?

@Pouyanpi
Copy link
Collaborator Author

Pouyanpi commented Apr 22, 2025

Thank you @tgasser-nv for the review. NeMoLLM is deprecated (just did the rebase so that it is clear), FiddlerGuardrails is not affected by the migration PR and is a community integration. I've opened a separate PR (#1132) for TaskPrompt as I had to implement some fixes.

Copy link
Collaborator

@tgasser-nv tgasser-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just a typo nit and please merge :-)

- Add test for multiple interactions with same policy
- Add test for multiple policies in single interaction
- Add test for duplicate policy IDs (currently allowed)
- Document missing validations for future improvement
@Pouyanpi Pouyanpi force-pushed the test/add-missing-tests branch from 89f0597 to f191dc1 Compare April 23, 2025 07:26
@Pouyanpi Pouyanpi merged commit 2a4f576 into develop Apr 23, 2025
10 checks passed
@Pouyanpi Pouyanpi deleted the test/add-missing-tests branch April 23, 2025 07:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants