feat(prompts): integration with promptfoo #84
ci.yml
on: pull_request
Run linters
7m 5s
Matrix: Run tests
Annotations
2 errors and 4 warnings
test_prompt.test_to_promptfoo:
packages/ragbits-core/tests/unit/prompts/test_prompt.py#L217
assert [{'content': ...ole': 'user'}] == [{'content': ...ole': 'user'}]
Left contains 2 more items, first extra item: {'content': "It's a really catchy tune.", 'role': 'assistant'}
Full diff:
[
{
'content': 'You are a song generator for a adult named John.',
'role': 'system',
},
{
'content': 'Theme for the song is pop.',
'role': 'user',
},
+ {
+ 'content': "It's a really catchy tune.",
+ 'role': 'assistant',
+ },
+ {
+ 'content': 'I like it.',
+ 'role': 'user',
+ },
]
|
Run tests (3.10)
Process completed with exit code 1.
|
Run tests (3.10)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4, actions/cache@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "packages", "results", "test-report".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Run linters
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4, actions/cache@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run linters
No files were found with the provided path: report.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
packages
Expired
|
80.4 KB |
|
results
Expired
|
24.7 KB |
|
test-report
Expired
|
14.7 KB |
|