Skip to content

feat(prompts): integration with promptfoo #84

feat(prompts): integration with promptfoo

feat(prompts): integration with promptfoo #84

Triggered via pull request October 2, 2024 11:20
Status Failure
Total duration 7m 14s
Billable time 10m
Artifacts 3

ci.yml

on: pull_request
Matrix: Run tests
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 4 warnings
test_prompt.test_to_promptfoo: packages/ragbits-core/tests/unit/prompts/test_prompt.py#L217
assert [{'content': ...ole': 'user'}] == [{'content': ...ole': 'user'}] Left contains 2 more items, first extra item: {'content': "It's a really catchy tune.", 'role': 'assistant'} Full diff: [ { 'content': 'You are a song generator for a adult named John.', 'role': 'system', }, { 'content': 'Theme for the song is pop.', 'role': 'user', }, + { + 'content': "It's a really catchy tune.", + 'role': 'assistant', + }, + { + 'content': 'I like it.', + 'role': 'user', + }, ]
Run tests (3.10)
Process completed with exit code 1.
Run tests (3.10)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4, actions/cache@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "packages", "results", "test-report". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
Run linters
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4, actions/cache@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run linters
No files were found with the provided path: report.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
packages Expired
80.4 KB
results Expired
24.7 KB
test-report Expired
14.7 KB