fix: one more try to get the visual regression files #71
dnotesAnnotations
11 errors and 1 warning
|
test
The path for one of the files in artifact is not valid: /packages/playwright/screenshots/Feature: Basic tests of Playwright browser and steps_Passing visual regression test_02.png.actual.png. Contains the following character: Colon :
Invalid characters include: Double quote ", Colon :, Less than <, Greater than >, Vertical bar |, Asterisk *, Question mark ?, Carriage return \r, Line feed \n
The following characters are not allowed in files that are uploaded due to limitations with certain file systems such as NTFS. To maintain file system agnostic behavior, these characters are intentionally not allowed to prevent potential problems with downloads on different file systems.
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size mobile (@concurrent @mobile):
packages/playwright/tests/playwright-actions-html.feature#L210
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-mobile" should match (#210)
Screenshot does not match the snapshot.
Diff percentage: 0.65%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:210:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.65%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size tablet (@concurrent @tablet):
packages/playwright/tests/playwright-actions-html.feature#L215
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-tablet" should match (#215)
Screenshot does not match the snapshot.
Diff percentage: 0.26%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:215:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.26%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size desktop (@concurrent @desktop):
packages/playwright/tests/playwright-actions-html.feature#L219
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-desktop" should match (#219)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:219:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size widescreen (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L223
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-widescreen" should match (#223)
Screenshot does not match the snapshot.
Diff percentage: 0.04%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:223:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.04%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size custom 200x800 (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L227
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-200x800" should match (#227)
Screenshot does not match the snapshot.
Diff percentage: 1.23%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:227:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 1.23%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size custom 500x800 (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L231
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-500x800" should match (#231)
Screenshot does not match the snapshot.
Diff percentage: 0.51%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-500x800.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:231:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.51%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-500x800.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing visual regression test (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L46
Error: Scenario finished with 1 errors:
the screenshot should match (#46)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/Feature: Basic tests of Playwright browser and steps_Passing visual regression test_02.png.(diff|actual).png
❯ tests/playwright.feature:46:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/Feature: Basic tests of Playwright browser and steps_Passing visual regression test_02.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing named visual regression test (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L50
Error: Scenario finished with 1 errors:
the screenshot "visual-regression-simple-page" should match (#50)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/visual-regression-simple-page.png.(diff|actual).png
❯ tests/playwright.feature:50:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/visual-regression-simple-page.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing named visual regression test of an element (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L58
Error: Scenario finished with 1 errors:
the screenshot "visual-regression-faq-section" of the "#faq" element should match (#58)
Failed to compare screenshots: Image sizes do not match.
❯ tests/playwright.feature:58:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Failed to compare screenshots: Image sizes do not match.' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Scenario: Delete the visual regression failure file (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L68
Error: the screenshot "visual-regression-simple-page.png.diff.png" should not exist (#68)
expect(received).toBeFalsy()
Received: true
❯ tests/playwright.feature:68:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { message: 'expect(received).toBeFalsy()\n\nReceived: true', pass: false }, isStepError: true }
|
|
test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|