chore: update tests to skip ci for webkit/firefox #68
dnotesAnnotations
10 errors and 1 warning
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size mobile (@concurrent @mobile):
packages/playwright/tests/playwright-actions-html.feature#L210
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-mobile" should match (#210)
Screenshot does not match the snapshot.
Diff percentage: 0.65%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:210:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.65%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size tablet (@concurrent @tablet):
packages/playwright/tests/playwright-actions-html.feature#L215
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-tablet" should match (#215)
Screenshot does not match the snapshot.
Diff percentage: 0.26%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:215:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.26%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size desktop (@concurrent @desktop):
packages/playwright/tests/playwright-actions-html.feature#L219
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-desktop" should match (#219)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:219:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size widescreen (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L223
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-widescreen" should match (#223)
Screenshot does not match the snapshot.
Diff percentage: 0.04%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:223:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.04%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size custom 200x800 (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L227
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-200x800" should match (#227)
Screenshot does not match the snapshot.
Diff percentage: 1.23%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:227:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 1.23%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size custom 500x800 (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L231
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-500x800" should match (#231)
Screenshot does not match the snapshot.
Diff percentage: 0.51%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-500x800.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:231:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.51%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-500x800.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing visual regression test (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L46
Error: Scenario finished with 1 errors:
the screenshot should match (#46)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/Feature: Basic tests of Playwright browser and steps_Passing visual regression test_02.png.(diff|actual).png
❯ tests/playwright.feature:46:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/Feature: Basic tests of Playwright browser and steps_Passing visual regression test_02.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing named visual regression test (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L50
Error: Scenario finished with 1 errors:
the screenshot "visual-regression-simple-page" should match (#50)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/visual-regression-simple-page.png.(diff|actual).png
❯ tests/playwright.feature:50:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/visual-regression-simple-page.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Example: Passing named visual regression test of an element (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L58
Error: Scenario finished with 1 errors:
the screenshot "visual-regression-faq-section" of the "#faq" element should match (#58)
Failed to compare screenshots: Image sizes do not match.
❯ tests/playwright.feature:58:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Failed to compare screenshots: Image sizes do not match.' }, isStepError: true }
|
|
tests/playwright.feature > Feature: Basic tests of Playwright browser and steps > Rule: Visual regression testing must be supported > Scenario: Delete the visual regression failure file (@concurrent @sequential):
packages/playwright/tests/playwright.feature#L68
Error: the screenshot "visual-regression-simple-page.png.diff.png" should not exist (#68)
expect(received).toBeFalsy()
Received: true
❯ tests/playwright.feature:68:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { message: 'expect(received).toBeFalsy()\n\nReceived: true', pass: false }, isStepError: true }
|
|
test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|