chore: add test running for pull requests #67
dnotesAnnotations
10 errors and 1 warning
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Screenshots must be supported > Scenario: Taking a screenshot with lots of exploded tags (@concurrent @slowmo @sequential @nojs @webkit @mobile):
packages/playwright/src/PlaywrightWorld.ts#L130
Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/webkit-2104/pw_run.sh
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ pnpm exec playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❯ PlaywrightWorld.startBrowser src/PlaywrightWorld.ts:130:53
❯ PlaywrightWorld.init src/PlaywrightWorld.ts:73:16
❯ initScenario tests/playwright-actions-html.feature:30:15
❯ initRuleScenario tests/playwright-actions-html.feature:351:25
❯ tests/playwright-actions-html.feature:387:25
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Screenshots must be supported > Scenario: Taking a screenshot with lots of exploded tags (@concurrent @slowmo @sequential @nojs @webkit @desktop):
packages/playwright/src/PlaywrightWorld.ts#L130
Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/webkit-2104/pw_run.sh
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ pnpm exec playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❯ PlaywrightWorld.startBrowser src/PlaywrightWorld.ts:130:53
❯ PlaywrightWorld.init src/PlaywrightWorld.ts:73:16
❯ initScenario tests/playwright-actions-html.feature:30:15
❯ initRuleScenario tests/playwright-actions-html.feature:351:25
❯ tests/playwright-actions-html.feature:395:25
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Screenshots must be supported > Scenario: Taking a screenshot with lots of exploded tags (@concurrent @slowmo @sequential @js @webkit @mobile):
packages/playwright/src/PlaywrightWorld.ts#L130
Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/webkit-2104/pw_run.sh
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ pnpm exec playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❯ PlaywrightWorld.startBrowser src/PlaywrightWorld.ts:130:53
❯ PlaywrightWorld.init src/PlaywrightWorld.ts:73:16
❯ initScenario tests/playwright-actions-html.feature:30:15
❯ initRuleScenario tests/playwright-actions-html.feature:351:25
❯ tests/playwright-actions-html.feature:403:25
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Screenshots must be supported > Scenario: Taking a screenshot with lots of exploded tags (@concurrent @slowmo @sequential @js @webkit @desktop):
packages/playwright/src/PlaywrightWorld.ts#L130
Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/webkit-2104/pw_run.sh
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ pnpm exec playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❯ PlaywrightWorld.startBrowser src/PlaywrightWorld.ts:130:53
❯ PlaywrightWorld.init src/PlaywrightWorld.ts:73:16
❯ initScenario tests/playwright-actions-html.feature:30:15
❯ initRuleScenario tests/playwright-actions-html.feature:351:25
❯ tests/playwright-actions-html.feature:411:25
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Screenshots must be supported > Scenario: Cleaning up the screenshots with exploded tags (@concurrent @sequential):
packages/playwright/tests/playwright-actions-html.feature#L195
Error: the screenshot "temp_(@Concurrent,@slowmo,@Sequential,@nojs,@WebKit,@mobile).png" should exist--delete it (#195)
expect(received).toBeTruthy()
Received: false
❯ tests/playwright-actions-html.feature:195:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { message: 'expect(received).toBeTruthy()\n\nReceived: false', pass: false }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size mobile (@concurrent @mobile):
packages/playwright/tests/playwright-actions-html.feature#L207
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-mobile" should match (#207)
Screenshot does not match the snapshot.
Diff percentage: 0.65%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:207:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.65%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-mobile.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size tablet (@concurrent @tablet):
packages/playwright/tests/playwright-actions-html.feature#L212
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-tablet" should match (#212)
Screenshot does not match the snapshot.
Diff percentage: 0.26%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:212:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.26%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-tablet.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size desktop (@concurrent @desktop):
packages/playwright/tests/playwright-actions-html.feature#L216
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-desktop" should match (#216)
Screenshot does not match the snapshot.
Diff percentage: 0.10%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:216:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.10%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-desktop.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size widescreen (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L220
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-widescreen" should match (#220)
Screenshot does not match the snapshot.
Diff percentage: 0.04%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:220:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 0.04%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-widescreen.png.(diff|actual).png' }, isStepError: true }
|
|
tests/playwright-actions-html.feature > Feature: Actions step definitions on a static page > Rule: Different browser sizes must be supported > Scenario: viewport size custom 200x800 (@concurrent):
packages/playwright/tests/playwright-actions-html.feature#L224
Error: Scenario finished with 1 errors:
the screenshot "viewport-size-200x800" should match (#224)
Screenshot does not match the snapshot.
Diff percentage: 1.23%
Diff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png
❯ tests/playwright-actions-html.feature:224:1
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { matcherResult: { pass: false, message: 'Screenshot does not match the snapshot.\nDiff percentage: 1.23%\nDiff image saved at: /home/runner/work/quickpickle/quickpickle/packages/playwright/screenshots/viewport-size-200x800.png.(diff|actual).png' }, isStepError: true }
|
|
test
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|