Skip to content
Playwright Test

Ops - Update Actions #19

Sign in to view logs

Ops - Update Actions

Ops - Update Actions #19

GitHub Actions / Playwright Test Report succeeded Aug 16, 2024 in 1s

22 passed, 4 failed and 2 skipped

Tests failed

❌ junit.xml

28 tests were completed in 16ms with 22 passed, 4 failed and 2 skipped.

Test suite Passed Failed Skipped Time
tests/accessibility/axe.spec.ts 2⚪ 0ms
tests/e2e/productSearch.spec.ts 1✅ 918ms
tests/e2e/productSearch.spec.ts 1✅ 2s
tests/pages/home.spec.ts 4✅ 2s
tests/pages/home.spec.ts 1✅ 8s
tests/pages/home.spec.ts 5✅ 8s
tests/pages/search.spec.ts 5✅ 12s
tests/pages/search.spec.ts 5✅ 14s
tests/visual/visual.spec.ts 1❌ 8s
tests/visual/visual.spec.ts 1❌ 12s
tests/visual/visual.spec.ts 2❌ 17s

✅ tests/accessibility/axe.spec.ts

⚪ Accessibility Scans › home page a11y
⚪ Accessibility Scans › search page a11y

✅ tests/e2e/productSearch.spec.ts

✅ product search › search for product

✅ tests/e2e/productSearch.spec.ts

✅ product search › search for product

✅ tests/pages/home.spec.ts

✅ home page › title is correct
✅ home page › product cards are visible
✅ home page › nav bar components are visible
✅ home page › footer components are visible

✅ tests/pages/home.spec.ts

✅ home page › has no broken links

✅ tests/pages/home.spec.ts

✅ home page › title is correct
✅ home page › product cards are visible
✅ home page › nav bar components are visible
✅ home page › footer components are visible
✅ home page › has no broken links

✅ tests/pages/search.spec.ts

✅ search page › title is correct
✅ search page › product cards are visible
✅ search page › nav bar components are visible
✅ search page › footer components are visible
✅ search page › has no broken links

✅ tests/pages/search.spec.ts

✅ search page › title is correct
✅ search page › product cards are visible
✅ search page › nav bar components are visible
✅ search page › footer components are visible
✅ search page › has no broken links

❌ tests/visual/visual.spec.ts

❌ home page visual-test › snapshot
	[chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────

❌ tests/visual/visual.spec.ts

❌ search page visual-test › snapshot
	[chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────

❌ tests/visual/visual.spec.ts

❌ home page visual-test › snapshot
	[firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────
❌ search page visual-test › snapshot
	[firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────

Annotations

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► home page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────
Raw output 
  [chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/86501406bd2e6cec21cbfdf917857d6530f55f2b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/9f85fd6b74b6910301cb7e058c75512d9fac4f1c.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/c6f4632b3d9c317d975ca4da3d0d09ade859c6cb.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/4bd728743e3aa8ad7040f640769778d14a7887ad.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/9e680fff50fbad4345ee4616c3f8216903320af2.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/9e680fff50fbad4345ee4616c3f8216903320af2.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry1/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry1/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/86501406bd2e6cec21cbfdf917857d6530f55f2b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/b8673110124d09a99c523ca8431fa76d6139d933.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/5d1a48238f211ae063e38f8e5561e7fa2819e53f.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/be531e6d4e336d60a52997540a3852f2efc182cb.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/6c50f0aaf2dd6638db2b7ca2e80820c2c6578af2.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/6c50f0aaf2dd6638db2b7ca2e80820c2c6578af2.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry2/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry2/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/86501406bd2e6cec21cbfdf917857d6530f55f2b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/c5b1cdf3cdd1369b35819d929296a01c47b16a73.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/a576d6e836010aa0e6ca16df2ad8f83835f86a3d.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/1b97a31a3487ce7dbbb58d370e417bfc89dd380b.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/e313d60d82e4dd6c980a484afee6db0cf1df2a30.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/e313d60d82e4dd6c980a484afee6db0cf1df2a30.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► search page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────
Raw output 
  [chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────

    Error: Screenshot comparison failed:

      30088 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 82863 pixels (ratio 0.03 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 52415 pixels (ratio 0.02 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30088 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/da2c790f382a817c788efe30b13a43313d33daa2.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/db257850b4f38fdd05930ce1c9331fcc02d6838b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/3f54aa036e4d2a90f1450711e3d32208080b9397.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/479191d6f6ac0ea3ea0258030c13caa630335528.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/9683f94907c298e00b54135bced656e74608e45b.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/9683f94907c298e00b54135bced656e74608e45b.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      30088 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry1/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry1/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 118552 pixels (ratio 0.04 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 88298 pixels (ratio 0.03 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30088 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/da2c790f382a817c788efe30b13a43313d33daa2.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/90e84df6f01336dc3c8262eb3300cb3f04c1d798.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/dc736d32ed084d694408c3cead276cf1a0f027fd.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/b2366f427359be797b7c926e5aff8476cc78166f.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/4a5a3a1175c09a9ac6f7f560469e7f874af73bc9.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/4a5a3a1175c09a9ac6f7f560469e7f874af73bc9.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      30089 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry2/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry2/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 30089 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30089 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/da2c790f382a817c788efe30b13a43313d33daa2.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/b060d201ec79bc203b6c532b0ed386671c1c4858.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/537eedfb829afa989cdfe337e2d60318cdaed4e8.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/5dc9bcc405bf410ab5ec20568d0a301b744cf525.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/4581069536b2c554397fdc6014d0fa7dc2ae3aef.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/4581069536b2c554397fdc6014d0fa7dc2ae3aef.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► home page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────
Raw output 
  [firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/897bc50acb3e6c632990930c3d5460d36e6990db.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/c73080f2c4e04b349253ff9153161e2601a22c6a.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/315d235257c254c0e51c74a1a53d22d1dccfc5bd.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/55d2d1655c8b9535a2ccf5952eae9b84fd80cf82.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/5b715f8641d5b3393a2ece85b065c606e55f3303.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/5b715f8641d5b3393a2ece85b065c606e55f3303.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry1/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry1/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/897bc50acb3e6c632990930c3d5460d36e6990db.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/6a9e0bc2d125154b1c31c0012bfe4101ba25bc92.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/eaf51a86cbda19745c4acb0689781b945dcc2cd6.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/1a4c7518ad91f3c9bdd792b58b524c930927d943.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/f6a8493f526e95872fb8a11ab799bc52b45ca8ec.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/f6a8493f526e95872fb8a11ab799bc52b45ca8ec.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry2/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry2/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/897bc50acb3e6c632990930c3d5460d36e6990db.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/e75bb64f95ba7fb164eaf0bb2fb4b828c7a14129.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/c648629177ac4c1b2b7f8fee8418488daed2f4d8.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/c96b8333d4917ffb95deee90834fa359bcee6b8a.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/655c8373b6e94aed6fb9441780412d7d1bef2de1.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/655c8373b6e94aed6fb9441780412d7d1bef2de1.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► search page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────
Raw output 
  [firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/7a2b46ecf9acb6f6871083de23a223fd8282ecc9.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/3541142814fd9f3f4cf8e965d1d0aaca65ae3d16.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/d49d186857318b7914953ca7ccdc2dddb7d42001.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/54abe884fe81226d824f38bc936e56d39fc6dc34.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/d25bcdcd1e776093dac461d2f88223708f2f6d7f.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/d25bcdcd1e776093dac461d2f88223708f2f6d7f.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry1/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry1/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/7a2b46ecf9acb6f6871083de23a223fd8282ecc9.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/10eaacd81368ea29fa13917c42e617aeef28f6dc.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/5917c6a6c3c663ab84f65a4c3644a8df77c109d5.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/9f705616b0a6a11f063e27858ce6a0bad0a114ed.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/59bc07e9284a3e6a21545b9666a61f0aab976670.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/59bc07e9284a3e6a21545b9666a61f0aab976670.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry2/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry2/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/7a2b46ecf9acb6f6871083de23a223fd8282ecc9.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/257af617c740fa8b88be09db85fa10aa50b66999.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/a367bea09b63fd763962ed8c8a778d8b986d1769.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/2320528fdefdc688bff9f8dc40b84c704fe9f3a6.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/9aac8fed77ad6ee70f62b97dd61003eceacbf633.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/9aac8fed77ad6ee70f62b97dd61003eceacbf633.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────
View more details on GitHub Actions