Skip to content
Playwright Test

Ops - Update Actions #16

Sign in to view logs

Ops - Update Actions

Ops - Update Actions #16

GitHub Actions / Playwright Test Report succeeded Aug 16, 2024 in 0s

22 passed, 4 failed and 2 skipped

Tests failed

❌ junit.xml

28 tests were completed in 18ms with 22 passed, 4 failed and 2 skipped.

Test suite Passed Failed Skipped Time
tests/accessibility/axe.spec.ts 2⚪ 0ms
tests/e2e/productSearch.spec.ts 1✅ 1s
tests/e2e/productSearch.spec.ts 1✅ 2s
tests/pages/home.spec.ts 4✅ 2s
tests/pages/home.spec.ts 1✅ 7s
tests/pages/home.spec.ts 5✅ 10s
tests/pages/search.spec.ts 5✅ 14s
tests/pages/search.spec.ts 5✅ 18s
tests/visual/visual.spec.ts 1❌ 8s
tests/visual/visual.spec.ts 1❌ 13s
tests/visual/visual.spec.ts 2❌ 18s

✅ tests/accessibility/axe.spec.ts

⚪ Accessibility Scans › home page a11y
⚪ Accessibility Scans › search page a11y

✅ tests/e2e/productSearch.spec.ts

✅ product search › search for product

✅ tests/e2e/productSearch.spec.ts

✅ product search › search for product

✅ tests/pages/home.spec.ts

✅ home page › title is correct
✅ home page › product cards are visible
✅ home page › nav bar components are visible
✅ home page › footer components are visible

✅ tests/pages/home.spec.ts

✅ home page › has no broken links

✅ tests/pages/home.spec.ts

✅ home page › title is correct
✅ home page › product cards are visible
✅ home page › nav bar components are visible
✅ home page › footer components are visible
✅ home page › has no broken links

✅ tests/pages/search.spec.ts

✅ search page › title is correct
✅ search page › product cards are visible
✅ search page › nav bar components are visible
✅ search page › footer components are visible
✅ search page › has no broken links

✅ tests/pages/search.spec.ts

✅ search page › title is correct
✅ search page › product cards are visible
✅ search page › nav bar components are visible
✅ search page › footer components are visible
✅ search page › has no broken links

❌ tests/visual/visual.spec.ts

❌ home page visual-test › snapshot
	[chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────

❌ tests/visual/visual.spec.ts

❌ search page visual-test › snapshot
	[chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────

❌ tests/visual/visual.spec.ts

❌ home page visual-test › snapshot
	[firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────
❌ search page visual-test › snapshot
	[firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────

Annotations

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► home page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────
Raw output 
  [chromium] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ─────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/cf1590fda28715a723681da6117e0f9ce8e30bba.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/0ca6f2db288c26bc281bdb40fea9e2c489147dbf.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/fb452fa0866f623b7be141805c09fc93b4cac161.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/7a1bd2b1957fd3d42eec162a4bd8b1517a3bee6f.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/e60d4c6d8740101a2a05d5b4d83ea6640f5f628f.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/e60d4c6d8740101a2a05d5b4d83ea6640f5f628f.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry1/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry1/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/cf1590fda28715a723681da6117e0f9ce8e30bba.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/cee7113b2596686e71a593d9f8dd575d47cb6352.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/f6861743b355c6a0a4e718a796fea82a55eea578.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/e8b4c3727630766992c5983ce3a20e1d5c275bca.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/3f33c7e20d2fe15360138c38d1234ff65596f90c.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/3f33c7e20d2fe15360138c38d1234ff65596f90c.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry2/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-chromium-retry2/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 280090 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/cf1590fda28715a723681da6117e0f9ce8e30bba.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/c9a9b11f785d24c04edb77096c7587a4cff9e065.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/c58d59e0c6c23f67a9992715786cba0f7bd62042.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/3d2a3124f8b573a72716909e65263d116c0abbce.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/0537759fb777b856193e8c6b2e70e55d590322fd.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/0537759fb777b856193e8c6b2e70e55d590322fd.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► search page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────
Raw output 
  [chromium] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ───────────────

    Error: Screenshot comparison failed:

      30088 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 82863 pixels (ratio 0.03 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 52415 pixels (ratio 0.02 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30088 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/410422f4aa31985bf349d35ca2b60ba7b437db4a.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/db13097c5979212a34e8067ed4e12f78b7d4081f.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/27f0ed56684d9cd398c1e42ecb64856f3302a6c2.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/c60c8458b6ca44f752fbe3d3ecd969193195ac91.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/ba164a3e65a5ef02975808efc275c87608354937.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/ba164a3e65a5ef02975808efc275c87608354937.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      30088 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry1/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry1/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 82863 pixels (ratio 0.03 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 52415 pixels (ratio 0.02 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30088 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/410422f4aa31985bf349d35ca2b60ba7b437db4a.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/950c615c88ecefde8baff292d59b124ede1ed6ea.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/5a2fe7618d224dad768742885311b587e1ece33d.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/67563ec6f61c7fec440041999523c7971b76eb8a.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/46e4f5dab61c62a2812a7c5d0b5aac9de52c545f.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/46e4f5dab61c62a2812a7c5d0b5aac9de52c545f.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      30088 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-chromium-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry2/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-chromium-retry2/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 259303 pixels (ratio 0.09 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 228713 pixels (ratio 0.08 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 30088 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/410422f4aa31985bf349d35ca2b60ba7b437db4a.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/bd2280094f2d3c04544b7e59140fb676810731b4.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/d3d404cdff9a5cf9ee130996737bf1e69a47334b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/a4f45868f7e524be1d0a81721f6023841d4a9319.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/e23ab67bb65cfa73156bb9625303f3bdc8e7616e.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/e23ab67bb65cfa73156bb9625303f3bdc8e7616e.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► home page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────
Raw output 
  [firefox] › tests/visual/visual.spec.ts:10:7 › home page visual-test › snapshot ──────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/fb238d08e08bcbd8cc208809d3eb3210f1aef53c.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/0c7e48262f5f7e18a58d48c7fc123a6081d07f20.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/00dc74ab787c04c8b7de46e6cee1e878953d8259.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/d9527e7e9c07af51874cd9ca94195627cb679c13.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/7e142b64e27f6f9051fd8724bfada36e8bef2905.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/7e142b64e27f6f9051fd8724bfada36e8bef2905.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry1/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry1/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/fb238d08e08bcbd8cc208809d3eb3210f1aef53c.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/48d247e48da0274c38bf42383d8a1d446526d142.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/990945a1a3d6bcb450b36e403fb55e38666fa8d8.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/51c31eced26ab95e71eb52c405da5815c6032537.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/624efd37bdd0ea9acddb6d800eca3e354bb063f7.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/624efd37bdd0ea9acddb6d800eca3e354bb063f7.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/home-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry2/home-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-home-page-visual-test-snapshot-firefox-retry2/home-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - Expected an image 1280px by 1545px, received 1280px by 1222px. 290404 pixels (ratio 0.15 of all image pixels) are different.


       9 |
      10 |   test("snapshot", async ({ homePage }) => {
    > 11 |     await expect(homePage.page).toHaveScreenshot({ fullPage: true });
         |                                 ^
      12 |   });
      13 | });
      14 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:11:33

    attachment #1: home-page-visual-test-snapshot-1-expected.png (image/png) ───────────────────────
    all-blob-reports/resources/fb238d08e08bcbd8cc208809d3eb3210f1aef53c.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: home-page-visual-test-snapshot-1-actual.png (image/png) ─────────────────────────
    all-blob-reports/resources/8b4b3d73e4d4505f772f55b7727ca43a189d72b7.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: home-page-visual-test-snapshot-1-diff.png (image/png) ───────────────────────────
    all-blob-reports/resources/8228a8c095ad13b3e49036fa516f0a3ca74f4207.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/f21af97643180c8de5f53586674dde7863520bf3.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/e8c7a31ab7ae710a1b8c9ce8f7c983c606fe118f.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/e8c7a31ab7ae710a1b8c9ce8f7c983c606fe118f.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in junit.xml

See this annotation in the file changed.

@github-actions github-actions / Playwright Test Report

tests/visual/visual.spec.ts ► search page visual-test › snapshot 

Failed test found in:
  junit.xml
Error:
    [firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────
Raw output 
  [firefox] › tests/visual/visual.spec.ts:20:7 › search page visual-test › snapshot ────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/2712edfe79f62e74fc65326d809ed4f67b1876fb.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/0668d4fb9c7af50f1f50288872cd920e07f9da11.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/0d39cd3bd6af4a202529ded982b32dab61ded9dc.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/a56f89c55d91c428d22118c98a62b892e358fca8.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/32a394c5530482608aa091bd328c1aa60f8fbf7c.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/32a394c5530482608aa091bd328c1aa60f8fbf7c.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry1/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry1/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/2712edfe79f62e74fc65326d809ed4f67b1876fb.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/72accc883026cdbf05018683a25294ac845a1d1b.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/034375178fd2d433a4caeeb6d5abbfad5d09c8af.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/2103d93dbdf84fb0dd7d5f24862b56c6d6178db1.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/bd4fcb73efa6b2b5fb0061ee5dc643ebfbacfe86.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/bd4fcb73efa6b2b5fb0061ee5dc643ebfbacfe86.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: Screenshot comparison failed:

      12652 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts-snapshots/search-page-visual-test-snapshot-1-firefox-linux.png
    Received: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry2/search-page-visual-test-snapshot-1-actual.png
        Diff: /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/test-results/tests-visual-visual-search-page-visual-test-snapshot-firefox-retry2/search-page-visual-test-snapshot-1-diff.png

    Call log:
      - page._expectScreenshot with timeout 5000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 12652 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
      -   disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 12652 pixels (ratio 0.01 of all image pixels) are different.


      19 |
      20 |   test("snapshot", async ({ searchPage }) => {
    > 21 |     await expect(searchPage.page).toHaveScreenshot({ fullPage: true });
         |                                   ^
      22 |   });
      23 | });
      24 |

        at /__w/playwright-boilerplate-using-package/playwright-boilerplate-using-package/tests/visual/visual.spec.ts:21:35

    attachment #1: search-page-visual-test-snapshot-1-expected.png (image/png) ─────────────────────
    all-blob-reports/resources/2712edfe79f62e74fc65326d809ed4f67b1876fb.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: search-page-visual-test-snapshot-1-actual.png (image/png) ───────────────────────
    all-blob-reports/resources/e3e78b319885cf6d92ff0fff13fc481a063a4482.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: search-page-visual-test-snapshot-1-diff.png (image/png) ─────────────────────────
    all-blob-reports/resources/31fc733f2e302993104e157b6ad4958c0d144e45.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: video (video/webm) ──────────────────────────────────────────────────────────────
    all-blob-reports/resources/358d12e5483feb9c9e3f5a243da0c1f7e86071e5.webm
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #5: trace (application/zip) ─────────────────────────────────────────────────────────
    all-blob-reports/resources/512c06dfc5dc520af7227e601fa3384a9d2f938b.zip
    Usage:

        npx playwright show-trace all-blob-reports/resources/512c06dfc5dc520af7227e601fa3384a9d2f938b.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────
View more details on GitHub Actions