Skip to content

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…

8ae40e8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Test/fix e2e workflow #1148

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…
8ae40e8
Select commit
Loading
Failed to load commit list.
GitHub Actions / E2E Tests - generic failed May 19, 2026 in 1s

88 passed, 2 failed and 56 skipped

Tests failed

❌ tests/e2e/test-results/results.xml

146 tests were completed in 226s with 88 passed, 2 failed and 56 skipped.

Test suite Passed Failed Skipped Time
edit/edit_corner_cases.spec.ts 4✅ 1⚪ 39s
edit/edit_corner_cases.spec.ts 3✅ 2⚪ 36s
edit/edit_hand.spec.ts 2✅ 20s
edit/edit_hand.spec.ts 2✅ 21s
edit/edit_via_doble_click.spec.ts 2✅ 13s
edit/edit_via_doble_click.spec.ts 2✅ 14s
edit/edit_via_selection.spec.ts 4✅ 27s
edit/edit_via_selection.spec.ts 4✅ 30s
editor/copy_cut_drop.spec.ts 3✅ 27s
editor/copy_cut_drop.spec.ts 2✅ 1⚪ 19s
editor/editor.spec.ts 2✅ 2⚪ 16s
editor/editor.spec.ts 1✅ 3⚪ 9s
insert/insert_corner_cases.spec.ts 8✅ 62s
insert/insert_corner_cases.spec.ts 6✅ 2❌ 68s
insert/insert_hand.spec.ts 2✅ 11s
insert/insert_hand.spec.ts 2✅ 13s
insert/insert.spec.ts 5✅ 28s
insert/insert.spec.ts 5✅ 35s
latex/latex.spec.ts 4✅ 23s
latex/latex.spec.ts 4✅ 27s
modal/confirmation_dialog.spec.ts 6✅ 20s
modal/confirmation_dialog.spec.ts 6✅ 26s
modal/toolbar.spec.ts 4✅ 3⚪ 9s
modal/toolbar.spec.ts 4✅ 3⚪ 11s
telemetry/telemetry.spec.ts 1✅ 10s
telemetry/telemetry.spec.ts 1⚪ 711ms
track-changes/equations_changes.spec.ts 6⚪ 1s
track-changes/equations_changes.spec.ts 6⚪ 3s
track-changes/latex_changes.spec.ts 4⚪ 505ms
track-changes/latex_changes.spec.ts 4⚪ 2s
track-changes/toolbar_changes.spec.ts 10⚪ 1s
track-changes/toolbar_changes.spec.ts 10⚪ 4s

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - generic editor › MTHTML-81 Edit styled equation: generic editor
✅ Edit equation (corner cases) - generic editor › MTHTML-97 Validate formula edition on styled text blocks: generic editor
✅ Edit equation (corner cases) - generic editor › MTHTML-85 User edits a formula and continues typing text: generic editor
✅ Edit equation (corner cases) - generic editor › MTHTML-100 User edits a formula deleted during edition: generic editor
⚪ Edit equation (corner cases) - generic editor › MTHTML-9 User edits formula via contextual toolbar: generic editor

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - generic editor › MTHTML-81 Edit styled equation: generic editor
⚪ Edit equation (corner cases) - generic editor › MTHTML-97 Validate formula edition on styled text blocks: generic editor
✅ Edit equation (corner cases) - generic editor › MTHTML-85 User edits a formula and continues typing text: generic editor
✅ Edit equation (corner cases) - generic editor › MTHTML-100 User edits a formula deleted during edition: generic editor
⚪ Edit equation (corner cases) - generic editor › MTHTML-9 User edits formula via contextual toolbar: generic editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - generic editor › @smoke MTHTML-8 Edit Hand equation with MathType: generic editor
✅ Edit equation by hand - generic editor › @smoke MTHTML-8 Edit Hand equation with ChemType: generic editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - generic editor › @smoke MTHTML-8 Edit Hand equation with MathType: generic editor
✅ Edit equation by hand - generic editor › @smoke MTHTML-8 Edit Hand equation with ChemType: generic editor

✅ edit/edit_via_doble_click.spec.ts

✅ Edit equation via double click - generic editor › @smoke MTHTML-2 Edit Math equation: generic editor
✅ Edit equation via double click - generic editor › @smoke MTHTML-2 Edit Chemistry equation: generic editor

✅ edit/edit_via_doble_click.spec.ts

✅ Edit equation via double click - generic editor › @smoke MTHTML-2 Edit Math equation: generic editor
✅ Edit equation via double click - generic editor › @smoke MTHTML-2 Edit Chemistry equation: generic editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Math equation with MathType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Math equation with ChemType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: generic editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Math equation with MathType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Math equation with ChemType: generic editor
✅ Edit equation via selection - generic editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: generic editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-95 Copy-paste math formula with generic editor
✅ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-96 Cut-paste math formula with generic editor
✅ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-86 Drag-drop math formula with generic editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-95 Copy-paste math formula with generic editor
✅ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-96 Cut-paste math formula with generic editor
⚪ Copy/Cut/Paste/Drag&Drop - generic editor › MTHTML-86 Drag-drop math formula with generic editor

✅ editor/editor.spec.ts

✅ Editor functionality - generic editor › Undo and Redo › MTHTML-78 Undo and redo math formula with generic editor
⚪ Editor functionality - generic editor › Resize › MTHTML-22 Formulas cannot be resized generic editor
⚪ Editor functionality - generic editor › Source code › MTHTML-87 Edit source code of a math formula with generic editor
✅ Editor functionality - generic editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: generic editor

✅ editor/editor.spec.ts

✅ Editor functionality - generic editor › Undo and Redo › MTHTML-78 Undo and redo math formula with generic editor
⚪ Editor functionality - generic editor › Resize › MTHTML-22 Formulas cannot be resized generic editor
⚪ Editor functionality - generic editor › Source code › MTHTML-87 Edit source code of a math formula with generic editor
⚪ Editor functionality - generic editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: generic editor

✅ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-80 Insert styled equation: generic editor
✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-68 Insert equation with special characters: generic editor
✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: generic editor
✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-80 Insert styled equation: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-68 Insert equation with special characters: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor

❌ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-80 Insert styled equation: generic editor
✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-68 Insert equation with special characters: generic editor
✅ Insert equation (corner cases) - generic editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: generic editor
❌ Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor @generic @regression
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-80 Insert styled equation: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-68 Insert equation with special characters: generic editor
✅ Insert equation (corner cases) - generic editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: generic editor
❌ Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor @generic @regression

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - generic editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: generic editor
✅ Insert equation via Hand - generic editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: generic editor

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - generic editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: generic editor
✅ Insert equation via Hand - generic editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: generic editor

✅ insert/insert.spec.ts

✅ Insert equation - generic editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: generic editor
✅ Insert equation - generic editor - MathType › Insert equation with MathType using MathML: generic editor
✅ Insert equation - generic editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: generic editor
✅ Insert equation - generic editor - ChemType › Insert equation with ChemType using MathML: generic editor
✅ ALT Attribute - generic editor › MTHTML-19 Formula - ALT attribute: generic editor

✅ insert/insert.spec.ts

✅ Insert equation - generic editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: generic editor
✅ Insert equation - generic editor - MathType › Insert equation with MathType using MathML: generic editor
✅ Insert equation - generic editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: generic editor
✅ Insert equation - generic editor - ChemType › Insert equation with ChemType using MathML: generic editor
✅ ALT Attribute - generic editor › MTHTML-19 Formula - ALT attribute: generic editor

✅ latex/latex.spec.ts

✅ LaTeX - generic editor › Validate LaTeX formula detection: generic editor
✅ LaTeX - generic editor › Insert formula using LaTeX equation entry form: generic editor
✅ LaTeX - generic editor › @smoke MTHTML-10 Edit LaTeX equation: generic editor
✅ LaTeX - generic editor › Edit empty LaTeX equation: generic editor

✅ latex/latex.spec.ts

✅ LaTeX - generic editor › Validate LaTeX formula detection: generic editor
✅ LaTeX - generic editor › Insert formula using LaTeX equation entry form: generic editor
✅ LaTeX - generic editor › @smoke MTHTML-10 Edit LaTeX equation: generic editor
✅ LaTeX - generic editor › Edit empty LaTeX equation: generic editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - generic editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: generic editor
✅ Confirmation dialog - generic editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-29 Insert an equation after aborting the cancel: generic editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - generic editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: generic editor
✅ Confirmation dialog - generic editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: generic editor
✅ Confirmation dialog - generic editor › MTHTML-29 Insert an equation after aborting the cancel: generic editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - generic editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: generic editor
✅ Toolbar functions - generic editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: generic editor
✅ Toolbar functions - generic editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: generic editor
⚪ Toolbar functions - generic editor › When the modal is displayed and minimize button is clicked, modal is minimized: generic editor
⚪ Toolbar functions - generic editor › When the modal is minimized and user double clicks the banner, modal opens: generic editor
⚪ Toolbar functions - generic editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: generic editor
✅ Toolbar functions - generic editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: generic editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - generic editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: generic editor
✅ Toolbar functions - generic editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: generic editor
✅ Toolbar functions - generic editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: generic editor
⚪ Toolbar functions - generic editor › When the modal is displayed and minimize button is clicked, modal is minimized: generic editor
⚪ Toolbar functions - generic editor › When the modal is minimized and user double clicks the banner, modal opens: generic editor
⚪ Toolbar functions - generic editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: generic editor
✅ Toolbar functions - generic editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: generic editor

✅ telemetry/telemetry.spec.ts

✅ Telemetry › MTHTML-59 MathType all events testing: generic editor

✅ telemetry/telemetry.spec.ts

⚪ Telemetry › MTHTML-59 MathType all events testing: generic editor

✅ track-changes/equations_changes.spec.ts

⚪ Track Changes - generic editor › MTHTML-113 Insert equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-115 Delete equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-114 Edit equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-113 Insert equation - ChemType toolbar
⚪ Track Changes - generic editor › MTHTML-115 Delete equation - ChemType toolbar
⚪ Track Changes - generic editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/equations_changes.spec.ts

⚪ Track Changes - generic editor › MTHTML-113 Insert equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-115 Delete equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-114 Edit equation - MathType toolbar
⚪ Track Changes - generic editor › MTHTML-113 Insert equation - ChemType toolbar
⚪ Track Changes - generic editor › MTHTML-115 Delete equation - ChemType toolbar
⚪ Track Changes - generic editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

⚪ Track Changes Latex - generic editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

⚪ Track Changes Latex - generic editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
⚪ Track Changes Latex - generic editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

⚪ Track Changes Options - generic editor › MTHTML-117 Accept all suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-118 Discard all suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › Accept all selected suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › Discard all selected suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-116 Preview final result - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-117 Accept all suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › MTHTML-118 Discard all suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › Accept all selected suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › Discard all selected suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › MTHTML-116 Preview final result - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

⚪ Track Changes Options - generic editor › MTHTML-117 Accept all suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-118 Discard all suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › Accept all selected suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › Discard all selected suggestions - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-116 Preview final result - MathType toolbar
⚪ Track Changes Options - generic editor › MTHTML-117 Accept all suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › MTHTML-118 Discard all suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › Accept all selected suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › Discard all selected suggestions - ChemType toolbar
⚪ Track Changes Options - generic editor › MTHTML-116 Preview final result - ChemType toolbar

Annotations

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - generic

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor @generic @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - MathType › MTHTML-23 Validate formula alignment: generic editor @generic @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('#editable')
      Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-generic-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-generic-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-generic-MathType (image/png) ──────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-generic-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/alignment-generic-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/alignment-generic-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('#editable')
      Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-generic-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-generic-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-generic-MathType (image/png) ──────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-generic-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/alignment-generic-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/alignment-generic-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-eeb4e-la-alignment-generic-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - generic

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor @generic @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - generic editor - ChemType › MTHTML-23 Validate formula alignment: generic editor @generic @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('#editable')
      Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-generic-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-generic-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-generic-ChemType (image/png) ──────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-generic-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/alignment-generic-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/alignment-generic-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('#editable')
      Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-generic-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-generic-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('#editable')
        - locator resolved to <div id="editable" contenteditable="true">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - Expected an image 750px by 54px, received 750px by 50px. 176 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-generic-ChemType (image/png) ──────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-generic-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/alignment-generic-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/alignment-generic-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-7ad7e-la-alignment-generic-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────