Skip to content

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…

8ae40e8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Test/fix e2e workflow #1148

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…
8ae40e8
Select commit
Loading
Failed to load commit list.
GitHub Actions / E2E Tests - froala failed May 19, 2026 in 1s

91 passed, 2 failed and 53 skipped

Tests failed

❌ tests/e2e/test-results/results.xml

146 tests were completed in 237s with 91 passed, 2 failed and 53 skipped.

Test suite Passed Failed Skipped Time
edit/edit_corner_cases.spec.ts 5✅ 51s
edit/edit_corner_cases.spec.ts 5✅ 57s
edit/edit_hand.spec.ts 2✅ 21s
edit/edit_hand.spec.ts 2✅ 22s
edit/edit_via_doble_click.spec.ts 2⚪ 0ms
edit/edit_via_doble_click.spec.ts 2⚪ 0ms
edit/edit_via_selection.spec.ts 4✅ 29s
edit/edit_via_selection.spec.ts 4✅ 31s
editor/copy_cut_drop.spec.ts 3✅ 28s
editor/copy_cut_drop.spec.ts 3✅ 30s
editor/editor.spec.ts 3✅ 1⚪ 28s
editor/editor.spec.ts 3✅ 1⚪ 29s
insert/insert_corner_cases.spec.ts 8✅ 42s
insert/insert_corner_cases.spec.ts 6✅ 2❌ 64s
insert/insert_hand.spec.ts 2✅ 11s
insert/insert_hand.spec.ts 2✅ 14s
insert/insert.spec.ts 5✅ 31s
insert/insert.spec.ts 5✅ 36s
latex/latex.spec.ts 4✅ 25s
latex/latex.spec.ts 4✅ 26s
modal/confirmation_dialog.spec.ts 6✅ 23s
modal/confirmation_dialog.spec.ts 6✅ 26s
modal/toolbar.spec.ts 4✅ 3⚪ 11s
modal/toolbar.spec.ts 4✅ 3⚪ 11s
telemetry/telemetry.spec.ts 1✅ 11s
telemetry/telemetry.spec.ts 1⚪ 409ms
track-changes/equations_changes.spec.ts 6⚪ 1s
track-changes/equations_changes.spec.ts 6⚪ 3s
track-changes/latex_changes.spec.ts 4⚪ 706ms
track-changes/latex_changes.spec.ts 4⚪ 2s
track-changes/toolbar_changes.spec.ts 10⚪ 2s
track-changes/toolbar_changes.spec.ts 10⚪ 4s

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - froala editor › MTHTML-81 Edit styled equation: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-97 Validate formula edition on styled text blocks: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-85 User edits a formula and continues typing text: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-100 User edits a formula deleted during edition: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-9 User edits formula via contextual toolbar: froala editor

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - froala editor › MTHTML-81 Edit styled equation: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-97 Validate formula edition on styled text blocks: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-85 User edits a formula and continues typing text: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-100 User edits a formula deleted during edition: froala editor
✅ Edit equation (corner cases) - froala editor › MTHTML-9 User edits formula via contextual toolbar: froala editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - froala editor › @smoke MTHTML-8 Edit Hand equation with MathType: froala editor
✅ Edit equation by hand - froala editor › @smoke MTHTML-8 Edit Hand equation with ChemType: froala editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - froala editor › @smoke MTHTML-8 Edit Hand equation with MathType: froala editor
✅ Edit equation by hand - froala editor › @smoke MTHTML-8 Edit Hand equation with ChemType: froala editor

✅ edit/edit_via_doble_click.spec.ts

⚪ Edit equation via double click - froala editor › @smoke MTHTML-2 Edit Math equation: froala editor
⚪ Edit equation via double click - froala editor › @smoke MTHTML-2 Edit Chemistry equation: froala editor

✅ edit/edit_via_doble_click.spec.ts

⚪ Edit equation via double click - froala editor › @smoke MTHTML-2 Edit Math equation: froala editor
⚪ Edit equation via double click - froala editor › @smoke MTHTML-2 Edit Chemistry equation: froala editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Math equation with MathType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Math equation with ChemType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: froala editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Math equation with MathType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Math equation with ChemType: froala editor
✅ Edit equation via selection - froala editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: froala editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-95 Copy-paste math formula with froala editor
✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-96 Cut-paste math formula with froala editor
✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-86 Drag-drop math formula with froala editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-95 Copy-paste math formula with froala editor
✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-96 Cut-paste math formula with froala editor
✅ Copy/Cut/Paste/Drag&Drop - froala editor › MTHTML-86 Drag-drop math formula with froala editor

✅ editor/editor.spec.ts

✅ Editor functionality - froala editor › Undo and Redo › MTHTML-78 Undo and redo math formula with froala editor
✅ Editor functionality - froala editor › Resize › MTHTML-22 Formulas cannot be resized froala editor
⚪ Editor functionality - froala editor › Source code › MTHTML-87 Edit source code of a math formula with froala editor
✅ Editor functionality - froala editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: froala editor

✅ editor/editor.spec.ts

✅ Editor functionality - froala editor › Undo and Redo › MTHTML-78 Undo and redo math formula with froala editor
✅ Editor functionality - froala editor › Resize › MTHTML-22 Formulas cannot be resized froala editor
⚪ Editor functionality - froala editor › Source code › MTHTML-87 Edit source code of a math formula with froala editor
✅ Editor functionality - froala editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: froala editor

✅ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-80 Insert styled equation: froala editor
✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-68 Insert equation with special characters: froala editor
✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: froala editor
✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-80 Insert styled equation: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-68 Insert equation with special characters: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor

❌ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-80 Insert styled equation: froala editor
✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-68 Insert equation with special characters: froala editor
✅ Insert equation (corner cases) - froala editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: froala editor
❌ Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor @froala @regression
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-80 Insert styled equation: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-68 Insert equation with special characters: froala editor
✅ Insert equation (corner cases) - froala editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: froala editor
❌ Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor @froala @regression

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - froala editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: froala editor
✅ Insert equation via Hand - froala editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: froala editor

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - froala editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: froala editor
✅ Insert equation via Hand - froala editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: froala editor

✅ insert/insert.spec.ts

✅ Insert equation - froala editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: froala editor
✅ Insert equation - froala editor - MathType › Insert equation with MathType using MathML: froala editor
✅ Insert equation - froala editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: froala editor
✅ Insert equation - froala editor - ChemType › Insert equation with ChemType using MathML: froala editor
✅ ALT Attribute - froala editor › MTHTML-19 Formula - ALT attribute: froala editor

✅ insert/insert.spec.ts

✅ Insert equation - froala editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: froala editor
✅ Insert equation - froala editor - MathType › Insert equation with MathType using MathML: froala editor
✅ Insert equation - froala editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: froala editor
✅ Insert equation - froala editor - ChemType › Insert equation with ChemType using MathML: froala editor
✅ ALT Attribute - froala editor › MTHTML-19 Formula - ALT attribute: froala editor

✅ latex/latex.spec.ts

✅ LaTeX - froala editor › Validate LaTeX formula detection: froala editor
✅ LaTeX - froala editor › Insert formula using LaTeX equation entry form: froala editor
✅ LaTeX - froala editor › @smoke MTHTML-10 Edit LaTeX equation: froala editor
✅ LaTeX - froala editor › Edit empty LaTeX equation: froala editor

✅ latex/latex.spec.ts

✅ LaTeX - froala editor › Validate LaTeX formula detection: froala editor
✅ LaTeX - froala editor › Insert formula using LaTeX equation entry form: froala editor
✅ LaTeX - froala editor › @smoke MTHTML-10 Edit LaTeX equation: froala editor
✅ LaTeX - froala editor › Edit empty LaTeX equation: froala editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - froala editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: froala editor
✅ Confirmation dialog - froala editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-29 Insert an equation after aborting the cancel: froala editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - froala editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: froala editor
✅ Confirmation dialog - froala editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: froala editor
✅ Confirmation dialog - froala editor › MTHTML-29 Insert an equation after aborting the cancel: froala editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - froala editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: froala editor
✅ Toolbar functions - froala editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: froala editor
✅ Toolbar functions - froala editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: froala editor
⚪ Toolbar functions - froala editor › When the modal is displayed and minimize button is clicked, modal is minimized: froala editor
⚪ Toolbar functions - froala editor › When the modal is minimized and user double clicks the banner, modal opens: froala editor
⚪ Toolbar functions - froala editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: froala editor
✅ Toolbar functions - froala editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: froala editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - froala editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: froala editor
✅ Toolbar functions - froala editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: froala editor
✅ Toolbar functions - froala editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: froala editor
⚪ Toolbar functions - froala editor › When the modal is displayed and minimize button is clicked, modal is minimized: froala editor
⚪ Toolbar functions - froala editor › When the modal is minimized and user double clicks the banner, modal opens: froala editor
⚪ Toolbar functions - froala editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: froala editor
✅ Toolbar functions - froala editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: froala editor

✅ telemetry/telemetry.spec.ts

✅ Telemetry › MTHTML-59 MathType all events testing: froala editor

✅ telemetry/telemetry.spec.ts

⚪ Telemetry › MTHTML-59 MathType all events testing: froala editor

✅ track-changes/equations_changes.spec.ts

⚪ Track Changes - froala editor › MTHTML-113 Insert equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-115 Delete equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-114 Edit equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-113 Insert equation - ChemType toolbar
⚪ Track Changes - froala editor › MTHTML-115 Delete equation - ChemType toolbar
⚪ Track Changes - froala editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/equations_changes.spec.ts

⚪ Track Changes - froala editor › MTHTML-113 Insert equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-115 Delete equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-114 Edit equation - MathType toolbar
⚪ Track Changes - froala editor › MTHTML-113 Insert equation - ChemType toolbar
⚪ Track Changes - froala editor › MTHTML-115 Delete equation - ChemType toolbar
⚪ Track Changes - froala editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

⚪ Track Changes Latex - froala editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

⚪ Track Changes Latex - froala editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
⚪ Track Changes Latex - froala editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

⚪ Track Changes Options - froala editor › MTHTML-117 Accept all suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-118 Discard all suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › Accept all selected suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › Discard all selected suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-116 Preview final result - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-117 Accept all suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › MTHTML-118 Discard all suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › Accept all selected suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › Discard all selected suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › MTHTML-116 Preview final result - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

⚪ Track Changes Options - froala editor › MTHTML-117 Accept all suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-118 Discard all suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › Accept all selected suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › Discard all selected suggestions - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-116 Preview final result - MathType toolbar
⚪ Track Changes Options - froala editor › MTHTML-117 Accept all suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › MTHTML-118 Discard all suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › Accept all selected suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › Discard all selected suggestions - ChemType toolbar
⚪ Track Changes Options - froala editor › MTHTML-116 Preview final result - ChemType toolbar

Annotations

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - froala

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor @froala @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - MathType › MTHTML-23 Validate formula alignment: froala editor @froala @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.fr-element')
      110 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-froala-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-froala-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 110 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 110 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-froala-MathType (image/png) ───────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-froala-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/alignment-froala-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/alignment-froala-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.fr-element')
      110 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-froala-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-froala-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 110 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 110 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-froala-MathType (image/png) ───────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-froala-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/alignment-froala-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/alignment-froala-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-48458-ula-alignment-froala-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - froala

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor @froala @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - froala editor - ChemType › MTHTML-23 Validate formula alignment: froala editor @froala @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.fr-element')
      110 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-froala-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-froala-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 110 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 110 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-froala-ChemType (image/png) ───────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-froala-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/alignment-froala-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/alignment-froala-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.fr-element')
      110 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-froala-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-froala-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 110 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.fr-element')
        - locator resolved to <div dir="auto" spellcheck="true" aria-disabled="false" contenteditable="true" class="fr-element fr-view">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 110 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-froala-ChemType (image/png) ───────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-froala-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/alignment-froala-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/alignment-froala-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-8dd9e-ula-alignment-froala-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────