Skip to content

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…

8ae40e8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Test/fix e2e workflow #1148

test: skip MTHTML-97 for generic firefox and fail MTHTML-100 for cked…
8ae40e8
Select commit
Loading
Failed to load commit list.
GitHub Actions / E2E Tests - ckeditor5 failed May 19, 2026 in 0s

134 passed, 2 failed and 10 skipped

Tests failed

❌ tests/e2e/test-results/results.xml

146 tests were completed in 449s with 134 passed, 2 failed and 10 skipped.

Test suite Passed Failed Skipped Time
edit/edit_corner_cases.spec.ts 4✅ 1⚪ 49s
edit/edit_corner_cases.spec.ts 4✅ 1⚪ 48s
edit/edit_hand.spec.ts 2✅ 26s
edit/edit_hand.spec.ts 2✅ 25s
edit/edit_via_doble_click.spec.ts 2✅ 34s
edit/edit_via_doble_click.spec.ts 2✅ 18s
edit/edit_via_selection.spec.ts 4✅ 39s
edit/edit_via_selection.spec.ts 4✅ 38s
editor/copy_cut_drop.spec.ts 3✅ 34s
editor/copy_cut_drop.spec.ts 2✅ 1⚪ 23s
editor/editor.spec.ts 4✅ 41s
editor/editor.spec.ts 4✅ 40s
insert/insert_corner_cases.spec.ts 8✅ 57s
insert/insert_corner_cases.spec.ts 6✅ 2❌ 78s
insert/insert_hand.spec.ts 2✅ 15s
insert/insert_hand.spec.ts 2✅ 18s
insert/insert.spec.ts 5✅ 40s
insert/insert.spec.ts 5✅ 43s
latex/latex.spec.ts 4✅ 33s
latex/latex.spec.ts 4✅ 32s
modal/confirmation_dialog.spec.ts 6✅ 35s
modal/confirmation_dialog.spec.ts 6✅ 34s
modal/toolbar.spec.ts 4✅ 3⚪ 18s
modal/toolbar.spec.ts 4✅ 3⚪ 16s
telemetry/telemetry.spec.ts 1✅ 11s
telemetry/telemetry.spec.ts 1⚪ 627ms
track-changes/equations_changes.spec.ts 6✅ 48s
track-changes/equations_changes.spec.ts 6✅ 50s
track-changes/latex_changes.spec.ts 4✅ 32s
track-changes/latex_changes.spec.ts 4✅ 30s
track-changes/toolbar_changes.spec.ts 10✅ 127s
track-changes/toolbar_changes.spec.ts 10✅ 138s

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-81 Edit styled equation: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-97 Validate formula edition on styled text blocks: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-85 User edits a formula and continues typing text: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-100 User edits a formula deleted during edition: ckeditor5 editor
⚪ Edit equation (corner cases) - ckeditor5 editor › MTHTML-9 User edits formula via contextual toolbar: ckeditor5 editor

✅ edit/edit_corner_cases.spec.ts

✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-81 Edit styled equation: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-97 Validate formula edition on styled text blocks: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-85 User edits a formula and continues typing text: ckeditor5 editor
✅ Edit equation (corner cases) - ckeditor5 editor › MTHTML-100 User edits a formula deleted during edition: ckeditor5 editor
⚪ Edit equation (corner cases) - ckeditor5 editor › MTHTML-9 User edits formula via contextual toolbar: ckeditor5 editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - ckeditor5 editor › @smoke MTHTML-8 Edit Hand equation with MathType: ckeditor5 editor
✅ Edit equation by hand - ckeditor5 editor › @smoke MTHTML-8 Edit Hand equation with ChemType: ckeditor5 editor

✅ edit/edit_hand.spec.ts

✅ Edit equation by hand - ckeditor5 editor › @smoke MTHTML-8 Edit Hand equation with MathType: ckeditor5 editor
✅ Edit equation by hand - ckeditor5 editor › @smoke MTHTML-8 Edit Hand equation with ChemType: ckeditor5 editor

✅ edit/edit_via_doble_click.spec.ts

✅ Edit equation via double click - ckeditor5 editor › @smoke MTHTML-2 Edit Math equation: ckeditor5 editor
✅ Edit equation via double click - ckeditor5 editor › @smoke MTHTML-2 Edit Chemistry equation: ckeditor5 editor

✅ edit/edit_via_doble_click.spec.ts

✅ Edit equation via double click - ckeditor5 editor › @smoke MTHTML-2 Edit Math equation: ckeditor5 editor
✅ Edit equation via double click - ckeditor5 editor › @smoke MTHTML-2 Edit Chemistry equation: ckeditor5 editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Math equation with MathType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Math equation with ChemType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: ckeditor5 editor

✅ edit/edit_via_selection.spec.ts

✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Math equation with MathType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Chemistry equation with MathType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Math equation with ChemType: ckeditor5 editor
✅ Edit equation via selection - ckeditor5 editor › @smoke MTHTML-8 Edit Chemistry equation with ChemType: ckeditor5 editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-95 Copy-paste math formula with ckeditor5 editor
✅ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-96 Cut-paste math formula with ckeditor5 editor
✅ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-86 Drag-drop math formula with ckeditor5 editor

✅ editor/copy_cut_drop.spec.ts

✅ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-95 Copy-paste math formula with ckeditor5 editor
✅ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-96 Cut-paste math formula with ckeditor5 editor
⚪ Copy/Cut/Paste/Drag&Drop - ckeditor5 editor › MTHTML-86 Drag-drop math formula with ckeditor5 editor

✅ editor/editor.spec.ts

✅ Editor functionality - ckeditor5 editor › Undo and Redo › MTHTML-78 Undo and redo math formula with ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Resize › MTHTML-22 Formulas cannot be resized ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Source code › MTHTML-87 Edit source code of a math formula with ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: ckeditor5 editor

✅ editor/editor.spec.ts

✅ Editor functionality - ckeditor5 editor › Undo and Redo › MTHTML-78 Undo and redo math formula with ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Resize › MTHTML-22 Formulas cannot be resized ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Source code › MTHTML-87 Edit source code of a math formula with ckeditor5 editor
✅ Editor functionality - ckeditor5 editor › Styled text › MTHTML-79 Validate formula insertion after typing text that contains styles: ckeditor5 editor

✅ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-80 Insert styled equation: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-68 Insert equation with special characters: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-80 Insert styled equation: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-68 Insert equation with special characters: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor

❌ insert/insert_corner_cases.spec.ts

✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-80 Insert styled equation: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-68 Insert equation with special characters: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: ckeditor5 editor
❌ Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-80 Insert styled equation: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-68 Insert equation with special characters: ckeditor5 editor
✅ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-90 User inserts a formula when the editor input doesn't have focus: ckeditor5 editor
❌ Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor
	[firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - ckeditor5 editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: ckeditor5 editor
✅ Insert equation via Hand - ckeditor5 editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: ckeditor5 editor

✅ insert/insert_hand.spec.ts

✅ Insert equation via Hand - ckeditor5 editor - MathType › @smoke MTHTML-20 Insert a handwritten equation using MathType: ckeditor5 editor
✅ Insert equation via Hand - ckeditor5 editor - ChemType › @smoke MTHTML-20 Insert a handwritten equation using ChemType: ckeditor5 editor

✅ insert/insert.spec.ts

✅ Insert equation - ckeditor5 editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - MathType › Insert equation with MathType using MathML: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - ChemType › Insert equation with ChemType using MathML: ckeditor5 editor
✅ ALT Attribute - ckeditor5 editor › MTHTML-19 Formula - ALT attribute: ckeditor5 editor

✅ insert/insert.spec.ts

✅ Insert equation - ckeditor5 editor - MathType › @smoke MTHTML-1 Insert equation with MathType via keyboard: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - MathType › Insert equation with MathType using MathML: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - ChemType › @smoke MTHTML-1 Insert equation with ChemType via keyboard: ckeditor5 editor
✅ Insert equation - ckeditor5 editor - ChemType › Insert equation with ChemType using MathML: ckeditor5 editor
✅ ALT Attribute - ckeditor5 editor › MTHTML-19 Formula - ALT attribute: ckeditor5 editor

✅ latex/latex.spec.ts

✅ LaTeX - ckeditor5 editor › Validate LaTeX formula detection: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › Insert formula using LaTeX equation entry form: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › @smoke MTHTML-10 Edit LaTeX equation: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › Edit empty LaTeX equation: ckeditor5 editor

✅ latex/latex.spec.ts

✅ LaTeX - ckeditor5 editor › Validate LaTeX formula detection: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › Insert formula using LaTeX equation entry form: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › @smoke MTHTML-10 Edit LaTeX equation: ckeditor5 editor
✅ LaTeX - ckeditor5 editor › Edit empty LaTeX equation: ckeditor5 editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - ckeditor5 editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-29 Insert an equation after aborting the cancel: ckeditor5 editor

✅ modal/confirmation_dialog.spec.ts

✅ Confirmation dialog - ckeditor5 editor › MTHTML-11 When wiris editor contains no changes and user clicks the Cancel button, modal closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-3 When wiris editor contains changes and user clicks the Cancel button, modal displays confirmation dialog: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › When confirmation dialog is displayed and user clicks cancel, confirmation dialog closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-12 When confirmation dialog is displayed and user clicks the Close button, wiris editor closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-14 When confirmation dialog is displayed and user press the ESC key, wiris editor closes: ckeditor5 editor
✅ Confirmation dialog - ckeditor5 editor › MTHTML-29 Insert an equation after aborting the cancel: ckeditor5 editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - ckeditor5 editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is displayed and minimize button is clicked, modal is minimized: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is minimized and user double clicks the banner, modal opens: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: ckeditor5 editor

✅ modal/toolbar.spec.ts

✅ Toolbar functions - ckeditor5 editor › MTHTML-13 When the modal is displayed and close button is clicked, wiris modal closes: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › When the modal is displayed and enable full screen button is clicked, display changes to full-screen: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › When the modal is displayed in full screen mode and disable full-screen button is clicked, display changes to normal: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is displayed and minimize button is clicked, modal is minimized: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is minimized and user double clicks the banner, modal opens: ckeditor5 editor
⚪ Toolbar functions - ckeditor5 editor › When the modal is minimized from full-screen mode and user double clicks the banner, modal opens in full-screen mode: ckeditor5 editor
✅ Toolbar functions - ckeditor5 editor › MTHTML-15 When the modal is displayed and ESC key is pressed, wiris modal closes: ckeditor5 editor

✅ telemetry/telemetry.spec.ts

✅ Telemetry › MTHTML-59 MathType all events testing: ckeditor5 editor

✅ telemetry/telemetry.spec.ts

⚪ Telemetry › MTHTML-59 MathType all events testing: ckeditor5 editor

✅ track-changes/equations_changes.spec.ts

✅ Track Changes - ckeditor5 editor › MTHTML-113 Insert equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-115 Delete equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-114 Edit equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-113 Insert equation - ChemType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-115 Delete equation - ChemType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/equations_changes.spec.ts

✅ Track Changes - ckeditor5 editor › MTHTML-113 Insert equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-115 Delete equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-114 Edit equation - MathType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-113 Insert equation - ChemType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-115 Delete equation - ChemType toolbar
✅ Track Changes - ckeditor5 editor › MTHTML-114 Edit equation - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

✅ Track Changes Latex - ckeditor5 editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/latex_changes.spec.ts

✅ Track Changes Latex - ckeditor5 editor › MTHTML-119 Edit existing latex equation via MT/CT - MathType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - MathType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-119 Edit existing latex equation via MT/CT - ChemType toolbar
✅ Track Changes Latex - ckeditor5 editor › MTHTML-120 Edit existing latex equation manually and via MT/CT - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

✅ Track Changes Options - ckeditor5 editor › MTHTML-117 Accept all suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-118 Discard all suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › Accept all selected suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › Discard all selected suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-116 Preview final result - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-117 Accept all suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-118 Discard all suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › Accept all selected suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › Discard all selected suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-116 Preview final result - ChemType toolbar

✅ track-changes/toolbar_changes.spec.ts

✅ Track Changes Options - ckeditor5 editor › MTHTML-117 Accept all suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-118 Discard all suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › Accept all selected suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › Discard all selected suggestions - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-116 Preview final result - MathType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-117 Accept all suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-118 Discard all suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › Accept all selected suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › Discard all selected suggestions - ChemType toolbar
✅ Track Changes Options - ckeditor5 editor › MTHTML-116 Preview final result - ChemType toolbar

Annotations

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - ckeditor5

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - MathType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.ck-editor__editable')
      626 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-ckeditor5-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-ckeditor5-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 626 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 626 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-ckeditor5-MathType (image/png) ────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-ckeditor5-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/alignment-ckeditor5-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/alignment-ckeditor5-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.ck-editor__editable')
      626 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-ckeditor5-MathType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-ckeditor5-MathType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 626 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 626 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-ckeditor5-MathType (image/png) ────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-ckeditor5-MathType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/alignment-ckeditor5-MathType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/alignment-ckeditor5-MathType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-8f0bb--alignment-ckeditor5-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 0 in tests/e2e/test-results/results.xml

See this annotation in the file changed.

@github-actions github-actions / E2E Tests - ckeditor5

insert/insert_corner_cases.spec.ts ► Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor

Failed test found in:
  tests/e2e/test-results/results.xml
Error:
    [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression 
Raw output
  [firefox] › insert/insert_corner_cases.spec.ts:66:11 › Insert equation (corner cases) - ckeditor5 editor - ChemType › MTHTML-23 Validate formula alignment: ckeditor5 editor @ckeditor5 @regression 

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.ck-editor__editable')
      626 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-ckeditor5-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-ckeditor5-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 626 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 626 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-ckeditor5-ChemType (image/png) ────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-ckeditor5-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/alignment-ckeditor5-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/alignment-ckeditor5-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(locator).toHaveScreenshot(expected) failed

    Locator: locator('.ck-editor__editable')
      626 pixels (ratio 0.01 of all image pixels) are different.

      Snapshot: alignment-ckeditor5-ChemType.png

    Call log:
      - Expect "toHaveScreenshot(alignment-ckeditor5-ChemType.png)" with timeout 10000ms
        - verifying given screenshot expectation
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - 626 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - waiting for locator('.ck-editor__editable')
        - locator resolved to <div lang="en" dir="ltr" role="textbox" contenteditable="true" aria-label="Rich Text Editor. Editing area: main. Press Alt+0 for help." class="ck ck-content ck-editor__editable ck-rounded-corners ck-editor__editable_inline ck-focused">…</div>
      - taking element screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - attempting scroll into view action
        - waiting for element to be stable
      - captured a stable screenshot
      - 626 pixels (ratio 0.01 of all image pixels) are different.


      83 |         // vertical misalignment between the formula image and the surrounding text.
      84 |         const editArea = editor.getEditAreaLocator()
    > 85 |         await expect(editArea).toHaveScreenshot(`alignment-${editorName}-${toolbar}.png`, {
         |                                ^
      86 |           // Allow up to 0.1 % of pixels to differ (sub-pixel rendering, font hinting, etc.)
      87 |           maxDiffPixelRatio: 0.001,
      88 |         })
        at /home/runner/work/html-integrations/html-integrations/tests/e2e/tests/insert/insert_corner_cases.spec.ts:85:32

    attachment #1: alignment-ckeditor5-ChemType (image/png) ────────────────────────────────────────
    Expected: ../fixtures/insert/insert_corner_cases.spec.ts-snapshots/alignment-ckeditor5-ChemType-firefox-linux.png
    Received: ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/alignment-ckeditor5-ChemType-actual.png
    Diff:     ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/alignment-ckeditor5-ChemType-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: screenshot (image/png) ──────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/test-failed-1.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Error Context: ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/error-context.md

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/trace.zip
    Usage:

        yarn playwright show-trace ../test-results/insert-insert_corner_cases-e4687--alignment-ckeditor5-editor-firefox-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────