Skip to content

test: begin black-box cleanup of the e2e suite - #2949

Open
p-targowicz wants to merge 1 commit into
masterfrom
blackbox-test-cleanup
Open

test: begin black-box cleanup of the e2e suite#2949
p-targowicz wants to merge 1 commit into
masterfrom
blackbox-test-cleanup

Conversation

@p-targowicz

@p-targowicz p-targowicz commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

Deduplication pass from the cross-repo test taxonomy: the integration
repository keeps black-box, real-device e2e coverage; API/CLI/internal
behavior is owned by mender-server's test layers (per-service acceptance
suites and the integration:ng Go runner - see
mendersoftware/mender-server#2034).

Changes:

  • Remove test_os_ent_migration.py. The DEFAULT_TENANT_TOKEN mechanism it
    exercises is not compiled into the open-source server; the enterprise
    server both implements it and already tests it
    (TestDefaultTenantTokenEnterprise in its integration suite, running in
    its CI). The remaining assertion, old users receiving 401 after
    migration, is a byproduct of enterprise login scoping rather than
    migration logic.
  • Remove the OS-mode test_ok_preauth_and_remove and
    test_fail_preauth_existing: pure device-auth API contracts, ported to
    the integration:ng suite with per-test CI runs. The enterprise
    variants remain until equivalent enterprise-mode backend coverage
    exists; the preauth-and-bootstrap flow (which needs a real device)
    stays here.
  • Mark the remaining internal-API usages as fixtures, not assertions:
    test_autogenerate_delta's tenant delta configuration (no public
    endpoint exists) and testutils' create_org (public org creation only
    exists via the signup flow). Setup may stay white-box; the behavior
    under test must not.

Net test collection: 195 -> 191, no collection errors.

@mender-test-bot

Copy link
Copy Markdown
Contributor

@p-targowicz, start a full integration test pipeline with:

  • mentioning me and start integration pipeline

my commands and options

You can prevent me from automatically starting CI pipelines:

  • if your pull request title starts with "[NoCI] ..."

You can trigger a client pipeline on multiple prs with:

  • mentioning me and start client pipeline --pr mender/127 --pr mender-connect/255

You can trigger a client pipeline for a specific Mender Client release with:

  • mentioning me and start client pipeline --release 6.0.x (can be given multiple times)
  • by default, a pipeline is triggered for each supported release the component is a part of

You can trigger GitHub->GitLab branch sync with:

  • mentioning me and sync

You can print PR statistics for a repository with:

  • mentioning me and print fast pr stats (Team stats only)
  • mentioning me and print full pr stats (Detailed report)
  • options: --repo <repo>, --team <name>, --all-repos, --exclude-drafts, --exclude-user <user>
  • mentioning me and print full pr stats --repo mender --all-repos --exclude-drafts

You can deploy a review app with:

  • mentioning me and start review app (OS environment)
  • mentioning me and start review app enterprise (Enterprise environment)

You can run e2e tests against a deployed review app with:

  • mentioning me and start review tests (defaults to os environment)
  • mentioning me and start review tests enterprise (for enterprise environment)

You can cherry pick to a given branch or branches with:

  • mentioning me and:
 cherry-pick to:
 * 1.0.x
 * 2.0.x

@p-targowicz
p-targowicz force-pushed the blackbox-test-cleanup branch from 5fe1561 to 26dfeeb Compare July 14, 2026 12:39
Remove the OS-to-enterprise migration test: the DEFAULT_TENANT_TOKEN
mechanism it exercises is not compiled into the open-source server at
all, and mender-server-enterprise both implements it and already tests
it (TestDefaultTenantTokenEnterprise in its integration suite, run in
its CI). The remaining assertion there, old users receiving 401 after
migration, is a byproduct of enterprise login scoping rather than
migration logic. Also remove the non-bootstrap preauth tests, pure
device-auth API contracts now owned by mender-server's integration:ng
suite; their enterprise variants stay until enterprise-mode backend
coverage exists. The delta configuration call and create_org keep
using internal APIs but are explicitly marked as fixtures since no
public equivalent exists.

Signed-off-by: Patryk Targowicz <patryk.targowicz@northern.tech>
@p-targowicz
p-targowicz force-pushed the blackbox-test-cleanup branch from 26dfeeb to 5f042f1 Compare July 17, 2026 07:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants