Skip to content

feat(content-insights): performance improvements [MAPS-256]#10973

Open
Adrian Meyer (primeinteger) wants to merge 1 commit into
masterfrom
MAPS-256
Open

feat(content-insights): performance improvements [MAPS-256]#10973
Adrian Meyer (primeinteger) wants to merge 1 commit into
masterfrom
MAPS-256

Conversation

@primeinteger
Copy link
Copy Markdown
Contributor

@primeinteger Adrian Meyer (primeinteger) commented May 12, 2026

Purpose

Fix Content Insights load times on large spaces by replacing serial offset pagination with parallel cursor streams.

Approach

  • Replace the single entry.getMany skip/limit loop with entry.getManyWithCursor.
  • Fan out one cursor stream per content type with bounded concurrency (FETCH_CONFIG.CONCURRENCY = 5, headroom under the ~7 req/s CMA limit) via a small concurrentMap worker pool.
  • Extract cursorPaginate to drain any cursor-paginated CMA endpoint, preserving the existing adaptive batch-shrinking on Response size too big (halve down to MIN_BATCH_SIZE).
  • Lift useContentTypes ahead of useAllEntries in Dashboard and pass content type ids in -- entries fetch is now keyed on the resolved id list.
  • Bump contentful-management 11.63.1 -> 11.76.0 for getManyWithCursor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant