Skip to content

Overture docs V2 update - #48

Open
MitchellShiell wants to merge 28 commits into
mainfrom
overtureDocsUpdate
Open

Overture docs V2 update#48
MitchellShiell wants to merge 28 commits into
mainfrom
overtureDocsUpdate

Conversation

@MitchellShiell

@MitchellShiell MitchellShiell commented Jul 24, 2026

Copy link
Copy Markdown
Collaborator

Overture docs site v2: restructure into Develop / Deploy / Use / Community

Rebuilds the documentation site around four audience-facing sections, replaces the old docs / guides / workshop split, adds the deployment and AI-assisted data discovery guides, and ships three interactive in-page tools. Component reference docs are pulled in from the submodules/ doc branches, so this PR is blocked on
the submodule PRs in the table below
.

overtureDocsUpdate -> main · 16 commits · 185 files (+13,787 / -10,069) plus 7 submodule pin bumps.

Submodule merges are preferable before merging docs

Every component's reference docs live in its own repo and are vendored here as a submodule. This PR's pins currently point at branch tips that are not yet on their default branches. Each row must be merged first, then the pin re-pointed at the resulting default-branch commit before this PR can go in.

Component Submodule path Repo Branch to merge Target branch Commits Doc files Pinned commit here PR
Lectern submodules/lectern overture-stack/lectern overtureDocsUpdate main 6 11 01fb704 overture-stack/lectern#448
Lyric submodules/lyric overture-stack/lyric overtureDocsUpdate main 4 3 181bbb1 overture-stack/lyric#215
Song submodules/song overture-stack/song overtureDocsUpdate develop 5 18 28a01d6a overture-stack/SONG#911
Score submodules/score overture-stack/score overtureDocsUpdate develop 2 9 38386151 overture-stack/score#504
Maestro submodules/maestro overture-stack/maestro overtureDocsUpdate master 6 13 cbb2bd6 overture-stack/maestro#297
Arranger submodules/arranger overture-stack/arranger overtureDocsUpdate main 5 20 b521460d overture-stack/arranger#1089
Stage submodules/stage overture-stack/stage overtureDocsUpdate main 2 1 580d785 overture-stack/stage#257

All seven branches are pushed and have no unpushed or uncommitted work.

What changed in this repo

Information architecture

The site moves from docs / guides / workshop / community to four audience-oriented Docusaurus plugin instances, each with its own sidebar:

Route Content path Sidebar Audience
/develop website/docs/develop-docs developSidebars.ts Component internals, API reference, contributing
/deploy website/docs/deploy-docs deploySidebars.ts Standing up a platform
/use website/docs/use-docs useSidebars.ts Submitting, retrieving, administering, workshop
/community website/docs/community-docs communitySidebars.ts Support, team, funding, licensing, conduct

sidebars.ts, guidesSidebars.ts, workshopSidebars.ts and casestudiesSidebars.ts
are removed. Navbar becomes Develop / Deploy / Use.

New content

  • Deployment guides (/deploy/deployment): per-component walkthroughs: Keycloak, Song, Score, Lectern, Lyric, search engine, Maestro, Arranger, Stage, plus file transfer, search portal, tabular data submission, and the Arranger MCP server.
  • AI-assisted data discovery (/use/ai-assisted-data-discovery): testing environment, connecting a host, configuration templates, use cases, and deploying your own MCP server.
  • Administration guides (/use/administration): building dictionaries, building Song schemas, customizing the data portal, index mappings.
  • API reference (/develop/api-reference): per-component Swagger pages for Song, Score, Maestro, Lyric, Lectern and Arranger. lecternAPI.json added; the Song, Score, Maestro and Lyric specs are regenerated against current code.
  • The IBC Workshop has been generalized and moved under /use/workshop with a new generalized intro page.

Interactive components

Three browser-only tools, each with a docs page under /use/config-generators-and-playgrounds:

  • ConfigGenerator: upload a flat CSV, infer types, and emit a Lectern dictionary, Song schema, Elasticsearch/opensearch mapping, Arranger configs and a Postgres table. Limitations on making configs for hierarchical data is presented on the page, this is here and crosslinked to complement the workshop.
  • DictionaryPlayground: live Lectern dictionary authoring and validation with lectern viewer component generation
  • SongSchemaPlayground: live Song schema authoring and validation (requiring some reworking).

Build and dependencies

  • Docusaurus 3.9.2 to 3.10.2; package renamed bridge-poc to overture-docs.
  • Adds @overture-stack/lectern-dictionary, @overture-stack/lectern-ui, the CodeMirror editor stack, and @docusaurus/plugin-client-redirects.
  • website/docsPlugin.ts gains webpack config to make the Lectern viewer bundle for the browser: aliases d3-dag to its ESM build (its CJS build pulls in Node built-ins), stubs Node core modules, rewrites node:-scheme imports, and silences the resulting d3-dag critical-dependency warning.
  • react/react-dom pinned via overrides for @overture-stack/lectern-ui.

Merge order

  1. Open and merge the seven submodule doc PRs in the table above.
  2. In each submodule, fetch and check out the merge commit on the default branch.
  3. Bump the seven pins in this branch, commit, push.
  4. Re-run the site build and confirm every submodule-sourced page still resolves.
  5. Merge this PR.

Verification

  • npm ci && npm run build in website/ is clean
  • No broken links reported by the Docusaurus build
  • Every legacy URL in the redirect list resolves
  • The three interactive tools render and run in a production build
  • All seven pins point at commits reachable from their default branches

@netlify

netlify Bot commented Jul 24, 2026

Copy link
Copy Markdown

Deploy Preview for overturedocs canceled.

Name Link
🔨 Latest commit 7a10f91
🔍 Latest deploy log https://app.netlify.com/projects/overturedocs/deploys/6a6b9809f1a225000826eb27

Resolves PR #911's conflict against origin/develop. 18 develop commits
absorbed; the single two-sided edit, the support link in
docs/02-Reference/00-submitting-metadata.md, keeps this branch's rewrite
over develop's stale docs.overture.bio path. Develop's own additions are
intact: the -ad allow-duplicates flag, the JetBrains README logo, and the
repo-wide formatter pass.
Resolves PR #504's conflict against origin/develop. 6 develop commits
absorbed across four conflicts: two support/reference-link rewrites kept
over develop's stale docs.overture.bio paths, README.md combined with
develop's Environment typo fix, and the Makefile Compose detection kept as
this branch's probe-with-fallback in place of develop's hardcoded
$(shell which docker) compose.

Develop's score -> score-client image rename, --remove-orphans, and
JetBrains logo are all intact. The branch's removal of --validate from the
upload options table still holds: #503 adds no CLI flag, and --validate is
declared only on DownloadCommand.
PR #257 was BEHIND by one commit (8195c9a, next@^12 vulnerability
upgrade). Rebased onto origin/main rather than taking GitHub's offered
merge commit, for consistency with the song and score rebases and to keep
history linear. No conflicts: that commit touches only package.json and
package-lock.json, while the branch touches docs/ and dev-services/.
Resolves PR #448's conflict against origin/main. 43 main commits
absorbed, one conflict: README.md, where main and this branch had
independently repointed the same stale under-development/lectern link.
Main used the older docs/core-software scheme, so this branch's
/develop/Lectern/overview wins, matching the site rename already applied
across song and score.

Main's prettier reformat of docs/03-dictionaryReference.md and its
displayName additions survive untouched. The docs/04-viewer/ pages were
verified against the rebased packages/ui: entry points,
DictionaryTableProps, CustomColumnConfig and MetaValueRenderer all match.
PR #297 targets M5-revised, the TypeScript rewrite, not master. 83
commits absorbed from a 2023 merge base.

The Java maestro-app config and the five old doc pages stay deleted; the
replacement pages cover their content and are more accurate, since
M5-revised's tech.md and README still list the kafka and repository
packages that 2cad87c consolidated away, and its setup.md points at a
nonexistent .env.schema.

Two corrections on top of the rebase: the README still carried master's
Java 11 and Maven prerequisites, which would have regressed the
TypeScript branch, and both setup guides documented a make help target
that does not exist.
Resolves PR #1089's conflicts. 11 commits absorbed, four conflicts.

MCP tool names: main's #1088 renamed them to snake_case and this branch
still had kebab-case, so main wins, verified against apps/mcp-server/src.
docs/mcp-server.md combined, keeping main's new query_arranger Prompts
block from #1087 alongside this branch's heading promotion.

The two .dev conflicts follow the branch's own drop-.dev-changes intent,
so .dev matches main exactly, except tech-debt.md where both entries are
kept: they are additive, and this branch's OpenSearch entry explains why
its Makefile change removes the start-os target.
Closes the unclosed code fence in docs/03-dictionaryReference.md that
trapped the ## Field Restrictions heading inside a code block. Docusaurus
was failing the site build on two broken anchors pointing at it, one from
the Lectern page itself and one from
website/docs/use-docs/administration/01-building-dictionaries.mdx.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant