Overture docs update - #911
Open
MitchellShiell wants to merge 8 commits into
Open
Conversation
5 tasks
MitchellShiell
force-pushed
the
overtureDocsUpdate
branch
from
July 30, 2026 16:04
8b67b0a to
69da766
Compare
The docs site's under-development section has been removed; Lyric (the tabular data submission service) is now the canonical destination for the 'data submission system' reference, so link to its core-software overview instead of the retired /docs/under-development/ page.
The site renamed /docs/core-software/* to /build/* to /develop/*, moved /docs/contribution to /develop/contributing, /guides/getting-started to /deploy, and /guides/administration-guides to /use. Each old path only resolved through a redirect hop. Verified every new target against a local site build.
MitchellShiell
force-pushed
the
overtureDocsUpdate
branch
from
July 30, 2026 17:33
69da766 to
bb13738
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Documentation for the Overture docs site.
The docs still described the pre-5.3.0 data model: donor/specimen/sample entities in the base schema, ID management delegated to an external service. They now describe the consolidated 5.3.0 schema and its migration path. Separately,
docs/02-Usage/→docs/02-Reference/to match the other components, and the setup guide is rewritten around this repo's own Compose stack instead of the retired Preludequickstartbranch.Source changes are limited to
Makefileanddocker-compose.yml: dev tooling, no application logic, no Java.Song 5.3.0 data model
04-data-model-management.md: base schema corrected to the three fields it actually requires (studyId,analysisType,files); the old text listed donor/specimen/sample IDs and "essential cancer sample characteristics". Adds a Schema Options section foroptions.fileTypesandoptions.externalValidations, including that omitting an option preserves its previous value while an empty list clears it.06-id-management.md: rewritten, replacing a 184-line page. Song generates both IDs it tracks, with no external ID service: analysis IDs are random UUIDs, file IDs deterministic UUID5 hashes of the analysis ID and file name. IDs are immutable, so changing a contributing value means UNPUBLISH + SUPPRESS + resubmit.11-database-migration.md(new): pre-5.3.0 data spanned multiple tables, 5.3.0 writes to one, so existing databases must be migrated. Documents the TypeScript migration script, opening with a back-up warning.Each carries a version note recording the old behaviour, including the retired "federated" ID mode.
Setup guide
The old guide opened with
git clone -b quickstart .../prelude.git. That branch is retired, so it now uses thedocker-compose.ymlandMakefilealready in this repo.make start-deps→ Keycloak9082, keycloak-db9444, Score8087, Minio8085.make start-song-serveradds song-db8432and song-server8080(debug5006).8180,9000,5433), not ours. Corrected, the Conductor row is gone, andsongDev.svg, which drew the Quickstart topology, is dropped.CLIENT_ACCESS_TOKEN=68fb42b4-…andCLIENT_STUDY_ID=demoare now placeholders. Both were Quickstart values that worked nowhere else, and this stack starts with an empty database, so there is nodemostudy to query.adminpassword in Keycloak, get a token via thesystemclient's direct access grant, exchange it atapikey/api_keyfor asong.WRITE/score.WRITEkey.myrealmand downloadskeycloak-apikeysat start-up; the targets build with./mvnw, so a JDK is needed even for the supporting services alone.make cleanandmake log-song-serverdocumented.Source changes
Makefile. The guide does not work without these:docker compose version, falls back to the standalone binary. V1 no longer ships with Docker Desktop, so every Compose target failed outright on a current install.MVN_EXEprefers the bundled./mvnwover a systemmvn.ROOT_DIRmoves above the detection block that now depends on it.docker-compose.yml. Without this the stack could not pull at all.bitnami/keycloak:22andbitnami/postgresql:11→bitnamilegacy/*; Bitnami archived its versioned tags in 2025. Commented in place.docs/02-Usage/→docs/02-Reference/Every page moves;
02-Usage.mdxbecomes02-Reference.mdx(retitled "Reference", glossary retained).docs/custom-schemas.mdis deleted, because its Options content is now the Schema Options section of04-data-model-management.md, where anyone configuring an analysis type already is.One real fix came along in the move:
01-retrieving-metadata.mdand02-updating-metadata.mdshowed a multi-analysis update queryinganalysis/search/id?submitterDonorId=<sample>, an endpoint that does not serve submitter sample lookups. Song has no server-side search for submitter sample or donor IDs, so the example now pages through the study's analyses, filters client-side, and patches each match by analysis ID.Overview and README fixes
00-overview.md: the repo tree said/song-servers(actual:/song-server); thesong-java-sdkentry described a package that no longer exists;song-python-sdkwas described as being for "java applications".01-setup.md: the services table credited Keycloak with OAuth2 "for Score" on the Song page, and the Song-serverapplication.ymllink pointed into the score repo.README.md: staledocs/core-software/Song/*links →/develop/Song/*, contributing →/develop/contributing, getting started →/deploy.