Skip to content

Port old test-data guide to new layout#4283

Open
jfy133 wants to merge 4 commits into
nf-core:mainfrom
jfy133:test-data-guide
Open

Port old test-data guide to new layout#4283
jfy133 wants to merge 4 commits into
nf-core:mainfrom
jfy133:test-data-guide

Conversation

@jfy133

@jfy133 jfy133 commented Jun 24, 2026

Copy link
Copy Markdown
Member

As reported on Slack by @pmoris , we are missing the old guide for nf-test datasets.
It was inadvertently dropped from the original porting as it was clustered in a big batch of files that we decided against porting for completeness reasons.

I have retrieved this specific file and tried to clean it up as far as possible to remove more 'specifications' like text and kept it strictly as a guide, including against the style guide.

I placed it in the existing 'testing' section because even if it's not necessarily nf-test related, it is intrinsically involved and I feel it would be the most likely place a user would look to find information bout it.

(Already LLM-assisted reviewed against style guide by Claude Haiku 4.5)

@netlify /docs/developing/testing/test-data

@netlify

netlify Bot commented Jun 24, 2026

Copy link
Copy Markdown

Deploy Preview for nf-core-main-site ready!

Name Link
🔨 Latest commit 95fbacd
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-main-site/deploys/6a3bc30f9a526a0009734e53
😎 Deploy Preview https://deploy-preview-4283--nf-core-main-site.netlify.app/docs/developing/testing/test-data
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@netlify

netlify Bot commented Jun 24, 2026

Copy link
Copy Markdown

Deploy Preview for nf-core-docs ready!

Name Link
🔨 Latest commit 95fbacd
🔍 Latest deploy log https://app.netlify.com/projects/nf-core-docs/deploys/6a3bc30f9a526a0009734e55
😎 Deploy Preview https://deploy-preview-4283--nf-core-docs.netlify.app/docs/developing/testing/test-data
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@pmoris

pmoris commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

As mentioned on Slack, it looks good to me! Cheers!

Comment on lines +102 to +103
3. Upload to the dedicated pipeline branch in a suitable location.
- (Recommended) Use the GitHub website upload function.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why the recommendation for using the web GUI?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So you don't have to clone the repo 😅

@christopher-hakkaart christopher-hakkaart left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added some very low-level suggestions. Consider them optional. Otherwise I think it looks good.

weight: 2
---

nf-core has a central repository on [nf-core/test-datasets](https://github.com/nf-core/test-datasets) containing small data files for testing of nf-core components and pipelines.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
nf-core has a central repository on [nf-core/test-datasets](https://github.com/nf-core/test-datasets) containing small data files for testing of nf-core components and pipelines.
nf-core maintains a central repository on [nf-core/test-datasets](https://github.com/nf-core/test-datasets), which contains small data files for testing nf-core components and pipelines.

For example, if you need to test a new bioinformatic short-read aligner that requires a genome file index, use an existing `genome.fasta` file on nf-core/test-datasets to generate the index, rather than using your own reference genome.

:::danger
Do not clone the nf-core/test-datasets repository: it is extremely large and will take a long time to download.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Do not clone the nf-core/test-datasets repository: it is extremely large and will take a long time to download.
Do not clone the nf-core/test-datasets repository. It is extremely large and will take a long time to download.

Avoid adding test data of new organisms as far as possible, and reuse existing files.

SARS-CoV-2 and _Homo sapiens_ (Chr 21) are the best supported organisms and should be used where possible.
If a new organism is absolutely required for a tool, first propose the addition on the [#test-data](https://nfcore.slack.com/archives/C02L5UB4Y9G) Slack channel.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
If a new organism is absolutely required for a tool, first propose the addition on the [#test-data](https://nfcore.slack.com/archives/C02L5UB4Y9G) Slack channel.
If a new organism is absolutely required for a tool, propose the addition on the [#test-data](https://nfcore.slack.com/archives/C02L5UB4Y9G) Slack channel.

- Include as much information as possible that could allow reconstruction of the file (for example, original source accession numbers or URLs, tool name and versions used to generate).
5. Open a pull request and request a review on the nf-core [#request-review](https://nfcore.slack.com/archives/CQY2U5QU9) Slack channel.

## Related documentation

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Related documentation
## Learn more

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants