Skip to content

docs: update 0.4 release notes#262

Merged
rapids-bot[bot] merged 3 commits into
NVIDIA:release/0.4from
willkill07:wkk_docs-0.4-release-notes
Jun 12, 2026
Merged

docs: update 0.4 release notes#262
rapids-bot[bot] merged 3 commits into
NVIDIA:release/0.4from
willkill07:wkk_docs-0.4-release-notes

Conversation

@willkill07

@willkill07 willkill07 commented Jun 12, 2026

Copy link
Copy Markdown
Member

Overview

Updates the release-note documentation for the NeMo Relay 0.4 release using the merged commit range from 0.3.0..release/0.4 as the source set.

  • I confirm this contribution is my own work, or I have the right to submit it under this project's license.
  • I searched existing issues and open pull requests, and this does not duplicate existing work.

Details

  • Refreshes the release-notes overview from 0.3 to 0.4.
  • Rewrites highlights around host plugin installation, PII redaction, local Guardrails, pricing, ATOF streaming, ATIF HTTP storage, and coding-agent trace fidelity.
  • Updates known issues and fixed-items notes for 0.4 support boundaries and resolved integration/export issues.

Where should the reviewer start?

Start with docs/about-nemo-relay/release-notes/index.mdx for the high-level release framing, then review highlights.mdx and known-issues.mdx for the detailed 0.4 notes.

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • Relates to: none

Summary by CodeRabbit

  • Documentation
    • Updated release notes to NeMo Relay 0.4: replaced 0.3 content with 0.4 compatibility notes; added built-in Guardrails plugin support (remote and local Python-backed), local marketplace install/uninstall/doctor flows, Claude Code/Codex CLI plugin flows, layered plugin config, first‑party PII redaction helpers, pricing-aware observability with cost propagation (requires configured pricing sources), new ATOF streaming endpoints and ATIF HTTP remote storage, and prerequisites (Python 3.11+, Node.js 24+, nemoguardrails runtime).
  • Bug Fixes
    • Expanded known-issues and resolved-behavior lists covering reliability and observability fixes.

@willkill07 willkill07 requested a review from lvojtku as a code owner June 12, 2026 16:57
@github-actions github-actions Bot added size:M PR is medium Documentation documentation-related labels Jun 12, 2026
@coderabbitai

coderabbitai Bot commented Jun 12, 2026

Copy link
Copy Markdown

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: bb2aa195-c531-4b2c-ab21-c9561110c3e0

📥 Commits

Reviewing files that changed from the base of the PR and between 2e1d137 and 45afd4e.

📒 Files selected for processing (1)
  • docs/about-nemo-relay/release-notes/highlights.mdx
📜 Recent review details
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (1)
  • GitHub Check: Preview docs
🧰 Additional context used
📓 Path-based instructions (12)
{docs/**,README.md,CONTRIBUTING.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

{docs/**,README.md,CONTRIBUTING.md}: For docs-only changes, run targeted checks only if commands, package names, or examples changed. Use just docs for docs-site builds and just docs-linkcheck when links changed
Run docs site build with just docs

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,CONTRIBUTING.md,**/*.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Run docs link validation with just docs-linkcheck when links change

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Verify README and docs entry points still match current package names and paths for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,examples/**,README.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Verify examples still run with documented commands for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,**/Cargo.toml,**/package.json,**/*.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Ensure renamed public surfaces are reflected consistently in manifests and docs for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.{md,mdx,py,sh,yaml,yml,toml,json}

📄 CodeRabbit inference engine (.agents/skills/contribute-docs/SKILL.md)

Keep package names, repo references, and build commands current

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.mdx

📄 CodeRabbit inference engine (.agents/skills/contribute-docs/SKILL.md)

In MDX files, top-of-file comments must use JSX comment delimiters: {/* to open and */} to close. Do not use HTML comments for MDX SPDX headers.

MDX top-of-file SPDX comments must use {/* ... */} delimiters instead of HTML comment delimiters (Must-Fix)

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.{html,md,mdx}

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Include SPDX license header in HTML and Markdown files using HTML comment syntax

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
docs/**/*.{md,mdx}

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Update embedded documentation snippets, patch docs, and binding-support notes if examples or supported bindings changed

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
docs/**

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Run just docs or ./scripts/build-docs.sh html to regenerate ignored Fern API reference pages before validation for documentation site changes

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,CONTRIBUTING.md,RELEASING.md,SECURITY.md}

⚙️ CodeRabbit configuration file

{docs/**,README.md,CONTRIBUTING.md,RELEASING.md,SECURITY.md}: Review documentation for technical accuracy against the current API, command correctness, and consistency across language bindings.
Flag stale examples, missing SPDX headers where required, and instructions that no longer match CI or pre-commit behavior.

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
**

⚙️ CodeRabbit configuration file

**:

AGENTS.md

This file provides guidance to agents, including Claude Code and OpenAI Codex, when working in this repository.

Project Overview

NeMo Relay is a multi-language agent runtime framework for execution scopes, lifecycle events, middleware, plugins, and observability around tool and LLM calls. The core runtime is Rust. Primary supported bindings are Rust, Python, and Node.js. Go, WebAssembly, and the raw C FFI are experimental and source-first.

The shared runtime model is:

  1. Scope stacks decide where work belongs and which scope-local behavior is visible.
  2. Middleware registries decide what guardrails and intercepts run around managed calls.
  3. Plugins install reusable runtime behavior from configuration.
  4. Events record runtime behavior in ATOF form.
  5. Subscribers and exporters consume events in-process or export them to ATIF, OpenTelemetry, OpenInference, or other backends.

Repository Structure

The repository layout separates the Rust runtime, language bindings, documentation,
integration patches, and agent-facing skills.

crates/
  core/       # Rust core runtime crate, published as nemo-relay
  adaptive/   # Adaptive runtime primitives and plugin components
  python/     # PyO3 native extension for the Python package
  ffi/        # Raw C ABI layer used by downstream bindings such as Go
  node/       # NAPI Node.js binding and JavaScript/TypeScript entry points
  wasm/       # wasm-bindgen WebAssembly binding and JS wrappers
python/
  nemo_relay/  # Python wrapper package: scopes, tools, LLM, middleware, typed helpers, plugins, adaptive helpers
  tests/      # Python tests
go/
  nemo_relay/  # Experimental Go CGo binding and tests
fern/         # Fern documentation site
scripts/      # Stable wrappers and helper scripts; build/test/docs entry points live in justfile
third_party/  # P...

Files:

  • docs/about-nemo-relay/release-notes/highlights.mdx
🔇 Additional comments (1)
docs/about-nemo-relay/release-notes/highlights.mdx (1)

12-16: LGTM!


Walkthrough

Updates NeMo Relay release notes from 0.3 to 0.4 across highlights, index, and known-issues: new feature list (built-in Guardrails, CLI plugin flows, PII redaction, pricing/cost propagation, ATOF/ATIF endpoints), updated compatibility/prerequisites, and expanded known-issues and fixes.

Changes

NeMo Relay 0.4 Release Notes

Layer / File(s) Summary
Release compatibility and scope
docs/about-nemo-relay/release-notes/index.mdx, docs/about-nemo-relay/release-notes/highlights.mdx
Transitions "Current Release" to NeMo Relay 0.4 with updated compatibility notes covering Python-only guardrails removal, pricing source requirements, local guardrails mode prerequisites (Python 3.11+), Node.js 24+ minimum, and async native subscriber delivery. Replaces 0.3 feature scope with 0.4 items including built-in nemo_guardrails, CLI host plugin flows, layered config, PII redaction, cost propagation to observability, and ATOF/ATIF streaming/storage.
Feature highlights – CLI, guardrails, observability, integrations, and tooling
docs/about-nemo-relay/release-notes/highlights.mdx, docs/about-nemo-relay/release-notes/index.mdx
Expands highlights with host plugin install/uninstall/doctor flows and local marketplace; built-in guardrails with local Python backend and first-party PII redaction across language/WASM surfaces; new ATOF streaming endpoints (HTTP POST, WebSocket, NDJSON) and ATIF HTTP remote storage with model pricing and cost layering propagated to metrics and traces; integration improvements for Hermes, OpenClaw, LangChain, OpenInference, and Deep Agents/LangGraph; documentation and tooling updates for plugin setup, CI workflows, skill eval datasets, and dependency attribution cleanup.
Known issues and fixes in NeMo Relay 0.4
docs/about-nemo-relay/release-notes/known-issues.mdx
Adds "NeMo Relay 0.4" known-issues section with expanded version-specific limitations (host plugins, first-request capture, guardrails prerequisites, PII scope, pricing behavior, ATIF/ATOF endpoint and credential dependencies). Introduces "Fixed in NeMo Relay 0.4" section documenting deadlock/queuing fixes, observability resolution, structured ATIF and Hermes observation preservation, OpenClaw nested output consistency, LangChain serialization improvements, context-manager teardown, Node.js scope handle correctness, and Deep Agents annotations. Extends "Fixed in Earlier Releases" with OTLP HTTP TLS support and Go scope stack preservation across OS threads.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title follows Conventional Commits format with the 'docs' type and provides a concise imperative summary of the changes within the 72-character limit.
Description check ✅ Passed The description includes all required template sections: Overview with checkboxes, Details with specific change descriptions, reviewer guidance, and Related Issues section.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions

github-actions Bot commented Jun 12, 2026

Copy link
Copy Markdown

@willkill07 willkill07 self-assigned this Jun 12, 2026
@willkill07 willkill07 added this to the 0.4 milestone Jun 12, 2026
@willkill07 willkill07 force-pushed the wkk_docs-0.4-release-notes branch from d4b67a9 to 6feacd5 Compare June 12, 2026 17:40

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/about-nemo-relay/release-notes/known-issues.mdx`:
- Around line 35-36: Update the sentence in
docs/about-nemo-relay/release-notes/known-issues.mdx to state that the NeMo
Guardrails plugin local backend requires Python 3.11+ and
`nemoguardrails==0.22.0` (the value of SUPPORTED_NEMOGUARDRAILS_VERSION) to be
present in the Python worker/subprocess environment that runs the local backend
(not the main NeMo Relay runtime process); reference
SUPPORTED_NEMOGUARDRAILS_VERSION in
crates/core/src/plugins/nemo_guardrails/local_worker.py as the authoritative
pin.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: 7832f4c6-5302-4a79-b9ef-b57a8e2e410f

📥 Commits

Reviewing files that changed from the base of the PR and between d4b67a9 and 6feacd5.

📒 Files selected for processing (3)
  • docs/about-nemo-relay/release-notes/highlights.mdx
  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
📜 Review details
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (2)
  • GitHub Check: Check / Run
  • GitHub Check: Preview docs
🧰 Additional context used
📓 Path-based instructions (12)
{docs/**,README.md,CONTRIBUTING.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

{docs/**,README.md,CONTRIBUTING.md}: For docs-only changes, run targeted checks only if commands, package names, or examples changed. Use just docs for docs-site builds and just docs-linkcheck when links changed
Run docs site build with just docs

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,CONTRIBUTING.md,**/*.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Run docs link validation with just docs-linkcheck when links change

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Verify README and docs entry points still match current package names and paths for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,examples/**,README.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Verify examples still run with documented commands for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,**/Cargo.toml,**/package.json,**/*.md}

📄 CodeRabbit inference engine (.agents/skills/validate-change/SKILL.md)

Ensure renamed public surfaces are reflected consistently in manifests and docs for large or public-facing changes

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.{md,mdx,py,sh,yaml,yml,toml,json}

📄 CodeRabbit inference engine (.agents/skills/contribute-docs/SKILL.md)

Keep package names, repo references, and build commands current

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.mdx

📄 CodeRabbit inference engine (.agents/skills/contribute-docs/SKILL.md)

In MDX files, top-of-file comments must use JSX comment delimiters: {/* to open and */} to close. Do not use HTML comments for MDX SPDX headers.

MDX top-of-file SPDX comments must use {/* ... */} delimiters instead of HTML comment delimiters (Must-Fix)

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
**/*.{html,md,mdx}

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Include SPDX license header in HTML and Markdown files using HTML comment syntax

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
docs/**/*.{md,mdx}

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Update embedded documentation snippets, patch docs, and binding-support notes if examples or supported bindings changed

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
docs/**

📄 CodeRabbit inference engine (CONTRIBUTING.md)

Run just docs or ./scripts/build-docs.sh html to regenerate ignored Fern API reference pages before validation for documentation site changes

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
{docs/**,README.md,CONTRIBUTING.md,RELEASING.md,SECURITY.md}

⚙️ CodeRabbit configuration file

{docs/**,README.md,CONTRIBUTING.md,RELEASING.md,SECURITY.md}: Review documentation for technical accuracy against the current API, command correctness, and consistency across language bindings.
Flag stale examples, missing SPDX headers where required, and instructions that no longer match CI or pre-commit behavior.

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
**

⚙️ CodeRabbit configuration file

**:

AGENTS.md

This file provides guidance to agents, including Claude Code and OpenAI Codex, when working in this repository.

Project Overview

NeMo Relay is a multi-language agent runtime framework for execution scopes, lifecycle events, middleware, plugins, and observability around tool and LLM calls. The core runtime is Rust. Primary supported bindings are Rust, Python, and Node.js. Go, WebAssembly, and the raw C FFI are experimental and source-first.

The shared runtime model is:

  1. Scope stacks decide where work belongs and which scope-local behavior is visible.
  2. Middleware registries decide what guardrails and intercepts run around managed calls.
  3. Plugins install reusable runtime behavior from configuration.
  4. Events record runtime behavior in ATOF form.
  5. Subscribers and exporters consume events in-process or export them to ATIF, OpenTelemetry, OpenInference, or other backends.

Repository Structure

The repository layout separates the Rust runtime, language bindings, documentation,
integration patches, and agent-facing skills.

crates/
  core/       # Rust core runtime crate, published as nemo-relay
  adaptive/   # Adaptive runtime primitives and plugin components
  python/     # PyO3 native extension for the Python package
  ffi/        # Raw C ABI layer used by downstream bindings such as Go
  node/       # NAPI Node.js binding and JavaScript/TypeScript entry points
  wasm/       # wasm-bindgen WebAssembly binding and JS wrappers
python/
  nemo_relay/  # Python wrapper package: scopes, tools, LLM, middleware, typed helpers, plugins, adaptive helpers
  tests/      # Python tests
go/
  nemo_relay/  # Experimental Go CGo binding and tests
fern/         # Fern documentation site
scripts/      # Stable wrappers and helper scripts; build/test/docs entry points live in justfile
third_party/  # P...

Files:

  • docs/about-nemo-relay/release-notes/index.mdx
  • docs/about-nemo-relay/release-notes/known-issues.mdx
  • docs/about-nemo-relay/release-notes/highlights.mdx
🪛 LanguageTool
docs/about-nemo-relay/release-notes/highlights.mdx

[style] ~52-~52: Three successive sentences begin with the same word. Consider rewording the sentence or use a thesaurus to find a synonym.
Context: ...e S3-compatible storage destinations. - Added model-pricing lookup and cost layering ...

(ENGLISH_WORD_REPEAT_BEGINNING_RULE)

🔇 Additional comments (2)
docs/about-nemo-relay/release-notes/highlights.mdx (1)

24-25: Duplicate Guardrails dependency note.

Same nemoguardrails requirement as known-issues.mdx; no separate action here.

docs/about-nemo-relay/release-notes/index.mdx (1)

15-18: LGTM!

Also applies to: 22-31, 41-55, 59-70

Comment thread docs/about-nemo-relay/release-notes/known-issues.mdx Outdated
Signed-off-by: Will Killian <wkillian@nvidia.com>

@lvojtku lvojtku left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved with comments

Comment thread docs/about-nemo-relay/release-notes/highlights.mdx Outdated
Co-authored-by: lvojtku <lvojtku@nvidia.com>
Signed-off-by: Will Killian <2007799+willkill07@users.noreply.github.com>
Comment thread docs/about-nemo-relay/release-notes/highlights.mdx Outdated
Comment thread docs/about-nemo-relay/release-notes/highlights.mdx Outdated
Co-authored-by: Will Killian <2007799+willkill07@users.noreply.github.com>
Signed-off-by: Will Killian <2007799+willkill07@users.noreply.github.com>

@mnajafian-nv mnajafian-nv left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thank you

@willkill07

Copy link
Copy Markdown
Member Author

/merge

@rapids-bot rapids-bot Bot merged commit 5710af2 into NVIDIA:release/0.4 Jun 12, 2026
26 checks passed
@willkill07 willkill07 deleted the wkk_docs-0.4-release-notes branch June 15, 2026 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Documentation documentation-related size:M PR is medium

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants