Skip to content

feat: add nvidia-tegra-nvgpu extension for Jetson Orin NX (GA10B)#1062

Draft
schwankner wants to merge 1 commit intosiderolabs:release-1.13from
schwankner:feat/nvidia-tegra-nvgpu
Draft

feat: add nvidia-tegra-nvgpu extension for Jetson Orin NX (GA10B)#1062
schwankner wants to merge 1 commit intosiderolabs:release-1.13from
schwankner:feat/nvidia-tegra-nvgpu

Conversation

@schwankner
Copy link
Copy Markdown

@schwankner schwankner commented May 2, 2026

Summary

Adds a Talos system extension packaging the NVIDIA GA10B GPU driver stack for Jetson Orin NX / Orin Nano (Tegra234 SoC).

** Draft — blocked on siderolabs/pkgs#1518** (kernel package must merge first to produce nvidia-tegra-nvgpu-pkg image)

Modules

Module Source Purpose
host1x.ko OE4T/linux-nv-oot Syncpoint allocator with GA10B ERRATA_SYNCPT_INVALID_ID_0 fix
host1x_fence.ko OE4T/linux-nv-oot DMA fence bridge for GPU/CPU sync
nvmap.ko OE4T/linux-nv-oot GPU memory allocator
mc_utils.ko OE4T/linux-nv-oot Memory controller EMC frequency helper
governor_pod_scaling.ko OE4T/linux-nv-oot nvhost_podgov devfreq governor
nvhost_ctrl_shim.ko in-tree (pkgs#1518) /dev/nvhost-ctrl for JetPack 6 CUDA runtime (SYNCPT_WAITMEX)
nvgpu.ko OE4T/linux-nvgpu Main GA10B GPU driver

Performance (Jetson Orin NX 16GB, Talos v1.13.0, CUDA 12.6)

  • ~60 tok/s with qwen2.5:0.5b (Q4_K_M, full GPU offload)
  • ~16 tok/s with qwen3:4b (Q4_K_M, full GPU offload, 3.1 GB VRAM)

Required companion extensions

  • nvidia-firmware-ext — GPU firmware blobs (PMU key, GSP firmware from JetPack r36.5)

Dependency chain

siderolabs/pkgs#1518     → builds nvidia-tegra-nvgpu-pkg OCI image
siderolabs/extensions    → this PR, wraps the pkg image as a Talos extension
siderolabs/sbc-jetson    → overlay providing CDI setup + device plugin DaemonSets

References

Adds a Talos system extension packaging the NVIDIA Jetson Orin GPU
driver stack built from OE4T sources (patches-r36.5 / patches-rel-36):

Modules:
- host1x.ko + host1x_fence.ko — OE4T syncpoint support (GA10B fixes)
- nvmap.ko, mc_utils.ko, governor_pod_scaling.ko — support modules
- nvhost_ctrl_shim.ko — /dev/nvhost-ctrl bridge for JetPack 6 CUDA
- nvgpu.ko — main GA10B Ampere GPU driver

Kernel package built in siderolabs/pkgs#1518.
Requires nvidia-firmware-ext for GPU firmware blobs.

Tested: ~60 tok/s (qwen2.5:0.5b) on Jetson Orin NX 16GB, Talos v1.13.0.

References: siderolabs/pkgs#1518
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant