Skip to content

docs: add quantization guide#17

Merged
wavekat-eason merged 7 commits into
mainfrom
docs/quantization-guide
Apr 20, 2026
Merged

docs: add quantization guide#17
wavekat-eason merged 7 commits into
mainfrom
docs/quantization-guide

Conversation

@wavekat-eason

@wavekat-eason wavekat-eason commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add a Quantization section to README explaining the INT4 quantization method (RTN weight-only via ONNX Runtime's MatMulNBitsQuantizer)
  • Link to tools/qwen3-tts-onnx/ with reproduction steps for both 1.7B VoiceDesign and 0.6B Base models
  • Document standalone quantize_int4.py flags for custom settings

Addresses user questions about how the published INT4 models were quantized.

Test plan

  • Verify README renders correctly on GitHub
  • Confirm links to tools/qwen3-tts-onnx/ and ONNX Runtime docs resolve

🤖 Generated with Claude Code

wavekat-eason and others added 7 commits April 21, 2026 10:16
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@wavekat-eason wavekat-eason merged commit cc39d15 into main Apr 20, 2026
5 checks passed
@wavekat-eason wavekat-eason deleted the docs/quantization-guide branch April 20, 2026 22:31
@github-actions github-actions Bot mentioned this pull request Apr 20, 2026
wavekat-eason pushed a commit that referenced this pull request Apr 20, 2026
## 🤖 New release

* `wavekat-tts`: 0.0.3 -> 0.0.4 (✓ API compatible changes)

<details><summary><i><b>Changelog</b></i></summary><p>

<blockquote>

##
[0.0.4](v0.0.3...v0.0.4)
- 2026-04-20

### Other

- add quantization guide
([#17](#17))
</blockquote>


</p></details>

---
This PR was generated with
[release-plz](https://github.com/release-plz/release-plz/).

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant