Instructions to use ryanontheinside/stable-audio-3-optimized-fp8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use ryanontheinside/stable-audio-3-optimized-fp8 with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Replace with baseline PR47 recipe artifacts (listening-validated engine)
Browse files- README.md +10 -7
- onnx/sa3-m/dit_fp8.onnx +2 -2
- tensorRT/sm_120/sa3-m/dit_fp8.trt +2 -2
README.md
CHANGED
|
@@ -15,10 +15,9 @@ tags:
|
|
| 15 |
FP8 GEMM-trunk quantization of the Stable Audio 3 medium DiT, built from
|
| 16 |
`stabilityai/stable-audio-3-optimized` `onnx/sa3-m/dit_fp16mixed.onnx` with the
|
| 17 |
producer recipe in [Stability-AI/stable-audio-3 PR #47](https://github.com/Stability-AI/stable-audio-3/pull/47)
|
| 18 |
-
(`build/make_calib.py` + `build/build_dit_fp8.py`)
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
base model for terms.
|
| 22 |
|
| 23 |
## Contents
|
| 24 |
|
|
@@ -31,10 +30,14 @@ base model for terms.
|
|
| 31 |
|
| 32 |
## Validation (vs the FP16-mixed engine, 47 prompts x 8 sigmas, L=646, RTX 5090)
|
| 33 |
|
| 34 |
-
- worst single-step latent cosine (x + dt*v
|
| 35 |
-
- 8-step compounded final-latent cosine over 47 prompts: mean 0.
|
| 36 |
-
median 0.
|
| 37 |
perturbation alone compounds to ~0.967, so this is a guide, not a gate)
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
- step latency B=1 L=646: ~10.6-11.0 ms vs ~18.7-19.4 ms FP16-mixed (~1.8x)
|
| 39 |
- under the stochastic pingpong sampler the engine produces a different but
|
| 40 |
comparable sample
|
|
|
|
| 15 |
FP8 GEMM-trunk quantization of the Stable Audio 3 medium DiT, built from
|
| 16 |
`stabilityai/stable-audio-3-optimized` `onnx/sa3-m/dit_fp16mixed.onnx` with the
|
| 17 |
producer recipe in [Stability-AI/stable-audio-3 PR #47](https://github.com/Stability-AI/stable-audio-3/pull/47)
|
| 18 |
+
(`build/make_calib.py` + `build/build_dit_fp8.py`). This is a derivative of
|
| 19 |
+
Stability AI's model weights and is distributed under the Stability AI
|
| 20 |
+
Community License; see the base model for terms.
|
|
|
|
| 21 |
|
| 22 |
## Contents
|
| 23 |
|
|
|
|
| 30 |
|
| 31 |
## Validation (vs the FP16-mixed engine, 47 prompts x 8 sigmas, L=646, RTX 5090)
|
| 32 |
|
| 33 |
+
- worst single-step latent cosine (x + dt*v, n=376): 0.9982
|
| 34 |
+
- 8-step compounded euler final-latent cosine over 47 prompts: mean 0.953,
|
| 35 |
+
median 0.957, worst 0.873 (the rollout is chaotic; a 1e-3 input
|
| 36 |
perturbation alone compounds to ~0.967, so this is a guide, not a gate)
|
| 37 |
+
- decoded audio under the production pingpong sampler tracks the FP16-mixed
|
| 38 |
+
generation at ~0.90 RMS-curve correlation (same conditioning and seeds) and
|
| 39 |
+
was validated by listening: the published sm_120 engine here is the exact
|
| 40 |
+
engine that passed that test
|
| 41 |
- step latency B=1 L=646: ~10.6-11.0 ms vs ~18.7-19.4 ms FP16-mixed (~1.8x)
|
| 42 |
- under the stochastic pingpong sampler the engine produces a different but
|
| 43 |
comparable sample
|
onnx/sa3-m/dit_fp8.onnx
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c4b4bafb3de4f7d7abc1c3f294eaad8276f2251f5c60ef538b468a7c8074c460
|
| 3 |
+
size 12414124
|
tensorRT/sm_120/sa3-m/dit_fp8.trt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:674a3ba7d4b52383edbcd2fffcb1b224fd710e6de19ae947af680b5b54cd3991
|
| 3 |
+
size 1493783180
|