Instructions to use stabilityai/stable-audio-3-optimized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Stable Audio 3
How to use stabilityai/stable-audio-3-optimized with Stable Audio 3:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Rebuild medium DiT fp16-mixed engines (sm_90 + new sm_120): attention now fuses, 4.3x faster
#4
by cortexelus - opened
- tensorRT/sm_120/sa3-m/dit_bf16.trt +3 -0
- tensorRT/sm_120/sa3-m/dit_fp16mixed.trt +3 -0
- tensorRT/sm_120/sa3-m/dit_fp32.trt +3 -0
- tensorRT/sm_120/sa3-sm-music/dit_fp16mixed.trt +3 -0
- tensorRT/sm_120/sa3-sm-music/dit_fp32.trt +3 -0
- tensorRT/sm_120/sa3-sm-sfx/dit_fp16mixed.trt +3 -0
- tensorRT/sm_120/sa3-sm-sfx/dit_fp32.trt +3 -0
- tensorRT/sm_120/same-l/dec_dynamic_fp32.trt +3 -0
- tensorRT/sm_120/same-l/dec_dynamic_triton_swa.trt +3 -0
- tensorRT/sm_120/same-l/enc_dynamic_triton_swa.trt +3 -0
- tensorRT/sm_120/same-s/dec_dynamic_bf16.trt +3 -0
- tensorRT/sm_120/same-s/dec_dynamic_fp32.trt +3 -0
- tensorRT/sm_120/same-s/enc_dynamic_bf16.trt +3 -0
- tensorRT/sm_120/t5gemma/t5gemma_fp16mixed.trt +3 -0
- tensorRT/sm_120/t5gemma/tokenizer.json +3 -0
- tensorRT/sm_90/sa3-m/dit_fp16mixed.trt +2 -2
tensorRT/sm_120/sa3-m/dit_bf16.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dc2fcfd7f1e94729164bbde2a5e129ce0bfa6bb0499b37f24b3d9ae4a05518c6
|
| 3 |
+
size 2924359388
|
tensorRT/sm_120/sa3-m/dit_fp16mixed.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ff6fdfa5f02fdfd8dbe6f5b1c2940afb44b508ae4b773b89d8bc5339e38dbed2
|
| 3 |
+
size 2917847172
|
tensorRT/sm_120/sa3-m/dit_fp32.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:caf0b4c767eab3c8ee267cc6882093eeec488f163999ea1b41c7ef170f5f2acb
|
| 3 |
+
size 5821527372
|
tensorRT/sm_120/sa3-sm-music/dit_fp16mixed.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5db04f5303fbe90290e928260ea4d0bb124057dabc93d68fc8286f763c4d72c7
|
| 3 |
+
size 924774476
|
tensorRT/sm_120/sa3-sm-music/dit_fp32.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53fe25491a12c57e585495f1d72eed90b75ce253fb48d038d68c99b014813288
|
| 3 |
+
size 1843281020
|
tensorRT/sm_120/sa3-sm-sfx/dit_fp16mixed.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e74cc523baf9c84e926dc377c495e1390bb5a5db26755a7172a200140636340a
|
| 3 |
+
size 924775276
|
tensorRT/sm_120/sa3-sm-sfx/dit_fp32.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b30e9a8f6fd5e1d8110f2ddbe2fb52fa89a48b2093b03d9045a0797820b61511
|
| 3 |
+
size 1843264284
|
tensorRT/sm_120/same-l/dec_dynamic_fp32.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f53cb8168ac5d1f378ab0223c8d043d5905161223be69261a9565645af4c4e36
|
| 3 |
+
size 1707141748
|
tensorRT/sm_120/same-l/dec_dynamic_triton_swa.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ccd5f48922fe46711593e5251fe45ef40a8a5eac52462b6d72ed69595458fd42
|
| 3 |
+
size 1194932516
|
tensorRT/sm_120/same-l/enc_dynamic_triton_swa.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a72e57ecee8c0d6db9077474bcd93086a7bd709cfcb1de3ab126bcfdc205c89
|
| 3 |
+
size 1194895540
|
tensorRT/sm_120/same-s/dec_dynamic_bf16.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5c9fb06d53e19a31f2922a0d5df9237546894fa1f10fd87695bb7f9c236826e8
|
| 3 |
+
size 115176812
|
tensorRT/sm_120/same-s/dec_dynamic_fp32.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37dbbfe2467e082434a88ebe3db76515dddab19c21c72b06eb00c682fda77c87
|
| 3 |
+
size 225065300
|
tensorRT/sm_120/same-s/enc_dynamic_bf16.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6986ddfe6a06962c072bfeb2cfa2a022b577fd1ae0840150b6b264ced3cdc4b9
|
| 3 |
+
size 111504324
|
tensorRT/sm_120/t5gemma/t5gemma_fp16mixed.trt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4f8998e66943bc037fb8e55b7ba025ab916c620be5dbc01eff743efb18379cb4
|
| 3 |
+
size 621003924
|
tensorRT/sm_120/t5gemma/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7794135caa3ea73918949c902a781cc61dab674a4b59c17d85931c77c1114cbd
|
| 3 |
+
size 34362429
|
tensorRT/sm_90/sa3-m/dit_fp16mixed.trt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d924c1fb8e0b5c5e19c82da96609eed2c999818af029d606f2f9c644a12da0da
|
| 3 |
+
size 2921827284
|