g-ronimo commited on
Commit
2cfce8a
·
verified ·
1 Parent(s): 13197a4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -15
README.md CHANGED
@@ -28,21 +28,6 @@ Used by **[wipe.photos](https://wipe.photos)** — a fully private, in-browser o
28
 
29
  **`lama_512_fp16.onnx` is recommended when you can fix the input to 512×512** (as wipe.photos does): the whole graph computes in fp16, and the FFTs are replaced by fixed-size matmuls so every op runs on the GPU with no CPU fallbacks — 0.43s vs 2.18s per 512×512 inference on WebGPU (M-series Mac), at the same quality as the weight-only variants (zero pixels differing by more than 50/255 from fp32). For arbitrary input sizes, use `lama_fp16.onnx` — half the size of fp32 with a max pixel difference of just 3–11/255.
30
 
31
- ## Benchmark
32
-
33
- Tested on two images (Node.js, CPU):
34
-
35
- | | fp32 | fp16 | int8 |
36
- |---|---|---|---|
37
- | File size | 209 MB | **110 MB** | 61.5 MB |
38
- | Load time | 0.69–0.81s | **0.40–0.41s** | 0.29–0.30s |
39
- | Inference time | 13–19s | 13–19s | 13–19s |
40
- | Max pixel diff (example.jpg) | — | **11** | 24 |
41
- | Max pixel diff (download.png) | — | **3** | 48 |
42
- | Pixels > 50 diff | — | **0** | 0 |
43
-
44
- Inference time is identical across all three — the compressed weights are dequantized to fp32 before each Conv so the CPU does the same work. The savings are purely storage and download size.
45
-
46
  ## Input
47
 
48
  | Name | Shape | Description |
 
28
 
29
  **`lama_512_fp16.onnx` is recommended when you can fix the input to 512×512** (as wipe.photos does): the whole graph computes in fp16, and the FFTs are replaced by fixed-size matmuls so every op runs on the GPU with no CPU fallbacks — 0.43s vs 2.18s per 512×512 inference on WebGPU (M-series Mac), at the same quality as the weight-only variants (zero pixels differing by more than 50/255 from fp32). For arbitrary input sizes, use `lama_fp16.onnx` — half the size of fp32 with a max pixel difference of just 3–11/255.
30
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  ## Input
32
 
33
  | Name | Shape | Description |