BiMaCoSR: Binary One-Step Diffusion Model Leveraging Flexible Matrix Compression for Real Super-Resolution
Kai Liu, Kaicheng Yang, Zheng Chen, Zhiteng Li,Yong Guo, Wenbo Li, Linghe Kong, and Yulun Zhang.
"BiMaCoSR: Binary One-Step Diffusion Model Leveraging Flexible Matrix Compression for Real Super-Resolution", arXiv, 2025
[arXiv] [supplementary material] [visual results] [pretrained models]
- 2025-02-04: This arXiv version and supplementary material are released.
- 2025-02-01: This repo is released.
Abstract: While super-resolution (SR) methods based on diffusion models (DM) have demonstrated inspiring performance, their deployment is impeded due to the heavy request of memory and computation. Recent researchers apply two kinds of methods to compress or fasten the DM. One is to compress the DM into 1-bit, aka binarization, alleviating the storage and computation pressure. The other distills the multi-step DM into only one step, significantly speeding up inference process. Nonetheless, it remains impossible to deploy DM to resource-limited edge devices. To address this problem, we propose BiMaCoSR, which combines binarization and one-step distillation to obtain extreme compression and acceleration. To prevent the catastrophic collapse of the model caused by binarization, we proposed sparse matrix branch (SMB) and low rank matrixbranch (LRM). Both auxiliary branches pass the full-precision (FP) information but in different ways. SMB absorbs the extreme values and its output is high rank, carrying abundant FP information. Whereas, the design of LRMB is inspired by LoRA and is initialized with the top r SVD components, outputting low rank representation. The computation and storage overhead of our proposed branches can be safely ignored. Comprehensive comparison experiments are conducted to exhibit BiMaCoSR outperforms current state-of-the-art binarization methods and gains competitive performance compared with FP one-step model. BiMaCoSR achieves a 23.8x compression ratio and a 27.4x speedup ratio compared to FP counterpart.
Image | HR | SinSR(FP) | XNOR | ReSTE | BiMaCoSR (ours) |
---|---|---|---|---|---|
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
- Release datasets.
- Release training and testing code.
- Release pre-trained BiMaCoSR.
- Provide WebUI.
- Provide HuggingFace🤗 demo.
We achieve state-of-the-art performance. Detailed results can be found in the paper. All visual results of BiMaCoSR will be provided soon.
Click to expand
- results in Table 1 of the main paper
- visual comparison (x4) in the main paper
- visual comparison (x4) in the supplementary material
If you find the code helpful in your research or work, please cite it!
@article{liu2025bimacosr,
title={BiMaCoSR: Binary One-Step Diffusion Model Leveraging Flexible Matrix Compression for Real Super-Resolution},
author={Liu, Kai and Yang, Kaicheng and Chen, Zheng and Li, Zhiteng and Li, Wenbo and Guo, Yong and Kong, Linghe and Zhang, Yulun},
journal={arXiv preprint arXiv:2502.00333},
year={2025}
}
This code is built on SinSR.