Model Compression & Optimization

Model compression has emerged as an important area of research for deploying deep learning models on IoT devices. However, model compression is not a sufficient solution to fit the models within the memory of a single device; as a result we need to distribute them across multiple devices. This leads to a distributed inference paradigm in which communication costs represent another major bottleneck. To this end, we focus on knowledge distillation and ‘teacher’ – ‘student’ type of architectures for distributed model compression, as well as data independent model compression.

model compressions

Selected Publications

13 entries « ‹ 1 of 3 › »

Munir, Mustafa; Li, Guihong; Rahman, Md Mostafijur; Zhang, Alex; Marculescu, Radu

From Data to Design: Leveraging Frequency Statistics for Efficient Neural Network Architectures Conference Forthcoming

2025 Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Forthcoming.

BibTeX

Munir, Mustafa; Rahman, Md Mostafijur; Marculescu, Radu

RapidNet: Multi-Level Dilated Convolution Based Mobile Backbone Conference

2025 Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2025), 2025.

BibTeX

Li, Guihong; Bhardwaj, Kartikeya; Yang, Yuedong; Marculescu, Radu

TIPS: Topologically Important Path Sampling for Anytime Neural Networks Conference

International Conference on Machine Learning (ICML), 2023.

Links | BibTeX

Goksoy, Alper-A; Li, Guihong; Mandal, Sumit K.; Ogras, Umit Y.; Marculescu, Radu

CANNON: Communication-Aware Sparse Neural Network Optimization Journal Article

In: IEEE Transactions on Emerging Topics in Computing, 2023.

Links | BibTeX

Hoang, Duc N. M; Liu, Shiwei; Marculescu, Radu; Wang, Zhangyang

Revisiting Pruning at Initialization through the Lens of Ramanujan Graph Conference

International Conference on Learning Representations (ICLR), 2023.

Links | BibTeX

Krishnakumar, Anish; Marculescu, Radu; Ogras, Umit Y

INDENT: Incremental Online Decision Tree Training for Domain-Specific Systems-on-Chip Proceedings Article

In: Proceedings of the 41st IEEE/ACM International Conference on Computer-Aided Design (ICCAD), pp. 1-9, 2022.

Links | BibTeX

13 entries « ‹ 1 of 3 › »