How to design a lightweigth DL model

Web: https://www.reddit.com/r/computervision/comments/sfsf5m/how_to_design_a_lightweigth_dl_model/

I have to design an ML model for a computer vision task. The problem is that all state-of-the-art solutions for this specific problem use relatively large models not suitable for real-time applications. What I want to do instead is design a lightweight model (e.g. smaller than 5M parameters).

Where can I start to look into deep learning techniques to achieve this? (Smth like depthwise separable conv or attentions, I guess)

It will be a Multibranch model with multiple inputs .. …

computervision design dl model