I don't think there is much to do for the small guys in deep learning anymore.

It's common sense that the intelligence will require extremely large amount of parameters to be of good use which is quite not possible to get hands on by small guys of some some research labs

common sense deep learning deeplearning good intelligence labs parameters research sense small think will