Detecting Brand Name Through Logos

I have been given a set of images. Each Image contains some number of billboards (between 1-4). My task is to detect all the brands that are on the billboards. When it comes to text part, I already have a solution in mind. The problem is in some of the images, there is only logo of the brand on the billboard. How do I tackle such cases? Any suggestions or heads up is appreciated.

brand brands deeplearning image images logo logos mind part set solution text through