Label mall objects in images or not?

Hi, i am deploying a YOLO based model where i am detecting mouring boillards.

I am in the phase of labelling my images and i was thinking about what to do with the small objects (the far away ones). On my task, objects far away than 20 meters (more or less) are NOT OF INTERESEST, as they are far enought to not be taking in mind in that image.

So my question is, lets say we have this image:

https://preview.redd.it/t0e6fpcvgy9b1.jpg?width=1920&format=pjpg&auto=webp&v=enabled&s=b495077a810e3c580ae2490bd799a650ad8e5e0c …

computervision images labelling objects small thinking yolo