Processing 80 camera streams on a single rack-mounted server - anyone worked on a similar problem?

I'm working on a surveillance application where we want to simultaneously process streams from up to 80 IP cameras on a single on-premises server. For each camera, we're:

1. decoding a frame from the incoming RTSP stream
2. performing pre-processing (blur removal, etc)
3. running inference on that frame using a YOLOv8 model
4. parsing results and triggering downstream logic based on what objects are detected

This is a lot of processing to do for 80 cameras at once! Plus, …

application cameras computervision decoding etc on-premises pre-processing process processing server surveillance