In a business context, why would you ever use a binary output for a binary classifier? Its it almost always better to output class probability so the business can set their own threshold?

Is it not almost always better to use probability output? So the business had a view of the model confidence for each prediction and can act on this information rather than a more black box output?

binary business classifier context datascience probability set threshold