[D] In Neural Networks is it effective to select the best-performing output neurons to train the model?

Imagine I have M number of inputs and 1 target. But instead of having 1 neuron in output layer in model, I put 1000 neurones in output layer with a custom loss function that calculates loss of each individual output with target in a batch size of X. Then I can find the minimum mean loss of each output in a batch. Then will back-propagate based on minimum loss. In next epoch I’ll keep the weights of the selected neuron, …

function imagine layer loss machinelearning networks neural networks neuron neurons train