Failing to replicate 'Deep Residual Learning' "[P]"

Hi Everyone,

for learning purposes I've been replicating the methods from Kaiming He's 2015 ['Deep Residual Learning for Image Recognition'](https://arxiv.org/pdf/1512.03385). I've built the VGG inspired plain-CNN as well as the ResNet architectures (standard & bottleneck).

However, I have been unable to replicate the degradation (saturation of accuracy) problem highlighted in the publication. The %-error figures in the publication show clear drops in %-error as training progresses followed by stagnation.

My figures appear to stagnate, but its clear the model is …

accuracy clear data error however machinelearning publication replicate residual show training validation