Automatic Differentiation with Python and C++ for Deep Learning

This story explores automatic differentiation, a feature of modern Deep Learning frameworks that automatically calculates the parameter gradients during the training loop. The story introduces this technology in conjunction with practical examples using Python and C++.

Roadmap

• Automatic Differentiation: what is, the motivation, etc
• Automatic Differentiation in Python with TensorFlow
• Automatic Differentiation in C++ with Eigen
• Conclusion

Automatic Differentiation

Modern frameworks such as PyTorch or TensorFlow have an enhanced functionality called automatic …

artificial intelligence autodiff coding cpp deep learning deep learning frameworks differentiation examples feature figure frameworks loop machine learning modern motivation practical programming python story technology training