Nov. 8, 2023, 9:07 p.m. | /u/shefcu

Machine Learning www.reddit.com

Hi everyone!

A couple of days ago, I finally decided to follow [Andrej Karpathy's micrograd tutorial](https://www.youtube.com/watch?v=VMj-3S1tku0). I liked the concepts so much I implemented it in C++ and added more functionality:

\- Optimizers: Adam, SGD with momentum
\- Activation functions: tanh, sigmoid, relu

I tried to make both the API as well as internal library as clean as possible so that everyone could understand the basic algorithms behind deep learning. Here is the project's [repo](https://github.com/fszewczyk/shkyera-grad) and a [get started guide](https://fszewczyk.github.io/shkyera-grad/md_docs_tutorials_GetStarted.html). …

adam functions machinelearning relu sigmoid

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US