Deep Learning notes

An unusual intro to deep learning.

The only primitive operation that one needs to understand to get started on in Deep Learning is dot product: vectors r and x of same dimension d can be dotted to produce a scalar


⟨r,x⟩=∑i∈[d]rixi\langle r,x \rangle = \sum_{i\in [d]}{r_i x_i} ⟨r,x⟩=∑i∈[d]​ri​xi​

.

To do this operation in parallel across multiple vectors

rr r

, one can write it as a matrix vector product. One way to think about these dot product is that …

deep learning intro multiple notes product vectors