Why is word2vec linear?

I was trying to implement a simpler version of word2vec from scratch. While reading up on it, I realised that word2vec implementation does not use any non linearity! Why is it so good at creating embeddings without a non linearity? And isn't non linearity a crucial part of NN? How can a linear function capture complex relationships between words?

languagetechnology linear word2vec