Skip-gram Word2Vec
Skip-gram Word2Vec
**Skip-gram Word2Vec** is an architecture for computing word embeddings. Instead of using surrounding words to predict the center word, as with CBow Word2Vec, Skip-gram Word2Vec uses the central word to predict the surrounding words.

The skip-gram objective function sums the log probabilities of the surrounding $n$ words to the left and right of the target word $w\_{t}$ to produce the following objective:

$$J\_\theta = \frac{1}{T}\sum^{T}\_{t=1}\sum\_{-n\leq{j}\leq{n}, \neq{0}}\log{p}\left(w\_{j+1}\mid{w\_{t}}\right)$$
Efficient Estimation of Word Representations in Vector Space
https://paperswithcode.com/paper/efficient-estimation-of-word-representations
Efficient Estimation of Word Representations in Vector Space