使用word2vec的两个句子之间的相似性

Question

句子 1 = "this is a sentence" 句子 2 = "this is sentence 2" 我想找出这两句话之间的相似之处。有人可以使用 Word2Vec

帮助我得到它的 完整代码

Answer 1

假设您有任何 word2vec 实用程序 word2vec:

import numpy as np

words1 = sentence1.split(' ')
words2 = sentence2.split(' ')

#The meaning of the sentence can be interpreted as the average of its words
sentence1_meaning = word2vec(words1[0])
count = 1
for w in words1[1:]:
    sentence1_meaning = np.add(sentence1_meaning, word2vec(w))
    count += 1
sentence1_meaning /= count

sentence2_meaning = word2vec(words2[0])
count = 1
for w in words2[1:]:
    sentence2_meaning = np.add(sentence2_meaning, word2vec(w))
    count += 1
sentence2_meaning /= count

#Similarity is the cosine between the vectors
similarity = np.dot(sentence1_meaning, sentence2_meaning)/(np.linalg.norm(sentence1_meaning)*np.linalg.norm(sentence2_meaning))

使用word2vec的两个句子之间的相似性

Similarity between two sentences using word2vec

python

machine-learning

deep-learning

sentence-similarity