FastText class 使用未定义的对象

FastText class uses undefined object

我在阅读此处找到的一篇文章时遇到了 FastText class...

https://stackabuse.com/python-for-nlp-working-with-facebook-fasttext-library/#disqus_thread

作者使用了未定义的对象"word_tokenized_corpus"。

ft_model = FastText(word_tokenized_corpus,
                      size=embedding_size,
                      window=window_size,
                      min_count=min_word,
                      sample=down_sampling,
                      sg=1,
                      iter=100)

由于显而易见的原因,我收到了一个错误。如何正确启动 class?

文章已被作者更新,增加了以下代码:

final_corpus = [
    preprocess_text(sentence)
    for sentence in artificial_intelligence
    if sentence.strip() != ""
]

word_punctuation_tokenizer = nltk.WordPunctTokenizer()
word_tokenized_corpus = [
    word_punctuation_tokenizer.tokenize(sent) for sent in final_corpus
]