在 python 中对文本进行预处理后如何删除空值

Question

例如我有一条推文“@cintya @groot @smanela https://blog...” 并且我做了一个预处理过程，link和mention已经被删除了，我觉得应该丢掉。但在 CSV 中，它们 return 是一个空值。我该如何修复它们？这是我的代码

def replaceMultiple(mainString, toBeReplaces, newString):
    for elem in toBeReplaces :
        if elem in mainString :
            mainString = mainString.replace(elem, newString)
    return  mainString

with open('datalatihNegatif.csv', encoding='utf-8') as csvfile:
    readCSV = csv.reader(csvfile, delimiter=',')
    for row in readCSV:
        _word = []
        username = row[0]
        date = row[1]
        text = row[2].lower()
        text = re.sub(r'@[A-Za-z0-9_]+','',text)
        text = re.sub(r'http\S+', '',text)

        text = replaceMultiple(text, ["!","@","#","$","%","^","&","*","(",
                                      ")","_","-","+","=","{","}","[","]",
                                      "\","/",",",".","?","<",">",":",";",
                                      "'",'"',"~","0","1","2","3","4","5","6","7","8","9"], '')
        text = text.strip()
        nltk_tokens = nltk.word_tokenize(text)
        stop_words = set(stopwords.words("indonesian"))
        stop_words_new = ['i','liked','video','an','at','ba','da','do','ka','ma','ta','uh','yg','al','eh','ha','ah','ng']
        new_stopwords_list = stop_words.union(stop_words_new)

        print(username)
        print(date)

        for word in nltk_tokens:
            if word not in new_stopwords_list:
                if stemmer.stem(word) != "":
                    _word.append(stemmer.stem(word))
        print(_word)
        csvFile = open('preprocessingDLNegatif.csv', 'a', newline='')
        csvWriter = csv.writer(csvFile)
        csvWriter.writerow(_word)
        csvFile.close()

我希望 CSV 中的结果被删除，但实际输出是 CSV 中的空值 1 行 481 is empty value, how can i remove it?

Answer 1

在写出之前检查 _word 中的任何内容如何：

if len(_word) != 0:
    csvFile = open('preprocessingDLNegatif.csv', 'a', newline='')
    csvWriter = csv.writer(csvFile)
    csvWriter.writerow(_word)
    csvFile.close()

我也不会为您写入的每条记录打开或关闭输出文件。在循环之前打开它一次，完成后关闭它。这样做会使我的答案看起来像：

if len(_word) != 0:
    csvWriter.writerow(_word)

在 python 中对文本进行预处理后如何删除空值

how to remove empty value after we do preprocessing text in python

python

preprocessor

text-mining