如何从字典中删除重复的键值（字符串）对？

Question

如果根据字符串相似性发现键值对重复，我将尝试从字典中删除整个键值对。示例：

d1={1:'Colins business partner sends millions of dollars to groups which target lives 
   for gruesome deaths domestically and abroad',
2:'Colins business partner sends millions of dollars to groups which target lives',
3:'Don t skip leg day y all'}

上面代码中1和2是相似的字符串，所以必须删除其中一个，下面的必须是保持ID完整的输出：

 d1={1:'Colins business partner sends millions of dollars to groups which target lives 
   for gruesome deaths domestically and abroad',
3:'Don t skip leg day y all'}

请帮我解决这个问题。

Answer 1

如果您所说的“相似性”是指一个字符串包含在另一个字符串中，并且您想消除较短的字符串，则可以通过嵌套循环来完成，如下所示。请注意，您想要复制字典，这样您就不会在迭代过程中更改原始字典。

d1={1:'Colins business partner sends millions of dollars to groups which target lives for gruesome deaths domestically and abroad',
2:'Colins business partner sends millions of dollars to groups which target lives',
3:'Don t skip leg day y all'}

d2 = dict(d1) #make a copy of d1
for k, sent in d1.items():
    for sentence in d1.values():
        if sent in sentence and len(sent) != len(sentence):
            del d2[k]
            break
print(d2)
# {1: 'Colins business partner sends millions of dollars to groups which target lives for gruesome deaths domestically and abroad', 3: 'Don t skip leg day y all'}

如何从字典中删除重复的键值（字符串）对？

How to delete duplicate key value(string) pairs from a dictionary?

python

dictionary

nlp

similarity