正在从 beautifulsoup4 网络抓取结果中删除特定 <h2 class>
Removing specific <h2 class> from beautifulsoup4 web crawling results
我目前正在尝试抓取来自 https://7news.com.au/news/coronavirus-sa 的新闻文章的标题。
发现所有标题都在h2classes下后，写了如下代码：
import requests
from bs4 import BeautifulSoup
url = f'https://7news.com.au/news/coronavirus-sa'
r = requests.get(url)
soup = BeautifulSoup(r.text, 'html.parser')
titles = soup.find('body').find_all('h2')
for i in titles:
print(i.text.strip())
这段代码的结果是：
News
Discover
Connect
SA COVID cases surge into triple digit figures for first time
Massive headaches at South Australian testing clinics as COVID cases surge
Revellers forced into isolation after SA teen goes clubbing while infectious with COVID
COVID scare hits Ashes Test in Adelaide after two media members test positive
SA to ease restrictions despite record number of COVID cases
‘We’re going to have cases every day’: SA records biggest COVID spike in 18 MONTHS
Fears for Adelaide nursing homes after COVID infections creep detected
Families in pre-Christmas quarantine after COVID alert for Adelaide school
South Australia records a JUMP in new COVID-19 cases - including infections in children
‘LOCK IT IN’: Mark McGowan to reveal date of WA’s long-awaited reopening to Australia
BOOSTER BOOST-UP: Australia makes change to COVID-19 vaccinations amid Omicron concern
Frydenberg calls for Aussies to ‘keep calm and carry on’ in the face of COVID-19 Omicron strain
News Just In
Our Network
Our Partners
Connect with 7NEWS
其中包含不必要的文本，例如 'News'、'Discover' 和 'News Just In'。
发生这种情况是因为这些文本也在 h2 class 下。因此，我添加了以下代码以从结果中删除它们：
soup.find('h2', id='css-1oh2gv-StyledHeading.e1fp214b7').decompose()
原来是属性错误
AttributeError: 'NoneType' object has no attribute 'decompose'
我也尝试了 clear() 方法，但它没有给出我想要的结果。
是否有另一种方法可以删除不需要的文本？
会发生什么？
您的选择太笼统了，因为它选择了所有 <h2> 并且不需要 .decompose() 来解决问题。
如何修复？
Select 更具体的标题：
soup.select('h2.Card-Headline')
例子
import requests
from bs4 import BeautifulSoup
url = f'https://7news.com.au/news/coronavirus-sa'
r = requests.get(url)
soup = BeautifulSoup(r.text, 'html.parser')
for h2 in soup.select('h2.Card-Headline'):
print(h2.text)
输出
SA COVID cases surge into triple digit figures for first time
Massive headaches at South Australian testing clinics as COVID cases surge
Revellers forced into isolation after SA teen goes clubbing while infectious with COVID
COVID scare hits Ashes Test in Adelaide after two media members test positive
SA to ease restrictions despite record number of COVID cases
‘We’re going to have cases every day’: SA records biggest COVID spike in 18 MONTHS
Fears for Adelaide nursing homes after COVID infections creep detected
Families in pre-Christmas quarantine after COVID alert for Adelaide school
South Australia records a JUMP in new COVID-19 cases - including infections in children
‘LOCK IT IN’: Mark McGowan to reveal date of WA’s long-awaited reopening to Australia
BOOSTER BOOST-UP: Australia makes change to COVID-19 vaccinations amid Omicron concern
Frydenberg calls for Aussies to ‘keep calm and carry on’ in the face of COVID-19 Omicron strain
只是除了回答问题外
另外 decompose() 选择更具体的选择 - 但如前所述，没有必要这样做：
for i in titles:
if 'Heading' in ' '.join(i['class']):
i.decompose()
我目前正在尝试抓取来自 https://7news.com.au/news/coronavirus-sa 的新闻文章的标题。
发现所有标题都在h2classes下后，写了如下代码：
import requests
from bs4 import BeautifulSoup
url = f'https://7news.com.au/news/coronavirus-sa'
r = requests.get(url)
soup = BeautifulSoup(r.text, 'html.parser')
titles = soup.find('body').find_all('h2')
for i in titles:
print(i.text.strip())
这段代码的结果是：
News
Discover
Connect
SA COVID cases surge into triple digit figures for first time
Massive headaches at South Australian testing clinics as COVID cases surge
Revellers forced into isolation after SA teen goes clubbing while infectious with COVID
COVID scare hits Ashes Test in Adelaide after two media members test positive
SA to ease restrictions despite record number of COVID cases
‘We’re going to have cases every day’: SA records biggest COVID spike in 18 MONTHS
Fears for Adelaide nursing homes after COVID infections creep detected
Families in pre-Christmas quarantine after COVID alert for Adelaide school
South Australia records a JUMP in new COVID-19 cases - including infections in children
‘LOCK IT IN’: Mark McGowan to reveal date of WA’s long-awaited reopening to Australia
BOOSTER BOOST-UP: Australia makes change to COVID-19 vaccinations amid Omicron concern
Frydenberg calls for Aussies to ‘keep calm and carry on’ in the face of COVID-19 Omicron strain
News Just In
Our Network
Our Partners
Connect with 7NEWS
其中包含不必要的文本，例如 'News'、'Discover' 和 'News Just In'。
发生这种情况是因为这些文本也在 h2 class 下。因此，我添加了以下代码以从结果中删除它们：
soup.find('h2', id='css-1oh2gv-StyledHeading.e1fp214b7').decompose()
原来是属性错误
AttributeError: 'NoneType' object has no attribute 'decompose'
我也尝试了 clear() 方法，但它没有给出我想要的结果。
是否有另一种方法可以删除不需要的文本？
会发生什么？
您的选择太笼统了，因为它选择了所有 <h2> 并且不需要 .decompose() 来解决问题。
如何修复？
Select 更具体的标题：
soup.select('h2.Card-Headline')
例子
import requests
from bs4 import BeautifulSoup
url = f'https://7news.com.au/news/coronavirus-sa'
r = requests.get(url)
soup = BeautifulSoup(r.text, 'html.parser')
for h2 in soup.select('h2.Card-Headline'):
print(h2.text)
输出
SA COVID cases surge into triple digit figures for first time
Massive headaches at South Australian testing clinics as COVID cases surge
Revellers forced into isolation after SA teen goes clubbing while infectious with COVID
COVID scare hits Ashes Test in Adelaide after two media members test positive
SA to ease restrictions despite record number of COVID cases
‘We’re going to have cases every day’: SA records biggest COVID spike in 18 MONTHS
Fears for Adelaide nursing homes after COVID infections creep detected
Families in pre-Christmas quarantine after COVID alert for Adelaide school
South Australia records a JUMP in new COVID-19 cases - including infections in children
‘LOCK IT IN’: Mark McGowan to reveal date of WA’s long-awaited reopening to Australia
BOOSTER BOOST-UP: Australia makes change to COVID-19 vaccinations amid Omicron concern
Frydenberg calls for Aussies to ‘keep calm and carry on’ in the face of COVID-19 Omicron strain
只是除了回答问题外
另外 decompose() 选择更具体的选择 - 但如前所述，没有必要这样做：
for i in titles:
if 'Heading' in ' '.join(i['class']):
i.decompose()