find_all() returns 仅列表的第一项与 for item in articles

Question

这是我的代码

from tkinter.ttk import Separator
import requests
from bs4 import BeautifulSoup

url='https://www.yellowpages.ca/search/si/2/hvac+services/Ontario+ON'

headers = {'user-agent' : 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36' , 'Accept-Language': 'en-US, en;q=0.5'}

r = requests.get(url, headers = headers)

soup = BeautifulSoup(r.content, 'html.parser')

articles = soup.find_all('div', class_ ='listing__content__wrapper')

for item in articles:

    company_name = item.find('a', class_ ="listing__name--link listing__link jsListingName").get_text(strip=True, separator='\n')


print(company_name)

#print(len(articles))

问题： 1.print(len(articles)) = 34 个列表计数 OK

2.print(company_name) = 只有一个 company_name 没有显示全部 company_name 列表

如何处理所有 company_name 列表？

Answer 1

这只是一个小调整 - 检查打印命令的索引，它应该运行在你的 for 循环中而不是在外部：

for item in articles:
    company_name = item.find('a', class_ ="listing__name--link listing__link jsListingName").get_text(strip=True, separator='\n')
    print(company_name)

例子

import requests
from bs4 import BeautifulSoup

url='https://www.yellowpages.ca/search/si/2/hvac+services/Ontario+ON'

headers = {'user-agent' : 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36' , 'Accept-Language': 'en-US, en;q=0.5'}

r = requests.get(url, headers = headers)

soup = BeautifulSoup(r.content, 'html.parser')

articles = soup.find_all('div', class_ ='listing__content__wrapper')

for item in articles:
    company_name = item.find('a', class_ ="listing__name--link listing__link jsListingName").get_text(strip=True, separator='\n')
    print(company_name)

输出

Face Heating & Cooling
RK Heating & Cooling
HVAC Service
Bryant Heating & Cooling Service Experts
Lambton Climate Care
County Lines HVAC & Fireplaces
Brant Custom Heat & Air
Special Gas Services
Gerry Kuchma Mechanical Inc
Aaa Technical Services
Affordable Comfort Heating and Cooling
Gaynor Mechanical Services Ltd
Custom Mechanical Ltd
Marleau HVAC Services Ltd
Associateair Mechanical Systems Ltd
True North Home Comfort
Comfort Zone Heating & Cooling
Grossi Plumbing & Heating
Zed-Air Heating & Air Conditioning
City Experts
Absolute Comfort Heating & Cooling Inc
Prouse Mechanical Ltd
Precision Heating and Cooling
Simcoe Home Comfort
Postma Heating And Cooling Inc
Affordable Comfort Heating & Cooling
HVAC Service
Lucky Air Climate Control Ltd
Mr Furnace Heating and Air Conditioning
Quality Heating and Cooling
Avis Heating & Air Conditioning
Polar Mechanical
Furnace King Home Services
Richmond Heating & Air Conditioning
Bayview Sheet Metal Heating And Air Conditioning Inc

find_all() returns 仅列表的第一项与 for item in articles

find_all() returns only first item of the list with for item in articles

beautifulsoup

web-scraping

python-requests

这是我的代码

例子

输出