得到了 Beautiful Soup 和 Selenium 的空列表

Question

https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king

我想从该网站获取 TOMATOMETER 和 AUDIENCE SCORE， 但得到一个空列表。

soup = BeautifulSoup(html, 'html.parser')
notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')

Answer 1

您的代码运行良好

>>> from bs4 import BeautifulSoup
>>> html = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king').text
>>> soup = BeautifulSoup(html, 'html.parser')
>>> notices = soup.select('#tomato_meter_link > span.mop-ratings-wrap__percentage')
>>> notices
[<span class="mop-ratings-wrap__percentage">93%</span>]

你是怎么得到html变量的？

Answer 2

您可以将 last-child 选择器用于跨度类型与父 class。这是使用 BeautifulSoup 4.7.1

import requests
from bs4 import BeautifulSoup

res = requests.get('https://www.rottentomatoes.com/m/the_lord_of_the_rings_the_return_of_the_king')
soup = bs(res.content, 'lxml')
ratings = [item.text.strip() for item in soup.select('h1.mop-ratings-wrap__score span:last-child')]
print(ratings)