我无法使用 rvest 获得价值

Question

我正在尝试使用 rvest 包抓取一组网页。它适用于大多数网页，但我可以使用 rvest

获取租金信息

url <- "http://www.trademe.co.nz/Browse/CategoryAttributeSearchResults.aspx?search=1&cid=5748&sidebar=1&132=FLAT&selected135=5&134=1&135=5&216=0&216=0&217=0&217=0&153=&122=0&122=0&123=0&123=0&59=25000&59=35000&178=0&178=0&sidebarSearch_keypresses=0&sidebarSearch_suggested=0"
rent_html <- read_html(url)

html_nodes(rent_html, "div.property-card-subtitle") # it works
html_nodes(rent_html, "div.list-view-card-price") # but this is not works

我想在网络上获取租金价格的价值，但我不知道如何访问它。

Answer 1

您引用的URL不包含列表值；您已单击列表选项到达那里。添加 &v=List 到 URL 然后

library(rvest)
url <- "http://www.trademe.co.nz/Browse/CategoryAttributeSearchResults.aspx?search=1&cid=5748&sidebar=1&132=FLAT&selected135=5&134=1&135=5&216=0&216=0&217=0&217=0&153=&122=0&122=0&123=0&123=0&59=25000&59=35000&178=0&178=0&sidebarSearch_keypresses=0&sidebarSearch_suggested=0&v=List"
rent_html <- read_html(url)
html_nodes(rent_html, "div.list-view-card-price")

有效。

Answer 2

你可以试试

rent_prices <- rent_html %>% html_nodes("div.property-card-price") %>% html_text()
#> rent_prices
# [1] "0 per week" "0 per week" "0 per week" "0 per week"  0 per week" "0 per week"
# [7] "0 per week" "0 per week" "0 per week" "0 per week" "0 per week" "5 per week"
#[13] "0 per week" "0 per week" "0 per week" "0 per week" "0 per week" "5 per week"
#[19] "0 per week" "0 per week" "0 per week" "0 per week" "0 per week" "0 per week"
#[25] "0 per week" "5 per week" "0 per week" "5 per week" "5 per week" "0 per week"
#[31] "0 per week" "0 per week" "0 per week" "0 per week" "0 per week" "5 per week"
#[37] "0 per week" "0 per week"

我无法使用 rvest 获得价值

I can't get value using rvest

macos

r

rvest