Python 请求模块卡在 requests.get() 并超时

Question

我一直在尝试从以下网站抓取网页：“https://www.india.ford.com/cars/aspire/”

import requests
from bs4 import BeautifulSoup
import csv

response = requests.get("https://www.india.ford.com/cars/aspire/", timeout=5)

if response.status_code!=200:
    print("error!")
else:
    print(response.status_code)

执行无限期停滞。

关于使用 timeout=5

我收到以下错误：

我是新手，很抱歉这是一个菜鸟问题。非常感谢任何帮助！ :P

Answer 1

超时需要使用try except.

该页面需要伪装浏览器

try:
    headers = {
        'user-agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.111 Safari/537.36',
    }
    response = requests.get("https://www.india.ford.com/cars/aspire/", headers=headers, timeout=5)

    if response.status_code != 200:
        print("error!")
    else:
        print(response.status_code)
except requests.exceptions.Timeout as error:
    print('time out')

Python 请求模块卡在 requests.get() 并超时

Python requests module gets stuck on requests.get() and gets timed out

python

web-scraping

get

python-requests-html