无法使用 Python 登录亚马逊

Question

我正在使用 Python 3 编写一个脚本来登录亚马逊以获取我的 Kindle 亮点。它基于这篇文章：https://blog.jverkamp.com/2015/07/02/scraping-kindle-highlights/

我无法成功登录，而是收到一条消息，提示我继续启用 cookies：

<RequestsCookieJar[<Cookie ubid-main=189-4768762-8531647 for .amazon.com/>]>
Failed to login: 

Please Enable Cookies to Continue

To continue shopping at Amazon.com, please enable cookies in your Web browser.
Learn more about cookies and how to enable them.

我已经包含了处理 cookie 的请求会话，但它似乎不起作用。

这是我用来尝试执行此操作的代码：

import bs4, requests

session = requests.Session()
session.headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36'
}

# Log in to Amazon, we have to get the real login page to bypass CSRF
print('Logging in...')
response = session.get('https://kindle.amazon.com/login')

soup = bs4.BeautifulSoup(response.text, "html.parser")

signin_data = {}
signin_form = soup.find('form', {'name': 'signIn'})
for field in signin_form.find_all('input'):
    try:
        signin_data[field['name']] = field['value']
    except:
        pass

signin_data[u'ap_email'] = 'myemail'
signin_data[u'ap_password'] = 'mypassword'


response = session.post('https://www.amazon.com/ap/signin', data = signin_data)

soup = bs4.BeautifulSoup(response.text, "html.parser")

warning = soup.find('div', {'id': 'message_warning'})
if warning:
    print('Failed to login: {0}'.format(warning.text))

我在使用会话时是否遗漏了什么？

Answer 1

您的登录表单数据实际上不正确应该是 email 和 password:

signin_data[u'email'] = 'your_email'
signin_data[u'password'] = 'your_password'

你也可以避免使用 css select 和 has_attr:

import bs4, requests

headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36'
}

from bs4 import BeautifulSoup

with requests.Session() as s:
    s.headers = headers
    r = s.get('https://kindle.amazon.com/login')
    soup = BeautifulSoup(r.content, "html.parser")
    signin_data = {s["name"]: s["value"]
                   for s in soup.select("form[name=signIn]")[0].select("input[name]")
                   if s.has_attr("value")}

    signin_data[u'email'] = 'your_em'
    signin_data[u'password'] = 'pass'

    response = s.post('https://www.amazon.com/ap/signin', data=signin_data)
    soup = bs4.BeautifulSoup(response.text, "html.parser")
    warning = soup.find('div', {'id': 'message_warning'})
    if warning:
        print('Failed to login: {0}'.format(warning.text))
    print(response.content)

输出的第一行，可以在最后看到<title>Amazon Kindle: Home</title>：

b'<?xml version="1.0" encoding="utf-8"?>\n<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">\n<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en-US" lang="en-US">\n  <head>\n    <title>Amazon Kindle: Home</title>\n

如果它仍然无法正常工作，您应该更新您的 requests 版本，也许可以尝试另一个用户代理。一旦我更改了 ap_email 和 ap_password 我就可以正常登录了。

Answer 2

2020 - 此代码将不再有效。 Amazon 已将 JavaScript 添加到其登录页面，如果不执行，则此序列将失败。检索到的页面将声明 cookie 未启用，即使它们是有效的。同时发送用户名和密码会产生包含验证码的验证页面响应。在第二次交换中发送用户名然后发送密码会导致回复“出现问题”，并会再次请求 username/password。亚马逊识别出 JavaScript 未执行。

无法使用 Python 登录亚马逊

Unable to log in to Amazon using Python

python

cookies

amazon

kindle