如何使用 Puppeteer 从 XHR 请求中获取 body / json 响应

Question

我想从我正在使用 Puppeteer 抓取的网站获取 JSON 数据，但我不知道如何取回请求的正文。这是我尝试过的：

const puppeteer = require('puppeteer')
const results = [];
(async () => {
    const browser = await puppeteer.launch({
        headless: false
    })
    const page = await browser.newPage()
    await page.goto("https://capuk.org/i-want-help/courses/cap-money-course/introduction", {
        waitUntil: 'networkidle2'
    });

    await page.type('#search-form > input[type="text"]', 'bd14ew')  
    await page.click('#search-form > input[type="submit"]')

    await page.on('response', response => {    
        if (response.url() == "https://capuk.org/ajax_search/capmoneycourses"){
            console.log('XHR response received'); 
            console.log(response.json()); 
        } 
    }); 
})()

这只是 returns 一个 promise 挂起函数。任何帮助都会很棒。

Answer 1

作为response.json returns 我们需要等待的承诺。

page.on('response', async (response) => {    
    if (response.url() == "https://capuk.org/ajax_search/capmoneycourses"){
        console.log('XHR response received'); 
        console.log(await response.json()); 
    } 
});

如何使用 Puppeteer 从 XHR 请求中获取 body / json 响应

How to get body / json response from XHR request with Puppeteer

javascript

node.js

puppeteer

webautomation