如何使用 WebRequest and/or HTML 敏捷包获取 Content-Disposition 附件中的文件

Question

我正在开发一个将从网站下载 PDF 文件的网络爬虫。

之前查看网站源代码，发现下载PDF的按钮实际上是表单的提交输入。该表单在 Content-Disposition header 中检索文件作为响应。

这是它的照片：

我的问题是，如何使用 Web 请求（或 HTML 敏捷包）获取此文件。我这样试过，但是听者returns null.

HttpWebResponse response = (HttpWebResponse)req.GetResponse();
string file = response.Headers["Content-Disposition"];

提前致谢

Answer 1

我已经有了答案，这是我为获取文件所做的工作

response = (HttpWebResponse)request.GetResponse();
stream = response.GetResponseStream();
byte[] retorno = ReadToEnd(stream);
response.Close();
stream.Close();

public static byte[] ReadToEnd(System.IO.Stream stream)
{
    long originalPosition = 0;

    if (stream.CanSeek)
    {
        originalPosition = stream.Position;
        stream.Position = 0;
    }

    try
    {
        byte[] readBuffer = new byte[4096];

        int totalBytesRead = 0;
        int bytesRead;

        while ((bytesRead = stream.Read(readBuffer, totalBytesRead, readBuffer.Length - totalBytesRead)) > 0)
        {
            totalBytesRead += bytesRead;

            if (totalBytesRead == readBuffer.Length)
            {
                int nextByte = stream.ReadByte();
                if (nextByte != -1)
                {
                    byte[] temp = new byte[readBuffer.Length * 2];
                    Buffer.BlockCopy(readBuffer, 0, temp, 0, readBuffer.Length);
                    Buffer.SetByte(temp, totalBytesRead, (byte)nextByte);
                    readBuffer = temp;
                    totalBytesRead++;
                }
            }
        }

        byte[] buffer = readBuffer;
        if (readBuffer.Length != totalBytesRead)
        {
            buffer = new byte[totalBytesRead];
            Buffer.BlockCopy(readBuffer, 0, buffer, 0, totalBytesRead);
        }
        return buffer;
    }
    finally
    {
        if (stream.CanSeek)
        {
            stream.Position = originalPosition;
        }
    }
}

谢谢

如何使用 WebRequest and/or HTML 敏捷包获取 Content-Disposition 附件中的文件

How to get File in Content-Disposition attachment using WebRequest and/or HTML Agility Pack

webrequest

httpwebresponse

content-disposition

html-agility-pack