C# 无效的 URI:URI 为空
C# Invalid URI: The URI is empty
您好,我正在尝试从网站收集所有数据。
开始时,我收集了该网站上的所有链接。之后访问它们。
问题是当我访问网站的多个页面时,"Invalid URI: The URI is empty" 错误显示在某些页面中。这些是一些失败的网址。
http://syayoyu.com/category/zensinyokudiet
http://syayoyu.com/fruitgranola-6759.html
http://syayoyu.com/category/diet/fruitgranola
从浏览器访问并一个一个访问它们工作正常。但是当我尝试在循环中访问时,错误发生了。你能告诉我它有什么问题吗?
这是我的访问码
HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(url);
request.UserAgent = "A .NET Web Crawler";
WebResponse response = request.GetResponse();
Stream stream = response.GetResponseStream();
StreamReader reader = new StreamReader(stream);
string htmlText = reader.ReadToEnd();
List<string> list = new List<string>(){
@"http://syayoyu.com/category/zensinyokudiet",
@"http://syayoyu.com/fruitgranola-6759.html",
@"http://syayoyu.com/category/diet/fruitgranola"
};
foreach (var url in list)
{
HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(url);
request.UserAgent = "A .NET Web Crawler";
WebResponse response = request.GetResponse();
//Stream stream = response.GetResponseStream();
//StreamReader reader = new StreamReader(stream);
//string htmlText = reader.ReadToEnd();
//Console.WriteLine(htmlText);
using (Stream stream = response.GetResponseStream())
{
using (StreamReader reader = new StreamReader(stream))
{
string htmlText = reader.ReadToEnd();
Console.WriteLine(htmlText);
}
}
}
在我的解决方案中,它工作正常,请问还有什么问题你不知道吗?
您好,我正在尝试从网站收集所有数据。
开始时,我收集了该网站上的所有链接。之后访问它们。 问题是当我访问网站的多个页面时,"Invalid URI: The URI is empty" 错误显示在某些页面中。这些是一些失败的网址。
http://syayoyu.com/category/zensinyokudiet
http://syayoyu.com/fruitgranola-6759.html
http://syayoyu.com/category/diet/fruitgranola
从浏览器访问并一个一个访问它们工作正常。但是当我尝试在循环中访问时,错误发生了。你能告诉我它有什么问题吗?
这是我的访问码
HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(url);
request.UserAgent = "A .NET Web Crawler";
WebResponse response = request.GetResponse();
Stream stream = response.GetResponseStream();
StreamReader reader = new StreamReader(stream);
string htmlText = reader.ReadToEnd();
List<string> list = new List<string>(){
@"http://syayoyu.com/category/zensinyokudiet",
@"http://syayoyu.com/fruitgranola-6759.html",
@"http://syayoyu.com/category/diet/fruitgranola"
};
foreach (var url in list)
{
HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(url);
request.UserAgent = "A .NET Web Crawler";
WebResponse response = request.GetResponse();
//Stream stream = response.GetResponseStream();
//StreamReader reader = new StreamReader(stream);
//string htmlText = reader.ReadToEnd();
//Console.WriteLine(htmlText);
using (Stream stream = response.GetResponseStream())
{
using (StreamReader reader = new StreamReader(stream))
{
string htmlText = reader.ReadToEnd();
Console.WriteLine(htmlText);
}
}
}
在我的解决方案中,它工作正常,请问还有什么问题你不知道吗?