用Fiddler抓下请求的信息,在http头里面会看到下面的数据:
Accept: */*
Accept-Encoding: gzip, deflate
Accept-Language: zh-CN
User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)
然后照单填进HttpRequest里就行了:
MyHttpWebRequest.Accept = "*/*"; MyHttpWebRequest.Headers.Add(HttpRequestHeader.AcceptEncoding, "gzip, deflate"); MyHttpWebRequest.Headers.Add(HttpRequestHeader.AcceptLanguage, "zh-CN"); MyHttpWebRequest.UserAgent = "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)";
WinForm里有一个WebBrowse控件可以获取网页内容
WebBrowser webBrowser =
new
WebBrowser();
Uri url =
new
Uri(
"http://www.amazon.com/gp/offer-listing/B004PLY1EG"
);
webBrowser.Url = url;
webBrowser.DocumentCompleted +=
new
WebBrowserDocumentCompletedEventHandler((sender, e) =>
{
if
(e.Url == url)
{
string
content = ((WebBrowser)sender).DocumentText;
}
});
看明白了吗