网抓并将数据写入excel里

看到别人的提问,用C#爬了一页青塔的数据并保存到excel里。获取网页数据用了自带的webclient.处理json数据用了newtonsoft.json.将爬取的数据写入新excel表里用了npoi.

using Newtonsoft.Json.Linq;
using System;
using System.Net;
using System.Text;
using System.Text.RegularExpressions;
using NPOI.SS.UserModel;
using System.IO;
using NPOI.XSSF.UserModel;

namespace 青塔
{
    class Program
    {
        static void Main(string[] args)
        {
            WebClient w = new WebClient();
            string url = "https://www.cingta.com/v1.0/api/get_subjectdetail/";
            w.Encoding = Encoding.UTF8;
            w.Headers.Add("Content-Type", "application/x-www-form-urlencoded;charset=UTF-8");
            w.Headers.Add("Referer","https://www.cingta.com/data/sch");
            string postString = "name=北京大学";
            byte[] postdata = Encoding.UTF8.GetBytes(postString);
            byte[] responsedata=w.UploadData(url,postdata);
            string responsetext = Regex.Unescape( Encoding.UTF8.GetString(responsedata));
            int i=0;
            string path = @"C:\Users\FanXiaoLei\Desktop\1.xlsx";
            IWorkbook wk = new XSSFWorkbook();
            ISheet Sht = wk.CreateSheet("数据");
            
            JObject js=JObject.Parse(responsetext);
            JToken ls = js["data"]["list"];
 
            foreach(JObject items in ls)
            {
                IRow rows = Sht.CreateRow(i);
                int j = 0;
                foreach (var item in items)
                { 
                    
                    ICell cell = rows.CreateCell(j);
                     
                    cell.SetCellValue(String.Format("{0}",i==0?item.Key:item.Value));
                    
                    j++;

                }

                i++;
            }
            using (FileStream fs = new FileStream(path, FileMode.Create, FileAccess.Write, FileShare.Write))
            {
                wk.Write(fs);
            }
            Console.WriteLine("done!");
            Console.ReadKey();
        }
    }
}

主要查了下北大的一点数据。效果还是可以的。比起vba,数据写入单元格要啰嗦不少。不过用npoi读写不依赖excel软件,也不错。

猜你喜欢

转载自blog.csdn.net/qq_24499417/article/details/104893258
今日推荐