黄石新闻网公告

下面我们使用python爬取黄石新闻的公告，练练手：
代码如下
可能比较繁琐（初学者）

import csv, requests
from bs4 import BeautifulSoup
import re
url = 'http://www.hsdcw.com/class2012_l_0_0_180_1.html'
x = requests.get(url)
x.encoding=x.apparent_encoding
print(x.apparent_encoding)
html=x.text
soup = BeautifulSoup(html, 'html.parser')
res = r'<a .*?>(.*?)</a>'
mm =  re.findall(res, html, re.S|re.M)
q=[]
a=[]
e=[]
w=()
for c in soup.find_all("span"):
    e.append(c.text)
for i in soup.find_all("a"):
    q.append(i.text)
res_url = r"(?<=href=\").+?(?=\")|(?<=href=\').+?(?=\')"
link = re.findall(res_url,html, re.I|re.S|re.M)
for c in link:
    a.append(c)
print(q[33:73])
print(a[35:75])
z=0
all=[]
while z<40:
    w=([e[:40][z]]+[q[33:73][z]]+[a[35:75][z]])
    z=z+1
    all.append(w)
    print(w)
print(all)
with open('E:\\黄石公告.csv', 'w+',newline="",encoding='GB2312') as f:
    writer = csv.writer(f)
    writer.writerow(["时间",'公告','网页链接'])
    for row in all:
        writer.writerow(row)

显示如下：
[[‘2018-8-14’, ‘黄石东楚传媒集团印务有限公司印刷物资协议供应商征集结果公告’, ‘http://www.hsdcw.com/html/2018-8-14/932269.htm’], [‘2018-8-6’, ‘矿冶工业文化讲解员招聘公告’, ‘http://www.hsdcw.com/html/2018-8-6/930011.htm’], [‘2018-7-16’, ‘印刷物资协议供应商征集公告’, ‘http://www.hsdcw.com/html/2018-7-16/926444.htm’], [‘2018-7-5’, ‘黄石东楚传媒集团印务有限公司车辆定点维修询价结果公告’, ‘http://www.hsdcw.com/html/2018-7-5/926521.htm’], [‘2018-7-5’, ‘黄石东楚传媒集团印务有限公司印刷物资采购招标结果公告’, ‘http://www.hsdcw.com/html/2018-7-5/926520.htm’], [‘2018-6-4’, ‘东楚融媒体影音网络集成移动直播平台项目后期编辑部分询价公告’, ‘http://www.hsdcw.com/html/2018-6-4/918627.htm’], [‘2018-6-4’, ‘黄石东楚传媒集团印务有限公司车辆定点维修询价公告’, ‘http://www.hsdcw.com/html/2018-6-4/918546.htm’], [‘2018-6-4’, ‘黄石东楚传媒集团印务有限公司印刷物资采购招标公告’, ‘http://www.hsdcw.com/html/2018-6-4/918537.htm’], [‘2018-4-24’, ‘明天上午公园路部分封闭 3条公交线临时改线’, ‘http://www.hsdcw.com/html/2018-4-24/912626.htm’], [‘2018-4-24’, ‘黄石日报传媒集团招聘公告’, ‘http://www.hsdcw.com/html/2018-4-24/912625.htm’], [‘2018-4-14’, ‘【省级环保督察整改进行时】关于对黄石市开展环境保护督察的公告’, ‘http://www.hsdcw.com/html/2018-4-14/910546.htm’], [‘2018-4-12’, ‘黄石日报社直播车辆询价公告’, ‘http://www.hsdcw.com/html/2018-4-12/910178.htm’], [‘2018-3-1’, ‘黄石市第五届志愿服务先进典型候选名单公示’, ‘http://www.hsdcw.com/html/2018-3-1/903843.htm’], [‘2018-2-8’, ‘公告’, ‘http://www.hsdcw.com/html/2018-2-8/901367.htm’], [‘2018-1-25’, ‘黄石市东楚传媒网络科技有限公司设备采购公示公告’, ‘http://www.hsdcw.com/html/2018-1-25/898455.htm’], [‘2018-1-10’, ‘黄石日报传媒集团招聘公告’, ‘http://www.hsdcw.com/html/2018-1-10/896876.htm’], [‘2018-1-10’, ‘您关心的这些事民生通道帮你问了’, ‘http://www.hsdcw.com/html/2018-1-10/896852.htm’], [‘2018-1-10’, ‘大冶荣获全国“平安农机”示范市称号’, ‘http://www.hsdcw.com/html/2018-1-10/896851.htm’], [‘2018-1-10’, ‘让流动人口感受家的温暖’, ‘http://www.hsdcw.com/html/2018-1-10/896850.htm’], [‘2018-1-10’, ‘铁山至东沟一级公路通车时间暂时未定’, ‘http://www.hsdcw.com/html/2018-1-10/896849.htm’], [‘2018-1-10’, ‘黄石日报传媒集团招聘公告’, ‘http://www.hsdcw.com/html/2018-1-10/896848.htm’], [‘2017-12-18’, ‘2018年度城乡居民基本医疗保险参保缴费相关事宜的公告’, ‘http://www.hsdcw.com/html/2017-12-18/893639.htm’], [‘2017-12-15’, ‘干部任前公示公告（2017年第14号）’, ‘http://www.hsdcw.com/html/2017-12-15/893490.htm’], [‘2017-12-12’, ‘干部任前公示公告（2017年第13号）’, ‘http://www.hsdcw.com/html/2017-12-12/892979.htm’], [‘2017-12-8’, ‘干部任前公示公告’, ‘http://www.hsdcw.com/html/2017-12-8/892585.htm’], [‘2017-11-21’, ‘市委宣传部、市文明办招聘工作面试成绩公告’, ‘http://www.hsdcw.com/html/2017-11-21/889680.htm’], [‘2017-11-14’, ‘黄石市委宣传部（市文明办）公开招聘工作人员面试的公告’, ‘http://www.hsdcw.com/html/2017-11-14/888610.htm’], [‘2017-11-6’, ‘黄石日报传媒集团招标公告’, ‘http://www.hsdcw.com/html/2017-11-6/886501.htm’], [‘2017-10-19’, ‘黄石市委宣传部（市文明办）关于公开招聘工作人员的公告’, ‘http://www.hsdcw.com/html/2017-10-19/883599.htm’], [‘2017-9-27’, ‘关于《湖北省阳新县曹家山金矿详查探矿权评估报告》定稿前的公示’, ‘http://www.hsdcw.com/html/2017-9-27/880506.htm’], [‘2017-9-19’, ‘黄石日报社中心机房UPS电池改造项目询价公告’, ‘http://www.hsdcw.com/html/2017-9-19/879407.htm’], [‘2017-9-8’, ‘中国荆州・世界华人楹联大赛征稿启事’, ‘http://www.hsdcw.com/html/2017-9-8/877434.htm’], [‘2017-9-8’, ‘中国荆州・屈原诗词大会征稿启事’, ‘http://www.hsdcw.com/html/2017-9-8/877433.htm’], [‘2017-9-7’, ‘关于《黄石市行政管理中使用信用信息暂行办法（征求意见稿）》公开征求意见’, ‘http://www.hsdcw.com/html/2017-9-7/877269.htm’], [‘2017-8-31’, ‘黄石日报社东楚传媒大厦弱电设备间改造项目招标公告’, ‘http://www.hsdcw.com/html/2017-8-31/876779.htm’], [‘2017-8-30’, ‘黄石市第二届文艺奖评奖作品征集启事’, ‘http://www.hsdcw.com/html/2017-8-30/875827.htm’], [‘2017-8-22’, ‘黄石日报社东楚传媒大厦弱电设备间改造项目招标公告’, ‘http://www.hsdcw.com/html/2017-8-22/874636.htm’], [‘2017-7-25’, ‘阳新县中心城区地名征集公告’, ‘http://www.hsdcw.com/html/2017-7-25/869694.htm’], [‘2017-7-7’, ‘黄石市城市公交集团有限公司招聘公告’, ‘http://www.hsdcw.com/html/2017-7-7/866785.htm’], [‘2017-6-11’, ‘关于压紧压实责任、全力做好防汛备汛工作的紧急通知’, ‘http://www.hsdcw.com/html/2017-6-11/861742.htm’]]

并且保存在e盘中，有兴趣的童鞋可以试试

猜你喜欢