案例 — 使用bs4 爬取猫眼电影热榜
发布于2019-08-07 11:03 阅读(819) 评论(0) 点赞(2) 收藏(5)
from bs4 import BeautifulSoup
from urllib import request
url = "http://maoyan.com/board"
rsq = request.urlopen(url)
html = rsq.read().decode()
soup = BeautifulSoup(html,"lxml")
items = soup.select('dd')
# 构建本地txt文档
with open("D://maoyan.txt","w",encoding="utf-8") as f:
for item in items:
# 提取标题
title = item.select('p a[data-act="boarditem-click" ]')[0].get_text()
# 提取主演
star = item.select('p[class = "star"]')[0].get_text().replace("\n","").strip(" ")
# 提取分数
score = item.select('p[class = "score"]')[0].get_text().strip('\n').strip(' ')
# 提取上映时间
releasetime = item.select('p[class = "releasetime"]')[0].get_text()
# 数据整合
datas = title + " " + releasetime + " "+ star + " " + score + "\n"
print(datas)
# 利用for循环把每条datas信息写入本地
f.write(datas)
f.close()
print("Sucessful")
所属网站分类: 技术文章 > 博客
作者：eirierbjs
链接：https://www.pythonheidong.com/blog/article/10151/d8e86eee87f713f54cf1/
来源：python黑洞网
任何形式的转载都请注明出处,如有侵权 一经发现 必将追究其法律责任
昵称:
评论内容：(最多支持255个字符)
---无人问津也好，技不如人也罢，你都要试着安静下来，去做自己该做的事，而不是让内心的烦躁、焦虑，坏掉你本来就不多的热情和定力