# Python3-Spider-Practice

**Repository Path**: cylml/Python3-Spider-Practice

## Basic Information

- **Project Name**: Python3-Spider-Practice
- **Description**: Python3 各种爬虫实战练习，JS 逆向、反反爬、验证码处理、登录签到抽奖、数据可视化，Python 3 practice of various spiders.
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2021-08-31
- **Last Updated**: 2025-04-10

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<h2 align="center">Python3 Spider Practice —— Python3 爬虫实战练习</h2>
<br>
<div align="center">
    <a href="https://github.com/TRHX/Python3-Spider-Practice">
        <img alt="Python3 Spider Practice" src="https://cdn.jsdelivr.net/npm/simple-icons@5.8.1/icons/spyderide.svg" height="260" width="260"></img>
    </a>
</div>
<br>
<div align="center">
    <a href="https://itrhx.blog.csdn.net/category_9351278.html">
        <img alt="CSDN 爬虫实战专栏" src="https://img.shields.io/static/v1?label=CSDN%20%E7%88%AC%E8%99%AB%E5%AE%9E%E6%88%98%E4%B8%93%E6%A0%8F&message=%20&color=%23F91310&logo=SciPy&style=flat-square&logoColor=white">
    </a>&nbsp;&nbsp;
    <a href="https://www.itrhx.com/categories/Python3-%E5%AD%A6%E4%B9%A0%E7%AC%94%E8%AE%B0/%E7%88%AC%E8%99%AB%E5%AE%9E%E6%88%98/">
        <img alt="个人博客爬虫实战专栏" src="https://img.shields.io/static/v1?label=%E4%B8%AA%E4%BA%BA%E5%8D%9A%E5%AE%A2%E7%88%AC%E8%99%AB%E5%AE%9E%E6%88%98%E4%B8%93%E6%A0%8F&message=%20&color=%230077E6&logo=Spyder%20IDE&style=flat-square&logoColor=white">
    </a>
</div>
<br>
<div align="center">
    <a href="https://www.itrhx.com/">
        <img alt="BLOG URL" src="https://img.shields.io/static/v1?label=BLOG&message=%20&color=%23FBBC05&logo=hexo&style=flat-square&logoColor=white">
    </a>&nbsp;&nbsp;
    <a href="https://itrhx.blog.csdn.net/">
        <img alt="CSDN URL" src="https://img.shields.io/static/v1?label=CSDN&message=%20&color=%23F91310&logo=c&style=flat-square&logoColor=white">
    </a>&nbsp;&nbsp;
    <a href="https://www.zhihu.com/people/itrhx">
        <img alt="Zhihu URL" src="https://img.shields.io/static/v1?label=Zhihu&message=%20&color=%230077E6&logo=zhihu&style=flat-square&logoColor=white">
    </a>&nbsp;&nbsp;
    <a href="mailto:admin@itrhx.com">
        <img alt="MAIL" src="https://img.shields.io/static/v1?label=MAIL&message=%20&color=green2&logo=gmail&style=flat-square&logoColor=white">
    </a>&nbsp;&nbsp;
    <a href="https://github.com/TRHX/">
        <img alt="GitHub followers" src="https://img.shields.io/github/followers/TRHX?color=%23008B8B&label=Followers&logo=GitHub&style=flat-square">
    </a>&nbsp;&nbsp;
        <a href="https://github.com/TRHX/Python3-Spider-Practice">
        <img alt="GitHub Repo stars" src="https://img.shields.io/github/stars/TRHX/Python3-Spider-Practice?label=Stars&logo=GitHub&style=flat-square">
    </a>
</div>

---

## 关于 💡

- ❗ 主要保存了本人在学习爬虫过程中写的代码，稍微复杂一点的在我博客里面有写分析过程，比较简单的项目，分析思路会直接写在 README 里面。

- ❗ 项目中部分代码可能已失效，原因可能是反爬措施更新、页面结构发生变化等，失效的可以提 issue，有时间会更新代码。

- ❗ **本仓库中所有内容仅供学习交流，严禁用于商业用途、非法用途，否则由此产生的一切后果均与作者无关，在本仓库中下载的文件学习完毕之后请于 24 小时内删除。**

## 分类 🏷️

- **[Material](https://github.com/TRHX/Python3-Spider-Practice/tree/master/Material)**：爬虫相关资料，均从互联网收集；

- **[AutomationTool](https://github.com/TRHX/Python3-Spider-Practice#automationtool-%E8%87%AA%E5%8A%A8%E5%8C%96%E5%B7%A5%E5%85%B7)**：使用自动化工具进行数据采集、验证码处理等；

- **[BasicTraining](https://github.com/TRHX/Python3-Spider-Practice#basictraining-%E5%9F%BA%E7%A1%80%E8%AE%AD%E7%BB%83)**：基础训练，一般是比较简单的爬虫；

- **[CommentPlugin](https://github.com/TRHX/Python3-Spider-Practice#commentplugin-%E8%AF%84%E8%AE%BA%E6%8F%92%E4%BB%B6)**：针对各大评论插件的爬虫，如 Facebook 评论插件等；

- **[FightAgainstSpider](https://github.com/TRHX/Python3-Spider-Practice#fightagainstspider-%E5%8F%8D%E5%8F%8D%E7%88%AC)**：针对常见的反爬虫手段的爬虫，如字体加密等；

- **[JSReverse](https://github.com/TRHX/Python3-Spider-Practice#jsreverse-js-%E9%80%86%E5%90%91)**：JS 加密解密、JS 逆向相关，重点关注逆向解密过程；【可以关注 [K 哥爬虫](https://blog.csdn.net/kdl_csdn) 同步更新】

- **[SignIn](https://github.com/TRHX/Python3-Spider-Practice#signin-%E7%AD%BE%E5%88%B0%E6%8A%BD%E5%A5%96)**：针对各种签到、抽奖的爬虫；

- **[SpiderDataVisualization](https://github.com/TRHX/Python3-Spider-Practice#spiderdatavisualization-%E6%95%B0%E6%8D%AE%E5%8F%AF%E8%A7%86%E5%8C%96)**：爬虫与数据可视化，如 COVID-19 数据可视化等。

## 目录 📑

### BasicTraining 基础训练

- [安居客武汉二手房](https://github.com/TRHX/Python3-Spider-Practice/tree/master/BasicTraining/anjuke)  

- [豆瓣电影TOP250](https://github.com/TRHX/Python3-Spider-Practice/tree/master/BasicTraining/douban-top250)

- [瓜子全国二手车](https://github.com/TRHX/Python3-Spider-Practice/tree/master/BasicTraining/guazi)

- [虎扑论坛步行街](https://github.com/TRHX/Python3-Spider-Practice/tree/master/BasicTraining/hupu)

- [猫眼电影TOP100](https://github.com/TRHX/Python3-Spider-Practice/tree/master/BasicTraining/maoyan-top100)  

### AutomationTool 自动化工具

- [模拟登陆哔哩哔哩](https://github.com/TRHX/Python3-Spider-Practice/tree/master/AutomationTool/bilibili-login)  【滑动验证码、Selenium】

- [模拟登陆12306](https://github.com/TRHX/Python3-Spider-Practice/tree/master/AutomationTool/12306-login)  【点触验证码、Selenium】

### SpiderDataVisualization 数据可视化

- [前程无忧招聘信息](https://github.com/TRHX/Python3-Spider-Practice/tree/master/SpiderDataVisualization/51job)  【MongoDB、Numpy、Pandas、Matplotlib】

- [COVID-19 肺炎疫情数据实时监控](https://github.com/TRHX/Python3-Spider-Practice/tree/master/SpiderDataVisualization/COVID-19)  【openpyxl、pyecharts、wordcloud】

### SignIn 签到抽奖

- [CSDN 自动签到抽奖](https://github.com/TRHX/Python3-Spider-Practice/tree/master/SignIn/csdn-sign-in)  【GitHub Actions、钉钉、企业微信机器人】

### CommentPlugin 评论插件

- [Facebook 评论插件、留言外挂程序](https://github.com/TRHX/Python3-Spider-Practice/tree/master/CommentPlugin/facebook-comments)

- [Vuukle 评论插件](https://github.com/TRHX/Python3-Spider-Practice/tree/master/CommentPlugin/vuukle-comments)

### FightAgainstSpider 反反爬

- [58同城武汉出租房](https://github.com/TRHX/Python3-Spider-Practice/tree/master/FightAgainstSpider/58tongcheng)【网站加密字体、MySQL】

### JSReverse JS 逆向

<div align="center">
    <a href="https://itrhx.blog.csdn.net/">
        <img alt="JS 逆向百例" src="https://img-blog.csdnimg.cn/6f9febc1da4b4e96902f5b5104277a0d.png"></img>
    </a>
</div>

- [百度翻译](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/fanyi_baidu_com)

- [有道翻译](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/fanyi_youdao_com)

- [建筑市场监管服务平台](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/jzsc_mohurd_gov_cn)

- [当乐网登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/oauth_d_cn)

- [房天下登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/passport_fang_com)

- [华强电子网登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/passport_hqew_com)

- [学易云登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/passport_xueyiyun_com)

- [天凤麻将网页数据](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/tenhou_net)

- [天安保险登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/tianaw_95505_cn)

- [宁波大学登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/uis_nbu_edu_cn)

- [航班管家人口流动大数据](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/unicom_trip_133_cn)

- [微博登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/weibo_com)

- [惠金所登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_hfax_com)

- [咪咕视频登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_miguvideo_com)

- [企名片创业项目数据](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_qimingpian_cn)

- [中烟新商盟登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_xinshangmeng_com)

- [三河市政务网数据](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/zwfw_san-he_gov_cn)

- [中国移动掌上门户登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/wap_10086_cn)

- [中国联通网上营业厅登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/uac_10010_com)

- [中国电信网上营业厅登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/login_189_cn)

- [37网游登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_37_com)

- [爱应用登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_iappstoday_com)

- [Steam 登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/store_steampowered_com)

- [360 登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/i_360_cn)

- [1号店登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/passport_yhd_com)

- [匀加速商城登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/www_15yunmall_com)

- [魅族登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/login_flyme_cn)

- [小米登录](https://github.com/TRHX/Python3-Spider-Practice/tree/master/JSReverse/account_xiaomi_com)