hellogithub-team/hydra

Hydra is a Python web scraping project created by the HelloGitHub team to collect and aggregate their own content and account data from multiple Chinese platforms. The platforms supported include WeChat, Zhihu, Juejin, Toutiao, CSDN, and others. The purpose is to let the team's authors see how their published articles are performing across all the places where HelloGitHub posts content, such as view counts and publication dates. The project is also intended as a learning resource. The README is written in Chinese and describes the project as a practical example that covers web scraping, database operations, common third-party libraries, parsing web pages and APIs, writing unit tests, mocking network requests, error monitoring, code quality automation, and GitHub Actions. The idea is that anyone who knows basic Python syntax can read through the code and learn from it. To run the project, you clone the repository, create a local configuration file, install dependencies using Poetry (a Python package manager), and then run individual scrapers for specific platforms using a command-line argument. The project requires Python 3.7.5 or newer. The README is in Chinese. The project is licensed under a Creative Commons license that allows sharing with attribution but prohibits commercial use and modifications.