efforg/psi-tumblr-crawler

This tool automatically downloads posts from a Tumblr blog and saves them in a structured data format. It was built for the Electronic Frontier Foundation's "Project Secret Identity" campaign, which focused on surveillance and privacy issues, letting the team archive blog content for analysis or record-keeping. You set it up by telling it which Tumblr blog to target and what kind of posts to grab (like photos) in a small configuration file. When you run the main script, the tool visits the specified blog, collects the posts, and packages the information into JSON files, a common, easy-to-use format for storing data. As a bonus feature, you can also point the tool at a GitHub repository, and it will automatically push the collected data there, creating a saved archive. This would be useful for anyone running a research or advocacy project who needs to back up content from a Tumblr blog. For example, if a campaign is collecting photo posts about a social issue and wants to keep a permanent, organized record of those posts, this tool handles the downloading and saving automatically. The documentation is sparse, so details are limited, but it appears to be a straightforward, no-frills utility rather than a full-featured application. It is designed to do one specific job, scraping Tumblr and saving the results, and handles that workflow through a simple shell script rather than a complex interface.