abhisheksinha1506/open-dir-downloader

This is a small collection of scripts for downloading files from the internet in bulk, built around a command line tool called wget that fetches files from a URL. There is no single app here, just four separate scripts for different situations and operating systems. Two of the scripts, one for Windows and one for Linux and macOS, show a simple menu where a person picks a category such as pictures, music, video, ebooks, or software, types in a source URL, and the script runs wget with the right file type filter already set up for that category. The other two scripts are written in PowerShell: one downloads a single file to a chosen folder, optionally using Windows' built in background transfer service so a large download can resume if interrupted, and the other crawls an open folder listing on a website, meaning a page that simply lists files and subfolders, and copies the whole structure to the local machine, optionally limited to certain file extensions. The README lists a set of specific fixes the author made, such as properly quoting file paths so filenames with spaces do not break the scripts, correcting a typo that had been matching the wrong file extensions, avoiding overwriting files with the same name from different folders, skipping files that already exist on a re-run, waiting briefly between requests so as not to overload the server being downloaded from, showing errors instead of hiding them, and limiting how many folders deep the directory crawler will recurse into to avoid it running endlessly. The README also reminds users to make sure they have permission to download from a site and to check its terms of service before doing so. The README does not mention a license for this project.