hakkachhamza/clonex

CloneX is a tool for turning a website you own or have permission to work with into a clean, editable local project, useful for redesigning an existing site or studying how it was built. It crawls the pages of the target site, following internal links and respecting the site's robots.txt rules, then downloads the HTML, images, fonts, and code that make up each page. Once downloaded, the tool rewrites links so they point to local files instead of the original website, and strips out tracking scripts, analytics code, and any proprietary branding, leaving behind a plain, ready to edit template. The final result is packaged as a folder with organized subfolders for pages, styles, scripts, images, and fonts, along with a README file, which a developer can then open and customize by replacing placeholder text for things like a company name, email, or address. The whole system runs as a set of connected services, a web dashboard, a backend, a background worker that does the actual crawling, and a database, all started together using Docker Compose with a single command. After starting it up, a user logs into a web dashboard, enters the website address they want to clone, and watches the crawl progress in real time, with the option to pause, resume, or cancel partway through. Once finished, a side by side preview compares the original site to the newly generated version, and the whole project can be downloaded as a zip file through the built in API. The project is explicit that it is meant only for authorized use: it blocks crawling of local or private network addresses by default, strips any login credentials from what it exports, and states plainly that a user must only clone websites they own or have written permission to clone. It is built with Next.js and React on the frontend and FastAPI with PostgreSQL on the backend, and is released under the MIT license.