smartaces/jacobian-lens-for-mac

This project is a Mac friendly version of Anthropic's Jacobian Lens, a research tool for peeking at what a language model seems to be thinking about internally before it finishes answering. The original version from Anthropic only runs on Nvidia CUDA graphics cards, so this fork rewrites it to run on Apple silicon Macs using Apple's own Metal based acceleration, and wraps it in a simple point and click local web app powered by a small AI model called Qwen. The web app walks a curious but non technical user through four guided experiments. The Focus Test shows whether you can tell what the model is thinking about even when it never says so out loud. The Missing Step Test looks for a reasoning step the model skips writing down. The Early Answer Test tries to see the model's answer before it actually states it. The Silent Warning Test looks for a problem the model notices internally but never mentions in its reply. The Missing Step tab also includes a cause and effect experiment, where you can swap one internal clue for another, such as changing a hidden association from spider to ant, and watch the model's final answer change as a result, offered as evidence that the clue genuinely influenced the answer rather than being a coincidence. To try it, you need an Apple silicon Mac with 16 gigabytes of memory recommended, about 10 gigabytes of free disk space, and Python 3.10 or newer. The app works immediately using saved example results, and only downloads the roughly 9 gigabyte Qwen model the first time you choose to run something live, asking for confirmation first. Beyond the web app, the repository still includes the original Jacobian Lens library for people who want to use it directly in their own code, including functions to apply an already trained lens to a model or to fit a new lens on your own model and text corpus. The project's own code is released under the Apache License 2.0, a permissive license that allows commercial and non commercial use as long as you keep the required notices. It downloads the Qwen model and lens separately from other sources with their own licenses.