romaniv1437/chromic-haptic

{"i":0,"repo":"romaniv1437/chromic-haptic","stars":0,"lang":"Dart","ok":true,"char_count":1310,"text":"Chromic Haptic Player is a mobile music app built with Flutter. It shows lyrics that light up letter by letter in sync with the song, and it vibrates your phone on every beat. You paste a SoundCloud track URL, and the app fetches aligned lyrics and beat data from a backend service that processes the audio using speech recognition and source separation.\n\nThe workflow has several stages. First you paste a URL into the app. The app sends that URL to a backend service called Modal, which takes about five minutes to process the track. Modal separates the vocals from the music, runs Whisper speech recognition to align each word to its timestamp, and detects beats for vibration timing. The result is a JSON file with all the timing data.\n\nOnce the app has that data, it caches it locally so you do not need to reprocess the same track. It plays the audio and renders the lyrics using custom fragment shaders that fill each character with a green glow, letter by letter, as the song progresses. A separate engine checks the playback position fifty times per second and triggers haptic vibration whenever the current timestamp hits a detected beat.\n\nThe code is organized into an engine for vibration timing, data models for lyrics, services for caching and backend communication, and widgets for painting lyrics and rendering glow effects. There are also custom shader files written in GLSL for the visual bloom and per character fill effects.\n\nTo run the app you need the Flutter SDK and the Android SDK. Vibration testing requires a physical Android phone since emulators cannot vibrate. The README includes commands for installing dependencies, running in debug mode, and building a release APK. No license information is provided.","error":null}