explaingit

kiara-02-lab-social/cam-guide-for-blind

0HTMLAudience · generalComplexity · 2/5ActiveSetup · easy

TLDR

Single-file browser tool that uses MediaPipe FaceMesh to speak short positioning hints so blind and low-vision users can frame themselves correctly on a webcam before a call.

Mindmap

mindmap
  root((cam-guide))
    Inputs
      Webcam stream
      Browser permissions
    Outputs
      Spoken instructions
      Lighting feedback
    Use Cases
      Pre-call framing for blind users
      Quick lighting check
      Accessible video call prep
    Tech Stack
      HTML
      MediaPipe
      Web Speech API
      WebAssembly

Things people build with this

USE CASE 1

Help a blind or low-vision user center themselves on a webcam before joining a call

USE CASE 2

Add a pre-call lighting and framing check to a corporate onboarding page

USE CASE 3

Ship a private offline face-positioning tool that needs no install

USE CASE 4

Adapt the rule set into an internal tool that warns staff about poor camera framing

Tech stack

HTMLJavaScriptMediaPipeWeb Speech API

Getting it running

Difficulty · easy Time to first run · 5min

Works best in Chrome or Edge, Firefox is not recommended and Safari is untested due to MediaPipe quirks.

In plain English

Cam Guide is a tool that helps blind and low-vision people position themselves correctly in front of a webcam before joining a video call. It is a single HTML file that you open in a web browser. There is nothing to install, no server, and no account, and once the page has loaded it works without an internet connection because all the processing happens on your own computer. The way it works is simple. You open the file in Chrome or Edge, click a Start camera button, and give the browser permission to use the webcam. The page then watches your face and speaks short instructions out loud through your speakers or headphones. Examples from the README include phrases like Move slightly right, You are too close, Look a little higher, and Straighten your head. When everything is in order it says You look great, you are ready for your call, and otherwise stays quiet to avoid being annoying. Repeated messages are limited to once every four seconds. The checks cover six things: whether a face is visible at all, whether the face is centred left to right, whether it is at the right height in the frame, whether the head is tilted, whether the user is too close or too far away, and whether the lighting is too dark or too bright. There is also an on-off toggle for the spoken feedback. Accessibility is the main concern of the design: ARIA labels and aria-live regions are set up to work with screen readers like NVDA, VoiceOver, and JAWS, and the camera preview is deliberately faded because it is only there for sighted people in the room. Underneath, the project uses Google's MediaPipe FaceMesh library, which finds 468 points on a face and runs as WebAssembly inside the browser, plus the browser's built-in Web Speech API for the voice. Lighting is checked by sampling pixel brightness on a small canvas every two seconds. The README explains the simple rules used for each check, such as comparing nose position to the centre of the frame, measuring the angle between the eyes for head tilt, and using the width of the face's bounding box as a rough distance signal. The target user is described as blind and low-vision freelancers joining calls with sighted clients, but the README notes it can also be a quick pre-call check for anyone. Browser support lists Chrome and Edge as recommended, Firefox as not recommended due to MediaPipe issues, and Safari as untested. Privacy is straightforward: no video is recorded or sent anywhere, and camera access only runs while the page is open.

Copy-paste prompts

Prompt 1
Open cam-guide-for-blind in Chrome and walk me through what each spoken hint means
Prompt 2
Add a French translation track for the spoken hints using the Web Speech API
Prompt 3
Swap MediaPipe FaceMesh for FaceLandmarker and measure the difference in head tilt accuracy
Prompt 4
Wire the lighting check to also raise an aria-live alert for screen reader users
Prompt 5
Bundle cam-guide-for-blind as a desktop app with Electron so it can sit in the system tray
Open on GitHub → Explain another repo

Generated 2026-05-22 · Model: sonnet-4-6 · Verify against the repo before relying on details.