reads face-on from any angle
RotoText
Sep – Oct 2026
TypeScriptMediaPipe
RotoText finds your face and irises in the webcam feed with MediaPipe, estimates where your eyes are in 3D from the iris size and midpoint, and projects the scene onto the screen from that point. Move your head and the text moves with you, as if it were behind the glass. It runs on desktop and phone cameras and drives a Line of Sight puzzle game built on the same projection.
eye position triangulated from MediaPipe iris landmarks, using iris size and midpoint
a projection from the viewer's eye position that creates depth and motion parallax as they move
desktop and phone camera modes, at 1280×720 and 640×480
what i built
- eye tracking on MediaPipe face and iris landmarks
- geometric projection from 3D eye position to the screen
- scene rendering for the 3D box and its targets
- a Line of Sight puzzle game on top of the projection
- device presets for desktop and phone cameras