The proposal
The idea
The result is a blind spot on both sides. Patients lose motivation with zero feedback, do movements wrong without knowing it, or quietly drop the program. Physios adjust prescriptions on guesswork instead of data. And the obvious fixes - video calls, wearables, filming yourself - are either impractical, expensive, or a privacy problem nobody wants.
A phone camera is the one sensor every patient already has. On-device pose estimation can turn it into a measurement tool: joint angles, rep counts, movement replay - without a single image ever leaving the device.
Goals
- A patient mobile flow: today's session from a prescribed program, live camera exercise with rep counting and angle measurement, end-of-session summary
- On-device pose estimation (MediaPipe/BlazePose or equivalent) feeding a deterministic, physio-readable scoring layer - angle thresholds per exercise, no black-box ML in the scoring
- A skeleton replay of each set: the movement as a time series of body points, scrubbable, no video stored
- An exercise library specced in a uniform format (pilot angle, movement direction, thresholds, default dose) that a physio can extend without code changes
