Pinch

Your Hands, Their Robot

A real-time hand-tracking relay that streams all 25 joints of each hand from Snap Spectacles to any browser - and lets a stuck robot post a bounty for a human to come help.

A hand-tracking skeleton and a robot hand joined at the fingertips by a dotted orange line
Domain
AI & Robotics
Stack
WebXR, Cloudflare Workers, Next.js, Hedera

01Robots still get stuck

Robots are great until they hit something they weren't trained for, and then someone has to walk over and help. Teaching them by hand usually means motion-capture labs and expensive rigs - not something you can do from a pair of glasses.

A small wheeled robot stuck against a box with an orange alert light

02How this works (no server on your Mac)

You open the AR page on Spectacles, tap anywhere and grant hand tracking. Every frame - 25 joints per hand, position and rotation - goes over a WebSocket to a Cloudflare Worker, which instantly broadcasts it to anyone watching, the robot included. Nothing is stored. When a robot gets stuck, it posts a bounty. A human verified with World ID claims it, shows up, and gets paid in crypto once the robot is freed.

Glasses streaming to a cloud that fans out to a robot arm and two browsers

03Robots shouldn't rescue robots

A bounty anyone can claim is the easiest thing to build, and the easiest thing to game - another robot could claim it, and now a robot is "helping" a robot. The whole point is that a human steps in when a robot gets stuck. So I connected World ID: before you can claim a bounty, you prove you're a real, unique human. It adds a step before every claim, and anyone without World ID can't take part.

An open door full of robots next to a door ringed in orange with one person in it

04The thumb is different

The WebXR thumb has no intermediate bone, so it reports 4 joints instead of 5. Pinch keeps all 25 joints in one fixed order and marks any untracked joint as null, so whatever's listening never has to guess which finger it's looking at.

A hand skeleton of joint dots with the thumb's missing joint as a hollow orange circle
new york--.----------:-- --