Dexterous manipulation data

Training datafor robot hands.

We put an instrumented glove on people who already have the skill and record what their hands do. Teams training manipulation policies license the result — at a fraction of what teleoperation costs.

Working prototype · recording with our first design partners

Illustrative trace
18
channels
60 Hz
sample rate
±1.5°
angular accuracy
$300
cost to build

The proof

One take, two views, same frame.

Left: the glove on a hand. Right: what the software reconstructed from its channels at that instant, thumb included. Both recordings come from one session, aligned by cross-correlating motion — nothing is re-enacted.

GloveReconstruction
Unedited · single session60 Hz live stream

On a robot hand

The same joint angles, on a Unitree Dex5-1.

Recorded angles retargeted onto Unitree’s five-finger hand in simulation: the hand closes, the robot hand closes. The glove drives the fingers and the hand’s orientation; position comes from the keyboard, because potentiometers measure joints, not where your arm is.

In simulation · nothing sped upPosition from the keyboard — the wrist tracker is the next revision
What it records, and what it misses →

Where this goes

Skills that were never written down.

A joiner knows how much pressure a chisel takes before the grain tears. None of that lives in a video dataset, because none of it is visible — it lives in the hand. Putting gloves on experts while they work is what we are building towards, and the domains below are where we want to start.

The glove worn on a hand driving a screwdriver into a device: rotary potentiometers at the finger joints and thumb linkage, with the wrist-mounted board behind
The recording is a by-product of the job getting done
  • Joinery
  • Watchmaking
  • Leatherwork
  • Kitchen work
  • Your domain

None of these are captured at volume today. They are where the glove goes once it is cheap enough to hand to a hundred people, which is the whole reason it is built the way it is.

Who is building this

Łukasz Sojka, Co-founder of Grasp
The hardest part of teaching a robot to work with its hands was never the model. It is that almost nobody has recorded enough real hands doing real work the rigs that can do it cost more than the robots. We built ours cheap enough to put on a hundred people instead of one, and we are recording the first sessions now.
Łukasz SojkaCo-founder

with Dmytro Nalyvaiko, co-founder

Access

Tell us what to record.

Name the task and we come back with what it would take to record it: which expert, how many hours, and what the first batch looks like. Craftsmen willing to be recorded are equally welcome — you are the other half of this.

No newsletter. We only write when there's data to share.