in a nutshell: we capture live ultrasound images of the forearm of a human subject using a standard ultrasound medical device, just like the ones used in hospitals; features of the images are associated to hand joint positions and forces; subsequently, positions and forces are predicted using the images. the prediction actuates a 3D hand model on the screen, which then replicates the intended hand motion / force.
you are required to push this system to the limit:
the third point is of special interest: so far our machine only predicts forces for a single degree of freedom, but we'd like to be able to predict multiple, simultaneous force applications (e.g., flexing theindex and the little finger at the same time). tests on healthy subjects will be performed as we go about; test on amputees or pain patients are possible.