MIT builds a way for you to manipulate objects through a TV

inFORM is a dynamic shape display that was designed and built by MIT. Using a Kinect sensor, the display allows users to manipulate physical objects through a TV screen.

This is called a Dynamic Shape Display. MIT built it, and it uses a Kinect sensor. In one of its applications, instead of a user in real life manipulating something on a TV, it puts the user on a TV, manipulating something in real life. See for yourself