Skip to main content
Part of complete coverage on

Computer display that lets you touch the real world

STORY HIGHLIGHTS
  • The inFORM Dynamic Shape Display is a table that can render 3D content physically
  • Using a Kinect sensor, users can create a 3D likeness of their hands
  • The display can also be used as a controller

(CNN) -- Picture this scene: an iPad resting on a table with the familiar 2D image from a video call on the screen.

The flat display shows your caller's upper body, talking away. But below this their hands and arms reach up out of the tabletop into the physical world, gently lifting a small red ball off the table and passing it from one digitally-recreated hand to the other.

It can already happen.

It's the work of the inFORM Dynamic Shape Display: a tabletop covered in miniature white squares that rise up like towers, to turn digital content into physical objects. Used in conjunction with a 3D sensor, like Microsoft's Kinect, it can capture a person's physical appearance and reproduce it in tiny skyscraper-like "pixel" blocks -- on-the-fly, anywhere in the world.

Essentially it's very similar to those kind of pin toys that you might know from museum novelty stores
Daniel Leithinger, MIT

"Essentially it's very similar to those kind of pin toys that you might know from museum novelty stores," explains MIT's Daniel Leithinger, part of the Tangible Media Group behind the inFORM.

Similar -- yes -- just a lot more impressive.

Read: Apple buys 3D company that helped make Kinect

To add color to the block shapes, a projector on the ceiling beams down light, turning the towers psychedelic hues as Leithinger demonstrates the table's capabilities.

It also has a deeper purpose -- communicating an extra layer of information from the sender to the receiver on the other end: "When you move your hands, not only do you have the shape of the hands, but you also see the color, the texture of the hands," says Leithinger.

ATF test shows 3-D gun in action
Man uses 3-D printer to make duck's foot

Leithinger shows off a couple of the table's party tricks: sculpting a model car from the blocks, coloring it in, and video-chatting about it with a colleague -- allowing them both to get hands-on with the model, regardless of physical distance.

The display doubles as an active controller, allowing a user to interact with 3D menus constructed by the table by moving the little red ball.

Read: Report: Next iPhone could have curved screen

"It's not real 3D because we can only push up and down each one of these pins," says Leithinger. "We can't push them sideways or have any other control over them at the moment -- we usually call this affect '2.5D'"

A lot of comments we get are like: 'Oh, it's like a super power'
Daniel Leithinger, MIT

Even so, the inFORM's remarkable capabilities seem to given some users big ideas. "A lot of comments we get are like -- 'Oh, it's like a super power'," he laughs.

They say it feels like being X-Men nemesis Magneto, he explains -- suddenly having the power to manipulate the world at a distance, just with a wave of your hand.

For Leithinger, his ambitions are a little more down to earth.

"In the future, where we hope to get is something like, say, a phone that you could have in your pocket, and as you interact with things on the phone you can actually touch them."

It remains to be seen whether or not users will be excited about a smartphone that can poke them back. Leithinger, for one, has a good feeling about it.

ADVERTISEMENT
Part of complete coverage on
October 1, 2014 -- Updated 1148 GMT (1948 HKT)
Imagine if going through airport security was just a matter of walking past a stretch of wall.
September 26, 2014 -- Updated 1303 GMT (2103 HKT)
From spotting allergens to counting calories, technology can lend a smart hand in the kitchen.
September 19, 2014 -- Updated 1326 GMT (2126 HKT)
Meet the 'Flavour Conductor', a magical instrument that took 10,000 hours to build and can change the taste of your drink through the power of sound.
September 3, 2014 -- Updated 1609 GMT (0009 HKT)
Mogees is a technology that turns any object into a musical instrument, by converting the vibrations you make when you touch it into sound.
September 11, 2014 -- Updated 1306 GMT (2106 HKT)
Scientists are attempting to harness the power of a star by mirroring how the sun produces heat and light. CNN's Nick Glass reports.
September 5, 2014 -- Updated 1137 GMT (1937 HKT)
Neil Harbisson is the world's first legally recognized cyborg. He has an antenna implanted into his skull that gives him the ability to perceive color.
August 29, 2014 -- Updated 1618 GMT (0018 HKT)
Move over, hoverboard: new technologies promise to make everything float free through levitation.
August 22, 2014 -- Updated 1645 GMT (0045 HKT)
Getting a foothold on the property ladder can be a challenge, and the prospects for many of us have been battered by the global recession.
August 21, 2014 -- Updated 1237 GMT (2037 HKT)
It's like a chair that isn't there, but magically appears whenever you need it. It's called the Chairless Chair. Find out how it works.
August 8, 2014 -- Updated 0939 GMT (1739 HKT)
Engineer Alan Bond has been developing a new concept for space travel for over 30 years -- and his creation is now on the verge of lift off.
July 25, 2014 -- Updated 1210 GMT (2010 HKT)
Crumbling buildings, burnt-out PCs, and cracked screens -- a new generation of "self-healing" technologies could soon consign them to history.
June 24, 2014 -- Updated 0909 GMT (1709 HKT)
Discover a dancing cactus field, basketball on the Hudson River, and mind-bending 3D projections on robotic screens.
May 23, 2014 -- Updated 1707 GMT (0107 HKT)
Would you live there? Design student Peter Trimble says it's actually a surprisingly good idea.
May 14, 2014 -- Updated 1450 GMT (2250 HKT)
Alpha Sphere
Singing Tesla coils, musical ice cream, vegetables on drums... and this ball? Find out how "hackers" have created a new generation of instruments.
May 28, 2014 -- Updated 1643 GMT (0043 HKT)
Technology has long learned from nature, but now it's going micro. "Cellular biomimicry" sees designers take inspiration from plant and animal cells.
April 9, 2014 -- Updated 1708 GMT (0108 HKT)
Forget wearable tech, embeddable implants are here. Learn more about the pioneers who are implanting devices into their bodies.
May 7, 2014 -- Updated 1026 GMT (1826 HKT)
A visitor of the 'NEXT Berlin' conference tries out Google Glass, a wearable computer that responds to voice commands and displays information before your eyes. It is expected to go to market in late 2013.
We know how wearable tech can enhance our fitness lives but there's evidence that its most significant application is yet to come: the workplace.
April 10, 2014 -- Updated 0813 GMT (1613 HKT)
Samsung's research unit announces new way to synthesize graphene, potentially opening the door to commercial production.
March 31, 2014 -- Updated 1215 GMT (2015 HKT)
iRobot, creators of vacuuming robot Roomba reveal how they learned from secret experiments -- in space travel, minefields, and toys.
March 28, 2014 -- Updated 1623 GMT (0023 HKT)
A light-bulb glowing in middle of a room with no wires attached. "It's the future," says Dr Katie Hall.
March 3, 2014 -- Updated 1626 GMT (0026 HKT)
Knee replacements that encourage cells to regrow could soon be manufactured -- by spiders. Find out how.
February 14, 2014 -- Updated 1403 GMT (2203 HKT)
Meet Chuck Hull: the humble American engineer who changed the world of manufacturing.
February 6, 2014 -- Updated 1448 GMT (2248 HKT)
The key to self-knowledge? Or just the return of the phony "mood ring"? Check out our top mood-sensing technology in development.
ADVERTISEMENT