NYT

My Life in a Video Game (Batteries Not Included)

Alexander Möhnle

Article Tools Sponsored By

By PETER WAYNER

Published: April 9, 2008

FOR his doctoral thesis, Rafael Ballagas worked with other students to build a magic wand that gave tours of Regensburg, Germany. Tourists could wander around the city, wave the wand to “cast a spell” and hear a voice tell them the history of where they were standing.

It sounds like magic, but the truth is a bit more mundane. The wand is just a cellphone, said Mr. Ballagas. “It’s packaged in a shell. It’s got a skin,” he explained.

The cellphone keeps track of tourists’ locations and notifies them when they get near a noteworthy part of Regensburg. When the tourists finish touring, the cellphone recalls their trip with information about every stop along their path. No one needs to take notes because the wand does it for them.

Computer designers are working feverishly to develop more of this kind of magic by embedding the latest generation of chips in new places and giving them new powers to animate the world. The goal is computers that are practically invisible to people and more fully integrated into their lives.

Mr. Ballagas’s project is a step along the way; perhaps that is why Nokia hired him to work in its Palo Alto, Calif., research lab. But in the future, computer chips will be finding homes in even odder places than magic wands.

Imagine an umbrella with a cellphone embedded in the handle. It could dial up the weather forecast for the day and the handle could glow green if the outlook was fair. But if a storm was coming it could start to flash red at a pace based on the probability of rain. A platform like this opens up new business models and opportunities for advertising.

The umbrella might be free — if you’re willing to listen to it whisper advertising offers in your ear: “Psst. You know that raspberry-pimento-vanilla coffee you like? The store you’re about to pass just took a fresh batch out of the roaster 12 minutes and 34 seconds ago. Oops. 35 seconds.”

Leah Buechley is a postdoctoral researcher in the Craft Technology Group at the University of Colorado at Boulder, which studies software applications in traditional handicrafts. She is selling the LilyPad Arduino, a small flower-shaped disk with a computer chip at the center, which can be sewn into clothes. Sensors like accelerometers, for measuring acceleration or detecting and measuring vibrations, and light detectors are attached with wires to the “petals,” so the chip can track the wearer’s motion.

The main board costs $19.95 and add-ons cost from $7.95 for a tricolor L.E.D. to $24.95 for an accelerometer (sparkfun.com).

Dr. Buechley says the boards can be worn as soft computers “in a noninvasive, non-weight-bearing way.” One dancer used a leotard covered with sensors to control a player piano with her movements. There was no need to pay a pianist to stay in sync.

While there are many opportunities for fun, Dr. Buechley said the real market could be devices to help the elderly. She is exploring how to knit clothes that monitor a person’s heart rate, breathing and joint movement.

At the Intel Corporation’s Digital Health Group, Eric Dishman, director of product research and innovation, said he saw many opportunities for making embedded computers that could help people. His group is focusing on preventing falls, social health and cognitive assistance.

“People with Alzheimer’s stop answering the front door or answering the phone,” he said. “It’s really embarrassing not to know the difference between a stranger or a spouse at the front door.”

So Intel built a phone with “caller ID on steroids.” When someone rings, the phone flashes “a picture of the person and a little sentence about the last thing you talked about.” This is often enough to start a conversation and keep people connected to their families and friends.

His group is also using embedded sensors like those marketed by Dr. Buechley to track the movement of patients to prevent falls. They have put the sensors in both the clothes of the user and the carpet where the person walks. “Think Dance Dance Revolution for elders,” he said, referring to the video game in which players move to music on a dance pad. The hidden computer would watch the length of the stride and the pace of the walk for any aberrations that would indicate a problem. It would then warn the person and perhaps even call for help.