Why Not Make Interfaces Better than 3D Reality? ______
University of Maryland
ome designers dream about building interfaces that approach the richness of 3D reality. They believe that the closer an interface resembles the real world, the easier the usage. They strive for resolution that matches ﬁlm—with rapid camera movement and lively animated objects. This is a dubious proposition since user studies show that disorienting navigation, complex user actions, and annoying occlusions can slow performance in the real world as well as 3D interfaces.1-3
Many constrained interfaces are designed to be simpler than the real world by restricting movement, limiting interface actions, and keeping interface objects in a plane. However, the strong utility of pure 3D interfaces for medical, architectural, product design, and scientific visualization means that interface design for pure 3D remains an important challenge.
An intriguing possibility is that enhanced 3D interfaces might offer simpler navigation, more compelling functionality, safer movements, and less occlusion, than 3D reality, especially for information exploration and visualization tasks. Such features can enable superhuman capabilities such as faster-than-light teleportation, ﬂying through objects, and x-ray vision. Enhanced 3D interfaces might have super-natural tools such as magic wands for instantly shrinking, enlarging, duplicating, or sending objects and enchanted environments that provide error prevention, history keeping, and programming-by-demonstration.
Playful game designers and creative application developers have already pushed the technology further than those who seek merely to mimic reality. Advanced designs are marked by their support of
This article reviews these clever enhanced 3D-design features and encourages approaches that facilitate user tasks rather than mimic reality.
For some computer-based tasks, pure 3D representations are clearly helpful and have become major industries: medical imagery, architectural drawing, computer-assisted design, and scientiﬁc simulations.
Designers of these successful applications start with the goals of meeting user needs for high resolution and maintaining faithfulness to reality. However, in these cases, the success is often due to design features that make the interface even better than reality. Users can change colors or shapes, group and ungroup components, send objects by email, and attach ﬂoating labels. Users can also carry out enhanced actions such as going back in time by undoing recent actions or playing animations in reverse. They can also collaborate with distant partners and use dynamic query sliders to support exploration.
Among the many innovations, there have been questionable 3D prototypes such as air-trafﬁc control systems that show altitude by perspective drawing, thereby only adding clutter to the plan view display.4 Other dubious 3D prototypes include digital libraries (showing books on shelves might be nice for browsing, but can inhibit searching and linking) and ﬁle directories (showing ﬁles as towers and trees as node-link diagrams can increase occlusion and navigation problems). Further questionable applications include ill-considered 3D features for situations in which simple 2D representations would do a better job. For example, adding a third dimension to bar charts might slow users and mislead them,5,6 but some users ﬁnd these so attractive that designers include them in most business graphics packages.
The controversy over 3D versus 2D interfaces is especially lively in information visualization circles. For scientiﬁc visualization, 3D is necessary because typical user tasks involve continuous variables (for example, temperature, density, pressure, velocity) and volumes, surfaces, inside and outside, left and right, and above and below. However, for information visualization, typical user tasks involve more categorical variables and the discovery of patterns, trends, clusters, outliers, and gaps. Users who analyze gene micro arrays, stock markets, or manufacturing quality control might work with hundreds of variables. Their preferred strategy is to explore relationships a few at a time through dynamic queries over coordinated 2D scattergrams with color and size coding, and occasionally using 3D (for example, Spotﬁre, DataDesk, SPSS/SigmaPlot, or SAS/GRAPH). To move past 3D, some users appreciate parallel coordinates, which map points in a multidimensional space into polylines across a 2D display.
The lessons from information visualization are that
12 November/December 2003 Published by the IEEE Computer Society 0272-1716/03/$17.00 © 2003 IEEE
Since navigation complexity is a key determinant of user success, it might be more important to ﬁght for two versus three clicks than to debate 2D versus 3D.
Another source of lessons are the intriguing, successful applications of 3D representations in game environments. These include first-person shooter games, such as Doom and Quake, in which users patrol city streets or race down castle corridors while shooting at opponents. Other successes are role-playing fantasy games with beautifully illustrated island havens or mountain strongholds—for example Myst, RealMyst, or Riven. Many games are socially enriched, letting users choose 3D avatars to represent themselves. Users can choose avatars that resemble themselves, but often the theatrical nature of these environments encourages them to pick bizarre characters or fantasy personas with desirable characteristics such as unusual strength or beauty.
Some Web-based 3D environments—such as ActiveWorlds (http://www.activeworlds.com)—involve millions of users and thousands of user-constructed worlds such as Yellowstone National Park, shopping malls, or urban neighborhoods (see Figure 1). Game devotees might spend dozens of hours per week immersed in their virtual worlds, chatting with collaborators or negotiating with opponents. Sony’s Everquest attracts users with this ambitious description: “Welcome to the world of EverQuest, a real 3D massively multi-player fantasy role-playing game. Prepare to enter an enormous virtual environment—an entire world with its own diverse species, economic systems, alliances, and politics.” Game consoles, such as Microsoft Xbox and Sony PlayStation 2, offer users the chance to play livelier 3D games—including NASCAR Thunder, Halo, or War of the Monsters.
Sims Online has 3D characters who live in a limited 3D home environment with social behaviors that users control; meanwhile There.com (http://www.there.com) emphasizes real people meeting to discuss substantive issues (see Figure 2). These environments might prove successful because of their increasingly rich social contexts based on spatial cognition. That is, users might come to appreciate the importance of the setting, and value participants who choose to stand close to them. Such environments might come to support effective business meetings (as promoters of Adobe’s Atmosphere, There.com, and Blaxxun envision), community discussion groups, and even contentious political forums. Atmosphere promoters invite users to “Imagine walking down the aisles of a virtual store and inspecting merchandise before you purchase it. Or imagine taking a virtual tour of the Great Pyramid of Giza, where you explore its internal corridors and view details down to the chisel marks on the stone.”
Three-dimensional art and entertainment experiences, often delivered by Web applications, provide another opportunity for innovative applications. Early 3D front ends for Windows offer rooms for shopping, games, Internet, and ofﬁce applications and will likely remain attractive to games, entertainment, and sports enthusiasts. Another recent product is Browse3D’s browser that provides a limited 3D Web browsing experience based on perspective. This product’s main beneﬁt is appropriate screen management of up to 16 Web pages. A skeptic might wonder if a 2D version would produce faster performance and better use of screen space.
A modest use of 3D techniques is to add highlights to 2D interfaces, such as buttons that appear raised or depressed, windows that overlap and leave shadows, or
3 Task Gallery from Microsoft enables users to perform Windows operations, although it restricts movement to in/out. Applications are on the sides, ﬂoor, and ceiling. (Courtesy of Microsoft Corporation.)
4 Win3D from Clockwise3d enables users to perform Windows operations, provides multiple rooms with planar movement, and permits teleportation among rooms. (Courtesy of ClockWise Technologies.)
icons that resemble real-world objects. Users might ﬁnd these interfaces enjoyable, recognizable, and memorable because they improve spatial memory use,8but they can also distract and confuse because of increased visual complexity. Users have not been enthusiastic about 3D malls and product demos, but they appreciate real estate walkthroughs. Attempts to build realistic devices—such as telephones, books, or CD players—produce pleasant smiles from ﬁrst-time users, but these designs have not caught on, probably because the compromises needed to produce 3D effects undermine usability.
Discussion of 3D design guidelines could lead to improved recommendations for interfaces that require pure 3D or for users who might beneﬁt from constrained or enhanced 3D experiences. Of course, these guidelines are just a starting point and they need reﬁnement and testing before designers can ensure that they improve the user experience. For the moment, this enumeration of features for effective 3D interfaces might serve as a checklist for designers, researchers, and educators:
Since enhanced 3D interfaces are such a rich topic, it seems likely that readers could easily add further guidelines.
Three-dimensional environments are greatly appreciated by some users and are helpful for some tasks. They have the potential for novel social, scientiﬁc, and commercial applications if designers go beyond the goal of mimicking 3D reality.
Enhanced 3D interfaces could be the key to finally making some kinds of 3D teleconferencing, collaboration, and teleoperation popular. Of course, this will require a good 3D interface design (pure, constrained, or enhanced) and more research on ﬁnding the payoffs beyond the entertaining features that appeal to first-time users.
Success will come to designers who provide compelling content, relevant features, appropriate entertainment, and novel social structures. Then by studying user performance and measuring satisfaction, they can polish their designs and reﬁne guidelines for others to follow.
This essay was stimulated by the invitation from Sandy Ressler to keynote the February 2002 Web3D conference. Ben Bederson, Andy Cockburn, Mary Czerwinski, Eric Dementhon, Jean-Daniel Fekete, Theresa-Marie Rhyne, George Robertson, Alistair Sutcliffe, Colin Ware, and anonymous reviewers provided thoughtful comments. A revised version of this essay will be included in the 4th edition of Designing the User Interface (Addison Wesley), to appear in April 2004.
Readers may contact Ben Shneiderman at Univ. of Maryland, Dept. of Computer Science, College Park, MD 20742; firstname.lastname@example.org.
Readers may contact Theresa-Marie Rhyne by email at email@example.com.
IEEE Computer Graphics and Applications