Huaishu Peng on Blending the Digital and Physical Worlds

University of Maryland Assistant Professor of Computer Science Huaishu Peng focuses his research on bridging the gap between digital and physical interactions. His work in human-computer interaction (HCI) explores how devices such as small robots, wearable technologies and haptic interfaces can make computing more tangible and accessible.

In this Q&A, Peng discusses his path into computer science, his research directions and how his work contributes to sustainability and new ways of connecting humans and machines.

Was there a defining moment that shaped your career path into computer science?

A few things led me to computer science. I have a bachelor’s degree in the field, but my interest really began earlier, in middle and high school, when I spent a lot of time playing computer games. I thought it would be exciting to learn how to create those games myself, and that’s what first drew me toward programming.

As I progressed, my focus evolved. What I do now isn’t the traditional idea of computer science, like writing algorithms or building systems entirely within the digital world. My research extends beyond that into what we call human-computer interaction and human-robot interaction. It’s about exploring where the digital and physical worlds meet and how people can engage with computational systems in new ways.

Can you tell me a little about your research focus?

HCI is a broad, interdisciplinary field that draws on researchers from computer science, information studies and design. My particular focus is on creating new systems and devices that let people interact with computational materials in tangible ways.

For example, my group has developed small robots that can move on a person’s body, exploring what it means for robots to be wearable rather than humanoid. We also study realistic haptic feedback in virtual reality. While VR systems today offer high-resolution visuals, they often lack sensations like force or temperature. We look at how to simulate those feelings to make digital environments more immersive.

Broadly, I’m interested in what happens when computation extends beyond screens and into the physical world.

Can you tell me a little about your lab?

Many people think of computer science labs as rooms filled with computers and code. My lab, the Small Artifacts Lab, is different. It’s more like a workshop with large windows and fabrication tools. We have 3D printers, laser cutters, soldering stations and hand tools. Students and researchers use them to prototype physical devices, from wearable robots to interactive gloves.

It’s a hands-on space for building and testing ideas. We also conduct user studies, sometimes bringing in participants, including blind users, to evaluate the accessibility tools we create.

What are you currently working on, and what interests you most about these projects?

We’re pursuing several directions under one theme: enabling people to design, build, and interact with intelligent physical artifacts more easily. One research line explores how to lower the barriers for people without technical backgrounds to create computational objects, such as simple robots or devices that move or respond to touch.

Another direction examines new ways humans can interact with their environments, such as desktop robots that can move objects while responding to voice or gestures. We’re also studying how virtual and physical experiences can blend together, with haptic technologies that enhance both.

Finally, we are exploring sustainability. As creating physical artifacts becomes easier, we have to consider the waste this could generate. My lab studies how to reuse or recycle materials like printed circuit boards so that physical computing can grow in a more environmentally responsible way.

What are some challenges you’ve encountered in your research, and how have you approached them?

One challenge relates to the ease of creating physical artifacts. As fabrication tools become more accessible, it can lead to material waste. Just as it’s easy to write code today, it might soon become easy to “print” robots or devices, which could create environmental issues if not managed responsibly.

We’re addressing this by developing ways to make materials reusable or reconfigurable. For example, we’re exploring printed circuit boards that can be repurposed rather than discarded. The idea is to make building and rebuilding physical devices as easy as writing and revising software.

How does your work connect with or contribute to the broader computer science community and society?

One area of impact is accessibility. Many tools for blind users focus on consuming information through screen readers or audio feedback, but few help them create digital content. My group built a system called TangibleGrid, which lets blind users design websites by arranging blocks on a tactile grid. Each block represents a web element, and as they organize these pieces, the system translates their layout into a web interface. It turns website creation into a physical experience.

Another example is our collaboration with artists and performers. We’ve worked with dance faculty on a project where small robots move on dancers’ bodies during live performances. The audience can use their phones to vote on how the robots move, influencing the choreography in real time. It’s a way to explore how technology can enable new forms of expression and engagement.

What inspired you to join UMD’s Department of Computer Science, and what have you enjoyed most so far?

UMD has a strong reputation in HCI and the resources needed to pursue this interdisciplinary research. The university provides excellent lab space and opportunities for cross-departmental collaboration.

What I’ve enjoyed most is working with students. Both undergraduate and graduate students bring creativity and enthusiasm to the lab. Seeing them develop their ideas into tangible prototypes is one of the most rewarding parts of my work.

If you could give one piece of advice to students interested in your area of research, what would it be?

Be curious and persistent. Curiosity drives exploration and discovery. Persistence helps you overcome challenges. Be open to learning from different disciplines, and don’t be afraid to experiment. Many interesting discoveries occur when you view problems from new perspectives.

—Story by Samuel Malede Zewdu, CS Communications